{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:30:20Z","timestamp":1776094220662,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":55,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445507","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T02:23:48Z","timestamp":1620440628000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Ask Me or Tell Me? Enhancing the Effectiveness of Crowdsourced Design Feedback"],"prefix":"10.1145","author":[{"given":"Fritz","family":"Lekschas","sequence":"first","affiliation":[{"name":"School of Engineering Harvard University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Spyridon","family":"Ampanavos","sequence":"additional","affiliation":[{"name":"Graduate School of Design Harvard University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pao","family":"Siangliulue","sequence":"additional","affiliation":[{"name":"B12, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanspeter","family":"Pfister","sequence":"additional","affiliation":[{"name":"Visual Computing Group Harvard University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krzysztof Z.","family":"Gajos","sequence":"additional","affiliation":[{"name":"School of Engineering and Applied Sciences Harvard University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Bad is stronger than good. Review of general psychology 5, 4","author":"Baumeister F","year":"2001","unstructured":"Roy\u00a0 F Baumeister , Ellen Bratslavsky , Catrin Finkenauer , and Kathleen\u00a0 D Vohs . 2001. Bad is stronger than good. Review of general psychology 5, 4 ( 2001 ), 323\u2013370. Roy\u00a0F Baumeister, Ellen Bratslavsky, Catrin Finkenauer, and Kathleen\u00a0D Vohs. 2001. Bad is stronger than good. Review of general psychology 5, 4 (2001), 323\u2013370."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598598"},{"key":"e_1_3_2_2_3_1","volume-title":"A facilitative versus directive approach in training clinical skills? Investigating students","author":"Berghmans Inneke","year":"2012","unstructured":"Inneke Berghmans , Nathalie Druine , Filip Dochy , and Katrien Struyven . 2012. A facilitative versus directive approach in training clinical skills? Investigating students \u2019 clinical performance and perceptions. Perspectives on medical education 1, 3 ( 2012 ), 104\u2013118. Inneke Berghmans, Nathalie Druine, Filip Dochy, and Katrien Struyven. 2012. A facilitative versus directive approach in training clinical skills? Investigating students\u2019 clinical performance and perceptions. Perspectives on medical education 1, 3 (2012), 104\u2013118."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1093\/elt\/ccm076"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557065"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/10862968209547445"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1123\/tsp.20.2.184"},{"key":"e_1_3_2_2_8_1","first-page":"210","article-title":"Did you ask a good question today? Alternative cognitive and metacognitive strategies","volume":"42","author":"Ciardiello V","year":"1998","unstructured":"Angelo\u00a0 V Ciardiello . 1998 . Did you ask a good question today? Alternative cognitive and metacognitive strategies . Journal of Adolescent & Adult Literacy 42 , 3 (1998), 210 \u2013 219 . Angelo\u00a0V Ciardiello. 1998. Did you ask a good question today? Alternative cognitive and metacognitive strategies. Journal of Adolescent & Adult Literacy 42, 3 (1998), 210\u2013219.","journal-title":"Journal of Adolescent & Adult Literacy"},{"key":"e_1_3_2_2_9_1","volume-title":"Statistical Power Analysis for the Behavioral Sciences (3 ed.)","author":"Cohen Jacob","unstructured":"Jacob Cohen . 1988. Statistical Power Analysis for the Behavioral Sciences (3 ed.) . Lawrence Erlbaum Associates , Hillsdale, NJ, USA . Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences (3 ed.). Lawrence Erlbaum Associates, Hillsdale, NJ, USA."},{"key":"e_1_3_2_2_10_1","volume-title":"Discussing Design: Improving Communication and Collaboration Through Critique. O\u2019Reilly","author":"Connor Adam","year":"2015","unstructured":"Adam Connor and Aaron Irizarry . 2015 . Discussing Design: Improving Communication and Collaboration Through Critique. O\u2019Reilly , Sebastopol, CA, USA . Adam Connor and Aaron Irizarry. 2015. Discussing Design: Improving Communication and Collaboration Through Critique. O\u2019Reilly, Sebastopol, CA, USA."},{"key":"e_1_3_2_2_11_1","unstructured":"Corel. 2020. Gravit Designer. https:\/\/designer.io. Accessed: 2020-02-16.  Corel. 2020. Gravit Designer. https:\/\/designer.io. Accessed: 2020-02-16."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059454.3059476"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Deanna Dannels Amy\u00a0Housley Gaffney and Kelly\u00a0Norris Martin. 2008. Beyond Content Deeper than Delivery: What Critique Feedback Reveals about Communication Expectations in Design Education.International Journal for the Scholarship of teaching and Learning 2 2(2008) n2.  Deanna Dannels Amy\u00a0Housley Gaffney and Kelly\u00a0Norris Martin. 2008. Beyond Content Deeper than Delivery: What Critique Feedback Reveals about Communication Expectations in Design Education.International Journal for the Scholarship of teaching and Learning 2 2(2008) n2.","DOI":"10.20429\/ijsotl.2008.020212"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/1050651907311923"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979359"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134680"},{"key":"e_1_3_2_2_17_1","unstructured":"Google. 2020. Google Drawings. https:\/\/docs.google.com\/drawings. Accessed: 2020-02-16.  Google. 2020. Google Drawings. https:\/\/docs.google.com\/drawings. Accessed: 2020-02-16."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2757226.2757249"},{"key":"e_1_3_2_2_19_1","unstructured":"Thomas Grill. 2017. Python implementation of Krippendorff\u2019s alpha. https:\/\/github.com\/grrrr\/krippendorff-alpha\/. Accessed: 2020-02-16.  Thomas Grill. 2017. Python implementation of Krippendorff\u2019s alpha. https:\/\/github.com\/grrrr\/krippendorff-alpha\/. Accessed: 2020-02-16."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.3102\/003465430298487"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858195"},{"key":"e_1_3_2_2_22_1","volume-title":"VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text. In Eighth International AAAI Conference on Weblogs and Social Media(ICWSM \u201914)","author":"Hutto J","year":"2014","unstructured":"Clayton\u00a0 J Hutto and Eric Gilbert . 2014 . VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text. In Eighth International AAAI Conference on Weblogs and Social Media(ICWSM \u201914) . AAAI, Menlo Park, CA, USA. Clayton\u00a0J Hutto and Eric Gilbert. 2014. VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text. In Eighth International AAAI Conference on Weblogs and Social Media(ICWSM \u201914). AAAI, Menlo Park, CA, USA."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174180"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.3102\/00028312027004664"},{"key":"e_1_3_2_2_25_1","volume-title":"Facilitating elaborative learning through guided student-generated questioning. Educational psychologist 27, 1","author":"King Alison","year":"1992","unstructured":"Alison King . 1992. Facilitating elaborative learning through guided student-generated questioning. Educational psychologist 27, 1 ( 1992 ), 111\u2013126. Alison King. 1992. Facilitating elaborative learning through guided student-generated questioning. Educational psychologist 27, 1 (1992), 111\u2013126."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15328023top2201_5"},{"key":"e_1_3_2_2_27_1","volume-title":"Rhetorical Traditions and the Teaching of Writing. Boynton\/Cook Publishers","author":"Knoblauch H","unstructured":"Cyril\u00a0 H Knoblauch and Lil Brannon . 1984. Rhetorical Traditions and the Teaching of Writing. Boynton\/Cook Publishers , Upper Montclair, NJ, USA . Cyril\u00a0H Knoblauch and Lil Brannon. 1984. Rhetorical Traditions and the Teaching of Writing. Boynton\/Cook Publishers, Upper Montclair, NJ, USA."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025883"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556420.2556788"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675283"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531651"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173629"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998319"},{"key":"e_1_3_2_2_34_1","unstructured":"Myle Ott. 2020. Unique Turker. https:\/\/uniqueturker.myleott.com. Accessed: 2020-02-16.  Myle Ott. 2020. Unique Turker. https:\/\/uniqueturker.myleott.com. Accessed: 2020-02-16."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702470"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00117714"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-006-9039-x"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-008-9124-4"},{"key":"e_1_3_2_2_39_1","volume-title":"The Reflective Practitioner: How professionals think in action. Vol.\u00a05126","author":"Sch\u00f6n A","unstructured":"Donald\u00a0 A Sch\u00f6n . 1984. The Reflective Practitioner: How professionals think in action. Vol.\u00a05126 . Basic Books , New York, NY, USA . Donald\u00a0A Sch\u00f6n. 1984. The Reflective Practitioner: How professionals think in action. Vol.\u00a05126. Basic Books, New York, NY, USA."},{"key":"e_1_3_2_2_40_1","volume-title":"The design studio: An exploration of its traditions and potentials","author":"Sch\u00f6n A","unstructured":"Donald\u00a0 A Sch\u00f6n . 1985. The design studio: An exploration of its traditions and potentials . RIBA Publications for RIBA Building Industry Trust , London, UK . 99 pages. Donald\u00a0A Sch\u00f6n. 1985. The design studio: An exploration of its traditions and potentials. RIBA Publications for RIBA Building Industry Trust, London, UK. 99 pages."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675239"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2757226.2757230"},{"key":"e_1_3_2_2_43_1","volume-title":"Best practice strategies for effective use of questions as a teaching tool. American journal of pharmaceutical education 77, 7","author":"Tofade Toyin","year":"2013","unstructured":"Toyin Tofade , Jamie Elsner , and Stuart\u00a0 T Haines . 2013. Best practice strategies for effective use of questions as a teaching tool. American journal of pharmaceutical education 77, 7 ( 2013 ), 155. Toyin Tofade, Jamie Elsner, and Stuart\u00a0T Haines. 2013. Best practice strategies for effective use of questions as a teaching tool. American journal of pharmaceutical education 77, 7 (2013), 155."},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124960"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0142-694X(99)00002-2"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207709"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978963"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059454.3059458"},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274455"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145252"},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531604"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675140"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901820"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059454.3059468"},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819953"}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445507","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445507","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:48Z","timestamp":1750195728000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445507"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":55,"alternative-id":["10.1145\/3411764.3445507","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445507","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}