{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T15:27:48Z","timestamp":1761060468483,"version":"3.41.0"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T00:00:00Z","timestamp":1512518400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CMMI 14-62693 and IIS 15-30818"],"award-info":[{"award-number":["CMMI 14-62693 and IIS 15-30818"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2017,12,6]]},"abstract":"<jats:p>Design instructors are integrating the use of online peer review platforms to keep pace with growing class sizes. However, these platforms typically prioritize randomized peer assignment strategies and show only the current solution to peers when writing feedback. This can result in low quality feedback in project-based design courses. We report on an experiment in which students (N=59) worked on twelve-week design projects and both wrote and received online feedback at four stages. The experiment tested a novel assignment strategy of peer mentorship, where peers were assigned to give feedback to all stages of the same project, and tested showing the context from the preceding design stage when composing feedback. The results showed that displaying the context from the preceding design stage led to feedback with higher perceived quality at the late design stages (but not at earlier stages) and feedback from mentors prompts longer responses from the feedback recipients. Our work contributes deeper empirical understanding of how assignment strategies and showing additional context affects peer feedback and provides practical guidelines for instructors to implement these methods in design courses.<\/jats:p>","DOI":"10.1145\/3134698","type":"journal-article","created":{"date-parts":[[2017,12,6]],"date-time":"2017-12-06T21:23:15Z","timestamp":1512595395000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Increasing Quality and Involvement in Online Peer Feedback Exchange"],"prefix":"10.1145","volume":"1","author":[{"given":"Sneha R.","family":"Krishna Kumaran","sequence":"first","affiliation":[{"name":"University of Illinois Urbana Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Deana C.","family":"McDonagh","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian P.","family":"Bailey","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,12,6]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Akers and Christine Sharon Sellers","author":"Ronald","year":"2009","unstructured":"Ronald L. Akers and Christine Sharon Sellers . 2009 . Criminological theories : introduction, evaluation, and application. Oxford University Press , New York. Ronald L. Akers and Christine Sharon Sellers. 2009. Criminological theories : introduction, evaluation, and application. Oxford University Press, New York."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1525-1497.2005.0162.x"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/1050651907311923"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145355"},{"key":"e_1_2_1_5_1","article-title":"Social bond theory and binge drinking among college students: A multivariate analysis","volume":"33","author":"Durkin Keith K.","year":"1999","unstructured":"Keith K. Durkin , Timothy W. Wolfe , and Gregory Clark . 1999 . Social bond theory and binge drinking among college students: A multivariate analysis . College Student Journal 33 , 3 (1999). Keith K. Durkin, Timothy W. Wolfe, and Gregory Clark. 1999. Social bond theory and binge drinking among college students: A multivariate analysis. College Student Journal 33, 3 (1999).","journal-title":"College Student Journal"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1533-8525.1989.tb01532.x"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.17239\/jowr-2012.04.02.1"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3102\/003465430298487"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.0266-4909.2003.00051.x"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858195"},{"volume-title":"Causes of delinquency","author":"Hirschi Travis","key":"e_1_2_1_11_1","unstructured":"Travis Hirschi . 1969. Causes of delinquency . University of California Press , Berkeley. Travis Hirschi. 1969. Causes of delinquency. University of California Press, Berkeley."},{"key":"e_1_2_1_12_1","volume-title":"Third AAAI Conference on Human Computation and Crowdsourcing. 72--82","author":"Hui Julie","year":"2015","unstructured":"Julie Hui , Amos Glenn , Rachel Jue , Elizabeth Gerber , and Steven Dow . 2015 . Using anonymity and communal efforts to improve quality of crowdsourced feedback . In Third AAAI Conference on Human Computation and Crowdsourcing. 72--82 . Julie Hui, Amos Glenn, Rachel Jue, Elizabeth Gerber, and Steven Dow. 2015. Using anonymity and communal efforts to improve quality of crowdsourced feedback. In Third AAAI Conference on Human Computation and Crowdsourcing. 72--82."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2598510.2598538"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508865.1508972"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026011"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/344452.344454"},{"key":"e_1_2_1_17_1","first-page":"421","article-title":"The college classroom: Some observations on the meanings of student participation","volume":"60","author":"Karp David A.","year":"1976","unstructured":"David A. Karp and William C. Yoels . 1976 . The college classroom: Some observations on the meanings of student participation . Sociology Social Research 60 , 4 (1976), 421 -- 439 . David A. Karp and William C. Yoels. 1976. The college classroom: Some observations on the meanings of student participation. Sociology Social Research 60, 4 (1976), 421--439.","journal-title":"Sociology Social Research"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025883"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675166"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505057"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724670"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_23_1","first-page":"100","article-title":"A Comparison of Anonymous Versus Identifiable e-Peer Review on College Student Writing Performance and the Extent of Critical Feedback","volume":"6","author":"Lu Ruiling","year":"2007","unstructured":"Ruiling Lu and Linda Bol . 2007 . A Comparison of Anonymous Versus Identifiable e-Peer Review on College Student Writing Performance and the Extent of Critical Feedback . Journal of Interactive Online Learning 6 , 2 (2007), 100 -- 115 . Ruiling Lu and Linda Bol. 2007. A Comparison of Anonymous Versus Identifiable e-Peer Review on College Student Writing Performance and the Extent of Critical Feedback. Journal of Interactive Online Learning 6, 2 (2007), 100--115.","journal-title":"Journal of Interactive Online Learning"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675283"},{"key":"e_1_2_1_25_1","volume-title":"Daly","author":"McCroskey James C.","year":"1984","unstructured":"James C. McCroskey and John A . Daly . 1984 . Avoiding communication : shyness, reticence, and communication apprehension \/ John A. Daly, James C. McCroskey, editors. Sage Publications, Beverly Hills . http:\/\/www.loc.gov\/catdir\/ enhancements\/fy0658\/83027242-t.html James C. McCroskey and John A. Daly. 1984. Avoiding communication : shyness, reticence, and communication apprehension \/ John A. Daly, James C. McCroskey, editors. Sage Publications, Beverly Hills. http:\/\/www.loc.gov\/catdir\/ enhancements\/fy0658\/83027242-t.html"},{"key":"e_1_2_1_26_1","volume-title":"Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education.","author":"Mulder Raoul A","year":"2007","unstructured":"Raoul A Mulder and Jon M Pearce . 2007 . PRAZE: Innovating teaching through online peer review . In Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education. Raoul A Mulder and Jon M Pearce. 2007. PRAZE: Innovating teaching through online peer review. In Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-005-5046-6"},{"key":"e_1_2_1_28_1","volume-title":"Tuned Models of Peer Assessment in MOOCs. In International Conference on Educational Data Mining.","author":"Piech Chris","year":"2013","unstructured":"Chris Piech , Jonathan Huang , Zhenghao Chen , Chuong Do , Andrew Ng , and Daphne Koller . 2013 . Tuned Models of Peer Assessment in MOOCs. In International Conference on Educational Data Mining. Chris Piech, Jonathan Huang, Zhenghao Chen, Chuong Do, Andrew Ng, and Daphne Koller. 2013. Tuned Models of Peer Assessment in MOOCs. In International Conference on Educational Data Mining."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00117714"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2015.10.006"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2876043"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1108\/03090560410560254"},{"key":"e_1_2_1_33_1","first-page":"66","article-title":"An analysis of calibrated peer review (CPR) in a science lecture classroom","volume":"37","author":"Walvoord Mark E.","year":"2008","unstructured":"Mark E. Walvoord , Marielle H. Hoefnagels , Douglas D. Gaffin , Matthew M. Chumchal , and David A. Long . 2008 . An analysis of calibrated peer review (CPR) in a science lecture classroom . Journal of College Science Teaching 37 , 4 (2008), 66 -- 73 . Mark E. Walvoord, Marielle H. Hoefnagels, Douglas D. Gaffin, Matthew M. Chumchal, and David A. Long. 2008. An analysis of calibrated peer review (CPR) in a science lecture classroom. Journal of College Science Teaching 37, 4 (2008), 66--73.","journal-title":"Journal of College Science Teaching"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025477"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1353\/jhe.2005.0038"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531604"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675140"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2901790.2901820"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819953"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3134698","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3134698","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3134698","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:24Z","timestamp":1750212684000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3134698"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,6]]},"references-count":39,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2017,12,6]]}},"alternative-id":["10.1145\/3134698"],"URL":"https:\/\/doi.org\/10.1145\/3134698","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2017,12,6]]},"assertion":[{"value":"2017-12-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}