{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T11:24:15Z","timestamp":1783337055937,"version":"3.54.6"},"reference-count":62,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2018,9,6]],"date-time":"2018-09-06T00:00:00Z","timestamp":1536192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2018,9,30]]},"abstract":"<jats:p>\n            In computer science, students could benefit from exposure to critical programming concepts from multiple perspectives. Peer review is one method to allow students to experience authentic uses of the concepts in an activity that is not itself programming. In this work, we examine how to implement the peer review process in early, object-oriented computer science courses as a way to increase the students\u2019 knowledge of programming concepts, specifically Abstraction, Decomposition, and Encapsulation, and to develop their higher-level thinking skills. We are exploring the peer review process, the effects of the type of review\n            <jats:italic>on the reviewers<\/jats:italic>\n            , and the results this has on the students\u2019 learning.\n          <\/jats:p>\n          <jats:p>To study these ideas, we used peer review activities in CS2 classes at two universities over the course of a semester. Using three groups (one reviewing their peers, one reviewing the instructor, and one completing small design or coding assignments), we measured the students\u2019 conceptual understanding throughout the semester with concept maps and the reviews they completed. We found that reviewing helped students learn Decomposition, especially those reviewing the instructor's programs, but we did not find that it improved the students\u2019 level of thinking. Overall, reviews (peer or otherwise) are beneficial for teaching Decomposition to CS2 students and can be used as an alternative method for teaching other object-oriented programming concepts.<\/jats:p>","DOI":"10.1145\/3152715","type":"journal-article","created":{"date-parts":[[2018,9,6]],"date-time":"2018-09-06T12:10:50Z","timestamp":1536235850000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Peer Review in CS2"],"prefix":"10.1145","volume":"18","author":[{"given":"Scott Alexander","family":"Turner","sequence":"first","affiliation":[{"name":"University of Wisconsin\u2014Stout, Menomonie, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manuel A.","family":"P\u00e9rez-Qui\u00f1ones","sequence":"additional","affiliation":[{"name":"University of North Carolina at Charlotte, Charlotte, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen H.","family":"Edwards","sequence":"additional","affiliation":[{"name":"Virginia Tech, Blacksburg, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,9,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/961511.961639"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1047344.1047492"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1029533.1029543"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/343048.343090"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1080\/00098650309602004"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543070003287"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/713611428"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508865.1508972"},{"key":"e_1_2_1_9_1","first-page":"148","article-title":"Using peer review as a vehicle for communication skill development and active learning","volume":"21","author":"Anewalt K.","year":"2005","unstructured":"K. Anewalt . 2005 . Using peer review as a vehicle for communication skill development and active learning . J. Comput. Small Coll. 21 , 2 (2005), 148 -- 155 . K. Anewalt. 2005. Using peer review as a vehicle for communication skill development and active learning. J. Comput. Small Coll. 21, 2 (2005), 148--155.","journal-title":"J. Comput. Small Coll."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/800100.803247"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1067445.1067468"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"A. J. Cox and W. F. Junkin. 2002. III Enhanced student learning in the introductory physics laboratory. Phys. Educ. 1 37 (2002).  A. J. Cox and W. F. Junkin. 2002. III Enhanced student learning in the introductory physics laboratory. Phys. Educ. 1 37 (2002).","DOI":"10.1088\/0031-9120\/37\/1\/305"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/00219266.2008.9656133"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.iheduc.2008.06.005"},{"key":"e_1_2_1_15_1","first-page":"214","article-title":"Effect of interface style in peer review comments for UML designs. Consort Comput Sci","volume":"22","author":"Turner S. A.","year":"2007","unstructured":"S. A. Turner , M. A. P\u00e9rez-Qui\u00f1ones , and S. H. Edwards . 2007 . Effect of interface style in peer review comments for UML designs. Consort Comput Sci . Coll. 22 , 3 (2007), 214 -- 220 . S. A. Turner, M. A. P\u00e9rez-Qui\u00f1ones, and S. H. Edwards. 2007. Effect of interface style in peer review comments for UML designs. Consort Comput Sci. Coll. 22, 3 (2007), 214--220.","journal-title":"Coll."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543068003249"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1007996.1008030"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)1052-3928(2008)134:4(346)"},{"key":"e_1_2_1_19_1","article-title":"Alternatives to instructor assessment: A case study of comparing self and peer assessment with instructor assessment under a networked innovative assessment procedures","volume":"29","author":"Liu E. Z. F.","year":"2002","unstructured":"E. Z. F. Liu , S. S. J. Lin , and S. M. Yuan . 2002 . Alternatives to instructor assessment: A case study of comparing self and peer assessment with instructor assessment under a networked innovative assessment procedures . Int. J. Instruct. Med. 29 , 4 (2002). E. Z. F. Liu, S. S. J. Lin, and S. M. Yuan. 2002. Alternatives to instructor assessment: A case study of comparing self and peer assessment with instructor assessment under a networked innovative assessment procedures. Int. J. Instruct. Med. 29, 4 (2002).","journal-title":"Int. J. Instruct. Med."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2006.322572"},{"key":"e_1_2_1_21_1","article-title":"A study of students' attitudes toward and desired system requirements of networked peer assessment system","volume":"30","author":"Liu E. Z.-F.","year":"2003","unstructured":"E. Z.-F. Liu and S.-M. Yuan . 2003 . A study of students' attitudes toward and desired system requirements of networked peer assessment system . Int. J. Instruct. Media 30 , 4 (2003). E. Z.-F. Liu and S.-M. Yuan. 2003. A study of students' attitudes toward and desired system requirements of networked peer assessment system. Int. J. Instruct. Media 30, 4 (2003).","journal-title":"Int. J. Instruct. Media"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1227310.1227406"},{"key":"e_1_2_1_23_1","first-page":"30","article-title":"Automatic assignment management and peer evaluation","volume":"18","author":"Trivedi A.","year":"2003","unstructured":"A. Trivedi , D. C. Kar , and H. Patterson-McNeill . 2003 . Automatic assignment management and peer evaluation . J. Comput. Small Coll , 18 , 4 (2003), 30 -- 37 . A. Trivedi, D. C. Kar, and H. Patterson-McNeill. 2003. Automatic assignment management and peer evaluation. J. Comput. Small Coll, 18, 4 (2003), 30--37.","journal-title":"J. Comput. Small Coll"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1325555.1325571"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1878450.1878470"},{"key":"e_1_2_1_26_1","volume-title":"Context and Consciousness: Activity Theory and Human Computer Interaction","author":"Nardi B. A.","unstructured":"B. A. Nardi . 1996. Context and Consciousness: Activity Theory and Human Computer Interaction . MIT Press , Cambridge, MA . B. A. Nardi. 1996. Context and Consciousness: Activity Theory and Human Computer Interaction. MIT Press, Cambridge, MA."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11422-008-9158-1"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-007-9082-2"},{"key":"e_1_2_1_29_1","first-page":"193","article-title":"The implementation of peer assessment: An action research approach","volume":"7","author":"Sivan A.","year":"2000","unstructured":"A. Sivan . 2000 . The implementation of peer assessment: An action research approach . Assess. Educ. Princip. Policy Pract. 7 , 2 (2000), 193 -- 213 . A. Sivan. 2000. The implementation of peer assessment: An action research approach. Assess. Educ. Princip. Policy Pract. 7, 2 (2000), 193--213.","journal-title":"Assess. Educ. Princip. Policy Pract."},{"key":"e_1_2_1_30_1","unstructured":"S. Turner and M. A. P\u00e9rez-Qui\u00f1ones. 2009. Exploring peer review in the computer science classroom. arXiv:0907.3456v1. Retrieved from http:\/\/arxiv.org\/abs\/0907.3456v1.  S. Turner and M. A. P\u00e9rez-Qui\u00f1ones. 2009. Exploring peer review in the computer science classroom. arXiv:0907.3456v1. Retrieved from http:\/\/arxiv.org\/abs\/0907.3456v1."},{"key":"e_1_2_1_31_1","first-page":"83","article-title":"Vygotsky's zone of proximal development as a theoretical foundation for cooperative learning","volume":"8","author":"Doolittle P. E.","year":"1997","unstructured":"P. E. Doolittle . 1997 . Vygotsky's zone of proximal development as a theoretical foundation for cooperative learning . J. Excell. Coll. Teach. 8 , 1 (1997), 83 -- 103 . P. E. Doolittle. 1997. Vygotsky's zone of proximal development as a theoretical foundation for cooperative learning. J. Excell. Coll. Teach. 8, 1 (1997), 83--103.","journal-title":"J. Excell. Coll. Teach."},{"key":"e_1_2_1_32_1","volume-title":"A Book of Object-Oriented Knowledge","author":"Henderson-Sellers B.","unstructured":"B. Henderson-Sellers . 1992. A Book of Object-Oriented Knowledge . Prentice-Hall , Englewood Cliffs, NJ . B. Henderson-Sellers. 1992. A Book of Object-Oriented Knowledge. Prentice-Hall, Englewood Cliffs, NJ."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1113034.1113040"},{"key":"e_1_2_1_34_1","volume-title":"Forms of intellectual and ethical development in the college years: A scheme","author":"Perry W. G.","unstructured":"W. G. Perry Jr . 1970. Forms of intellectual and ethical development in the college years: A scheme . Holt , Rinehart 8 Winston, New York, NY . W. G. Perry Jr. 1970. Forms of intellectual and ethical development in the college years: A scheme. Holt, Rinehart 8 Winston, New York, NY."},{"key":"e_1_2_1_35_1","volume-title":"The Psychology of Intelligence. Harcourt and Brace","author":"Piaget J.","unstructured":"J. Piaget . 1950. The Psychology of Intelligence. Harcourt and Brace , New York, NY . J. Piaget. 1950. The Psychology of Intelligence. Harcourt and Brace, New York, NY."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1227310.1227482"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140123.1140154"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1189215.1189185"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2361276.2361283"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1999.0462"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1024338.1024378"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404523"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352135.1352169"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the 7th International Conference on Learning Sciences. International Society of the Learning Sciences.","author":"Walker J. M. T.","unstructured":"J. M. T. Walker and P. H. King . 2006. Contrasting cases: What we can learn from students' perceptions of \u201cgood\u201d design . In Proceedings of the 7th International Conference on Learning Sciences. International Society of the Learning Sciences. J. M. T. Walker and P. H. King. 2006. Contrasting cases: What we can learn from students' perceptions of \u201cgood\u201d design. In Proceedings of the 7th International Conference on Learning Sciences. International Society of the Learning Sciences."},{"key":"e_1_2_1_45_1","volume-title":"Contemporary Linguistics: An Introduction","author":"O'Grady W.","year":"1989","unstructured":"W. O'Grady , M. Dobrovolsky , and M. Aronoff . 1989 . Contemporary Linguistics: An Introduction . St. Martin's Press , New York . W. O'Grady, M. Dobrovolsky, and M. Aronoff. 1989. Contemporary Linguistics: An Introduction. St. Martin's Press, New York."},{"key":"e_1_2_1_46_1","volume-title":"Taxonomy of Educational Objectives. Allyn 8 Bacon","author":"Bloom B. S.","unstructured":"B. S. Bloom . 1984. Taxonomy of Educational Objectives. Allyn 8 Bacon , Boston, MA . B. S. Bloom. 1984. Taxonomy of Educational Objectives. Allyn 8 Bacon, Boston, MA."},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the American Society for Engineering Education (ASEE\u201984)","author":"Hamilton S.","unstructured":"S. Hamilton , L. Brunell , G. Tamm , and O. Arnas . 2006. Peer review in engineering courses as a learning tool . In Proceedings of the American Society for Engineering Education (ASEE\u201984) . S. Hamilton, L. Brunell, G. Tamm, and O. Arnas. 2006. Peer review in engineering courses as a learning tool. In Proceedings of the American Society for Engineering Education (ASEE\u201984)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.59.1.14"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/1268784.1268834"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/282991.283096"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/13504620802278829"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400701864880"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/1360312022000069978"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1080\/1468181032000158336"},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the 3rd International Conference on Concept Mapping.","author":"Kandiko C. B.","unstructured":"C. B. Kandiko , I. M. Kinchin , and D. B. Hay . 2008. Longitudinal studies of cognitive change among students and their supervisors in the course of research supervision leading to a PhD . In Proceedings of the 3rd International Conference on Concept Mapping. C. B. Kandiko, I. M. Kinchin, and D. B. Hay. 2008. Longitudinal studies of cognitive change among students and their supervisors in the course of research supervision leading to a PhD. In Proceedings of the 3rd International Conference on Concept Mapping."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1080\/01421590120091087"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10734-007-9099-8"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1080\/001318800363908"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.42.1.116"},{"key":"e_1_2_1_60_1","doi-asserted-by":"crossref","unstructured":"J. D. Novak and D. B. Gowin. 1984. Learning How to Learn. Cambridge University Press Cambridge.  J. D. Novak and D. B. Gowin. 1984. Learning How to Learn. Cambridge University Press Cambridge.","DOI":"10.1017\/CBO9781139173469"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352322.1352251"},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of the 7th Australian Conference on Computing Education. Australian Computer Society, Inc.: Newcastle, New South Wales, Australia.","author":"Hamer J.","year":"2005","unstructured":"J. Hamer , K. T. K. Ma , and H. H. F. Kwong . 2005 . A method of automatic grade calibration in peer assessment . In Proceedings of the 7th Australian Conference on Computing Education. Australian Computer Society, Inc.: Newcastle, New South Wales, Australia. J. Hamer, K. T. K. Ma, and H. H. F. Kwong. 2005. A method of automatic grade calibration in peer assessment. In Proceedings of the 7th Australian Conference on Computing Education. Australian Computer Society, Inc.: Newcastle, New South Wales, Australia."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3152715","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3152715","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:09Z","timestamp":1750212669000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3152715"}},"subtitle":["Conceptual Learning and High-Level Thinking"],"short-title":[],"issued":{"date-parts":[[2018,9,6]]},"references-count":62,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,9,30]]}},"alternative-id":["10.1145\/3152715"],"URL":"https:\/\/doi.org\/10.1145\/3152715","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,9,6]]},"assertion":[{"value":"2017-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}