{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T06:36:14Z","timestamp":1781332574087,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":92,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,6,17]],"date-time":"2020-06-17T00:00:00Z","timestamp":1592352000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,17]]},"DOI":"10.1145\/3437800.3439204","type":"proceedings-article","created":{"date-parts":[[2020,12,25]],"date-time":"2020-12-25T16:47:27Z","timestamp":1608914847000},"page":"75-129","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Differentiated Assessments for Advanced Courses that Reveal Issues with Prerequisite Skills"],"prefix":"10.1145","author":[{"given":"Greg L.","family":"Nelson","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Filip","family":"Str\u00f6mb\u00e4ck","sequence":"additional","affiliation":[{"name":"Link\u00f6ping University, Link\u00f6ping, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ari","family":"Korhonen","sequence":"additional","affiliation":[{"name":"Aalto University, Espoo, Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marjahan","family":"Begum","sequence":"additional","affiliation":[{"name":"Copenhagen Business School, Copenhagen, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ben","family":"Blamey","sequence":"additional","affiliation":[{"name":"Uppsala University, Uppsala, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karen H.","family":"Jin","sequence":"additional","affiliation":[{"name":"University of New Hampshire, Manchester, NH, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Violetta","family":"Lonati","sequence":"additional","affiliation":[{"name":"Universit\u00e0 degli Studi di Milano, Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bonnie","family":"MacKellar","sequence":"additional","affiliation":[{"name":"St John's University, Queens, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mattia","family":"Monga","sequence":"additional","affiliation":[{"name":"Universit\u00e0 degli Studi di Milano, Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,12,25]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/09500693.2010.512369"},{"key":"e_1_3_2_1_2_1","volume-title":"Computer Science Curricula","author":"Association for Computing Machinery. 2013.","year":"2013","unstructured":"Association for Computing Machinery. 2013. Computer Science Curricula 2013 . https:\/\/www.acm.org\/education\/curricula-recommendations Association for Computing Machinery. 2013. Computer Science Curricula 2013. https:\/\/www.acm.org\/education\/curricula-recommendations"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls1301_1"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2839509.2844559"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/63334.63337"},{"key":"e_1_3_2_1_6_1","article-title":"Report on the final BRACElet workshop: Auckland University of Technology, September 2010","author":"Clear Tony","year":"2011","unstructured":"Tony Clear , J. Whalley , P. Robbins , A. Philpott , A. Eckerdal , and M. Laakso . 2011 . Report on the final BRACElet workshop: Auckland University of Technology, September 2010 . Journal of Applied Computing and Information Technology 15 (Jun 2011). Issue 1. http:\/\/aut.researchgateway.ac.nz\/handle\/10292\/1514 Tony Clear, J. Whalley, P. Robbins, A. Philpott, A. Eckerdal, and M. Laakso. 2011. Report on the final BRACElet workshop: Auckland University of Technology, September 2010. Journal of Applied Computing and Information Technology 15 (Jun 2011). Issue 1. http:\/\/aut.researchgateway.ac.nz\/handle\/10292\/1514","journal-title":"Journal of Applied Computing and Information Technology 15"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls1301_2"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538911"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"L. J. Cronbach and P. Meehl. 1955. Construct validity in psychological tests. Psychological bulletin 52 4 (1955) 281--302.  L. J. Cronbach and P. Meehl. 1955. Construct validity in psychological tests. Psychological bulletin 52 4 (1955) 281--302.","DOI":"10.1037\/h0040957"},{"key":"e_1_3_2_1_10_1","volume-title":"32nd Annual Frontiers in Education","author":"J. H.","year":"2002","unstructured":"J. H. Cross II, T Dean Hendrix , and Larry A Barowski . 2002. Using the debugger as an integral part of teaching CS1 . In 32nd Annual Frontiers in Education , Vol. 2 . IEEE, Stripes Publishing LLC , Chapaign, IL, USA , F1G--F1G. https:\/\/doi.org\/10. 1109\/FIE. 2002 .1158137 J. H. Cross II, T Dean Hendrix, and Larry A Barowski. 2002. Using the debugger as an integral part of teaching CS1. In 32nd Annual Frontiers in Education, Vol. 2. IEEE, Stripes Publishing LLC, Chapaign, IL, USA, F1G--F1G. https:\/\/doi.org\/10. 1109\/FIE.2002.1158137"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.18260\/1-2--22214"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2013.153"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.2190\/3LFX-9RRF-67T8-UVK9"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017777"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scico.2013.11.040"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858796.2858801"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352322.1352226"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1789934.1789935"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445368"},{"key":"e_1_3_2_1_20_1","first-page":"1","article-title":"Notional Machines and Programming Language Semantics in Education (Dagstuhl Seminar 19281)","volume":"9","author":"Guzdial Mark","year":"2019","unstructured":"Mark Guzdial , Shriram Krishnamurthi , Juha Sorva , and Jan Vahrenhold . 2019 . Notional Machines and Programming Language Semantics in Education (Dagstuhl Seminar 19281) . Dagstuhl Reports 9 , 7 (2019), 1 -- 23 . https:\/\/doi.org\/10.4230\/ DagRep.9.7.1 Mark Guzdial, Shriram Krishnamurthi, Juha Sorva, and Jan Vahrenhold. 2019. Notional Machines and Programming Language Semantics in Education (Dagstuhl Seminar 19281). Dagstuhl Reports 9, 7 (2019), 1--23. https:\/\/doi.org\/10.4230\/ DagRep.9.7.1","journal-title":"Dagstuhl Reports"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2017.1414728"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159530"},{"key":"e_1_3_2_1_23_1","volume-title":"IASDR 2019 Conference Proceedings. International Association of Societies of Design Research, Manchester, 11","author":"Herriot Richard","year":"2019","unstructured":"Richard Herriot . 2019 . What Kind of Research is Research Through Design? . In IASDR 2019 Conference Proceedings. International Association of Societies of Design Research, Manchester, 11 . https:\/\/iasdr2019.org\/uploads\/files\/Proceedings\/ op-f-1078-Her-R.pdf Richard Herriot. 2019. What Kind of Research is Research Through Design?. In IASDR 2019 Conference Proceedings. International Association of Societies of Design Research, Manchester, 11. https:\/\/iasdr2019.org\/uploads\/files\/Proceedings\/ op-f-1078-Her-R.pdf"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445364"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/268085.268132"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3344429.3372501"},{"key":"e_1_3_2_1_27_1","volume-title":"Association for Computing Machinery","author":"Joint Task Force on Computing Curricula","year":"2013","unstructured":"Joint Task Force on Computing Curricula , Association for Computing Machinery ( ACM) and IEEE Computer Society . 2013 . Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science. Association for Computing Machinery, New York, NY, USA. Joint Task Force on Computing Curricula, Association for Computing Machinery (ACM) and IEEE Computer Society. 2013. Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science. Association for Computing Machinery, New York, NY, USA."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/jee.20104"},{"key":"e_1_3_2_1_29_1","volume-title":"Proceedings of the 41st ACM Technical Symposium on Computer Science Education (SIGCSE '10)","author":"Kaczmarczyk Lisa C.","unstructured":"Lisa C. Kaczmarczyk , Elizabeth R. Petrick , J. Philip East , and Geoffrey L. Herman . 2010. Identifying Student Misconceptions of Programming . In Proceedings of the 41st ACM Technical Symposium on Computer Science Education (SIGCSE '10) . Association for Computing Machinery, New York, NY, USA, 107--111. https: \/\/doi.org\/10.1145\/1734263.1734299 10.1145\/1734263.1734299 Lisa C. Kaczmarczyk, Elizabeth R. Petrick, J. Philip East, and Geoffrey L. Herman. 2010. Identifying Student Misconceptions of Programming. In Proceedings of the 41st ACM Technical Symposium on Computer Science Education (SIGCSE '10). Association for Computing Machinery, New York, NY, USA, 107--111. https: \/\/doi.org\/10.1145\/1734263.1734299"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12000"},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE '14)","author":"Karpierz Kuba","unstructured":"Kuba Karpierz and Steven A. Wolfman . 2014. Misconceptions and Concept Inventory Questions for Binary Search Trees and Hash Tables . In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE '14) . Association for Computing Machinery, New York, NY, USA, 109--114. https: \/\/doi.org\/10.1145\/2538862.2538902 10.1145\/2538862.2538902 Kuba Karpierz and Steven A. Wolfman. 2014. Misconceptions and Concept Inventory Questions for Binary Search Trees and Hash Tables. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE '14). Association for Computing Machinery, New York, NY, USA, 109--114. https: \/\/doi.org\/10.1145\/2538862.2538902"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 18th Koli Calling International Conference on Computing Education Research (Koli Calling '18)","author":"Kennedy Cazembe","unstructured":"Cazembe Kennedy and Eileen T. Kraemer . 2018. What Are They Thinking?: Eliciting Student Reasoning About Troublesome Concepts in Introductory Computer Science . In Proceedings of the 18th Koli Calling International Conference on Computing Education Research (Koli Calling '18) . ACM, New York, NY, USA, Article 7, 10 pages. https:\/\/doi.org\/10.1145\/3279720.3279728 10.1145\/3279720.3279728 Cazembe Kennedy and Eileen T. Kraemer. 2018. What Are They Thinking?: Eliciting Student Reasoning About Troublesome Concepts in Introductory Computer Science. In Proceedings of the 18th Koli Calling International Conference on Computing Education Research (Koli Calling '18). ACM, New York, NY, USA, Article 7, 10 pages. https:\/\/doi.org\/10.1145\/3279720.3279728"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.11.3.221.3831"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2003.10.005"},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of the First International Workshop on Computing Education Research (ICER '05)","author":"Ben-David Kolikant Yifat","year":"2005","unstructured":"Yifat Ben-David Kolikant . 2005 . Students? Alternative Standards for Correctness . In Proceedings of the First International Workshop on Computing Education Research (ICER '05) . ACM, New York, NY, USA, 37--43. https:\/\/doi.org\/10.1145\/1089786. 1089790 10.1145\/1089786 Yifat Ben-David Kolikant. 2005. Students? Alternative Standards for Correctness. In Proceedings of the First International Workshop on Computing Education Research (ICER '05). ACM, New York, NY, USA, 37--43. https:\/\/doi.org\/10.1145\/1089786. 1089790"},{"key":"e_1_3_2_1_36_1","volume-title":"Handbook of Research on Discrete Event Simulation Environments: Technologies and Applications, Evon M","author":"Korhonen Ari","unstructured":"Ari Korhonen . 2010. Applications of Visual Algorithm Simulation . In Handbook of Research on Discrete Event Simulation Environments: Technologies and Applications, Evon M . O. Abu-Taieh and Asim A. El-Sheikh (Eds.). IGI Global , Hershey, PA, USA , 234--251. https:\/\/doi.org\/10.4018\/978--1--60566--774--4 10.4018\/978--1--60566--774--4 Ari Korhonen. 2010. Applications of Visual Algorithm Simulation. In Handbook of Research on Discrete Event Simulation Environments: Technologies and Applications, Evon M. O. Abu-Taieh and Asim A. El-Sheikh (Eds.). IGI Global, Hershey, PA, USA, 234--251. https:\/\/doi.org\/10.4018\/978--1--60566--774--4"},{"key":"e_1_3_2_1_37_1","volume-title":"Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE '20)","author":"Krause-Levy Sophia","unstructured":"Sophia Krause-Levy , Sander Valstar , Leo Porter , and William G. Griswold . 2020. Exploring the Link Between Prerequisites and Performance in Advanced Data Structures . In Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE '20) . Association for Computing Machinery, New York, NY, USA, 386--392. https:\/\/doi.org\/10.1145\/3328778.3366867 10.1145\/3328778.3366867 Sophia Krause-Levy, Sander Valstar, Leo Porter, and William G. Griswold. 2020. Exploring the Link Between Prerequisites and Performance in Advanced Data Structures. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE '20). Association for Computing Machinery, New York, NY, USA, 386--392. https:\/\/doi.org\/10.1145\/3328778.3366867"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899447"},{"key":"e_1_3_2_1_39_1","volume-title":"Fincher","author":"Lancaster Thomas","year":"2019","unstructured":"Thomas Lancaster , Anthony Robins , and Sally A . Fincher . 2019 . Assessment and plagiarism. In The Cambridge handbook of computing education research, Sally A Fincher and Anthony V Robins (Eds.). Cambridge University Press , Cambridge, UK, 414--444. Thomas Lancaster, Anthony Robins, and Sally A. Fincher. 2019. Assessment and plagiarism. In The Cambridge handbook of computing education research, Sally A Fincher and Anthony V Robins (Eds.). Cambridge University Press, Cambridge, UK, 414--444."},{"key":"e_1_3_2_1_40_1","volume-title":"The Stanford Encyclopedia of Philosophy (fall 2020 ed.), Edward N","author":"Legg Catherine","unstructured":"Catherine Legg and Christopher Hookway . 2020. Pragmatism . In The Stanford Encyclopedia of Philosophy (fall 2020 ed.), Edward N . Zalta (Ed.). Metaphysics Research Lab, Stanford University , Standford, CA, USA . Catherine Legg and Christopher Hookway. 2020. Pragmatism. In The Stanford Encyclopedia of Philosophy (fall 2020 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University, Standford, CA, USA."},{"key":"e_1_3_2_1_41_1","volume-title":"Gierl","author":"Leighton Jacqueline P.","year":"2007","unstructured":"Jacqueline P. Leighton and Mark J . Gierl . 2007 . Verbal reports as data for cognitive diagnostic assessment. In Cognitive Diagnostic Assessment for Education: Theory and Applications, Jacqueline Leighton and Mark Gierl (Eds.). Cambridge University Press , Cambridge, 146--172. https:\/\/doi.org\/10.1017\/CBO9780511611186.006 10.1017\/CBO9780511611186.006 Jacqueline P. Leighton and Mark J. Gierl. 2007. Verbal reports as data for cognitive diagnostic assessment. In Cognitive Diagnostic Assessment for Education: Theory and Applications, Jacqueline Leighton and Mark Gierl (Eds.). Cambridge University Press, Cambridge, 146--172. https:\/\/doi.org\/10.1017\/CBO9780511611186.006"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1288580.1288598"},{"key":"e_1_3_2_1_43_1","unstructured":"Barbara Liskov and John Guttag. 2000. Program development in JAVA: abstraction specification and object-oriented design. Pearson Education.  Barbara Liskov and John Guttag. 2000. Program development in JAVA: abstraction specification and object-oriented design. Pearson Education."},{"key":"e_1_3_2_1_44_1","volume-title":"Kate Sanders, Otto Sepp\u00e4l\u00e4, Beth Simon, and Lynda Thomas.","author":"Lister Raymond","year":"2004","unstructured":"Raymond Lister , Elizabeth S. Adams , Sue Fitzgerald , William Fone , John Hamer , Morten Lindholm , Robert McCartney , Jan Erik Mostr\u00f6m , Kate Sanders, Otto Sepp\u00e4l\u00e4, Beth Simon, and Lynda Thomas. 2004 . A Multi-National Study of Reading and Tracing Skills in Novice Programmers. In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education (ITiCSEWGR '04). Association for Computing Machinery, New York, NY, USA, 119--150. https:\/\/doi.org\/10.1145\/1044550.1041673 10.1145\/1044550.1041673 Raymond Lister, Elizabeth S. Adams, Sue Fitzgerald, William Fone, John Hamer, Morten Lindholm, Robert McCartney, Jan Erik Mostr\u00f6m, Kate Sanders, Otto Sepp\u00e4l\u00e4, Beth Simon, and Lynda Thomas. 2004. A Multi-National Study of Reading and Tracing Skills in Novice Programmers. In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education (ITiCSEWGR '04). Association for Computing Machinery, New York, NY, USA, 119--150. https:\/\/doi.org\/10.1145\/1044550.1041673"},{"key":"e_1_3_2_1_45_1","volume-title":"Proceedings of the Eleventh Australasian Conference on Computing Education -","volume":"95","author":"L\u00f6nnberg Jan","year":"2009","unstructured":"Jan L\u00f6nnberg , Anders Berglund , and Lauri Malmi . 2009 . How Students Develop Concurrent Programs . In Proceedings of the Eleventh Australasian Conference on Computing Education - Volume 95 (ACE '09). Australian Computer Society, Inc., Darlinghurst, Australia, 129--138. http:\/\/dl.acm.org\/citation.cfm?id= 1862712. 1862732 Jan L\u00f6nnberg, Anders Berglund, and Lauri Malmi. 2009. How Students Develop Concurrent Programs. In Proceedings of the Eleventh Australasian Conference on Computing Education - Volume 95 (ACE '09). Australian Computer Society, Inc., Darlinghurst, Australia, 129--138. http:\/\/dl.acm.org\/citation.cfm?id=1862712. 1862732"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404531"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3174781.3174784"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3293881.3295779"},{"key":"e_1_3_2_1_49_1","volume-title":"Proceedings of the Seventh Baltic Sea Conference on Computing Education Research -","volume":"88","author":"L\u00f6nnberg Jan","year":"2007","unstructured":"Jan L\u00f6nnberg and Anders Berglund . 2007 . Students? Understandings of Concurrent Programming . In Proceedings of the Seventh Baltic Sea Conference on Computing Education Research - Volume 88 . Australian Computer Society, Inc., Darlinghurst, Australia, 77--86. http:\/\/dl.acm.org\/citation.cfm?id=2449323.2449332 Jan L\u00f6nnberg and Anders Berglund. 2007. Students? Understandings of Concurrent Programming. In Proceedings of the Seventh Baltic Sea Conference on Computing Education Research - Volume 88. Australian Computer Society, Inc., Darlinghurst, Australia, 77--86. http:\/\/dl.acm.org\/citation.cfm?id=2449323.2449332"},{"key":"e_1_3_2_1_50_1","volume-title":"Reeves","author":"McKenney Susan","year":"2014","unstructured":"Susan McKenney and Thomas C . Reeves . 2014 . Design and development research. In Handbook of Research on Educational Communications and Technology: Fourth Edition. Springer New York , New York, NY, 131--140. https:\/\/doi.org\/10.1007\/ 978--1--4614--3185--5_11 Susan McKenney and Thomas C. Reeves. 2014. Design and development research. In Handbook of Research on Educational Communications and Technology: Fourth Edition. Springer New York, New York, NY, 131--140. https:\/\/doi.org\/10.1007\/ 978--1--4614--3185--5_11"},{"key":"e_1_3_2_1_51_1","volume-title":"Reeves","author":"McKenney Susan E.","year":"2012","unstructured":"Susan E. McKenney and Thomas C . Reeves . 2012 . Conducting Educational Design Research. Routledge , London. Susan E. McKenney and Thomas C. Reeves. 2012. Conducting Educational Design Research. Routledge, London."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/260111.260214"},{"key":"e_1_3_2_1_53_1","volume-title":"Object-oriented software construction","author":"Meyer Bertrand","unstructured":"Bertrand Meyer . 1997. Object-oriented software construction . Vol. 2 . Prentice hall Englewood Cliffs, USA. Bertrand Meyer. 1997. Object-oriented software construction. Vol. 2. Prentice hall Englewood Cliffs, USA."},{"key":"e_1_3_2_1_54_1","volume-title":"Exploring the Role of Visualization and Engagement in Computer Science Education","author":"Naps Thomas L.","unstructured":"Thomas L. Naps , Guido R\u00f6\u00dfling , Vicki Almstrum , Wanda Dann , Rudolf Fleischer , Chris Hundhausen , Ari Korhonen , Lauri Malmi , Myles McNally , Susan Rodger , and J. \u00c1ngel Vel\u00e1zquez-Iturbide . 2002. Exploring the Role of Visualization and Engagement in Computer Science Education . In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education (ITiCSEWGR '02). Association for Computing Machinery, New York, NY, USA, 131--152. https:\/\/doi.org\/10.1145\/960568.782998 10.1145\/960568.782998 Thomas L. Naps, Guido R\u00f6\u00dfling, Vicki Almstrum, Wanda Dann, Rudolf Fleischer, Chris Hundhausen, Ari Korhonen, Lauri Malmi, Myles McNally, Susan Rodger, and J. \u00c1ngel Vel\u00e1zquez-Iturbide. 2002. Exploring the Role of Visualization and Engagement in Computer Science Education. In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education (ITiCSEWGR '02). Association for Computing Machinery, New York, NY, USA, 131--152. https:\/\/doi.org\/10.1145\/960568.782998"},{"key":"e_1_3_2_1_55_1","volume-title":"Proceedings of the 19th Koli Calling International Conference on Computing Education Research (Koli Calling '19)","author":"Nelson Greg L.","unstructured":"Greg L. Nelson , Andrew Hu , Benjamin Xie , and Amy J. Ko . 2019. Towards Validity for a Formative Assessment for Language-specific Program Tracing Skills . In Proceedings of the 19th Koli Calling International Conference on Computing Education Research (Koli Calling '19) . ACM, New York, NY, USA, Article 20, 10 pages. https:\/\/doi.org\/10.1145\/3364510.3364525 10.1145\/3364510.3364525 Greg L. Nelson, Andrew Hu, Benjamin Xie, and Amy J. Ko. 2019. Towards Validity for a Formative Assessment for Language-specific Program Tracing Skills. In Proceedings of the 19th Koli Calling International Conference on Computing Education Research (Koli Calling '19). ACM, New York, NY, USA, Article 20, 10 pages. https:\/\/doi.org\/10.1145\/3364510.3364525"},{"key":"e_1_3_2_1_56_1","volume-title":"Proceedings of the 2018 ACM Conference on International Computing Education Research (ICER '18)","author":"Greg","unstructured":"Greg L. Nelson and Andrew J. Ko. 2018. On Use of Theory in Computing Education Research . In Proceedings of the 2018 ACM Conference on International Computing Education Research (ICER '18) . Association for Computing Machinery, New York, NY, USA, 31--39. https:\/\/doi.org\/10.1145\/3230977.3230992 10.1145\/3230977.3230992 Greg L. Nelson and Andrew J. Ko. 2018. On Use of Theory in Computing Education Research. In Proceedings of the 2018 ACM Conference on International Computing Education Research (ICER '18). Association for Computing Machinery, New York, NY, USA, 31--39. https:\/\/doi.org\/10.1145\/3230977.3230992"},{"key":"e_1_3_2_1_57_1","volume-title":"Proceedings of the 2017 ACM Conference on International Computing Education Research (ICER '17)","author":"Nelson Greg L.","unstructured":"Greg L. Nelson , Benjamin Xie , and Andrew J. Ko . 2017. Comprehension First: Evaluating a Novel Pedagogy and Tutoring System for Program Tracing in CS1 . In Proceedings of the 2017 ACM Conference on International Computing Education Research (ICER '17) . Association for Computing Machinery, New York, NY, USA, 2--11. https:\/\/doi.org\/10.1145\/3105726.3106178 10.1145\/3105726.3106178 Greg L. Nelson, Benjamin Xie, and Andrew J. Ko. 2017. Comprehension First: Evaluating a Novel Pedagogy and Tutoring System for Program Tracing in CS1. In Proceedings of the 2017 ACM Conference on International Computing Education Research (ICER '17). Association for Computing Machinery, New York, NY, USA, 2--11. https:\/\/doi.org\/10.1145\/3105726.3106178"},{"key":"e_1_3_2_1_58_1","volume-title":"A Philosophy of Software Design","author":"Ousterhout John","unstructured":"John Ousterhout . 2018. A Philosophy of Software Design . Yaknyam Press . John Ousterhout. 2018. A Philosophy of Software Design. Yaknyam Press."},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960316"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445212"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.2190\/689T-1R2A-X4W4-29J2"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373165.3373179"},{"key":"e_1_3_2_1_63_1","volume-title":"Papers Presented at the First Workshop on Empirical Studies of Programmers on Empirical Studies of Programmers","author":"Perkins D. N.","year":"1842","unstructured":"D. N. Perkins and Fay Martin . 1986. Fragile Knowledge and Neglected Strategies in Novice Programmers . In Papers Presented at the First Workshop on Empirical Studies of Programmers on Empirical Studies of Programmers . Ablex Publishing Corp ., Norwood, NJ, USA, 213--229. http:\/\/dl.acm.org\/citation.cfm?id=2 1842 . 28896 D. N. Perkins and Fay Martin. 1986. Fragile Knowledge and Neglected Strategies in Novice Programmers. In Papers Presented at the First Workshop on Empirical Studies of Programmers on Empirical Studies of Programmers. Ablex Publishing Corp., Norwood, NJ, USA, 213--229. http:\/\/dl.acm.org\/citation.cfm?id=21842. 28896"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/290320.283117"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159457"},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339404"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077618"},{"key":"e_1_3_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400500224310"},{"key":"e_1_3_2_1_69_1","volume-title":"Educational design research","author":"Reeves Thomas C.","unstructured":"Thomas C. Reeves . 2006. Design research from the technology perspective . In Educational design research . Routledge , 86--109. Thomas C. Reeves. 2006. Design research from the technology perspective. In Educational design research. Routledge, 86--109."},{"key":"e_1_3_2_1_70_1","volume-title":"Proceedings of the eighteenth Conference of Australian Association for Engineering. Department of Computer Science and Software Engineering","author":"Rowe Gerard","year":"2007","unstructured":"Gerard Rowe and Chris Smaill . 2007 . Development of an electromagnetic course?concept inventory?a work in progress . In Proceedings of the eighteenth Conference of Australian Association for Engineering. Department of Computer Science and Software Engineering , The University of Melbourne, Melbourne, Australia, 7. Gerard Rowe and Chris Smaill. 2007. Development of an electromagnetic course?concept inventory?a work in progress. In Proceedings of the eighteenth Conference of Australian Association for Engineering. Department of Computer Science and Software Engineering, The University of Melbourne, Melbourne, Australia, 7."},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1316450.1316453"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/2543882.2543885"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1080\/23752696.2018.1433546"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/2094131.2094154"},{"key":"e_1_3_2_1_76_1","volume-title":"Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE '16)","author":"Sheard Judy","year":"2016","unstructured":"Simon, Judy Sheard , Daryl D'Souza , Peter Klemperer , Leo Porter , Juha Sorva , Martijn Stegeman , and Daniel Zingaro . 2016 . Benchmarking Introductory Programming Exams: How and Why . In Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE '16) . Association for Computing Machinery, New York, NY, USA, 154--159. https:\/\/doi.org\/10.1145\/2899415.2899473 10.1145\/2899415.2899473 Simon, Judy Sheard, Daryl D'Souza, Peter Klemperer, Leo Porter, Juha Sorva, Martijn Stegeman, and Daniel Zingaro. 2016. Benchmarking Introductory Programming Exams: How and Why. In Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE '16). Association for Computing Machinery, New York, NY, USA, 154--159. https:\/\/doi.org\/10.1145\/2899415.2899473"},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310"},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/1839594.1839612"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3105726.3106186"},{"key":"e_1_3_2_1_80_1","volume-title":"Proceedings of the Seventh Baltic Sea Conference on Computing Education Research -","volume":"88","author":"Sorva Juha","year":"2007","unstructured":"Juha Sorva . 2007 . Students? Understandings of Storing Objects . In Proceedings of the Seventh Baltic Sea Conference on Computing Education Research - Volume 88 (Koli Calling '07). Australian Computer Society, Inc., AUS, 127--135. Juha Sorva. 2007. Students? Understandings of Storing Objects. In Proceedings of the Seventh Baltic Sea Conference on Computing Education Research - Volume 88 (Koli Calling '07). Australian Computer Society, Inc., AUS, 127--135."},{"key":"e_1_3_2_1_81_1","volume-title":"Visual program simulation in introductory programming education","author":"Sorva Juha","unstructured":"Juha Sorva . 2012. Visual program simulation in introductory programming education ; Visuaalinen ohjelmasimulaatio ohjelmoinnin alkeisopetuksessa. G4 Monografiav\u00e4it\u00f6skirja. Aalto-yliopisto . http:\/\/urn.fi\/URN:ISBN:978--952--60--4626--6 Juha Sorva. 2012. Visual program simulation in introductory programming education; Visuaalinen ohjelmasimulaatio ohjelmoinnin alkeisopetuksessa. G4 Monografiav\u00e4it\u00f6skirja. Aalto-yliopisto. http:\/\/urn.fi\/URN:ISBN:978--952--60--4626--6"},{"key":"e_1_3_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483710"},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/2490822"},{"key":"e_1_3_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2013.807962"},{"key":"e_1_3_2_1_85_1","volume-title":"Smith","author":"Strauss Milton E.","year":"2009","unstructured":"Milton E. Strauss and Gregory T . Smith . 2009 . Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology 5 (4 2009), 1--25. https:\/\/doi.org\/10.1146\/annurev.clinpsy.032408.153639 10.1146\/annurev.clinpsy.032408.153639 Milton E. Strauss and Gregory T. Smith. 2009. Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology 5 (4 2009), 1--25. https:\/\/doi.org\/10.1146\/annurev.clinpsy.032408.153639"},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339415"},{"key":"e_1_3_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2014.970779"},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.259"},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287419"},{"key":"e_1_3_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/382192.383004"},{"key":"e_1_3_2_1_91_1","volume-title":"Proceedings of the 8th Australasian Conference on Computing Education -","volume":"52","author":"Whalley Jacqueline L.","year":"2006","unstructured":"Jacqueline L. Whalley , Raymond Lister , Errol Thompson , Tony Clear , Phil Robbins , P. K. Ajith Kumar , and Christine Prasad . 2006 . An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies . In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (ACE '06). Australian Computer Society, Inc., AUS, 243--252. Jacqueline L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins, P. K. Ajith Kumar, and Christine Prasad. 2006. An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies. In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (ACE '06). Australian Computer Society, Inc., AUS, 243--252."},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2019.1565235"},{"key":"e_1_3_2_1_93_1","volume-title":"Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE '18)","author":"Xie Benjamin","unstructured":"Benjamin Xie , Greg L. Nelson , and Andrew J. Ko . 2018. An Explicit Strategy to Scaffold Novice Program Tracing . In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE '18) . Association for Computing Machinery, New York, NY, USA, 344--349. https:\/\/doi.org\/10.1145\/3159450.3159527 10.1145\/3159450.3159527 Benjamin Xie, Greg L. Nelson, and Andrew J. Ko. 2018. An Explicit Strategy to Scaffold Novice Program Tracing. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE '18). Association for Computing Machinery, New York, NY, USA, 344--349. https:\/\/doi.org\/10.1145\/3159450.3159527"}],"event":{"name":"ITiCSE '20: Innovation and Technology in Computer Science Education","location":"Trondheim Norway","acronym":"ITiCSE '20","sponsor":["Bilkent University Bilkent University","SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437800.3439204","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3437800.3439204","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:25Z","timestamp":1750191445000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437800.3439204"}},"subtitle":["A Design Investigation"],"short-title":[],"issued":{"date-parts":[[2020,6,17]]},"references-count":92,"alternative-id":["10.1145\/3437800.3439204","10.1145\/3437800"],"URL":"https:\/\/doi.org\/10.1145\/3437800.3439204","relation":{},"subject":[],"published":{"date-parts":[[2020,6,17]]},"assertion":[{"value":"2020-12-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}