{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T03:11:23Z","timestamp":1774321883881,"version":"3.50.1"},"reference-count":99,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T00:00:00Z","timestamp":1747699200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>Algorithm design is a vital skill developed in most undergraduate Computer Science (CS) programs, but few research studies focus on pedagogy related to algorithms coursework. To understand the work that has been done in the area, we present a systematic survey and literature review of CS Education studies. We search for research that is both related to algorithm design (as described by the ACM Curricular Guidelines) and evaluated on post-secondary-level students. Across all venues we searched prior to July 2024, we only find 102 such papers.<\/jats:p>\n          <jats:p>We first classify these papers by topic, evaluation metric, evaluation methods, and intervention target. Through our classification, we find a broad sparsity of papers which indicates that many open questions remain about teaching algorithm design. We also note the need for papers using rigorous research methods, as only 43 out of 92 papers presenting quantitative data use statistical tests, and only 16 out of 47 papers presenting qualitative data follow a coding scheme. Only 18 papers report controlled trials. In addition, almost all authors only contribute to one publication, an indication that few groups are specializing on these topics.<\/jats:p>\n          <jats:p>We then synthesize the results of the existing literature to give insights into what the corpus reveals about how we should teach algorithms. Broadly, we find that much of the literature explores implementing well-established practices, such as active learning or automated assessment, in the algorithms classroom. However, there are algorithms-specific results as well: A number of papers find that students may under-utilize certain algorithmic design techniques, and studies describe a variety of ways to select algorithms problems that increase student engagement and learning.<\/jats:p>\n          <jats:p>The results we present, along with the publicly available set of papers collected, provide a detailed representation of the current corpus of CS Education work related to algorithm design and can orient further research in the area.<\/jats:p>","DOI":"10.1145\/3727987","type":"journal-article","created":{"date-parts":[[2025,4,4]],"date-time":"2025-04-04T16:16:40Z","timestamp":1743783400000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Teaching Algorithm Design: A Literature Review"],"prefix":"10.1145","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8602-2002","authenticated-orcid":false,"given":"Jonathan","family":"Liu","sequence":"first","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6284-9972","authenticated-orcid":false,"given":"Seth","family":"Poulsen","sequence":"additional","affiliation":[{"name":"Utah State University, Logan, Utah, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0614-8310","authenticated-orcid":false,"given":"Erica","family":"Goodwin","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1606-0484","authenticated-orcid":false,"given":"Hongxuan","family":"Chen","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Urbana, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7982-0885","authenticated-orcid":false,"given":"Grace","family":"Williams","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8818-8172","authenticated-orcid":false,"given":"Yael","family":"Gertner","sequence":"additional","affiliation":[{"name":"University of Illinois Urbana-Champaign, Urbana, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1495-9805","authenticated-orcid":false,"given":"Diana","family":"Franklin","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,5,20]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/1227310.1227338"},{"issue":"4","key":"e_1_3_2_3_2","first-page":"30","article-title":"Reduction in CS: A (mostly) quantitative analysis of reductive solutions to algorithmic problems","volume":"8","author":"Armoni Michal","year":"2009","unstructured":"Michal Armoni. 2009. Reduction in CS: A (mostly) quantitative analysis of reductive solutions to algorithmic problems. Journal on Educational Resources in Computing 8, 4, Article 11 (Jan. 2009), 30 pages.","journal-title":"Journal on Educational Resources in Computing"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287432"},{"key":"e_1_3_2_5_2","first-page":"1","volume-title":"Proceedings of the 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC)","author":"Behroozi Mahnaz","year":"2019","unstructured":"Mahnaz Behroozi, Chris Parnin, and Titus Barik. 2019. Hiring is broken: What do developers say about technical interviews? In Proceedings of the 2019 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC). IEEE, IEEE Computer Society, Los Alamitos, CA, 1\u20139."},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1145\/3328778.3366938","volume-title":"Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201920)","author":"Belleville Patrice","year":"2020","unstructured":"Patrice Belleville, Steven A. Wolfman, Susanne Bradley, and Cinda Heeren. 2020. Inverted two-stage exams for prospective learning: Using an initial group stage to incentivize anticipation of transfer. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201920). ACM, New York, NY, 720\u2013738."},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1080\/08993400701791133"},{"key":"e_1_3_2_8_2","first-page":"15","volume-title":"Proceedings of the 4th International Workshop on Computing Education Research (ICER\u00a0\u201908)","author":"Bennedssen Jens","year":"2008","unstructured":"Jens Bennedssen and Michael E. Caspersen. 2008. Abstraction ability as an indicator of success for learning computing science? In Proceedings of the 4th International Workshop on Computing Education Research (ICER\u00a0\u201908). ACM, New York, NY, 15\u201326."},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/1140124.1140166"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3197091.3197147"},{"key":"e_1_3_2_11_2","first-page":"344","volume-title":"Proceedings of the 2022 ACM Conference on International Computing Education Research (ICER\u00a0\u201922)","author":"Brown Noelle","year":"2022","unstructured":"Noelle Brown, Koriann South, and Eliane S. Wiese. 2022. The shortest path to ethics in AI: An integrated assignment where human concerns guide technical decisions. In Proceedings of the 2022 ACM Conference on International Computing Education Research (ICER\u00a0\u201922), Vol. 1. ACM, New York, NY, 344\u2013355."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445211"},{"key":"e_1_3_2_13_2","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1145\/971300.971457","volume-title":"Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201904)","author":"Collberg Christian","year":"2004","unstructured":"Christian Collberg, Stephen G. Kobourov, and Suzanne Westbrook. 2004. AlgoVista: An algorithmic search tool in an educational setting. In Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201904). ACM, New York, NY, 462\u2013466."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF03177550"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1145\/3287324.3287511","volume-title":"Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201919)","author":"Coore Daniel","year":"2019","unstructured":"Daniel Coore and Daniel Fokum. 2019. Facilitating course assessment with a competitive programming platform. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201919). ACM, New York, NY, 449\u2013455."},{"key":"e_1_3_2_16_2","first-page":"16","volume-title":"Proceedings of the 18th ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201913)","author":"Crescenzi Pierluigi","year":"2013","unstructured":"Pierluigi Crescenzi, Emma Enstr\u00f6m, and Viggo Kann. 2013. From theory to practice: NP-completeness for every CS student. In Proceedings of the 18th ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201913). ACM, New York, NY, 16\u201321."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157148"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3105726.3106171"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.5555\/1177299"},{"key":"e_1_3_2_20_2","first-page":"290","volume-title":"Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201918)","author":"Deb Debzani","year":"2018","unstructured":"Debzani Deb, Muztaba Fuad, James Etim, and Clay Gloster. 2018. MRS: Automated assessment of interactive classroom exercises. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201918). ACM, New York, NY, 290\u2013295."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017793"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/1067445.1067525"},{"key":"e_1_3_2_23_2","volume-title":"Content Analysis","author":"Drisko James W.","year":"2016","unstructured":"James W. Drisko and Tina Maschi. 2016. Content Analysis. Oxford University Press."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373165.3373187"},{"issue":"1","key":"e_1_3_2_25_2","first-page":"38","article-title":"Iteratively intervening with the \u201cmost difficult\u201d topics of an algorithms and complexity course","volume":"17","author":"Enstr\u00f6m Emma","year":"2017","unstructured":"Emma Enstr\u00f6m and Viggo Kann. 2017. Iteratively intervening with the \u201cmost difficult\u201d topics of an algorithms and complexity course. ACM Transactions on Computing Education 17, 1, Article 4 (Jan. 2017), 38 pages.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_2_26_2","unstructured":"Jeff Erickson. 2019. Algorithms (1st. ed.). self-pub."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3571785.3574127"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3197091.3197129"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017698"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899454"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_3_2_32_2","unstructured":"Association for Computing Machinery. 2024. ACM Digital Library. Retrieved from https:\/\/dl.acm.org"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3587102.3588843"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2016.1171470"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/1562877.1562897"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/1539024.1508897"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/377435.377490"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/611892.611920"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/1007996.1008020"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017801"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2094131.2094147"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432412"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1076\/csed.13.1.53.13541"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3470652"},{"issue":"3","key":"e_1_3_2_45_2","first-page":"18","article-title":"Learning IS child\u2019s play: Game-based learning in computer science education","volume":"19","author":"Hosseini Hadi","year":"2019","unstructured":"Hadi Hosseini, Maxwell Hartt, and Mehrnaz Mostafapour. 2019. Learning IS child\u2019s play: Game-based learning in computer science education. ACM Transactions on Computing Education 19, 3, Article 22 (Jan. 2019), 18 pages.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"866","DOI":"10.1145\/3287324.3287411","volume-title":"Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201919)","author":"Hosseini Hadi","year":"2019","unstructured":"Hadi Hosseini and Laurel Perweiler. 2019. Are you game? In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201919). ACM, New York, NY, 866\u2013872."},{"issue":"2002","key":"e_1_3_2_47_2","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1006\/jvlc.2002.0237","article-title":"A meta-study of algorithm visualization effectiveness","volume":"13","author":"Hundhausen Christopher D.","year":"2002","unstructured":"Christopher D. Hundhausen, Sarah A. Douglas, and John T. Stasko. 2002. A meta-study of algorithm visualization effectiveness. Journal of Visual Languages & Computing 13, 3 (2002), 259\u2013290.","journal-title":"Journal of Visual Languages & Computing"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3160489.3160496"},{"key":"e_1_3_2_49_2","first-page":"305","volume-title":"Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201917)","author":"Izu Cruz","year":"2017","unstructured":"Cruz Izu, Cheryl Pope, and Amali Weerasinghe. 2017. On the ability to reason about program behaviour: A think-aloud study. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201917). ACM, New York, NY, 305\u2013310."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/330908.331889"},{"key":"e_1_3_2_51_2","volume-title":"Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science","author":"Association for Computing Machinery (ACM) Joint Task Force on Computing Curricula and IEEE Computer Society","year":"2013","unstructured":"Association for Computing Machinery (ACM) Joint Task Force on Computing Curricula and IEEE Computer Society. 2013. Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science. ACM, New York, NY."},{"key":"e_1_3_2_52_2","first-page":"120","volume-title":"Proceedings of the 2022 ACM Conference on International Computing Education Research (ICER\u00a0\u201922)","author":"Kallia Maria","year":"2022","unstructured":"Maria Kallia, Quintin Cutts, and Nicola Looker. 2022. When rhetorical logic meets programming: Collective argumentative reasoning in problem-solving in programming. In Proceedings of the 2022 ACM Conference on International Computing Education Research (ICER\u00a0\u201922), Vol. 1. ACM, New York, NY, 120\u2013134."},{"key":"e_1_3_2_53_2","volume-title":"Guidelines for Performing Systematic Literature Reviews in Software Engineering","author":"Kitchenham Barbara","year":"2007","unstructured":"Barbara Kitchenham and Stuart Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01. Software Engineering Group, Keele University and Department of Computer Science, University of Durham, Salt Lake City, UT."},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3664191"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538907"},{"key":"e_1_3_2_56_2","first-page":"198","volume-title":"Proceedings of the 16th Annual Joint Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201911)ACM","author":"Lee Ming-Han","year":"2011","unstructured":"Ming-Han Lee and Guido R\u00f6\u00dfling. 2011. Toward replicating handmade algorithm visualization behaviors in a digital environment: A pre-study. In Proceedings of the 16th Annual Joint Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201911). ACM, New York, NY, 198\u2013202."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366921"},{"key":"e_1_3_2_58_2","first-page":"185","volume-title":"Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1 (ITiCSE\u00a0\u201921)","author":"Lin Shu","year":"2021","unstructured":"Shu Lin, Na Meng, Dennis Kafura, and Wenxin Li. 2021. PDL: Scaffolding problem solving in programming courses. In Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1 (ITiCSE\u00a0\u201921). ACM, New York, NY, 185\u2013191."},{"key":"e_1_3_2_59_2","first-page":"284","volume-title":"Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 (SIGCSE\u00a0\u201923)","author":"Luu Michael","year":"2023","unstructured":"Michael Luu, Matthew Ferland, Varun Nagaraj Rao, Arushi Arora, Randy Huynh, Frederick Reiber, Jennifer Wong-Ma, and Michael Shindler. 2023. What is an algorithms course? Survey results of introductory undergraduate algorithms courses in the U.S. In Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1 (SIGCSE\u00a0\u201923). ACM, New York, NY, 284\u2013290."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3293881.3295779"},{"key":"e_1_3_2_61_2","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1145\/3291279.3339409","volume-title":"Proceedings of the 2019 ACM Conference on International Computing Education Research (ICER\u00a0\u201919)","author":"Malmi Lauri","year":"2019","unstructured":"Lauri Malmi, Judy Sheard, P\u00e4ivi Kinnunen, Simon, and Jane Sinclair. 2019. Computing education theories: What are they and how are they used? In Proceedings of the 2019 ACM Conference on International Computing Education Research (ICER\u00a0\u201919). ACM, New York, NY, 187\u2013197."},{"issue":"1","key":"e_1_3_2_62_2","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1145\/1217862.1217864","article-title":"Moving digital libraries into the student learning space: The GetSmart experience","volume":"6","author":"Marshall Byron B.","year":"2006","unstructured":"Byron B. Marshall, Hsinchun Chen, Rao Shen, and Edward A. Fox. 2006. Moving digital libraries into the student learning space: The GetSmart experience. Journal on Educational Resources in Computing 6, 1 (Mar. 2006), 2\u2013es.","journal-title":"Journal on Educational Resources in Computing"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/971300.971360"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/2325296.2325310"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339422"},{"key":"e_1_3_2_66_2","first-page":"109","volume-title":"Proceedings of the 31st SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201900)","author":"Naps Thomas L.","year":"2000","unstructured":"Thomas L. Naps, James R. Eagan, and Laura L. Norton. 2000. JHAV\u00c9\u2014An environment to actively engage students in web-based algorithm visualizations. In Proceedings of the 31st SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201900). ACM, New York, NY, 109\u2013113."},{"key":"e_1_3_2_67_2","first-page":"323","volume-title":"Proceedings of the 2022 ACM Conference on International Computing Education Research (ICER\u00a0\u201922)","author":"Oleson Alannah","year":"2022","unstructured":"Alannah Oleson, Benjamin Xie, Jean Salac, Jayne Everson, F. Megumi Kivuva, and Amy J. Ko. 2022. A decade of demographics in computing education research: A critical review of trends in collection, reporting, and use. In Proceedings of the 2022 ACM Conference on International Computing Education Research (ICER\u00a0\u201922), Vol. 1. ACM, New York, NY, 323\u2013343."},{"key":"e_1_3_2_68_2","unstructured":"Taylor & Francis Online. 2024. Computer Science Education. Retrieved from https:\/\/www.tandfonline.com\/journals\/ncse20"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/1140124.1140129"},{"key":"e_1_3_2_70_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1145\/2445196.2445212","volume-title":"Proceeding of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201913)","author":"Paul Wolfgang","year":"2013","unstructured":"Wolfgang Paul and Jan Vahrenhold. 2013. Hunting high and low: Instruments to detect misconceptions related to algorithms and data structures. In Proceeding of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201913). ACM, New York, NY, 29\u201334."},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/1121341.1121439"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3197091.3197128"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3372782.3406263"},{"key":"e_1_3_2_74_2","first-page":"13","article-title":"A guide to writing the dissertation literature review","volume":"14","author":"Randolph Justus","year":"2009","unstructured":"Justus Randolph. 2009. A guide to writing the dissertation literature review. Practical Assessment, Research, and Evaluation 14, Article 13 (2009).","journal-title":"Practical Assessment, Research, and Evaluation"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/191029.191057"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/1047344.1047452"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339408"},{"issue":"1","key":"e_1_3_2_78_2","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1145\/1227504.1227366","article-title":"Algorithm visualization: A report on the state of the field","volume":"39","author":"Shaffer Clifford A.","year":"2007","unstructured":"Clifford A. Shaffer, Matthew Cooper, and Stephen H. Edwards. 2007. Algorithm visualization: A report on the state of the field. SIGCSE Bulletin 39, 1 (Mar. 2007), 150\u2013154.","journal-title":"SIGCSE Bulletin"},{"issue":"3","key":"e_1_3_2_79_2","first-page":"22","article-title":"Algorithm visualization: The state of the field","volume":"10","author":"Shaffer Clifford A.","year":"2010","unstructured":"Clifford A. Shaffer, Matthew L. Cooper, Alexander Joel D. Alon, Monika Akbar, Michael Stewart, Sean Ponce, and Stephen H. Edwards. 2010. Algorithm visualization: The state of the field. ACM Transactions on Computing Education 10, 3, Article 9 (Aug. 2010), 22 pages.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/1584322.1584334"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2022.2079865"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1080\/08993400701538021"},{"key":"e_1_3_2_83_2","first-page":"119","volume-title":"Proceedings of the 7th Baltic Sea Conference on Computing Education Research (Koli Calling\u00a0\u201907)","author":"Simon","year":"2007","unstructured":"Simon. 2007. Koli calling comes of age: An analysis. In Proceedings of the 7th Baltic Sea Conference on Computing Education Research (Koli Calling\u00a0\u201907), Vol. 88. Australian Computer Society, Inc., AUS, 119\u2013126."},{"key":"e_1_3_2_84_2","first-page":"25","volume-title":"Proceedings of the 28th SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201997)","author":"Stasko John T.","year":"1997","unstructured":"John T. Stasko. 1997. Using student-built algorithm animations as learning aids. In Proceedings of the 28th SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201997). ACM, New York, NY, 25\u201329."},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/2401796.2401806"},{"key":"e_1_3_2_86_2","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1145\/1508865.1509038","volume-title":"Proceedings of the 40th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201909)","author":"Taylor David Scot","year":"2009","unstructured":"David Scot Taylor, Andrei F. Lurie, Cay S. Horstmenn, Menko B. Johnson, Sean K. Sharma, and Edward C. Yin. 2009. Predictive vs. passive animation learning tools. In Proceedings of the 40th ACM Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201909). ACM, New York, NY, 494\u2013498."},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3230977.3230980"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2014.970782"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017697"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/2325296.2325311"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/2534972"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.1145\/3304221.3319749"},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899451"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899450"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366816"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569765"},{"key":"e_1_3_2_97_2","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1145\/1121341.1121395","volume-title":"Proceedings of the 37th SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201906)","author":"Winters Titus","year":"2006","unstructured":"Titus Winters and Tom Payne. 2006. Closing the loop on test creation: A question assessment mechanism for instructors. In Proceedings of the 37th SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u00a0\u201906). ACM, New York, NY, 169\u2013170."},{"key":"e_1_3_2_98_2","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569728"},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159528"},{"key":"e_1_3_2_100_2","first-page":"89","volume-title":"Proceedings of the 5th Annual SIGCSE\/SIGCUE ITiCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201900)","author":"Andreas Zeller","year":"2000","unstructured":"Andreas Zeller. 2000. Making students read and review code. In Proceedings of the 5th Annual SIGCSE\/SIGCUE ITiCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE\u00a0\u201900). ACM, New York, NY, 89\u201392."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727987","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3727987","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:57:24Z","timestamp":1750298244000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727987"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,20]]},"references-count":99,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3727987"],"URL":"https:\/\/doi.org\/10.1145\/3727987","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,20]]},"assertion":[{"value":"2024-07-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}