{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:12:02Z","timestamp":1776107522352,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":95,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:00:00Z","timestamp":1659484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,8,3]]},"DOI":"10.1145\/3501385.3543957","type":"proceedings-article","created":{"date-parts":[[2022,8,4]],"date-time":"2022-08-04T04:08:58Z","timestamp":1659586138000},"page":"27-43","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":370,"title":["Automatic Generation of Programming Exercises and Code Explanations Using Large Language Models"],"prefix":"10.1145","author":[{"given":"Sami","family":"Sarsa","sequence":"first","affiliation":[{"name":"Aalto University, Finland"}]},{"given":"Paul","family":"Denny","sequence":"additional","affiliation":[{"name":"The University of Auckland, New Zealand"}]},{"given":"Arto","family":"Hellas","sequence":"additional","affiliation":[{"name":"Aalto University, Finland"}]},{"given":"Juho","family":"Leinonen","sequence":"additional","affiliation":[{"name":"Aalto University, Finland"}]}],"member":"320","published-online":{"date-parts":[[2022,8,3]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159493"},{"key":"e_1_3_2_1_2_1","volume-title":"A survey of automated assessment approaches for programming assignments. Computer science education 15, 2","author":"Ala-Mutka M","year":"2005","unstructured":"Kirsti\u00a0 M Ala-Mutka . 2005. A survey of automated assessment approaches for programming assignments. Computer science education 15, 2 ( 2005 ), 83\u2013102. Kirsti\u00a0M Ala-Mutka. 2005. A survey of automated assessment approaches for programming assignments. Computer science education 15, 2 (2005), 83\u2013102."},{"key":"e_1_3_2_1_3_1","article-title":"Plagiarism in Programming Assessments","volume":"20","author":"Albluwi Ibrahim","year":"2019","unstructured":"Ibrahim Albluwi . 2019 . Plagiarism in Programming Assessments : A Systematic Review. ACM Trans. Comput. Educ. 20 , 1, Article 6 (dec 2019), 28\u00a0pages. https:\/\/doi.org\/10.1145\/3371156 10.1145\/3371156 Ibrahim Albluwi. 2019. Plagiarism in Programming Assessments: A Systematic Review. ACM Trans. Comput. Educ. 20, 1, Article 6 (dec 2019), 28\u00a0pages. https:\/\/doi.org\/10.1145\/3371156","journal-title":"A Systematic Review. ACM Trans. Comput. Educ."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.18260\/1-2--31231"},{"key":"e_1_3_2_1_5_1","unstructured":"Cory Althoff. 2022. The Self-Taught Programmer: The Definitive Guide to Programming Professionally. Hachette UK.  Cory Althoff. 2022. The Self-Taught Programmer: The Definitive Guide to Programming Professionally. Hachette UK."},{"key":"e_1_3_2_1_6_1","volume-title":"Self-efficacy: toward a unifying theory of behavioral change.Psychological review 84, 2","author":"Bandura Albert","year":"1977","unstructured":"Albert Bandura . 1977. Self-efficacy: toward a unifying theory of behavioral change.Psychological review 84, 2 ( 1977 ). Albert Bandura. 1977. Self-efficacy: toward a unifying theory of behavioral change.Psychological review 84, 2 (1977)."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432430"},{"key":"e_1_3_2_1_8_1","volume-title":"Kevin F. Collis","author":"Biggs B.","unstructured":"John\u00a0 B. Biggs and K.\u00a0 F. Collis . 1982. Evaluating the quality of learning : the SOLO taxonomy (structure of the observed learning outcome) \/ John B. Biggs , Kevin F. Collis . Academic Press New York . xiii, 245 p. : pages. John\u00a0B. Biggs and K.\u00a0F. Collis. 1982. Evaluating the quality of learning : the SOLO taxonomy (structure of the observed learning outcome) \/ John B. Biggs, Kevin F. Collis. Academic Press New York. xiii, 245 p. : pages."},{"key":"e_1_3_2_1_9_1","unstructured":"Tom\u00a0B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel\u00a0M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in neural information processing systems. 1877\u20131901.  Tom\u00a0B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel\u00a0M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in neural information processing systems. 1877\u20131901."},{"key":"e_1_3_2_1_10_1","volume-title":"A Validated Scoring Rubric for Explain-in-Plain-English Questions","author":"Chen Binglin","unstructured":"Binglin Chen , Sushmita Azad , Rajarshi Haldar , Matthew West , and Craig Zilles . 2020. A Validated Scoring Rubric for Explain-in-Plain-English Questions . Association for Computing Machinery , New York, NY, USA , 563\u2013569. https:\/\/doi.org\/10.1145\/3328778.3366879 10.1145\/3328778.3366879 Binglin Chen, Sushmita Azad, Rajarshi Haldar, Matthew West, and Craig Zilles. 2020. A Validated Scoring Rubric for Explain-in-Plain-English Questions. Association for Computing Machinery, New York, NY, USA, 563\u2013569. https:\/\/doi.org\/10.1145\/3328778.3366879"},{"key":"e_1_3_2_1_11_1","volume-title":"Jared Kaplan, Harri Edwards, Yuri Burda","author":"Chen Mark","year":"2021","unstructured":"Mark Chen , Jerry Tworek , Heewoo Jun , Qiming Yuan , Henrique Ponde de\u00a0Oliveira Pinto , Jared Kaplan, Harri Edwards, Yuri Burda , Nicholas Joseph, Greg Brockman , 2021 . Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374(2021). Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de\u00a0Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, 2021. Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374(2021)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Matteo Ciniselli Luca Pascarella and Gabriele Bavota. 2022. To What Extent do Deep Learning-based Code Recommenders Generate Predictions by Cloning Code from the Training Set?arXiv preprint arXiv:2204.06894(2022).  Matteo Ciniselli Luca Pascarella and Gabriele Bavota. 2022. To What Extent do Deep Learning-based Code Recommenders Generate Predictions by Cloning Code from the Training Set?arXiv preprint arXiv:2204.06894(2022).","DOI":"10.1145\/3524842.3528440"},{"key":"e_1_3_2_1_13_1","volume-title":"Peer instruction: Ten years of experience and results. American journal of physics 69, 9","author":"Crouch H","year":"2001","unstructured":"Catherine\u00a0 H Crouch and Eric Mazur . 2001. Peer instruction: Ten years of experience and results. American journal of physics 69, 9 ( 2001 ), 970\u2013977. Catherine\u00a0H Crouch and Eric Mazur. 2001. Peer instruction: Ten years of experience and results. American journal of physics 69, 9 (2001), 970\u2013977."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2828959.2828967"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953299"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3059033"},{"key":"#cr-split#-e_1_3_2_1_17_1.1","unstructured":"Iddo Drori Sarah Zhang Reece Shuttleworth Leonard Tang Albert Lu Elizabeth Ke Kevin Liu Linda Chen Sunny Tran Newman Cheng Roman Wang Nikhil Singh Taylor\u00a0L. Patti Jayson Lynch Avi Shporer Nakul Verma Eugene Wu and Gilbert Strang. 2021. A Neural Network Solves Explains and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Level. https:\/\/doi.org\/10.48550\/ARXIV.2112.15594 10.48550\/ARXIV.2112.15594"},{"key":"#cr-split#-e_1_3_2_1_17_1.2","doi-asserted-by":"crossref","unstructured":"Iddo Drori Sarah Zhang Reece Shuttleworth Leonard Tang Albert Lu Elizabeth Ke Kevin Liu Linda Chen Sunny Tran Newman Cheng Roman Wang Nikhil Singh Taylor\u00a0L. Patti Jayson Lynch Avi Shporer Nakul Verma Eugene Wu and Gilbert Strang. 2021. A Neural Network Solves Explains and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Level. https:\/\/doi.org\/10.48550\/ARXIV.2112.15594","DOI":"10.1073\/pnas.2123433119"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373165.3373187"},{"key":"e_1_3_2_1_19_1","unstructured":"Angela\u00a0Lee Duckworth and Lauren Eskreis-Winkler. 2013. True grit. Aps Observer 26(2013).  Angela\u00a0Lee Duckworth and Lauren Eskreis-Winkler. 2013. True grit. Aps Observer 26(2013)."},{"key":"e_1_3_2_1_20_1","unstructured":"Rodrigo Duran Albina Zavgorodniaia and Juha Sorva. 2021. Cognitive Load Theory in Computing Education Research: A Review. (2021). http:\/\/rodrigoduran.net\/papers\/CLT_in_CER.pdf Preprint.  Rodrigo Duran Albina Zavgorodniaia and Juha Sorva. 2021. Cognitive Load Theory in Computing Education Research: A Review. (2021). http:\/\/rodrigoduran.net\/papers\/CLT_in_CER.pdf Preprint."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372782.3406259"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1473195.1473240"},{"key":"e_1_3_2_1_23_1","volume-title":"The role of deliberate practice in the acquisition of expert performance.Psychological review 100, 3","author":"Ericsson K\u00a0Anders","year":"1993","unstructured":"K\u00a0Anders Ericsson , Ralf\u00a0 T Krampe , and Clemens Tesch-R\u00f6mer . 1993. The role of deliberate practice in the acquisition of expert performance.Psychological review 100, 3 ( 1993 ), 363. K\u00a0Anders Ericsson, Ralf\u00a0T Krampe, and Clemens Tesch-R\u00f6mer. 1993. The role of deliberate practice in the acquisition of expert performance.Psychological review 100, 3 (1993), 363."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3160489.3160493"},{"key":"e_1_3_2_1_25_1","volume-title":"Pedagogical approaches","author":"Falkner Katrina","unstructured":"Katrina Falkner and Judy Sheard . 2019. Pedagogical approaches ( 1 st ed.). Cambridge University Press , United Kingdom , 445\u2013480. https:\/\/doi.org\/10.1017\/9781108654555.016 10.1017\/9781108654555.016 Katrina Falkner and Judy Sheard. 2019. Pedagogical approaches(1st ed.). Cambridge University Press, United Kingdom, 445\u2013480. https:\/\/doi.org\/10.1017\/9781108654555.016","edition":"1"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng Ming Gong Linjun Shou Bing Qin Ting Liu Daxin Jiang 2020. CodeBERT: A pre-trained model for programming and natural languages. arXiv preprint arXiv:2002.08155(2020).  Zhangyin Feng Daya Guo Duyu Tang Nan Duan Xiaocheng Feng Ming Gong Linjun Shou Bing Qin Ting Liu Daxin Jiang 2020. CodeBERT: A pre-trained model for programming and natural languages. arXiv preprint arXiv:2002.08155(2020).","DOI":"10.18653\/v1\/2020.findings-emnlp.139"},{"key":"e_1_3_2_1_27_1","volume-title":"The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conference. 10\u201319","author":"Finnie-Ansley James","year":"2022","unstructured":"James Finnie-Ansley , Paul Denny , Brett\u00a0 A Becker , Andrew Luxton-Reilly , and James Prather . 2022 . The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conference. 10\u201319 . James Finnie-Ansley, Paul Denny, Brett\u00a0A Becker, Andrew Luxton-Reilly, and James Prather. 2022. The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conference. 10\u201319."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632320.2632346"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432539"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2011.579808"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3446871.3469765"},{"key":"e_1_3_2_1_32_1","volume-title":"The power of feedback. Review of educational research 77, 1","author":"Hattie John","year":"2007","unstructured":"John Hattie and Helen Timperley . 2007. The power of feedback. Review of educational research 77, 1 ( 2007 ), 81\u2013112. John Hattie and Helen Timperley. 2007. The power of feedback. Review of educational research 77, 1 (2007), 81\u2013112."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3059065"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445451"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1930464.1930480"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TALE.2018.8615375"},{"key":"e_1_3_2_1_37_1","unstructured":"MA Jenkins and Joseph\u00a0Frederick Traub. 1967. An algorithm for an automatic general polynomial solver. Citeseer.  MA Jenkins and Joseph\u00a0Frederick Traub. 1967. An algorithm for an automatic general polynomial solver. Citeseer."},{"key":"e_1_3_2_1_38_1","volume-title":"An analysis and survey of the development of mutation testing","author":"Jia Yue","year":"2010","unstructured":"Yue Jia and Mark Harman . 2010. An analysis and survey of the development of mutation testing . IEEE transactions on software engineering 37, 5 ( 2010 ), 649\u2013678. Yue Jia and Mark Harman. 2010. An analysis and survey of the development of mutation testing. IEEE transactions on software engineering 37, 5 (2010), 649\u2013678."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341525.3387392"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3231711"},{"key":"e_1_3_2_1_41_1","volume-title":"Learnersourcing: improving learning with collective learner activity. Ph.\u00a0D. Dissertation","author":"Kim Juho","unstructured":"Juho Kim . 2015. Learnersourcing: improving learning with collective learner activity. Ph.\u00a0D. Dissertation . Massachusetts Institute of Technology . Juho Kim. 2015. Learnersourcing: improving learning with collective learner activity. Ph.\u00a0D. Dissertation. Massachusetts Institute of Technology."},{"key":"e_1_3_2_1_42_1","unstructured":"Takeshi Kojima Shixiang\u00a0Shane Gu Machel Reid Yutaka Matsuo and Yusuke Iwasawa. 2022. Large Language Models are Zero-Shot Reasoners. arXiv preprint arXiv:2205.11916(2022).  Takeshi Kojima Shixiang\u00a0Shane Gu Machel Reid Yutaka Matsuo and Yusuke Iwasawa. 2022. Large Language Models are Zero-Shot Reasoners. arXiv preprint arXiv:2205.11916(2022)."},{"key":"e_1_3_2_1_43_1","volume-title":"Automatically. In 2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). IEEE, 467\u2013475","author":"Lehtinen Teemu","year":"2021","unstructured":"Teemu Lehtinen , Andr\u00e9\u00a0 L Santos , and Juha Sorva . 2021 . Let\u2019s Ask Students About Their Programs , Automatically. In 2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). IEEE, 467\u2013475 . Teemu Lehtinen, Andr\u00e9\u00a0L Santos, and Juha Sorva. 2021. Let\u2019s Ask Students About Their Programs, Automatically. In 2021 IEEE\/ACM 29th International Conference on Program Comprehension (ICPC). IEEE, 467\u2013475."},{"key":"e_1_3_2_1_44_1","volume-title":"Exploring the Effects of Contextualized Problem Descriptions on Problem Solving. In Australasian Computing Education Conference (Virtual, SA, Australia) (ACE \u201921)","author":"Leinonen Juho","year":"2021","unstructured":"Juho Leinonen , Paul Denny , and Jacqueline Whalley . 2021 . Exploring the Effects of Contextualized Problem Descriptions on Problem Solving. In Australasian Computing Education Conference (Virtual, SA, Australia) (ACE \u201921) . Association for Computing Machinery, New York, NY, USA, 30\u201339. https:\/\/doi.org\/10.1145\/3441636.3442302 10.1145\/3441636.3442302 Juho Leinonen, Paul Denny, and Jacqueline Whalley. 2021. Exploring the Effects of Contextualized Problem Descriptions on Problem Solving. In Australasian Computing Education Conference (Virtual, SA, Australia) (ACE \u201921). Association for Computing Machinery, New York, NY, USA, 30\u201339. https:\/\/doi.org\/10.1145\/3441636.3442302"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478431.3499372"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899472"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341525.3387385"},{"key":"e_1_3_2_1_48_1","unstructured":"Yujia Li David Choi Junyoung Chung Nate Kushman Julian Schrittwieser R\u00e9mi Leblond Tom Eccles James Keeling Felix Gimeno Agustin\u00a0Dal Lago 2022. Competition-Level Code Generation with AlphaCode. arXiv preprint arXiv:2203.07814(2022).  Yujia Li David Choi Junyoung Chung Nate Kushman Julian Schrittwieser R\u00e9mi Leblond Tom Eccles James Keeling Felix Gimeno Agustin\u00a0Dal Lago 2022. Competition-Level Code Generation with AlphaCode. arXiv preprint arXiv:2203.07814(2022)."},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442481.3442498"},{"key":"e_1_3_2_1_50_1","volume-title":"A Multi-National Study of Reading and Tracing Skills in Novice Programmers","author":"Lister Raymond","unstructured":"Raymond Lister , Elizabeth\u00a0 S. Adams , Sue Fitzgerald , William Fone , John Hamer , Morten Lindholm , Robert McCartney , Jan\u00a0Erik Mostr\u00f6m , Kate Sanders , Otto Sepp\u00e4l\u00e4 , Beth Simon , and Lynda Thomas . 2004. A Multi-National Study of Reading and Tracing Skills in Novice Programmers . In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education (Leeds, United Kingdom) (ITiCSE-WGR \u201904). Association for Computing Machinery, New York, NY, USA, 119\u2013150. https:\/\/doi.org\/10.1145\/1044550.1041673 10.1145\/1044550.1041673 Raymond Lister, Elizabeth\u00a0S. Adams, Sue Fitzgerald, William Fone, John Hamer, Morten Lindholm, Robert McCartney, Jan\u00a0Erik Mostr\u00f6m, Kate Sanders, Otto Sepp\u00e4l\u00e4, Beth Simon, and Lynda Thomas. 2004. A Multi-National Study of Reading and Tracing Skills in Novice Programmers. In Working Group Reports from ITiCSE on Innovation and Technology in Computer Science Education (Leeds, United Kingdom) (ITiCSE-WGR \u201904). Association for Computing Machinery, New York, NY, USA, 119\u2013150. https:\/\/doi.org\/10.1145\/1044550.1041673"},{"key":"e_1_3_2_1_51_1","first-page":"3","article-title":"Further Evidence of a Relationship between Explaining","volume":"41","author":"Lister Raymond","year":"2009","unstructured":"Raymond Lister , Colin Fidge , and Donna Teague . 2009 . Further Evidence of a Relationship between Explaining , Tracing and Writing Skills in Introductory Programming. SIGCSE Bull. 41 , 3 (jul 2009), 161\u2013165. https:\/\/doi.org\/10.1145\/1595496.1562930 10.1145\/1595496.1562930 Raymond Lister, Colin Fidge, and Donna Teague. 2009. Further Evidence of a Relationship between Explaining, Tracing and Writing Skills in Introductory Programming. SIGCSE Bull. 41, 3 (jul 2009), 161\u2013165. https:\/\/doi.org\/10.1145\/1595496.1562930","journal-title":"Tracing and Writing Skills in Introductory Programming. SIGCSE Bull."},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140123.1140157"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2810041"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2828959.2828960"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400802114581"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2361276.2361299"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159500"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3304221.3319768"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351287.3351288"},{"key":"e_1_3_2_1_60_1","volume-title":"Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Transactions on Computing Education (TOCE)","author":"Paiva Jos\u00e9\u00a0Carlos","year":"2022","unstructured":"Jos\u00e9\u00a0Carlos Paiva , Jos\u00e9\u00a0Paulo Leal , and \u00c1lvaro Figueira . 2022. Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Transactions on Computing Education (TOCE) ( 2022 ). Jos\u00e9\u00a0Carlos Paiva, Jos\u00e9\u00a0Paulo Leal, and \u00c1lvaro Figueira. 2022. Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Transactions on Computing Education (TOCE) (2022)."},{"key":"e_1_3_2_1_61_1","unstructured":"Hammond Pearce Benjamin Tan Baleegh Ahmad Ramesh Karri and Brendan Dolan-Gavitt. 2021. Can OpenAI Codex and Other Large Language Models Help Us Fix Security Bugs?arXiv preprint arXiv:2112.02125(2021).  Hammond Pearce Benjamin Tan Baleegh Ahmad Ramesh Karri and Brendan Dolan-Gavitt. 2021. Can OpenAI Codex and Other Large Language Models Help Us Fix Security Bugs?arXiv preprint arXiv:2112.02125(2021)."},{"key":"e_1_3_2_1_62_1","unstructured":"Hammond Pearce Benjamin Tan Prashanth Krishnamurthy Farshad Khorrami Ramesh Karri and Brendan Dolan-Gavitt. 2022. Pop Quiz! Can a Large Language Model Help With Reverse Engineering?arXiv preprint arXiv:2202.01142(2022).  Hammond Pearce Benjamin Tan Prashanth Krishnamurthy Farshad Khorrami Ramesh Karri and Brendan Dolan-Gavitt. 2022. Pop Quiz! Can a Large Language Model Help With Reverse Engineering?arXiv preprint arXiv:2202.01142(2022)."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.2190\/GUJT-JCBJ-Q6QU-Q9PL"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505290"},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197091.3197117"},{"key":"e_1_3_2_1_66_1","volume-title":"Proceedings of the 27th ACM Conference on Innovation and Technology in Computer Science Education Vol 1.","author":"Pirttinen Nea","year":"2022","unstructured":"Nea Pirttinen and Juho Leinonen . 2022 . Can Students Review Their Peers? Comparison of Peer and Instructor Reviews . In Proceedings of the 27th ACM Conference on Innovation and Technology in Computer Science Education Vol 1. Nea Pirttinen and Juho Leinonen. 2022. Can Students Review Their Peers? Comparison of Peer and Instructor Reviews. In Proceedings of the 27th ACM Conference on Innovation and Technology in Computer Science Education Vol 1."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159457"},{"key":"e_1_3_2_1_68_1","volume-title":"Unlimited Trace Tutor: Learning Code Tracing With Automatically Generated Programs","author":"Qi Ruixiang","unstructured":"Ruixiang Qi and Davide Fossati . 2020. Unlimited Trace Tutor: Learning Code Tracing With Automatically Generated Programs . Association for Computing Machinery , New York, NY, USA , 427\u2013433. https:\/\/doi.org\/10.1145\/3328778.3366939 10.1145\/3328778.3366939 Ruixiang Qi and Davide Fossati. 2020. Unlimited Trace Tutor: Learning Code Tracing With Automatically Generated Programs. Association for Computing Machinery, New York, NY, USA, 427\u2013433. https:\/\/doi.org\/10.1145\/3328778.3366939"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"crossref","unstructured":"Emily\u00a0Q Rosenzweig Allan Wigfield and Jacquelyne\u00a0S Eccles. 2019. Expectancy-value theory and its relevance for student motivation and learning.(2019).  Emily\u00a0Q Rosenzweig Allan Wigfield and Jacquelyne\u00a0S Eccles. 2019. Expectancy-value theory and its relevance for student motivation and learning.(2019).","DOI":"10.1017\/9781316823279.026"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287504"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/2543882.2543885"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3105726.3106192"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-022-00458-8"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/2828959.2828963"},{"key":"e_1_3_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/1384271.1384328"},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1162\/0011526054622015"},{"key":"e_1_3_2_1_77_1","volume-title":"Focus on formative feedback. Review of educational research 78, 1","author":"Shute J","year":"2008","unstructured":"Valerie\u00a0 J Shute . 2008. Focus on formative feedback. Review of educational research 78, 1 ( 2008 ), 153\u2013189. Valerie\u00a0J Shute. 2008. Focus on formative feedback. Review of educational research 78, 1 (2008), 153\u2013189."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3430895.3460142"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/6592.6594"},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1984.5010283"},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209635.3209639"},{"key":"e_1_3_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1002\/cae.21974"},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/1584322.1584336"},{"key":"e_1_3_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632320.2632349"},{"key":"e_1_3_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953196"},{"key":"e_1_3_2_1_86_1","volume-title":"A surprising effect of feedback on learning. Learning and instruction 15, 6","author":"Vollmeyer Regina","year":"2005","unstructured":"Regina Vollmeyer and Falko Rheinberg . 2005. A surprising effect of feedback on learning. Learning and instruction 15, 6 ( 2005 ), 589\u2013602. Regina Vollmeyer and Falko Rheinberg. 2005. A surprising effect of feedback on learning. Learning and instruction 15, 6 (2005), 589\u2013602."},{"key":"e_1_3_2_1_87_1","volume-title":"Mind in society: Development of higher psychological processes","author":"Vygotsky Lev\u00a0Semenovich","unstructured":"Lev\u00a0Semenovich Vygotsky and Michael Cole . 1978. Mind in society: Development of higher psychological processes . Harvard university press . Lev\u00a0Semenovich Vygotsky and Michael Cole. 1978. Mind in society: Development of higher psychological processes. Harvard university press."},{"key":"e_1_3_2_1_88_1","volume-title":"Proceedings of the 8th Australasian Conference on Computing Education -","volume":"52","author":"Whalley L.","year":"2006","unstructured":"Jacqueline\u00a0 L. Whalley , Raymond Lister , Errol Thompson , Tony Clear , Phil Robbins , P.\u00a0K.\u00a0 Ajith Kumar , and Christine Prasad . 2006 . An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies . In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (Hobart, Australia) (ACE \u201906). Australian Computer Society, Inc., AUS, 243\u2013252. Jacqueline\u00a0L. Whalley, Raymond Lister, Errol Thompson, Tony Clear, Phil Robbins, P.\u00a0K.\u00a0Ajith Kumar, and Christine Prasad. 2006. An Australasian Study of Reading and Comprehension Skills in Novice Programmers, Using the Bloom and SOLO Taxonomies. In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (Hobart, Australia) (ACE \u201906). Australian Computer Society, Inc., AUS, 243\u2013252."},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2876042"},{"key":"e_1_3_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.854064"},{"key":"e_1_3_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230977.3230999"},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2019.1565235"},{"key":"e_1_3_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159527"},{"key":"e_1_3_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287483"}],"event":{"name":"ICER 2022: ACM Conference on International Computing Education Research","location":"Lugano and Virtual Event Switzerland","acronym":"ICER 2022","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the 2022 ACM Conference on International Computing Education Research - Volume 1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501385.3543957","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3501385.3543957","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:19Z","timestamp":1750188619000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501385.3543957"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,3]]},"references-count":95,"alternative-id":["10.1145\/3501385.3543957","10.1145\/3501385"],"URL":"https:\/\/doi.org\/10.1145\/3501385.3543957","relation":{},"subject":[],"published":{"date-parts":[[2022,8,3]]},"assertion":[{"value":"2022-08-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}