{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T04:08:23Z","timestamp":1778213303852,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":88,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,7]],"date-time":"2023-08-07T00:00:00Z","timestamp":1691366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ulla Tuominen Foundation"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,7]]},"DOI":"10.1145\/3568813.3600139","type":"proceedings-article","created":{"date-parts":[[2023,9,10]],"date-time":"2023-09-10T15:33:07Z","timestamp":1694359987000},"page":"93-105","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":114,"title":["Exploring the Responses of Large Language Models to Beginner Programmers\u2019 Help Requests"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6502-209X","authenticated-orcid":false,"given":"Arto","family":"Hellas","sequence":"first","affiliation":[{"name":"Aalto University, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6829-9449","authenticated-orcid":false,"given":"Juho","family":"Leinonen","sequence":"additional","affiliation":[{"name":"The University of Auckland, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7277-9282","authenticated-orcid":false,"given":"Sami","family":"Sarsa","sequence":"additional","affiliation":[{"name":"Aalto University, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2272-2763","authenticated-orcid":false,"given":"Charles","family":"Koutcheme","sequence":"additional","affiliation":[{"name":"Aalto University, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0205-7003","authenticated-orcid":false,"given":"Lilja","family":"Kujanp\u00e4\u00e4","sequence":"additional","affiliation":[{"name":"Aalto University, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-1727-1317","authenticated-orcid":false,"given":"Juha","family":"Sorva","sequence":"additional","affiliation":[{"name":"Aalto University, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,9,10]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787717"},{"key":"e_1_3_2_1_2_1","volume-title":"A survey of automated assessment approaches for programming assignments. Computer science education 15, 2","author":"Ala-Mutka M","year":"2005","unstructured":"Kirsti\u00a0 M Ala-Mutka . 2005. A survey of automated assessment approaches for programming assignments. Computer science education 15, 2 ( 2005 ), 83\u2013102. Kirsti\u00a0M Ala-Mutka. 2005. A survey of automated assessment approaches for programming assignments. Computer science education 15, 2 (2005), 83\u2013102."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676723.2677258"},{"key":"e_1_3_2_1_4_1","volume-title":"Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473","author":"Bahdanau Dzmitry","year":"2014","unstructured":"Dzmitry Bahdanau , Kyunghyun Cho , and Yoshua Bengio . 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 ( 2014 ). Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899463"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Brett\u00a0A. Becker Paul Denny James Finnie-Ansley Andrew Luxton-Reilly James Prather and Eddie\u00a0Antonio Santos. 2022. Programming Is Hard \u2013 Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generation.  Brett\u00a0A. Becker Paul Denny James Finnie-Ansley Andrew Luxton-Reilly James Prather and Eddie\u00a0Antonio Santos. 2022. Programming Is Hard \u2013 Or at Least It Used to Be: Educational Opportunities And Challenges of AI Code Generation.","DOI":"10.1145\/3545945.3569759"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3344429.3372508"},{"key":"e_1_3_2_1_8_1","unstructured":"Gary D\u00a0Borich Borich. 2005. Educational psychology: A contemporary approach.  Gary D\u00a0Borich Borich. 2005. Educational psychology: A contemporary approach."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632320.2632343"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994154"},{"key":"e_1_3_2_1_11_1","volume-title":"Language models are few-shot learners. Advances in neural information processing systems 33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown , Benjamin Mann , Nick Ryder , Melanie Subbiah , Jared\u00a0 D Kaplan , Prafulla Dhariwal , Arvind Neelakantan , Pranav Shyam , Girish Sastry , Amanda Askell , 2020. Language models are few-shot learners. Advances in neural information processing systems 33 ( 2020 ), 1877\u20131901. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared\u00a0D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877\u20131901."},{"key":"e_1_3_2_1_12_1","volume-title":"Determinants of help seeking: Relations between perceived reasons for classroom help-avoidance and help-seeking behaviors in an experimental context.J. of Educ. Psychology 90, 4","author":"Butler Ruth","year":"1998","unstructured":"Ruth Butler . 1998. Determinants of help seeking: Relations between perceived reasons for classroom help-avoidance and help-seeking behaviors in an experimental context.J. of Educ. Psychology 90, 4 ( 1998 ). Ruth Butler. 1998. Determinants of help seeking: Relations between perceived reasons for classroom help-avoidance and help-seeking behaviors in an experimental context.J. of Educ. Psychology 90, 4 (1998)."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787710"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Paul Denny Viraj Kumar and Nasser Giacaman. 2022. Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language.  Paul Denny Viraj Kumar and Nasser Giacaman. 2022. Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language.","DOI":"10.1145\/3545945.3569823"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2325296.2325318"},{"key":"e_1_3_2_1_16_1","volume-title":"Computing Education in the Era of Generative AI. arXiv preprint arXiv:2306.02608","author":"Denny Paul","year":"2023","unstructured":"Paul Denny , James Prather , Brett\u00a0 A Becker , James Finnie-Ansley , Arto Hellas , Juho Leinonen , Andrew Luxton-Reilly , Brent\u00a0 N Reeves , Eddie\u00a0Antonio Santos , and Sami Sarsa . 2023. Computing Education in the Era of Generative AI. arXiv preprint arXiv:2306.02608 ( 2023 ). Paul Denny, James Prather, Brett\u00a0A Becker, James Finnie-Ansley, Arto Hellas, Juho Leinonen, Andrew Luxton-Reilly, Brent\u00a0N Reeves, Eddie\u00a0Antonio Santos, and Sami Sarsa. 2023. Computing Education in the Era of Generative AI. arXiv preprint arXiv:2306.02608 (2023)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445696"},{"key":"e_1_3_2_1_18_1","volume-title":"Robosourcing Educational Resources\u2013Leveraging Large Language Models for Learnersourcing. arXiv preprint arXiv:2211.04715","author":"Denny Paul","year":"2022","unstructured":"Paul Denny , Sami Sarsa , Arto Hellas , and Juho Leinonen . 2022. Robosourcing Educational Resources\u2013Leveraging Large Language Models for Learnersourcing. arXiv preprint arXiv:2211.04715 ( 2022 ). Paul Denny, Sami Sarsa, Arto Hellas, and Juho Leinonen. 2022. Robosourcing Educational Resources\u2013Leveraging Large Language Models for Learnersourcing. arXiv preprint arXiv:2211.04715 (2022)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1163405.1163409"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1930464.1930485"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3160489.3160493"},{"key":"e_1_3_2_1_22_1","volume-title":"The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conf.ACM, 10\u201319","author":"Finnie-Ansley James","year":"2022","unstructured":"James Finnie-Ansley , Paul Denny , Brett\u00a0 A. Becker , Andrew Luxton-Reilly , and James Prather . 2022 . The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conf.ACM, 10\u201319 . James Finnie-Ansley, Paul Denny, Brett\u00a0A. Becker, Andrew Luxton-Reilly, and James Prather. 2022. The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Australasian Computing Education Conf.ACM, 10\u201319."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3576123.3576134"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699751"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3051457.3051467"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3059065"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3300115.3309508"},{"key":"e_1_3_2_1_28_1","volume-title":"Long short-term memory. Neural computation 9, 8","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber . 1997. Long short-term memory. Neural computation 9, 8 ( 1997 ), 1735\u20131780. Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735\u20131780."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1930464.1930480"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2656450.2656476"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858796.2858798"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400500056530"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1151588.1151600"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3571785.3574124"},{"key":"e_1_3_2_1_35_1","volume-title":"Survey of hallucination in natural language generation. Comput. Surveys","author":"Ji Ziwei","year":"2022","unstructured":"Ziwei Ji , Nayeon Lee , Rita Frieske , Tiezheng Yu , Dan Su , Yan Xu , Etsuko Ishii , Yejin Bang , Andrea Madotto , and Pascale Fung . 2022. Survey of hallucination in natural language generation. Comput. Surveys ( 2022 ). Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Yejin Bang, Andrea Madotto, and Pascale Fung. 2022. Survey of hallucination in natural language generation. Comput. Surveys (2022)."},{"key":"e_1_3_2_1_36_1","volume-title":"Bug Catalogue: I. Technical Report","author":"Johnson Lewis","year":"1983","unstructured":"W.\u00a0 Lewis Johnson , Elliot Soloway , Benjamin Cutler , and Steven Draper . 1983 . Bug Catalogue: I. Technical Report . Yale University , YaleU\/CSD\/ RR #286. W.\u00a0Lewis Johnson, Elliot Soloway, Benjamin Cutler, and Steven Draper. 1983. Bug Catalogue: I. Technical Report. Yale University, YaleU\/CSD\/RR #286."},{"key":"e_1_3_2_1_37_1","volume-title":"Expertise reversal effect and its implications for learner-tailored instruction. Educational psychology review 19","author":"Kalyuga Slava","year":"2007","unstructured":"Slava Kalyuga . 2007. Expertise reversal effect and its implications for learner-tailored instruction. Educational psychology review 19 ( 2007 ), 509\u2013539. Slava Kalyuga. 2007. Expertise reversal effect and its implications for learner-tailored instruction. Educational psychology review 19 (2007), 509\u2013539."},{"key":"e_1_3_2_1_38_1","volume-title":"Perceived achievement goal structure and college student help seeking.J of educational psychology 96, 3","author":"Karabenick A","year":"2004","unstructured":"Stuart\u00a0 A Karabenick . 2004. Perceived achievement goal structure and college student help seeking.J of educational psychology 96, 3 ( 2004 ). Stuart\u00a0A Karabenick. 2004. Perceived achievement goal structure and college student help seeking.J of educational psychology 96, 3 (2004)."},{"key":"e_1_3_2_1_39_1","volume-title":"Barbara\u00a0J Ericson, David Weintrop, and Tovi Grossman.","author":"Kazemitabaar Majeed","year":"2023","unstructured":"Majeed Kazemitabaar , Justin Chow , Carl Ka\u00a0To Ma , Barbara\u00a0J Ericson, David Weintrop, and Tovi Grossman. 2023 . Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming . arXiv preprint arXiv:2302.07427 (2023). Majeed Kazemitabaar, Justin Chow, Carl Ka\u00a0To Ma, Barbara\u00a0J Ericson, David Weintrop, and Tovi Grossman. 2023. Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory Programming. arXiv preprint arXiv:2302.07427 (2023)."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3231711"},{"key":"e_1_3_2_1_41_1","volume-title":"Evaluating CodeClusters for Effectively Providing Feedback on Code Submissions. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20139.","author":"Koivisto Teemu","year":"2022","unstructured":"Teemu Koivisto and Arto Hellas . 2022 . Evaluating CodeClusters for Effectively Providing Feedback on Code Submissions. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20139. Teemu Koivisto and Arto Hellas. 2022. Evaluating CodeClusters for Effectively Providing Feedback on Code Submissions. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20139."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478431.3499359"},{"key":"e_1_3_2_1_43_1","volume-title":"Comparing Code Explanations Created by Students and Large Language Models. arXiv preprint arXiv:2304.03938","author":"Leinonen Juho","year":"2023","unstructured":"Juho Leinonen , Paul Denny , Stephen MacNeil , Sami Sarsa , Seth Bernstein , Joanne Kim , Andrew Tran , and Arto Hellas . 2023. Comparing Code Explanations Created by Students and Large Language Models. arXiv preprint arXiv:2304.03938 ( 2023 ). Juho Leinonen, Paul Denny, Stephen MacNeil, Sami Sarsa, Seth Bernstein, Joanne Kim, Andrew Tran, and Arto Hellas. 2023. Comparing Code Explanations Created by Students and Large Language Models. arXiv preprint arXiv:2304.03938 (2023)."},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478431.3499372"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569770"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3105726.3106181"},{"key":"e_1_3_2_1_47_1","volume-title":"Piloting Natural Language Generation for Personalized Progress Feedback. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20138.","author":"Lepp\u00e4nen Leo","year":"2022","unstructured":"Leo Lepp\u00e4nen , Arto Hellas , and Juho Leinonen . 2022 . Piloting Natural Language Generation for Personalized Progress Feedback. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20138. Leo Lepp\u00e4nen, Arto Hellas, and Juho Leinonen. 2022. Piloting Natural Language Generation for Personalized Progress Feedback. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20138."},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3304221.3319740"},{"key":"e_1_3_2_1_49_1","first-page":"1","article-title":"Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing","volume":"55","author":"Liu Pengfei","year":"2023","unstructured":"Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , and Graham Neubig . 2023 . Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing . Comput. Surveys 55 , 9 (2023), 1 \u2013 35 . Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2023. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. Comput. Surveys 55, 9 (2023), 1\u201335.","journal-title":"Comput. Surveys"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858252"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569785"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545947.3569630"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3501709.3544280"},{"key":"e_1_3_2_1_54_1","volume-title":"In: Proceedings of the 12th International Conference on Educational Data Mining (EDM","author":"Mao Ye","year":"2019","unstructured":"Ye Mao . 2019 . One minute is enough: Early prediction of student success and event-level difficulty during novice programming tasks . In In: Proceedings of the 12th International Conference on Educational Data Mining (EDM 2019). Ye Mao. 2019. One minute is enough: Early prediction of student success and event-level difficulty during novice programming tasks. In In: Proceedings of the 12th International Conference on Educational Data Mining (EDM 2019)."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372782.3406264"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2014.7044420"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3335814"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366885"},{"key":"e_1_3_2_1_59_1","volume-title":"StereoSet: Measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456","author":"Nadeem Moin","year":"2020","unstructured":"Moin Nadeem , Anna Bethke , and Siva Reddy . 2020. StereoSet: Measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456 ( 2020 ). Moin Nadeem, Anna Bethke, and Siva Reddy. 2020. StereoSet: Measuring stereotypical bias in pretrained language models. arXiv preprint arXiv:2004.09456 (2020)."},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159495"},{"key":"e_1_3_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2568023"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3304221.3319768"},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351287.3351288"},{"key":"e_1_3_2_1_64_1","volume-title":"EDULEARN14 proceedings","author":"Onah FO","year":"2014","unstructured":"Daniel\u00a0 FO Onah , Jane Sinclair , and Russell Boyatt . 2014 . Dropout rates of massive open online courses: behavioural patterns . EDULEARN14 proceedings (2014), 5825\u20135834. Daniel\u00a0FO Onah, Jane Sinclair, and Russell Boyatt. 2014. Dropout rates of massive open online courses: behavioural patterns. EDULEARN14 proceedings (2014), 5825\u20135834."},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737596"},{"key":"e_1_3_2_1_67_1","volume-title":"Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang , Jeff Wu , Xu Jiang , Diogo Almeida , Carroll\u00a0 L Wainwright , Pamela Mishkin , Chong Zhang , Sandhini Agarwal , Katarina Slama , Alex Ray , 2022. Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155 ( 2022 ). Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll\u00a0L Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, 2022. Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155 (2022)."},{"key":"e_1_3_2_1_68_1","volume-title":"Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Transactions on Computing Education (TOCE)","author":"Paiva Jos\u00e9\u00a0Carlos","year":"2022","unstructured":"Jos\u00e9\u00a0Carlos Paiva , Jos\u00e9\u00a0Paulo Leal , and \u00c1lvaro Figueira . 2022. Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Transactions on Computing Education (TOCE) ( 2022 ). Jos\u00e9\u00a0Carlos Paiva, Jos\u00e9\u00a0Paulo Leal, and \u00c1lvaro Figueira. 2022. Automated Assessment in Computer Science Education: A State-of-the-Art Review. ACM Transactions on Computing Education (TOCE) (2022)."},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2828959.2828966"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287374"},{"key":"e_1_3_2_1_71_1","volume-title":"Usability and Interactions with Copilot for Novice Programmers. arXiv preprint arXiv:2304.02491","author":"Prather James","year":"2023","unstructured":"James Prather , Brent\u00a0 N Reeves , Paul Denny , Brett\u00a0 A Becker , Juho Leinonen , Andrew Luxton-Reilly , Garrett Powell , James Finnie-Ansley , and Eddie\u00a0Antonio Santos . 2023. \" It\u2019s Weird That it Knows What I Want\" : Usability and Interactions with Copilot for Novice Programmers. arXiv preprint arXiv:2304.02491 ( 2023 ). James Prather, Brent\u00a0N Reeves, Paul Denny, Brett\u00a0A Becker, Juho Leinonen, Andrew Luxton-Reilly, Garrett Powell, James Finnie-Ansley, and Eddie\u00a0Antonio Santos. 2023. \"It\u2019s Weird That it Knows What I Want\": Usability and Interactions with Copilot for Novice Programmers. arXiv preprint arXiv:2304.02491 (2023)."},{"key":"e_1_3_2_1_72_1","unstructured":"Alec Radford Karthik Narasimhan Tim Salimans Ilya Sutskever 2018. Improving language understanding by generative pre-training. (2018).  Alec Radford Karthik Narasimhan Tim Salimans Ilya Sutskever 2018. Improving language understanding by generative pre-training. (2018)."},{"key":"e_1_3_2_1_73_1","volume-title":"Language models are unsupervised multitask learners. OpenAI blog 1, 8","author":"Radford Alec","year":"2019","unstructured":"Alec Radford , Jeffrey Wu , Rewon Child , David Luan , Dario Amodei , Ilya Sutskever , 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 ( 2019 ), 9. Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9."},{"key":"e_1_3_2_1_74_1","volume-title":"Why do some students avoid asking for help? An examination of the interplay among students","author":"Ryan M","year":"1998","unstructured":"Allison\u00a0 M Ryan , Margaret\u00a0 H Gheen , and Carol Midgley . 1998. Why do some students avoid asking for help? An examination of the interplay among students \u2019 academic efficacy, teachers\u2019 social\u2013emotional role, and the classroom goal structure.J. of educational psychology 90, 3 ( 1998 ). Allison\u00a0M Ryan, Margaret\u00a0H Gheen, and Carol Midgley. 1998. Why do some students avoid asking for help? An examination of the interplay among students\u2019 academic efficacy, teachers\u2019 social\u2013emotional role, and the classroom goal structure.J. of educational psychology 90, 3 (1998)."},{"key":"e_1_3_2_1_75_1","volume-title":"Avoiding seeking help in the classroom: Who and why?Educational Psychology Review 13, 2","author":"Ryan M","year":"2001","unstructured":"Allison\u00a0 M Ryan , Paul\u00a0 R Pintrich , and Carol Midgley . 2001. Avoiding seeking help in the classroom: Who and why?Educational Psychology Review 13, 2 ( 2001 ), 93\u2013114. Allison\u00a0M Ryan, Paul\u00a0R Pintrich, and Carol Midgley. 2001. Avoiding seeking help in the classroom: Who and why?Educational Psychology Review 13, 2 (2001), 93\u2013114."},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3501385.3543957"},{"key":"e_1_3_2_1_77_1","volume-title":"Help Request Prompt Structure Influence on Help Request Quantity and Course Retention. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20139.","author":"Sarsa Sami","year":"2022","unstructured":"Sami Sarsa , Jesper Pettersson , and Arto Hellas . 2022 . How to Help to Ask for Help? Help Request Prompt Structure Influence on Help Request Quantity and Course Retention. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20139. Sami Sarsa, Jesper Pettersson, and Arto Hellas. 2022. How to Help to Ask for Help? Help Request Prompt Structure Influence on Help Request Quantity and Course Retention. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1\u20139."},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1080\/03069885.2016.1213372"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2828959.2828963"},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287394"},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/182.358436"},{"key":"e_1_3_2_1_82_1","volume-title":"What do novices know about programming? In Directions in Human\u2013Computer Interactions, Albert Badre and Ben Shneiderman (Eds.). Vol.\u00a06","author":"Soloway Elliot","unstructured":"Elliot Soloway , Kate Ehrlich , Jeffrey\u00a0 G. Bonar , and Judith Greenspan . 1982. What do novices know about programming? In Directions in Human\u2013Computer Interactions, Albert Badre and Ben Shneiderman (Eds.). Vol.\u00a06 . Ablex Publishing , 27\u201354. Elliot Soloway, Kate Ehrlich, Jeffrey\u00a0G. Bonar, and Judith Greenspan. 1982. What do novices know about programming? In Directions in Human\u2013Computer Interactions, Albert Badre and Ben Shneiderman (Eds.). Vol.\u00a06. Ablex Publishing, 27\u201354."},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/6138.6145"},{"key":"e_1_3_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519665"},{"key":"e_1_3_2_1_85_1","volume-title":"Attention is all you need. Advances in neural information processing systems 30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan\u00a0 N Gomez , \u0141ukasz Kaiser , and Illia Polosukhin . 2017. Attention is all you need. Advances in neural information processing systems 30 ( 2017 ). Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan\u00a0N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/2674683.2674692"},{"key":"e_1_3_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676723.2677260"},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2013.99"},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545945.3569830"}],"event":{"name":"ICER 2023: ACM Conference on International Computing Education Research","location":"Chicago IL USA","acronym":"ICER 2023"},"container-title":["Proceedings of the 2023 ACM Conference on International Computing Education Research V.1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3568813.3600139","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3568813.3600139","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:26:27Z","timestamp":1750281987000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3568813.3600139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,7]]},"references-count":88,"alternative-id":["10.1145\/3568813.3600139","10.1145\/3568813"],"URL":"https:\/\/doi.org\/10.1145\/3568813.3600139","relation":{},"subject":[],"published":{"date-parts":[[2023,8,7]]},"assertion":[{"value":"2023-09-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}