{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T01:31:53Z","timestamp":1769736713144,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,11,13]],"date-time":"2023-11-13T00:00:00Z","timestamp":1699833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,11,13]]},"DOI":"10.1145\/3631802.3631804","type":"proceedings-article","created":{"date-parts":[[2024,2,6]],"date-time":"2024-02-06T12:45:51Z","timestamp":1707223551000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Feedback on Student Programming Assignments: Teaching Assistants vs Automated Assessment Tool"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-7744-7452","authenticated-orcid":false,"given":"Nynne Grauslund","family":"Kristiansen","sequence":"first","affiliation":[{"name":"IT University of Copenhagen, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3498-0970","authenticated-orcid":false,"given":"Sebastian Mateos","family":"Nicolajsen","sequence":"additional","affiliation":[{"name":"IT University of Copenhagen, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5093-5806","authenticated-orcid":false,"given":"Claus","family":"Brabrand","sequence":"additional","affiliation":[{"name":"IT University of Copenhagen, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,2,6]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"[n. d.]. University Teaching Assistant Salaries by Country. https:\/\/www.salaryexpert.com\/salary\/browse\/countries\/university-teaching-assistant. Accessed: 2023-03-17."},{"key":"e_1_3_2_1_2_1","volume-title":"A survey on grading format of automated grading tools for programming assignments. arXiv preprint arXiv:2212.01714","author":"Agrawal Aditi","year":"2022","unstructured":"Aditi Agrawal and Benjamin Reed. 2022. A survey on grading format of automated grading tools for programming assignments. arXiv preprint arXiv:2212.01714 (2022)."},{"key":"e_1_3_2_1_3_1","volume-title":"A survey of automated assessment approaches for programming assignments. Computer science education 15, 2","author":"Ala-Mutka M","year":"2005","unstructured":"Kirsti\u00a0M Ala-Mutka. 2005. A survey of automated assessment approaches for programming assignments. Computer science education 15, 2 (2005), 83\u2013102."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2010.2098442"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.18260\/1-2--31231"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3390\/su12187451"},{"key":"e_1_3_2_1_7_1","unstructured":"Julio\u00a0C Caiza and Jos\u00e9 Mar\u00eda\u00a0del \u00c1lamo\u00a0Ramiro. 2013. Programming assignments automatic grading: review of tools and implementations. (2013)."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3446871.3469758"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017725"},{"key":"e_1_3_2_1_10_1","volume-title":"Formative and summative assessment in the classroom. Theory into practice 55, 2","author":"Dixson D","year":"2016","unstructured":"Dante\u00a0D Dixson and Frank\u00a0C Worrell. 2016. Formative and summative assessment in the classroom. Theory into practice 55, 2 (2016), 153\u2013159."},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the international conference on education and information systems: technologies and applications EISTA, Vol.\u00a03. Citeseer.","author":"Edwards H","year":"2003","unstructured":"Stephen\u00a0H Edwards. 2003. Using test-driven development in the classroom: Providing students with automatic, concrete feedback on performance. In Proceedings of the international conference on education and information systems: technologies and applications EISTA, Vol.\u00a03. Citeseer."},{"key":"e_1_3_2_1_12_1","volume-title":"Five years with kattis\u2014using an automated assessment system in teaching. In 2011 Frontiers in education conference (FIE)","author":"Enstr\u00f6m Emma","unstructured":"Emma Enstr\u00f6m, Gunnar Kreitz, Fredrik Niemel\u00e4, Pehr S\u00f6derman, and Viggo Kann. 2011. Five years with kattis\u2014using an automated assessment system in teaching. In 2011 Frontiers in education conference (FIE). IEEE, T3J\u20131."},{"key":"e_1_3_2_1_13_1","volume-title":"The impact of teaching assistants on improving pupils","author":"Farrell Peter","year":"2010","unstructured":"Peter Farrell, Alison Alborz, Andy Howes, and Diana Pearson. 2010. The impact of teaching assistants on improving pupils\u2019 academic achievement in mainstream schools: A review of the literature. Educational review 62, 4 (2010), 435\u2013448."},{"key":"e_1_3_2_1_14_1","volume-title":"Five misunderstandings about case-study research. Qualitative inquiry 12, 2","author":"Flyvbjerg Bent","year":"2006","unstructured":"Bent Flyvbjerg. 2006. Five misunderstandings about case-study research. Qualitative inquiry 12, 2 (2006), 219\u2013245."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017694"},{"key":"e_1_3_2_1_16_1","volume-title":"Student Practice Sessions Modeled as ICAP Activity Silos","author":"Gaweda M","year":"2021","unstructured":"Adam\u00a0M Gaweda and Collin\u00a0F Lynch. 2021. Student Practice Sessions Modeled as ICAP Activity Silos.International Educational Data Mining Society (2021)."},{"key":"e_1_3_2_1_17_1","unstructured":"Imran Ghory. 2007. Using FizzBuzz to Find Developers who Grok Coding. https:\/\/imranontech.com\/2007\/01\/24\/using-fizzbuzz-to-find-developers-who-grok-coding\/. Accessed: 2023-01-13."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3390\/su11205568"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3502718.3524784"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3564721.3564724"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2020.1860408"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1930464.1930480"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cl.2018.01.004"},{"key":"e_1_3_2_1_24_1","unstructured":"Code judge. 2023. Code judge. https:\/\/codejudge.io. Accessed: 2023-01-13."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3446871.3469761"},{"key":"e_1_3_2_1_26_1","volume-title":"CODELAB: A Developers\u2019 Tool for Efficient Code Generation and Optimization. In International Conference on Computational Science. Springer, 729\u2013738","author":"Mirkovi\u0107 Dragan","year":"2003","unstructured":"Dragan Mirkovi\u0107 and S\u00a0Lennart Johnsson. 2003. CODELAB: A Developers\u2019 Tool for Efficient Code Generation and Optimization. In International Conference on Computational Science. Springer, 729\u2013738."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339422"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2016.1179865"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3513140"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3513140"},{"key":"e_1_3_2_1_31_1","first-page":"2012","article-title":"The Year of the MOOC","volume":"2","author":"Pappano Laura","year":"2012","unstructured":"Laura Pappano. 2012. The Year of the MOOC. The New York Times 2, 12 (2012), 2012.","journal-title":"The New York Times"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18260\/p.23569"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3141880.3141912"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE44824.2020.9274245"},{"key":"e_1_3_2_1_35_1","unstructured":"Jonathan Sharples P Blatchford and R Webster. 2016. Making best use of teaching assistants. (2016)."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2015.24"},{"key":"e_1_3_2_1_37_1","unstructured":"SonarQube. 2023. SonarQube Documentation. https:\/\/docs.sonarqube.org\/latest\/. Accessed: 2023-01-13."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TALE.2015.7386010"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/cae.21974"},{"key":"e_1_3_2_1_40_1","volume-title":"The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational psychologist 46, 4","author":"VanLehn Kurt","year":"2011","unstructured":"Kurt VanLehn. 2011. The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational psychologist 46, 4 (2011), 197\u2013221."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676723.2677226"}],"event":{"name":"Koli Calling '23: 23rd Koli Calling International Conference on Computing Education Research","location":"Koli Finland","acronym":"Koli Calling '23"},"container-title":["Proceedings of the 23rd Koli Calling International Conference on Computing Education Research"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631802.3631804","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3631802.3631804","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T16:19:22Z","timestamp":1755879562000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3631802.3631804"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,13]]},"references-count":41,"alternative-id":["10.1145\/3631802.3631804","10.1145\/3631802"],"URL":"https:\/\/doi.org\/10.1145\/3631802.3631804","relation":{},"subject":[],"published":{"date-parts":[[2023,11,13]]},"assertion":[{"value":"2024-02-06","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}