{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T09:14:17Z","timestamp":1758273257894,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Institute of Coding (Office for Students)"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,3]]},"DOI":"10.1145\/3408877.3432411","type":"proceedings-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T18:46:01Z","timestamp":1614969961000},"page":"1055-1061","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["An Empirical Study to Determine if Mutants Can Effectively Simulate Students' Programming Mistakes to Increase Tutors' Confidence in Autograding"],"prefix":"10.1145","author":[{"given":"Benjamin Simon","family":"Clegg","sequence":"first","affiliation":[{"name":"University of Sheffield, Sheffield, United Kingdom"}]},{"given":"Phil","family":"McMinn","sequence":"additional","affiliation":[{"name":"University of Sheffield, Sheffield, United Kingdom"}]},{"given":"Gordon","family":"Fraser","sequence":"additional","affiliation":[{"name":"University of Passau, Passau, Germany"}]}],"member":"320","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEIP.2017.27"},{"key":"e_1_3_2_1_2_1","first-page":"1","article-title":"Novice Java Programming Mistakes: Large-Scale Data vs","volume":"17","author":"Brown N. C. C.","unstructured":"Brown , N. C. C. , and Altadmri , A . Novice Java Programming Mistakes: Large-Scale Data vs . Educator Beliefs. ACM Transactions on Computing Education 17 , 2 (may 2017), 1 -- 21 . Brown, N. C. C., and Altadmri, A. Novice Java Programming Mistakes: Large-Scale Data vs. Educator Beliefs. ACM Transactions on Computing Education 17, 2 (may 2017), 1--21.","journal-title":"Educator Beliefs. ACM Transactions on Computing Education"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3324884.3416667"},{"key":"e_1_3_2_1_4_1","volume-title":"PIT Mutation Testing. [Online","author":"Coles H.","year":"2020","unstructured":"Coles , H. PIT Mutation Testing. [Online ; accessed 2020 -08--26] https:\/\/pitest.org\/. Coles, H. PIT Mutation Testing. [Online; accessed 2020-08--26] https:\/\/pitest.org\/."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/C-M.1978.218136"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025179"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2014.40"},{"key":"e_1_3_2_1_8_1","volume-title":"JaCoCo Java Code Coverage Library. [Online","author":"Hoffmann M. R.","year":"2020","unstructured":"Hoffmann , M. R. , Mandrikov , E. , and Friedenhagen , M . JaCoCo Java Code Coverage Library. [Online ; accessed 2020 -08--27] http:\/\/eclemma.org\/jacoco\/, 2016. Hoffmann, M. R., Mandrikov, E., and Friedenhagen, M. JaCoCo Java Code Coverage Library. [Online; accessed 2020-08--27] http:\/\/eclemma.org\/jacoco\/, 2016."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cl.2018.01.004"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2010.62"},{"key":"e_1_3_2_1_11_1","volume-title":"The Major Mutation Framework. [Online","author":"Just R.","year":"2020","unstructured":"Just , R. The Major Mutation Framework. [Online ; accessed 2020 -08--26] http:\/\/mutation-testing.org\/doc\/major.pdf, 2018. Just, R. The Major Mutation Framework. [Online; accessed 2020-08--26] http:\/\/mutation-testing.org\/doc\/major.pdf, 2018."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635929"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2011.6100138"},{"key":"e_1_3_2_1_14_1","first-page":"284","volume-title":"Proceedings of the 49th ACM Technical Symposium on Computer Science Education - SIGCSE '18","author":"Krusche S.","year":"2018","unstructured":"Krusche , S. , and Seitz , A . ArTEMiS - An Automatic Assessment Management System for Interactive Learning . In Proceedings of the 49th ACM Technical Symposium on Computer Science Education - SIGCSE '18 ( New York, New York, USA , 2018 ), ACM Press, pp. 284 -- 289 . Krusche, S., and Seitz, A. ArTEMiS - An Automatic Assessment Management System for Interactive Learning. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education - SIGCSE '18 (New York, New York, USA, 2018), ACM Press, pp. 284--289."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366947"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2017.169"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2554850.2554978"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/stvr.1509"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984043.2989222"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491956.2462195"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2016.48"},{"key":"e_1_3_2_1_22_1","first-page":"23","volume-title":"Proceedings of 2015 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2015 (jan","author":"Staubitz T.","year":"2016","unstructured":"Staubitz , T. , Klement , H. , Renz , J. , Teusner , R. , and Meinel , C . Towards practical programming exercises and automated assessment in Massive Open Online Courses . In Proceedings of 2015 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2015 (jan 2016 ), Institute of Electrical and Electronics Engineers Inc. , pp. 23 -- 30 . Staubitz, T., Klement, H., Renz, J., Teusner, R., and Meinel, C. Towards practical programming exercises and automated assessment in Massive Open Online Courses. In Proceedings of 2015 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2015 (jan 2016), Institute of Electrical and Electronics Engineers Inc., pp. 23--30."}],"event":{"name":"SIGCSE '21: The 52nd ACM Technical Symposium on Computer Science Education","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Virtual Event USA","acronym":"SIGCSE '21"},"container-title":["Proceedings of the 52nd ACM Technical Symposium on Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432411","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3408877.3432411","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:37Z","timestamp":1750195897000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432411"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":22,"alternative-id":["10.1145\/3408877.3432411","10.1145\/3408877"],"URL":"https:\/\/doi.org\/10.1145\/3408877.3432411","relation":{},"subject":[],"published":{"date-parts":[[2021,3,3]]},"assertion":[{"value":"2021-03-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}