{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T20:36:29Z","timestamp":1773693389847,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":14,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,3]]},"DOI":"10.1145\/3408877.3432430","type":"proceedings-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T18:45:38Z","timestamp":1614969938000},"page":"1062-1068","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":43,"title":["STOP THE (AUTOGRADER) INSANITY: Regression Penalties to Deter Autograder Overreliance"],"prefix":"10.1145","author":[{"given":"Elisa","family":"Baniassad","sequence":"first","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lucas","family":"Zamprogno","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Braxton","family":"Hall","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reid","family":"Holmes","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"A Survey of Automated Assessment Approaches for Programming Assignments. Computer Science Education(Feb","author":"Ala-Mutka Kirsti M.","year":"2007","unstructured":"Kirsti M. Ala-Mutka . 2007. A Survey of Automated Assessment Approaches for Programming Assignments. Computer Science Education(Feb . 2007 ). https:\/\/doi.org\/10.1080\/08993400500150747 Kirsti M. Ala-Mutka. 2007. A Survey of Automated Assessment Approaches for Programming Assignments. Computer Science Education(Feb. 2007). https:\/\/doi.org\/10.1080\/08993400500150747"},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the Technical Symposium on Computer Science Education (SIGCSE). 2--7.https:\/\/doi.org\/10","author":"Benotti Luciana","unstructured":"Luciana Benotti , Federico Aloi , Franco Bulgarelli , and Marcos J. Gomez . 2018. The Effect of a Web-Based Coding Tool with Automatic Feedback on Students' Performance and Perceptions . In Proceedings of the Technical Symposium on Computer Science Education (SIGCSE). 2--7.https:\/\/doi.org\/10 .1145\/3159450.3159579 Luciana Benotti, Federico Aloi, Franco Bulgarelli, and Marcos J. Gomez. 2018. The Effect of a Web-Based Coding Tool with Automatic Feedback on Students' Performance and Perceptions. In Proceedings of the Technical Symposium on Computer Science Education (SIGCSE). 2--7.https:\/\/doi.org\/10.1145\/3159450.3159579"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEET.2019.00021"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290511.3290528"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1597849.1384371"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159595"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1930464.1930480"},{"key":"e_1_3_2_1_8_1","volume-title":"On the Use of Resubmissions in Automatic Assessment Systems. Computer Science Education(Feb","author":"Karavirta Ville","year":"2007","unstructured":"Ville Karavirta , Ari Korhonen , and Lauri Malmi . 2007. On the Use of Resubmissions in Automatic Assessment Systems. Computer Science Education(Feb . 2007 ). https:\/\/doi.org\/10.1080\/08993400600912426 Ville Karavirta, Ari Korhonen, and Lauri Malmi. 2007. On the Use of Resubmissions in Automatic Assessment Systems. Computer Science Education(Feb. 2007). https:\/\/doi.org\/10.1080\/08993400600912426"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEET.2019.00022"},{"key":"e_1_3_2_1_10_1","unstructured":"Formative Authorised Educator M Garcia. 2018. The things you learn the hard way- Beware \"return scores instantly\". (2018). https:\/\/discuss.goformative.com\/t\/the-things-you-learn-the-hard-way-beware-return-scores-instantly\/1880\/16  Formative Authorised Educator M Garcia. 2018. The things you learn the hard way- Beware \"return scores instantly\". (2018). https:\/\/discuss.goformative.com\/t\/the-things-you-learn-the-hard-way-beware-return-scores-instantly\/1880\/16"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"K\u00e1roly Neh\u00e9z S\u00e1ndor Kir\u00e1ly and Oliver Hornyak. 2017. Some aspects of grading Java code submissions in MOOCs. Research in Learning Technology (RLT)27 (072017). https:\/\/doi.org\/10.25304\/rlt.v25.1945  K\u00e1roly Neh\u00e9z S\u00e1ndor Kir\u00e1ly and Oliver Hornyak. 2017. Some aspects of grading Java code submissions in MOOCs. Research in Learning Technology (RLT)27 (072017). https:\/\/doi.org\/10.25304\/rlt.v25.1945","DOI":"10.25304\/rlt.v25.1945"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140123.1140131"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339416"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3426431.3428654"}],"event":{"name":"SIGCSE '21: The 52nd ACM Technical Symposium on Computer Science Education","location":"Virtual Event USA","acronym":"SIGCSE '21","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the 52nd ACM Technical Symposium on Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432430","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3408877.3432430","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:37Z","timestamp":1750195897000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432430"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":14,"alternative-id":["10.1145\/3408877.3432430","10.1145\/3408877"],"URL":"https:\/\/doi.org\/10.1145\/3408877.3432430","relation":{},"subject":[],"published":{"date-parts":[[2021,3,3]]},"assertion":[{"value":"2021-03-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}