{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T20:15:31Z","timestamp":1762460131036,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,3,2]],"date-time":"2023-03-02T00:00:00Z","timestamp":1677715200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,3,2]]},"DOI":"10.1145\/3545945.3569801","type":"proceedings-article","created":{"date-parts":[[2023,3,3]],"date-time":"2023-03-03T23:40:27Z","timestamp":1677886827000},"page":"924-930","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Discovering, Autogenerating, and Evaluating Distractors for Python Parsons Problems in CS1"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6572-4347","authenticated-orcid":false,"suffix":"IV","given":"David H.","family":"Smith","sequence":"first","affiliation":[{"name":"University of Illinois, Urbana, IL, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4601-4398","authenticated-orcid":false,"given":"Craig","family":"Zilles","sequence":"additional","affiliation":[{"name":"University of Illinois, Urbana, IL, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,3,3]]},"reference":[{"volume-title":"Introduction to measurement theory","author":"Allen Mary J","key":"e_1_3_2_1_1_1","unstructured":"Mary J Allen and Wendy M Yen. 2001. Introduction to measurement theory. Waveland Press."},{"key":"e_1_3_2_1_2_1","unstructured":"Elizabeth L Bjork Robert A Bjork et al. 2011. Making things hard on yourself but in a good way: Creating desirable difficulties to enhance learning. Psychology and the real world: Essays illustrating fundamental contributions to society 2 59--68 (2011)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jarmac.2014.03.002"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326977ea1101_2"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404532"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373165.3373187"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3364510.3364524"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960342"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787731"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3141880.3141895"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960335"},{"key":"e_1_3_2_1_12_1","volume-title":"Mohammed Hassan, Seth Poulsen, Matthew West, and Craig Zilles.","author":"Fowler Max","year":"2022","unstructured":"Max Fowler, David H Smith IV, Mohammed Hassan, Seth Poulsen, Matthew West, and Craig Zilles. 2022. Reevaluating the relationship between explaining, tracing, and writing skills in CS1 in a replication study. Computer Science Education (2022), 1--29."},{"key":"e_1_3_2_1_13_1","volume-title":"An Exploration of How a Technology-Facilitated Part-Complete Solution Method Supports the Learning of Computer Programming. Issues in Informing Science & Information Technology 4","author":"Garner Stuart","year":"2007","unstructured":"Stuart Garner. 2007. An Exploration of How a Technology-Facilitated Part-Complete Solution Method Supports the Learning of Computer Programming. Issues in Informing Science & Information Technology 4 (2007)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.3102\/0034654317726529"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1119\/1.14030"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960314"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445292"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1822090.1822178"},{"key":"e_1_3_2_1_19_1","first-page":"119","article-title":"Two-dimensional parson's puzzles: The concept, tools, and first observations","volume":"10","author":"Ihantola Petri","year":"2011","unstructured":"Petri Ihantola and Ville Karavirta. 2011. Two-dimensional parson's puzzles: The concept, tools, and first observations. Journal of Information Technology Education 10, 2 (2011), 119--132.","journal-title":"Journal of Information Technology Education"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.2466\/pr0.1966.18.3.879"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1709424.1709460"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13421-014-0452-8"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404531"},{"key":"e_1_3_2_1_24_1","unstructured":"Susan Matlock-Hetzel. 1997. Basic Concepts in Item and Test Analysis. (1997)."},{"key":"e_1_3_2_1_25_1","volume-title":"How to read and really use an item analysis. Nurse educator 34, 4","author":"McGahee Thayer W","year":"2009","unstructured":"Thayer W McGahee and Julia Ball. 2009. How to read and really use an item analysis. Nurse educator 34, 4 (2009), 166--171."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632320.2632348"},{"key":"e_1_3_2_1_27_1","volume-title":"Proceedings of the third international conference on cognitive science","volume":"644648","author":"Nathan Mitchell J","year":"2001","unstructured":"Mitchell J Nathan, Kenneth R Koedinger, Martha W Alibali, et al. 2001. Expert blind spot: When content knowledge eclipses pedagogical content knowledge. In Proceedings of the third international conference on cognitive science, Vol. 644648."},{"key":"e_1_3_2_1_28_1","volume-title":"Proceedings of the 8th Australasian Conference on Computing Education-Volume 52","author":"Parsons Dale","year":"2006","unstructured":"Dale Parsons and Patricia Haden. 2006. Parson's programming puzzles: a fun and effective learning tool for first programming courses. In Proceedings of the 8th Australasian Conference on Computing Education-Volume 52. 157--163."},{"key":"e_1_3_2_1_29_1","volume-title":"The effect of testing versus restudy on retention: a meta-analytic review of the testing effect. Psychological bulletin 140, 6","author":"Rowland Christopher A","year":"2014","unstructured":"Christopher A Rowland. 2014. The effect of testing versus restudy on retention: a meta-analytic review of the testing effect. Psychological bulletin 140, 6 (2014), 1432."},{"key":"e_1_3_2_1_30_1","volume-title":"Peter AH Peterson, and Alan T Sherman","author":"Scheponik Travis","year":"2019","unstructured":"Travis Scheponik, Enis Golaszewski, Geoffrey Herman, Spencer Offenberger, Linda Oliva, Peter AH Peterson, and Alan T Sherman. 2019. Investigating crowd-sourcing to generate distractors for multiple-choice assessments. In National Cyber Summit. Springer, 185--201."},{"key":"e_1_3_2_1_31_1","unstructured":"D. H. Smith IV. 2022. DistractingParsonsGen - A Parsons Problem Distractor Gen- erator. https:\/\/github.com\/CoffeePoweredComputers\/DistractingParsonsGen\/"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1584322.1584336"},{"volume-title":"Mind in society: Development of higher psychological processes","author":"Vygotsky Lev Semenovich","key":"e_1_3_2_1_33_1","unstructured":"Lev Semenovich Vygotsky and Michael Cole. 1978. Mind in society: Development of higher psychological processes. Harvard university press."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445228"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.18260\/p.24575"},{"key":"e_1_3_2_1_36_1","volume-title":"The many ways of the BRACElet project. Bulletin of Applied Computing and Information Technology","author":"Whalley J","year":"2007","unstructured":"J Whalley, Tony Clear, and RF Lister. 2007. The many ways of the BRACElet project. Bulletin of Applied Computing and Information Technology (2007)."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Craig B Zilles Matthew West Geoffrey L Herman and Timothy Bretl. 2019. Every University Should Have a Computer-Based Testing Facility.. In CSEDU (1). 414--420.","DOI":"10.5220\/0007753304140420"}],"event":{"name":"SIGCSE 2023: The 54th ACM Technical Symposium on Computer Science Education","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Toronto ON Canada","acronym":"SIGCSE 2023"},"container-title":["Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3545945.3569801","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3545945.3569801","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:19Z","timestamp":1750182679000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3545945.3569801"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,2]]},"references-count":37,"alternative-id":["10.1145\/3545945.3569801","10.1145\/3545945"],"URL":"https:\/\/doi.org\/10.1145\/3545945.3569801","relation":{},"subject":[],"published":{"date-parts":[[2023,3,2]]},"assertion":[{"value":"2023-03-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}