{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,24]],"date-time":"2025-08-24T01:10:04Z","timestamp":1755997804251,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,16]],"date-time":"2021-08-16T00:00:00Z","timestamp":1629072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,16]]},"DOI":"10.1145\/3446871.3469741","type":"proceedings-article","created":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T13:50:22Z","timestamp":1629208222000},"page":"157-168","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Evaluating Proof Blocks Problems as Exam Questions"],"prefix":"10.1145","author":[{"given":"Seth","family":"Poulsen","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]},{"given":"Mahesh","family":"Viswanathan","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]},{"given":"Geoffrey L.","family":"Herman","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]},{"given":"Matthew","family":"West","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,8,17]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10817-007-9072-3"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-63104-6_41"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-43144-4_8"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404532"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373165.3373187"},{"volume-title":"Discrete mathematics: mathematical reasoning and proof with puzzles, patterns, and games","author":"Ensley E","key":"e_1_3_2_1_6_1","unstructured":"Douglas\u00a0 E Ensley and J\u00a0Winston Crawley . 2005. Discrete mathematics: mathematical reasoning and proof with puzzles, patterns, and games . John Wiley & Sons . Douglas\u00a0E Ensley and J\u00a0Winston Crawley. 2005. Discrete mathematics: mathematical reasoning and proof with puzzles, patterns, and games. John Wiley & Sons."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3141880.3141895"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/BLOCKS.2015.7369000"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352135.1352226"},{"key":"e_1_3_2_1_10_1","volume-title":"A Psychometric Evaluation of the Digital Logic Concept Inventory.Computer Science Education 24, 4","author":"Herman L.","year":"2014","unstructured":"Geoffrey\u00a0 L. Herman , Craig Zilles , and Michael\u00a0 C. Loui . 2014. A Psychometric Evaluation of the Digital Logic Concept Inventory.Computer Science Education 24, 4 ( 2014 ), 277 \u2013 303. Geoffrey\u00a0L. Herman, Craig Zilles, and Michael\u00a0C. Loui. 2014. A Psychometric Evaluation of the Digital Logic Concept Inventory.Computer Science Education 24, 4 (2014), 277 \u2013 303."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5951\/jresematheduc.45.1.0062"},{"volume-title":"Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science","author":"Association for Computing Machinery\u00a0(ACM) Joint Task Force\u00a0on Computing\u00a0Curricula and IEEE\u00a0Computer Society. 2013.","key":"e_1_3_2_1_12_1","unstructured":"Association for Computing Machinery\u00a0(ACM) Joint Task Force\u00a0on Computing\u00a0Curricula and IEEE\u00a0Computer Society. 2013. Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science . Association for Computing Machinery , New York, NY, USA . Association for Computing Machinery\u00a0(ACM) Joint Task Force\u00a0on Computing\u00a0Curricula and IEEE\u00a0Computer Society. 2013. Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science. Association for Computing Machinery, New York, NY, USA."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702302"},{"volume-title":"Applications of item response theory to practical testing problems","author":"Lord M","key":"e_1_3_2_1_14_1","unstructured":"Frederic\u00a0 M Lord . 1980. Applications of item response theory to practical testing problems . Routledge . Frederic\u00a0M Lord. 1980. Applications of item response theory to practical testing problems. Routledge."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868358.1868363"},{"key":"e_1_3_2_1_17_1","volume-title":"Proceedings of the 8th Australasian Conference on Computing Education -","volume":"52","author":"Parsons Dale","year":"2006","unstructured":"Dale Parsons and Patricia Haden . 2006 . Parson\u2019s Programming Puzzles: A Fun and Effective Learning Tool for First Programming Courses . In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (Hobart, Australia) (ACE \u201906). Australian Computer Society, Inc., AUS, 157\u2013163. Dale Parsons and Patricia Haden. 2006. Parson\u2019s Programming Puzzles: A Fun and Effective Learning Tool for First Programming Courses. In Proceedings of the 8th Australasian Conference on Computing Education - Volume 52 (Hobart, Australia) (ACE \u201906). Australian Computer Society, Inc., AUS, 157\u2013163."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339404"},{"key":"e_1_3_2_1_19_1","volume-title":"\u00a0and Sherman","author":"Poulsen Seth","year":"2021","unstructured":"Seth Poulsen , Geoffrey\u00a0 L. Herman , Peter\u00a0 A.H. Peterson , Enis Enis\u00a0Golaszewski , Akshita Gorti , Linda Oliva , Travis Scheponik , and Alan T . \u00a0and Sherman . 2021 . Psychometric Evaluation of the Cybersecurity Concept Inventory. ACM Transactions on Computing Education (TOCE) In press ( 2021). Seth Poulsen, Geoffrey\u00a0L. Herman, Peter\u00a0A.H. Peterson, Enis Enis\u00a0Golaszewski, Akshita Gorti, Linda Oliva, Travis Scheponik, and Alan T.\u00a0and Sherman. 2021. Psychometric Evaluation of the Cybersecurity Concept Inventory. ACM Transactions on Computing Education (TOCE) In press (2021)."},{"key":"e_1_3_2_1_20_1","volume-title":"Proof Blocks: Autogradeable Scaffolding Activities for Learning to Write Proofs. arxiv:2106.11032\u00a0[cs.CY]","author":"Poulsen Seth","year":"2021","unstructured":"Seth Poulsen , Mahesh Viswanathan , Geoffrey\u00a0 L. Herman , and Matthew West . 2021 . Proof Blocks: Autogradeable Scaffolding Activities for Learning to Write Proofs. arxiv:2106.11032\u00a0[cs.CY] Seth Poulsen, Mahesh Viswanathan, Geoffrey\u00a0L. Herman, and Matthew West. 2021. Proof Blocks: Autogradeable Scaffolding Activities for Learning to Write Proofs. arxiv:2106.11032\u00a0[cs.CY]"},{"key":"e_1_3_2_1_21_1","volume-title":"R: A language and environment for statistical computing","author":"Team R Core","year":"2020","unstructured":"R Core Team . 2020 . R: A language and environment for statistical computing . R Foundation for Statistical Computing , Vienna, Austria . https:\/\/www.R-project.org\/ R Core Team. 2020. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https:\/\/www.R-project.org\/"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v017.i05"},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the second international seminar on misconceptions and educational strategies in science and mathematics, Vol.\u00a03. ERIC, 457\u2013470","author":"Selden Annie","year":"1987","unstructured":"Annie Selden and John Selden . 1987 . Errors and misconceptions in college level theorem proving . In Proceedings of the second international seminar on misconceptions and educational strategies in science and mathematics, Vol.\u00a03. ERIC, 457\u2013470 . Annie Selden and John Selden. 1987. Errors and misconceptions in college level theorem proving. In Proceedings of the second international seminar on misconceptions and educational strategies in science and mathematics, Vol.\u00a03. ERIC, 457\u2013470."},{"volume-title":"Difficulties in Learning to Understand and Construct Proofs. In Making the Connection, Marilyn\u00a0P","author":"Selden Annie","key":"e_1_3_2_1_24_1","unstructured":"Annie Selden and John Selden . 2008. Overcoming Students \u2019 Difficulties in Learning to Understand and Construct Proofs. In Making the Connection, Marilyn\u00a0P . Carlson and Chris Rasmussen (Eds.). The Mathematical Association of America , Washington DC , 95\u2013110. https:\/\/doi.org\/10.5948\/UPO9780883859759.009 Annie Selden and John Selden. 2008. Overcoming Students\u2019 Difficulties in Learning to Understand and Construct Proofs. In Making the Connection, Marilyn\u00a0P. Carlson and Chris Rasmussen (Eds.). The Mathematical Association of America, Washington DC, 95\u2013110. https:\/\/doi.org\/10.5948\/UPO9780883859759.009"},{"key":"e_1_3_2_1_25_1","first-page":"3","article-title":"Ims learning tools interoperability: Enabling a mash-up approach to teaching and learning tools","volume":"7","author":"Severance Charles","year":"2010","unstructured":"Charles Severance , Ted Hanss , and Josepth Hardin . 2010 . Ims learning tools interoperability: Enabling a mash-up approach to teaching and learning tools . Technology, Instruction, Cognition and Learning 7 , 3 - 4 (2010), 245\u2013262. Charles Severance, Ted Hanss, and Josepth Hardin. 2010. Ims learning tools interoperability: Enabling a mash-up approach to teaching and learning tools. Technology, Instruction, Cognition and Learning 7, 3-4 (2010), 245\u2013262.","journal-title":"Technology, Instruction, Cognition and Learning"},{"volume-title":"The second handbook of research on the psychology of mathematics education","author":"Stylianides J","key":"e_1_3_2_1_26_1","unstructured":"Andreas\u00a0 J Stylianides , Kristen\u00a0 N Bieda , and Francesca Morselli . 2016. Proof and argumentation in mathematics education research . In The second handbook of research on the psychology of mathematics education . Brill Sense , 315\u2013351. Andreas\u00a0J Stylianides, Kristen\u00a0N Bieda, and Francesca Morselli. 2016. Proof and argumentation in mathematics education research. In The second handbook of research on the psychology of mathematics education. Brill Sense, 315\u2013351."},{"volume-title":"Compendium for Research in Mathematics Education","author":"Stylianides GJ","key":"e_1_3_2_1_27_1","unstructured":"GJ Stylianides , AJ Stylianides , and K Weber . 2017. Research on the teaching and learning of proof: Taking stock and moving forward . In Compendium for Research in Mathematics Education , Jinfa Cai (Ed.). National Council of Teachers of Mathematics , Chapter\u00a010, 237\u2013266. GJ Stylianides, AJ Stylianides, and K Weber. 2017. Research on the teaching and learning of proof: Taking stock and moving forward. In Compendium for Research in Mathematics Education, Jinfa Cai (Ed.). National Council of Teachers of Mathematics, Chapter\u00a010, 237\u2013266."},{"key":"e_1_3_2_1_28_1","unstructured":"PrairieLearn Team. 2021. pl-order-blocks Documentation. https:\/\/prairielearn.readthedocs.io\/en\/latest\/elements\/pl-order-blocks-element  PrairieLearn Team. 2021. pl-order-blocks Documentation. https:\/\/prairielearn.readthedocs.io\/en\/latest\/elements\/pl-order-blocks-element"},{"key":"e_1_3_2_1_29_1","unstructured":"PrairieLearn Team. 2021. PrairieLearn Documentation. https:\/\/prairielearn.readthedocs.io\/en\/latest\/  PrairieLearn Team. 2021. PrairieLearn Documentation. https:\/\/prairielearn.readthedocs.io\/en\/latest\/"},{"volume-title":"Mind in society: The development of higher psychological processes","author":"Vygotsky Lev\u00a0Semenovich","key":"e_1_3_2_1_31_1","unstructured":"Lev\u00a0Semenovich Vygotsky . 1978. Mind in society: The development of higher psychological processes . Harvard university press . Lev\u00a0Semenovich Vygotsky. 1978. Mind in society: The development of higher psychological processes. Harvard university press."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1015535614355"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:EDUC.0000040410.57253.a1"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2771839.2771860"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.18260\/p.24575"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7610.1976.tb00381.x"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287370"}],"event":{"name":"ICER 2021: ACM Conference on International Computing Education Research","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Virtual Event USA","acronym":"ICER 2021"},"container-title":["Proceedings of the 17th ACM Conference on International Computing Education Research"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446871.3469741","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3446871.3469741","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:32Z","timestamp":1750193252000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446871.3469741"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,16]]},"references-count":35,"alternative-id":["10.1145\/3446871.3469741","10.1145\/3446871"],"URL":"https:\/\/doi.org\/10.1145\/3446871.3469741","relation":{},"subject":[],"published":{"date-parts":[[2021,8,16]]},"assertion":[{"value":"2021-08-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}