{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T18:38:49Z","timestamp":1768415929523,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":51,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T00:00:00Z","timestamp":1657152000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF SHF","award":["#1749936, #1714699"],"award-info":[{"award-number":["#1749936, #1714699"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,7]]},"DOI":"10.1145\/3502718.3524799","type":"proceedings-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T10:28:30Z","timestamp":1657189710000},"page":"276-282","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Check It Off"],"prefix":"10.1145","author":[{"given":"Gina R.","family":"Bai","sequence":"first","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}]},{"given":"Kai","family":"Presler-Marshall","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}]},{"given":"Thomas W.","family":"Price","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}]},{"given":"Kathryn T.","family":"Stolee","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"53","article-title":"Software security requirements checklist. International Journal of Software Engineering","volume":"3","author":"Alam Mahtab","year":"2010","unstructured":"Mahtab Alam . 2010 . Software security requirements checklist. International Journal of Software Engineering , IJSE , Vol. 3 , 1 (2010), 53 -- 62 . Mahtab Alam. 2010. Software security requirements checklist. International Journal of Software Engineering, IJSE , Vol. 3, 1 (2010), 53--62.","journal-title":"IJSE"},{"key":"e_1_3_2_1_2_1","volume-title":"Static Estimation of Test Coverage. In International Working Conf. on Source Code Analysis and Manipulation. 55--64","author":"Tiago","unstructured":"Tiago L. Alves and Joost Visser. 2009 . Static Estimation of Test Coverage. In International Working Conf. on Source Code Analysis and Manipulation. 55--64 . Tiago L. Alves and Joost Visser. 2009. Static Estimation of Test Coverage. In International Working Conf. on Source Code Analysis and Manipulation. 55--64."},{"key":"e_1_3_2_1_3_1","volume-title":"Pragmatic Software Testing Education. In ACM Technical Symposium on Computer Science Education (SIGCSE '19)","author":"Aniche Maur'icio","year":"2019","unstructured":"Maur'icio Aniche , Felienne Hermans , and Arie van Deursen . 2019 . Pragmatic Software Testing Education. In ACM Technical Symposium on Computer Science Education (SIGCSE '19) . 414--420. Maur'icio Aniche, Felienne Hermans, and Arie van Deursen. 2019. Pragmatic Software Testing Education. In ACM Technical Symposium on Computer Science Education (SIGCSE '19). 414--420."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW50294.2020.00075"},{"key":"#cr-split#-e_1_3_2_1_5_1.1","unstructured":"Gina R. Bai. 2022. ginaBai\/TestingChecklistStudy: TestingChecklistStudyMaterials. https:\/\/doi.org\/10.5281\/zenodo.6466776 10.5281\/zenodo.6466776"},{"key":"#cr-split#-e_1_3_2_1_5_1.2","unstructured":"Gina R. Bai. 2022. ginaBai\/TestingChecklistStudy: TestingChecklistStudyMaterials. https:\/\/doi.org\/10.5281\/zenodo.6466776"},{"key":"e_1_3_2_1_6_1","volume-title":"Stolee","author":"Bai Gina R.","year":"2021","unstructured":"Gina R. Bai , Justin Smith , and Kathryn T . Stolee . 2021 . How Students Unit Test: Perceptions, Practices , and Pitfalls. In ITiCSE 2021: 26th ACM Conference on Innovation and Technology in Computer Science Education . ACM , 248--254. Gina R. Bai, Justin Smith, and Kathryn T. Stolee. 2021. How Students Unit Test: Perceptions, Practices, and Pitfalls. In ITiCSE 2021: 26th ACM Conference on Innovation and Technology in Computer Science Education . ACM, 248--254."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Lex Bijlsma Niels Doorn Harrie Passier Harold Pootjes and Sylvia Stuurman. 2021. How do Students Test Software Units?. In Int'l Conf. on Software Engineering: Software Engineering Education and Training (ICSE-SEET). 189--198.  Lex Bijlsma Niels Doorn Harrie Passier Harold Pootjes and Sylvia Stuurman. 2021. How do Students Test Software Units?. In Int'l Conf. on Software Engineering: Software Engineering Education and Training (ICSE-SEET). 189--198.","DOI":"10.1109\/ICSE-SEET52601.2021.00029"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2676723.2677247"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/308769.308798"},{"key":"e_1_3_2_1_10_1","article-title":"Teaching Software Testing using Data Structures","volume":"8","author":"Buckley Ingrid A.","year":"2017","unstructured":"Ingrid A. Buckley and Winston S. Buckley . 2017 . Teaching Software Testing using Data Structures . International Journal of Advanced Computer Science and Applications , Vol. 8 , 4 (2017). Ingrid A. Buckley and Winston S. Buckley. 2017. Teaching Software Testing using Data Structures. International Journal of Advanced Computer Science and Applications , Vol. 8, 4 (2017).","journal-title":"International Journal of Advanced Computer Science and Applications"},{"key":"e_1_3_2_1_11_1","volume-title":"Unit Test Smells and Accuracy of Software Engineering Student Test Suites. In Conference on Innovation and Technology in Computer Science Education. 7.","author":"Buffardi Kevin","year":"2021","unstructured":"Kevin Buffardi and Juan Aguirre-Ayala . 2021 . Unit Test Smells and Accuracy of Software Engineering Student Test Suites. In Conference on Innovation and Technology in Computer Science Education. 7. Kevin Buffardi and Juan Aguirre-Ayala. 2021. Unit Test Smells and Accuracy of Software Engineering Student Test Suites. In Conference on Innovation and Technology in Computer Science Education. 7."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE-SEET52601.2021.00011"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Lucas Cordova Jeffrey Carver Noah Gershmel and Gursimran Walia. 2021. A Comparison of Inquiry-Based Conceptual Feedback vs. Traditional Detailed Feedback Mechanisms in Software Testing Education: An Empirical Investigation . 87--93.  Lucas Cordova Jeffrey Carver Noah Gershmel and Gursimran Walia. 2021. A Comparison of Inquiry-Based Conceptual Feedback vs. Traditional Detailed Feedback Mechanisms in Software Testing Education: An Empirical Investigation . 87--93.","DOI":"10.1145\/3408877.3432417"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3350768.3350796"},{"key":"e_1_3_2_1_15_1","volume-title":"Applying PBL in Software Engineering Education. In 2009 22nd Conference on Software Engineering Education and Training. 182--189","author":"dos Santos Simone C.","unstructured":"Simone C. dos Santos , Maria da Concei\u00e7\u00e3o Moraes Batista , Ana Paula C. Cavalcanti , Jones O. Albuquerque , and Silvio R.L. Meira . 2009 . Applying PBL in Software Engineering Education. In 2009 22nd Conference on Software Engineering Education and Training. 182--189 . Simone C. dos Santos, Maria da Concei\u00e7\u00e3o Moraes Batista, Ana Paula C. Cavalcanti, Jones O. Albuquerque, and Silvio R.L. Meira. 2009. Applying PBL in Software Engineering Education. In 2009 22nd Conference on Software Engineering Education and Training. 182--189."},{"key":"e_1_3_2_1_16_1","volume-title":"Comparing Test Quality Measures for Assessing Student-Written Tests. In 36th International Conference on Software Engineering (ICSE Companion","author":"Stephen","year":"2014","unstructured":"Stephen H. Edwards and Zalia Shams. 2014a . Comparing Test Quality Measures for Assessing Student-Written Tests. In 36th International Conference on Software Engineering (ICSE Companion 2014 ). 354--363. Stephen H. Edwards and Zalia Shams. 2014a. Comparing Test Quality Measures for Assessing Student-Written Tests. In 36th International Conference on Software Engineering (ICSE Companion 2014). 354--363."},{"key":"e_1_3_2_1_17_1","volume-title":"Conference on Innovation and Technology in Computer Science Education (ITiCSE '14)","author":"Stephen","unstructured":"Stephen H. Edwards and Zalia Shams. 2014b. Do Student Programmers All Tend to Write the Same Software Tests? . In Conference on Innovation and Technology in Computer Science Education (ITiCSE '14) . 171--176. Stephen H. Edwards and Zalia Shams. 2014b. Do Student Programmers All Tend to Write the Same Software Tests?. In Conference on Innovation and Technology in Computer Science Education (ITiCSE '14). 171--176."},{"key":"e_1_3_2_1_18_1","volume-title":"Technical Symposium on CS Education . 221--226","author":"Edwards Stephen H.","unstructured":"Stephen H. Edwards , Zalia Shams , Michael Cogswell , and Robert C. Senkbeil . 2012. Running Students' Software Tests Against Each Others' Code: New Life for an Old \"Gimmick \". In Technical Symposium on CS Education . 221--226 . Stephen H. Edwards, Zalia Shams, Michael Cogswell, and Robert C. Senkbeil. 2012. Running Students' Software Tests Against Each Others' Code: New Life for an Old \"Gimmick\". In Technical Symposium on CS Education . 221--226."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ESEM.2013.15"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2512276.2512301"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/563340.563446"},{"key":"e_1_3_2_1_22_1","unstructured":"Orlena CZ Gotel and CW Finkelstein. 1994. An analysis of the requirements traceability problem. In Int'l Conf. on Requirements Engineering. 94--101.  Orlena CZ Gotel and CW Finkelstein. 1994. An analysis of the requirements traceability problem. In Int'l Conf. on Requirements Engineering. 94--101."},{"key":"e_1_3_2_1_23_1","volume-title":"Gall","author":"Grano Giovanni","year":"2019","unstructured":"Giovanni Grano , Fabio Palomba , and Harald C . Gall . 2019 . Lightweight Assessment of Test-Case Effectiveness using Source-Code-Quality Indicators. IEEE Transactions on Software Engineering ( 2019), 1--1. Giovanni Grano, Fabio Palomba, and Harald C. Gall. 2019. Lightweight Assessment of Test-Case Effectiveness using Source-Code-Quality Indicators. IEEE Transactions on Software Engineering (2019), 1--1."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cptl.2015.08.001"},{"key":"e_1_3_2_1_25_1","volume-title":"Integrating Testing Throughout the CS Curriculum. In Conference on Software Testing, Verification and Validation Workshops (ICSTW). 441--444","author":"Heckman Sarah","year":"2020","unstructured":"Sarah Heckman , Jessica Young Schmidt , and Jason King . 2020 . Integrating Testing Throughout the CS Curriculum. In Conference on Software Testing, Verification and Validation Workshops (ICSTW). 441--444 . Sarah Heckman, Jessica Young Schmidt, and Jason King. 2020. Integrating Testing Throughout the CS Curriculum. In Conference on Software Testing, Verification and Validation Workshops (ICSTW). 441--444."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2568225.2568271"},{"key":"e_1_3_2_1_27_1","volume-title":"Technical Symposium on Computer Science Education (SIGCSE '97)","author":"Jackson Ursula","unstructured":"Ursula Jackson , Bill Z. Manaris , and Ren\u00e9e A . McCauley. 1997. Strategies for Effective Integration of Software Engineering Concepts and Techniques into the Undergraduate Computer Science Curriculum . In Technical Symposium on Computer Science Education (SIGCSE '97) . 360--364. Ursula Jackson, Bill Z. Manaris, and Ren\u00e9e A. McCauley. 1997. Strategies for Effective Integration of Software Engineering Concepts and Techniques into the Undergraduate Computer Science Curriculum. In Technical Symposium on Computer Science Education (SIGCSE '97). 360--364."},{"key":"e_1_3_2_1_28_1","volume-title":"Bespoke Tools: Adapted to the Concepts Developers Know. In Foundations of Software Engineering (ESEC\/FSE","author":"Johnson Brittany","year":"2015","unstructured":"Brittany Johnson , Rahul Pandita , Emerson Murphy-Hill , and Sarah Heckman . 2015 . Bespoke Tools: Adapted to the Concepts Developers Know. In Foundations of Software Engineering (ESEC\/FSE 2015). 878--881. Brittany Johnson, Rahul Pandita, Emerson Murphy-Hill, and Sarah Heckman. 2015. Bespoke Tools: Adapted to the Concepts Developers Know. In Foundations of Software Engineering (ESEC\/FSE 2015). 878--881."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2950290.2950304"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486877"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/366413.364617"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1952.10483441"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2017.02.042"},{"key":"e_1_3_2_1_34_1","volume-title":"International Conference on Educational Data Mining. 1--13","author":"Marwan Samiha","year":"2021","unstructured":"Samiha Marwan , Yang Shi , Ian Menezes , Min Chi , Tiffany Barnes , and Thomas W Price . 2021 . Just a Few Expert Constraints Can Help : Humanizing Data-Driven Subgoal Detection for Novice Programming . In International Conference on Educational Data Mining. 1--13 . Samiha Marwan, Yang Shi, Ian Menezes, Min Chi, Tiffany Barnes, and Thomas W Price. 2021. Just a Few Expert Constraints Can Help : Humanizing Data-Driven Subgoal Detection for Novice Programming. In International Conference on Educational Data Mining. 1--13."},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASWEC.2008.4483238"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2931037.2931057"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5220\/0010496204370444"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635925"},{"key":"e_1_3_2_1_39_1","volume-title":"Understanding Myths and Realities of Test-suite Evolution. In Foundations of Software Engineering (FSE '12)","author":"Pinto Leandro Sales","year":"2012","unstructured":"Leandro Sales Pinto , Saurabh Sinha , and Alessandro Orso . 2012 . Understanding Myths and Realities of Test-suite Evolution. In Foundations of Software Engineering (FSE '12) . Article 33, bibinfonumpages11 pages. Leandro Sales Pinto, Saurabh Sinha, and Alessandro Orso. 2012. Understanding Myths and Realities of Test-suite Evolution. In Foundations of Software Engineering (FSE '12). Article 33, bibinfonumpages11 pages."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSTW50294.2020.00080"},{"key":"e_1_3_2_1_41_1","volume-title":"The Effect of Checklist in Code Review for Inexperienced Students: An Empirical Study. In Conference on Software Engineering Education and Training. 120--124","author":"Rong Guoping","year":"2012","unstructured":"Guoping Rong , Jingyi Li , Mingjuan Xie , and Tao Zheng . 2012 . The Effect of Checklist in Code Review for Inexperienced Students: An Empirical Study. In Conference on Software Engineering Education and Training. 120--124 . Guoping Rong, Jingyi Li, Mingjuan Xie, and Tao Zheng. 2012. The Effect of Checklist in Code Review for Inexperienced Students: An Empirical Study. In Conference on Software Engineering Education and Training. 120--124."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287384"},{"key":"e_1_3_2_1_43_1","volume-title":"Towards the Role of Test Design in Programming Assignments. In 2017 IEEE 30th Conference on Software Engineering Education and Training (CSEE&T) . 170--179","author":"Scatalon Lilian P.","unstructured":"Lilian P. Scatalon , Jorge M. Prates , Draylson M. de Souza , Ellen F. Barbosa , and Rog\u00e9rio E. Garcia . 2017 . Towards the Role of Test Design in Programming Assignments. In 2017 IEEE 30th Conference on Software Engineering Education and Training (CSEE&T) . 170--179 . Lilian P. Scatalon , Jorge M. Prates, Draylson M. de Souza, Ellen F. Barbosa, and Rog\u00e9rio E. Garcia. 2017. Towards the Role of Test Design in Programming Assignments. In 2017 IEEE 30th Conference on Software Engineering Education and Training (CSEE&T) . 170--179."},{"key":"e_1_3_2_1_44_1","volume-title":"Toward Practical Mutation Analysis for Evaluating the Quality of Student-Written Software Tests. In ACM Conference on International Computing Education Research (ICER '13)","author":"Shams Zalia","unstructured":"Zalia Shams and Stephen H. Edwards . 2013 . Toward Practical Mutation Analysis for Evaluating the Quality of Student-Written Software Tests. In ACM Conference on International Computing Education Research (ICER '13) . 53--58. Zalia Shams and Stephen H. Edwards. 2013. Toward Practical Mutation Analysis for Evaluating the Quality of Student-Written Software Tests. In ACM Conference on International Computing Education Research (ICER '13). 53--58."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1176617.1176743"},{"key":"e_1_3_2_1_46_1","volume-title":"Investigating Severity Thresholds for Test Smells. In Mining Software Repositories (MSR '20)","author":"Spadini Davide","year":"2020","unstructured":"Davide Spadini , Martin Schvarcbacher , Ana-Maria Oprescu , Magiel Bruntink , and Alberto Bacchelli . 2020 . Investigating Severity Thresholds for Test Smells. In Mining Software Repositories (MSR '20) . 311--321. Davide Spadini, Martin Schvarcbacher, Ana-Maria Oprescu, Magiel Bruntink, and Alberto Bacchelli. 2020. Investigating Severity Thresholds for Test Smells. In Mining Software Repositories (MSR '20). 311--321."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.21037\/jtd.2016.08.16"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/52.582981"},{"key":"e_1_3_2_1_49_1","volume-title":"36th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '05)","author":"Stevenson Michael","year":"2005","unstructured":"Wick, Michael and Stevenson , Daniel and Wagner , Paul. 2005 . Using Testing and JUnit Across the Curriculum . In 36th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '05) . 236--240. Wick, Michael and Stevenson, Daniel and Wagner, Paul. 2005. Using Testing and JUnit Across the Curriculum . In 36th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '05). 236--240."},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISSRE.2003.1251029"}],"event":{"name":"ITiCSE 2022: Innovation and Technology in Computer Science Education","location":"Dublin Ireland","acronym":"ITiCSE 2022","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3502718.3524799","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3502718.3524799","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:47Z","timestamp":1750183787000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3502718.3524799"}},"subtitle":["Exploring the Impact of a Checklist Intervention on the Quality of Student-authored Unit Tests"],"short-title":[],"issued":{"date-parts":[[2022,7,7]]},"references-count":51,"alternative-id":["10.1145\/3502718.3524799","10.1145\/3502718"],"URL":"https:\/\/doi.org\/10.1145\/3502718.3524799","relation":{},"subject":[],"published":{"date-parts":[[2022,7,7]]},"assertion":[{"value":"2022-07-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}