{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T20:12:49Z","timestamp":1762459969673,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,26]],"date-time":"2021-06-26T00:00:00Z","timestamp":1624665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,26]]},"DOI":"10.1145\/3430665.3456373","type":"proceedings-article","created":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T22:26:22Z","timestamp":1624055182000},"page":"338-344","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Developing an Open-Book Online Exam for Final Year Students"],"prefix":"10.1145","author":[{"given":"Keith","family":"Quille","sequence":"first","affiliation":[{"name":"TU Dublin, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keith","family":"Nolan","sequence":"additional","affiliation":[{"name":"TU Dublin, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brett A.","family":"Becker","sequence":"additional","affiliation":[{"name":"University College Dublin, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Se\u00e1n","family":"McHugh","sequence":"additional","affiliation":[{"name":"TU Dublin, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,26]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Benjamin Samuel Bloom, et al","author":"Anderson Lorin W","year":"2001","unstructured":"Lorin W Anderson , Benjamin Samuel Bloom, et al . 2001 . A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. Longman . Lorin W Anderson, Benjamin Samuel Bloom, et al. 2001. A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. Longman."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/0260293970220103"},{"key":"e_1_3_2_1_3_1","volume-title":"Reliability and Learner Opinion. In International Conference on Engaging Pedagogy.","author":"Becker B","year":"2011","unstructured":"B Becker and Orla Butler . 2011 . Learner-to-Educator Feedback--Acquiescence Bias , Reliability and Learner Opinion. In International Conference on Engaging Pedagogy. B Becker and Orla Butler. 2011. Learner-to-Educator Feedback--Acquiescence Bias, Reliability and Learner Opinion. In International Conference on Engaging Pedagogy."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/0013188850270307"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.3108\/beej.2004.03000004"},{"key":"e_1_3_2_1_6_1","volume-title":"Coefficient alpha and the internal structure of tests. psychometrika 16, 3","author":"Cronbach Lee J","year":"1951","unstructured":"Lee J Cronbach . 1951. Coefficient alpha and the internal structure of tests. psychometrika 16, 3 ( 1951 ), 297--334. Lee J Cronbach. 1951. Coefficient alpha and the internal structure of tests. psychometrika 16, 3 (1951), 297--334."},{"key":"e_1_3_2_1_7_1","volume-title":"Construct validity in psychological tests. Psychological bulletin 52, 4","author":"Cronbach Lee J","year":"1955","unstructured":"Lee J Cronbach and Paul E Meehl . 1955. Construct validity in psychological tests. Psychological bulletin 52, 4 ( 1955 ), 281. Lee J Cronbach and Paul E Meehl. 1955. Construct validity in psychological tests. Psychological bulletin 52, 4 (1955), 281."},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of the Fourteenth Australasian Computing Education Conference (ACE '12)","author":"de Raadt Michael","year":"2012","unstructured":"Michael de Raadt . 2012 . Student Created Cheat-sheets in Examinations: Impact on Student Outcomes . In Proceedings of the Fourteenth Australasian Computing Education Conference (ACE '12) . Australian Computer Society, Inc., Darlinghurst, Australia, Australia, 71--76. http:\/\/dl.acm.org\/citation.cfm?id=2483716.2483725 Michael de Raadt. 2012. Student Created Cheat-sheets in Examinations: Impact on Student Outcomes. In Proceedings of the Fourteenth Australasian Computing Education Conference (ACE '12). Australian Computer Society, Inc., Darlinghurst, Australia, Australia, 71--76. http:\/\/dl.acm.org\/citation.cfm?id=2483716.2483725"},{"key":"e_1_3_2_1_9_1","volume-title":"Measuring Effects of Modality on Perceived Test Anxiety for Computer Programming Exams. SIGCSE'16 Proceedings of the 47th ACM Technical Symposium on Computing Science Education(2016)","author":"Deloatch Robert","year":"2016","unstructured":"Robert Deloatch , Brian P Bailey , and Alex Kirlik . 2016 . Measuring Effects of Modality on Perceived Test Anxiety for Computer Programming Exams. SIGCSE'16 Proceedings of the 47th ACM Technical Symposium on Computing Science Education(2016) , 291--296. https:\/\/doi.org\/10.1145\/2839509.2844604 Robert Deloatch, Brian P Bailey, and Alex Kirlik. 2016. Measuring Effects of Modality on Perceived Test Anxiety for Computer Programming Exams. SIGCSE'16 Proceedings of the 47th ACM Technical Symposium on Computing Science Education(2016), 291--296. https:\/\/doi.org\/10.1145\/2839509.2844604"},{"key":"e_1_3_2_1_10_1","volume-title":"Why Welch's test is Type Ierror robust. The Quantitative Methods in Psychology12, 1","author":"Derrick Ben","year":"2016","unstructured":"Ben Derrick , Deirdre Toher , and Paul White . 2016. Why Welch's test is Type Ierror robust. The Quantitative Methods in Psychology12, 1 ( 2016 ). Ben Derrick, Deirdre Toher, and Paul White. 2016. Why Welch's test is Type Ierror robust. The Quantitative Methods in Psychology12, 1 (2016)."},{"key":"e_1_3_2_1_11_1","volume-title":"Amanda Fitzgerald, and Aileen Oreilly.","author":"Dooley Barbara","year":"2019","unstructured":"Barbara Dooley , cliodhna o'connor , Amanda Fitzgerald, and Aileen Oreilly. 2019 . My World Survey 2: The National Study of Youth Mental Health in Ireland . Barbara Dooley, cliodhna o'connor, Amanda Fitzgerald, and Aileen Oreilly. 2019. My World Survey 2: The National Study of Youth Mental Health in Ireland."},{"key":"e_1_3_2_1_12_1","volume-title":"Open-book assessment: A contribution to improved learning? Studies in Educational Evaluation26, 2","author":"Eilertsen Tor Vidar","year":"2000","unstructured":"Tor Vidar Eilertsen and Odd Valdermo . 2000. Open-book assessment: A contribution to improved learning? Studies in Educational Evaluation26, 2 ( 2000 ), 91 --103. https:\/\/doi.org\/10.1016\/S0191--491X(00)00010--9 Tor Vidar Eilertsen and Odd Valdermo. 2000. Open-book assessment: A contribution to improved learning? Studies in Educational Evaluation26, 2 (2000), 91 --103. https:\/\/doi.org\/10.1016\/S0191--491X(00)00010--9"},{"key":"e_1_3_2_1_13_1","unstructured":"Centre for Teaching and Learning. [n.d.]. A guide for academics - A guide foropen book exams available at https:\/\/www.newcastle.edu.au\/__data\/assets\/pdf_file\/0006\/268980\/Open-Book-Exams.pdf.  Centre for Teaching and Learning. [n.d.]. A guide for academics - A guide foropen book exams available at https:\/\/www.newcastle.edu.au\/__data\/assets\/pdf_file\/0006\/268980\/Open-Book-Exams.pdf."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3174781.3174784"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366940"},{"volume-title":"Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE '19)","author":"Mason Tony","key":"e_1_3_2_1_16_1","unstructured":"Tony Mason , Ada Gavrilovska , and David A. Joyner . 2019. Collaboration Versus Cheating: Reducing Code Plagiarism in an Online MS Computer Science Program . In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE '19) . Association for Computing Machinery, New York, NY, USA, 1004--1010. https:\/\/doi.org\/10.1145\/3287324.3287443 Tony Mason, Ada Gavrilovska, and David A. Joyner. 2019. Collaboration Versus Cheating: Reducing Code Plagiarism in an Online MS Computer Science Program. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE '19). Association for Computing Machinery, New York, NY, USA, 1004--1010. https:\/\/doi.org\/10.1145\/3287324.3287443"},{"key":"e_1_3_2_1_17_1","unstructured":"Microsoft. [n.d.]. Azure Notebooks. https:\/\/notebooks.azure.com\/.  Microsoft. [n.d.]. Azure Notebooks. https:\/\/notebooks.azure.com\/."},{"volume-title":"Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (SIGCSE'21)","author":"Mooney Catherine","key":"e_1_3_2_1_18_1","unstructured":"Catherine Mooney and Brett A. Becker . 2021. Investigating the Impact of the COVID-19 Pandemic on Computing Students' Sense of Belonging . In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (SIGCSE'21) . Association for Computing Machinery, New York, NY, USA, 612--618. https:\/\/doi.org\/10.1145\/3408877.3432407 Catherine Mooney and Brett A. Becker. 2021. Investigating the Impact of the COVID-19 Pandemic on Computing Students' Sense of Belonging. In Proceedings of the 52nd ACM Technical Symposium on Computer Science Education (SIGCSE'21). Association for Computing Machinery, New York, NY, USA, 612--618. https:\/\/doi.org\/10.1145\/3408877.3432407"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999541.2999557"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351287.3351296"},{"key":"e_1_3_2_1_21_1","volume-title":"International Conference on Engaging Pedagogy(2015)","author":"Nolan Keith","year":"2015","unstructured":"Keith Nolan , Aidan Mooney , and Susan Bergin . 2015 . Facilitating student learning in Computer Science: large class sizes and interventions . International Conference on Engaging Pedagogy(2015) . Keith Nolan, Aidan Mooney, and Susan Bergin. 2015. Facilitating student learning in Computer Science: large class sizes and interventions. International Conference on Engaging Pedagogy(2015)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3286960.3286966"},{"key":"e_1_3_2_1_23_1","volume-title":"Proceedings of the 10th International Conference on Computer Science Education: Innovation and Technology (CSEIT'19)","author":"Nolan Keith","year":"2019","unstructured":"Keith Nolan , Aidan Mooney , and Susan Bergin . 2019 . A Picture of Mental Health in First Year Computer Science . In Proceedings of the 10th International Conference on Computer Science Education: Innovation and Technology (CSEIT'19) . Global Science and Technology Fourm. Keith Nolan, Aidan Mooney, and Susan Bergin. 2019. A Picture of Mental Health in First Year Computer Science. In Proceedings of the 10th International Conference on Computer Science Education: Innovation and Technology (CSEIT'19). Global Science and Technology Fourm."},{"volume-title":"Psychometric theory 3E","author":"Nunnally Jum C","key":"e_1_3_2_1_24_1","unstructured":"Jum C Nunnally . 1994. Psychometric theory 3E . Tata McGraw-Hill education. Jum C Nunnally. 1994. Psychometric theory 3E. Tata McGraw-Hill education."},{"key":"e_1_3_2_1_25_1","first-page":"36","article-title":"Critical thinking: The art of Socratic questioning","volume":"31","author":"Paul Richard","year":"2007","unstructured":"Richard Paul and Linda Elder . 2007 . Critical thinking: The art of Socratic questioning . Journal of developmental education 31 , 1 (2007), 36 . Richard Paul and Linda Elder. 2007. Critical thinking: The art of Socratic questioning. Journal of developmental education 31, 1 (2007), 36.","journal-title":"Journal of developmental education"},{"key":"e_1_3_2_1_27_1","volume-title":"International Conference on Enguaging Pedagogy (ICEP), 3rd and 4th December, College of Computing Technology","author":"Quille K","year":"2015","unstructured":"K Quille and S Bergin . 2015 . Programming: Factors that Influence Success Revisited and Expanded . In International Conference on Enguaging Pedagogy (ICEP), 3rd and 4th December, College of Computing Technology , Dublin, Ireland. K Quille and S Bergin. 2015. Programming: Factors that Influence Success Revisited and Expanded. In International Conference on Enguaging Pedagogy (ICEP), 3rd and 4th December, College of Computing Technology, Dublin, Ireland."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2019.1612679"},{"key":"e_1_3_2_1_29_1","volume-title":"Becker","author":"Quille Keith","year":"2020","unstructured":"Keith Quille , Keith Nolan , Sean McHugh , and Brett A . Becker . 2020 . Associated Exam Papers and Module Descriptors . http:\/\/tiny.cc\/ITiCSE21OpenBook. Keith Quille, Keith Nolan, Sean McHugh, and Brett A. Becker. 2020. Associated Exam Papers and Module Descriptors. http:\/\/tiny.cc\/ITiCSE21OpenBook."},{"key":"e_1_3_2_1_30_1","first-page":"1","article-title":"Open book testing in online learning environments","volume":"7","author":"Rakes Glenda C","year":"2008","unstructured":"Glenda C Rakes . 2008 . Open book testing in online learning environments . Journal of Interactive Online Learning 7 , 1 (2008), 1 -- 9 . Glenda C Rakes. 2008. Open book testing in online learning environments. Journal of Interactive Online Learning 7, 1 (2008), 1--9.","journal-title":"Journal of Interactive Online Learning"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1839594.1839612"},{"key":"e_1_3_2_1_32_1","volume-title":"Study Behavior in the Closed-Book and the Open-Book Examination: A Comparative Analysis. Educational Research and Evaluation6, 4","author":"Theophilides Christos","year":"2000","unstructured":"Christos Theophilides and Mary Koutselini . 2000. Study Behavior in the Closed-Book and the Open-Book Examination: A Comparative Analysis. Educational Research and Evaluation6, 4 ( 2000 ), 379--393. https:\/\/doi.org\/10.1076\/edre.6.4.379.6932 arXiv: https:\/\/doi.org\/10.1076\/edre.6.4.379.6932 Christos Theophilides and Mary Koutselini. 2000. Study Behavior in the Closed-Book and the Open-Book Examination: A Comparative Analysis. Educational Research and Evaluation6, 4 (2000), 379--393. https:\/\/doi.org\/10.1076\/edre.6.4.379.6932 arXiv: https:\/\/doi.org\/10.1076\/edre.6.4.379.6932"},{"key":"e_1_3_2_1_33_1","volume-title":"Developments in Business Simulation and Experiential Learning: Proceedings of the Annual ABSEL conference","volume":"33","author":"Whiteley T Rick","year":"2014","unstructured":"T Rick Whiteley . 2014 . Using The Socratic Method and Bloom's Taxonomy of the Cognitive Domain to Enhance Online Discussion, Critical Thinking, and Stu-dent Learning . In Developments in Business Simulation and Experiential Learning: Proceedings of the Annual ABSEL conference , Vol. 33 . T Rick Whiteley. 2014. Using The Socratic Method and Bloom's Taxonomy of the Cognitive Domain to Enhance Online Discussion, Critical Thinking, and Stu-dent Learning. In Developments in Business Simulation and Experiential Learning: Proceedings of the Annual ABSEL conference, Vol. 33."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432515"}],"event":{"name":"ITiCSE 2021: 26th ACM Conference on Innovation and Technology in Computer Science Education","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Virtual Event Germany","acronym":"ITiCSE 2021"},"container-title":["Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430665.3456373","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3430665.3456373","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:41Z","timestamp":1750195481000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430665.3456373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,26]]},"references-count":33,"alternative-id":["10.1145\/3430665.3456373","10.1145\/3430665"],"URL":"https:\/\/doi.org\/10.1145\/3430665.3456373","relation":{},"subject":[],"published":{"date-parts":[[2021,6,26]]},"assertion":[{"value":"2021-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}