{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T20:37:23Z","timestamp":1773693443773,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,26]],"date-time":"2021-06-26T00:00:00Z","timestamp":1624665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,26]]},"DOI":"10.1145\/3430665.3456323","type":"proceedings-article","created":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T22:26:22Z","timestamp":1624055182000},"page":"352-358","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Assessing Programming Skills and Knowledge During the COVID-19 Pandemic: An Experience Report"],"prefix":"10.1145","author":[{"given":"Norman Tiong Seng","family":"Lee","sequence":"first","affiliation":[{"name":"Singapore University of Technology and Design, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oka","family":"Kurniawan","sequence":"additional","affiliation":[{"name":"Singapore University of Technology and Design, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kenny Tsu Wei","family":"Choo","sequence":"additional","affiliation":[{"name":"Singapore University of Technology and Design, Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,26]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/273133.273140"},{"key":"e_1_3_2_1_2_1","first-page":"1","article-title":"When old becomes new: a case study of oral examination as an online assessment tool","volume":"0","author":"Akimov Alexandr","year":"2020","unstructured":"Alexandr Akimov and Mirela Malin . 2020 . When old becomes new: a case study of oral examination as an online assessment tool . Assessment & Evaluation in Higher Education , Vol. 0 , 0 (2020), 1 -- 17 . https:\/\/doi.org\/10.1080\/02602938.2020.1730301 Alexandr Akimov and Mirela Malin. 2020. When old becomes new: a case study of oral examination as an online assessment tool. Assessment & Evaluation in Higher Education, Vol. 0, 0 (2020), 1--17. https:\/\/doi.org\/10.1080\/02602938.2020.1730301","journal-title":"Assessment & Evaluation in Higher Education"},{"key":"e_1_3_2_1_3_1","volume-title":"Infocomm Usage-Households and Individuals","author":"Development Authority Infocomm Media","year":"2021","unstructured":"Infocomm Media Development Authority . 2020. Infocomm Usage-Households and Individuals . Singapore . https:\/\/www.imda.gov.sg\/infocomm-media-landscape\/research-and-statistics\/infocomm-usage-households-and-individuals Retrieved March 10, 2021 from Infocomm Media Development Authority. 2020. Infocomm Usage-Households and Individuals. Singapore. https:\/\/www.imda.gov.sg\/infocomm-media-landscape\/research-and-statistics\/infocomm-usage-households-and-individuals Retrieved March 10, 2021 from"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1508865.1508989"},{"key":"e_1_3_2_1_5_1","volume-title":"Jorre de St Jorre","author":"Bearman M.","year":"2020","unstructured":"M. Bearman , P. Dawson , M. O'Donnell , J. Tai , and T. Jorre de St Jorre . 2020 . Ensuring academic integrity and assessment security with redesigned online delivery. https:\/\/dteach.deakin.edu.au\/2020\/03\/23\/academic-integrity-online\/ M. Bearman, P. Dawson, M. O'Donnell, J. Tai, and T. Jorre de St Jorre. 2020. Ensuring academic integrity and assessment security with redesigned online delivery. https:\/\/dteach.deakin.edu.au\/2020\/03\/23\/academic-integrity-online\/"},{"key":"e_1_3_2_1_6_1","first-page":"2","article-title":"Teaching with Games: The Minesweeper and Asteroids Experience","volume":"17","author":"Becker Katrin","year":"2001","unstructured":"Katrin Becker . 2001 . Teaching with Games: The Minesweeper and Asteroids Experience . J. Comput. Sci. Coll. , Vol. 17 , 2 (Dec. 2001), 23--33. Katrin Becker. 2001. Teaching with Games: The Minesweeper and Asteroids Experience. J. Comput. Sci. Coll., Vol. 17, 2 (Dec. 2001), 23--33.","journal-title":"J. Comput. Sci. Coll."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1080\/02602938.2018.1527892"},{"key":"e_1_3_2_1_8_1","volume-title":"proceedings of 2nd international plagiarism conference. Citeseer, 19--21","author":"Clarke Robert","year":"2006","unstructured":"Robert Clarke and Thomas Lancaster . 2006 . Eliminating the successor to plagiarism? Identifying the usage of contract cheating sites . In proceedings of 2nd international plagiarism conference. Citeseer, 19--21 . Robert Clarke and Thomas Lancaster. 2006. Eliminating the successor to plagiarism? Identifying the usage of contract cheating sites. In proceedings of 2nd international plagiarism conference. Citeseer, 19--21."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPCA.2007.4365466"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2006.322314"},{"key":"e_1_3_2_1_11_1","first-page":"1","article-title":"COVID-19: 20 countries' higher education intra-period digital pedagogy responses","volume":"3","author":"Crawford Joseph","year":"2020","unstructured":"Joseph Crawford , Kerryn Butler-Henderson , J\u00fcrgen Rudolph , Bashar Malkawi , Matt Glowatz , Rob Burton , Paola A. Magni , and Sophia Lam . 2020 . COVID-19: 20 countries' higher education intra-period digital pedagogy responses . Journal of Applied Learning & Teaching , Vol. 3 , 1 (2020), 1 -- 20 . https:\/\/doi.org\/\/10.37074\/jalt.2020.3.1.7 Joseph Crawford, Kerryn Butler-Henderson, J\u00fcrgen Rudolph, Bashar Malkawi, Matt Glowatz, Rob Burton, Paola A. Magni, and Sophia Lam. 2020. COVID-19: 20 countries' higher education intra-period digital pedagogy responses. Journal of Applied Learning & Teaching, Vol. 3, 1 (2020), 1--20. https:\/\/doi.org\/\/10.37074\/jalt.2020.3.1.7","journal-title":"Journal of Applied Learning & Teaching"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3416465.3416472"},{"key":"e_1_3_2_1_13_1","unstructured":"Coleen Flaherty. 2020. https:\/\/www.insidehighered.com\/news\/2020\/05\/11\/online-proctoring-surging-during-covid-19  Coleen Flaherty. 2020. https:\/\/www.insidehighered.com\/news\/2020\/05\/11\/online-proctoring-surging-during-covid-19"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/0047239520934017"},{"key":"e_1_3_2_1_15_1","first-page":"3","article-title":"Assessing Students' Knowledge: Oral Exams vs","volume":"37","author":"Gharibyan Hasmik","year":"2005","unstructured":"Hasmik Gharibyan . 2005 . Assessing Students' Knowledge: Oral Exams vs . Written Tests. SIGCSE Bull. , Vol. 37 , 3 (June 2005), 143--147. Hasmik Gharibyan. 2005. Assessing Students' Knowledge: Oral Exams vs. Written Tests. SIGCSE Bull., Vol. 37, 3 (June 2005), 143--147.","journal-title":"Written Tests. SIGCSE Bull."},{"key":"e_1_3_2_1_16_1","unstructured":"Anandha Gopalan and Robert Chatley. 2020. Converting to online exams. http:\/\/www.imperial.ac.uk\/staff\/educational-development\/teaching-toolkit\/remote-online-learning\/case-studies\/converting-to-online-exams\/ Retrieved June 25 2020 from  Anandha Gopalan and Robert Chatley. 2020. Converting to online exams. http:\/\/www.imperial.ac.uk\/staff\/educational-development\/teaching-toolkit\/remote-online-learning\/case-studies\/converting-to-online-exams\/ Retrieved June 25 2020 from"},{"key":"e_1_3_2_1_17_1","volume-title":"COVID-19 circuit breaker: Closure of workplace premises. https:\/\/www.gov.sg\/article\/covid-19-circuit-breaker-closure-of-workplace-premises Retrieved","author":"Government Singapore","year":"2021","unstructured":"Singapore Government . 2020. COVID-19 circuit breaker: Closure of workplace premises. https:\/\/www.gov.sg\/article\/covid-19-circuit-breaker-closure-of-workplace-premises Retrieved March 10, 2021 from Singapore Government. 2020. COVID-19 circuit breaker: Closure of workplace premises. https:\/\/www.gov.sg\/article\/covid-19-circuit-breaker-closure-of-workplace-premises Retrieved March 10, 2021 from"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3059065"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/02602938.2010.515012"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1080\/02602938.2014.961124"},{"key":"e_1_3_2_1_21_1","volume-title":"https:\/\/web.respondus.com\/he\/monitor\/ Retrieved","author":"Respondus Inc. [n.d.] a. Respondus Monitor.","year":"2020","unstructured":"Respondus Inc. [n.d.] a. Respondus Monitor. https:\/\/web.respondus.com\/he\/monitor\/ Retrieved June 25, 2020 from Respondus Inc. [n.d.] a. Respondus Monitor. https:\/\/web.respondus.com\/he\/monitor\/ Retrieved June 25, 2020 from"},{"key":"e_1_3_2_1_22_1","volume-title":"https:\/\/www.zoom.us Retrieved","author":"Zoom Video Communications Inc. [n.d.] b. Zoom.","year":"2021","unstructured":"Zoom Video Communications Inc. [n.d.] b. Zoom. https:\/\/www.zoom.us Retrieved Jan 10, 2021 from Zoom Video Communications Inc. [n.d.] b. Zoom. https:\/\/www.zoom.us Retrieved Jan 10, 2021 from"},{"key":"e_1_3_2_1_23_1","volume-title":"Inspera Smarter Proctoring. https:\/\/www.inspera.com\/smarter-proctoring Retrieved","year":"2021","unstructured":"Inspera. [n.d.]. Inspera Smarter Proctoring. https:\/\/www.inspera.com\/smarter-proctoring Retrieved Jan 10, 2021 from Inspera. [n.d.]. Inspera Smarter Proctoring. https:\/\/www.inspera.com\/smarter-proctoring Retrieved Jan 10, 2021 from"},{"key":"e_1_3_2_1_24_1","volume-title":"https:\/\/kivy.org Retrieved","year":"2020","unstructured":"Kivy. [n.d.]. Kivy. https:\/\/kivy.org Retrieved June 25, 2020 from Kivy. [n.d.]. Kivy. https:\/\/kivy.org Retrieved June 25, 2020 from"},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the 51st ACM Technical Symposium on Computer Science Education","author":"Kurniawan Oka","unstructured":"Oka Kurniawan , Norman Tiong Seng Lee , and Christopher M. Poskitt . 2020. Securing Bring-Your-Own-Device (BYOD) Programming Exams . In Proceedings of the 51st ACM Technical Symposium on Computer Science Education ( Portland, OR, USA) (SIGCSE '20). Association for Computing Machinery, New York, NY, USA, 880--886. https:\/\/doi.org\/10.1145\/3328778.3366907 Oka Kurniawan, Norman Tiong Seng Lee, and Christopher M. Poskitt. 2020. Securing Bring-Your-Own-Device (BYOD) Programming Exams. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education (Portland, OR, USA) (SIGCSE '20). Association for Computing Machinery, New York, NY, USA, 880--886. https:\/\/doi.org\/10.1145\/3328778.3366907"},{"key":"e_1_3_2_1_26_1","volume-title":"EduSCAPES: An SUTD Pedagogy Magazine. https:\/\/www.sutd.edu.sg\/learningsciences\/Resources\/SUTD-Pedagogy-Newsletter Retrieved","author":"Lee Norman","year":"2020","unstructured":"Norman Lee , Kenny Choo , and Oka Kurniawan . 2020. Assessing Programming Knowledge and Ability with an Online Oral Exam . In EduSCAPES: An SUTD Pedagogy Magazine. https:\/\/www.sutd.edu.sg\/learningsciences\/Resources\/SUTD-Pedagogy-Newsletter Retrieved June 10, 2020 from Norman Lee, Kenny Choo, and Oka Kurniawan. 2020. Assessing Programming Knowledge and Ability with an Online Oral Exam. In EduSCAPES: An SUTD Pedagogy Magazine. https:\/\/www.sutd.edu.sg\/learningsciences\/Resources\/SUTD-Pedagogy-Newsletter Retrieved June 10, 2020 from"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/820127.820176"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/0098628313487425"},{"key":"e_1_3_2_1_29_1","volume-title":"Assessing Student Learning: Alternatives to Closed-Book Exams. https:\/\/cat.wfu.edu\/2020\/04\/alternativestoexams\/ Retrieved","author":"McCauley Anita","year":"2020","unstructured":"Anita McCauley . 2020. Assessing Student Learning: Alternatives to Closed-Book Exams. https:\/\/cat.wfu.edu\/2020\/04\/alternativestoexams\/ Retrieved June 10, 2020 from Anita McCauley. 2020. Assessing Student Learning: Alternatives to Closed-Book Exams. https:\/\/cat.wfu.edu\/2020\/04\/alternativestoexams\/ Retrieved June 10, 2020 from"},{"key":"e_1_3_2_1_30_1","volume-title":"https:\/\/www.microsoft.com\/en-sg\/microsoft-365\/microsoft-teams\/group-chat-software Retrieved","author":"Teams Microsoft","year":"2020","unstructured":"Microsoft. [n.d.]. Microsoft Teams . https:\/\/www.microsoft.com\/en-sg\/microsoft-365\/microsoft-teams\/group-chat-software Retrieved June 25, 2020 from Microsoft. [n.d.]. Microsoft Teams. https:\/\/www.microsoft.com\/en-sg\/microsoft-365\/microsoft-teams\/group-chat-software Retrieved June 25, 2020 from"},{"key":"e_1_3_2_1_31_1","volume-title":"Lone Leth Thomsen, and Kristian Torp","author":"N\u00f8rmark Kurt","year":"2008","unstructured":"Kurt N\u00f8rmark , Lone Leth Thomsen, and Kristian Torp . 2008 . Mini project programming exams. In Reflections on the Teaching of Programming. Springer , 228--242. Kurt N\u00f8rmark, Lone Leth Thomsen, and Kristian Torp. 2008. Mini project programming exams. In Reflections on the Teaching of Programming. Springer, 228--242."},{"key":"e_1_3_2_1_32_1","volume-title":"Assessment and exams in times of Korona. https:\/\/mitt.uib.no\/courses\/25566\/pages\/assessment-and-exams-in-times-of-korona Retrieved","author":"University of Bergen. 2020.","year":"2020","unstructured":"University of Bergen. 2020. Assessment and exams in times of Korona. https:\/\/mitt.uib.no\/courses\/25566\/pages\/assessment-and-exams-in-times-of-korona Retrieved June 10, 2020 from University of Bergen. 2020. Assessment and exams in times of Korona. https:\/\/mitt.uib.no\/courses\/25566\/pages\/assessment-and-exams-in-times-of-korona Retrieved June 10, 2020 from"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287489"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1021\/ed084p1663"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.43.3.450"},{"key":"e_1_3_2_1_36_1","volume-title":"Teaching intelligence: how to take your classes online. https:\/\/www.timeshighereducation.com\/career\/teaching-intelligence-how-take-your-classes-online Retrieved","author":"Sanger Catherine Shea","year":"2020","unstructured":"Catherine Shea Sanger . 2020. Teaching intelligence: how to take your classes online. https:\/\/www.timeshighereducation.com\/career\/teaching-intelligence-how-take-your-classes-online Retrieved June 25, 2020 from Catherine Shea Sanger. 2020. Teaching intelligence: how to take your classes online. https:\/\/www.timeshighereducation.com\/career\/teaching-intelligence-how-take-your-classes-online Retrieved June 25, 2020 from"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734445"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1080\/23752696.2018.1510294"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3059064"},{"key":"e_1_3_2_1_40_1","volume-title":"Proceedings of the 25th International Conference on Software Engineering","author":"Sindre Guttorm","unstructured":"Guttorm Sindre , Steinar Line , and Ottar V. Valvrag . 2003. Positive Experiences with an Open Project Assignment in an Introductory Programming Course . In Proceedings of the 25th International Conference on Software Engineering ( Portland, Oregon) (ICSE '03). IEEE Computer Society, USA, 608--613. Guttorm Sindre, Steinar Line, and Ottar V. Valvrag. 2003. Positive Experiences with an Open Project Assignment in an Introductory Programming Course. In Proceedings of the 25th International Conference on Software Engineering (Portland, Oregon) (ICSE '03). IEEE Computer Society, USA, 608--613."},{"key":"e_1_3_2_1_41_1","first-page":"1","article-title":"The role of authentic assessment to preserve academic integrity and promote skill development and employability","volume":"0","author":"Sotiriadou Popi","year":"2019","unstructured":"Popi Sotiriadou , Danielle Logan , Amanda Daly , and Ross Guest . 2019 . The role of authentic assessment to preserve academic integrity and promote skill development and employability . Studies in Higher Education , Vol. 0 , 0 (2019), 1 -- 17 . https:\/\/doi.org\/10.1080\/03075079.2019.1582015 Popi Sotiriadou, Danielle Logan, Amanda Daly, and Ross Guest. 2019. The role of authentic assessment to preserve academic integrity and promote skill development and employability. Studies in Higher Education, Vol. 0, 0 (2019), 1--17. https:\/\/doi.org\/10.1080\/03075079.2019.1582015","journal-title":"Studies in Higher Education"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1300\/J460v02n03_04"},{"key":"e_1_3_2_1_43_1","volume-title":"Coronavirus: NUS students get zero marks for cheating in take-home exam. The Straits Times (15","author":"Wong Yang","year":"2020","unstructured":"Yang Wong . 2020 . Coronavirus: NUS students get zero marks for cheating in take-home exam. The Straits Times (15 Jun 2020). https:\/\/www.straitstimes.com\/singapore\/education\/coronavirus-nus-students-get-zero-marks-for-cheating-on-take-home-exam Yang Wong. 2020. Coronavirus: NUS students get zero marks for cheating in take-home exam. The Straits Times (15 Jun 2020). https:\/\/www.straitstimes.com\/singapore\/education\/coronavirus-nus-students-get-zero-marks-for-cheating-on-take-home-exam"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341525.3387376"}],"event":{"name":"ITiCSE 2021: 26th ACM Conference on Innovation and Technology in Computer Science Education","location":"Virtual Event Germany","acronym":"ITiCSE 2021","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the 26th ACM Conference on Innovation and Technology in Computer Science Education V. 1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430665.3456323","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3430665.3456323","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:22Z","timestamp":1750193242000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430665.3456323"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,26]]},"references-count":44,"alternative-id":["10.1145\/3430665.3456323","10.1145\/3430665"],"URL":"https:\/\/doi.org\/10.1145\/3430665.3456323","relation":{},"subject":[],"published":{"date-parts":[[2021,6,26]]},"assertion":[{"value":"2021-06-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}