{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T00:45:04Z","timestamp":1782521104354,"version":"3.54.5"},"reference-count":86,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2025,9,30]]},"abstract":"<jats:p>\n            Automated assessment is well-established within computer science courses but largely absent from human\n            <jats:bold>\u2013<\/jats:bold>\n            computer interaction courses. Automating the assessment of human\n            <jats:bold>\u2013<\/jats:bold>\n            computer interaction (HCI) is challenging because the coursework tends not to be computational but rather highly creative, such as designing and implementing interactive prototypes. We meet this challenge by developing an automarker for HCI \u2018MarCHIr\u2019 to assess key aspects of web prototypes: visual design, interactivity and accessibility. MarCHIr automatically compiles web prototypes and analyses them at the pixel level to assess designs using foundational Gestalt visual principles. While computer science student assessments are often personalised with permutations of numbers, we use random assignment of colours to personalise creative prototype assignments at the scale of hundreds of students. Finally, MarCHIr integrates industry accessibility checks to HCI student assessment. We share 2 years of case study data across two cohorts of university students and reflect on implications for the use of automated assessment within HCI tertiary education.\n          <\/jats:p>","DOI":"10.1145\/3732788","type":"journal-article","created":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T08:20:09Z","timestamp":1747038009000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["An Automated Marker for Computer\u2013Human Interaction \u2018MarCHIr\u2019: Assessment of Creative Web Prototypes"],"prefix":"10.1145","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5541-4425","authenticated-orcid":false,"given":"Danielle","family":"Lottridge","sequence":"first","affiliation":[{"name":"Computer Science, University of Auckland, Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6181-5383","authenticated-orcid":false,"given":"Davis","family":"Dimalen","sequence":"additional","affiliation":[{"name":"Computer Science, University of Auckland, Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3095-8717","authenticated-orcid":false,"given":"Gerald","family":"Weber","sequence":"additional","affiliation":[{"name":"Computer Science, University of Auckland, Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,7,22]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2018. Evaluation and Repair: LIFT from UsableNet. Retrieved August 16 2022 from https:\/\/jimthatcher.com\/lifteval.htm"},{"key":"e_1_3_1_3_2","unstructured":"2021. Example of Proximity Principle in Wiki Commons. Retrieved August 16 2022 from https:\/\/commons.wikimedia.org\/wiki\/File:%E5%9C%96a.jpg"},{"key":"e_1_3_1_4_2","unstructured":"2022. CodeRunner. Retrieved August 16 2022 from https:\/\/moodle.org\/plugins\/qtype_coderunner"},{"key":"e_1_3_1_5_2","unstructured":"2022. Developer Survey 2022. Retrieved July 02 2024 from https:\/\/survey.stackoverflow.co\/2022\/#technology"},{"key":"e_1_3_1_6_2","unstructured":"2022. Pa11y. Retrieved August 16 2022 from https:\/\/pa11y.org\/"},{"key":"e_1_3_1_7_2","unstructured":"2022. Selenium. Retrieved August 16 2022 from https:\/\/www.selenium.dev\/"},{"key":"e_1_3_1_8_2","unstructured":"2022. The State of Developer Ecosystem 2022. Retrieved July 02 2024 from https:\/\/www.jetbrains.com\/lp\/devecosystem-2022\/"},{"key":"e_1_3_1_9_2","unstructured":"2022. The Top Programming Languages 2022. Retrieved July 02 2024 from https:\/\/octoverse.github.com\/2022\/top-programming-languages"},{"issue":"10","key":"e_1_3_1_10_2","first-page":"47","article-title":"JavaMarker extended: An Eclipse plugin to mark Java GUI programs","volume":"29","author":"Ahmadzadeh Marzieh","year":"2011","unstructured":"Marzieh Ahmadzadeh, Mahsa Janghorban, and Behnaz Jamasb. 2011. JavaMarker extended: An Eclipse plugin to mark Java GUI programs. International\u00a0Journal\u00a0of\u00a0Computer\u00a0Applications 29, 10 (2011), 47\u201351.","journal-title":"International\u00a0Journal\u00a0of\u00a0Computer\u00a0Applications"},{"key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1145\/1535654.1535662","volume-title":"Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)","author":"Aizpurua Amaia","year":"2009","unstructured":"Amaia Aizpurua, Myriam Arrue, Markel Vigo, and Julio Abascal. 2009. Transition of accessibility evaluation tools to new standards. In Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A), 36\u201344."},{"key":"e_1_3_1_12_2","volume-title":"Proceedings of the 17th International Web for All Conference (W4A \u201920)","author":"Almeida Rafael","year":"2020","unstructured":"Rafael Almeida and Carlos Duarte. 2020. Analysis of automated contrast checking tools. In Proceedings of the 17th International Web for All Conference (W4A \u201920). ACM, New York, NY, Article 18, 4 pages. DOI: 10.1145\/3371300.3383348"},{"key":"e_1_3_1_13_2","volume-title":"A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom\u2019s Taxonomy of Educational Objectives","author":"Anderson Lorin W.","year":"2001","unstructured":"Lorin W. Anderson, David R. Krathwohl, Peter Airasian, Kathleen Cruikshank, Richard Mayer, Paul Pintrich, James Raths, and Merlin Wittrock. 2001. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom\u2019s Taxonomy of Educational Objectives. Longman."},{"key":"e_1_3_1_14_2","first-page":"79","volume-title":"Proceedings of the 10th Computer Science Education Research Conference","author":"Steven Annor Prince","year":"2021","unstructured":"Prince Steven Annor, Edwin Kayang, Samuel Boateng, and George Boateng. 2021. Autograd: Automated grading software for mobile game assignments in suacode courses. In Proceedings of the 10th Computer Science Education Research Conference, 79\u201385."},{"key":"e_1_3_1_15_2","volume-title":"Standards for Educational and Psychological Testing","author":"American Educational Research Association, American Psychological Association","year":"2014","unstructured":"American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. 2014. Standards for Educational and Psychological Testing. American Educational Research Association."},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1145\/3328778.3366843","volume-title":"Proceedings of the 51st ACM Technical Symposium on Computer Science Education","author":"Baker Catherine M.","year":"2020","unstructured":"Catherine M. Baker, Yasmine N. El-Glaly, and Kristen Shinohara. 2020. A systematic analysis of accessibility in computing education research. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education, 107\u2013113."},{"issue":"3","key":"e_1_3_1_17_2","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1145\/382208.382516","article-title":"Machine assisted marking of programming assignments","volume":"17","author":"Benson M.","year":"1985","unstructured":"M. Benson. 1985. Machine assisted marking of programming assignments. ACM SIGCSE Bulletin 17, 3 (1985), 24\u201325.","journal-title":"ACM SIGCSE Bulletin"},{"issue":"3","key":"e_1_3_1_18_2","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1145\/1026487.1008016","article-title":"An experimental analysis of GAME: A generic automated marking environment","volume":"36","author":"Blumenstein Michael","year":"2004","unstructured":"Michael Blumenstein, Steven Green, Ann Nguyen, and Vallipuram Muthukkumarasamy. 2004. An experimental analysis of GAME: A generic automated marking environment. ACM SIGCSE Bulletin 36, 3 (2004), 67\u201371.","journal-title":"ACM SIGCSE Bulletin"},{"issue":"3","key":"e_1_3_1_19_2","first-page":"223","article-title":"Teaching tip: How to reduce plagiarism","volume":"14","author":"Born Apiwan D.","year":"2003","unstructured":"Apiwan D. Born. 2003. Teaching tip: How to reduce plagiarism. Journal of Information Systems Education 14, 3 (2003), 223.","journal-title":"Journal of Information Systems Education"},{"key":"e_1_3_1_20_2","article-title":"Automatic web usability evaluation: What needs to be done","author":"Giorgio Brajnik","year":"2000","unstructured":"Giorgio Brajnik. 2000. Automatic web usability evaluation: What needs to be done. In Proceedings of the 6th Conference on Human Factors and the Web.","journal-title":"Proceedings of the 6th Conference on Human Factors and the Web"},{"key":"e_1_3_1_21_2","first-page":"1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems","author":"Cambre Julia","year":"2018","unstructured":"Julia Cambre, Scott Klemmer, and Chinmay Kulkarni. 2018. Juxtapeer: Comparative peer review yields higher quality feedback and promotes deeper reflection. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1\u201313."},{"key":"e_1_3_1_22_2","volume-title":"The Psychology of Human-Computer Interaction","author":"Card Stuart","year":"1983","unstructured":"Stuart Card, Thomas Moran, and Allen Newell. 1983. The Psychology of Human-Computer Interaction. Lawrence Erlbaum Associates."},{"key":"e_1_3_1_23_2","first-page":"697","volume-title":"Proceedings of the 2021 Computing Conference on Intelligent Computing1","author":"Carmichael Dawn","year":"2022","unstructured":"Dawn Carmichael, Claire MacEachen, and Jacqueline Archibald. 2022. Gamification in a learning resource for the study of human computer interaction. In Proceedings of the 2021 Computing Conference on Intelligent Computing, Vol. 1, Springer, 697\u2013717."},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/1101670.1101673"},{"key":"e_1_3_1_25_2","first-page":"100027","article-title":"Automatic feedback in online learning environments: A systematic literature review","volume":"2","author":"Pinheiro Cavalcanti Anderson","year":"2021","unstructured":"Anderson Pinheiro Cavalcanti, Arthur Barbosa, Ruan Carvalho, Fred Freitas, Yi-Shan Tsai, Dragan Ga\u0161evi\u0107, and Rafael Ferreira Mello. 2021. Automatic feedback in online learning environments: A systematic literature review. Computers and Education: Artificial Intelligence 2 (2021), 100027.","journal-title":"Computers and Education: Artificial Intelligence"},{"key":"e_1_3_1_26_2","first-page":"586","volume-title":"Proceedings of the 6th IEEE International Conference on Advanced Learning Technologies (ICALT \u201906). IEEE","author":"Cheniti-Belcadhi Lilia","year":"2006","unstructured":"Lilia Cheniti-Belcadhi, Nicola Henze, and Rafik Braham. 2006. Implementation of a personalized assessment web service. In Proceedings of the 6th IEEE International Conference on Advanced Learning Technologies (ICALT \u201906). IEEE, 586\u2013590."},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2427076.2427086"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/2888574"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3381911"},{"key":"e_1_3_1_30_2","unstructured":"Wendy Chisholm Gregg Vanderheiden and Ian Jacobs. 1999. Web Content Accessibility Guidelines 1.0. The World Wide Web Consortium (W3C). Retrieved from http:\/\/www.w3.org\/TR\/WCAG10\/"},{"key":"e_1_3_1_31_2","unstructured":"Lu\u00eds Maia Costa Jos\u00e9 Paulo Leal and Ricardo Queir\u00f3s. 2023. Automated assessment of simple web applications. In Proceedings of the 4th International Computer Programming Education Conference."},{"key":"e_1_3_1_32_2","first-page":"21","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI \u201924)","volume":"900","author":"Das Maitraye","year":"2024","unstructured":"Maitraye Das, Alexander J. Fiannaca, Meredith Ringel Morris, Shaun K. Kane, and Cynthia L. Bennett. 2024. From provenance to aberrations: Image creator and screen reader user perspectives on alt text for AI-generated images. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI \u201924). ACM, New York, NY, Article 900, 21 pages. DOI: 10.1145\/3613904.3642325"},{"key":"e_1_3_1_33_2","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1145\/3441636.3442309","volume-title":"Proceedings of the Australasian Computing Education Conference (ACE \u201921)","author":"Denny Paul","year":"2021","unstructured":"Paul Denny, Jacqueline Whalley, and Juho Leinonen. 2021. Promoting early engagement with programming assignments using scheduled automated feedback. In Proceedings of the Australasian Computing Education Conference (ACE \u201921). ACM, New York, NY, 88\u201395. DOI: 10.1145\/3441636.3442309"},{"key":"e_1_3_1_34_2","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1145\/3328778.3366914","volume-title":"Proceedings of the 51st ACM Technical Symposium on Computer Science Education","author":"El-Glaly Yasmine N.","year":"2020","unstructured":"Yasmine N. El-Glaly. 2020. Teaching accessibility to software engineering students. In Proceedings of the 51st ACM Technical Symposium on Computer Science Education, 121\u2013127."},{"key":"e_1_3_1_35_2","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1145\/638249.638253","volume-title":"Proceedings of the 5th International ACM Conference on Assistive technologies","author":"Fairweather Peter G.","year":"2002","unstructured":"Peter G. Fairweather, Vicki L. Hanson, Sam R. Detweiler, and Richard S. Schwerdtfeger. 2002. From assistive technology to a web accessibility service. In Proceedings of the 5th International ACM Conference on Assistive technologies, 4\u20138."},{"key":"e_1_3_1_36_2","first-page":"8","volume-title":"Informatics","author":"Ferati Mexhid","year":"2020","unstructured":"Mexhid Ferati and Bahtijar Vogel. 2020. Accessibility in web development courses: A case study. Informatics 7 (2020), 8."},{"issue":"6","key":"e_1_3_1_37_2","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1037\/h0055392","article-title":"The information capacity of the human motor system in controlling the amplitude of movement","volume":"47","author":"Fitts Paul M.","year":"1954","unstructured":"Paul M. Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47, 6 (1954), 381.","journal-title":"Journal of Experimental Psychology"},{"key":"e_1_3_1_38_2","first-page":"33","volume-title":"Ergonomics of Human-System Interaction \u2014 Part 210: Human-Centred Design for Interactive Systems","author":"International Organisation for Standardisation","year":"2019","unstructured":"International Organisation for Standardisation. 2019. Ergonomics of Human-System Interaction \u2014 Part 210: Human-Centred Design for Interactive Systems (2nd ed.), 33 pages. Retrieved from https:\/\/www.iso.org\/obp\/ui\/#iso:std:iso:9241:-210:ed-2:v1:en","edition":"2"},{"key":"e_1_3_1_39_2","first-page":"1","volume-title":"Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)\u2013","author":"Gay Greg","year":"2010","unstructured":"Greg Gay and Cindy Qi Li. 2010. AChecker: Open, interactive, customizable, web accessibility checking. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A). 1\u20132."},{"issue":"3","key":"e_1_3_1_40_2","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1145\/1140123.1140139","article-title":"An introspective approach to marking graphical user interfaces","volume":"38","author":"Gray Geoffrey R.","year":"2006","unstructured":"Geoffrey R. Gray and Colin A. Higgins. 2006. An introspective approach to marking graphical user interfaces. ACM SIGCSE Bulletin 38, 3 (2006), 43\u201347.","journal-title":"ACM SIGCSE Bulletin"},{"key":"e_1_3_1_41_2","volume-title":"User and Task Analysis for Interface Design","author":"Hackos JoAnn T.","year":"1998","unstructured":"JoAnn T. Hackos and Janice Redish. 1998. User and Task Analysis for Interface Design. Wiley New York."},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445983"},{"issue":"1","key":"e_1_3_1_43_2","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/s11280-011-0130-8","article-title":"Web accessibility guidelines","volume":"15","author":"Harper Simon","year":"2012","unstructured":"Simon Harper and Alex Q. Chen. 2012. Web accessibility guidelines. World Wide Web 15, 1 (2012), 61\u201388.","journal-title":"World Wide Web"},{"key":"e_1_3_1_44_2","volume-title":"The UX Book: Agile UX Design for a Quality User Experience","author":"Hartson Rex","year":"2018","unstructured":"Rex Hartson and Pardha S. Pyla. 2018. The UX Book: Agile UX Design for a Quality User Experience. Morgan Kaufmann."},{"key":"e_1_3_1_45_2","volume-title":"Rapid Contextual Design: a How-to Guide to Key Techniques for User-Centered Design","author":"Holtzblatt Karen","year":"2004","unstructured":"Karen Holtzblatt, Jessamyn Burns Wendell, and Shelley Wood. 2004. Rapid Contextual Design: a How-to Guide to Key Techniques for User-Centered Design. Elsevier."},{"key":"e_1_3_1_46_2","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1145\/365024.365035","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Ivory Melody Y.","year":"2001","unstructured":"Melody Y. Ivory, Rashmi R. Sinha, and Marti A. Hearst. 2001. Empirically validated web page design metrics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 53\u201360."},{"key":"e_1_3_1_47_2","first-page":"1","volume-title":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","author":"Jia Lin","year":"2021","unstructured":"Lin Jia, Yasmine N. Elglaly, Catherine M. Baker, and Kristen Shinohara. 2021. Infusing accessibility into programming courses. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 1\u20136."},{"key":"e_1_3_1_48_2","first-page":"229","volume-title":"Proceedings of the 1st African Conference on Human Computer Interaction","author":"Jordan Zayira","year":"2016","unstructured":"Zayira Jordan, Jose Abdelnour Nocera, Anicia Peters, Susan Dray, and Stephen Kimani. 2016. A living HCI curriculum. In Proceedings of the 1st African Conference on Human Computer Interaction, 229\u2013232."},{"issue":"2","key":"e_1_3_1_49_2","doi-asserted-by":"crossref","first-page":"S379","DOI":"10.3233\/JCM-2006-6S214","article-title":"Challenges and opportunities for improving code-based testing of graphical user interfaces","volume":"6","author":"Karam Marcel R.","year":"2006","unstructured":"Marcel R. Karam, Sergiu M. Dascalu, and Rami H. Hazim\u00e9. 2006. Challenges and opportunities for improving code-based testing of graphical user interfaces. Journal of Computational Methods in Sciences and Engineering 6, s2 (2006), S379\u2013S388.","journal-title":"Journal of Computational Methods in Sciences and Engineering"},{"key":"e_1_3_1_50_2","first-page":"5","volume-title":"Proceedings of the 1st Educators\u2019 Day on Web Engineering Curricula","author":"Karavirta Ville","year":"2010","unstructured":"Ville Karavirta and Petri Ihantola. 2010. Automatic assessment of javascript exercises. In Proceedings of the 1st Educators\u2019 Day on Web Engineering Curricula, 5\u20139."},{"key":"e_1_3_1_51_2","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/978-3-319-08596-8_16","volume-title":"Proceedings of the 14th International Conference on Computers Helping People with Special Needs (ICCHP \u201914)","author":"Klein Eduard","year":"2014","unstructured":"Eduard Klein, Anton Bolfing, and Markus Riesch. 2014. Checking web accessibility with the content accessibility checker (CAC). In Proceedings of the 14th International Conference on Computers Helping People with Special Needs (ICCHP \u201914). Springer, 109\u2013112."},{"key":"e_1_3_1_52_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/978-3-030-01662-3_2","volume-title":"Creative Business and Social Innovations for a Sustainable Future","author":"Krishnan Reshmy","year":"2019","unstructured":"Reshmy Krishnan. 2019. Achieving cognitive skills in multimedia through revised bloom taxonomy. In Creative Business and Social Innovations for a Sustainable Future. Springer, 11\u201320."},{"key":"e_1_3_1_53_2","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1145\/2556325.2566238","volume-title":"Proceedings of the 1st ACM conference on Learning@ Scale Conference","author":"Kulkarni Chinmay E.","year":"2014","unstructured":"Chinmay E. Kulkarni, Richard Socher, Michael S. Bernstein, and Scott R. Klemmer. 2014. Scaling short-answer grading by combining peer assessment with algorithmic scoring. In Proceedings of the 1st ACM conference on Learning@ Scale Conference, 99\u2013108."},{"key":"e_1_3_1_54_2","first-page":"642","volume-title":"International Journal of Engineering Education","author":"Kvadsheim Reidar","year":"2010","unstructured":"Reidar Kvadsheim, Mari Mehlen, and Harald \u00d8yen Kittang. 2010. Web-based automatic feedback on assignments in statistics: How can it help students learn statistics and universities reduce costs? International Journal of Engineering Education 26, 3 (2010), 642\u2013654."},{"issue":"2","key":"e_1_3_1_55_2","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.chb.2003.10.018","article-title":"Improving web accessibility: A study of webmaster perceptions","volume":"20","author":"Lazar Jonathan","year":"2004","unstructured":"Jonathan Lazar, Alfreda Dudley-Sponaugle, and Kisha-Dawn Greenidge. 2004. Improving web accessibility: A study of webmaster perceptions. Computers in Human Behavior 20, 2 (2004), 269\u2013288.","journal-title":"Computers in Human Behavior"},{"key":"e_1_3_1_56_2","first-page":"1","volume-title":"Proceedings of the 13th International Web for All Conference","author":"Lewthwaite Sarah","year":"2016","unstructured":"Sarah Lewthwaite and David Sloan. 2016. Exploring pedagogical culture for accessibility education in computing science. In Proceedings of the 13th International Web for All Conference, 1\u20134."},{"key":"e_1_3_1_57_2","first-page":"159","volume-title":"Proceedings of the 2023 ACM Conference on International Computing Education Research-Volume","volume":"1","author":"Li Tiffany Wenting","year":"2023","unstructured":"Tiffany Wenting Li, Silas Hsu, Max Fowler, Zhilin Zhang, Craig Zilles, and Karrie Karahalios. 2023. Am I wrong, or is the autograder wrong? Effects of AI grading mistakes on learning. In Proceedings of the 2023 ACM Conference on International Computing Education Research-Volume 1, 159\u2013176."},{"key":"e_1_3_1_58_2","first-page":"273","volume-title":"Proceedings of the 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE \u201904)","author":"Liffick Blaise W.","year":"2004","unstructured":"Blaise W. Liffick. 2004. An assistive technology project for an HCI course. In Proceedings of the 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education (ITiCSE \u201904). ACM, New York, NY, 273. DOI: 10.1145\/1007996.1008111"},{"key":"e_1_3_1_59_2","first-page":"736","volume-title":"Proceedings of the 29th International Conference on Software Engineering (ICSE \u201907)","author":"Ludi Stephanie","year":"2007","unstructured":"Stephanie Ludi. 2007. Introducing accessibility requirements through external stakeholder utilization in an undergraduate requirements engineering course. In Proceedings of the 29th International Conference on Software Engineering (ICSE \u201907). IEEE, 736\u2013743."},{"key":"e_1_3_1_60_2","first-page":"38","volume-title":"Proceedings of the International Conference on Human-Computer Interaction","author":"Maguire Martin","year":"2017","unstructured":"Martin Maguire. 2017. Guidelines for a University Short Course on Human-Computer Interaction. In Proceedings of the International Conference on Human-Computer Interaction. Springer, 38\u201346."},{"issue":"1","key":"e_1_3_1_61_2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1080\/08993400601069820","article-title":"Implementations of the CC\u2019 01 human\u2013computer interaction guidelines using Bloom\u2019s taxonomy","volume":"17","author":"Manaris Bill","year":"2007","unstructured":"Bill Manaris, Michael Wainer, Arthur E. Kirkpatrick, RoxAnn H. Stalvey, Christine Shannon, Laura Leventhal, Julie Barnes, John Wright, J. Ben Schafer, and Dean Sanders. 2007. Implementations of the CC\u2019 01 human\u2013computer interaction guidelines using Bloom\u2019s taxonomy. Computer Science Education 17, 1 (2007), 21\u201357.","journal-title":"Computer Science Education"},{"issue":"2","key":"e_1_3_1_62_2","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/TE.2016.2604210","article-title":"Personalized assessment as a means to mitigate plagiarism","volume":"60","author":"Manoharan Sathiamoorthy","year":"2016","unstructured":"Sathiamoorthy Manoharan. 2016. Personalized assessment as a means to mitigate plagiarism. IEEE Transactions on Education 60, 2 (2016), 112\u2013119.","journal-title":"IEEE Transactions on Education"},{"issue":"1","key":"e_1_3_1_63_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3636515","article-title":"Automated grading and feedback tools for programming education: A systematic review","volume":"24","author":"Messer Marcus","year":"2024","unstructured":"Marcus Messer, Neil C. C. Brown, Michael K\u00f6lling, and Miaojing Shi. 2024. Automated grading and feedback tools for programming education: A systematic review. ACM Transactions on Computing Education 24, 1 (2024), 1\u201343.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_1_64_2","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1109\/ICS51289.2020.00099","volume-title":"Proceedings of the 2020 International Computer Symposium (ICS)","author":"Nguyen Bao-An","year":"2020","unstructured":"Bao-An Nguyen, Kuan-Yu Ho, and Hsi-Min Chen. 2020. Measure students\u2019 contribution in web programming projects by exploring source code repository. In Proceedings of the 2020 International Computer Symposium (ICS). IEEE, 473\u2013478."},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3427594"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/2737596"},{"issue":"2","key":"e_1_3_1_67_2","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1002\/col.20091","article-title":"Location of Munsell colors in the RAL Design System","volume":"30","author":"\u00d6zt\u00fcrk. Leyla Dokuzer","year":"2005","unstructured":"Leyla Dokuzer \u00d6zt\u00fcrk. 2005. Location of Munsell colors in the RAL Design System. Color Research & Application 30, 2 (2005), 130\u2013134.","journal-title":"Color Research & Application"},{"issue":"3","key":"e_1_3_1_68_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3513140","article-title":"Automated assessment in computer science education: A state-of-the-art review","volume":"22","author":"Carlos Paiva Jos\u00e9","year":"2022","unstructured":"Jos\u00e9 Carlos Paiva, Jos\u00e9 Paulo Leal, and \u00c1lvaro Figueira. 2022. Automated assessment in computer science education: A state-of-the-art review. ACM Transactions on Computing Education 22, 3 (2022), 1\u201340.","journal-title":"ACM Transactions on Computing Education"},{"issue":"2","key":"e_1_3_1_69_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2160547.2160548","article-title":"No user left behind: Including accessibility in student projects and the impact on CS students\u2019 attitudes","volume":"12","author":"Poor G. Michael","year":"2012","unstructured":"G. Michael Poor, Laura M. Leventhal, Julie Barnes, Duke R. Hutchings, Paul Albee, and Laura Campbell. 2012. No user left behind: Including accessibility in student projects and the impact on CS students\u2019 attitudes. ACM Transactions on Computing Education 12, 2 (2012), 1\u201322.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_1_70_2","article-title":"Matching user interfaces to assess simple web applications (Short Paper)","author":"Primo Marco","year":"2021","unstructured":"Marco Primo and Jos\u00e9 Paulo Leal. 2021. Matching user interfaces to assess simple web applications (Short Paper). In Proceedings of the 2nd International Computer Programming Education Conference (ICPEC \u201921). Schloss-Dagstuhl-Leibniz Zentrum f\u00fcr Informatik.","journal-title":"Proceedings of the 2nd International Computer Programming Education Conference (ICPEC \u201921)"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/2831424"},{"key":"e_1_3_1_72_2","volume-title":"Interaction Design: Beyond Human-Computer Interaction","author":"Rogers Yvonne","year":"2002","unstructured":"Yvonne Rogers, Helen Sharp, and Jenny Preece. 2002. Interaction Design: Beyond Human-Computer Interaction. Wiley."},{"key":"e_1_3_1_73_2","first-page":"1","volume-title":"Proceedings of the 5th Annual ACM Conference on Learning at Scale","author":"Sarwate Avneesh","year":"2018","unstructured":"Avneesh Sarwate, Creston Brunch, Jason Freeman, and Sebastian Siva. 2018. Grading at scale in earsketch. In Proceedings of the 5th Annual ACM Conference on Learning at Scale, 1\u20134."},{"key":"e_1_3_1_74_2","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1145\/3159450.3159484","volume-title":"Proceedings of the 49th ACM Technical Symposium on Computer Science Education","author":"Shinohara Kristen","year":"2018","unstructured":"Kristen Shinohara, Saba Kawas, Amy J. Ko, and Richard E. Ladner. 2018. Who teaches accessibility? A survey of US computing faculty. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education, 197\u2013202."},{"key":"e_1_3_1_75_2","first-page":"4901","volume-title":"Proceedings of the EDSIG Conference ISSN","volume":"2473","author":"Siegfried Robert M.","year":"2022","unstructured":"Robert M. Siegfried and Kees Leune. 2022. A teaching case: A seminar course in accessible computing. In Proceedings of the EDSIG Conference ISSN, Vol. 2473, 4901."},{"key":"e_1_3_1_76_2","first-page":"84","volume-title":"Proceedings of the 46th ACM Technical Symposium on Computer Science Education","author":"Carvalho Siochi Antonio","year":"2015","unstructured":"Antonio Carvalho Siochi and William Randall Hardy. 2015. WebWolf: Towards a simple framework for automated assessment of webpage assignments in an introductory web programming class. In Proceedings of the 46th ACM Technical Symposium on Computer Science Education, 84\u201389."},{"key":"e_1_3_1_77_2","first-page":"1","volume-title":"Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems","author":"St-Cyr Olivier","year":"2018","unstructured":"Olivier St-Cyr, Craig M. MacDonald, Elizabeth F. Churchill, Jenny J. Preece, and Anna Bowser. 2018. Developing a community of practice to support global HCI education. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, 1\u20137."},{"key":"e_1_3_1_78_2","first-page":"1","volume-title":"Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems","author":"St-Cyr Olivier","year":"2020","unstructured":"Olivier St-Cyr, Craig M. MacDonald, Colin M. Gray, Leigh Ellen Potter, Anna Vasilchenko, Jaisie Sin, and Elizabeth F. Churchill. 2020. EduCHI 2020: 2nd Annual Symposium on HCI Education. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 1\u20138."},{"key":"e_1_3_1_79_2","first-page":"229","volume-title":"Proceedings of the 2008 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT Research in Developing Countries: Riding the Wave of Technology","author":"Suleman Hussein","year":"2008","unstructured":"Hussein Suleman. 2008. Automatic marking with Sakai. In Proceedings of the 2008 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists on IT Research in Developing Countries: Riding the Wave of Technology, 229\u2013236."},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/2048931.2048932"},{"key":"e_1_3_1_81_2","volume-title":"Proceedings of the International Conference on Information Systems Development (ISD)","author":"Timbi-Sisalima Cristian","year":"2016","unstructured":"Cristian Timbi-Sisalima, Carlos Iv\u00e1n Mart\u00edn Amor, Salvador Ot\u00f3n, Jos\u00e9 R. Hilera, and Juan Aguado-Delgado. 2016. Comparative analysis of online web accessibility evaluation tools. In Proceedings of the International Conference on Information Systems Development (ISD)."},{"key":"e_1_3_1_82_2","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1145\/1639642.1639670","volume-title":"Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility","author":"Waller Annalu","year":"2009","unstructured":"Annalu Waller, Vicki L. Hanson, and David Sloan. 2009. Including accessibility within and beyond undergraduate computing courses. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, 155\u2013162."},{"key":"e_1_3_1_83_2","first-page":"1","volume-title":"Proceedings of the 21st Koli Calling International Conference on Computing Education Research","author":"Wang Muyu","year":"2021","unstructured":"Muyu Wang, Naaz Sibia, Ilir Dema, Michael Liut, and Carlos An\u00edbal Su\u00e1rez. 2021. Building a better SQL automarker for database courses. In Proceedings of the 21st Koli Calling International Conference on Computing Education Research, 1\u20133."},{"key":"e_1_3_1_84_2","first-page":"113","volume-title":"Proceedings of the 13th Australasian Computing Education Conference (ACE \u201911)","author":"Whalley Jacqueline L.","year":"2011","unstructured":"Jacqueline L. Whalley and Anne Philpott. 2011. A unit testing approach to building novice programmers\u2019 skills and confidence. In Proceedings of the 13th Australasian Computing Education Conference (ACE \u201911). Australian Computer Society, Inc., Australia, 113\u2013118."},{"key":"e_1_3_1_85_2","first-page":"1","volume-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems","author":"Zhang Xiaoyi","year":"2021","unstructured":"Xiaoyi Zhang, Lilian De Greef, Amanda Swearngin, Samuel White, Kyle Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, et al. 2021. Screen recognition: Creating accessibility metadata for mobile applications from pixels. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1\u201315."},{"key":"e_1_3_1_86_2","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1145\/3242587.3242616","volume-title":"Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology","author":"Zhang Xiaoyi","year":"2018","unstructured":"Xiaoyi Zhang, Anne Spencer Ross, and James Fogarty. 2018. Robust annotation of mobile application interfaces in methods for accessibility repair and enhancement. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, 609\u2013621."},{"issue":"4","key":"e_1_3_1_87_2","first-page":"127","article-title":"Inclusive design advisor: Understanding the design practice before developing inclusivity tools","volume":"8","author":"Zitkus Emilene","year":"2013","unstructured":"Emilene Zitkus, Patrick Langdon, and P. John Clarkson. 2013. Inclusive design advisor: Understanding the design practice before developing inclusivity tools. Journal of Usability Studies 8, 4 (2013), 127\u2013143.","journal-title":"Journal of Usability Studies"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3732788","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,22]],"date-time":"2025-07-22T23:24:15Z","timestamp":1753226655000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3732788"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,22]]},"references-count":86,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,30]]}},"alternative-id":["10.1145\/3732788"],"URL":"https:\/\/doi.org\/10.1145\/3732788","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,22]]},"assertion":[{"value":"2023-12-11","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-31","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}