{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T17:15:04Z","timestamp":1775841304648,"version":"3.50.1"},"reference-count":191,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,9,28]],"date-time":"2018-09-28T00:00:00Z","timestamp":1538092800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Netherlands Organisation for Scientific Research","doi-asserted-by":"crossref","award":["023.005.063"],"award-info":[{"award-number":["023.005.063"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2019,3,31]]},"abstract":"<jats:p>Formative feedback, aimed at helping students to improve their work, is an important factor in learning. Many tools that offer programming exercises provide automated feedback on student solutions. We have performed a systematic literature review to find out what kind of feedback is provided, which techniques are used to generate the feedback, how adaptable the feedback is, and how these tools are evaluated. We have designed a labelling to classify the tools, and use Narciss\u2019 feedback content categories to classify feedback messages. We report on the results of coding a total of 101 tools. We have found that feedback mostly focuses on identifying mistakes and less on fixing problems and taking a next step. Furthermore, teachers cannot easily adapt tools to their own needs. However, the diversity of feedback types has increased over the past decades and new techniques are being applied to generate feedback that is increasingly helpful for students.<\/jats:p>","DOI":"10.1145\/3231711","type":"journal-article","created":{"date-parts":[[2018,9,28]],"date-time":"2018-09-28T17:47:33Z","timestamp":1538156853000},"page":"1-43","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":250,"title":["A Systematic Literature Review of Automated Feedback Generation for Programming Exercises"],"prefix":"10.1145","volume":"19","author":[{"given":"Hieke","family":"Keuning","sequence":"first","affiliation":[{"name":"Open University of the Netherlands and Windesheim University of Applied Sciences"}]},{"given":"Johan","family":"Jeuring","sequence":"additional","affiliation":[{"name":"Utrecht University and Open University of the Netherlands"}]},{"given":"Bastiaan","family":"Heeren","sequence":"additional","affiliation":[{"name":"Open University of the Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2018,9,28]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(80)90023-5"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400500150747"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018423.1019977"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1734243.1734245"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/64.108947"},{"key":"e_1_2_2_6_1","unstructured":"John R. Anderson. 1983. The Architecture of Cognition. Lawrence Erlbaum Associates Inc.   John R. Anderson. 1983. The Architecture of Cognition. Lawrence Erlbaum Associates Inc."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/6592.6593"},{"key":"e_1_2_2_8_1","unstructured":"Paolo Antonucci. 2014. AutoTeach: Incremental Hints For Programming Exercises. Master\u2019s thesis. ETH Zurich.  Paolo Antonucci. 2014. AutoTeach: Incremental Hints For Programming Exercises. Master\u2019s thesis. ETH Zurich."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2729094.2742607"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.1999.839303"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/952989.803494"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00157068"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(76)80021-1"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-27101-9_12"},{"key":"e_1_2_2_15_1","unstructured":"Christoph Beierle Marija Kula\u0161 and Manfred Widera. 2003. Automatic analysis of programming assignments. In DeLFI: Die 1. e-Learning Fachtagung Informatik. 144--153.  Christoph Beierle Marija Kula\u0161 and Manfred Widera. 2003. Automatic analysis of programming assignments. In DeLFI: Die 1. e-Learning Fachtagung Informatik. 144--153."},{"key":"e_1_2_2_16_1","volume-title":"Proceedings of the International Workshop on Teaching Logic Programming. 18--34","author":"Beierle Christoph","year":"2004"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00402268"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.3402\/rlt.v1i2.9481"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1122018.1122050"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1272848.1272879"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2006.11.006"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.5555\/977403.978384"},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Jeffrey G. Bonar and Robert Cunningham. 1988. Bridge: Intelligent Tutoring with Intermediate Representations. Technical Report. Carnegie Mellon University University of Pittsburgh.  Jeffrey G. Bonar and Robert Cunningham. 1988. Bridge: Intelligent Tutoring with Intermediate Representations. Technical Report. Carnegie Mellon University University of Pittsburgh.","DOI":"10.21236\/ADA218938"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"David Boud and Elizabeth Molloy (Eds.). 2012. Feedback in Higher and Professional Education: Understanding it and Doing it Well. Routledge.  David Boud and Elizabeth Molloy (Eds.). 2012. Feedback in Higher and Professional Education: Understanding it and Doing it Well. Routledge.","DOI":"10.4324\/9780203074336"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/0954730920290104"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2713609.2713611"},{"key":"e_1_2_2_27_1","volume-title":"Proceedings of the Conference on Learning Sciences. 357--362","author":"Brusilovsky Peter","year":"1996"},{"key":"e_1_2_2_28_1","volume-title":"Proceedings of the International Technology, Education and Development Conference. 5691--5700","author":"Julio"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1288580.1288595"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/13.848075"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(03)00030-7"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00890449"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1988042.1988046"},{"key":"e_1_2_2_34_1","doi-asserted-by":"crossref","unstructured":"Albert T. Corbett and John R. Anderson. 1993. Student modeling in an intelligent programming tutor. In Cognitive Models and Intelligent Environments for Learning Programming. Vol. 111. Springer 135--144.  Albert T. Corbett and John R. Anderson. 1993. Student modeling in an intelligent programming tutor. In Cognitive Models and Intelligent Environments for Learning Programming. Vol. 111. Springer 135--144.","DOI":"10.1007\/978-3-662-11334-9_13"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01099821"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365111"},{"key":"e_1_2_2_37_1","unstructured":"Albert T. Corbett John R. Anderson and Eric J. Patterson. 1990. Student modeling and tutoring flexibility in the lisp intelligent tutoring system. In Intelligent Tutoring Systems. Ablex 83--106.  Albert T. Corbett John R. Anderson and Eric J. Patterson. 1990. Student modeling and tutoring flexibility in the lisp intelligent tutoring system. In Intelligent Tutoring Systems. Ablex 83--106."},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Tonci Dadic. 2011. Intelligent tutoring system for learning programming. In Intelligent Tutoring Systems in E-Learning Environments. IGI Global 166--186.  Tonci Dadic. 2011. Intelligent tutoring system for learning programming. In Intelligent Tutoring Systems in E-Learning Environments. IGI Global 166--186.","DOI":"10.4018\/978-1-61692-008-1.ch009"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ITI.2008.4588458"},{"key":"e_1_2_2_40_1","unstructured":"Ronald Lee Danielson. 1975. Pattie: An Automated Tutor for Top-down Programming. Ph.D. Dissertation. University of Illinois at Urbana-Champaign.  Ronald Lee Danielson. 1975. Pattie: An Automated Tutor for Top-down Programming. Ph.D. Dissertation. University of Illinois at Urbana-Champaign."},{"key":"e_1_2_2_41_1","volume-title":"Proceedings of the Monet Workshop on Model-Based System at ECAI.","author":"de Barros Leliane Nunes","year":"2006"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJKL.2015.071054"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CSEET.2011.5876088"},{"key":"e_1_2_2_44_1","volume-title":"Proceedings of the Frontiers in Education Conference. 1--8.","author":"De Souza Draylson M."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1096-7516(01)00038-0"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.8.2.130.3820"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1163405.1163409"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1029994.1029995"},{"key":"e_1_2_2_49_1","first-page":"44","article-title":"Experiences using test-driven development with an automated grader","volume":"22","author":"Edwards Stephen H.","year":"2007","journal-title":"J. Comput. Sci. Colleges"},{"key":"e_1_2_2_50_1","first-page":"237","article-title":"Experiences of using automated assessment in computer science courses","volume":"14","author":"English John","year":"2015","journal-title":"J. Info. Technol. Edu.: Innovat. Pract."},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1168054.1168085"},{"key":"e_1_2_2_52_1","volume-title":"Proceedings of the CAA Conference.","author":"Foxley Eric"},{"key":"e_1_2_2_53_1","unstructured":"Timothy S. Gegg-Harrison. 1993. Exploiting Program Schemata in a Prolog Tutoring System. Ph.D. Dissertation. Duke University.   Timothy S. Gegg-Harrison. 1993. Exploiting Program Schemata in a Prolog Tutoring System. Ph.D. Dissertation. Duke University."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734412"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2325296.2325356"},{"key":"e_1_2_2_56_1","volume-title":"Proceedings of the Conference on Information Technology and Applications.","author":"Ghosh Moumita"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxh080"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1597849.1384329"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2008.4720331"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089786.1089796"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13218-015-0367-y"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJLT.2014.065752"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2015.75"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2635868.2635912"},{"key":"e_1_2_2_66_1","unstructured":"Mark Guzdial. 2004. Programming environments for novices. In Computer Science Education Research Sally Fincher and Marian Petre (Eds.). CRC Press 127--154.  Mark Guzdial. 2004. Programming environments for novices. In Computer Science Education Research Sally Fincher and Marian Petre (Eds.). CRC Press 127--154."},{"key":"e_1_2_2_67_1","unstructured":"Budi Hartanto. 2014. Incorporating Anchored Learning in a C# Intelligent Tutoring System. Ph.D. Dissertation. Queensland University of Technology.  Budi Hartanto. 2014. Incorporating Anchored Learning in a C# Intelligent Tutoring System. Ph.D. Dissertation. Queensland University of Technology."},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.5176\/2251-2195_CSEIT13.09"},{"key":"e_1_2_2_69_1","first-page":"99","article-title":"Assessment of student programming assignments in COBOL. Edu","volume":"4","author":"Hasan Helen M.","year":"1988","journal-title":"Comput."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.3102\/003465430298487"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICESD.1994.302282"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/1269900.1268805"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/1163405.1163410"},{"key":"e_1_2_2_74_1","doi-asserted-by":"crossref","unstructured":"Colin A. Higgins and Fatima Z. Mansouri. 2000. PRAM: A courseware system for the automatic assessment of AI programs. In Innovative Teaching and Learning. Vol. 1. Springer 311--329.  Colin A. Higgins and Fatima Z. Mansouri. 2000. PRAM: A courseware system for the automatic assessment of AI programs. In Innovative Teaching and Learning. Vol. 1. Springer 311--329.","DOI":"10.1007\/978-3-7908-1868-0_10"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/637610.544431"},{"key":"e_1_2_2_76_1","volume-title":"Proceedings of the Conference on Computers in Education. 142--146","author":"Holland Jay","year":"2009"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2004.02.001"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/1052883.1052895"},{"key":"e_1_2_2_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/1930464.1930480"},{"key":"e_1_2_2_80_1","volume-title":"Proceedings of the PEG Conference on Knowledge Based Environments for Teaching and Learning. 322--329","author":"Innocenti Carlo","year":"1991"},{"key":"e_1_2_2_81_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(96)00025-5"},{"key":"e_1_2_2_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/353519.343160"},{"key":"e_1_2_2_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/268085.268210"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2691352.2691355"},{"key":"e_1_2_2_85_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30950-2_40"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07221-0_40"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(90)90094-G"},{"key":"e_1_2_2_88_1","volume-title":"Proceedings of the AAAI Conference. 162--168","author":"Lewis Johnson W.","year":"1984"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1985.232210"},{"key":"e_1_2_2_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/2534860"},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2011.11.002"},{"key":"e_1_2_2_92_1","doi-asserted-by":"publisher","DOI":"10.1002\/cae.21569"},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICALT.2014.35"},{"key":"e_1_2_2_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089733.1089734"},{"key":"e_1_2_2_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/2691352.2691356"},{"key":"e_1_2_2_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899422"},{"key":"e_1_2_2_98_1","doi-asserted-by":"publisher","DOI":"10.1080\/088395198117659"},{"key":"e_1_2_2_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/51909.51930"},{"key":"e_1_2_2_101_1","volume-title":"Proceedings of the Workshop on Graph Based Tools, Electronic Communications of the EASST","volume":"1","author":"K\u00f6llmann Carsten","year":"2006"},{"key":"e_1_2_2_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASE.2008.47"},{"key":"e_1_2_2_103_1","first-page":"105","article-title":"Intelligent learning environments within blended learning for ensuring effective C programming course","volume":"3","author":"Kose Utku","year":"2012","journal-title":"Int. J. Artific. Intell. Appl."},{"key":"e_1_2_2_104_1","doi-asserted-by":"publisher","DOI":"10.1145\/2828959.2828968"},{"key":"e_1_2_2_105_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993400500224286"},{"key":"e_1_2_2_106_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07221-0_38"},{"key":"e_1_2_2_107_1","doi-asserted-by":"crossref","unstructured":"Nguyen-Thinh Le. 2016. A classification of adaptive feedback in educational systems for programming. Systems 4 2 (2016).  Nguyen-Thinh Le. 2016. A classification of adaptive feedback in educational systems for programming. Systems 4 2 (2016).","DOI":"10.3390\/systems4020022"},{"key":"e_1_2_2_108_1","volume-title":"Proceedings of the Conference on Computers in Education. 63--70","author":"Le Nguyen-Thinh","year":"2006"},{"key":"e_1_2_2_109_1","volume-title":"Proceedings of the Conference on Computers in Education. 51--58","author":"Le Nguyen-Thinh","year":"2009"},{"key":"e_1_2_2_110_1","doi-asserted-by":"crossref","unstructured":"Nguyen-Thinh Le and Niels Pinkwart. 2011. Adding weights to constraints in intelligent tutoring systems: Does it improve the error diagnosis? In Towards Ubiquitous Learning. LNCS 6964. 233--247.   Nguyen-Thinh Le and Niels Pinkwart. 2011. Adding weights to constraints in intelligent tutoring systems: Does it improve the error diagnosis? In Towards Ubiquitous Learning. LNCS 6964. 233--247.","DOI":"10.1007\/978-3-642-23985-4_19"},{"key":"e_1_2_2_111_1","volume-title":"Proceedings of the Conference on Cognition and Exploratory Learning in Digital Age. 43--50","author":"Le Nguyen-Thinh","year":"2011"},{"key":"e_1_2_2_112_1","volume-title":"Proceedings of the Workshop on AI-supported Education for Computer Science. 51--60","author":"Le Nguyen-Thinh","year":"2014"},{"key":"e_1_2_2_113_1","volume-title":"Advanced Computational Methods for Knowledge Engineering","author":"Le Nguyen-Thinh"},{"key":"e_1_2_2_114_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00120883"},{"key":"e_1_2_2_116_1","doi-asserted-by":"publisher","DOI":"10.1076\/0899-3408(200008)10:2;1-C;FT147"},{"key":"e_1_2_2_117_1","volume-title":"Proceedings of the IEEE Conference on Advanced Learning Technologies. 317--321","author":"MacNish Cara","year":"2002"},{"key":"e_1_2_2_118_1","doi-asserted-by":"crossref","unstructured":"Tim A. Majchrzak and Claus A. Usener. 2013. Evaluating the synergies of integrating e-assessment and software testing. In Information Systems Development. Springer New York NY 179--193.  Tim A. Majchrzak and Claus A. Usener. 2013. Evaluating the synergies of integrating e-assessment and software testing. In Information Systems Development. Springer New York NY 179--193.","DOI":"10.1007\/978-1-4614-4951-5_15"},{"key":"e_1_2_2_119_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74063-6_29"},{"key":"e_1_2_2_120_1","doi-asserted-by":"publisher","DOI":"10.1145\/282991.283108"},{"key":"e_1_2_2_121_1","first-page":"55","article-title":"An enhanced generic automated marking environment: GAME-2","volume":"2","author":"Matloobi Roozbeh","year":"2007","journal-title":"IEEE Multidisc. Eng. Edu. Mag."},{"key":"e_1_2_2_122_1","volume-title":"Proceedings of the Interactive Computer Aided Learning Conference","volume":"1","author":"Matloobi Roozbeh","year":"2009"},{"key":"e_1_2_2_123_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.1986.tb00073.x"},{"key":"e_1_2_2_124_1","doi-asserted-by":"publisher","DOI":"10.1016\/0898-1221(92)90148-B"},{"key":"e_1_2_2_125_1","doi-asserted-by":"publisher","DOI":"10.1145\/572133.572137"},{"key":"e_1_2_2_126_1","doi-asserted-by":"crossref","unstructured":"Jean McKendree Bob Radlinski and Michael E. Atwood. 1992. The grace tutor: A qualified success. In Intelligent Tutoring Systems. Springer 677--684.   Jean McKendree Bob Radlinski and Michael E. Atwood. 1992. The grace tutor: A qualified success. In Intelligent Tutoring Systems. Springer 677--684.","DOI":"10.1007\/3-540-55606-0_78"},{"key":"e_1_2_2_127_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0203_2"},{"key":"e_1_2_2_128_1","volume-title":"User Modeling","author":"Mitrovic Antonija"},{"key":"e_1_2_2_129_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2728672"},{"key":"e_1_2_2_130_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8640.1987.tb00169.x"},{"key":"e_1_2_2_131_1","unstructured":"Susanne Narciss. 2008. Feedback strategies for interactive learning tasks. Handbook of Research on Educational Communications and Technology. Routledge 125--144.  Susanne Narciss. 2008. Feedback strategies for interactive learning tasks. Handbook of Research on Educational Communications and Technology. Routledge 125--144."},{"key":"e_1_2_2_132_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01956028"},{"key":"e_1_2_2_133_1","doi-asserted-by":"publisher","DOI":"10.1145\/2566486.2568023"},{"key":"e_1_2_2_134_1","doi-asserted-by":"publisher","DOI":"10.1145\/366413.364537"},{"key":"e_1_2_2_135_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737596"},{"key":"e_1_2_2_136_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJTEL.2013.059495"},{"key":"e_1_2_2_137_1","doi-asserted-by":"publisher","DOI":"10.1145\/1345375.1345441"},{"key":"e_1_2_2_139_1","volume-title":"Proceedings of the Workshop on Data Mining for Educational Assessment and Feedback.","author":"Perelman Daniel","year":"2014"},{"key":"e_1_2_2_140_1","first-page":"113","article-title":"Automated assessment tools: Too many cooks, not enough collaboration","volume":"32","author":"Pettit Raymond","year":"2017","journal-title":"J. Comput. Sci. Colleges"},{"key":"e_1_2_2_141_1","volume-title":"Proceedings of the Workshop on Adaptive and Intelligent Web-Based Education Systems, ITS. 70--80","author":"Peylo Christoph","year":"2000"},{"key":"e_1_2_2_142_1","doi-asserted-by":"publisher","DOI":"10.1145\/782941.782986"},{"key":"e_1_2_2_143_1","volume-title":"Proceedings of the Australasian Conference on Computing Education. 59--68","author":"Pisan Yusuf","year":"2002"},{"key":"e_1_2_2_144_1","volume-title":"Proceedings of the Conference on Information Technology.","author":"Pribela Ivan","year":"2011"},{"key":"e_1_2_2_145_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077618"},{"key":"e_1_2_2_146_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142829"},{"key":"e_1_2_2_147_1","volume-title":"Proceedings of the National Conference on Programming.","author":"Rahman Khirulnizam Abd","year":"2007"},{"key":"e_1_2_2_148_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011078011415"},{"key":"e_1_2_2_149_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-015-0070-z"},{"key":"e_1_2_2_150_1","volume-title":"Proceedings of the Conference on e-Learning, e-Business, Entreprise Information Systems, 8 e-Government.","author":"del Pino Juan Carlos","year":"2012"},{"key":"e_1_2_2_151_1","volume-title":"Proceedings of the International Symposium in Information Technology. 1186--1192","author":"Romli Rohaida","year":"2010"},{"key":"e_1_2_2_152_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2002.1157893"},{"key":"e_1_2_2_153_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(76)90022-9"},{"key":"e_1_2_2_154_1","doi-asserted-by":"crossref","unstructured":"Warren Sack. 1992. Knowledge base compilation and the language design game. In Intell. Tutor. Syst. 225--233.   Warren Sack. 1992. Knowledge base compilation and the language design game. In Intell. Tutor. Syst. 225--233.","DOI":"10.1007\/3-540-55606-0_29"},{"key":"e_1_2_2_155_1","doi-asserted-by":"crossref","unstructured":"Warren Sack and Elliot Soloway. 1992. From PROUST to CHIRON: ITS design as iterative engineering; intermediate results are important&excl; Comput.-Assist. Instruct. Intell. Tutor. Syst.: Shared Goals Complement. Approaches (1992) 239--274.  Warren Sack and Elliot Soloway. 1992. From PROUST to CHIRON: ITS design as iterative engineering; intermediate results are important&excl; Comput.-Assist. Instruct. Intell. Tutor. Syst.: Shared Goals Complement. Approaches (1992) 239--274.","DOI":"10.4324\/9781315044361-9"},{"key":"e_1_2_2_156_1","doi-asserted-by":"publisher","DOI":"10.1145\/507758.377666"},{"key":"e_1_2_2_157_1","doi-asserted-by":"publisher","DOI":"10.1145\/1595496.1562971"},{"key":"e_1_2_2_158_1","doi-asserted-by":"publisher","DOI":"10.1145\/1083431.1083464"},{"key":"e_1_2_2_159_1","doi-asserted-by":"publisher","DOI":"10.1080\/10494820.2010.486685"},{"key":"e_1_2_2_160_1","doi-asserted-by":"publisher","DOI":"10.3102\/0034654307313795"},{"key":"e_1_2_2_161_1","doi-asserted-by":"publisher","DOI":"10.1145\/2499370.2462195"},{"key":"e_1_2_2_162_1","volume-title":"Proceedings of the ASEE Annual Conference and Exposition.","author":"Matthew"},{"key":"e_1_2_2_163_1","article-title":"Meno-II: An AI-based programming tutor","volume":"10","author":"Soloway Elliot","year":"1983","journal-title":"J. Comput.-Based Instruct."},{"key":"e_1_2_2_164_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(97)00003-1"},{"key":"e_1_2_2_165_1","doi-asserted-by":"publisher","DOI":"10.1145\/2490822"},{"key":"e_1_2_2_166_1","doi-asserted-by":"publisher","DOI":"10.1145\/1140123.1140131"},{"key":"e_1_2_2_167_1","volume-title":"Proceedings of the Conference on Computer Supported Education 2","author":"Striewe Michael","year":"2009"},{"key":"e_1_2_2_168_1","doi-asserted-by":"publisher","DOI":"10.1145\/1999747.1999832"},{"key":"e_1_2_2_169_1","volume-title":"Computer Assisted Assessment. Research into E-Assessment","author":"Striewe Michael"},{"key":"e_1_2_2_170_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053187"},{"key":"e_1_2_2_171_1","first-page":"49","article-title":"Qualitative evaluation of the java intelligent tutoring system","volume":"3","author":"Sykes Edward","year":"2005","journal-title":"J. System., Cybernet. Info."},{"key":"e_1_2_2_172_1","first-page":"25","article-title":"Design, development and evaluation of the java intelligent tutoring system. Technol., Instruct","volume":"8","author":"Sykes Edward","year":"2010","journal-title":"Cogn. Learn."},{"key":"e_1_2_2_173_1","doi-asserted-by":"publisher","DOI":"10.5555\/276953.276964"},{"key":"e_1_2_2_174_1","doi-asserted-by":"publisher","DOI":"10.5555\/2486788.2486941"},{"key":"e_1_2_2_175_1","doi-asserted-by":"publisher","DOI":"10.1145\/1151954.1067452"},{"key":"e_1_2_2_176_1","volume-title":"Proceedings of the Australasian Conference on Computing Education","volume":"30","author":"Truong Nghi","year":"2004"},{"key":"e_1_2_2_177_1","first-page":"591","article-title":"A generalized knowledge-based approach to comprehend pascal and C programs","volume":"83","author":"Ueno Haruki","year":"2000","journal-title":"IEICE Trans. Info. Syst."},{"key":"e_1_2_2_178_1","doi-asserted-by":"publisher","DOI":"10.1145\/989253.989263"},{"key":"e_1_2_2_179_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07221-0_24"},{"key":"e_1_2_2_180_1","doi-asserted-by":"publisher","DOI":"10.2190\/MJDX-9PP4-KFMT-09PM"},{"key":"e_1_2_2_181_1","doi-asserted-by":"publisher","DOI":"10.5555\/1435351.1435353"},{"key":"e_1_2_2_182_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00119977"},{"key":"e_1_2_2_183_1","unstructured":"Anne Venables and Liz Haywood. 2003. Programming students NEED instant feedback&anp;excl; In Proceedings of the Australasian Conference on Computing Education Vol. 20. 267--272.   Anne Venables and Liz Haywood. 2003. Programming students NEED instant feedback&anp;excl; In Proceedings of the Australasian Conference on Computing Education Vol. 20. 267--272."},{"key":"e_1_2_2_184_1","doi-asserted-by":"publisher","DOI":"10.1145\/2462476.2462501"},{"key":"e_1_2_2_185_1","doi-asserted-by":"publisher","DOI":"10.5555\/1434921.1434923"},{"key":"e_1_2_2_186_1","volume-title":"Intelligent Tutoring Systems. LNCS","author":"Vizca\u00edno Aurora","year":"1839"},{"key":"e_1_2_2_187_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2012.12.005"},{"key":"e_1_2_2_188_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2010.08.003"},{"key":"e_1_2_2_189_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2002_2"},{"key":"e_1_2_2_190_1","first-page":"351","article-title":"ELM-ART: An adaptive versatile system for web-based instruction","volume":"12","author":"Weber Gerhard","year":"2001","journal-title":"Int. J. Artific. Intell. Edu."},{"key":"e_1_2_2_191_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7091-2670-7_30"},{"key":"e_1_2_2_192_1","doi-asserted-by":"crossref","unstructured":"Dinesha Weragama. 2013. Intelligent Tutoring System for Learning PHP. Ph.D. Dissertation. Queensland University of Technology.  Dinesha Weragama. 2013. Intelligent Tutoring System for Learning PHP. Ph.D. Dissertation. Queensland University of Technology.","DOI":"10.1007\/978-3-642-39112-5_64"},{"key":"e_1_2_2_193_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-014-0014-z"},{"key":"e_1_2_2_194_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCA.2007.4376454"},{"key":"e_1_2_2_195_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2003.1191799"},{"key":"e_1_2_2_196_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.1988.712842"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3231711","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3231711","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:08:16Z","timestamp":1750208896000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3231711"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,28]]},"references-count":191,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,3,31]]}},"alternative-id":["10.1145\/3231711"],"URL":"https:\/\/doi.org\/10.1145\/3231711","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,9,28]]},"assertion":[{"value":"2018-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}