{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T14:11:17Z","timestamp":1773843077168,"version":"3.50.1"},"reference-count":47,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,3,27]],"date-time":"2025-03-27T00:00:00Z","timestamp":1743033600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Ministry of Education","award":["PID2020-119620RB-I00"],"award-info":[{"award-number":["PID2020-119620RB-I00"]}]},{"name":"the Ministry of Education","award":["PID2023-149341OB-I00"],"award-info":[{"award-number":["PID2023-149341OB-I00"]}]},{"name":"the Telefonica-Complutense Honorary Chair on Digital Education and Serious Games","award":["PID2020-119620RB-I00"],"award-info":[{"award-number":["PID2020-119620RB-I00"]}]},{"name":"the Telefonica-Complutense Honorary Chair on Digital Education and Serious Games","award":["PID2023-149341OB-I00"],"award-info":[{"award-number":["PID2023-149341OB-I00"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Serious games are powerful interactive environments that provide more authentic experiences for learning or training different skills. However, developing effective serious games is complex, and a more systematic approach is needed to create better evidence-based games. Learning analytics\u2014based on the analysis of collected in-game user interactions\u2014can support game development and the players\u2019 learning process, providing assessment information to teachers, students, and other stakeholders. However, empirical studies applying and demonstrating the use of learning analytics in the context of serious games in real environments remain scarce. In this paper, we study the application of learning analytics throughout the whole lifecycle of a serious game, in order to assess the game\u2019s design and players\u2019 learning using a serious game that introduces basic programming concepts through a visual programming language. The game was played by N = 134 high school students in two 50-min sessions. During the game sessions, all player interactions were collected, including the time spent solving levels, their programming solutions, and the number of replays. We analyzed these interaction traces to gain insights that can facilitate teachers\u2019 use of serious games in their lessons and assessments, as well as guide developers in making possible improvements to the game. Among these insights, knowing which tasks students struggle with is critical for both teachers and game developers, and can also reveal game design issues. Among the results obtained through analysis of the interaction data, we found differences between boys and girls when playing. Girls play in a more reflexive way and, in terms of acceptance of the game, a higher percentage of girls had neutral opinions. We also found the most repeated errors, the level each player reached, and how long it took them to reach those levels. These data will help to make further improvements to the game\u2019s design, resulting in a more effective educational tool in the future. The process and results of this study can guide other researchers when applying learning analytics to evaluate and improve the educational design of serious games, as well as supporting teachers\u2014both during and after the game activity\u2014in applying an evidence-based assessment of the players based on the collected learning analytics.<\/jats:p>","DOI":"10.3390\/computers14040122","type":"journal-article","created":{"date-parts":[[2025,3,27]],"date-time":"2025-03-27T12:41:02Z","timestamp":1743079262000},"page":"122","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Learning Analytics to Guide Serious Game Development: A Case Study Using Articoding"],"prefix":"10.3390","volume":"14","author":[{"given":"Antonio","family":"Calvo-Morata","sequence":"first","affiliation":[{"name":"Department of Software Engineering and Artificial Intelligence, Complutense University of Madrid, 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2965-3104","authenticated-orcid":false,"given":"Cristina","family":"Alonso-Fern\u00e1ndez","sequence":"additional","affiliation":[{"name":"Department of Software Engineering and Artificial Intelligence, Complutense University of Madrid, 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2520-507X","authenticated-orcid":false,"given":"Julio","family":"Santilario-Berthilier","sequence":"additional","affiliation":[{"name":"Department of Software Engineering and Artificial Intelligence, Complutense University of Madrid, 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6595-5690","authenticated-orcid":false,"given":"Iv\u00e1n","family":"Mart\u00ednez-Ortiz","sequence":"additional","affiliation":[{"name":"Department of Software Engineering and Artificial Intelligence, Complutense University of Madrid, 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8200-6216","authenticated-orcid":false,"given":"Baltasar","family":"Fern\u00e1ndez-Manj\u00f3n","sequence":"additional","affiliation":[{"name":"Department of Software Engineering and Artificial Intelligence, Complutense University of Madrid, 28040 Madrid, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2025,3,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"358152","DOI":"10.1155\/2014\/358152","article-title":"An overview of serious games","volume":"2014","author":"Laamarti","year":"2014","journal-title":"Int. J. Comput. Games Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1016\/j.compedu.2012.03.004","article-title":"A systematic literature review of empirical evidence on computer games and serious games","volume":"59","author":"Connolly","year":"2012","journal-title":"Comput. Educ."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"D\u00f6rner, R., G\u00f6bel, S., Effelsberg, W., and Wiemeyer, J. (2016). Serious Games, Springer International Publishing.","DOI":"10.1007\/978-3-319-40612-1"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.entcom.2013.09.002","article-title":"Serious games for health","volume":"4","author":"Wattanasoontorn","year":"2013","journal-title":"Entertain. Comput."},{"key":"ref_5","unstructured":"UNESCO (2022, March 14). UNESCO Research Shows Women Career Scientists Still Face Gender Bias. Available online: https:\/\/en.unesco.org\/news\/unesco-research-shows-women-career-scientists-still-face-gender-bias."},{"key":"ref_6","unstructured":"Blumberg, S., Krawina, M., M\u00e4kel\u00e4, E., and Soller, H. (2024, August 01). Women In Tech: The Best Bet to Solve Europe\u2019s Talent Shortage. Available online: https:\/\/www.mckinsey.com\/capabilities\/mckinsey-digital\/our-insights\/women-in-tech-the-best-bet-to-solve-europes-talent-shortage#\/."},{"key":"ref_7","unstructured":"Eurostat (2022, March 14). More Women Join Science and Engineering Ranks. Available online: https:\/\/ec.europa.eu\/eurostat\/web\/products-eurostat-news\/-\/edn-20220211-2."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Schulte, C., Sentance, S., Sparmann, S., Altin, R., Friebroon-Yesharim, M., Landman, M., R\u00fccker, M.T., Satavlekar, S., Siegel, A., and Tedre, M. (2024, January 8\u201310). Values and Beliefs Underpinning K-12 Computing Education. Proceedings of the Annual Conference on Innovation and Technology in Computer Science Education, ITiCSE, Milan, Italy.","DOI":"10.1145\/3649405.3659532"},{"key":"ref_9","unstructured":"OECD (2024, July 17). PISA 2025 Learning in the Digital World. Available online: https:\/\/www.oecd.org\/en\/topics\/sub-issues\/learning-in-the-digital-world\/pisa-2025-learning-in-the-digital-world.html."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Shute, V., Rahimi, S., and Smith, G. (2019). Game-Based Learning Analytics in Physics Playground. Data Analytics Approaches in Educational Games and Gamification Systems, Springer.","DOI":"10.1007\/978-981-32-9335-9_4"},{"key":"ref_11","unstructured":"Mojang, A.B., and TM Microsoft Corporation (2022, March 14). Minecraft Education Edition. Available online: https:\/\/education.minecraft.net\/."},{"key":"ref_12","unstructured":"(2020, June 09). Electronic Arts. SimCityEDU: Pollution Challenge!. Available online: https:\/\/www.ea.com\/news\/glasslab-launches-simcityedu?isLocalized=true."},{"key":"ref_13","unstructured":"Kahoot DragonBox (2022, March 14). DragonBox. Available online: https:\/\/dragonbox.com\/."},{"key":"ref_14","first-page":"66","article-title":"Students\u2019 Algebraic Thinking and Attitudes Towards Algebra: The Effects of Game-Based Learning Using Dragonbox 12 + App","volume":"5","author":"Siew","year":"2016","journal-title":"Res. J. Math. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1007\/978-3-030-02762-9_21","article-title":"A Review of Serious Games for Programming","volume":"Volume 11243","author":"Tregel","year":"2018","journal-title":"Serious Games"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.chb.2018.10.001","article-title":"Girls\u2019 video gaming behaviour and undergraduate degree selection: A secondary data analysis approach","volume":"91","author":"Hosein","year":"2019","journal-title":"Comput. Human. Behav."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Freire, M., Serrano-Laguna, \u00c1., Iglesias, B.M., Mart\u00ednez-Ortiz, I., Moreno-Ger, P., and Fern\u00e1ndez-Manj\u00f3n, B. (2016). Game Learning Analytics: Learning Analytics for Serious Games. Learning, Design, and Technology, Springer International Publishing.","DOI":"10.1007\/978-3-319-17727-4_21-1"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1186\/s40561-023-00244-y","article-title":"Learning analytics in virtual laboratories: A systematic literature review of empirical research","volume":"10","author":"Elmoazen","year":"2023","journal-title":"Smart Learn. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"221831","DOI":"10.1109\/ACCESS.2020.3043278","article-title":"Enhancing Confidence in Using Computational Thinking Skills via Playing a Serious Game: A Case Study to Increase Motivation in Learning Computer Programming","volume":"8","author":"Kazimoglu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"103198","DOI":"10.1016\/j.scico.2024.103198","article-title":"Mi Superpoder es la Programaci\u00f3n: A tool for teaching programming to children and youth","volume":"240","author":"Arias","year":"2025","journal-title":"Sci. Comput. Program."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.procs.2021.01.141","article-title":"Evaluating Aspects of Usability in Video Game-Based Programming Learning Platforms","volume":"181","author":"Villegas","year":"2021","journal-title":"Procedia Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1016\/j.sbspro.2015.04.224","article-title":"Learning Basic Programming Concepts by Creating Games with Scratch Programming Environment","volume":"191","author":"Ouahbi","year":"2015","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Moreno-Le\u00f3n, J., and Robles, G. (2015, January 9\u201311). Dr. Scratch: A Web Tool to Automatically Evaluate Scratch Projects. Proceedings of the Workshop in Primary and Secondary Computing Education, London, UK.","DOI":"10.1145\/2818314.2818338"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"115","DOI":"10.17083\/ijsg.v10i2.577","article-title":"Using Visual Programming Games to Study Novice Programmers","volume":"10","author":"Delozier","year":"2023","journal-title":"Int. J. Serious Games"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gundersen, S.W., and Lampropoulos, G. (2025). Using Serious Games and Digital Games to Improve Students\u2019 Computational Thinking and Programming Skills in K-12 Education: A Systematic Literature Review. Technologies, 13.","DOI":"10.3390\/technologies13030113"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Tlili, A., and Chang, M. (2019). Data Analytics Approaches in Educational Games and Gamification Systems: Summary, Challenges, and Future Insights, Springer.","DOI":"10.1007\/978-981-32-9335-9"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, M., Kang, J., Liu, S., Zou, W., and Hodson, J. (2017). Learning Analytics as an Assessment Tool in Serious Games: A Review of Literature. Serious Games and Edutainment Applications, Springer International Publishing.","DOI":"10.1007\/978-3-319-51645-5_24"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.csi.2016.09.014","article-title":"Applying standards to systematize learning analytics in serious games","volume":"50","author":"Haag","year":"2017","journal-title":"Comput. Stand. Interfaces"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1145\/234867.234872","article-title":"Programming pedagogy\u2014A psychological overview","volume":"28","author":"Winslow","year":"1996","journal-title":"ACM SIGCSE Bull."},{"key":"ref_30","first-page":"14","article-title":"Novice programmer\u2019s misconception of programming reflected on problem-solving plans","volume":"1","author":"Kwon","year":"2017","journal-title":"Int. J. Comput. Sci. Educ. Sch."},{"key":"ref_31","first-page":"137","article-title":"Learning and teaching programming: A review and discussion","volume":"21","author":"Robins","year":"2003","journal-title":"Int. J. Phytoremediat."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.edurev.2017.09.003","article-title":"Demystifying computational thinking","volume":"22","author":"Shute","year":"2017","journal-title":"Educ. Res. Rev."},{"key":"ref_33","first-page":"161","article-title":"Applications of Simva to Simplify Serious Games Validation and Deployment","volume":"15","author":"Freire","year":"2020","journal-title":"IEEE Rev. Iberoam. Tecnol. Aprendiz."},{"key":"ref_34","unstructured":"Perez-Colado, I., P\u00e9rez-Colado, V.M., Martinez-Ortiz, I., Freire, M., and Fernandez-Manjon, B. (2020, January 6\u20139). Simplifiying Serious Games Authoring and Validation with uAdventure and SIMVA. Proceedings of the 2020 IEEE 20th International Conference on Advanced Learning Technologies (ICALT), Tartu, Estonia."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1080\/08993408.2021.1956216","article-title":"The Coding Stages Assessment: Development and validation of an instrument for assessing young children\u2019s proficiency in the ScratchJr programming language","volume":"32","author":"Bers","year":"2022","journal-title":"Comput. Sci. Educ."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Feigenspan, J., Kastner, C., Liebig, J., Apel, S., and Hanenberg, S. (2012, January 11\u201313). Measuring programming experience. Proceedings of the 2012 20th IEEE International Conference on Program Comprehension (ICPC), Passau, Germany.","DOI":"10.1109\/ICPC.2012.6240511"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.compedu.2017.05.022","article-title":"Customizing scaffolds for game-based learning in physics: Impacts on knowledge acquisition and game design creativity","volume":"113","author":"Kao","year":"2017","journal-title":"Comput. Educ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"101583","DOI":"10.1016\/j.tele.2021.101583","article-title":"Improving evidence-based assessment of players using serious games","volume":"60","author":"Freire","year":"2021","journal-title":"Telemat. Inform."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"104135","DOI":"10.1016\/j.compedu.2021.104135","article-title":"The use and effects of incentive systems on learning and performance in educational games","volume":"165","author":"Rahimi","year":"2021","journal-title":"Comput. Educ."},{"key":"ref_40","first-page":"1","article-title":"Interaction Patterns During Block-based Programming Activities Predict Computational Thinking: Analysis of the Differences in Gender, Cognitive Load, Spatial Ability, and Programming Proficiency","volume":"3","author":"Yusuf","year":"2024","journal-title":"AI Comput. Sci. Robot. Technol."},{"key":"ref_41","first-page":"1","article-title":"Using Gamification to Teach Students Programming Concepts","volume":"4","author":"Elshiekh","year":"2017","journal-title":"Open Access Libr. J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2029","DOI":"10.1007\/s10639-018-9702-x","article-title":"A pilot study on the effectiveness and acceptance of an educational game for teaching programming concepts to primary school students","volume":"23","author":"Giannakoulas","year":"2018","journal-title":"Educ. Inf. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1504\/IJTEL.2020.106282","article-title":"Evaluating a game-development approach to teach introductory programming concepts in secondary education","volume":"12","author":"Papadakis","year":"2020","journal-title":"Int. J. Technol. Enhanc. Learn."},{"key":"ref_44","first-page":"5","article-title":"PlayIT: Game Based Learning Approach for Teaching Programming Concepts","volume":"19","author":"Mathrani","year":"2016","journal-title":"J. Educ. Technol. Soc."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Holly, M., Habich, L., Seiser, M., Glawogger, F., Innerebner, K., Kupsa, S., Einwallner, P., and Pirker, J. (2024, January 5\u20138). FemQuest\u2014An Interactive Multiplayer Game to Engage Girls in Programming. Proceedings of the 2024 IEEE Conference on Games (CoG), Milan, Italy.","DOI":"10.1109\/CoG60054.2024.10645537"},{"key":"ref_46","first-page":"100061","article-title":"A Serious game for programming in higher education","volume":"4","author":"Hainey","year":"2024","journal-title":"Comput. Educ. X Real."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"100850","DOI":"10.1016\/j.entcom.2024.100850","article-title":"Programming Fun(damentals): Using commercial video games to teach basic coding to adult learners","volume":"52","year":"2025","journal-title":"Entertain. Comput."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/4\/122\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:02:51Z","timestamp":1760029371000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/4\/122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,27]]},"references-count":47,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4]]}},"alternative-id":["computers14040122"],"URL":"https:\/\/doi.org\/10.3390\/computers14040122","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,27]]}}}