{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T14:41:53Z","timestamp":1783694513239,"version":"3.55.0"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,9,6]],"date-time":"2023-09-06T00:00:00Z","timestamp":1693958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Call for Projects to Generate New Scientific Leadership","award":["21948\/JLI\/22"],"award-info":[{"award-number":["21948\/JLI\/22"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2024,1,31]]},"abstract":"<jats:p>The rapid technological evolution of the last years has motivated students to develop capabilities that will prepare them for an unknown future in the 21st century. In this context, many teachers intend to optimise the learning process, making it more dynamic and exciting through the introduction of gamification. Thus, this article focuses on a data-driven assessment of geometry competencies, which are essential for developing problem-solving and higher-order thinking skills. Our main goal is to adapt, evaluate and compare Bayesian Knowledge Tracing (BKT), Performance Factor Analysis (PFA), Elo, and Deep Knowledge Tracing (DKT) algorithms applied to the data of a geometry game named Shadowspect, in order to predict students\u2019 performance by means of several classifier metrics. We analysed two algorithmic configurations, with and without prioritisation of Knowledge Components (KCs) \u2013 the skills needed to complete a puzzle successfully, and we found Elo to be the algorithm with the best prediction power with the ability to model the real knowledge of students. However, the best results are achieved without KCs because it is a challenging task to differentiate between KCs effectively in game environments. Our results prove that the above-mentioned algorithms can be applied in formal education to improve teaching, learning, and organisational efficiency.<\/jats:p>","DOI":"10.1145\/3614436","type":"journal-article","created":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T11:14:44Z","timestamp":1691752484000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Adapting Knowledge Inference Algorithms to Measure Geometry Competencies through a Puzzle Game"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5548-7704","authenticated-orcid":false,"given":"Sofia","family":"Strukova","sequence":"first","affiliation":[{"name":"Department of Information and Communication Engineering, University of Murcia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2304-6365","authenticated-orcid":false,"given":"Jos\u00e9 A.","family":"Ruip\u00e9rez-Valiente","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, University of Murcia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6424-3322","authenticated-orcid":false,"given":"F\u00e9lix G\u00f3mez","family":"M\u00e1rmol","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, University of Murcia, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,9,6]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"2022. Common Core State Standards of Geometry. Retrieved 1 August 2022 from http:\/\/www.corestandards.org\/Math\/Content\/G\/"},{"key":"e_1_3_2_3_2","unstructured":"Ali Alkhatlan and Jugal Kalita. 2018. Intelligent tutoring systems: A comprehensive historical survey with recent developments. arXiv:1812.09628. Retrieved from https:\/\/arxiv.org\/abs\/1812.09628"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.19105\/ojbs.v14i2.4009"},{"issue":"2","key":"e_1_3_2_5_2","first-page":"185","article-title":"Why students engage in \u201cgaming the system\u201d behaviour in interactive learning environments","volume":"19","author":"Baker Ryan","year":"2008","unstructured":"Ryan Baker, Jason Walonoski, Neil Heffernan, Ido Roll, Albert Corbett, and Kenneth Koedinger. 2008. Why students engage in \u201cgaming the system\u201d behaviour in interactive learning environments. Journal of Interactive Learning Research 19, 2 (2008), 185\u2013224.","journal-title":"Journal of Interactive Learning Research"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30950-2_57"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.3928\/00220124-20160715-09"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10798-018-9446-3"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-020-00202-6"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF01099821"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7091-2670-7_25"},{"issue":"1","key":"e_1_3_2_12_2","first-page":"80","article-title":"Analyzing student process data in game-based assessments with bayesian knowledge tracing and dynamic bayesian networks","volume":"11","author":"Cui Yang","year":"2019","unstructured":"Yang Cui, Man-Wai Chu, and Fu Chen. 2019. Analyzing student process data in game-based assessments with bayesian knowledge tracing and dynamic bayesian networks. Journal of Educational Data Mining 11, 1 (2019), 80\u2013100.","journal-title":"Journal of Educational Data Mining"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69132-7_44"},{"key":"e_1_3_2_14_2","volume-title":"Combining Elo Rating and Collaborative Filtering to improve Learner Ability Estimation in an e-learning Context","author":"Dahl Ole Halvor","year":"2018","unstructured":"Ole Halvor Dahl and Olav Fykse. 2018. Combining Elo Rating and Collaborative Filtering to improve Learner Ability Estimation in an e-learning Context. Master\u2019s thesis. NTNU."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.3233\/AIC-190624"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1117\/12.2293395"},{"key":"e_1_3_2_17_2","volume-title":"The Rating of Chessplayers, Past and Present","author":"Elo Arpad E.","year":"1978","unstructured":"Arpad E. Elo. 1978. The Rating of Chessplayers, Past and Present. Arco Pub."},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.4143614"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jecp.2014.01.002"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2022.3226661"},{"key":"e_1_3_2_21_2","volume-title":"Proceedings of the NIPS 2013 Workshop on Data Driven Education","author":"Gonzalez-Brenes Jose","year":"2013","unstructured":"Jose Gonzalez-Brenes, Yun Huang, and Peter Brusilovsky. 2013. Fast: Feature-aware student knowledge tracing. In Proceedings of the NIPS 2013 Workshop on Data Driven Education. University of Pittsburgh. Retrieved from http:\/\/d-scholarship.pitt.edu\/20353\/"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-019-01694-7"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-15569-8_1"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2012.01245.x"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1137\/07070111X"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.106963"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1002\/ca.23916"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-017-9542-1"},{"key":"e_1_3_2_29_2","unstructured":"Qi Liu Shuanghong Shen Zhenya Huang Enhong Chen and Yonghe Zheng. 2021. A Survey of Knowledge Tracing. arXiv:2105.15106. Retrieved from https:\/\/arxiv.org\/abs\/2105.15106"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462827"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.35542\/osf.io\/9pz68"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i11.21560"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2018.05.011"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313565"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.15219\/em82.1444"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/2207243.2207249"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.3233\/978-1-60750-028-5-531"},{"issue":"2","key":"e_1_3_2_38_2","first-page":"1","article-title":"Metrics for evaluation of student models","volume":"7","author":"Pel\u00e1nek Radek","year":"2015","unstructured":"Radek Pel\u00e1nek. 2015. Metrics for evaluation of student models. Journal of Educational Data Mining 7, 2 (2015), 1\u201319.","journal-title":"Journal of Educational Data Mining"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2016.03.017"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-017-9193-2"},{"key":"e_1_3_2_41_2","unstructured":"Chris Piech Jonathan Bassen Jonathan Huang Surya Ganguli Mehran Sahami Leonidas J. Guibas and Jascha Sohl-Dickstein. 2015. Deep knowledge tracing. Advances in Neural Information Processing Systems 28 (2015) 1\u20139. Retrieved from https:\/\/proceedings.neurips.cc\/paper\/2015\/file\/bac9162b47c56fc8a4d2a519803d51b3-Paper.pdf"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3086703"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2020.104008"},{"issue":"2","key":"e_1_3_2_44_2","first-page":"816","article-title":"Detecting and clustering students by their gamification behaviour with badges: A case study in engineering education","volume":"33","author":"Ruip\u00e9rez-Valiente Jos\u00e9 A.","year":"2017","unstructured":"Jos\u00e9 A. Ruip\u00e9rez-Valiente, Pedro J. Mu\u00f1oz-Merino, and Carlos Delgado Kloos. 2017. Detecting and clustering students by their gamification behaviour with badges: A case study in engineering education. International Journal of Engineering Education 33, 2-B (2017), 816\u2013830.","journal-title":"International Journal of Engineering Education"},{"key":"e_1_3_2_45_2","first-page":"61","volume-title":"Proceedings of the 2nd Workshop on AI-supported Education for Computer Science","author":"Sahebi Shaghayegh","year":"2014","unstructured":"Shaghayegh Sahebi, Yun Huang, and Peter Brusilovsky. 2014. Parameterized exercises in java programming: Using knowledge structure for performance prediction. In Proceedings of the 2nd Workshop on AI-supported Education for Computer Science. University of Pittsburgh, 61\u201370."},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.7086179"},{"key":"e_1_3_2_47_2","unstructured":"Richard Scruggs Ryan S. Baker and Bruce M. McLaren. 2019. Extending Deep Knowledge Tracing: Inferring Interpretable Knowledge and Predicting Post-System Performance. arXiv:1910.12597. Retrieved from https:\/\/arxiv.org\/abs\/1910.12597"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3462203.3475905"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.9781\/ijimai. 2022.10.004"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-18480-3_16"},{"key":"e_1_3_2_51_2","volume-title":"Flood risk and social justice","author":"Vojinovic Zoran","year":"2012","unstructured":"Zoran Vojinovic and Michael B. Abbott. 2012. Flood risk and social justice. IWA Publishing."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-23207-8_56"},{"key":"e_1_3_2_53_2","volume-title":"Proceedings of the Educational Data Mining 2011","author":"Wauters Kelly","year":"2010","unstructured":"Kelly Wauters, Piet Desmet, and Wim Van Noortgate. 2010. Monitoring learners\u2019 proficiency: Weight adaptation in the Elo rating system. In Proceedings of the Educational Data Mining 2011."},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-6494.1991.tb00259.x"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dibe.2022.100111"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3231644.3231647"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3051457.3053976"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3614436","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3614436","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:30Z","timestamp":1750287030000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3614436"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,6]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1,31]]}},"alternative-id":["10.1145\/3614436"],"URL":"https:\/\/doi.org\/10.1145\/3614436","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,6]]},"assertion":[{"value":"2022-08-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-28","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}