{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T20:58:23Z","timestamp":1776459503834,"version":"3.51.2"},"reference-count":108,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,9,18]],"date-time":"2023-09-18T00:00:00Z","timestamp":1694995200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006013","name":"United Arab Emirates University","doi-asserted-by":"publisher","award":["12R135"],"award-info":[{"award-number":["12R135"]}],"id":[{"id":"10.13039\/501100006013","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>The utilization of reinforcement learning (RL) within the field of education holds the potential to bring about a significant shift in the way students approach and engage with learning and how teachers evaluate student progress. The use of RL in education allows for personalized and adaptive learning, where the difficulty level can be adjusted based on a student\u2019s performance. As a result, this could result in heightened levels of motivation and engagement among students. The aim of this article is to investigate the applications and techniques of RL in education and determine its potential impact on enhancing educational outcomes. It compares the various policies induced by RL with baselines and identifies four distinct RL techniques: the Markov decision process, partially observable Markov decision process, deep RL network, and Markov chain, as well as their application in education. The main focus of the article is to identify best practices for incorporating RL into educational settings to achieve effective and rewarding outcomes. To accomplish this, the article thoroughly examines the existing literature on using RL in education and its potential to advance educational technology. This work provides a thorough analysis of the various techniques and applications of RL in education to answer questions related to the effectiveness of RL in education and its future prospects. The findings of this study will provide researchers with a benchmark to compare the usefulness and effectiveness of commonly employed RL algorithms and provide direction for future research in education.<\/jats:p>","DOI":"10.3390\/informatics10030074","type":"journal-article","created":{"date-parts":[[2023,9,17]],"date-time":"2023-09-17T23:57:46Z","timestamp":1694995066000},"page":"74","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Reinforcement Learning in Education: A Literature Review"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2340-7113","authenticated-orcid":false,"given":"Bisni","family":"Fahad Mon","sequence":"first","affiliation":[{"name":"Computer and Network Engineering, College of Information Technology, UAE University, Al Ain 15551, United Arab Emirates"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3182-6684","authenticated-orcid":false,"given":"Asma","family":"Wasfi","sequence":"additional","affiliation":[{"name":"Electrical and Communication Engineering, UAE University, Al Ain 15551, United Arab Emirates"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6159-7512","authenticated-orcid":false,"given":"Mohammad","family":"Hayajneh","sequence":"additional","affiliation":[{"name":"Computer and Network Engineering, College of Information Technology, UAE University, Al Ain 15551, United Arab Emirates"}]},{"given":"Ahmad","family":"Slim","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering, The University of Arizona, Tucson, AZ 85721, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9777-9609","authenticated-orcid":false,"given":"Najah","family":"Abu Ali","sequence":"additional","affiliation":[{"name":"Computer and Network Engineering, College of Information Technology, UAE University, Al Ain 15551, United Arab Emirates"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,18]]},"reference":[{"key":"ref_1","first-page":"358","article-title":"Artificial intelligence and engineering education","volume":"109","author":"Johri","year":"2020","journal-title":"JEE"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1002\/j.2168-9830.2007.tb00944.x","article-title":"Development of a work sampling methodology for behavioral observations: Application to teamwork","volume":"96","author":"Shuman","year":"2007","journal-title":"J. Eng. Educ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1002\/j.2168-9830.2001.tb00637.x","article-title":"The learning mechanism of the interactive multimedia intelligent tutoring system (IMITS)","volume":"90","author":"Butz","year":"2001","journal-title":"J. Eng. Educ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10639-021-10741-7","article-title":"Application of machine learning in higher education to assess student academic performance, at-risk, and attrition: A meta-analysis of literature","volume":"27","author":"Fahd","year":"2022","journal-title":"Educ. Inf. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3577","DOI":"10.1007\/s10639-019-09946-8","article-title":"A machine learning algorithm framework for predicting students performance: A case study of baccalaureate students in Morocco","volume":"24","author":"Qazdar","year":"2019","journal-title":"Educ. Inf. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"9913","DOI":"10.1007\/s10639-022-11010-x","article-title":"A machine learning enabled affective E-learning system model","volume":"27","author":"Liu","year":"2022","journal-title":"Educ. Inf. Technol."},{"key":"ref_7","first-page":"729","article-title":"Reinforcement learning","volume":"12","author":"Wiering","year":"2012","journal-title":"Adapt. Learn. Optim."},{"key":"ref_8","unstructured":"Puterman, M.L. (2014). Markov Decision Processes: Discrete Stochastic Dynamic Programming, John Wiley & Sons."},{"key":"ref_9","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1613\/jair.301","article-title":"Reinforcement learning: A survey","volume":"4","author":"Kaelbling","year":"1996","journal-title":"J. Artif. Intell. Res."},{"key":"ref_11","unstructured":"Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1038\/nature16961","article-title":"Mastering the game of Go with deep neural networks and tree search","volume":"529","author":"Silver","year":"2016","journal-title":"Nature"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1038\/nature24270","article-title":"Mastering the game of go without human knowledge","volume":"550","author":"Silver","year":"2017","journal-title":"Nature"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Mothanna, Y., and Hewahi, N. (2022, January 20\u201321). Review on Reinforcement Learning in CartPole Game. Proceedings of the 2022 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), Sakheer, Bahrain.","DOI":"10.1109\/3ICT56508.2022.9990767"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Souchleris, K., Sidiropoulos, G.K., and Papakostas, G.A. (2023). Reinforcement Learning in Game Industry\u2014Review, Prospects and Challenges. Appl. Sci., 13.","DOI":"10.3390\/app13042443"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1109\/TLT.2017.2692761","article-title":"Approximately optimal teaching of approximately optimal learners","volume":"11","author":"Whitehill","year":"2017","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sutton, R.S., and Barto, A.G. (1998). Introduction to Reinforcement Learning, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_19","unstructured":"Littman, M.L. (1994). Machine Learning Proceedings 1994, Elsevier."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/s10489-008-0115-1","article-title":"Learning teaching strategies in an adaptive and intelligent educational system through reinforcement learning","volume":"31","author":"Iglesias","year":"2009","journal-title":"Appl. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.knosys.2009.01.007","article-title":"Reinforcement learning of pedagogical policies in adaptive and intelligent educational systems","volume":"22","author":"Iglesias","year":"2009","journal-title":"Knowl.-Based Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"223","DOI":"10.15388\/infedu.2003.17","article-title":"An experience applying reinforcement learning in a web-based adaptive and intelligent educational system","volume":"2","author":"Iglesias","year":"2003","journal-title":"Inform. Educ."},{"key":"ref_23","unstructured":"Martin, K.N., and Arroyo, I. (September, January 30). AgentX: Using reinforcement learning to improve the effectiveness of intelligent tutoring systems. Proceedings of the International Conference on Intelligent Tutoring Systems, Macei\u00f3, Brazil."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s11257-010-9093-1","article-title":"Empirically evaluating the application of reinforcement learning to the induction of effective and adaptive pedagogical strategies","volume":"21","author":"Chi","year":"2011","journal-title":"User Model. User-Adapt. Interact."},{"key":"ref_25","first-page":"345","article-title":"Reinforcement learning algorithm for partially observable Markov decision problems","volume":"7","author":"Jaakkola","year":"1994","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","unstructured":"Koenig, S., and Simmons, R. (1998). Artificial Intelligence Based Mobile Robotics: Case Studies of Successful Robot Systems, MIT Press."},{"key":"ref_27","unstructured":"Mandel, T., Liu, Y.E., Levine, S., Brunskill, E., and Popovic, Z. (2014, January 5\u20139). Offline policy evaluation across representations with applications to educational games. Proceedings of the AAMAS, Paris, France."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1290","DOI":"10.1111\/cogs.12290","article-title":"Faster teaching via pomdp planning","volume":"40","author":"Rafferty","year":"2016","journal-title":"Cogn. Sci."},{"key":"ref_29","unstructured":"Clement, B., Oudeyer, P.Y., and Lopes, M. (July, January 29). A Comparison of Automatic Teaching Strategies for Heterogeneous Student Populations. Proceedings of the International Educational Data Mining Society, Raleigh, North Carolina."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, P., Rowe, J.P., Min, W., Mott, B.W., and Lester, J.C. (2017, January 19\u201325). Interactive Narrative Personalization with Deep Reinforcement Learning. Proceedings of the IJCAI, Melbourne, Australia.","DOI":"10.24963\/ijcai.2017\/538"},{"key":"ref_31","first-page":"101","article-title":"Application of AHP-DEA-FCE model in college English teaching quality evaluation","volume":"51","author":"Luo","year":"2013","journal-title":"Int. J. Appl. Math. Stat."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2021\/9943865","article-title":"Algorithm of classroom teaching quality evaluation based on Markov chain","volume":"2021","author":"Yuan","year":"2021","journal-title":"Complexity"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Anand, D., Gupta, V., Paruchuri, P., and Ravindran, B. (2021, January 2\u20139). An enhanced advising model in teacher-student framework using state categorization. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.","DOI":"10.1609\/aaai.v35i8.16823"},{"key":"ref_34","unstructured":"Zimmer, M., Viappiani, P., and Weng, P. (2014, January 5\u20139). Teacher-student framework: A reinforcement learning approach. Proceedings of the AAMAS Workshop Autonomous Robots and Multirobot Systems, Paris, France."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"220","DOI":"10.3102\/10769986221129847","article-title":"Deep reinforcement learning for adaptive learning systems","volume":"48","author":"Li","year":"2023","journal-title":"J. Educ. Behav. Stat."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"T\u00e1rraga-S\u00e1nchez, M.d.l.\u00c1., Ballesteros-Garc\u00eda, M.d.M., and Migall\u00f3n, H. (2023). Teacher-Developed Computer Games for Classroom and Online Reinforcement Learning for Early Childhood. Educ. Sci., 13.","DOI":"10.3390\/educsci13020108"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1111\/bmsp.12144","article-title":"A reinforcement learning approach to personalized learning recommendation systems","volume":"72","author":"Tang","year":"2019","journal-title":"Br. J. Math. Stat. Psychol."},{"key":"ref_38","unstructured":"Aleven, V., McLaughlin, E.A., Glenn, R.A., and Koedinger, K.R. (2016). Handbook of Research on Learning and Instruction, Routledge."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Williams, J.J., Kim, J., Rafferty, A., Maldonado, S., Gajos, K.Z., Lasecki, W.S., and Heffernan, N. (2016, January 25\u201326). Axis: Generating explanations at scale with learnersourcing and machine learning. Proceedings of the Third (2016) ACM Conference on Learning@ Scale, Edinburgh, UK.","DOI":"10.1145\/2876034.2876042"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Patikorn, T., and Heffernan, N.T. (2020, January 12\u201314). Effectiveness of crowd-sourcing on-demand assistance from teachers in online learning platforms. Proceedings of the Seventh ACM Conference on Learning@ Scale, Virtual, USA.","DOI":"10.1145\/3386527.3405912"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Erickson, J.A., Botelho, A.F., McAteer, S., Varatharaj, A., and Heffernan, N.T. (2020, January 23\u201327). The automated grading of student open responses in mathematics. Proceedings of the Tenth International Conference on Learning Analytics &, Knowledge, Frankfurt, Germany.","DOI":"10.1145\/3375462.3375523"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Barnes, T., and Stamper, J. (2008, January 23\u201327). Toward automatic hint generation for logic proof tutoring using historical student data. Proceedings of the International Conference on Intelligent Tutoring Systems, Montreal, QC, Canada.","DOI":"10.1007\/978-3-540-69132-7_41"},{"key":"ref_43","unstructured":"Efremov, A., Ghosh, A., and Singla, A. (2020, January 10\u201313). Zero-shot learning of hint policy via reinforcement learning and program synthesis. Proceedings of the EDM, Virtual."},{"key":"ref_44","unstructured":"He-Yueya, J., and Singla, A. (2021). Quizzing Policy Using Reinforcement Learning for Inferring the Student Knowledge State. Int. Educ. Data Min. Soc., 533\u2013539."},{"key":"ref_45","unstructured":"Liu, Y.E., Mandel, T., Brunskill, E., and Popovic, Z. (2014, January 4\u20137). Trading Off Scientific Knowledge and User Learning with Multi-Armed Bandits. Proceedings of the EDM, London, UK."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Williams, J.J., Rafferty, A.N., Tingley, D., Ang, A., Lasecki, W.S., and Kim, J. (2018, January 21\u201326). Enhancing online problems through instructor-centered tools for randomized experiments. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada.","DOI":"10.1145\/3173574.3173781"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Rafferty, A.N., Ying, H., and Williams, J.J. (2018, January 27\u201330). Bandit assignment for educational experiments: Benefits to students versus statistical power. Proceedings of the International Conference on Artificial Intelligence in Education, London, UK.","DOI":"10.1007\/978-3-319-93846-2_53"},{"key":"ref_48","first-page":"47","article-title":"Statistical consequences of using multi-armed bandits to conduct adaptive educational experiments","volume":"11","author":"Rafferty","year":"2019","journal-title":"J. Educ. Data Min."},{"key":"ref_49","unstructured":"Howard, R.A. (1960). Dynamic Programming and Markov Processes, MIT Press."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ritter, F.E., Nerb, J., Lehtinen, E., and O\u2019Shea, T.M. (2007). In Order to Learn: How the Sequence of Topics Influences Learning, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780195178845.001.0001"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1037\/h0033572","article-title":"Ingredients for a theory of instruction","volume":"27","author":"Atkinson","year":"1972","journal-title":"Am. Psychol."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1037\/h0033475","article-title":"Optimizing the learning of a second-language vocabulary","volume":"96","author":"Atkinson","year":"1972","journal-title":"J. Exp. Psychol."},{"key":"ref_53","unstructured":"Sondik, E.J. (1971). The Optimal Control of Partially Observable Markov Processes, Stanford University."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/BF01099821","article-title":"Knowledge tracing: Modeling the acquisition of procedural knowledge","volume":"4","author":"Corbett","year":"1994","journal-title":"User Model. User-Adapt. Interact."},{"key":"ref_55","unstructured":"Corbett, A. (2023, February 14). Cognitive mastery learning in the act programming tutor. In Proceedings of the Adaptive User Interfaces. AAAI SS-00-01. Available online: https:\/\/api.semanticscholar.org\/CorpusID:16877673."},{"key":"ref_56","first-page":"10","article-title":"Hidden Markov models and the Baum-Welch algorithm","volume":"53","author":"Welch","year":"2003","journal-title":"IEEE Inf. Theory Soc. Newsl."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1016\/j.jcss.2011.12.025","article-title":"A spectral algorithm for learning hidden Markov models","volume":"78","author":"Hsu","year":"2012","journal-title":"J. Comput. Syst. Sci."},{"key":"ref_58","unstructured":"Falakmasir, M.H., Pardos, Z.A., Gordon, G.J., and Brusilovsky, P. (2013, January 6\u20139). A Spectral Learning Approach to Knowledge Tracing. Proceedings of the EDM, Memphis, TN, USA."},{"key":"ref_59","unstructured":"Baker, R.S.d., Corbett, A.T., Gowda, S.M., Wagner, A.Z., MacLaren, B.A., Kauffman, L.R., Mitchell, A.P., and Giguere, S. (2010, January 20\u201324). Contextual slip and prediction of student performance after use of an intelligent tutor. Proceedings of the User Modeling, Adaptation, and Personalization: 18th International Conference, UMAP 2010, Big Island, HI, USA. Proceedings 18."},{"key":"ref_60","first-page":"227","article-title":"The behavior of tutoring systems","volume":"16","author":"VanLehn","year":"2006","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s40593-015-0056-x","article-title":"Regulative loops, step loops and task loops","volume":"26","author":"VanLehn","year":"2016","journal-title":"Int. J. Artif. Intell. Educ."},{"key":"ref_62","unstructured":"Chi, M., Jordan, P.W., Vanlehn, K., and Litman, D.J. (2009, January 6\u201310). To elicit or to tell: Does it matter?. Proceedings of the Aied, Brighton, UK."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Bassen, J., Balaji, B., Schaarschmidt, M., Thille, C., Painter, J., Zimmaro, D., Games, A., Fast, E., and Mitchell, J.C. (2020, January 25\u201330). Reinforcement learning for the adaptive scheduling of educational activities. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3313831.3376518"},{"key":"ref_64","unstructured":"Yang, X., Zhou, G., Taub, M., Azevedo, R., and Chi, M. (2020). Student Subtyping via EM-Inverse Reinforcement Learning. Int. Educ. Data Min. Soc., 269\u2013279."},{"key":"ref_65","unstructured":"Zhu, X., Singla, A., Zilles, S., and Rafferty, A.N. (2018). An overview of machine teaching. arXiv."},{"key":"ref_66","first-page":"8464","article-title":"Teaching inverse reinforcement learners via features and demonstrations","volume":"31","author":"Haug","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_67","unstructured":"Tschiatschek, S., Ghosh, A., Haug, L., Devidze, R., and Singla, A. (2019). Learner-aware teaching: Inverse reinforcement learning with preferences and constraints. Adv. Neural Inf. Process. Syst., 32, Available online: https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2019\/hash\/3de568f8597b94bda53149c7d7f5958c-Abstract.html."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Kamalaruban, P., Devidze, R., Cevher, V., and Singla, A. (2019). Interactive teaching algorithms for inverse reinforcement learning. arXiv.","DOI":"10.24963\/ijcai.2019\/374"},{"key":"ref_69","unstructured":"Rakhsha, A., Radanovic, G., Devidze, R., Zhu, X., and Singla, A. (2020, January 13\u201318). Policy teaching via environment poisoning: Training-time adversarial attacks against reinforcement learning. Proceedings of the International Conference on Machine Learning, PMLR, Virtual."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Gissl\u00e9n, L., Eakins, A., Gordillo, C., Bergdahl, J., and Tollmar, K. (2021, January 17\u201320). Adversarial reinforcement learning for procedural content generation. Proceedings of the 2021 IEEE Conference on Games (CoG), Copenhagen, Denmark.","DOI":"10.1109\/CoG52621.2021.9619053"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Khalifa, A., Bontrager, P., Earle, S., and Togelius, J. (2020, January 19\u201323). Pcgrl: Procedural content generation via reinforcement learning. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Virtual.","DOI":"10.1609\/aiide.v16i1.7416"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Kartal, B., Sohre, N., and Guy, S.J. (2016, January 8\u201312). Data driven Sokoban puzzle generation with Monte Carlo tree search. Proceedings of the Twelfth Artificial Intelligence and Interactive Digital Entertainment Conference, Burlingame, CA, USA.","DOI":"10.1609\/aiide.v12i1.12859"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"6389","DOI":"10.1007\/s11042-021-11806-y","article-title":"RALF: An adaptive reinforcement learning framework for teaching dyslexic students","volume":"81","author":"Minoofam","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_74","unstructured":"Fok, A.W.P., and Ip, H.H. (2023, February 02). Personalized Education (PE) \u0153 Technology Integration for Individual Learning. Available online: https:\/\/citeseerx.ist.psu.edu\/document?repid=rep1&type=pdf&doi=0e4d60d16aec5ca0202f59957161c9a91a50d56a."},{"key":"ref_75","unstructured":"Ackerman, P.L. (1999). Traits and Knowledge as Determinants of Learning and Individual Differences: Putting It All Together, American Psychological Association."},{"key":"ref_76","unstructured":"Fok, A.W., Wong, H.S., and Chen, Y. (2005, January 6\u20139). Hidden Markov model based characterization of content access patterns in an e-learning environment. Proceedings of the 2005 IEEE International Conference on Multimedia and Expo, Amsterdam, The Netherlands."},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Wu, D., Wang, S., Liu, Q., Abualigah, L., and Jia, H. (2022). An improved teaching-learning-based optimization algorithm with reinforcement learning strategy for solving optimization problems. Comput. Intell. Neurosci., 2022.","DOI":"10.1155\/2022\/1535957"},{"key":"ref_78","unstructured":"Durik, A.M., Hulleman, C.S., and Harackiewicz, J.M. (2015). Interest in Mathematics and Science Learning, American Educational Research Association location."},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Slim, A., Al Yusuf, H., Abbas, N., Abdallah, C.T., Heileman, G.L., and Slim, A. (2021, January 13\u201315). A Markov Decision Processes Modeling for Curricular Analytics. Proceedings of the 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA), Virtually Online.","DOI":"10.1109\/ICMLA52953.2021.00071"},{"key":"ref_80","unstructured":"Slim, A. (2016). Curricular Analytics in Higher Education. [Ph.D. Thesis, The University of New Mexico]."},{"key":"ref_81","unstructured":"Venezia, A., Callan, P.M., Finney, J.E., Kirst, M.W., and Usdan, M.D. (2023, February 10). The Governance Divide: A Report on a Four-State Study on Improving College Readiness and Success. National Center Report# 05-3. National Center for Public Policy and Higher Education 2005, Available online: https:\/\/eric.ed.gov\/?id=ED508097."},{"key":"ref_82","unstructured":"Whitt, E.J., Schuh, J.H., Kinzie, J., and Kuh, G.D. (2013). Student Success in College: Creating Conditions That Matter, Jossey-Bass."},{"key":"ref_83","unstructured":"Tinto, V. (2012). Leaving College: Rethinking the Causes and Cures of Student Attrition, University of Chicago Press."},{"key":"ref_84","unstructured":"Heileman, G.L., Hickman, M., Slim, A., and Abdallah, C.T. (2017, January 25\u201328). Characterizing the complexity of curricular patterns in engineering programs. Proceedings of the 2017 ASEE Annual Conference & Exposition, Columbus, OH, USA."},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Slim, A., Kozlick, J., Heileman, G.L., Wigdahl, J., and Abdallah, C.T. (2014, January 7\u201311). Network analysis of university courses. Proceedings of the 23rd International Conference on World Wide Web, Seoul, Republic of Korea.","DOI":"10.1145\/2567948.2579360"},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.arthro.2006.09.005","article-title":"Repair of full-thickness cartilage defects with cells of different origin in a rabbit model","volume":"23","author":"Yan","year":"2007","journal-title":"Arthrosc. J. Arthrosc. Relat. Surg."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.ejor.2014.01.014","article-title":"Analysis of customer lifetime value and marketing expenditure decisions through a Markovian-based model","volume":"237","author":"Ekinci","year":"2014","journal-title":"Eur. J. Oper. Res."},{"key":"ref_88","first-page":"679","article-title":"A Markovian decision process","volume":"6","author":"Bellman","year":"1957","journal-title":"J. Math. Mech."},{"key":"ref_89","first-page":"2778","article-title":"Optimizing instructional policies","volume":"26","author":"Lindsey","year":"2013","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Clement, B., Roy, D., Oudeyer, P.Y., and Lopes, M. (2013). Multi-armed bandits for intelligent tutoring systems. arXiv.","DOI":"10.1109\/DEVLRN.2014.6983019"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Segal, A., Ben David, Y., Williams, J.J., Gal, K., and Shalom, Y. (2018, January 27\u201330). Combining difficulty ranking with multi-armed bandits to sequence educational content. Proceedings of the Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK. Proceedings, Part II 19.","DOI":"10.1007\/978-3-319-93846-2_59"},{"key":"ref_92","unstructured":"Matheson, J.E. (1964). Optimum Teaching Procedures Derived from Mathematical Learning Models, Stanford University, Institute in Engineering-Economic Systems."},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Xia, Q., Chiu, T.K., Zhou, X., Chai, C.S., and Cheng, M. (2022). Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education. Comput. Educ. Artif. Intell., 100118.","DOI":"10.1016\/j.caeai.2022.100118"},{"key":"ref_94","doi-asserted-by":"crossref","unstructured":"Cao, J., Yang, T., Lai, I.K.W., and Wu, J. (2021). Student acceptance of intelligent tutoring systems during COVID-19: The effect of political influence. Int. J. Electr. Eng. Educ.","DOI":"10.1177\/00207209211003270"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Holstein, K., McLaren, B.M., and Aleven, V. (2019). Co-designing a real-time classroom orchestration tool to support teacher-AI complementarity. Grantee Submiss.","DOI":"10.18608\/jla.2019.62.3"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"3004","DOI":"10.1111\/bjet.12854","article-title":"Building pipelines for educational data using AI and multimodal analytics: A \u201cgrey-box\u201d approach","volume":"50","author":"Sharma","year":"2019","journal-title":"Br. J. Educ. Technol."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"1808","DOI":"10.1111\/bjet.12984","article-title":"The impact of AI and robotics on physical, social-emotional and intellectual learning outcomes: An integrated analytical framework","volume":"51","year":"2020","journal-title":"Br. J. Educ. Technol."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"23821205211024078","DOI":"10.1177\/23821205211024078","article-title":"Are we ready to integrate artificial intelligence literacy into medical school curriculum: Students and faculty survey","volume":"8","author":"Wood","year":"2021","journal-title":"J. Med. Educ. Curric. Dev."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"1130","DOI":"10.1111\/bjet.13088","article-title":"Constructionism and AI: A history and possible futures","volume":"52","author":"Kahn","year":"2021","journal-title":"Br. J. Educ. Technol."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12909-021-02870-x","article-title":"The impact of artificial intelligence on clinical education: Perceptions of postgraduate trainee doctors in London (UK) and recommendations for trainers","volume":"21","author":"Banerjee","year":"2021","journal-title":"BMC Med. Educ."},{"key":"ref_101","first-page":"3","article-title":"What Do Turkish Pre-Service Teachers Think About Artificial Intelligence?","volume":"3","author":"Haseski","year":"2019","journal-title":"Int. J. Comput. Sci. Educ. Sch."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"178","DOI":"10.14324\/LRE.18.2.03","article-title":"Can Artificial Intelligence Help Predict a Learner\u2019s Needs? Lessons from Predicting Student Satisfaction","volume":"18","author":"Parapadakis","year":"2020","journal-title":"Lond. Rev. Educ."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1007\/s00146-016-0667-2","article-title":"The case of classroom robots: Teachers\u2019 deliberations on the ethical tensions","volume":"32","author":"Serholt","year":"2017","journal-title":"AI Soc."},{"key":"ref_104","unstructured":"Bostrom, N. (2016). Science Fiction and Philosophy: From Time Travel to Superintelligence, Wiley-Blackwell."},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1518\/001872097778543886","article-title":"Humans and automation: Use, misuse, disuse, abuse","volume":"39","author":"Parasuraman","year":"1997","journal-title":"Hum. Factors"},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"1","DOI":"10.14324\/LRE.19.1.01","article-title":"The role and challenges of education for responsible AI","volume":"19","author":"Dignum","year":"2021","journal-title":"Lond. Rev. Educ."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Dignum, V. (2019). Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way, Springer.","DOI":"10.1007\/978-3-030-30371-6"},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1145\/3375637.3375644","article-title":"AI is multidisciplinary","volume":"5","author":"Dignum","year":"2020","journal-title":"AI Matters"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/10\/3\/74\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:52:37Z","timestamp":1760129557000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/10\/3\/74"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,18]]},"references-count":108,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["informatics10030074"],"URL":"https:\/\/doi.org\/10.3390\/informatics10030074","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,18]]}}}