{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T22:13:36Z","timestamp":1771712016364,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,8,23]],"date-time":"2022-08-23T00:00:00Z","timestamp":1661212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>There has been much discussion among academics on how pupils may be taught online while yet maintaining a high degree of learning efficiency, in part because of the worldwide COVID-19 pandemic in the previous two years. Students may have trouble focusing due to a lack of teacher\u2013student interaction, yet online learning has some advantages that are unavailable in traditional classrooms. The architecture of online courses for students is integrated into a system called the Adaptive and Intelligent Education System (AIES). In AIESs, reinforcement learning is often used in conjunction with the development of teaching strategies, and this reinforcement-learning-based system is known as RLATES. As a prerequisite to conducting research in this field, this paper undertakes the consolidation and analysis of existing research, design approaches, and model categories for adaptive and intelligent educational systems, with the hope of serving as a reference for scholars in the same field to help them gain access to the relevant information quickly and easily.<\/jats:p>","DOI":"10.3390\/fi14090245","type":"journal-article","created":{"date-parts":[[2022,8,23]],"date-time":"2022-08-23T21:05:12Z","timestamp":1661288712000},"page":"245","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Artificial Intelligence in Adaptive and Intelligent Educational System: A Review"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8922-3838","authenticated-orcid":false,"given":"Jingwen","family":"Dong","sequence":"first","affiliation":[{"name":"Faculty of Computer Science & Information Technology, Universiti Putra Malaysia, Serdang 43400, Malaysia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7818-8208","authenticated-orcid":false,"given":"Siti Nurulain","family":"Mohd Rum","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science & Information Technology, Universiti Putra Malaysia, Serdang 43400, Malaysia"}]},{"given":"Khairul Azhar","family":"Kasmiran","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science & Information Technology, Universiti Putra Malaysia, Serdang 43400, Malaysia"}]},{"given":"Teh Noranis","family":"Mohd Aris","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science & Information Technology, Universiti Putra Malaysia, Serdang 43400, Malaysia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8100-1782","authenticated-orcid":false,"given":"Raihani","family":"Mohamed","sequence":"additional","affiliation":[{"name":"Faculty of Computer Science & Information Technology, Universiti Putra Malaysia, Serdang 43400, Malaysia"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/j.bushor.2019.11.003","article-title":"Artificial intelligence and machine learning as business tools: A framework for diagnosing value destruction potential","volume":"63","author":"Canhoto","year":"2020","journal-title":"Bus. Horiz."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1038\/s41580-019-0176-5","article-title":"Setting the standards for machine learning in biology","volume":"20","author":"Jones","year":"2019","journal-title":"Nat. Rev. Mol. Cell Biol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sidey-Gibbons, J.A.M., and Sidey-Gibbons, C.J. (2019). Machine learning in medicine: A practical introduction. BMC Med. Res. Methodol., 19.","DOI":"10.1186\/s12874-019-0681-4"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1080\/13562517.2020.1748593","article-title":"A pedagogy of data and Artificial Intelligence for student subjectification","volume":"25","author":"Loftus","year":"2020","journal-title":"Teach. High. Educ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1109\/JSTSP.2017.2692560","article-title":"A Machine Learning Approach for Tracking and Predicting Student Performance in Degree Programs","volume":"11","author":"Xu","year":"2017","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1080\/02680939.2015.1035758","article-title":"Digital education governance: Data visualization, predictive analytics, and \u2018real-time\u2019 policy instruments","volume":"31","author":"Williamson","year":"2016","journal-title":"J. Educ. Policy"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1016\/j.compedu.2007.08.002","article-title":"Development of an adaptive learning system with two sources of personalization information","volume":"51","author":"Tseng","year":"2008","journal-title":"Comput. Educ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4477","DOI":"10.1007\/s10639-020-10182-8","article-title":"Design framework of adaptive intelligent tutoring systems","volume":"25","year":"2020","journal-title":"Educ. Inf. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2092","DOI":"10.1016\/j.eswa.2012.10.014","article-title":"Comparing strategies for modeling students learning styles through reinforcement learning in adaptive and intelligent educational systems: An experimental analysis","volume":"40","author":"Lima","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/s10489-008-0115-1","article-title":"Learning teaching strategies in an Adaptive and Intelligent Educational System through Reinforcement Learning","volume":"31","author":"Iglesias","year":"2009","journal-title":"Appl. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.knosys.2009.01.007","article-title":"Reinforcement learning of pedagogical policies in adaptive and intelligent educational systems","volume":"22","author":"Iglesias","year":"2009","journal-title":"Knowl.-Based Syst."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A., and Silver, D. (2016, January 12\u201317). Deep Reinforcement Learning with Double Q-Learning. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, The Twenty-Eighth Conference on Innovative Applications of Artificial Intelligence, The Sixth Symposium on Educational Advances in Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"ref_13","first-page":"169","article-title":"Towards a Personalized Learning Experience Using Reinforcement Learning","volume":"Volume 801","author":"Hassanien","year":"2019","journal-title":"Machine Learning Paradigms: Theory and Application"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bassen, J., Balaji, B., Schaarschmidt, M., Thille, C., Painter, J., Zimmaro, D., Games, A., Fast, E., and Mitchell, J.C. (2020). Reinforcement Learning for the Adaptive Scheduling of Educational Activities. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, ACM.","DOI":"10.1145\/3313831.3376518"},{"key":"ref_15","first-page":"1000","article-title":"Reinforcement learning with human teachers: Evidence of feedback and guidance with implications for learning performance","volume":"Volume 6","author":"Thomaz","year":"2006","journal-title":"Proceedings of the AAAI"},{"key":"ref_16","unstructured":"Zhang, P. (2013). Using POMDP-based Reinforcement Learning for Online Optimization of Teaching Strategies in an Intelligent Tutoring System. [Ph.D. Thesis, University of Guelph]."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1613\/jair.301","article-title":"Reinforcement Learning: A Survey","volume":"4","author":"Kaelbling","year":"1996","journal-title":"J. Artif. Intell. Res."},{"key":"ref_18","unstructured":"Atkeson, C.G., and Santamaria, J.C. (1997, January 25). A comparison of direct and model-based reinforcement learning. Proceedings of the International Conference on Robotics and Automation, Albuquerque, NM, USA."},{"key":"ref_19","unstructured":"Nguyen, N.T., Hoang, B.H., Huynh, C.P., Hwang, D., Trawi\u0144ski, B., and Vossen, G. A Modified I2A Agent for Learning in a Stochastic Environment. Proceedings of the Computational Collective Intelligence."},{"key":"ref_20","unstructured":"Ha, D., and Schmidhuber, J. (2018). World Models. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Akanksha, E., Sharma, N., and Gulati, K. (2021, January 8\u201310). Review on Reinforcement Learning, Research Evolution and Scope of Application. Proceedings of the 2021 5th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.","DOI":"10.1109\/ICCMC51019.2021.9418283"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_24","unstructured":"Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2019). Continuous control with deep reinforcement learning. arXiv."},{"key":"ref_25","unstructured":"Bellemare, M.G., Dabney, W., and Munos, R. (2017, January 6\u201311). A Distributional Perspective on Reinforcement Learning. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1016\/j.cviu.2009.06.008","article-title":"Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process","volume":"114","author":"Hoey","year":"2010","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yu, X., Fan, Y., Xu, S., and Ou, L. (2021). A self-adaptive SAC-PID control approach based on reinforcement learning for mobile robots. Int. J. Robust Nonlinear Control, early view.","DOI":"10.1002\/rnc.5662"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-642-27645-3_1","article-title":"Reinforcement Learning and Markov Decision Processes","volume":"Volume 12","author":"Wiering","year":"2012","journal-title":"Reinforcement Learning"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.engappai.2014.12.007","article-title":"Concurrent Markov decision processes for robot team learning","volume":"39","author":"Girard","year":"2015","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1109\/TR.2014.2338811","article-title":"Semi-Markov Decision Process With Partial Information for Maintenance Decisions","volume":"63","author":"Srinivasan","year":"2014","journal-title":"IEEE Trans. Reliab."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3826","DOI":"10.1109\/TCYB.2020.2977374","article-title":"Deep Reinforcement Learning for Multiagent Systems: A Review of Challenges, Solutions, and Applications","volume":"50","author":"Nguyen","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.compeleceng.2019.07.019","article-title":"A review of reinforcement learning for autonomous building energy management","volume":"78","author":"Mason","year":"2019","journal-title":"Comput. Electr. Eng."},{"key":"ref_33","first-page":"1","article-title":"Issues in using function approximation for reinforcement learning","volume":"Volume 6","author":"Thrun","year":"1993","journal-title":"Proceedings of the 1993 Connectionist Models Summer School"},{"key":"ref_34","unstructured":"van Hasselt, H.P. (2011). Insights in Reinforcement Learning, W\u00f6hrmann Print Service, B.V."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1488","DOI":"10.1016\/j.ijinfomgt.2016.05.007","article-title":"Evaluation module based on Bayesian networks to Intelligent Tutoring Systems","volume":"37","year":"2017","journal-title":"Int. J. Inf. Manag."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"05027","DOI":"10.1051\/e3sconf\/202131705027","article-title":"Intelligent Tutoring System Using Bayesian Network for Vocational High Schools in Indonesia","volume":"317","author":"Burhan","year":"2021","journal-title":"E3S Web Conf."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.envsoft.2012.03.012","article-title":"Good practice in Bayesian network modelling","volume":"37","author":"Chen","year":"2012","journal-title":"Environ. Model. Softw."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1080\/10494820.2018.1558257","article-title":"Intelligent tutoring systems: A systematic review of characteristics, applications, and evaluation methods","volume":"29","author":"Mousavinasab","year":"2021","journal-title":"Interact. Learn. Environ."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1178","DOI":"10.1002\/j.0022-0337.2009.73.10.tb04809.x","article-title":"Intelligent Tutoring System for Clinical Reasoning Skill Acquisition in Dental Students","volume":"73","author":"Suebnukarn","year":"2009","journal-title":"J. Dent. Educ."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/9\/245\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:14:04Z","timestamp":1760141644000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/9\/245"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,23]]},"references-count":39,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["fi14090245"],"URL":"https:\/\/doi.org\/10.3390\/fi14090245","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,23]]}}}