{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T07:06:37Z","timestamp":1783062397533,"version":"3.54.6"},"reference-count":56,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,29]],"date-time":"2025-06-29T00:00:00Z","timestamp":1751155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Higher Education, Scientific Research, and Innovation","award":["22"],"award-info":[{"award-number":["22"]}]},{"name":"Digital Development Agency (DDA)","award":["22"],"award-info":[{"award-number":["22"]}]},{"name":"CNRST of Morocco","award":["22"],"award-info":[{"award-number":["22"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Immersive learning has been recognized as a promising paradigm for enhancing educational experiences through the integration of VR. We propose an architecture for intelligent tutoring in immersive VR environments that employs LLM-based non-playable characters. Key system capabilities are identified, including natural language understanding, real-time adaptive dialogue, and multimodal interaction through hand tracking, gaze detection, and haptic feedback. The system synchronizes speech output with NPC animations, enhancing both interactional realism and cognitive immersion. This design demonstrates that AI-driven VR interactions can significantly improve learner engagement. System performance was generally stable; however, minor latency was observed during speech processing, indicating areas for technical refinement. Overall, this research highlights the transformative potential of VR in education and emphasizes the importance of ongoing optimization to maximize its effectiveness in immersive learning contexts.<\/jats:p>","DOI":"10.3390\/info16070556","type":"journal-article","created":{"date-parts":[[2025,6,30]],"date-time":"2025-06-30T13:06:17Z","timestamp":1751288777000},"page":"556","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["An Architecture for Intelligent Tutoring in Virtual Reality: Integrating LLMs and Multimodal Interaction for Immersive Learning"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0327-8249","authenticated-orcid":false,"given":"Mohamed","family":"El Hajji","sequence":"first","affiliation":[{"name":"IRF-SIC Laboratory, Ibnou Zohr University, Agadir 80000, Morocco"},{"name":"Regional Center for Education and Training Professions-Souss Massa, Agadir 80000, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6201-1985","authenticated-orcid":false,"given":"Tarek","family":"Ait Baha","sequence":"additional","affiliation":[{"name":"IRF-SIC Laboratory, Ibnou Zohr University, Agadir 80000, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6282-3972","authenticated-orcid":false,"given":"Anas","family":"Berka","sequence":"additional","affiliation":[{"name":"IRF-SIC Laboratory, Ibnou Zohr University, Agadir 80000, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-3076-1366","authenticated-orcid":false,"given":"Hassan","family":"Ait Nacer","sequence":"additional","affiliation":[{"name":"Polydisciplinary Faculty of Taroudant, Ibnou Zohr University, Taroudant 83000, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5878-726X","authenticated-orcid":false,"given":"Houssam","family":"El Aouifi","sequence":"additional","affiliation":[{"name":"IRF-SIC Laboratory, Ibnou Zohr University, Agadir 80000, Morocco"},{"name":"FSJES AM, Ibnou Zohr University, Ait Melloul 86153, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4934-2322","authenticated-orcid":false,"given":"Youssef","family":"Es-Saady","sequence":"additional","affiliation":[{"name":"IRF-SIC Laboratory, Ibnou Zohr University, Agadir 80000, Morocco"},{"name":"Polydisciplinary Faculty of Taroudant, Ibnou Zohr University, Taroudant 83000, Morocco"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Shen, J., Zhou, X., Wu, W., Wang, L., and Chen, Z. (2023). Worldwide overview and country differences in metaverse research: A bibliometric analysis. Sustainability, 15.","DOI":"10.3390\/su15043541"},{"key":"ref_2","first-page":"44","article-title":"Challenges of the sudden shift to asynchronous virtual education in nursing education during the COVID-19 pandemic: A qualitative study","volume":"11","author":"Moradi","year":"2022","journal-title":"Nurs. Midwifery Stud."},{"key":"ref_3","first-page":"12","article-title":"From reality to virtuality: Re-discussing cities with the concept of the metaverse","volume":"4","author":"Kemec","year":"2022","journal-title":"Int. J. Manag. Account."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"106","DOI":"10.54691\/bcpbm.v36i.3396","article-title":"Innovation and Development in the Metaverse under the Digital Economy\u2014Takes Tencent as an Example","volume":"36","author":"Fei","year":"2023","journal-title":"BCP Bus. Manag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1109\/COMST.2022.3202047","article-title":"A Survey on Metaverse: Fundamentals, Security, and Privacy","volume":"25","author":"Wang","year":"2023","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"6","DOI":"10.56294\/mr20226","article-title":"Immersive environments, Metaverse and the key challenges in programming","volume":"19","author":"Argote","year":"2022","journal-title":"Metaverse Basic Appl. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4209","DOI":"10.1109\/ACCESS.2021.3140175","article-title":"A metaverse: Taxonomy, components, applications, and open challenges","volume":"10","author":"Park","year":"2022","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e31737","DOI":"10.2196\/31737","article-title":"Improving user experience of virtual health assistants: Scoping review","volume":"23","author":"Curtis","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1007\/s42979-023-02092-6","article-title":"The power of personalization: A systematic review of personality-adaptive chatbots","volume":"4","author":"Fadili","year":"2023","journal-title":"SN Comput. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1145\/1952712.1952717","article-title":"An empirical investigation of virtual world projects and metaverse technology capabilities","volume":"42","author":"Owens","year":"2011","journal-title":"ACM SIGMIS Database Database Adv. Inf. Syst."},{"key":"ref_11","first-page":"32","article-title":"Educational applications of metaverse: Possibilities and limitations","volume":"18","author":"Bokyung","year":"2022","journal-title":"J. Educ. Eval. Health Prof."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hatami, M., Qu, Q., Chen, Y., Kholidy, H., Blasch, E., and Ardiles-Cruz, E. (2024). A Survey of the Real-Time Metaverse: Challenges and Opportunities. Future Internet, 16.","DOI":"10.20944\/preprints202409.0889.v2"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"486","DOI":"10.3390\/encyclopedia2010031","article-title":"Metaverse","volume":"2","author":"Mystakidis","year":"2022","journal-title":"Encyclopedia"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"14671","DOI":"10.1109\/JIOT.2023.3278329","article-title":"A Survey on the Metaverse: The State-of-the-Art, Technologies, Applications, and Challenges","volume":"10","author":"Wang","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"101717","DOI":"10.1016\/j.jsis.2022.101717","article-title":"Immersive virtual reality in the age of the Metaverse: A hybrid-narrative review based on the technology affordance perspective","volume":"31","author":"Dincelli","year":"2022","journal-title":"J. Strateg. Inf. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Grande, R., Albusac, J., Vallejo, D., Glez-Morcillo, C., and Castro-Schez, J. (2024). Performance Evaluation and Optimization of 3D Models from Low-Cost 3D Scanning Technologies for Virtual Reality and Metaverse E-Commerce. Appl. Sci., 14.","DOI":"10.3390\/app14146037"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Goel, R., Baral, S., Mishra, T., and Jain, V. (2023). Augmented and Virtual Reality in Industry 5.0. Augmented and Virtual Reality Series, Volume 2, De Gruyter.","DOI":"10.1515\/9783110790146"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"121101","DOI":"10.1007\/s11432-021-3449-x","article-title":"Toward the third generation artificial intelligence","volume":"66","author":"Zhang","year":"2023","journal-title":"Sci. China Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ramadan, Z., and Ramadan, J. (2025, January 18). AI avatars and co-creation in the metaverse, Consum. Behav. Tour. Hosp., Available online: https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/cbth-07-2024-0246\/full\/html.","DOI":"10.1108\/CBTH-07-2024-0246"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Agrati, L. (2023). Tutoring in the metaverse. Study on student-teachers\u2019 and tutors\u2019 perceptions about NPC tutor. Front. Educ., 8.","DOI":"10.3389\/feduc.2023.1202442"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1007\/s10055-020-00489-9","article-title":"Immersive Virtual Reality in K-12 and Higher Education: A systematic review of the last decade scientific literature","volume":"25","author":"Pellas","year":"2021","journal-title":"Virtual Real."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"189359","DOI":"10.1109\/ACCESS.2024.3489233","article-title":"A Systematic Review of Immersive Virtual Reality in STEM Education: Advantages and Disadvantages on Learning and User Experience","volume":"12","author":"Acevedo","year":"2024","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"em2090","DOI":"10.29333\/ejmste\/11814","article-title":"The Use of Virtual Reality in a Chemistry Lab and Its Impact on Students\u2019 Self-Efficacy, Interest, Self-Concept and Laboratory Anxiety","volume":"18","author":"Gungor","year":"2022","journal-title":"Eurasia J. Math. Sci. Technol. Educ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2987","DOI":"10.1007\/s11042-019-08214-8","article-title":"Immersive virtual reality to enforce teaching in engineering education","volume":"79","author":"Halabi","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"100917","DOI":"10.1016\/j.imr.2022.100917","article-title":"The digital metaverse: Applications in artificial intelligence, medical education, and integrative health","volume":"12","author":"Ahuja","year":"2023","journal-title":"Integr. Med. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e34964","DOI":"10.1016\/j.heliyon.2024.e34964","article-title":"Fostering Design Thinking mindset for university students with NPCs in the metaverse","volume":"10","author":"Huyen","year":"2024","journal-title":"Heliyon"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"104701","DOI":"10.1016\/j.compedu.2022.104701","article-title":"Diverse approaches to learning with immersive Virtual Reality identified from a systematic review","volume":"195","author":"Won","year":"2023","journal-title":"Comput. Educ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1937","DOI":"10.1007\/s00371-020-01942-1","article-title":"Immersive analysis of user motion in VR applications","volume":"36","author":"Kloiber","year":"2020","journal-title":"Vis. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"103778","DOI":"10.1016\/j.compedu.2019.103778","article-title":"A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda","volume":"147","author":"Radianti","year":"2020","journal-title":"Comput. Educ."},{"key":"ref_30","first-page":"100069","article-title":"Developing an immersive game-based learning platform with generative artificial intelligence and virtual reality technologies\u2014\u201cLearningverseVR\u201d","volume":"4","author":"Song","year":"2024","journal-title":"Comput. Educ. X Real."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Campitiello, L., Beatini, V., and Di Tore, S. (2024). Non-player Character Smart in Virtual Learning Environment: Empowering Education Through Artificial Intelligence. Artificial Intelligence with and for Learning Sciences. Past, Present, and Future Horizons, Springer.","DOI":"10.1007\/978-3-031-57402-3_14"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chodvadiya, C., Solanki, V., and Singh, K. (2024, January 1\u20133). Intelligent Virtual Worlds: A Survey of the Role of AI in the Metaverse. Proceedings of the 2024 3rd International Conference for Innovation in Technology (INOCON), Bangalore, India. Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/10511825.","DOI":"10.1109\/INOCON60754.2024.10511825"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Pariy, V., Lipianina-Honcharenko, K., Brukhanskyi, R., Sachenko, A., Tkachyk, F., and Lendiuk, D. (2023, January 21\u201325). Intelligent Verbal Interaction Methods with Non-Player Characters in Metaverse Applications. Proceedings of the 2023 IEEE 5th International Conference on Advanced Information and Communication Technologies (AICT), Lviv, Ukraine. Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/10452688.","DOI":"10.1109\/AICT61584.2023.10452688"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J., and Kim, S. (2020). Navigating Non-Playable Characters Based on User Trajectories with Accumulation Map and Path Similarity. Symmetry, 12.","DOI":"10.3390\/sym12101592"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Moon, J. (2018). Reviews of Social Embodiment for Design of Non-Player Characters in Virtual Reality-Based Social Skill Training for Autistic Children. Multimodal Technol. Interact., 2.","DOI":"10.3390\/mti2030053"},{"key":"ref_36","first-page":"17","article-title":"A Future Direction for Virtual Reality Language Learning Using Dialogue Generation Systems","volume":"2","author":"Xu","year":"2022","journal-title":"J. Educ. Humanit. Soc. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"105581","DOI":"10.1016\/j.engappai.2022.105581","article-title":"Artificial intelligence for the metaverse: A survey","volume":"117","author":"Pham","year":"2023","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sumon, R., Uddin, S., Akter, S., Mozumder, M., Khan, M., and Kim, H. (2024). Natural Language Processing Influence on Digital Socialization and Linguistic Interactions in the Integration of the Metaverse in Regular Social Life. Electronics, 13.","DOI":"10.3390\/electronics13071331"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1109\/TIV.2024.3349466","article-title":"Integrating Large Language Models and Metaverse in Autonomous Racing: An Education-Oriented Perspective","volume":"9","author":"Li","year":"2024","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"100048","DOI":"10.1016\/j.nlp.2023.100048","article-title":"A survey of GPT-3 family large language models including ChatGPT and GPT-4","volume":"6","author":"Kalyan","year":"2024","journal-title":"Nat. Lang. Process. J."},{"key":"ref_41","unstructured":"Grattafiori, A., Dubey, A., Jauhri, A., Pandey, A., and Kadian, A. (2024). The Llama 3 Herd of Models. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"101751","DOI":"10.1016\/j.csl.2024.101751","article-title":"End-to-End Speech-to-Text Translation: A Survey","volume":"90","author":"Sethiya","year":"2025","journal-title":"Comput. Speech Lang."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"15171","DOI":"10.1007\/s11042-022-13943-4","article-title":"A deep learning approaches in text-to-speech system: A systematic review and recent research perspective","volume":"82","author":"Kumar","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Guan, J., Zhang, Z., Zhou, H., Hu, T., Wang, K., He, D., Feng, H., Liu, J., Ding, E., and Liu, Z. (2023). StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generator. arXiv.","DOI":"10.1109\/CVPR52729.2023.00151"},{"key":"ref_45","unstructured":"Rahman, R., and Islam, M. (2023). VREd: A Virtual Reality-Based Classroom for Online Education Using Unity3D WebGL. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"3077","DOI":"10.1109\/TVCG.2025.3549123","article-title":"An embodied body morphology task for investigating self-avatar proportions perception in Virtual Reality","volume":"31","author":"Boban","year":"2025","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"M\u00fcsseler, J., Salm-Hoogstraeten, S., and B\u00f6ffel, C. (2022). Perspective taking and avatar-self merging. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.714464"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2062","DOI":"10.1109\/TVCG.2020.2973077","article-title":"Avatar and sense of embodiment: Studying the relative preference between appearance, control and point of view","volume":"26","author":"Fribourg","year":"2020","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Cha, H., Kim, B., and Joo, H. (2024, January 16\u201322). Pegasus: Personalized generative 3d avatars with composable attributes. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR52733.2024.00108"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.1109\/TVCG.2018.2794629","article-title":"The impact of avatar personalization and immersion on virtual body ownership, presence, and emotional response","volume":"24","author":"Waltemate","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Altundas, S., and Karaarslan, E. (2023). Cross-platform and Personalized Avatars in the Metaverse: Ready Player Me Case. Digital Twin Driven Intelligent Systems and Emerging Metaverse, Springer.","DOI":"10.1007\/978-981-99-0252-1"},{"key":"ref_52","unstructured":"Zhang, Z., Zhang, A., Li, M., and Smola, A. (2022). Automatic Chain of Thought Prompting in Large Language Models. arXiv."},{"key":"ref_53","unstructured":"Radford, A., Kim, J., Xu, T., Brockman, G., McLeavey, C., and Sutskever, I. (2022). Robust Speech Recognition via Large-Scale Weak Supervision. arXiv."},{"key":"ref_54","unstructured":"Lin, W., Chen, L., Xiong, W., Ran, K., and Fan, A. (2023). Measuring the Sense of Presence and Learning Efficacy in Immersive Virtual Assembly Training. arXiv."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Lysenko, S., and Kachur, A. (2023, January 13\u201315). Challenges Towards VR Technology: VR Architecture Optimization. Proceedings of the 2023 13th International Conference on Dependable Systems, Services and Technologies (DESSERT), Athens, Greece. Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/10416538.","DOI":"10.1109\/DESSERT61349.2023.10416538"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"12827","DOI":"10.1007\/s10639-024-13210-z","article-title":"Virtual reality and augmented reality-supported K-12 STEM learning: Trends, advantages and challenges","volume":"30","author":"Jiang","year":"2025","journal-title":"Educ. Inf. Technol."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/7\/556\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:01:19Z","timestamp":1760032879000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/7\/556"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,29]]},"references-count":56,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["info16070556"],"URL":"https:\/\/doi.org\/10.3390\/info16070556","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,29]]}}}