{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T20:15:32Z","timestamp":1780344932123,"version":"3.54.1"},"reference-count":47,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,9,23]],"date-time":"2024-09-23T00:00:00Z","timestamp":1727049600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["739578"],"award-info":[{"award-number":["739578"]}]},{"name":"European Union\u2019s Horizon 2020 Research and Innovation Programme","award":["101093159"],"award-info":[{"award-number":["101093159"]}]},{"name":"European Union","award":["739578"],"award-info":[{"award-number":["739578"]}]},{"name":"European Union","award":["101093159"],"award-info":[{"award-number":["101093159"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Advancements in technology that can reshape educational paradigms, with Extended Reality (XR) have a pivotal role. This paper introduces an interactive XR intelligent assistant featuring a virtual teacher that interacts dynamically with PowerPoint presentations using OpenAI\u2019s ChatGPT API. The system incorporates Azure Cognitive Services for multilingual speech-to-text and text-to-speech capabilities, custom lip-syncing solutions, eye gaze, head rotation and gestures. Additionally, panoramic images can be used as a sky box giving the illusion that the AI assistant is located at another location. Findings from three pilots indicate that the proposed technology has a lot of potential to be used as an additional tool for enhancing the learning process. However, special care must be taken into privacy and ethical issues.<\/jats:p>","DOI":"10.3390\/mti8090083","type":"journal-article","created":{"date-parts":[[2024,9,24]],"date-time":"2024-09-24T10:41:47Z","timestamp":1727174507000},"page":"83","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Extended Reality Educational System with Virtual Teacher Interaction for Enhanced Learning"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3617-2261","authenticated-orcid":false,"given":"Fotis","family":"Liarokapis","sequence":"first","affiliation":[{"name":"Research Centre on Interactive Media, Smart Systems and Emerging Technologies (CYENS\u2014Centre of Excellence), 23 Dimarchou Lellou Dimitriadi Street, Nicosia 1016, Cyprus"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vaclav","family":"Milata","sequence":"additional","affiliation":[{"name":"Research Centre on Interactive Media, Smart Systems and Emerging Technologies (CYENS\u2014Centre of Excellence), 23 Dimarchou Lellou Dimitriadi Street, Nicosia 1016, Cyprus"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4690-6687","authenticated-orcid":false,"given":"Filip","family":"Skola","sequence":"additional","affiliation":[{"name":"Research Centre on Interactive Media, Smart Systems and Emerging Technologies (CYENS\u2014Centre of Excellence), 23 Dimarchou Lellou Dimitriadi Street, Nicosia 1016, Cyprus"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Stanney, K.M., Nye, H., Haddad, S., Hale, K.S., Padron, C.K., and Cohn, J.V. (2021). Extended reality (XR) environments. Handbook of Human Factors and Ergonomics, John Wiley & Sons, Ltd. Chapter 30.","DOI":"10.1002\/9781119636113.ch30"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ratcliffe, J., Soave, F., Bryan-Kinns, N., Tokarchuk, L., and Farkhatdinov, I. (2021, January 8\u201313). Extended Reality (XR) Remote Research: A Survey of Drawbacks and Opportunities. Proceedings of the CHI\u201921: 2021 CHI Conference on Human Factors in Computing Systems, New York, NY, USA.","DOI":"10.1145\/3411764.3445170"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2809","DOI":"10.1364\/OL.492370","article-title":"Toward a see-through camera via AR lightguide","volume":"48","author":"Ma","year":"2023","journal-title":"Opt. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2270027","DOI":"10.1002\/lpor.202270027","article-title":"Augmented Reality Enabled by On-Chip Meta-Holography Multiplexing Light","volume":"16","author":"Shi","year":"2022","journal-title":"Laser Photonics Rev."},{"key":"ref_5","unstructured":"The World Bank, and UNICEF (2021). The State of the Global Education Crisis: A Path to Recovery, UNICEF."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1109\/MCG.2024.3406139","article-title":"XR4ED: An Extended Reality Platform for Education","volume":"44","author":"Liarokapis","year":"2024","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103778","DOI":"10.1016\/j.compedu.2019.103778","article-title":"A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda","volume":"147","author":"Radianti","year":"2020","journal-title":"Comput. Educ."},{"key":"ref_8","first-page":"155","article-title":"Systematic literature review and bibliometric analysis on virtual reality and education","volume":"28","year":"2022","journal-title":"Educ. Inf. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Garz\u00f3n, J. (2021). An Overview of Twenty-Five Years of Augmented Reality in Education. Multimodal Technol. Interact., 5.","DOI":"10.3390\/mti5070037"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1860","DOI":"10.1080\/10494820.2020.1859546","article-title":"Augmented reality in education. A scientific mapping in Web of Science","volume":"31","year":"2023","journal-title":"Interact. Learn. Environ."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dengel, A., Iqbal, M.Z., Grafe, S., and Mangina, E. (2022). A Review on Augmented Reality Authoring Toolkits for Education. Front. Virtual Real., 3.","DOI":"10.3389\/frvir.2022.798032"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Friston, S.J., Congdon, B.J., Swapp, D., Izzouzi, L., Brandst\u00e4tter, K., Archer, D., Olkkonen, O., Thiel, F.J., and Steed, A. (2021, January 8\u201310). Ubiq: A System to Build Flexible Social Virtual Reality Experiences. Proceedings of the VRST\u201921: 27th ACM Symposium on Virtual Reality Software and Technology, New York, NY, USA.","DOI":"10.1145\/3489849.3489871"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1080\/0144929X.2016.1268647","article-title":"How virtual reality affects perceived learning effectiveness: A task\u2013technology fit perspective","volume":"36","author":"Zhang","year":"2017","journal-title":"Behav. Inf. Technol."},{"key":"ref_14","unstructured":"Hussin, N.H., Jaafar, J., and Downe, A.G. Assessing educators\u2019 acceptance of virtual reality (VR) in the classroom using the unified theory of acceptance and use of technology (UTAUT). Proceedings of the IVIC\u201911: Second International Conference on Visual Informatics: Sustaining Research and Innovations\u2014Volume Part I."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"6798","DOI":"10.1109\/ACCESS.2020.3048708","article-title":"Augmented Reality and Virtual Reality for Learning: An Examination Using an Extended Technology Acceptance Model","volume":"9","author":"Jang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1086","DOI":"10.1002\/cae.22504","article-title":"Virtual reality as a didactic resource from the perspective of engineering teachers","volume":"30","author":"Vergara","year":"2022","journal-title":"Comput. Appl. Eng. Educ."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Meccawy, M. (2022). Creating an Immersive XR Learning Experience: A Roadmap for Educators. Electronics, 11.","DOI":"10.3390\/electronics11213547"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"21582440221093348","DOI":"10.1177\/21582440221093348","article-title":"Current State and General Perceptions of the Use of Extended Reality (XR) Technology at the University of Newcastle: Interviews and Surveys From Staff and Students","volume":"12","author":"Kluge","year":"2022","journal-title":"SAGE Open"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1109\/TLT.2023.3242553","article-title":"Immersive Learning Frameworks: A Systematic Literature Review","volume":"16","author":"Fernandes","year":"2023","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_20","unstructured":"Auer, M.E., and Tsiatsos, T. (2024). Perceptions and Challenges of Implementing XR Technologies in Education: A Survey-Based Study. Smart Mobile Communication & Artificial Intelligence, Springer."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Reiners, D., Davahli, M.R., Karwowski, W., and Cruz-Neira, C. (2021). The Combination of Artificial Intelligence and Extended Reality: A Systematic Review. Front. Virtual Real., 2.","DOI":"10.3389\/frvir.2021.721933"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/MC.2023.3263576","article-title":"Generative Artificial Intelligence and the Education Sector","volume":"56","author":"Ahmad","year":"2023","journal-title":"Computer"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1080\/14703297.2023.2190148","article-title":"Chatting and cheating: Ensuring academic integrity in the era of ChatGPT","volume":"61","author":"Debby","year":"2024","journal-title":"Innov. Educ. Teach. Int."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"100022","DOI":"10.1016\/j.chbah.2023.100022","article-title":"ChatGPT in education: Methods, potentials, and limitations","volume":"1","author":"Memarian","year":"2023","journal-title":"Comput. Hum. Behav. Artif. Hum."},{"key":"ref_25","unstructured":"Kjelldahl, L., and Baranoski, G.V. (2010). Using Augmented Reality as a Medium to Assist Teaching in Higher Education. Proceedings\nof the 31st Annual Conference of the European Association for Computer Graphics, Eurographics 2010\u2014Education Papers, Norrk\u00f6ping,\nSweden, May 3\u20137, 2010, Eurographics Association."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Santos Gardu\u00f1o, H.A., Esparza Mart\u00ednez, M.I., and Portuguez Castro, M. (2021). Impact of Virtual Reality on Student Motivation in a High School Science Course. Appl. Sci., 11.","DOI":"10.3390\/app11209516"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"100452","DOI":"10.1016\/j.edurev.2022.100452","article-title":"The potential of immersive virtual reality to enhance learning: A meta-analysis","volume":"36","author":"Coban","year":"2022","journal-title":"Educ. Res. Rev."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1470","DOI":"10.1002\/cae.22532","article-title":"A meta-analysis and systematic review of the effect of virtual reality technology on users\u2019 learning outcomes","volume":"30","author":"Yu","year":"2022","journal-title":"Comput. Appl. Eng. Educ."},{"key":"#cr-split#-ref_29.1","unstructured":"Bourdin, J., and Shesh, A. (2017). Using Activity Led Learning for Teaching Computer Graphics Principles Through Augmented Reality. Proceedings of the 38th Annual Conference of the European Association for Computer Graphics, Eurographics 2017-Education Papers, Lyon,"},{"key":"#cr-split#-ref_29.2","unstructured":"France, April 24-28, 2017, Eurographics Association."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1145\/3580492","article-title":"Modeling, Replicating, and Predicting Human Behavior: A Survey","volume":"18","author":"Fuchs","year":"2023","journal-title":"ACM Trans. Auton. Adapt. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1007\/s12559-015-9326-z","article-title":"Open challenges in modelling, analysis and synthesis of human behaviour in human\u2013human and human\u2013machine interactions","volume":"7","author":"Vinciarelli","year":"2015","journal-title":"Cogn. Comput."},{"key":"ref_32","first-page":"43","article-title":"A survey on ontologies for human behavior recognition","volume":"46","author":"Lilius","year":"2014","journal-title":"ACM Comput. Surv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ca\u00f1as, J.J. (2022). AI and Ethics When Human Beings Collaborate with AI Agents. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.836650"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1038\/nrn.2017.14","article-title":"Sense of agency in the human brain","volume":"18","author":"Haggard","year":"2017","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Flathmann, C., Schelble, B.G., Zhang, R., and McNeese, N.J. (2021, January 19\u201321). Modeling and Guiding the Creation of Ethical Human\u2013AI Teams. Proceedings of the AIES\u201921: 2021 AAAI\/ACM Conference on AI, Ethics, and Society, New York, NY, USA.","DOI":"10.1145\/3461702.3462573"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., L\u00fctge, C., Madelin, R., Pagallo, U., and Rossi, F. (2021). An Ethical Framework for a Good AI Society: Opportunities, Risks, Principles, and Recommendations. Ethics, Governance, and Policies in Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-030-81907-1_3"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"102433","DOI":"10.1016\/j.ijinfomgt.2021.102433","article-title":"Ethical framework for Artificial Intelligence and Digital technologies","volume":"62","author":"Ashok","year":"2022","journal-title":"Int. J. Inf. Manag."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1093\/analys\/58.1.7","article-title":"The extended mind","volume":"58","author":"Clark","year":"1998","journal-title":"Analysis"},{"key":"#cr-split#-ref_39.1","unstructured":"Hu, R., and Charalambous, P. (2024). Emotional Responses to Exclusionary Behaviors in Intelligent Embodied Augmented Reality Agents. Proceedings of the 45th Annual Conference of the European Association for Computer Graphics,"},{"key":"#cr-split#-ref_39.2","unstructured":"Eurographics 2024-Short Papers, Limassol, Cyprus, April 22-26, 2024, Eurographics Association."},{"key":"ref_40","first-page":"4","article-title":"The Benefits of Multilingual Classrooms","volume":"74","author":"Hansel","year":"2019","journal-title":"YC Young Child."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Krejsa, J., and Liarokapis, F. (2021, January 17\u201320). A Novel Lip Synchronization Approach for Games and Virtual Environments. Proceedings of the 2021 IEEE Conference on Games (CoG), Copenhagen, Denmark.","DOI":"10.1109\/CoG52621.2021.9619128"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Krejsa, J., Kerou, B., and Liarokapis, F. (2018, January 5\u20137). A Model for Eye and Head Motion for Virtual Agents. Proceedings of the 2018 10th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), W\u00fcrzburg, Germany.","DOI":"10.1109\/VS-Games.2018.8493406"},{"key":"ref_43","unstructured":"Mittelberg,, I. (2007). Gesture & Thought. DavidMcNeill, Chicago: Chicago University Press, 340 Pages, Taylor & Francis:."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1111\/j.1467-9280.2005.01619.x","article-title":"Digital Chameleons: Automatic Assimilation of Nonverbal Gestures in Immersive Virtual Environments","volume":"16","author":"Bailenson","year":"2005","journal-title":"Psychol. Sci."},{"key":"ref_45","first-page":"1","article-title":"Review on Panoramic Imaging and Its Applications in Scene Understanding","volume":"71","author":"Gao","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/9\/83\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:00:53Z","timestamp":1760112053000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/8\/9\/83"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,23]]},"references-count":47,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["mti8090083"],"URL":"https:\/\/doi.org\/10.3390\/mti8090083","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,23]]}}}