{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,28]],"date-time":"2026-05-28T00:44:05Z","timestamp":1779929045438,"version":"3.53.1"},"reference-count":50,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T00:00:00Z","timestamp":1772409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010790","name":"European Union within the Erasmus+ programme","doi-asserted-by":"publisher","award":["2022-1-IT02-KA220- HED-00008955"],"award-info":[{"award-number":["2022-1-IT02-KA220- HED-00008955"]}],"id":[{"id":"10.13039\/501100010790","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010790","name":"European Union within the Erasmus+ programme","doi-asserted-by":"publisher","award":["2023-1-IT02- KA220-HED-0001621181"],"award-info":[{"award-number":["2023-1-IT02- KA220-HED-0001621181"]}],"id":[{"id":"10.13039\/501100010790","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Understanding how learners engage with immersive sign language training environments is essential for advancing virtual reality-based education and inclusion. This study analyzes behavioral engagement in SONAR, a virtual reality application designed for sign language training and validation. We focus on three automatically derived engagement indicators (Visual Attention (VA), Video Replay Frequency (VRF), and Post-Playback Viewing Time (PPVT)) and examine their relationship with learning performance in a sample of 117 university students. Participants completed a self-paced Training phase with 12 sign language instructional videos, followed by a Validation quiz assessing retention. We employed Pearson correlation analysis to examine the relationships between engagement indicators and quiz performance, followed by binomial Generalized Linear Model (GLM) regression to assess their joint predictive contributions. Additionally, we conducted temporal analysis by aggregating moment-to-moment VA traces across all learners to characterize engagement dynamics during the learning session. Results show that VA exhibits a strong positive correlation with quiz performance (r = 0.76), followed by PPVT (r = 0.66), whereas VRF shows no meaningful association. A binomial GLM confirms that VA and PPVT are significant predictors of learning success, jointly explaining a substantial proportion of performance variance (pseudo\u2212R2 = 0.83). Going beyond outcome-oriented analysis, we characterize temporal engagement patterns by aggregating moment-to-moment VA traces across all learners. The temporal profile reveals distinct attention peaks aligned with informationally dense segments of both training and validation videos, as well as phase-specific engagement dynamics, including initial acclimatization, oscillatory attention cycles during learning, and pronounced attentional peaks during assessment. Together, these findings highlight the central role of sustained and strategically allocated visual attention in VR-based sign language learning and demonstrate the value of behavioral trace data for understanding and predicting learner engagement in immersive environments.<\/jats:p>","DOI":"10.3390\/mti10030023","type":"journal-article","created":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T12:39:56Z","timestamp":1772455196000},"page":"23","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Behavioral Engagement in VR-Based Sign Language Learning: Visual Attention as a Predictor of Performance and Temporal Dynamics"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-3098-9349","authenticated-orcid":false,"given":"Davide","family":"Traini","sequence":"first","affiliation":[{"name":"Department of Information Engineering, Universit\u00e0 delle Marche, 60121 Ancona, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3607-260X","authenticated-orcid":false,"given":"Jos\u00e9 Manuel","family":"Alcalde-Llergo","sequence":"additional","affiliation":[{"name":"Department of Computer Science and AI, Universidad de C\u00f3rdoba, 14071 C\u00f3rdoba, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3242-5332","authenticated-orcid":false,"given":"Mariana","family":"Buenestado-Fern\u00e1ndez","sequence":"additional","affiliation":[{"name":"Department of Education, Universidad de C\u00f3rdoba, 14071 C\u00f3rdoba, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1360-8499","authenticated-orcid":false,"given":"Domenico","family":"Ursino","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, Universit\u00e0 delle Marche, 60121 Ancona, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8153-5052","authenticated-orcid":false,"given":"Enrique","family":"Yeguas-Bol\u00edvar","sequence":"additional","affiliation":[{"name":"Department of Computer Science and AI, Universidad de C\u00f3rdoba, 14071 C\u00f3rdoba, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1470","DOI":"10.1002\/cae.22532","article-title":"A meta-analysis and systematic review of the effect of virtual reality technology on users\u2019 learning outcomes","volume":"30","author":"Yu","year":"2022","journal-title":"Comput. Appl. Eng. Educ."},{"key":"ref_2","unstructured":"Wang, J., Ivrissimtzis, I., Li, Z., and Shi, L. (2024). The Impact of 2D and 3D Gamified VR on Learning American Sign Language. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Berrezueta-Guzman, S., Daya, R., and Wagner, S. (2025). Virtual reality in sign language education: Opportunities, challenges, and the road ahead. Front. Virtual Real., 6.","DOI":"10.3389\/frvir.2025.1625910"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e2000","DOI":"10.7717\/peerj-cs.2000","article-title":"A review on cultivating effective learning: Synthesizing educational theories and virtual reality for enhanced educational experiences","volume":"10","author":"Mallek","year":"2024","journal-title":"PeerJ Comput. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Abeysinghe, Y., Hasan, S., and Tanveer, M. (2025, January 11). Assessing Visual Attention in Gaze-Based VR Learning Environments Using Eye-Tracking Measures. Proceedings of the GSGA Research Conference, Norfolk, VA, USA.","DOI":"10.1145\/3715669.3726795"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1007\/s10055-022-00738-z","article-title":"Eye tracking in virtual reality: A broad review of applications and challenges","volume":"27","author":"Adhanom","year":"2023","journal-title":"Virtual Real."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5213","DOI":"10.1038\/s41598-025-89336-y","article-title":"Prediction of intrinsic and extraneous cognitive load with oculometric and biometric indicators","volume":"15","author":"Ekin","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, J.Y., Yang, C.H., Liao, W.C., Yang, K.C., Chang, I.W., Sheu, B.C., and Ni, Y.H. (2022). Highly engaged video-watching pattern in asynchronous online pharmacology course in pre-clinical 4th-Year medical students was associated with a good self-expectation, understanding, and performance. Front. Med., 8.","DOI":"10.3389\/fmed.2021.799412"},{"key":"ref_9","unstructured":"Galbraith, J. (2004, January 18\u201320). Active viewing: And oxymoron in video-based instruction. Proceedings of the Society for Applied Learning Technologies Conference, Kissimmee, FL, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1186\/s40561-025-00381-6","article-title":"Learning analytics in immersive virtual learning environments: A systematic literature review","volume":"12","author":"Tao","year":"2025","journal-title":"Smart Learn. Environ."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s40692-020-00169-2","article-title":"Immersive virtual reality as a pedagogical tool in education: A systematic literature review of quantitative learning outcomes and experimental design","volume":"8","author":"Hamilton","year":"2021","journal-title":"J. Comput. Educ."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chen, B., Wang, Y., and Wang, L. (2022). The effects of virtual reality-assisted language learning: A meta-analysis. Sustainability, 14.","DOI":"10.3390\/su14063147"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Huang, X., Zou, D., Cheng, G., and Xie, H. (2021). A systematic review of AR and VR enhanced language learning. Sustainability, 13.","DOI":"10.3390\/su13094639"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Harris, C., and Sun, B. (2022). Assessing the effect of interactivity design in VR based second language learning tool. Proceedings of the 2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), IEEE.","DOI":"10.1109\/ISMAR55827.2022.00015"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yigitbas, E., Schmidt, M., Bucchiarone, A., Bassanelli, S., and Engels, G. (2024). Gamification-and virtual reality-based learning environment for UML class diagram modeling. Proceedings of the 2024 IEEE Global Engineering Education Conference (EDUCON), IEEE.","DOI":"10.1109\/EDUCON60312.2024.10578774"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1177\/10711813241275080","article-title":"Barriers toward the implementation of extended reality (XR) technologies to support education and training in workforce development programs","volume":"Volume 68","author":"Upadhyay","year":"2024","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"e39989","DOI":"10.2196\/39989","article-title":"The effects of immersive virtual reality applications on enhancing the learning outcomes of undergraduate health care students: Systematic review with meta-synthesis","volume":"25","author":"Liu","year":"2023","journal-title":"J. Med. Internet Res."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Odunga, J.O., Musuva, P.M., and Ndiege, J.R.A. (2025). Exploring Emerging Technologies for Inclusive Education in Students with Learning Disabilities: A Systematic Literature Review. Proceedings of the 2025 IST-Africa Conference (IST-Africa), IEEE.","DOI":"10.23919\/IST-Africa67297.2025.11060558"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chalkiadakis, A., Seremetaki, A., Kanellou, A., Kallishi, M., Morfopoulou, A., Moraitaki, M., and Mastrokoukou, S. (2024). Impact of artificial intelligence and virtual reality on educational inclusion: A systematic review of technologies supporting students with disabilities. Educ. Sci., 14.","DOI":"10.3390\/educsci14111223"},{"key":"ref_20","first-page":"1","article-title":"Reinforcing Inclusive Education with Virtual Reality: Strengthening Knowledge with the STEAM Approach for Students with Disabilities","volume":"28","year":"2025","journal-title":"CLEI Electron. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1358","DOI":"10.1111\/jir.13177","article-title":"Immersive virtual reality is more effective than non-immersive devices for developing real-world skills in people with intellectual disability","volume":"68","author":"Franze","year":"2024","journal-title":"J. Intellect. Disabil. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s10209-023-00969-0","article-title":"Inclusive AR\/VR: Accessibility barriers for immersive technologies","volume":"23","author":"Creed","year":"2024","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Moreno-Cruz, A., Mu\u00f1oz-Arteaga, J., Ponce-Gallegos, J.C., and Guti\u00e9rrez-Vela, F.L. (2025). Agile Production of Inclusive Learning Environments with Virtual Reality to Support Bachelor Students with Disabilities. IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, IEEE.","DOI":"10.1109\/RITA.2025.3601613"},{"key":"ref_24","first-page":"1715885","article-title":"Inclusive education beyond formal settings: AR and VR as accessibility strategies for deaf and hard-of-hearing individuals","volume":"Volume 10","year":"2025","journal-title":"Frontiers in Education"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ubur, S.D. (2024). [DC] Enhancing Accessibility and Emotional Expression in Educational Extended Reality for Deaf and Hard of Hearing: A User-Centric Investigation. Proceedings of the 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE.","DOI":"10.1109\/VRW62533.2024.00362"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"El Ghoul, O., and Othman, A. (2022). Virtual reality for educating Sign Language using signing avatar: The future of creative learning for deaf students. Proceedings of the 2022 IEEE Global Engineering Education Conference (EDUCON), IEEE.","DOI":"10.1109\/EDUCON52537.2022.9766692"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"57","DOI":"10.3390\/virtualworlds4040057","article-title":"Accessible American Sign Language Learning in Virtual Reality via Inverse Kinematics","volume":"Volume 4","author":"Immanuel","year":"2025","journal-title":"Virtual Worlds"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wen, H., Xu, Y., Li, L., Ru, X., Wu, Z., Fu, Y., Zheng, X., and Wang, X. (2024). Enhancing Sign Language Teaching: A Mixed Reality Approach for Immersive Learning and Multi-Dimensional Feedback. Proceedings of the 2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE.","DOI":"10.1109\/SMC54092.2024.10831092"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bisio, A., Yeguas-Bol\u00edvar, E., Aparicio-Mart\u00ednez, P., Redel-Mac\u00edas, M.D., Pinzi, S., Rossi, S., and Taborri, J. (2023). Training program on sign language: Social inclusion through Virtual Reality in ISENSE project. Proceedings of the 2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), IEEE.","DOI":"10.1109\/MetroXRAINE58569.2023.10405777"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1111\/cdep.12073","article-title":"Staying Engaged: Knowledge and Research Needs in Student Engagement","volume":"8","author":"Wang","year":"2014","journal-title":"Child Dev. Perspect."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Fredricks, J.A., and McColskey, M.T. (2012). The measurement of student engagement: A comparative analysis of various methods and student self-report instruments. Handbook of Research on Student Engagement, Springer.","DOI":"10.1007\/978-1-4614-2018-7_37"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lin, X.P., Li, B.B., Yao, Z.N., Yang, Z., and Zhang, M. (2024). The impact of virtual reality on student engagement in the classroom: A critical review. Front. Psychol., 15.","DOI":"10.3389\/fpsyg.2024.1360574"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ai, D., Xiao, J., Xing, L., Li, T., Yang, G., and Fang, G. (2025). Virtual Reality Technology in Education: Dynamic Analysis of Student Engagement and Cognitive Load. Proceedings of the 2025 International Conference on Distance Education and Learning (ICDEL), IEEE.","DOI":"10.1109\/ICDEL65868.2025.11193491"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sol\u00e9-Beteta, X., Navarro, J., Gaj\u0161ek, B., Guadagni, A., and Zaballos, A. (2022). A data-driven approach to quantify and measure students\u2019 engagement in synchronous virtual learning environments. Sensors, 22.","DOI":"10.3390\/s22093294"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Winter, M., Mordel, J., Mendzheritskaya, J., Biedermann, D., Ciordas-Hertel, G.P., Hahnel, C., Bengs, D., Wolter, I., Goldhammer, F., and Drachsler, H. (2024). Behavioral trace data in an online learning environment as indicators of learning engagement in university students. Front. Psychol., 15.","DOI":"10.3389\/fpsyg.2024.1396881"},{"key":"ref_36","unstructured":"Bozkir, E., \u00d6zdel, S., Wang, M., David-John, B., Gao, H., Butler, K., Jain, E., and Kasneci, E. (2023). Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"40","DOI":"10.16910\/jemr.13.6.1","article-title":"Fixation duration and the learning process: An eye tracking study with subtitled videos","volume":"13","author":"Negi","year":"2020","journal-title":"J. Eye Mov. Res."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Bagher, M.M., Sajjadi, P., Wallgr\u00fcn, J.O., La Femina, P.C., and Klippel, A. (2021). Move the object or move the user: The role of interaction techniques on embodied learning in VR. Front. Virtual Real., 2.","DOI":"10.3389\/frvir.2021.695312"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mo, C.Y., Wang, C., Dai, J., and Jin, P. (2022). Video playback speed influence on learning effect from the perspective of personalized adaptive learning: A study based on cognitive load theory. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.839982"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"100806","DOI":"10.1016\/j.iheduc.2021.100806","article-title":"Video learning analytics: Investigating behavioral patterns and learner clusters in video-based online learning","volume":"50","author":"Yoon","year":"2021","journal-title":"Internet High. Educ."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"251","DOI":"10.18608\/hla17.022","article-title":"Analytics of learner video use","volume":"1","author":"Mirriahi","year":"2017","journal-title":"Handb. Learn. Anal."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Wang, H., and Shi, B.E. (2024). User Engagement Correlates Better with Behavioral than Physiological Measures in a Virtual Reality Robotic Rehabilitation System. Proceedings of the 2024 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE.","DOI":"10.1109\/SMC54092.2024.10831286"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Gorin, H., Patel, J., Qiu, Q., Merians, A., Adamovich, S., and Fluet, G. (2024). A review of the use of gaze and pupil metrics to assess mental workload in gamified and simulated sensorimotor tasks. Sensors, 24.","DOI":"10.3390\/s24061759"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Haar, S., Sundar, G., and Faisal, A.A. (2021). Embodied Virtual Reality for the Study of Real-World Motor Learning. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0245717"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"101721","DOI":"10.1016\/j.psychsport.2020.101721","article-title":"The Effect of a Virtual Reality Environment on Gaze Behaviour and Motor Skill Learning","volume":"50","author":"Harris","year":"2020","journal-title":"Psychol. Sport Exerc."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Lehrman, A.L. (2025). Embodied Learning Through Immersive Virtual Reality: Theoretical Perspectives for Art and Design Education. Behav. Sci., 15.","DOI":"10.3390\/bs15070917"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Dastmalchi, M.R., and Goli, A. (2024). Embodied learning in virtual reality: Comparing direct and indirect interaction effects on educational outcomes. Proceedings of the 2024 IEEE Frontiers in Education Conference (FIE), IEEE.","DOI":"10.1109\/FIE61694.2024.10892964"},{"key":"ref_48","unstructured":"Higgins, P., Barron, R., and Matuszek, C. (2022, January 7\u201310). Head pose as a proxy for gaze in virtual reality. Proceedings of the 5th International Workshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI), Online."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Prakash, A., and Rajendran, R. (2025). Decoding Learner Behavior in Virtual Reality Education: Insights from Epistemic Network Analysis and Differential Sequence Mining. IEEE Transactions on Visualization and Computer Graphics, IEEE.","DOI":"10.1109\/TVCG.2025.3549899"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"104681","DOI":"10.1016\/j.compedu.2022.104681","article-title":"A review study on eye-tracking technology usage in immersive virtual reality learning environments","volume":"196","author":"Shadiev","year":"2023","journal-title":"Comput. Educ."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/3\/23\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T13:23:28Z","timestamp":1772457808000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/3\/23"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,2]]},"references-count":50,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["mti10030023"],"URL":"https:\/\/doi.org\/10.3390\/mti10030023","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,2]]}}}