{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T00:58:10Z","timestamp":1772499490325,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T00:00:00Z","timestamp":1764806400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005713","name":"Technical University of Munich","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005713","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Virtual Worlds"],"abstract":"<jats:p>Along with the rapid advancement of Virtual Reality (VR) and the metaverse, interest in this technology has surged among game developers and in fields such as education and healthcare. VR has enabled the rise in immersive, gamified activities, whether for rehabilitation, therapy, or learning. Additionally, VR and Motion Capture (MoCap) have allowed developers to create further accessibility features for end-users with special needs. However, the excitement of using new technology often does not align with the end user\u2019s use cases. The over-reliance on cutting-edge hardware can negatively impact most end users who lack access to such expensive tools. To this end, we conducted an inclusivity-focused study that enables learners to practice ASL in an immersive and engaging way using only head- and controller-based tracking. Our approach replaces full-body MoCap with Inverse Kinematics (IK) and simple controller mappings for upper-body pose and hand-gesture recognition, providing a low-cost, reproducible alternative to costly setups.<\/jats:p>","DOI":"10.3390\/virtualworlds4040057","type":"journal-article","created":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T16:37:02Z","timestamp":1764952622000},"page":"57","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Accessible American Sign Language Learning in Virtual Reality via Inverse Kinematics"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-2021-846X","authenticated-orcid":false,"given":"Jeremy","family":"Immanuel","sequence":"first","affiliation":[{"name":"Chair of Software Engineering, Technical University of Munich, 74076 Heilbronn, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5559-2056","authenticated-orcid":false,"given":"Santiago","family":"Berrezueta-Guzman","sequence":"additional","affiliation":[{"name":"Chair of Software Engineering, Technical University of Munich, 74076 Heilbronn, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,4]]},"reference":[{"key":"ref_1","unstructured":"Liddell, S.K. (2021). American Sign Language Syntax, Walter de Gruyter GmbH & Co. KG."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Neidle, C., and Nash, J.C.P. (2015). American sign language. Sign Languages of the World: A Comparative Handbook, Walter de Gruyter GmbH & Co. KG.","DOI":"10.1515\/9781614518174-007"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1017\/CBO9781107280298.002","article-title":"Sign languages in the world","volume":"1","author":"Fenlon","year":"2015","journal-title":"Socioling. Deaf Communities"},{"key":"ref_4","unstructured":"World Health Organization (2021). World Report on Hearing, World Health Organization."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Newport, E.L., and Meier, R.P. (2017). The acquisition of American sign language. The Crosslinguistic Study of Language Acquisition, Psychology Press.","DOI":"10.4324\/9781315802541-12"},{"key":"ref_6","unstructured":"Modern Language Association (2021). Enrollments in Languages Other Than English in United States Institutions of Higher Education, Fall 2021, Modern Language Association. Report."},{"key":"ref_7","first-page":"13","article-title":"Facilitating Exposure to Sign Languages of the World: The Case for Mobile Assisted Language Learning","volume":"13","author":"Parton","year":"2014","journal-title":"J. Inf. Technol. Educ. Innov. Pract."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1691","DOI":"10.1007\/s11423-024-10351-3","article-title":"Virtual reality and gamification in education: A systematic review","volume":"72","author":"Lampropoulos","year":"2024","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1089\/g4h.2022.0130","article-title":"The effect of a virtual reality-mediated gamified rehabilitation program on pain, disability, function, and balance in knee osteoarthritis: A prospective randomized controlled study","volume":"12","author":"Tuna","year":"2023","journal-title":"Games Health J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"El Ghoul, O., and Othman, A. (2022, January 28\u201331). Virtual reality for educating Sign Language using signing avatar: The future of creative learning for deaf students. Proceedings of the 2022 IEEE Global Engineering Education Conference (EDUCON), Tunis, Tunisia.","DOI":"10.1109\/EDUCON52537.2022.9766692"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"6657","DOI":"10.1080\/10494820.2023.2277746","article-title":"Sign language in immersive virtual reality: Design, development, and evaluation of a virtual reality learning environment prototype","volume":"32","author":"Kasapakis","year":"2024","journal-title":"Interact. Learn. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Quandt, L. (2020, January 26\u201328). Teaching ASL signs using signing avatars and immersive learning in virtual reality. Proceedings of the 22nd international ACM SIGACCESS Conference on Computers and Accessibility, Virtual Event.","DOI":"10.1145\/3373625.3418042"},{"key":"ref_13","unstructured":"Jedli\u010dka, P., Kr\u0148oul, Z., Kanis, J., and \u017delezn\u1ef3, M. (2020, January 11\u201316). Sign language motion capture dataset for data-driven synthesis. Proceedings of the LREC2020 9th Workshop on the Representation and Processing of Sign Languages: Sign Language Resources in the Service of the Language Community, Technological Challenges and Application Perspectives, Marseille, France."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"38548","DOI":"10.1109\/ACCESS.2025.3544022","article-title":"Serious Games supported by Virtual Reality-Literature Review","volume":"13","author":"Damianova","year":"2025","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/j.jss.2007.02.020","article-title":"Navigating towards improved surgical safety using aviation-based strategies","volume":"145","author":"Kao","year":"2008","journal-title":"J. Surg. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Berrezueta-Guzman, S., Chen, W., and Wagner, S. (2025, January 27\u201329). A Therapeutic Role-Playing VR Game for Children with Intellectual Disabilities. Proceedings of the 2025 International Conference on Metaverse Computing, Networking and Applications (MetaCom), Seoul, Republic of Korea.","DOI":"10.1109\/MetaCom65502.2025.00066"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.morpho.2020.08.004","article-title":"Learning anatomy by virtual reality and augmented reality. A scope review","volume":"104","author":"Duarte","year":"2020","journal-title":"Morphologie"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Debailleux, L., Hismans, G., and Duroisin, N. (2017, January 23\u201325). Exploring cultural heritage using virtual reality. Proceedings of the Digital Cultural Heritage: Final Conference of the Marie Sk\u0142odowska-Curie Initial Training Network for Digital Cultural Heritage, ITN-DCH 2017, Olimje, Slovenia. Revised Selected Papers.","DOI":"10.1007\/978-3-319-75826-8_24"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1080\/10494820.2020.1765392","article-title":"Virtual reality in language learning: A systematic review and implications for research and practice","volume":"31","author":"Parmaxi","year":"2023","journal-title":"Interact. Learn. Environ."},{"key":"ref_20","unstructured":"Alam, M.S., De Bastion, M., Malzkuhn, M., and Quandt, L.C. (2023, January 10). Recognizing highly variable American Sign Language in virtual reality. Proceedings of the 8th International Workshop on Sign Language Translation and Avatar Technology (SLTAT), Rhodes, Greece."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Alam, M.S., Lamberton, J., Wang, J., Leannah, C., Miller, S., Palagano, J., de Bastion, M., Smith, H.L., Malzkuhn, M., and Quandt, L.C. (2023). ASL Champ!: A Virtual Reality Game with Deep-Learning Driven Sign Recognition. arXiv.","DOI":"10.1016\/j.cexr.2024.100059"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3432211","article-title":"Teaching american sign language in mixed reality","volume":"4","author":"Shao","year":"2020","journal-title":"Proc. ACM Interac. Mob. Wearable Ubiquitous Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Vaitkevi\u010dius, A., Taroza, M., Bla\u017eauskas, T., Dama\u0161evi\u010dius, R., Maskeli\u016bnas, R., and Wo\u017aniak, M. (2019). Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion. Appl. Sci., 9.","DOI":"10.3390\/app9030445"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1109\/THMS.2022.3219242","article-title":"Vision-Based Human Pose Estimation via Deep Learning: A Survey","volume":"53","author":"Lan","year":"2023","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, V., Gao, C., Hoffmann, H., and Ahuja, K. (2024, January 13\u201316). MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices. Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, Pittsburgh, PA, USA. UIST \u201924.","DOI":"10.1145\/3654777.3676461"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, B., Jing, L., and Li, X. (2025). Inverse Kinematics-Augmented Sign Language: A Simulation-Based Framework for Scalable Deep Gesture Recognition. Algorithms, 18.","DOI":"10.3390\/a18080463"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s00530-013-0332-2","article-title":"Rule-based approach to recognizing human body poses and gestures in real time","volume":"20","author":"Hachaj","year":"2013","journal-title":"Multimed. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lazarou, M., Li, B., and Stathaki, T. (2021). A novel shape matching descriptor for real-time hand gesture recognition. arXiv.","DOI":"10.1016\/j.cviu.2021.103241"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yun, H., Ponton, J.L., Andujar, C., and Pelechano, N. (2023, January 25\u201329). Animation fidelity in self-avatars: Impact on user performance and sense of agency. Proceedings of the 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR), Shanghai, China.","DOI":"10.1109\/VR55154.2023.00044"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Borzelli, D., Boarini, V., and Casile, A. (2025). A quantitative assessment of the hand kinematic features estimated by the Oculus Quest 2. Sci. Rep., 15.","DOI":"10.1038\/s41598-025-91552-5"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Berrezueta-Guzman, S., Daya, R., and Wagner, S. (2025). Virtual Reality in Sign Language Education: Opportunities, Challenges, and the Road Ahead. Front. Virtual Real., 6.","DOI":"10.3389\/frvir.2025.1625910"},{"key":"ref_32","unstructured":"Parger, M., Mueller, J.H., Schmalstieg, D., and Steinberger, M. (December, January 28). Human Upper-Body Inverse Kinematics for Increased Embodiment in Consumer-Grade Virtual Reality. Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology, Tokyo, Japan. VRST \u201918."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103268","DOI":"10.1016\/j.displa.2025.103268","article-title":"Pushing the boundaries of immersion and storytelling: A technical review of Unreal Engine","volume":"91","author":"Sobchyshak","year":"2026","journal-title":"Displays"},{"key":"ref_34","unstructured":"Mehmedova, E., Berrezueta-Guzman, S., and Wagner, S. (2025). Virtual Reality User Interface Design: Best Practices and Implementation. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1007\/s11423-023-10337-7","article-title":"Gamification enhances student intrinsic motivation, perceptions of autonomy and relatedness, but minimal impact on competency: A meta-analysis and systematic review","volume":"72","author":"Li","year":"2024","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"100322","DOI":"10.1016\/j.edurev.2020.100322","article-title":"Does gamification improve student learning outcome? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts","volume":"30","author":"Bai","year":"2020","journal-title":"Educ. Res. Rev."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Jaramillo-Mediavilla, L., Basantes-Andrade, A., Cabezas-Gonz\u00e1lez, M., and Casillas-Mart\u00edn, S. (2024). Impact of Gamification on Motivation and Academic Performance: A Systematic Review. Educ. Sci., 14.","DOI":"10.3390\/educsci14060639"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, M., Ma, S., and Shi, Y. (2023). Examining the effectiveness of gamification as a tool promoting teaching and learning in educational settings: A meta-analysis. Front. Psychol., 14.","DOI":"10.3389\/fpsyg.2023.1253549"}],"container-title":["Virtual Worlds"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2813-2084\/4\/4\/57\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T05:26:32Z","timestamp":1764998792000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2813-2084\/4\/4\/57"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,4]]},"references-count":38,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["virtualworlds4040057"],"URL":"https:\/\/doi.org\/10.3390\/virtualworlds4040057","relation":{},"ISSN":["2813-2084"],"issn-type":[{"value":"2813-2084","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,4]]}}}