{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T09:52:11Z","timestamp":1775901131777,"version":"3.50.1"},"reference-count":90,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T00:00:00Z","timestamp":1743465600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,4,1]],"date-time":"2025-04-01T00:00:00Z","timestamp":1743465600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Johann Wolfgang Goethe-Universit\u00e4t, Frankfurt am Main"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Tech Know Learn"],"published-print":{"date-parts":[[2026,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    This article examines the predictability of communication scenarios within the context of simulation-based learning in\n                    <jats:italic>virtual reality<\/jats:italic>\n                    (VR). The aim is to investigate multimodal patterns of social interaction that accompany human communication in conflict situations. Understanding these patterns can ultimately enhance educational technologies\u2019 ability to address problematic learning situations and support learners in benefiting from VR-based learning. To achieve this, the system must accurately predict the task context. A central goal of this article is to shed light on this potential. Additionally, our research extends to visual communication beyond purely linguistic interactions, aiming to enhance VR immersion in communicative practices. To this end, the article examines the associations between multimodal information units generated by individuals interacting in three distinct learning scenarios: work organization, school pedagogy, and social life. Several experiments demonstrate that predictability exists when multimodal communication is analyzed at the level of eight coarse-grained modalities, including speech, head and body movements, and gestures. The interactions are observed in VR using\n                    <jats:sc>Va.Si.Li-Lab<\/jats:sc>\n                    , a simulation-based system that virtualizes learning scenarios, enabling participants to collaboratively manage potentially conflicting tasks through multimodal communication (Mehler et al. in: Duffy (ed) Digital human modeling and applications in health, safety, ergonomics and risk management, Springer Nature Switzerland, Cham, 2023). The article discusses the technology underlying\n                    <jats:sc>Va.Si.Li-Lab<\/jats:sc>\n                    , its database, and the post-processing of interaction data, including speech data. It provides theoretical motivation for the application scenarios and presents experimental data to illustrate the system\u2019s usefulness. Based on these data, the article details experiments on the multimodal detection of social scenarios, positioning\n                    <jats:sc>Va.Si.Li-Lab<\/jats:sc>\n                    as a use case in simulation-based learning.\n                  <\/jats:p>","DOI":"10.1007\/s10758-025-09837-7","type":"journal-article","created":{"date-parts":[[2025,4,3]],"date-time":"2025-04-03T16:45:05Z","timestamp":1743698705000},"page":"11-50","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Simulation-Based Learning in Virtual Reality: Three Use Cases from Social Science and Technological Foundations in Terms of Va.Si.Li-Lab"],"prefix":"10.1007","volume":"31","author":[{"given":"Mevl\u00fct","family":"Bagci","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2567-7539","authenticated-orcid":false,"given":"Alexander","family":"Mehler","sequence":"additional","affiliation":[]},{"given":"Giuseppe","family":"Abrami","sequence":"additional","affiliation":[]},{"given":"Patrick","family":"Schrottenbacher","sequence":"additional","affiliation":[]},{"given":"Christian","family":"Spiekermann","sequence":"additional","affiliation":[]},{"given":"Maxim","family":"Konca","sequence":"additional","affiliation":[]},{"given":"Jakob","family":"Schreiber","sequence":"additional","affiliation":[]},{"given":"Kevin","family":"Saukel","sequence":"additional","affiliation":[]},{"given":"Marc","family":"Quintino","sequence":"additional","affiliation":[]},{"given":"Juliane","family":"Engel","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,4,1]]},"reference":[{"key":"9837_CR1","doi-asserted-by":"crossref","unstructured":"Abrami, G., Mehler, A., Spiekermann, C., Kett, A., L\u00f6\u00f6ck, S., & Schwarz, L. (2020). 16. In L. Daniela, (Ed), Educational Technologies in the area of ubiquitous historical computing in virtual reality (pp. 240\u2013261). Taylor & Francis. Retrieved from https:\/\/www.taylorfrancis.com\/chapters\/edit\/10.4324\/9781003001874-16","DOI":"10.4324\/9781003001874-16"},{"key":"9837_CR2","doi-asserted-by":"publisher","unstructured":"Al Awadhi, S., Al Habib, N., Al-Murad, D., Al deei, F., Houti, M., & Beyrouthy, T., et al. (2018). Interactive virtual reality educational application. Advances in Science, Technology and Engineering Systems Journal,3(4), 72\u201382. https:\/\/doi.org\/10.25046\/aj030409","DOI":"10.25046\/aj030409"},{"issue":"22","key":"9837_CR3","doi-asserted-by":"publisher","first-page":"99","DOI":"10.3991\/ijim.v15i22.25003","volume":"15","author":"G Al Farsi","year":"2021","unstructured":"Al Farsi, G., AbM, Yusof, Romli, A., Tawafak, R. M., Malik, S. I., Jabbar, J., et al. (2021). A review of virtual reality applications in an educational domain. International Journal of Interactive Mobile Technologies (iJIM), 15(22), 99\u2013110. https:\/\/doi.org\/10.3991\/ijim.v15i22.25003","journal-title":"International Journal of Interactive Mobile Technologies (iJIM)"},{"key":"9837_CR4","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1515\/9783110224948.435","volume-title":"Handbook of technical communication","author":"J Allwood","year":"2012","unstructured":"Allwood, J., & Ahls\u00e9n, E. (2012). Multimodal communication. In A. Mehler, L. Romary, & D. Gibbon (Eds.), Handbook of technical communication (pp. 435\u2013460). De Gruyter."},{"issue":"1","key":"9837_CR5","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1080\/00986280802529079","volume":"36","author":"SC Baker","year":"2009","unstructured":"Baker, S. C., Wentz, R. K., & Woods, M. M. (2009). Using virtual worlds in education: Second Life\u00ae as an educational tool. Teaching of Psychology, 36(1), 59\u201364. https:\/\/doi.org\/10.1080\/00986280802529079","journal-title":"Teaching of Psychology"},{"issue":"1","key":"9837_CR6","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/lnc3.12170","volume":"10","author":"M Baroni","year":"2016","unstructured":"Baroni, M. (2016). Grounding distributional semantics in the visual world. Language and Linguistics Compass, 10(1), 3\u201313. https:\/\/doi.org\/10.1111\/lnc3.12170","journal-title":"Language and Linguistics Compass"},{"issue":"3","key":"9837_CR7","doi-asserted-by":"publisher","first-page":"17","DOI":"10.2478\/alfa-2022-0016","volume":"27","author":"L Benkovi\u010dov\u00e1","year":"2022","unstructured":"Benkovi\u010dov\u00e1, L. (2022). Linking virtual reality, architecture, and crime prevention for educational purposes. Architecture Papers of the Faculty of Architecture and Design STU, 27(3), 17\u201328. https:\/\/doi.org\/10.2478\/alfa-2022-0016","journal-title":"Architecture Papers of the Faculty of Architecture and Design STU"},{"key":"9837_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1613\/jair.4135","volume":"49","author":"E Bruni","year":"2014","unstructured":"Bruni, E., Tran, N. K., & Baroni, M. (2014). Multimodal distributional semantics. Journal of Artificial Intelligence Research, 49, 1\u201347. https:\/\/doi.org\/10.1613\/jair.4135","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9837_CR9","unstructured":"Butler, J. (2010). Excitable speech: A politics of the performative. Transferred to digital printing 2008 ed. Routledge."},{"key":"9837_CR10","doi-asserted-by":"publisher","DOI":"10.3389\/feduc.2022.965640","author":"E Campos","year":"2022","unstructured":"Campos, E., Hidrogo, I., & Zavala, G. (2022). Impact of virtual reality use on the teaching and learning of vectors. Frontiers in Education. https:\/\/doi.org\/10.3389\/feduc.2022.965640","journal-title":"Frontiers in Education"},{"key":"9837_CR11","doi-asserted-by":"publisher","DOI":"10.3389\/frvir.2022.995090","author":"Z Chang","year":"2022","unstructured":"Chang, Z., Bai, H., Zhang, L., Gupta, K., He, W., & Billinghurst, M. (2022). The impact of virtual agents\u2019 multimodal communication on brain activity and cognitive load in Virtual Reality. Frontiers in Virtual Reality. https:\/\/doi.org\/10.3389\/frvir.2022.995090","journal-title":"Frontiers in Virtual Reality"},{"issue":"4","key":"9837_CR12","doi-asserted-by":"publisher","first-page":"499","DOI":"10.3102\/0034654320933544","volume":"90","author":"O Chernikova","year":"2020","unstructured":"Chernikova, O., Heitzmann, N., Stadler, M., Holzberger, D., Seidel, T., & Fischer, F. (2020). Simulation-based learning in higher education: A meta-analysis. Review of Educational Research, 90(4), 499\u2013541. https:\/\/doi.org\/10.3102\/0034654320933544","journal-title":"Review of Educational Research"},{"key":"9837_CR13","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511620539","volume-title":"Using language","author":"HH Clark","year":"1996","unstructured":"Clark, H. H. (1996). Using language. Cambridge University Press."},{"key":"9837_CR14","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2020.00323","author":"S Clough","year":"2020","unstructured":"Clough, S., & Duff, M. C. (2020). The role of gesture in communication and cognition: Implications for understanding and treating neurogenic communication disorders. Frontiers in Human Neuroscience. https:\/\/doi.org\/10.3389\/fnhum.2020.00323","journal-title":"Frontiers in Human Neuroscience"},{"key":"9837_CR15","doi-asserted-by":"publisher","first-page":"857","DOI":"10.1007\/978-3-531-91095-6_35","volume-title":"Handbuch der Schulforschung","author":"A Combe","year":"2008","unstructured":"Combe, A., & Kolbe, F. U. (2008). Lehrerprofessionalit\u00e4t: Wissen, K\u00f6nnen, Handeln. In W. Helsper & J. B\u00f6hme (Eds.), Handbuch der Schulforschung (pp. 857\u2013875). VS Verlag f\u00fcr Sozialwissenschaften."},{"key":"9837_CR16","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511801389","volume-title":"Support Vector machines and other kernel-based learning methods","author":"N Cristianini","year":"2000","unstructured":"Cristianini, N., & Shaw-Taylor, J. (2000). Support Vector machines and other kernel-based learning methods. Cambridge University Press."},{"key":"9837_CR17","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1111\/bjet.13296","volume":"12","author":"CP Dai","year":"2022","unstructured":"Dai, C. P., Ke, F., Dai, Z., & Pachman, M. (2022). Improving teaching practices via virtual reality-supported simulation-based learning: Scenario design and the duration of implementation. British Journal of Educational Technology, 12, 54. https:\/\/doi.org\/10.1111\/bjet.13296","journal-title":"British Journal of Educational Technology"},{"key":"9837_CR18","doi-asserted-by":"publisher","DOI":"10.3390\/su12072698","author":"L Daniela","year":"2020","unstructured":"Daniela, L. (2020). Virtual museums as learning agents. Sustainability. https:\/\/doi.org\/10.3390\/su12072698","journal-title":"Sustainability"},{"key":"9837_CR19","doi-asserted-by":"publisher","DOI":"10.3390\/su10113883","author":"L Daniela","year":"2018","unstructured":"Daniela, L., Visvizi, A., Guti\u00e9rrez-Braojos, C., & Lytras, M. D. (2018). Sustainable higher education and technology-enhanced learning (TEL). Sustainability. https:\/\/doi.org\/10.3390\/su10113883","journal-title":"Sustainability"},{"issue":"1","key":"9837_CR20","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1177\/0888406416664184","volume":"40","author":"MR Dawson","year":"2017","unstructured":"Dawson, M. R., & Lignugaris, Kraft B. (2017). Meaningful practice: Generalizing foundation teaching skills from TLE TeachLivE\u2122to the classroom. Teacher Education and Special Education., 40(1), 26\u201350. https:\/\/doi.org\/10.1177\/0888406416664184","journal-title":"Teacher Education and Special Education."},{"key":"9837_CR21","doi-asserted-by":"publisher","unstructured":"Dengel, A., Auer, A., Urlbauer, P., & L\u00e4ufer, T. (2022). Game-based teaching of basic hardware components with an educational virtual reality at different levels of immersion. In Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education (Vol 1. pp. 138\u2013144). https:\/\/doi.org\/10.1145\/3502718.3524824","DOI":"10.1145\/3502718.3524824"},{"key":"9837_CR22","doi-asserted-by":"crossref","unstructured":"Devineau, G., Moutarde, F., Xi, W., & Yang, J. (2018). Deep learning for hand gesture recognition on skeletal data. In 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) (pp. 106\u2013113).","DOI":"10.1109\/FG.2018.00025"},{"key":"9837_CR23","unstructured":"Durette, P. N. (2023). gTTS: Google text-to-speech. Retrieved February 23, 2023, from https:\/\/github.com\/pndurette\/gTTS"},{"key":"9837_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijinfomgt.2022.102542","author":"YK Dwivedi","year":"2022","unstructured":"Dwivedi, Y. K., Hughes, L., Baabdullah, A. M., Ribeiro-Navarrete, S., Giannakis, M., Al-Debei, M. M., et al. (2022). Metaverse beyond the hype: Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. International Journal of Information Management. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2022.102542","journal-title":"International Journal of Information Management"},{"key":"9837_CR25","volume-title":"An introduction to systemic functional linguistics","author":"S Eggins","year":"1994","unstructured":"Eggins, S. (1994). An introduction to systemic functional linguistics. Continuum."},{"issue":"3","key":"9837_CR26","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1080\/17457823.2020.1738255","volume":"15","author":"J Engel","year":"2020","unstructured":"Engel, J., Beach, D., & J\u00f6rissen, B. (2020). Introduction: Cultural sedimentations - ethnography on the materiality and historicity of aesthetic practices. Ethnography and Education, 15(3), 267\u2013269. https:\/\/doi.org\/10.1080\/17457823.2020.1738255","journal-title":"Ethnography and Education"},{"key":"9837_CR27","doi-asserted-by":"publisher","first-page":"3076","DOI":"10.1007\/978-1-4419-1428-6_129","volume-title":"Encyclopedia of the sciences of learning","author":"C Frasson","year":"2012","unstructured":"Frasson, C., & Blanchard, E. G. (2012). Simulation-based learning. In N. M. Seel (Ed.), Encyclopedia of the sciences of learning (pp. 3076\u20133080). Springer."},{"key":"9837_CR28","doi-asserted-by":"crossref","unstructured":"Friston, S. J., Congdon, B. J., Swapp, D., Izzouzi, L., Brandst\u00e4tter, K., Archer, D., et\u00a0al. (2021). Ubiq: A system to build flexible social virtual reality experiences. In Y. Itoh, K. Takashima, P. Punpongsanon, M. Sra, K. Fujita, S. Yoshida, et\u00a0al., (Eds.), Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. VRST \u201921. New York (pp. 1\u201311). Association for Computing Machinery.","DOI":"10.1145\/3489849.3489871"},{"key":"9837_CR29","doi-asserted-by":"publisher","unstructured":"Fu, G., Jiang, Y., Xiao, J., Huang, P., Luo, X., Ni, M., et\u00a0al. (2024). Construction of virtual simulation teaching platform for risk experimental projects in VR environment. In Proceedings of the 2024 7th International Conference on Software Engineering and Information Management. ICSIM \u201924 (pp. 92\u201397). Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3647722.3647736","DOI":"10.1145\/3647722.3647736"},{"key":"9837_CR30","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2011.00011","author":"B Galantucci","year":"2011","unstructured":"Galantucci, B., & Garrod, S. (2011). Experimental semiotics: A review. Frontiers in Human Neuroscience. https:\/\/doi.org\/10.3389\/fnhum.2011.00011","journal-title":"Frontiers in Human Neuroscience"},{"key":"9837_CR31","doi-asserted-by":"publisher","unstructured":"Gemmell, C., Mackie, I., Owoicho, P., Rossetto, F., Fischer, S., & Dalton, J. (2022). GRILLBot: An assistant for real-world tasks with neural semantic parsing and graph-based representations. https:\/\/doi.org\/10.48550\/ARXIV.2208.14884.","DOI":"10.48550\/ARXIV.2208.14884."},{"issue":"3","key":"9837_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/BF03219572","volume":"21","author":"R Gilbert","year":"1994","unstructured":"Gilbert, R., & Low, P. (1994). Discourse and power in education: Analysing institutional processes in schools. Australian Educational Researcher, 21(3), 1\u201324.","journal-title":"Australian Educational Researcher"},{"issue":"1","key":"9837_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2307\/2095141","volume":"48","author":"E Goffman","year":"1983","unstructured":"Goffman, E. (1983). The interaction order: American Sociological Association, 1982 presidential address. American Sociological Review, 48(1), 1\u201317.","journal-title":"American Sociological Review"},{"key":"9837_CR34","volume-title":"Language, context, and text: Aspects of language in a socialsemiotic perspective","author":"MAK Halliday","year":"1989","unstructured":"Halliday, M. A. K., & Hasan, R. (1989). Language, context, and text: Aspects of language in a socialsemiotic perspective. Oxford University Press."},{"key":"9837_CR35","unstructured":"Helsper, W. (2016). Lehrerprofessionalit\u00e4t - der Strukturtheoretische Ansatz. In M. Rothland, (Ed.), Beruf Lehrer\/Lehrerin. utb Schulp\u00e4dagogik (pp. 103\u2013125). Waxmann and UTB."},{"key":"9837_CR36","unstructured":"Heyer, G., & Bordag, S. (2007) A structuralist framework for quantitative linguistics. In Aspects of Automatic Text Analysis Studies in Fuzziness and Soft Computing. Springer."},{"key":"9837_CR37","volume-title":"Prolegomena to a theory of language","author":"L Hjelmslev","year":"1969","unstructured":"Hjelmslev, L. (1969). Prolegomena to a theory of language. University of Wisconsin Press."},{"issue":"2","key":"9837_CR38","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1609\/aimag.v5i2.434","volume":"5","author":"JD Hollan","year":"1984","unstructured":"Hollan, J. D., Hutchins, E. L., & Weitzman, L. (1984). STEAMER: An interactive inspectable simulation-based training system. AI Magazine, 5(2), 15\u201315. https:\/\/doi.org\/10.1609\/aimag.v5i2.434","journal-title":"AI Magazine"},{"key":"9837_CR39","doi-asserted-by":"publisher","unstructured":"Immohr, F., Rendle, G., Neidhardt, A., G\u00f6ring, S., Ramachandra\u00a0Rao, R. R., Arevalo\u00a0Arboleda, S., et\u00a0al. (2023). Proof-of-concept study to evaluate the impact of spatial audio on social presence and user behavior in multi-modal VR communication. In Proceedings of the 2023 ACM International Conference on Interactive Media Experiences. IMX \u201923 (pp. 209\u2013215). Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3573381.3596458","DOI":"10.1145\/3573381.3596458"},{"issue":"6","key":"9837_CR40","doi-asserted-by":"publisher","first-page":"2544","DOI":"10.1111\/BJET.12936","volume":"51","author":"F Ke","year":"2020","unstructured":"Ke, F., & Xu, X. (2020). Virtual reality simulation-based learning of teaching with alternative perspectives taking. British Journal of Educational Technology, 51(6), 2544\u20132557. https:\/\/doi.org\/10.1111\/BJET.12936","journal-title":"British Journal of Educational Technology"},{"key":"9837_CR41","doi-asserted-by":"crossref","unstructured":"Kiela, D., Bulat, L., & Clark, S. (2015). Grounding semantics in olfactory perception. In C. Zong, & M. Strube, (Eds.), Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) (pp. 231\u2013236). Association for Computational Linguistics.","DOI":"10.3115\/v1\/P15-2038"},{"key":"9837_CR42","doi-asserted-by":"publisher","first-page":"1003","DOI":"10.1613\/jair.5665","volume":"60","author":"D Kiela","year":"2017","unstructured":"Kiela, D., & Clark, S. (2017). Learning neural audio embeddings for grounding semantics in auditory perception. Journal of Artificial Intelligence Research, 60, 1003\u20131030. https:\/\/doi.org\/10.1613\/jair.5665","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9837_CR43","doi-asserted-by":"publisher","DOI":"10.4324\/9780203970034","volume-title":"Multimodality: A social semiotic approach to contemporary communication","author":"G Kress","year":"2009","unstructured":"Kress, G. (2009). Multimodality: A social semiotic approach to contemporary communication. London: Routledge."},{"key":"9837_CR44","volume-title":"Language and reality","author":"S Lamb","year":"2004","unstructured":"Lamb, S. (2004). Language and reality. Continuum."},{"key":"9837_CR45","doi-asserted-by":"publisher","first-page":"136164","DOI":"10.1109\/ACCESS.2021.3115961","volume":"9","author":"XS Li","year":"2021","unstructured":"Li, X. S., Fan, Z. Z., Ren, Y. Y., Zheng, X. L., & Yang, R. (2021). Classification of eye movement and its application in driving based on a refined pre-processing and machine learning algorithm. IEEE Access, 9, 136164\u2013136181. https:\/\/doi.org\/10.1109\/ACCESS.2021.3115961","journal-title":"IEEE Access"},{"key":"9837_CR46","doi-asserted-by":"publisher","unstructured":"Lin, X., & Chen, Z. (2024). Knowledge transfer happen in virtual simulation experiment teaching: A factor study based on educational experiment. In Proceedings of the 2023 6th International Conference on Educational Technology Management. ICETM \u201923 (p. 137\u2013147). Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3637907.3637966","DOI":"10.1145\/3637907.3637966"},{"issue":"2","key":"9837_CR47","doi-asserted-by":"publisher","first-page":"622","DOI":"10.1111\/bjet.13268","volume":"54","author":"HC Lin","year":"2023","unstructured":"Lin, H. C., Hwang, G. J., Chou, K. R., & Tsai, C. K. (2023). Fostering complex professional skills with interactive simulation technology: A virtual reality-based flipped learning approach. British Journal of Educational Technology, 54(2), 622\u2013641. https:\/\/doi.org\/10.1111\/bjet.13268","journal-title":"British Journal of Educational Technology"},{"key":"9837_CR48","volume-title":"Unity virtual reality projects","author":"J Linowes","year":"2015","unstructured":"Linowes, J. (2015). Unity virtual reality projects. Packt Publishing Ltd."},{"key":"9837_CR49","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1057\/978-1-349-69568-3_4","volume-title":"The sociology of space: Materiality, social structures, and action","author":"M L\u00f6w","year":"2016","unstructured":"L\u00f6w, M. (2016). Toward a sociological concept of space. The sociology of space: Materiality, social structures, and action (pp. 105\u2013127). Palgrave Macmillan."},{"key":"9837_CR50","unstructured":"L\u00fccking, A., Mehler, A., & Menke, P. (2008). Taking fingerprints of speech-and-gesture ensembles: Approaching empirical evidence of intrapersonal alignment in multimodal communication. In J. Ginzburg, P. Healey, Y. Sato, (Eds.), LONDIAL 2008: Proceedings of the 12th Workshop on the Semantics and Pragmatics of Dialogue (SEMDIAL). King\u2019s College London (pp. 157\u2013164). Retrieved from https:\/\/pub.uni-bielefeld.de\/record\/1918903"},{"key":"9837_CR51","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1515\/9783110224948.591","volume-title":"Handbook of technical communication","author":"A L\u00fccking","year":"2012","unstructured":"L\u00fccking, A., & Pfeiffer, T. (2012). Framing multi-modal technical communication. With focal points in speech-gesture-integration and gaze recognition. In A. Mehler, L. Romary, & D. Gibbon (Eds.), Handbook of technical communication (pp. 591\u2013644). De Gruyter. https:\/\/doi.org\/10.1515\/9783110224948.591"},{"key":"9837_CR52","unstructured":"Luhmann, N., & Schorr, K. E. (1979) Das Technologiedefizit der Erziehung und die P\u00e4dagogik. Zeitschrift f\u00fcr P\u00e4dagogik, (pp. 345-365(25))."},{"key":"9837_CR53","doi-asserted-by":"publisher","unstructured":"Markic, S., & Abels, S. (2014). Heterogeneity and diversity: A growing challenge or enrichment for science education in German schools? EURASIA Journal of Mathematics, Science and Technology Education. https:\/\/doi.org\/10.12973\/eurasia.2014.1082a","DOI":"10.12973\/eurasia.2014.1082a"},{"key":"9837_CR54","doi-asserted-by":"publisher","DOI":"10.1145\/3508361","author":"D Martin","year":"2022","unstructured":"Martin, D., Malpica, S., Gutierrez, D., Masia, B., & Serrano, A. (2022). Multimodality in VR: A survey. ACM Computing Surveys. https:\/\/doi.org\/10.1145\/3508361","journal-title":"ACM Computing Surveys"},{"key":"9837_CR55","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s12369-013-0189-8","volume":"08","author":"R Mead","year":"2013","unstructured":"Mead, R., Atrash, A., & Matari\u0107, M. (2013). Automated proxemic feature extraction and behavior recognition: Applications in human\u2013robot interaction. International Journal of Social Robotics, 08, 5. https:\/\/doi.org\/10.1007\/s12369-013-0189-8","journal-title":"International Journal of Social Robotics"},{"key":"9837_CR56","doi-asserted-by":"crossref","unstructured":"Mehler, A., & L\u00fccking, A. (2009). A structural model of semiotic alignment: The classification of multimodal ensembles as a novel machine learning task. In Proceedings of IEEE Africon; 2009 (pp. 806\u2013812). Retrieved from https:\/\/www.texttechnologylab.org\/wp-content\/uploads\/2015\/08\/mehler_luecking_2009.pdf","DOI":"10.1109\/AFRCON.2009.5308098"},{"key":"9837_CR57","unstructured":"Mehler, A., & L\u00fccking, A. (2012). Pathways of Alignment between gesture and speech: Assessing information transmission in multimodal ensembles. In G. Giorgolo, K. & Alahverdzhieva (Eds.), Proceedings of the International Workshop on Formal and Computational Approaches to Multimodal Communication under the auspices of ESSLLI 2012 (pp. 10). Retrieved from https:\/\/www.texttechnologylab.org\/wp-content\/uploads\/2016\/06\/Mehler_Luecking_FoCoMC2012-2.pdf"},{"key":"9837_CR58","doi-asserted-by":"publisher","unstructured":"Mehler, A., Abrami, G., Spiekermann, C., Jostock, M. (2018). VAnnotatoR: A framework for generating multimodal hypertexts. In J. Rubart, (Ed.), Proceedings of the 29th ACM Conference on Hypertext and Social Media. HT \u201918 (pp. 150\u2013154). ACM, New York, NY, USA. https:\/\/doi.org\/10.1145\/3209542.3209572","DOI":"10.1145\/3209542.3209572"},{"key":"9837_CR59","doi-asserted-by":"crossref","unstructured":"Mehler, A., Geibel, P., & Pustylnikov, O. (2007). Structural classifiers of text types: Towards a novel model of text representation. Journal for Language Technology and Computational Linguistics (JLCL),22(2), 51\u201366. Retrieved from https:\/\/www.texttechnologylab.org\/wp-content\/uploads\/2015\/08\/mehler_geibel_pustylnikov_2007.pdf","DOI":"10.21248\/jlcl.22.2007.95"},{"key":"9837_CR60","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1007\/978-3-031-35741-1_39","volume-title":"Digital human modeling and applications in health, safety, ergonomics and risk management","author":"A Mehler","year":"2023","unstructured":"Mehler, A., Bagci, M., Henlein, A., Abrami, G., Spiekermann, C., Schrottenbacher, P., et al. (2023). A multimodal data model for simulation-based learning with Va.Si.Li-Lab. In V. G. Duffy (Ed.), Digital human modeling and applications in health, safety, ergonomics and risk management (pp. 539\u2013565). Springer Nature Switzerland. https:\/\/doi.org\/10.1007\/978-3-031-35741-1_39"},{"key":"9837_CR61","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-014-0386-8","author":"A Mehler","year":"2014","unstructured":"Mehler, A., L\u00fccking, A., & Abrami, G. (2014). WikiNect: Image schemata as a basis of gestural writing for kinetic museum wikis. Universal Access in the Information Society. https:\/\/doi.org\/10.1007\/s10209-014-0386-8","journal-title":"Universal Access in the Information Society"},{"key":"9837_CR62","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3253388","author":"A Meloni","year":"2023","unstructured":"Meloni, A., Angioni, S., Salatino, A., Osborne, F., Recupero, D. R., & Motta, E. (2023). Integrating conversational agents and knowledge graphs within the scholarly domain. IEEE Access. https:\/\/doi.org\/10.1109\/ACCESS.2023.3253388","journal-title":"IEEE Access"},{"key":"9837_CR63","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.compedu.2013.07.033","volume":"70","author":"Z Merchant","year":"2014","unstructured":"Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students\u2019 learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29\u201340. https:\/\/doi.org\/10.1016\/j.compedu.2013.07.033","journal-title":"Computers & Education"},{"key":"9837_CR64","unstructured":"OpenAI.: OpenAI API. Retrieved April 14, 2024, from https:\/\/platform.openai.com\/docs\/api-reference\/completions"},{"issue":"5","key":"9837_CR65","doi-asserted-by":"publisher","first-page":"3671","DOI":"10.1007\/s10586-022-03601-7","volume":"25","author":"N Ouerhani","year":"2022","unstructured":"Ouerhani, N., Maalel, A., & Gh\u00e9zala, H. B. (2022). SMAD: SMart assistant during and after a medical emergency case based on deep learning sentiment analysis. Cluster Computing, 25(5), 3671\u20133681. https:\/\/doi.org\/10.1007\/s10586-022-03601-7","journal-title":"Cluster Computing"},{"key":"9837_CR66","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2022.103787","volume":"77","author":"M \u00d6zdemir","year":"2022","unstructured":"\u00d6zdemir, M., Kisa, D. H., Guren, O., & Akan, A. (2022). Hand gesture classification using time-frequency images and transfer learning based on CNN. Biomedical Signal Processing and Control, 77, 103787. https:\/\/doi.org\/10.1016\/j.bspc.2022.103787","journal-title":"Biomedical Signal Processing and Control"},{"issue":"4","key":"9837_CR67","doi-asserted-by":"publisher","first-page":"748","DOI":"10.1109\/TLT.2020.3019405","volume":"13","author":"N Pellas","year":"2020","unstructured":"Pellas, N., Dengel, A., & Christopoulos, A. (2020). A scoping review of immersive virtual reality in STEM education. IEEE Transactions on Learning Technologies, 13(4), 748\u2013761. https:\/\/doi.org\/10.1109\/TLT.2020.3019405","journal-title":"IEEE Transactions on Learning Technologies"},{"key":"9837_CR68","doi-asserted-by":"publisher","unstructured":"Pettersson, J., & Falkman, P. (2020). Human movement direction classification using virtual reality and eye tracking. Procedia Manufacturing,51, 95\u2013102. In 30th International Conference on Flexible Automation and Intelligent Manufacturing (FAIM2021). https:\/\/doi.org\/10.1016\/j.promfg.2020.10.015","DOI":"10.1016\/j.promfg.2020.10.015"},{"key":"9837_CR69","doi-asserted-by":"publisher","unstructured":"Pinter, L., Izquierdo, M., & Siddiqui, M. F. H. (2023). Revolutionizing learning: An interactive vr application for solids of revolution. In Proceedings of the 7th International Conference on Education and Multimedia Technology. ICEMT \u201923 (pp. 35\u201340). Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3625704.3625742","DOI":"10.1145\/3625704.3625742"},{"key":"9837_CR70","doi-asserted-by":"crossref","unstructured":"Pirker, J., Lesjak, I., Guetl, C., Maroon, V. R. (2017). A room-scale physics laboratory experience. In M. Chang, N. Chen, R. Huang, Kinshuk, D. G. Sampson, R. Vasiu, (Eds.), 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT) (pp. 482\u2013484).","DOI":"10.1109\/ICALT.2017.92"},{"key":"9837_CR71","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1016\/j.compedu.2016.02.002","volume":"95","author":"V Potkonjak","year":"2016","unstructured":"Potkonjak, V., Gardner, M., Callaghan, V., Mattila, P., Guetl, C., Petrovi\u0107, V. M., et al. (2016). Virtual laboratories for education in science, technology, and engineering. Computers & Education, 95, 309\u2013327. https:\/\/doi.org\/10.1016\/j.compedu.2016.02.002","journal-title":"Computers & Education"},{"key":"9837_CR72","unstructured":"Radford, A., Kim, J. W., Xu, T., Brockman, G., McLeavey, C., & Sutskever, I. (2023). Robust speech recognition via large-scale weak supervision. In Proceedings of the 40th International Conference on Machine Learning. ICML\u201923. JMLR.org; (pp. 28492\u201328518)."},{"key":"9837_CR73","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00899","author":"V Raimondi","year":"2014","unstructured":"Raimondi, V. (2014). Social interaction, languaging and the operational conditions for the emergence of observing. Frontiers in Psychology. https:\/\/doi.org\/10.3389\/fpsyg.2014.00899","journal-title":"Frontiers in Psychology"},{"key":"9837_CR74","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2023.1240790","author":"F Richlan","year":"2023","unstructured":"Richlan, F., Wei\u00df, M., Kastner, P., & Braid, J. (2023). Virtual training, real effects: A narrative review on sports performance enhancement through interventions in virtual reality. Frontiers in Psychology. https:\/\/doi.org\/10.3389\/fpsyg.2023.1240790","journal-title":"Frontiers in Psychology"},{"key":"9837_CR75","unstructured":"Robert, J. (2023). Pydub. github. . Retrieved February 03, 2023, from https:\/\/github.com\/jiaaro\/pydub"},{"issue":"5","key":"9837_CR76","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.1111\/bjet.12993","volume":"51","author":"K Sharma","year":"2020","unstructured":"Sharma, K., & Giannakos, M. (2020). Multimodal data capabilities for learning: What can multimodal data tell us about learning? British Journal of Educational Technology, 51(5), 1450\u20131484. https:\/\/doi.org\/10.1111\/bjet.12993","journal-title":"British Journal of Educational Technology"},{"key":"9837_CR77","doi-asserted-by":"crossref","unstructured":"Song X, Salcianu, A., Song, Y., Dopson, D., Zhou, D. (2021). Fast wordpiece tokenization. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Online and Punta Cana, Dominican Republic: Association for Computational Linguistics (pp. 2089\u20132103). Retrieved from https:\/\/aclanthology.org\/2021.emnlp-main.160","DOI":"10.18653\/v1\/2021.emnlp-main.160"},{"key":"9837_CR78","doi-asserted-by":"publisher","unstructured":"Souza, V. C., Maciel, A., Nedel, L. P., Kopper, R., Loges, K., & Schlemmer, E. (2020). The effect of virtual reality on knowledge transfer and retention in collaborative group-based learning for neuroanatomy students. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR) (pp. 92\u2013101). https:\/\/doi.org\/10.1109\/SVR51698.2020.00028","DOI":"10.1109\/SVR51698.2020.00028"},{"key":"9837_CR79","unstructured":"Spiekermann, C., Abrami, G., & Mehler, A. (2018). VAnnotatoR: A Gesture-driven annotation framework for linguistic and multimodal annotation. In J. Pustejovsky, & I. van\u00a0der Sluis, (Eds.) Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). AREA. Paris, France: European Language Resources Association (ELRA) (pp. 1\u20135). Retrieved from https:\/\/www.texttechnologylab.org\/wp-content\/uploads\/2018\/03\/VAnnotatoR.pdf"},{"issue":"1","key":"9837_CR80","first-page":"9","volume":"9","author":"C Stark","year":"2010","unstructured":"Stark, C. (2010). The neoliberal ideology and the challenges for social work ethics and practice. Revista de Asisten\u0163\u0103 Social\u0103, 9(1), 9\u201319.","journal-title":"Revista de Asisten\u0163\u0103 Social\u0103"},{"issue":"4","key":"9837_CR81","doi-asserted-by":"publisher","DOI":"10.2196\/36725","volume":"11","author":"HV Stenseth","year":"2022","unstructured":"Stenseth, H. V., Steindal, S. A., Solberg, M. T., \u00d8lnes, M. A., Mohallem, A., S\u00f8rensen, A. L., et al. (2022). Simulation-based learning supported by technology to enhance critical thinking in nursing students: Protocol for a scoping review. JMIR Research Protocols, 11(4), e36725. https:\/\/doi.org\/10.2196\/36725","journal-title":"JMIR Research Protocols"},{"key":"9837_CR82","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1613\/jair.2934","volume":"37","author":"PD Turney","year":"2010","unstructured":"Turney, P. D., & Pantel, P. (2010). From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research, 37, 141\u2013188.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"9837_CR83","unstructured":"Wagner-Willi, M., & Sturm, T, (Eds) (2018). Handbuch schulische Inklusion. vol. 4959 of UTB. Stuttgart: UTB GmbH and Barbara Budrich. Retrieved from https:\/\/elibrary.utb.de\/doi\/book\/10.36198\/9783838549590"},{"issue":"6","key":"9837_CR84","doi-asserted-by":"publisher","first-page":"911","DOI":"10.3102\/00346543221079417","volume":"92","author":"S W\u00f6rner","year":"2022","unstructured":"W\u00f6rner, S., Kuhn, J., & Scheiter, K. (2022). The best of two worlds: A systematic review on combining real and virtual experiments in science education. Review of Educational Research, 92(6), 911\u2013952. https:\/\/doi.org\/10.3102\/00346543221079417","journal-title":"Review of Educational Research"},{"key":"9837_CR85","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1007\/s10209-017-0594-0","volume":"18","author":"TH Wu","year":"2019","unstructured":"Wu, T. H., Wu, F., Liang, C. J., Li, Y. F., Tseng, C. M., & Kang, S. C. (2019). A virtual reality tool for training in global engineering collaboration. Universal Access in the Information Society, 18, 1243\u2013255. https:\/\/doi.org\/10.1007\/s10209-017-0594-0","journal-title":"Universal Access in the Information Society"},{"key":"9837_CR86","doi-asserted-by":"publisher","unstructured":"Xu, J., Gannon, P., Emmorey, K., Smith, J., & Braun, A. (2009). Symbolic gestures and spoken language are processed by a common neural system. Proceedings of the National Academy of Sciences,106(49), 20664\u201320669. https:\/\/doi.org\/10.1073\/pnas.0909197106. Retrieved from https:\/\/www.pnas.org\/doi\/pdf\/10.1073\/pnas.0909197106.","DOI":"10.1073\/pnas.0909197106"},{"key":"9837_CR87","doi-asserted-by":"publisher","unstructured":"Yang, L., Ni, S. T., Wang, Y., Yu, A., Lee, J. A., Hui, P. (2024). Interoperability of the metaverse: A digital ecosystem perspective review. Preprint at arXiv:2403.05205. https:\/\/doi.org\/10.48550\/arXiv.2403.05205","DOI":"10.48550\/arXiv.2403.05205"},{"issue":"1","key":"9837_CR88","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1111\/jcal.12874","volume":"40","author":"M Yoon","year":"2024","unstructured":"Yoon, M., Choi, K., Yoon, S., & Jo, I. H. (2024). Task type matters: The impact of virtual reality training on training performance. Journal of Computer Assisted Learning, 40(1), 205\u2013218. https:\/\/doi.org\/10.1111\/jcal.12874","journal-title":"Journal of Computer Assisted Learning"},{"key":"9837_CR89","doi-asserted-by":"crossref","unstructured":"Yu, Y., Ge, Z., Zhang, H., Chen, F., Qi, H., Li, R., et\u00a0al. (2024). A white wine fermentation experiment based on VR virtual simulation. In Proceedings of the 2023 4th International Conference on Machine Learning and Computer Application. ICMLCA \u201923 (pp. 986\u2013990). Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3650215.3650390","DOI":"10.1145\/3650215.3650390"},{"issue":"5","key":"9837_CR90","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1080\/01421590050110777","volume":"22","author":"A Ziv","year":"2000","unstructured":"Ziv, A., Small, S. D., & Wolpe, P. R. (2000). Patient safety and simulation-based medical education. Medical Teacher, 22(5), 489\u2013495. https:\/\/doi.org\/10.1080\/01421590050110777","journal-title":"Medical Teacher"}],"container-title":["Technology, Knowledge and Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10758-025-09837-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10758-025-09837-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10758-025-09837-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T10:00:47Z","timestamp":1775210447000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10758-025-09837-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,1]]},"references-count":90,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,3]]}},"alternative-id":["9837"],"URL":"https:\/\/doi.org\/10.1007\/s10758-025-09837-7","relation":{},"ISSN":["2211-1662","2211-1670"],"issn-type":[{"value":"2211-1662","type":"print"},{"value":"2211-1670","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,1]]},"assertion":[{"value":"30 November 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 April 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have not disclosed any competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"competing interests"}}]}}