{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T19:35:55Z","timestamp":1769283355018,"version":"3.49.0"},"reference-count":56,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T00:00:00Z","timestamp":1769040000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Paris Lodron University of Salzburg Publication Fund"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Extended Reality (XR) technologies have matured into powerful tools for training in high-stakes domains, from emergency response to search and rescue. Yet current systems often struggle to balance real-time AI-driven personalisation with the need for human oversight and calibrated trust. This article synthesizes the programmatic contributions of a multi-study doctoral project to advance a design-and-evaluation framework for trustworthy adaptive XR training. Across six studies, we explored (i) recommender-driven scenario adaptation based on multimodal performance and physiological signals, (ii) persuasive dashboards for trainers, (iii) architectures for AI-supported XR training in medical mass-casualty contexts, (iv) theoretical and practical integration of Human-in-the-Loop (HITL) supervision, (v) user trust and over-reliance in the face of misleading AI suggestions, and (vi) the role of interaction modality in shaping workload, explainability, and trust in human\u2013robot collaboration. Together, these investigations show how adaptive policies, transparent explanation, and adjustable autonomy can be orchestrated into a single adaptation loop that maintains trainee engagement, improves learning outcomes, and preserves trainer agency. We conclude with design guidelines and a research agenda for extending trustworthy XR training into safety-critical environments.<\/jats:p>","DOI":"10.3390\/mti10010011","type":"journal-article","created":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T09:16:59Z","timestamp":1769159819000},"page":"11","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Adaptive Realities: Human-in-the-Loop AI for Trustworthy XR Training in Safety-Critical Domains"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9075-0187","authenticated-orcid":false,"given":"Daniele","family":"Pretolesi","sequence":"first","affiliation":[{"name":"Department for Artificial Intelligence and Human Interfaces, University of Salzburg, 5020 Salzburg, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4483-7710","authenticated-orcid":false,"given":"Georg","family":"Regal","sequence":"additional","affiliation":[{"name":"Department for Artificial Intelligence and Human Interfaces, University of Salzburg, 5020 Salzburg, Austria"},{"name":"Center for Technology Experience, Austrian Institute of Technology, 1210 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5327-2494","authenticated-orcid":false,"given":"Helmut","family":"Schrom-Feiertag","sequence":"additional","affiliation":[{"name":"Department for Artificial Intelligence and Human Interfaces, University of Salzburg, 5020 Salzburg, Austria"},{"name":"Center for Technology Experience, Austrian Institute of Technology, 1210 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manfred","family":"Tscheligi","sequence":"additional","affiliation":[{"name":"Department for Artificial Intelligence and Human Interfaces, University of Salzburg, 5020 Salzburg, Austria"},{"name":"Center for Technology Experience, Austrian Institute of Technology, 1210 Vienna, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Endsley, M.R. (2021). Situation awareness. Handbook of Human Factors and Ergonomics, John Wiley & Sons, Inc.","DOI":"10.1002\/9781119636113.ch17"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1136\/jnnp-2022-330207","article-title":"Immersive medical virtual reality: Still a novelty or already a necessity?","volume":"94","author":"Loetscher","year":"2023","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1007\/s40670-022-01698-4","article-title":"Use of Extended Reality in Medical Education: An Integrative Review","volume":"33","author":"Curran","year":"2022","journal-title":"Med. Sci. Educ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2010.1","article-title":"Affect detection: An interdisciplinary review of models, methods, and their applications","volume":"1","author":"Calvo","year":"2010","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3001837","article-title":"Interacting with recommenders\u2014Overview and research directions","volume":"7","author":"Jugovac","year":"2017","journal-title":"ACM Trans. Interact. Intell. Syst. (TiiS)"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bainbridge, L. (1983). Ironies of automation. Analysis, Design and Evaluation of Man\u2013Machine Systems, Elsevier.","DOI":"10.1016\/B978-0-08-029348-6.50026-9"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","article-title":"Explanation in artificial intelligence: Insights from the social sciences","volume":"267","author":"Miller","year":"2019","journal-title":"Artif. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","article-title":"Trust in automation: Designing for appropriate reliance","volume":"46","author":"Lee","year":"2004","journal-title":"Hum. Factors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/3236386.3241340","article-title":"The Mythos of Model Interpretability: In machine learning, the concept of interpretability is both important and slippery","volume":"16","author":"Lipton","year":"2018","journal-title":"Queue"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1177\/10468781241236688","article-title":"Integrating biofeedback and artificial intelligence into eXtended reality training scenarios: A systematic literature review","volume":"55","author":"Blackmore","year":"2024","journal-title":"Simul. Gaming"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1177\/0018720816665459","article-title":"The automation-by-expertise-by-training interaction: Why automation-related accidents continue to occur in sociotechnical systems","volume":"59","author":"Strauch","year":"2017","journal-title":"Hum. Factors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1518\/001872097778543886","article-title":"Humans and automation: Use, misuse, disuse, abuse","volume":"39","author":"Parasuraman","year":"1997","journal-title":"Hum. Factors"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/3468.844354","article-title":"A model for types and levels of human interaction with automation","volume":"30","author":"Parasuraman","year":"2000","journal-title":"IEEE Trans. Syst. Man Cybern.-Part A Syst. Humans"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1518\/001872095779049499","article-title":"Measurement of situation awareness in dynamic systems","volume":"37","author":"Endsley","year":"1995","journal-title":"Hum. Factors"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sheridan, T.B. (2019). Individual differences in attributes of trust in automation: Measurement and application to system design. Front. Psychol., 10.","DOI":"10.3389\/fpsyg.2019.01117"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/MIS.2014.87","article-title":"Man versus machine or man+ machine?","volume":"29","author":"Cummings","year":"2014","journal-title":"IEEE Intell. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2401","DOI":"10.1007\/s10489-018-1361-5","article-title":"Interactive machine learning: Experimental evidence for the human in the algorithmic loop: A case study on Ant Colony Optimization","volume":"49","author":"Holzinger","year":"2019","journal-title":"Appl. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1186\/s41235-024-00599-x","article-title":"Transparency improves the accuracy of automation use, but automation confidence information does not","volume":"9","author":"Tatasciore","year":"2024","journal-title":"Cogn. Res. Princ. Implic."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yang, X.J., Unhelkar, V.V., Li, K., and Shah, J.A. (2017). Evaluating effects of user experience and system transparency on trust in automation. Proceedings of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction, IEEE.","DOI":"10.1145\/2909824.3020230"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xu, X., Yu, A., Jonker, T.R., Todi, K., Lu, F., Qian, X., Belo, J.M.E., Wang, T., Li, M., and Mun, A. (2023). XAIR: A Framework of Explainable AI in Augmented Reality. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery.","DOI":"10.1145\/3544548.3581500"},{"key":"ref_21","first-page":"50","article-title":"Moral crumple zones: Cautionary tales in human-robot interaction","volume":"4","author":"Elish","year":"2019","journal-title":"Engag. Sci. Technol. Soc."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1177\/00187208211037457","article-title":"Adaptable (not adaptive) automation: Forefront of human\u2013automation teaming","volume":"64","author":"Calhoun","year":"2022","journal-title":"Hum. Factors"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1080\/10357718.2024.2328293","article-title":"Elevating humanism in high-stakes automation: Experts-in-the-loop and resort-to-force decision making","volume":"78","author":"Davis","year":"2024","journal-title":"Aust. J. Int. Aff."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1007\/s43681-022-00144-w","article-title":"\u2018Design-for-responsible\u2019algorithmic decision-making systems: A question of ethical judgement and human meaningful control","volume":"2","author":"Holford","year":"2022","journal-title":"AI Ethics"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3359152","article-title":"The principles and limits of algorithm-in-the-loop decision making","volume":"3","author":"Green","year":"2019","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1111\/j.1467-8535.2009.01038.x","article-title":"What are the learning affordances of 3-D virtual environments?","volume":"41","author":"Dalgarno","year":"2010","journal-title":"Br. J. Educ. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1561\/1100000049","article-title":"A survey of augmented reality","volume":"8","author":"Billinghurst","year":"2015","journal-title":"Found. Trends\u00ae Hum.- Interact."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s00530-010-0190-0","article-title":"The effects of recommendations\u2019 presentation on persuasion and satisfaction in a movie recommender system","volume":"16","author":"Nanou","year":"2010","journal-title":"Multimed. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3158369","article-title":"Deep learning based recommender system: A survey and new perspectives","volume":"52","author":"Zhang","year":"2019","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1007\/s40747-020-00212-w","article-title":"Artificial intelligence in recommender systems","volume":"7","author":"Zhang","year":"2021","journal-title":"Complex Intell. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1080\/1463922X.2017.1315750","article-title":"Situation awareness-based agent transparency and human-autonomy teaming effectiveness","volume":"19","author":"Chen","year":"2018","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Grassini, S., Laumann, K., and Rasmussen Skogstad, M. (2020). The use of virtual reality alone does not promote training performance (but sense of presence does). Front. Psychol., 11.","DOI":"10.3389\/fpsyg.2020.01743"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Slater, M., P\u00e9rez Marcos, D., Ehrsson, H., and Sanchez-Vives, M.V. (2009). Inducing illusory ownership of a virtual body. Front. Neurosci., 3.","DOI":"10.3389\/neuro.01.029.2009"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1145\/566654.566630","article-title":"Physiological measures of presence in stressful virtual environments","volume":"21","author":"Meehan","year":"2002","journal-title":"Acm. Trans. Graph."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Picard, R.W. (2000). Affective Computing, MIT Press.","DOI":"10.1007\/978-3-540-45012-2_2"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1007\/s10648-019-09465-5","article-title":"Cognitive Architecture and Instructional Design: 20 Years Later","volume":"31","author":"Sweller","year":"2019","journal-title":"Educ. Psychol. Rev."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1207\/S15326985EP3801_6","article-title":"Nine ways to reduce cognitive load in multimedia learning","volume":"38","author":"Mayer","year":"2003","journal-title":"Educ. Psychol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1145\/764008.763957","article-title":"Persuasive technology: Using computers to change what we think and do","volume":"2002","author":"Fogg","year":"2002","journal-title":"Ubiquity"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1037\/0003-066X.55.1.68","article-title":"Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being","volume":"55","author":"Ryan","year":"2000","journal-title":"Am. Psychol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1177\/0018720814547570","article-title":"Trust in Automation","volume":"57","author":"Hoff","year":"2015","journal-title":"Hum. Factors J. Hum. Factors Ergon. Soc."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Arrieta","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_42","first-page":"1","article-title":"To trust or to think: Cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making","volume":"5","author":"Malaya","year":"2021","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_43","unstructured":"Doshi-Velez, F., and Kim, B. (2017). Towards a rigorous science of interpretable machine learning. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1177\/00187208211009995","article-title":"Trusting automation: Designing for responsivity and resilience","volume":"65","author":"Chiou","year":"2023","journal-title":"Hum. Factors"},{"key":"ref_45","unstructured":"Binns, R. (2018, January 23\u201324). Fairness in machine learning: Lessons from political philosophy. Proceedings of the Conference on Fairness, Accountability and Transparency, PMLR, New York, NY, USA."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1023\/A:1008942012299","article-title":"Multiagent systems: A survey from a machine learning perspective","volume":"8","author":"Stone","year":"2000","journal-title":"Auton. Robot."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1561\/1100000005","article-title":"Human\u2013robot interaction: A survey","volume":"1","author":"Goodrich","year":"2008","journal-title":"Found. Trends\u00ae Hum.-Interact."},{"key":"ref_48","unstructured":"Pretolesi, D. (2022). Personalised training: Integrating recommender systems in XR training platforms. Proceedings of the Mensch und Computer 2022-Workshopband, Gesellschaft f\u00fcr Informatik eV."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Pretolesi, D., Zechner, O., Guirao, D.G., Schrom-Feiertag, H., and Tscheligi, M. (2023). AI-Supported XR Training: Personalizing Medical First Responder Training. Proceedings of the International Conference on Artificial Intelligence and Virtual Reality, Springer.","DOI":"10.1007\/978-981-99-9018-4_25"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Pretolesi, D., Zechner, O., Schrom-Feiertag, H., and Tscheligi, M. (2024). Can I Trust You? Exploring the Impact of Misleading AI Suggestions on User\u2019s Trust. Proceedings of the 2024 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), IEEE.","DOI":"10.1109\/MetroXRAINE62247.2024.10796402"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Pretolesi, D., Gutierrez, R., Regal, G., and Tscheligi, M. (2025). Human, I Need You: Comparison of Human-Robot Interaction Modalities for Search and Rescue Missions. Proceedings of the International Conference on Mobile and Ubiquitous Multimedia, Association for Computing Machinery.","DOI":"10.1145\/3771882.3771895"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Pretolesi, D., Zechner, O., Zafari, S., and Tscheligi, M. (2023). Human in the Loop for XR Training: Theory, Practice and Recommendations for Effective and Safe Training Environments. Proceedings of the 2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), IEEE.","DOI":"10.1109\/MetroXRAINE58569.2023.10405775"},{"key":"ref_53","unstructured":"Pretolesi, D., and Zechner, O. (2023, January 19\u201321). Persuasive XR Training: Improving Training with AI and Dashboards. Proceedings of the 18th International Conference on Persuasive Technology (PERSUASIVE 2023), Eindhoven, The Netherlands. CEUR Workshop Proceedings, 2023."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3597623","article-title":"Virtual, Augmented, and Mixed Reality for Human-robot Interaction: A Survey and Virtual Design Element Taxonomy","volume":"12","author":"Walker","year":"2022","journal-title":"ACM Trans. Hum.-Robot Interact."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1007\/s10055-020-00434-w","article-title":"Adaptive virtual reality-based training: A systematic literature review and framework","volume":"24","author":"Zahabi","year":"2020","journal-title":"Virtual Real."},{"key":"ref_56","first-page":"2935","article-title":"A Survey of Accuracy Evaluation Metrics of Recommendation Tasks","volume":"10","author":"Gunawardana","year":"2009","journal-title":"J. Mach. Learn. Res."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/1\/11\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T09:48:57Z","timestamp":1769161737000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/1\/11"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,22]]},"references-count":56,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["mti10010011"],"URL":"https:\/\/doi.org\/10.3390\/mti10010011","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,22]]}}}