{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T15:20:40Z","timestamp":1784301640321,"version":"3.55.0"},"reference-count":48,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T00:00:00Z","timestamp":1697414400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004955","name":"Austrian Federal Ministry for Climate Action, Environment, Energy, Mobility, Innovation and Technology","doi-asserted-by":"publisher","award":["866702"],"award-info":[{"award-number":["866702"]}],"id":[{"id":"10.13039\/501100004955","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Graz University of Technology Open Access Publishing Fund","award":["866702"],"award-info":[{"award-number":["866702"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>Augmented reality (AR) could be a means for a more sustainable education of the next generation of pilots. This study aims to assess an AR-supported training concept for approach to landing, which is the riskiest phase of flying an aircraft and the most difficult to learn. The evaluation was conducted with 59 participants (28 women and 31 men) in a pretest\u2013post-test control group design. No significant effect of the AR-supported training was observed when comparing the experimental and the control groups. However, the results show that for the experimental group that trained with AR, higher performance in post-test was associated with higher AR presence and comfort with AR during training. Although both gender groups improved their approach quality after training, the improvement was larger in women as compared to men. Trainees\u2019 workload, fear of failure, and negative emotions decreased in post-test as compared to pre-test, but the decrease was significantly larger in women than in men. The experimental group who used AR support during training showed improved performance despite the absence of AR support in post-test. However, the AR-based training concept had a similar effect to conventional simulator training. Although more research is necessary to explore the training opportunities in AR and mixed reality, the results of this study indicate that such an application would be beneficial to bridge the gap between theoretical and practical instruction.<\/jats:p>","DOI":"10.3390\/app132011346","type":"journal-article","created":{"date-parts":[[2023,10,16]],"date-time":"2023-10-16T08:32:57Z","timestamp":1697445177000},"page":"11346","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Performance, Emotion, Presence: Investigation of an Augmented Reality-Supported Concept for Flight Training"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9770-6186","authenticated-orcid":false,"given":"Birgit","family":"Moesl","sequence":"first","affiliation":[{"name":"Institute of Engineering and Business Informatics, Graz University of Technology, Kopernikusgasse 24\/III, 8010 Graz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6673-618X","authenticated-orcid":false,"given":"Harald","family":"Schaffernak","sequence":"additional","affiliation":[{"name":"Institute of Engineering and Business Informatics, Graz University of Technology, Kopernikusgasse 24\/III, 8010 Graz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1550-2279","authenticated-orcid":false,"given":"Wolfgang","family":"Vorraber","sequence":"additional","affiliation":[{"name":"Institute of Engineering and Business Informatics, Graz University of Technology, Kopernikusgasse 24\/III, 8010 Graz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5559-6855","authenticated-orcid":false,"given":"Reinhard","family":"Braunstingl","sequence":"additional","affiliation":[{"name":"Institute of Mechanics, Graz University of Technology, Kopernikusgasse 24\/IV, 8010 Graz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1682-6304","authenticated-orcid":false,"given":"Ioana Victoria","family":"Koglbauer","sequence":"additional","affiliation":[{"name":"Institute of Engineering and Business Informatics, Graz University of Technology, Kopernikusgasse 24\/III, 8010 Graz, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,16]]},"reference":[{"key":"ref_1","unstructured":"Woods, B. (2022, November 16). How Airlines Plan to Create a New Generation of Pilots Amid Fears of Decade-Long Cockpit Crisis. Available online: https:\/\/www.cnbc.com\/2022\/11\/11\/how-airlines-plan-to-create-new-generation-of-pilots-at-time-of-crisis.html."},{"key":"ref_2","first-page":"43","article-title":"How Pink is the Sky? A Cross-national Study of the Gendered Occupation of Pilot","volume":"5","author":"Mitchell","year":"2005","journal-title":"Employ. Relat. Rec."},{"key":"ref_3","unstructured":"Bridges, D., Neal-Smith, J., and Mills, A. (2014). Absent Aviators, Gender Issues in Aviation, Ashgate Publishing, Ltd."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.trf.2018.05.023","article-title":"Ab initio pilot training for traffic separation and visual airport procedures in a naturalistic flight simulation environment","volume":"58","author":"Koglbauer","year":"2018","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_5","unstructured":"Turney, M.A. (2004). Tapping Diverse Talents in Aviation: Culture, Gender, and Diversity, Ashgate."},{"key":"ref_6","first-page":"1","article-title":"National survey results: Retention of women in collegiate aviation","volume":"7","author":"Turney","year":"2002","journal-title":"J. Air Transp."},{"key":"ref_7","unstructured":"Turney, M.A. (2004). Tapping Diverse Talents in Aviation: Culture, Gender, and Diversity, Ashgate."},{"key":"ref_8","unstructured":"Brown, L. (2017, January 14\u201316). The Next Generation Classroom: Transforming Aviation Training with Augmented Reality. Proceedings of the 2017: Training Pilots of the Future\u2013Techniques & Technology, Daytona Beach, FL, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1027\/2192-0923\/a000214","article-title":"A Research Agenda for Implementing Augmented Reality in Ab Initio Pilot Training","volume":"11","author":"Moesl","year":"2021","journal-title":"Aviat. Psychol. Appl. Hum. Factors"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Moesl, B., Schaffernak, H., Vorraber, W., Holy, M., Herrele, T., Braunstingl, R., and Koglbauer, I.V. (2022). Towards a More Socially Sustainable Advanced Pilot Training by Integrating Wearable Augmented Reality Devices. Sustainability, 14.","DOI":"10.3390\/su14042220"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Schaffernak, H., Moesl, B., Vorraber, W., and Koglbauer, I.V. (2020). Potential Augmented Reality Application Areas for Pilot Education: An Exploratory Study. Educ. Sci., 10.","DOI":"10.3390\/educsci10040086"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/978-3-030-74009-2_14","article-title":"Design and Evaluation of an Augmented Reality Application for Landing Training","volume":"Volume 1378","author":"Ahram","year":"2021","journal-title":"Human Interaction, Emerging Technologies and Future Applications IV"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Moesl, B., Schaffernak, H., Vorraber, W., Braunstingl, R., and Koglbauer, I.V. (2023). Multimodal Augmented Reality Applications for Training of Traffic Procedures in Aviation. Multimodal Technol. Interact., 7.","DOI":"10.3390\/mti7010003"},{"key":"ref_14","unstructured":"Air Safety Institute (2008). Mastering Takeoffs & Landings, Air Safety Institute."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"05016009","DOI":"10.1061\/(ASCE)EI.1943-5541.0000311","article-title":"New approach for the teaching of concrete compression tests in large groups of engineering students","volume":"143","author":"Vergara","year":"2017","journal-title":"J. Prof. Issues Eng. Educ. Pract."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Garz\u00f3n, J. (2021). An Overview of Twenty-Five Years of Augmented Reality in Education. Multimodal Technol. Interact., 5.","DOI":"10.3390\/mti5070037"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1111\/jcal.12008","article-title":"A mixed methods assessment of students\u2019 flow experiences during a mobile augmented reality science game","volume":"29","author":"Bressler","year":"2013","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1126\/science.1167311","article-title":"Immersive Interfaces for Engagement and Learning","volume":"323","author":"Dede","year":"2009","journal-title":"Science"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.ijhcs.2016.09.014","article-title":"The development and validation of the ARI questionnaire: An instrument for measuring immersion in location-based augmented reality settings","volume":"98","author":"Georgiou","year":"2017","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_20","unstructured":"American Psychological Association (2023). APA Dictionary of Psychology, American Psychological Association."},{"key":"ref_21","unstructured":"Csikszentmihalyi, M. (1990). Flow: The Psychology of Optimal Experience, Harper & Row New York."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cross, J.I., Boag-Hodgson, C.C., and Mavin, T.J. (2023). Measuring Presence and Situation Awareness in a Virtual Reality Flight Simulator. Aviat. Psychol. Appl. Hum. Factors, 2.","DOI":"10.1027\/2192-0923\/a000250"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1162\/105474698565686","article-title":"Measuring Presence in Virtual Environments: A Presence Questionnaire","volume":"7","author":"Witmer","year":"1998","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1177\/0018720811403731","article-title":"Where\u2019s the Emotion? How Sport Psychology Can Inform Research on Emotion in Human Factors","volume":"53","author":"Eccles","year":"2011","journal-title":"Hum. Factors"},{"key":"ref_25","unstructured":"Braunstingl, R., Baciu, C., and Koglbauer, I. (2019, January 6\u20137). Learning Style, Motivation, Emotional State and Workload of High Performers. Proceedings of the ERD 2018 Social & Behavioural Sciences, Cluj-Napoca, Romania."},{"key":"ref_26","unstructured":"Bauer, S., Braunstingl, R., Riesel, M., and Koglbauer, I. (201, January 24\u201328). Improving the method for upset recovery training of ab initio student pilots in simulated and real flight. Proceedings of the 33rd Conference of the European Association for Aviation Psychology, Dubrovnik, Croatia."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Koglbauer, I. (2017, January 7\u20138). Evaluation Of A Coaching Program With Ab Initio Student Pilots. Proceedings of the ERD 2017 Social & Behavioural Sciences, Cluj-Napoca, Romania.","DOI":"10.15405\/epsbs.2018.06.79"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.cogbrainres.2005.05.011","article-title":"Intelligence and neural efficiency: Further evidence of the influence of task content and sex on the brain\u2013IQ relationship","volume":"25","author":"Neubauer","year":"2005","journal-title":"Cogn. Brain Res."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hoffman, R.R., Hancock, P.A., Scerbo, M.W., Parasuraman, R., and Szalma, J.L. (2015). The Cambridge Handbook of Applied Perception Research, Cambridge University Press.","DOI":"10.1017\/CBO9780511973017"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hoffman, R.R., Hancock, P.A., Scerbo, M.W., Parasuraman, R., and Szalma, J.L. (2015). The Cambridge Handbook of Applied Perception Research, Cambridge University Press.","DOI":"10.1017\/CBO9780511973017"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.sbspro.2015.11.231","article-title":"Simulator Training Improves the Estimation of Collision Parameters and the Performance of Student Pilots","volume":"209","author":"Koglbauer","year":"2015","journal-title":"Procedia-Soc. Behav. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1037\/1076-898X.1.3.179","article-title":"Object versus space-based models of visual attention: Implications for the design of head-up displays","volume":"1","author":"Wickens","year":"1995","journal-title":"J. Exp. Psychol. Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1080\/10508410709336939","article-title":"HUD With a Velocity (Flight-Path) Vector Reduces Lateral Error During Landing in Restricted Visibility","volume":"17","author":"Goteman","year":"2007","journal-title":"Int. J. Aviat. Psychol."},{"key":"ref_34","unstructured":"Fitts, P.M., and Posner, M.I. (1967). Human Performance, Brooks\/Cole."},{"key":"ref_35","unstructured":"Microsoft (2021). Hololens Hardware, Microsoft. [1st ed.]."},{"key":"ref_36","unstructured":"Frohmann, P. (2019). Utilization of Augmented Reality in Aviation\u2014Assisting Small Aircraft Pilots in Approaching and Landing. [Master\u2019s Thesis, Graz University of Technology]."},{"key":"ref_37","unstructured":"Leedy, P.D., Ormrod, J.E., and Johnson, L.R. (2015). Practical Research: Planning and Design, Pearson Education."},{"key":"ref_38","unstructured":"NATO-AGARD Situation Awareness Rating Technique (SART): The development of a tool for aircrew systems design. Proceedings of the Situation Awareness in Aerospace Operations (AGARD-CP-478)."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research","volume":"Volume 52","author":"Hancock","year":"1988","journal-title":"Human Mental Workload; Advances in Psychology"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1037\/0022-3514.54.6.1063","article-title":"Development and validation of brief measures of positive and negative affect: The PANAS scales","volume":"54","author":"Watson","year":"1988","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1026\/\/0012-1924.47.2.57","article-title":"QCM: A questionnaire to assess current motivation in learning situations","volume":"47","author":"Rheinberg","year":"2001","journal-title":"Diagnostica"},{"key":"ref_42","unstructured":"Stevens, J.P. (1999). Intermediate Statistics. A Modern Approach, Lawrence Erlbaum Associates Publishers."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Weissgerber, T., Milic, N., Winham, S., and Garovic, V. (2015). Beyond Bar and Line Graphs: Time for a New Data Presentation Paradigm. PLoS Biol., 13.","DOI":"10.1371\/journal.pbio.1002128"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1007\/BF03172978","article-title":"Motivation and metacognition when learning a complex system","volume":"14","author":"Vollmeyer","year":"1999","journal-title":"Eur. J. Psychol. Educ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/S0959-4752(99)00031-6","article-title":"Does motivation affect performance via persistence?","volume":"10","author":"Vollmeyer","year":"2000","journal-title":"Learn. Instr."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Westerink, J., Krans, M., and Ouwerkerk, M. (2011). Sensing Emotions: The Impact of Context on Experience Measurements, Springer.","DOI":"10.1007\/978-90-481-3258-4"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Brown, E., and Cairns, P. (2004, January 24\u201329). A Grounded Investigation of Game Immersion. Proceedings of the CHI \u201904 Extended Abstracts on Human Factors in Computing Systems, Vienna, Austria.","DOI":"10.1145\/985921.986048"},{"key":"ref_48","unstructured":"Ermi, L., and M\u00e4yr\u00e4, F. (2005, January 16\u201320). Fundamental Components of the Gameplay Experience: Analysing Immersion. Proceedings of the Digital Games Research Conference 2005, Changing Views: Worlds in Play, Vancouver, BC, Canada."}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/13\/20\/11346\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:07:43Z","timestamp":1760130463000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/13\/20\/11346"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,16]]},"references-count":48,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["app132011346"],"URL":"https:\/\/doi.org\/10.3390\/app132011346","relation":{},"ISSN":["2076-3417"],"issn-type":[{"value":"2076-3417","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,16]]}}}