{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T20:33:15Z","timestamp":1771273995264,"version":"3.50.1"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,1,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Training operators to efficiently operate critical systems is a cumbersome and costly activity. A training program aims at modifying operators\u2019 knowledge and skills about the system they will operate. The design, implementation and evaluation of a \u2018good\u2019 training program is a complex activity that requires involving multi-disciplinary work from multiple stakeholders. This paper proposes the combined use of task descriptions and augmented reality (AR) technologies to support training activities both for trainees and instructors. AR interactions offer the unique benefit of bringing together the cyber and the physical aspects of an aircraft cockpit, thus providing support to training in this context that cannot be achieved by software tutoring systems. On the instructor side, the LeaFT-MixeR system supports the systematic coverage of planed tasks as well as the constant monitoring of trainee performance. On the trainee side, LeaFT-MixeR provides real-time AR information supporting the identification of objects with which to interact, in order to perform the planned task. The paper presents the engineering principles and their implementation to bring together AR technologies and tool-supported task models. We show how these principles are embedded in LeaFT-MixeR system as well as its application to the training of flight procedures in aircraft cockpits.<\/jats:p>","DOI":"10.1093\/iwcomp\/iwab007","type":"journal-article","created":{"date-parts":[[2021,3,29]],"date-time":"2021-03-29T15:06:37Z","timestamp":1617030397000},"page":"17-39","source":"Crossref","is-referenced-by-count":26,"title":["Engineering Task-based Augmented Reality Guidance: Application to the Training of Aircraft Flight Procedures"],"prefix":"10.1093","volume":"33","author":[{"given":"Giorgia","family":"Lallai","sequence":"first","affiliation":[{"name":"University of Cagliari, Department of Mathematics and Computer Science, Via Ospedale 72, 09124, Cagliari, Italy"}]},{"given":"Giovanni","family":"Loi Zedda","sequence":"additional","affiliation":[{"name":"ICS-IRIT, Universit\u00e9 Paul Sabatier - Toulouse III 118, route de Narbonne, 31062 Toulouse, France"}]},{"given":"C\u00e9lia","family":"Martinie","sequence":"additional","affiliation":[{"name":"ICS-IRIT, Universit\u00e9 Paul Sabatier - Toulouse III 118, route de Narbonne, 31062 Toulouse, France"}]},{"given":"Philippe","family":"Palanque","sequence":"additional","affiliation":[{"name":"ICS-IRIT, Universit\u00e9 Paul Sabatier - Toulouse III 118, route de Narbonne, 31062 Toulouse, France"}]},{"given":"Mauro","family":"Pisano","sequence":"additional","affiliation":[{"name":"University of Cagliari, Department of Mathematics and Computer Science, Via Ospedale 72, 09124, Cagliari, Italy"}]},{"given":"Lucio Davide","family":"Spano","sequence":"additional","affiliation":[{"name":"University of Cagliari, Department of Mathematics and Computer Science, Via Ospedale 72, 09124, Cagliari, Italy"}]}],"member":"286","published-online":{"date-parts":[[2021,3,26]]},"reference":[{"key":"2021070808100362600_ref1","article-title":"Flight Crew Operating Manual A318\/A319\/A320\/A321 FMGS Pilots Guide Vol 4","author":"Airbus","year":"2005"},{"key":"2021070808100362600_ref2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.edurev.2016.11.002","article-title":"Advantages and challenges associated with augmented reality for education: a systematic review of the literature","volume":"20","author":"Ak\u00e7ayir","year":"2017","journal-title":"Educ. Res. Rev."},{"key":"2021070808100362600_ref3","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1145\/1822018.1822043","volume-title":"Proceedings of the 2nd ACM SIGCHI symposium on engineering interactive computing systems, pp.","author":"Barboni","year":"2010"},{"key":"2021070808100362600_ref4","author":"Boeing","year":"1994"},{"key":"2021070808100362600_ref5","author":"Campos","year":"2017"},{"key":"2021070808100362600_ref6","first-page":"520","article-title":"Virtual and mixed reality interfaces for e-training: examples of applications in light aircraft maintenance","volume-title":"Universal Access in Human-Computer Interaction","author":"Christian","year":"2007"},{"key":"2021070808100362600_ref7","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1007\/s11251-005-5774-2","article-title":"Towards a personalized task selection model with shared instructional control","volume":"34","author":"Corbalan","year":"2006","journal-title":"Instr. Sci."},{"key":"2021070808100362600_ref8","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1109\/MCG.2011.4","article-title":"Augmented reality for aircraft maintenance training and operations support","volume":"31","author":"Crescenzio","year":"2011","journal-title":"IEEE Comput. Graph. Appl."},{"key":"2021070808100362600_ref9","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1007\/978-3-319-22723-8_16","article-title":"Enhanced task modelling for systematic identification and explicit representation of human errors","volume-title":"Human-Computer Interaction, INTERACT 2015","author":"Fahssi","year":"2015"},{"key":"2021070808100362600_ref10","doi-asserted-by":"crossref","DOI":"10.1145\/1878537.1878571","article-title":"Instructional strategies for scenario-based training: insights from applied research","volume-title":"Proc. of the 2010 spring simulation multiconference","author":"Fowlkes","year":"2010"},{"key":"2021070808100362600_ref11","volume-title":"The Conditions of Learning and the Theory of Instruction","author":"Gagn\u00e9","year":"1985"},{"key":"2021070808100362600_ref12","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1145\/2207676.2207763","article-title":"TeleAdvisor: a versatile augmented reality tool for remote assistance","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Gurevich","year":"2012"},{"key":"2021070808100362600_ref13","doi-asserted-by":"crossref","DOI":"10.1109\/DASC.2005.1563376","article-title":"A mobile application of augmented reality for aerospace maintenance training","volume-title":"24th Digital Avionics Systems Conference, vol. 1, pp. 5.B.3\u20135.1","author":"Haritos","year":"2005"},{"key":"2021070808100362600_ref14","article-title":"The impacts of using augmented reality to support aircraft maintenance","volume-title":"Technical Report AFIT-ENY-MS-19-M-121","author":"Hebert","year":"2019"},{"key":"2021070808100362600_ref15","doi-asserted-by":"crossref","first-page":"1355","DOI":"10.1109\/TVCG.2010.245","article-title":"Exploring the benefits of augmented reality documentation for maintenance and repair","volume":"17","author":"Henderson","year":"2011","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"2021070808100362600_ref16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ICTON.2011.5970856","article-title":"An introduction to augmented reality with applications in aeronautical maintenance","volume-title":"2011 13th international conference on transparent optical networks","author":"Hincapi\u00e9","year":"2011"},{"key":"2021070808100362600_ref17","author":"Joint Aviation Authorities","year":"2006"},{"key":"2021070808100362600_ref18","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1007\/978-3-540-49197-2_18","article-title":"A novel virtual reality tool for teaching dynamic 3D anatomy","volume-title":"Computer Vision, Virtual Reality and Robotics in Medicine","author":"Kancherla","year":"1995"},{"key":"2021070808100362600_ref19","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1007\/978-3-540-73335-5_71","article-title":"Summary of usability evaluations of an educational augmented reality application","volume-title":"Virtual Reality","author":"Kaufmann","year":"2007"},{"key":"2021070808100362600_ref20","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/ICIT.2016.7475092","article-title":"Effects of cyber-physical production systems on human factors in a weaving mill: implementation of digital working environments based on augmented reality","volume-title":"2016 IEEE international conference on industrial technology (ICIT)","author":"Kerpen","year":"2016"},{"key":"2021070808100362600_ref21","volume-title":"The Nall Report 2007: Accident Trends and Factors for 2006","author":"Krey","year":"2007"},{"key":"2021070808100362600_ref22","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s11528-012-0559-3","article-title":"Augmented reality in education and training","volume":"56","author":"Lee","year":"2012","journal-title":"TechTrends"},{"key":"2021070808100362600_ref23","first-page":"4","article-title":"TOUCAN: an IDE supporting the development of effective interactive Java applications","author":"Martinie","year":"2018"},{"key":"2021070808100362600_ref24","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1145\/2774225.2774845","article-title":"A generic tool-supported framework for coupling task models and interactive applications","volume-title":"Proceedings of the 7th ACM SIGCHI symposium on engineering interactive computing systems","author":"Martinie","year":"2015"},{"key":"2021070808100362600_ref25","first-page":"12","article-title":"Analysing and demonstrating tool-supported customizable task notations","volume-title":"Proceedings of the ACM on human-computer interaction","author":"Martinie","year":"2019"},{"key":"2021070808100362600_ref26","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1145\/1996461.1996495","article-title":"Model-based training: an approach supporting\noperability of critical interactive systems","volume-title":"Proceedings of the 3rd ACM SIGCHI symposium on engineering interactive computing systems","author":"Martinie","year":"2011"},{"key":"2021070808100362600_ref27","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1007\/978-3-642-23765-2_40","article-title":"Structuring and composition mechanisms to address scalability issues in task nodels","volume-title":"Human-Computer Interaction, INTERACT 2011","author":"Martinie","year":"2011"},{"key":"2021070808100362600_ref28","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/MCG.2004.1297006","article-title":"Developing killer apps for industrial augmented reality","volume":"24","author":"Navab","year":"2004","journal-title":"IEEE Comput. Graph. Appl."},{"key":"2021070808100362600_ref29","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.rcim.2017.06.002","article-title":"A systematic review of augmented reality applications in maintenance","volume":"49","author":"Palmarini","year":"2018","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"2021070808100362600_ref30","first-page":"15","article-title":"Real-time anomaly detection in elderly behavior with the support of task models","volume-title":"Proceedings of the ACM on human-computer interaction","author":"Parvin","year":"2018"},{"key":"2021070808100362600_ref31","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1007\/978-0-387-35175-9_58","article-title":"ConcurTaskTrees: a diagrammatic notation for specifying task models","volume-title":"Human-computer interaction, INTERACT \u201897: IFIP TC13 international conference on human-computer interaction, 14th\u201318th July 1997, Sydney, Australia, The International Federation for Information Processing (IFIP)","author":"Paterno","year":"1997"},{"key":"2021070808100362600_ref32","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139062367","volume-title":"Human Error","author":"Reason","year":"1990"},{"key":"2021070808100362600_ref33","volume-title":"The Human Contribution: Unsafe Acts, Accidents and Heroic Recoveries","author":"Reason","year":"2008"},{"issue":"2","key":"2021070808100362600_ref34","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/BF02504928","article-title":"A history of instructional design and technology: Part II: a history of instructional design","volume":"49","author":"Reiser","year":"2001","journal-title":"Educ. Technol. Res. Dev."},{"key":"2021070808100362600_ref35","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3758\/s13423-012-0333-8","article-title":"Augmented visual, auditory, haptic, and multimodal feedback in motor learning: a review","volume":"20","author":"Sigrist","year":"2013","journal-title":"Psychon. Bull. Rev."},{"key":"2021070808100362600_ref36","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1109\/38.267487","article-title":"New realities in aircraft design and manufacture","volume":"14","author":"Sims","year":"1994","journal-title":"IEEE Comput. Graph. Appl."},{"key":"2021070808100362600_ref37","doi-asserted-by":"crossref","DOI":"10.1145\/642611.642626","article-title":"Comparative effectiveness of augmented reality in object assembly","author":"Tang","year":"2003"},{"key":"2021070808100362600_ref38","author":"Army Field Artillery School","year":"1984"},{"key":"2021070808100362600_ref39","first-page":"350","article-title":"Training Document (1975) Pamphlet","author":"U.S. Department of Defense","year":"1975"},{"key":"2021070808100362600_ref40","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.compedu.2012.10.024","article-title":"Current status, opportunities and challenges of augmented reality in education","volume":"62","author":"Wu","year":"2013","journal-title":"Comput Educ."}],"container-title":["Interacting with Computers"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/iwc\/article-pdf\/33\/1\/17\/38495857\/iwab007.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/iwc\/article-pdf\/33\/1\/17\/38495857\/iwab007.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,8]],"date-time":"2021-07-08T16:41:12Z","timestamp":1625762472000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/iwc\/article\/33\/1\/17\/6190181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3,26]]},"published-print":{"date-parts":[[2021,1,12]]}},"URL":"https:\/\/doi.org\/10.1093\/iwcomp\/iwab007","relation":{},"ISSN":["0953-5438","1873-7951"],"issn-type":[{"value":"0953-5438","type":"print"},{"value":"1873-7951","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,1]]},"published":{"date-parts":[[2021,1]]}}}