{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T17:48:08Z","timestamp":1793728088128,"version":"4.6.1"},"reference-count":67,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T00:00:00Z","timestamp":1750636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Virtual Real."],"abstract":"<jats:p>Self-guided tutorials from videos help users learn new skills and complete tasks with varying complexity, from repairing a gadget to learning how to play an instrument. However, users may struggle to interpret 3D movements and gestures from 2D representations due to different viewpoints, occlusions, and depth perception. Augmented Reality (AR) can alleviate this challenge by enabling users to view complex instructions in their 3D space. However, most approaches only provide feedback if a live expert is present and do not consider self-guided tutorials. Our work explores virtual hand augmentations as automatic feedback mechanisms to enhance self-guided, gesture-based AR tutorials. We evaluated different error feedback designs and hand placement strategies on speed, accuracy and preference in a user study with 18 participants. Specifically, we investigate two visual feedback styles \u2014 <jats:italic>color feedback<\/jats:italic>, which changes the color of the hands\u2019 joints to signal pose correctness, and <jats:italic>shape feedback<\/jats:italic>, which exaggerates fingers length to guide correction \u2014 as well as two placement strategies: <jats:italic>superimposed<\/jats:italic>, where the feedback hand overlaps the user\u2019s own, and <jats:italic>adjacent<\/jats:italic>, where it appears beside the user\u2019s hand. Results show significantly faster replication time when users are provided with color or baseline no explicit feedback, when compared to shape manipulation feedback. Furthermore, despite users\u2019 preferences for adjacent placement for the feedback representation, superimposed placement significantly reduces replication time. We found no effects on accuracy for short-time recall, suggesting that while these factors may influence task efficiency, they may not strongly affect overall task proficiency.<\/jats:p>","DOI":"10.3389\/frvir.2025.1574965","type":"journal-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T05:21:04Z","timestamp":1750656064000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Exploring AR hand augmentations as error feedback mechanisms for enhancing gesture-based tutorials"],"prefix":"10.3389","volume":"6","author":[{"given":"Catarina G.","family":"Fidalgo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yukang","family":"Yan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mauricio","family":"Sousa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joaquim","family":"Jorge","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Lindlbauer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"B1","first-page":"1","article-title":"Beyond being real: a sensorimotor control perspective on interactions in virtual reality","volume-title":"Proceedings of the 2022 CHI conference on human factors in computing systems","author":"Abtahi","year":"2022"},{"key":"B2","doi-asserted-by":"crossref","first-page":"1343","DOI":"10.1145\/2702613.2732927","article-title":"Showme: a remote collaboration system that supports immersive gestural communication","volume-title":"Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems","author":"Amores","year":"2015"},{"key":"B3","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1109\/SVR.2019.00018","article-title":"Balletvr: a virtual reality system for ballet arm positions training","volume-title":"2019 21st symposium on virtual and augmented reality (SVR)","author":"Barioni","year":"2019"},{"key":"B4","first-page":"4","article-title":"SUS-A quick and dirty usability scale. Usability evaluation in industry","volume":"189","author":"Brooke","year":"1996"},{"key":"B5","doi-asserted-by":"publisher","first-page":"22","DOI":"10.3389\/frobt.2015.00022","article-title":"Immersive data comprehension: visualizing uncertainty in measurable models","volume":"2","author":"Brunet","year":"2015","journal-title":"Front. Robotics AI"},{"key":"B6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3313831.3376720","article-title":"Augmented reality training for industrial assembly work - are projection-based ar assistive systems an appropriate tool for assembly training?","volume-title":"Proceedings of the 2020 CHI conference on human factors in computing systems","author":"B\u00fcttner","year":"2020"},{"key":"B7","first-page":"1283","article-title":"Cognitive flexibility and adaptability to environmental changes in dynamic complex problem-solving tasks","volume":"48","author":"Ca\u00f1as","year":"2005","journal-title":"Ergonomics"},{"key":"B8","doi-asserted-by":"crossref","DOI":"10.1145\/3654777.3676384","article-title":"Sonohaptics: an audio-haptic cursor for gaze-based object selection in xr","volume-title":"Proceedings of the 37th annual ACM symposium on user interface software and technology","author":"Cho","year":"2024"},{"key":"B9","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1145\/3379337.3415591","article-title":"Reactive video: adaptive video playback based on user motion for supporting physical activity","volume-title":"Proceedings of the 33rd annual ACM symposium on user interface software and technology","author":"Clarke","year":"2020"},{"key":"B10","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1016\/j.chb.2018.08.055","article-title":"Developments and trends in learning with instructional video","volume":"89","author":"de Koning","year":"2018","journal-title":"Comput. Hum. Behav."},{"key":"B11","doi-asserted-by":"publisher","first-page":"3121","DOI":"10.1109\/TVCG.2022.3227999","article-title":"Visual cue based corrective feedback for motor skill training in mixed reality: a survey","volume":"30","author":"Diller","year":"2024","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"B12","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1145\/3374920.3374945","article-title":"Eguide: investigating different visual appearances and guidance techniques for egocentric guidance visualizations","volume-title":"Proceedings of the fourteenth international conference on tangible, embedded, and embodied interaction","author":"D\u00fcrr","year":"2020"},{"key":"B13","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1145\/3461778.3462066","article-title":"\u201ci\u2019m better off on my own\u201d: understanding how a tutorial\u2019s medium affects physical skill development","volume-title":"Designing interactive systems conference 2021","author":"Endow","year":"2021"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1149","DOI":"10.3758\/brm.41.4.1149","article-title":"Statistical power analyses using g* power 3.1: tests for correlation and regression analyses","volume":"41","author":"Faul","year":"2009","journal-title":"Behav. Res. methods"},{"key":"B15","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/3242587.3242594","article-title":"Ownershift: facilitating overhead interaction in virtual reality with an ownership-preserving hand space shift","volume-title":"Proceedings of the 31st annual ACM symposium on user interface software and technology","author":"Feuchtner","year":"2018"},{"key":"B16","doi-asserted-by":"crossref","DOI":"10.1109\/TVCG.2023.3247081","volume-title":"A survey on remote assistance and training in mixed reality environments","author":"Fidalgo","year":""},{"key":"B17","first-page":"438","article-title":"Magic: manipulating avatars and gestures to improve remote collaboration","volume-title":"2023 IEEE conference virtual reality and 3D user interfaces (VR)","author":"Fidalgo","year":""},{"key":"B18","doi-asserted-by":"publisher","first-page":"951","DOI":"10.3758\/MC.38.7.951","article-title":"Scaffolding feedback to maximize long-term error correction","volume":"38","author":"Finn","year":"2010","journal-title":"Mem. and cognition"},{"key":"B19","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1016\/b0-12-227210-2\/00157-6","article-title":"Hand movements","volume":"2","author":"Flanagan","year":"2002","journal-title":"Encycl. Hum. brain"},{"key":"B20","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1080\/08959280802541013","article-title":"Faded versus increasing feedback, task variability trajectories, and transfer of training","volume":"22","author":"Goodman","year":"2009","journal-title":"Hum. Perform."},{"key":"B21","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/ISMAR.2010.5643554","article-title":"Task support system by displaying instructional video onto ar workspace","volume-title":"2010 IEEE international symposium on mixed and augmented reality","author":"Goto","year":"2010"},{"key":"B22","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1145\/2380116.2380167","article-title":"Duplotrack: a real-time system for authoring and guiding duplo block assembly","volume-title":"Proceedings of the 25th annual ACM symposium on user interface software and technology","author":"Gupta","year":"2012"},{"key":"B23","first-page":"139","article-title":"Development of nasa-tlx (task load index): results of empirical and theoretical research","volume-title":"North-holland, vol. 52 of","author":"Hart","year":"1988"},{"key":"B24","doi-asserted-by":"publisher","first-page":"166","DOI":"10.1016\/j.cag.2018.09.017","article-title":"Design considerations for combining augmented reality with intelligent tutors","volume":"77","author":"Herbert","year":"2018","journal-title":"Comput. and Graph."},{"key":"B25","first-page":"1","article-title":"Adaptutar: an adaptive tutoring system for machine tasks in augmented reality","volume-title":"Proceedings of the 2021 CHI conference on human factors in computing systems","author":"Huang","year":"2021"},{"key":"B26","doi-asserted-by":"publisher","first-page":"207","DOI":"10.2466\/pms.1975.41.1.207","article-title":"Effects of four psychological primary colors on anxiety state","volume":"41","author":"Jacobs","year":"1975","journal-title":"Percept. Mot. Ski."},{"key":"B27","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.learninstruc.2007.01.011","article-title":"Attention guiding in multimedia learning","volume":"18","author":"Jamet","year":"2008","journal-title":"Learn. Instr."},{"key":"B28","first-page":"1","article-title":"Flowar: how different augmented reality visualizations of online fitness videos support flow for at-home yoga exercises","volume-title":"Proceedings of the 2023 CHI conference on human factors in computing systems","author":"Jo","year":"2023"},{"key":"B29","first-page":"1","article-title":"Physical keyboards in virtual reality: analysis of typing performance and effects of avatar hands","volume-title":"Proceedings of the 2018 CHI conference on human factors in computing systems","author":"Knierim","year":"2018"},{"key":"B30","article-title":"3d visualization for model comprehension a case study conducted at ericsson ab","author":"Krolovitsch","year":"2009"},{"key":"B31","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1145\/2414536.2414588","article-title":"Ar record&replay: situated compositing of video content in mobile augmented reality","volume-title":"Proceedings of the 24th Australian computer-human interaction conference","author":"Langlotz","year":"2012"},{"key":"B32","first-page":"1","article-title":"Stargazer: an interactive camera robot for capturing how-to videos based on subtle instructor cues","volume-title":"Proceedings of the 2023 CHI conference on human factors in computing systems","author":"Li","year":"2023"},{"key":"B33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/VR50410.2021.00069","article-title":"Correction of avatar hand movements supports learning of a motor skill","volume-title":"2021 IEEE virtual reality and 3D user interfaces (VR)","author":"Lilija","year":"2021"},{"key":"B34","first-page":"1","article-title":"Pianohandsync: an alignment-based hand pose discrepancy visualization system for piano learning","volume-title":"Extended abstracts of the 2023 CHI conference on human factors in computing systems","author":"Liu","year":""},{"key":"B35","first-page":"1","article-title":"Instrumentar: auto-generation of augmented reality tutorials for operating digital instruments through recording embodied demonstration","volume-title":"Proceedings of the 2023 CHI conference on human factors in computing systems","author":"Liu","year":""},{"key":"B36","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1016\/j.learninstruc.2017.12.007","article-title":"Adding immersive virtual reality to a science lab simulation causes more presence but less learning","volume":"60","author":"Makransky","year":"2019","journal-title":"Learn. Instr."},{"key":"B37","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1007\/s11423-020-09749-6","article-title":"Five ways to increase the effectiveness of instructional video","volume":"68","author":"Mayer","year":"2020","journal-title":"Educ. Technol. Res. Dev."},{"key":"B38","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1145\/3379337.3415832","article-title":"Iteratively adapting avatars using task-integrated optimisation","volume-title":"Proceedings of the 33rd annual ACM symposium on user interface software and technology","author":"McIntosh","year":"2020"},{"key":"B39","doi-asserted-by":"crossref","first-page":"6547","DOI":"10.1145\/3025453.3025688","article-title":"Retargeting video tutorials showing tools with surface contact to augmented reality","volume-title":"Proceedings of the 2017 CHI conference on human factors in computing systems","author":"Mohr","year":"2017"},{"key":"B40","doi-asserted-by":"publisher","first-page":"7073","DOI":"10.1007\/s11042-019-08437-9","article-title":"Comparative study of ar versus video tutorials for minor maintenance operations","volume":"79","author":"Morillo","year":"2020","journal-title":"Multimedia Tools Appl."},{"key":"B41","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1145\/1744161.1744163","article-title":"Natural user interfaces are not natural","volume":"17","author":"Norman","year":"2010","journal-title":"interactions"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1517","DOI":"10.1007\/s00371-019-01662-1","article-title":"Development and evaluation of a self-training system for tennis shots with motion feature assessment and visualization","volume":"35","author":"Oshita","year":"2019","journal-title":"Vis. Comput."},{"key":"B43","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1016\/j.chb.2009.09.001","article-title":"Why does signaling enhance multimedia learning? evidence from eye movements","volume":"26","author":"Ozcelik","year":"2010","journal-title":"Comput. Hum. Behav."},{"key":"B44","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1145\/237091.237102","article-title":"The go-go interaction technique: non-linear mapping for direct manipulation in vr","volume-title":"Proceedings of the 9th annual ACM symposium on User interface software and technology","author":"Poupyrev","year":"1996"},{"key":"B45","first-page":"1","article-title":"Paper trail: an immersive authoring system for augmented reality instructional experiences","volume-title":"Proceedings of the 2022 CHI conference on human factors in computing systems","author":"Rajaram","year":"2022"},{"key":"B46","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1109\/ISMAR50242.2020.00049","article-title":"Influence of hand visualization on tool-based motor skills training in an immersive vr simulator","volume-title":"2020 IEEE international symposium on mixed and augmented reality (ISMAR)","author":"Ricca","year":"2020"},{"key":"B47","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/VR50410.2021.00031","article-title":"The influence of hand visualization in tool-based motor-skills training, a longitudinal study","volume-title":"2021 IEEE virtual reality and 3D user interfaces (VR)","author":"Ricca","year":"2021"},{"key":"B48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3411764.3445759","article-title":"Ninja hands: using many hands to improve target selection in vr","volume-title":"Proceedings of the 2021 CHI conference on human factors in computing systems","author":"Schjerlund","year":"2021"},{"key":"B49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/21681163.2022.2154277","article-title":"enAudiovisual augmentation for coil positioning in transcranial magnetic stimulation","author":"Sch\u00fctz","year":"2022","journal-title":"Comput. methods biomechanics Biomed. Eng. Imaging and Vis."},{"key":"B50","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1109\/VRW55335.2022.00086","article-title":"Ar hero: generating interactive augmented reality guitar tutorials","volume-title":"2022 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW)","author":"Skreinig","year":"2022"},{"key":"B51","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1145\/2207676.2207702","article-title":"Lightguide: projected visualizations for hand movement guidance","author":"Sodhi","year":"2012","journal-title":"Proc. SIGCHI Conf. Hum. Factors Comput. Syst."},{"key":"B52","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1145\/2470654.2470679","article-title":"Bethere: 3d mobile collaboration with spatial input","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Sodhi","year":"2013"},{"key":"B53","article-title":"Manual for the state-trait anxiety inventory (self-evaluation questionnaire)","author":"Spielberger","year":"1970"},{"key":"B54","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/ISMAR59233.2023.00030","article-title":"State-aware configuration detection for augmented reality step-by-step tutorials","volume-title":"2023 IEEE international symposium on mixed and augmented reality (ISMAR)","author":"Stanescu","year":"2023"},{"key":"B55","doi-asserted-by":"crossref","DOI":"10.1145\/3411764.3445580","article-title":"Impact of task on attentional tunneling in handheld augmented reality","volume-title":"Proceedings of the 2021 CHI conference on human factors in computing systems","author":"Syiem","year":"2021"},{"key":"B56","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1145\/642611.642626","article-title":"Comparative effectiveness of augmented reality in object assembly","author":"Tang","year":"2003","journal-title":"Proc. SIGCHI Conf. Hum. factors Comput. Syst."},{"key":"B57","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1145\/2407516.2407590","article-title":"3d helping hands: a gesture based mr system for remote collaboration","volume-title":"Proceedings of the 11th ACM SIGGRAPH international conference on virtual-reality continuum and its applications in industry","author":"Tecchia","year":"2012"},{"key":"B58","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1109\/CLEI.2018.00078","article-title":"Learning how to play a guitar with the hololens: a case study","volume-title":"2018 XLIV Latin American computer conference (CLEI)","author":"Torres","year":"2018"},{"key":"B59","first-page":"36","article-title":"User experience of gesture based interfaces: a comparison with traditional interaction methods on pragmatic and hedonic qualities","volume-title":"International gesture workshop","author":"Van Beurden","year":"2011"},{"key":"B60","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1109\/ISMAR59233.2023.00087","article-title":"Effects of opaque, transparent and invisible hand visualization styles on motor dexterity in a virtual reality based purdue pegboard test","volume-title":"2023 IEEE international symposium on mixed and augmented reality (ISMAR)","author":"Voisard","year":"2023"},{"key":"B61","doi-asserted-by":"crossref","DOI":"10.1145\/3613904.3642935","article-title":"Exploring visualizations for precisely guiding bare hand gestures in virtual reality","volume-title":"Proceedings of the CHI conference on human factors in computing systems","author":"Wang","year":"2024"},{"key":"B62","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1145\/1978942.1978963","article-title":"The aligned rank transform for nonparametric factorial analyses using only anova procedures","volume-title":"Proceedings of the SIGCHI conference on human factors in computing systems","author":"Wobbrock","year":"2011"},{"key":"B63","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1145\/3379337.3415819","article-title":"Video-annotated augmented reality assembly tutorials","volume-title":"Proceedings of the 33rd annual ACM symposium on user interface software and technology","author":"Yamaguchi","year":"2020"},{"key":"B64","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/ISMAR50242.2020.00085","article-title":"Perspective matters: design implications for motion guidance in mixed reality","volume-title":"2020 IEEE international symposium on mixed and augmented reality (ISMAR)","author":"Yu","year":"2020"},{"key":"B65","doi-asserted-by":"crossref","DOI":"10.1145\/3613904.3642143","article-title":"Design space of visual feedforward and corrective feedback in xr-based motion guidance systems","volume-title":"Proceedings of the CHI conference on human factors in computing systems","author":"Yu","year":"2024"},{"key":"B66","doi-asserted-by":"publisher","first-page":"1899","DOI":"10.1145\/3025453.3026001","article-title":"Memory in motion: the influence of gesture- and touch-based input modalities on spatial memory","volume":"17","author":"Zagermann","year":"2017","journal-title":"Proc. 2017 CHI Conf. Hum. Factors Comput. Syst."},{"key":"B67","first-page":"821","article-title":"Movement guidance using a mixed reality mirror","volume-title":"Proceedings of the 2022 ACM designing interactive systems conference","author":"Zhou","year":"2022"}],"container-title":["Frontiers in Virtual Reality"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2025.1574965\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T05:21:18Z","timestamp":1750656078000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2025.1574965\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":67,"alternative-id":["10.3389\/frvir.2025.1574965"],"URL":"https:\/\/doi.org\/10.3389\/frvir.2025.1574965","relation":{},"ISSN":["2673-4192"],"issn-type":[{"value":"2673-4192","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,23]]},"article-number":"1574965"}}