{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T23:37:12Z","timestamp":1772840232773,"version":"3.50.1"},"reference-count":49,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T00:00:00Z","timestamp":1737936000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004239","name":"Politechnika Pozna\u0144ska","doi-asserted-by":"publisher","award":["0214\/SBAD\/0248"],"award-info":[{"award-number":["0214\/SBAD\/0248"]}],"id":[{"id":"10.13039\/501100004239","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Virtual Real."],"abstract":"<jats:p>This research explores integrating augmented reality (AR) with machine learning (ML) to enhance hands-on skill acquisition through origami folding. We developed an AR system using the YOLOv8 model to provide real-time feedback and automatic validation of each folding step, offering step-by-step guidance to users. A novel approach to training dataset preparation was introduced, which improves the accuracy of detecting and assessing origami folding stages. In a formative user study involving 16 participants tasked with folding multiple origami models, the results revealed that while the ML-driven feedback increased task completion times, it also made participants feel more confident throughout the folding process. However, they also reported that the feedback system added cognitive load, slowing their progress, though it provided valuable guidance. These findings suggest that while ML-supported AR systems can enhance the user experience, further optimization is required to streamline the feedback process and improve efficiency in complex manual tasks.<\/jats:p>","DOI":"10.3389\/frvir.2025.1499830","type":"journal-article","created":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T06:43:10Z","timestamp":1737960190000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Enhancing augmented reality with machine learning for hands-on origami training"],"prefix":"10.3389","volume":"6","author":[{"given":"Miko\u0142aj","family":"\u0141ysakowski","sequence":"first","affiliation":[]},{"given":"Jakub","family":"Gapsa","sequence":"additional","affiliation":[]},{"given":"Chenxu","family":"Lyu","sequence":"additional","affiliation":[]},{"given":"Thomas","family":"Bohn\u00e9","sequence":"additional","affiliation":[]},{"given":"S\u0142awomir Konrad","family":"Tadeja","sequence":"additional","affiliation":[]},{"given":"Piotr","family":"Skrzypczy\u0144ski","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,1,27]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1016\/0734-189X(83)90046-4","article-title":"Animating planar folds by computer","volume":"24","author":"Agui","year":"1983","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"B2","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.sbspro.2011.01.028","article-title":"Origami art as a means of facilitating learning","volume":"11","author":"Andreass","year":"2011","journal-title":"Procedia - Soc. Behav. Sci."},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-024-19861-x","article-title":"Decision support for augmented reality-based assistance systems deployment in industrial settings","author":"Bock","year":"2024","journal-title":"Multimedia Tools Appl."},{"key":"B4","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1109\/VRW58643.2023.00084","article-title":"Towards augmented reality guiding systems: an engineering design of an immersive system for complex 3D printing repair process","volume-title":"2023 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW)","author":"Bozzi","year":"2023"},{"key":"B5","doi-asserted-by":"crossref","DOI":"10.1145\/3274783.3274834","article-title":"Marvel: enabling mobile augmented reality with low energy and low latency","volume-title":"Proceedings of the ACM conference on embedded networked sensor systems (SenSys)","author":"Chen","year":"2018"},{"key":"B6","first-page":"147\u2014","article-title":"Origami sensei: mixed reality ai-assistant for creative tasks using hands","volume-title":"Companion Publication of the 2023 ACM designing interactive systems conference","author":"Chen","year":"2023"},{"key":"B7","doi-asserted-by":"crossref","first-page":"76\u2014","DOI":"10.1145\/2071536.2071547","article-title":"A comparison of four methods for cognitive load measurement","volume-title":"Proceedings of the 23rd Australian computer-human interaction conference","author":"Chen","year":"2011"},{"key":"B8","doi-asserted-by":"publisher","first-page":"100175","DOI":"10.1016\/j.jii.2020.100175","article-title":"Augmented reality smart glasses in industrial assembly: current status and future challenges","volume":"20","author":"Danielsson","year":"2020","journal-title":"J. Industrial Inf. Integration"},{"key":"B10","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1145\/3196709.3196737","article-title":"Bare-handed 3d drawing in augmented reality","volume-title":"Proceedings of the 2018 designing interactive systems conference","author":"Dudley","year":"2018"},{"key":"B11","unstructured":"EasyAR MEGA library\n          \n          \n          2024"},{"key":"B12","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1007\/s11031-008-9102-4","article-title":"Flow, performance and moderators of challenge-skill balance","volume":"32","author":"Engeser","year":"2008","journal-title":"Motivation Emot."},{"key":"B13","doi-asserted-by":"publisher","first-page":"165","DOI":"10.5220\/0008877901650172","article-title":"Real-time object detection and tracking in mixed reality using microsoft hololens","volume":"4","author":"Farasin","year":"2020","journal-title":"15th Int. Jt. Conf. Comput. Vis. Imaging Comput. Graph. Theory Appl."},{"key":"B14","first-page":"167","article-title":"Development of tomato harvest support system using mixed reality head mounted display","volume-title":"IEEE 4th global conference on life sciences and technologies","author":"Goka","year":"2022"},{"key":"B15","doi-asserted-by":"crossref","DOI":"10.1145\/3305365.3329729","article-title":"PlayGAMI: augmented reality origami creativity platform","volume-title":"ACM SIGGRAPH 2019 appy hour","author":"Grandhi","year":"2019"},{"key":"B16","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/s0166-4115(08)62386-9","article-title":"Development of NASA-TLX (task load index): results of empirical and theoretical research","author":"Hart","year":"1988","journal-title":"Adv. Psychol."},{"key":"B17","article-title":"Teaching work measurement through origami in developing countries","volume-title":"2nd south American international conference on industrial engineering and operations management","author":"Herbas Torrico","year":"2021"},{"key":"B18","article-title":"Ultralytics YOLO","author":"Jocher","year":"2023"},{"key":"B19","doi-asserted-by":"publisher","first-page":"100213","DOI":"10.1016\/j.jjimei.2024.100213","article-title":"Crafting the techno-functional blocks for metaverse - a review and research agenda","volume":"4","author":"Johri","year":"2024","journal-title":"Int. J. Inf. Manag. Data Insights"},{"key":"B20","first-page":"1","article-title":"Surgical education using artificial intelligence, augmented reality and machine learning: a review","volume-title":"IEEE international conference on consumer electronics - taiwan (ICCE-TW)","author":"Khandelwal","year":"2019"},{"key":"B21","doi-asserted-by":"crossref","DOI":"10.1145\/3544548.3581270","article-title":"Bubbleu: exploring augmented reality game design with uncertain AI-based interaction","volume-title":"Proceedings of the 2023 CHI conference on human factors in computing systems","author":"Kim","year":"2023"},{"key":"B22","doi-asserted-by":"crossref","DOI":"10.1109\/ICCV51070.2023.00371","article-title":"Segment anything","author":"Kirillov","year":"2023"},{"key":"B23","doi-asserted-by":"publisher","first-page":"20067","DOI":"10.1038\/s41598-022-24715-3","article-title":"Psychometric analysis of the flow short scale translated to Finnish","volume":"12","author":"Laakasuo","year":"2022","journal-title":"Sci. Rep."},{"key":"B24","doi-asserted-by":"publisher","first-page":"02325","DOI":"10.48550\/arXiv.1512.02325","article-title":"SSD: single shot multibox detector","author":"Liu","year":"2015","journal-title":"Corr. abs\/1512"},{"key":"B25","article-title":"Origami unfolded: augmented reality and machine learning integration for manipulative training scenarios","volume-title":"A Metaverse for the good: the European metaverse research network conference","author":"\u0141ysakowski","year":"2024"},{"key":"B26","first-page":"154","article-title":"Using AR and YOLOv8-based object detection to support real-world visual search in industrial workshop: lessons learned from a pilot study","volume-title":"Ieee int. Symp. On mixed and augmented reality adjunct (ISMAR-Adjunct)","author":"\u0141ysakowski","year":""},{"key":"B27","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1109\/edge60047.2023.00059","article-title":"Real-time onboard object detection for augmented reality: enhancing head-mounted display with YOLOv8","author":"\u0141ysakowski","year":"","journal-title":"IEEE Int. Conf. Edge Comput. Commun."},{"key":"B28","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1111\/mice.12932","article-title":"Methodology to integrate augmented reality and pattern recognition for crack detection","volume":"37","author":"Malek","year":"2022","journal-title":"Computer-Aided Civ. Infrastructure Eng."},{"key":"B29","doi-asserted-by":"publisher","first-page":"310","DOI":"10.3390\/jimaging8110310","article-title":"A review of synthetic image data and its use in computer vision","volume":"8","author":"Man","year":"2022","journal-title":"J. Imaging"},{"key":"B30","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1177\/1541931218621010","article-title":"A deeper look at the nasa tlx and where it falls short","volume":"62","author":"McKendrick","year":"2018","journal-title":"Proc. Hum. Factors Ergonomics Soc. Annu. Meet."},{"key":"B31","doi-asserted-by":"publisher","first-page":"32","DOI":"10.5920\/jpa.1022","article-title":"Playing in limbo","volume":"4","author":"Monnier","year":"2022","journal-title":"J. Play Adulthood"},{"key":"B32","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.rcim.2017.06.002","article-title":"A systematic review of augmented reality applications in maintenance","volume":"49","author":"Palmarini","year":"2018","journal-title":"Robotics Computer-Integrated Manuf."},{"key":"B33","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.compmedimag.2014.06.007","article-title":"Machine learning-based augmented reality for improved surgical scene understanding","volume":"41","author":"Pauly","year":"2015","journal-title":"Comput. Med. Imaging Graph."},{"key":"B34","doi-asserted-by":"publisher","first-page":"012018","DOI":"10.1088\/1757-899x\/528\/1\/012018","article-title":"The mental workload analysis of staff in study program of private educational organization","volume":"528","author":"Prabaswari","year":"2019","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"B35","unstructured":"Vuforia engine library\n          \n          \n          2023"},{"key":"B36","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1109\/cvpr.2016.91","article-title":"You only look once: unified, real-time object detection","author":"Redmon","year":"2016","journal-title":"CVPR"},{"key":"B37","first-page":"91","article-title":"Faster R-CNN: towards real-time object detection with region proposal networks","volume-title":"Advances in neural information processing systems 28: annual conference on neural information processing systems 2015, december 7-12, 2015, Montreal, quebec, Canada","author":"Ren","year":"2015"},{"key":"B38","doi-asserted-by":"publisher","first-page":"1088","DOI":"10.1587\/transinf.2019edp7242","article-title":"Anomaly detection of folding operations for origami instruction with single camera","author":"Shimanuki","year":"2020","journal-title":"IEICE Trans. Inf. Syst. 103-D"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.3389\/frvir.2024.1461145","article-title":"Augmented reality in engineering education: enhancing learning and application","volume":"5","author":"Suhail","year":"2024","journal-title":"Front. Virtual Real."},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.62707\/aishej.v13i3.591","article-title":"Beyond paper folding: origami and focused play to enhance interdisciplinary learning and teaching in universities","volume":"13","author":"Supple","year":"2021","journal-title":"All Irel. J. High. Educ."},{"key":"B41","doi-asserted-by":"publisher","first-page":"31039","DOI":"10.1007\/s11042-021-10520-z","article-title":"Exploring gestural input for engineering surveys of real-life structures in virtual reality using photogrammetric 3D models","volume":"80","author":"Tadeja","year":"","journal-title":"Multimedia Tools Appl."},{"key":"B42","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1109\/MCG.2021.3114955","article-title":"Measurement and inspection of photo-realistic 3-D VR models","volume":"41","author":"Tadeja","year":"","journal-title":"IEEE Comput. Graph. Appl."},{"key":"B43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TENCON.2012.6412167","article-title":"Folding support for beginners based on state estimation of origami","volume-title":"TENCON 2012 IEEE region 10 conference","author":"Watanabe","year":"2012"},{"key":"B44","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.1007\/978-3-319-32467-8_95","article-title":"Origami guru: an augmented reality application to assist paper folding","volume-title":"Information Technology: new generations","author":"Wiwatwattana","year":"2016"},{"key":"B45","article-title":"What is YOLOv8: an in-depth exploration of the internal features of the next-generation object detector","author":"Yaseen","year":"2024"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2304.11968","article-title":"Track anything: segment anything meets videos","author":"Yang","year":"2023","journal-title":"arXiv, cs.cv"},{"key":"B46","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1109\/econf51404.2020.9385487","article-title":"The integration of augmented reality (ar) in learning environment","volume-title":"2020 sixth international conference on e-learning (econf)","author":"Zambri","year":"2020"},{"key":"B47","doi-asserted-by":"publisher","first-page":"e0240226","DOI":"10.1371\/journal.pone.0240226","article-title":"Origami folding: taxing resources necessary for the acquisition of sequential skills","volume":"15","author":"Zhao","year":"2020","journal-title":"PLoS One"},{"key":"B48","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1016\/j.procir.2021.11.187","article-title":"Image-based state tracking in augmented reality supported assembly operations","volume":"104","author":"Zogopoulos","year":"2021","journal-title":"Procedia CIRP"},{"key":"B49","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1109\/CHIuXiD57244.2022.10009854","article-title":"Metaverse as A Future of education: a systematic review","volume":"1","author":"Zonaphan","year":"2022","journal-title":"2022 8th Int. HCI UX Conf. Indonesia (CHIuXiD)"}],"container-title":["Frontiers in Virtual Reality"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2025.1499830\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T06:43:22Z","timestamp":1737960202000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frvir.2025.1499830\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,27]]},"references-count":49,"alternative-id":["10.3389\/frvir.2025.1499830"],"URL":"https:\/\/doi.org\/10.3389\/frvir.2025.1499830","relation":{},"ISSN":["2673-4192"],"issn-type":[{"value":"2673-4192","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,27]]},"article-number":"1499830"}}