{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T08:42:30Z","timestamp":1770540150357,"version":"3.49.0"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T00:00:00Z","timestamp":1657670400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Australian Research Council Discovery Projects","award":["DP200102858"],"award-info":[{"award-number":["DP200102858"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>We provide an experimental evaluation of a wearable augmented reality (AR) system we have developed for human-robot teams working on tasks requiring collaboration in shared physical workspace. Recent advances in AR technology have facilitated the development of more intuitive user interfaces for many human-robot interaction applications. While it has been anticipated that AR can provide a more intuitive interface to robot assistants helping human workers in various manufacturing scenarios, existing studies in robotics have been largely limited to teleoperation and programming. Industry 5.0 envisions cooperation between human and robot working in teams. Indeed, there exist many industrial tasks that can benefit from human-robot collaboration. A prime example is high-value composite manufacturing. Working with our industry partner towards this example application, we evaluated our AR interface design for shared physical workspace collaboration in human-robot teams. We conducted a multi-dimensional analysis of our interface using established metrics. Results from our user study (n = 26) show that, subjectively, the AR interface feels more novel and a standard joystick interface feels more dependable to users. However, the AR interface was found to reduce physical demand and task completion time, while increasing robot utilization. Furthermore, user\u2019s freedom of choice to collaborate with the robot may also affect the perceived usability of the system.<\/jats:p>","DOI":"10.1145\/3524082","type":"journal-article","created":{"date-parts":[[2022,3,18]],"date-time":"2022-03-18T18:39:38Z","timestamp":1647628778000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":46,"title":["Design and Evaluation of an Augmented Reality Head-mounted Display Interface for Human Robot Teams Collaborating in Physically Shared Manufacturing Tasks"],"prefix":"10.1145","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6299-2098","authenticated-orcid":false,"given":"Wesley P.","family":"Chan","sequence":"first","affiliation":[{"name":"Monash University, Australia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8832-9449","authenticated-orcid":false,"given":"Geoffrey","family":"Hanks","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4110-2359","authenticated-orcid":false,"given":"Maram","family":"Sakr","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5897-2086","authenticated-orcid":false,"given":"Haomiao","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1815-0264","authenticated-orcid":false,"given":"Tiger","family":"Zuo","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1355-980X","authenticated-orcid":false,"given":"H. F. Machiel","family":"van der Loos","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, BC, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9639-5291","authenticated-orcid":false,"given":"Elizabeth","family":"Croft","sequence":"additional","affiliation":[{"name":"Monash University, Australia"}]}],"member":"320","published-online":{"date-parts":[[2022,7,13]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157815"},{"key":"e_1_3_2_3_2","first-page":"294","volume-title":"IEEE International Workshop on Robot and Human Communication (ROMAN)","author":"Andersen Rasmus S.","year":"2016","unstructured":"Rasmus S. Andersen, Ole Madsen, Thomas B. Moeslund, and Heni Ben Amor. 2016. Projecting robot intentions into human environments. In IEEE International Workshop on Robot and Human Communication (ROMAN). 294\u2013301."},{"key":"e_1_3_2_4_2","unstructured":"J. Brooke. 1996. SUS: a \u201cquick and dirty\u201d usability scale. In Usability Evaluation in Industry P. W. Jordan B. Thomas B. A. Weerdmeester and A. L. McClelland (Eds.). Taylor and Francis."},{"key":"e_1_3_2_5_2","article-title":"An augmented reality human-robot physical collaboration interface design for shared, large-scale, labour-intensive manufacturing tasks","author":"Chan Wesley P.","year":"2020","unstructured":"Wesley P. Chan, Geoffrey Hanks, Maram Sakr, Tiger Zuo, H. F. Machiel Van der Loos, and Elizabeth A. Croft. 2020. An augmented reality human-robot physical collaboration interface design for shared, large-scale, labour-intensive manufacturing tasks. In IEEE International Workshop on Intelligent Robots and Systems (IROS).","journal-title":"IEEE International Workshop on Intelligent Robots and Systems (IROS)"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2008.05.002"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-29363-9_28"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/IECON.2013.6700441"},{"key":"e_1_3_2_9_2","article-title":"Five-point Likert items: T test versus Mann-Whitney-Wilcoxon","volume":"15","author":"Winter Joost de","year":"2010","unstructured":"Joost de Winter and Dimitra Dodou. 2010. Five-point Likert items: T test versus Mann-Whitney-Wilcoxon. Pract. Assess., Res. Eval. 15 (2010).","journal-title":"Pract. Assess., Res. Eval."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2713168.2713169"},{"key":"e_1_3_2_11_2","unstructured":"Retrieved from: https:\/\/epson.com\/moverio-augmented-reality 2018 Augmented Reality and Mixed Reality"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40436-014-0087-9"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2016.7745146"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2013.6483609"},{"key":"e_1_3_2_15_2","unstructured":"Jason M. Gregory Christopher Reardon Kevin Lee Geoffrey White Ki Ng and Caitlyn Sims. 2019. Enabling intuitive human-robot teaming using augmented reality and gesture control. arXiv:1909.06415 [cs.RO]."},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2017.09.048"},{"key":"e_1_3_2_17_2","first-page":"139","volume-title":"Advances in Psychology","author":"Hart Sandra G.","year":"1988","unstructured":"Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (task load index): Results of empirical and theoretical research. In Advances in Psychology, Vol. 52. Elsevier, 139\u2013183."},{"key":"e_1_3_2_18_2","first-page":"521","volume-title":"IEEE International Workshop on Robot and Human Communication (ROMAN).","author":"Heerink M.","year":"2006","unstructured":"M. Heerink, B. Krose, V. Evers, and B. Wielinga. 2006. The influence of a robot\u2019s social abilities on acceptance by elderly users. In IEEE International Workshop on Robot and Human Communication (ROMAN).521\u2013526."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.245"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR-Adjunct.2016.0097"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.4108\/ICST.PERVASIVEHEALTH2010.8892"},{"key":"e_1_3_2_22_2","first-page":"127","volume-title":"SID Symposium Digest of Technical Papers","author":"Kress Bernard C.","year":"2017","unstructured":"Bernard C. Kress and William J. Cummings. 2017. Towards the ultimate mixed reality experience: HoloLens display architecture choices. In SID Symposium Digest of Technical Papers, Vol. 48. 127\u2013131."},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89350-9_6"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCE.2015.7177800"},{"key":"e_1_3_2_25_2","unstructured":"Retrieved from https:\/\/www.magicleap.com\/ 2018 Magic Leap"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/RIOS.2018.8406626"},{"key":"e_1_3_2_27_2","unstructured":"Retrieved from https:\/\/moveit.ros.org\/ 2019 MoveIt"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40436-017-0184-7"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2019.101820"},{"key":"e_1_3_2_30_2","first-page":"1838","article-title":"Robot programming through augmented trajectories in augmented reality","author":"Quintero Camilo Perez","year":"2018","unstructured":"Camilo Perez Quintero, Sarah Li, Matthew K. X. J. Pan, Wesley P. Chan, H. F. Machiel Van der Loos, and Elizabeth A. Croft. 2018. Robot programming through augmented trajectories in augmented reality. In IEEE International Workshop on Intelligent Robots and Systems (IROS).1838\u20131844.","journal-title":"IEEE International Workshop on Intelligent Robots and Systems (IROS)."},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/SSRR.2018.8468622"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2019.8673173"},{"key":"e_1_3_2_33_2","unstructured":"Retrieved from https:\/\/github.com\/siemens\/ros-sharp 2017 ros-sharp"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS45743.2020.9340822"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919842925"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/C2010-0-65192-3"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.9781\/ijimai.2017.445"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2016.7745108"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3171221.3171253"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2019.8673306"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40436-015-0131-4"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2012.09.013"},{"key":"e_1_3_2_43_2","volume-title":"Robotics: Science and Systems","author":"Wilcox Ronald","year":"2012","unstructured":"Ronald Wilcox, Stefanos Nikolaidis, and Julie Shah. 2012. Optimization of temporal dynamics for adaptive human-robot interaction in assembly manufacturing. In Robotics: Science and Systems."}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524082","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3524082","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:05Z","timestamp":1750188665000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3524082"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,13]]},"references-count":42,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3524082"],"URL":"https:\/\/doi.org\/10.1145\/3524082","relation":{},"ISSN":["2573-9522","2573-9522"],"issn-type":[{"value":"2573-9522","type":"print"},{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,13]]},"assertion":[{"value":"2020-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}