{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T15:08:05Z","timestamp":1777734485739,"version":"3.51.4"},"reference-count":91,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T00:00:00Z","timestamp":1719532800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100014013","name":"UKRI","doi-asserted-by":"crossref","award":["EP\/V026682\/1"],"award-info":[{"award-number":["EP\/V026682\/1"]}],"id":[{"id":"10.13039\/100014013","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2024,6,30]]},"abstract":"<jats:p>Controlling assistive robots can be challenging for some users, especially those lacking relevant experience. Augmented Reality (AR) User Interfaces (UIs) have the potential to facilitate this task. Although extensive research regarding legged manipulators exists, comparatively little is on their UIs. Most existing UIs leverage traditional control interfaces such as joysticks, Hand-Held (HH) controllers and 2D UIs. These interfaces not only risk being unintuitive, thus discouraging interaction with the robot partner, but also draw the operator\u2019s focus away from the task and towards the UI. This shift in attention raises additional safety concerns, particularly in potentially hazardous environments where legged manipulators are frequently deployed. Moreover, traditional interfaces limit the operators\u2019 availability to use their hands for other tasks. Towards overcoming these limitations, in this article, we provide a user study comparing an AR Head-Mounted Display (HMD) UI we developed for controlling a legged manipulator against off-the-shelf control methods for such robots. This user study involved 27 participants and 135 trials, from which we gathered over 405 completed questionnaires. These trials involved multiple navigation and manipulation tasks with varying difficulty levels using a Boston Dynamics\u2019s Spot, a 7 df Kinova robot arm and a Robotiq 2F-85 gripper that we integrated into a legged manipulator. We made the comparison between UIs across multiple dimensions relevant to a successful human\u2013robot interaction. These dimensions include cognitive workload, technology acceptance, fluency, system usability, immersion and trust. Our study employed a factorial experimental design with participants undergoing five different conditions, generating longitudinal data. Due to potential unknown distributions and outliers in such data, using parametric methods for its analysis is questionable, and while non-parametric alternatives exist, they may lead to reduced statistical power. Therefore, to analyse the data that resulted from our experiment, we chose Bayesian data analysis as an effective alternative to address these limitations. Our results show that AR UIs can outpace HH-based control methods and reduce the cognitive requirements when designers include hands-free interactions and cognitive offloading principles into the UI. Furthermore, the use of the AR UI together with our cognitive offloading feature resulted in higher usability scores and significantly higher fluency and Technology Acceptance Model scores. Regarding immersion, our results revealed that the response values for the AR Immersion questionnaire associated with the AR UI are significantly higher than those associated with the HH UI, regardless of the main interaction method with the former, i.e., hand gestures or cognitive offloading. Derived from the participants\u2019 qualitative answers, we believe this is due to a combination of factors, of which the most important is the free use of the hands when using the HMD, as well as the ability to see the real environment without the need to divert their attention to the UI. Regarding trust, our findings did not display discernible differences in reported trust scores across UI options. However, during the manipulation phase of our user study, where participants were given the choice to select their preferred UI, they consistently reported higher levels of trust compared to the navigation category. Moreover, there was a drastic change in the percentage of participants that selected the AR UI for completing this manipulation stage after incorporating the cognitive offloading feature. Thus, trust seems to have mediated the use and non-use of the UIs in a dimension different from the ones considered in our study, i.e., delegation and reliance. Therefore, our AR HMD UI for the control of legged manipulators was found to improve human\u2013robot interaction across several relevant dimensions, underscoring the critical role of UI design in the effective and trustworthy utilisation of robotic systems.<\/jats:p>","DOI":"10.1145\/3660649","type":"journal-article","created":{"date-parts":[[2024,4,22]],"date-time":"2024-04-22T20:01:56Z","timestamp":1713816116000},"page":"1-37","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Multi-Dimensional Evaluation of an Augmented Reality Head-Mounted Display User Interface for Controlling Legged Manipulators"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1300-6896","authenticated-orcid":false,"given":"Rodrigo","family":"Chac\u00f3n Quesada","sequence":"first","affiliation":[{"name":"Personal Robotics Laboratory, Imperial College London, London, United Kingdom"}]},{"given":"Yiannis","family":"Demiris","sequence":"additional","affiliation":[{"name":"Personal Robotics Laboratory, Imperial College London, London, United Kingdom"}]}],"member":"320","published-online":{"date-parts":[[2024,6,28]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2014.2371048"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2013.03.017"},{"key":"e_1_3_2_4_2","unstructured":"Anybotics. 2023. How to Hire an Industrial Inspection Robot. Retrieved from https:\/\/www.anybotics.com\/news\/how-to-hire-an-industrial-inspection-robot-part-1\/. Accessed: 2024-01."},{"key":"e_1_3_2_5_2","unstructured":"Apple. 2021. More to Explore with ARKit 5. Retrieved from https:\/\/developer.apple.com\/augmented-reality\/arkit\/. Accessed: 2021-09."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102575"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8794273"},{"key":"e_1_3_2_8_2","first-page":"194","article-title":"SUS-A quick and dirty usability scale","volume":"189","author":"Brooke John","year":"1996","unstructured":"John Brooke. 1996. SUS-A quick and dirty usability scale. Usability Evaluation in Industry 189, 194 (1996), 4\u20137.","journal-title":"Usability Evaluation in Industry"},{"key":"e_1_3_2_9_2","first-page":"329","volume-title":"Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR \u201914)","author":"Caetano Daniel","year":"2014","unstructured":"Daniel Caetano, Fernando Mattioli, Edgard Lamounier, and Alexandre Cardoso. 2014. [DEMO] On the use of augmented reality techniques in a telerehabilitation environment for wheelchair users\u2019 training. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR \u201914). 329\u2013330."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.14209\/jcis.2020.5"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS40897.2019.8968290"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS45743.2020.9341422"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS47612.2022.9981989"},{"key":"e_1_3_2_14_2","first-page":"11950","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA \u201923)","author":"Chacon Quesada Rodrigo","year":"2023","unstructured":"Rodrigo Chacon Quesada and Yiannis Demiris. 2023. Design and evaluation of an augmented reality head-mounted display user interface for controlling legged manipulators. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA \u201923), 11950\u201311956."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","unstructured":"Wesley P. Chan Morgan Crouch Khoa Hoang Charlie Chen Nicole Robinson and Elizabeth Croft. 2022. Design and implementation of a human-robot joint action framework using augmented reality and eye gaze. arXiv:2208.11856 Retrieved from 10.48550\/arXiv.2208.11856","DOI":"10.48550\/arXiv.2208.11856"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3524082"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434073.3444677"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.2307\/249008"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.35.8.982"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2021.3138384"},{"key":"e_1_3_2_21_2","volume-title":"Modeling Trust to Improve Human-Robot Interaction","author":"Desai Munjal","year":"2012","unstructured":"Munjal Desai. 2012. Modeling Trust to Improve Human-Robot Interaction. Ph.D. Dissertation. University of Massachusetts Lowell."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2013.6483596"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2011.09.003"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00170-012-4629-7"},{"key":"e_1_3_2_25_2","first-page":"677","article-title":"Assessing mental workload in industrial environments: A review of applied studies","volume":"492","author":"Anacleto Filho P. C.","year":"2023","unstructured":"P. C. Anacleto Filho, Lincoln da Silva, Ana Pombeiro, Nelson Costa, Paula Carneiro, and Pedro Arezes. 2023. Assessing mental workload in industrial environments: A review of applied studies. Occupational and Environmental Safety and Health V 492, (2023), 677\u2013689.","journal-title":"Occupational and Environmental Safety and Health V"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48891.2023.10160285"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2011.6005235"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2022.2041882"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2016.09.014"},{"key":"e_1_3_2_30_2","first-page":"210","article-title":"NASA task load index for human-robot interaction workload measurement","volume":"32","author":"Gomer Joshua A.","year":"2011","unstructured":"Joshua A. Gomer and Christopher C. Pagano. 2011. NASA task load index for human-robot interaction workload measurement. International Test and Evaluation Association Journal 32 (2011), 210\u2013214.","journal-title":"International Test and Evaluation Association Journal"},{"key":"e_1_3_2_31_2","unstructured":"Google. 2021. Cloud Anchors Overview for Android. Retrieved from https:\/\/developers.google.com\/ar\/develop\/java\/cloud-anchors\/overview-android. Accessed: 2021-09."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/KBSE.1996.552822"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811417254"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"e_1_3_2_35_2","first-page":"61","volume-title":"Proceedings of the 21st International Conference on Artificial Reality and Telexistence (ICAT \u201911)","volume":"2","author":"Hashimoto Sunao","year":"2011","unstructured":"Sunao Hashimoto, Akihiko Ishida, Masahiko Inami, and Takeo Igarashi. 2011. Touchme: An augmented reality based remote robot manipulation. In Proceedings of the 21st International Conference on Artificial Reality and Telexistence (ICAT \u201911), Vol. 2, 61\u201366."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-27928-8_23"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2019.2904558"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2007.907483"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3412374"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.24"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2019.8798010"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1207\/S15327566IJCE0401_04"},{"key":"e_1_3_2_43_2","first-page":"1","article-title":"How mobile touch devices foster cognitive offloading in the elderly: The effects of input and feedback","volume":"40","author":"Jin Tao","year":"2022","unstructured":"Tao Jin, Jiamin He, Wenrui Wang, Zhengxin Wu, and Haoran Gu. 2022. How mobile touch devices foster cognitive offloading in the elderly: The effects of input and feedback. International Journal of Human\u2013Computer Interaction 40, (2022), 1\u201311.","journal-title":"International Journal of Human\u2013Computer Interaction"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48891.2023.10161412"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8594509"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA48891.2023.10161095"},{"key":"e_1_3_2_47_2","volume-title":"Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan","author":"Kruschke John","year":"2014","unstructured":"John Kruschke. 2014. Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan, Academic Press."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0029146"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1177\/2515245918771304"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-016-1221-4"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-4488-0_58"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2015.7333607"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8594482"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140139208967392"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1117\/12.919751"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/RCAR.2016.7784014"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1080\/1463922X.2018.1491071"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.3390\/robotics9020021"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.21105\/joss.01541"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-12243-0_2"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.2307\/258792"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1201\/9780429029608"},{"key":"e_1_3_2_63_2","unstructured":"Microsoft. 2021. Spatial Anchors. Retrieved from https:\/\/azure.microsoft.com\/en-us\/services\/spatial-anchors\/#overview. Accessed: 2021-09."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.1993.583833"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.5555\/3378680.3378814"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3111055"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v050.i12"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2022.920844"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2021.102698"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2015.7333643"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/SSRR.2018.8468622"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2016.07.002"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS45743.2020.9340822"},{"key":"e_1_3_2_74_2","first-page":"1425","volume-title":"Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics","author":"Ruffo Kenneth","year":"1992","unstructured":"Kenneth Ruffo and Paul Milgram. 1992. Effect of stereographic + stereovideo \u2018tether\u2019 enhancement for a peg-in-hole task. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. IEEE, 1425\u20131430."},{"key":"e_1_3_2_75_2","first-page":"176","volume-title":"Proceedings of the 17th ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201922)","author":"Salomons Nicole","year":"2022","unstructured":"Nicole Salomons, Kaitlynn T. Pineda, Ad\u00e9r\u00f3nk\u00e9 Ad\u00e9jare, and Brian Scassellati. 2022. \u201cWe make a great team!\u201d: Adults with low prior domain knowledge learn more from a peer robot than a tutor robot. In Proceedings of the 17th ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201922). IEEE, 176\u2013184."},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aat7544"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816634228"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364919866905"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOMW.2017.7917585"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517719"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/332040.332443"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-022-01814-7"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.46.2.186.11926"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1109\/NER.2017.8008377"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-28872-7_7"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020230"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2016.11.183"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2011.6005225"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2017.00060"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2017.05.017"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS40897.2019.8968117"},{"key":"e_1_3_2_92_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8594002"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660649","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3660649","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:22Z","timestamp":1750287022000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3660649"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,28]]},"references-count":91,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,6,30]]}},"alternative-id":["10.1145\/3660649"],"URL":"https:\/\/doi.org\/10.1145\/3660649","relation":{},"ISSN":["2573-9522"],"issn-type":[{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,28]]},"assertion":[{"value":"2023-07-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-15","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}