{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T08:55:21Z","timestamp":1773392121412,"version":"3.50.1"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,2,15]],"date-time":"2023-02-15T00:00:00Z","timestamp":1676419200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["IIS-1909864 and CNS-1810631"],"award-info":[{"award-number":["IIS-1909864 and CNS-1810631"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2023,3,31]]},"abstract":"<jats:p>Mixed Reality provides a powerful medium for transparent and effective human-robot communication, especially for robots with significant physical limitations (e.g., those without arms). To enhance nonverbal capabilities for armless robots, this article presents two studies that explore two different categories of mixed reality deictic gestures for armless robots: a virtual arrow positioned over a target referent (a non-ego-sensitive allocentric gesture) and a virtual arm positioned over the gesturing robot (an ego-sensitive allocentric gesture). In Study 1, we explore the tradeoffs between these two types of gestures with respect to both objective performance and subjective social perceptions. Our results show fundamentally different task-oriented versus social benefits, with non-ego-sensitive allocentric gestures enabling faster reaction time and higher accuracy, but ego-sensitive gestures enabling higher perceived social presence, anthropomorphism, and likability. In Study 2, we refine our design recommendations by showing that in fact these different gestures should not be viewed as mutually exclusive alternatives, and that by using them together, robots can achieve both task-oriented and social benefits.<\/jats:p>","DOI":"10.1145\/3563387","type":"journal-article","created":{"date-parts":[[2022,9,13]],"date-time":"2022-09-13T14:12:03Z","timestamp":1663078323000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Best of Both Worlds? Combining Different Forms of Mixed Reality Deictic Gestures"],"prefix":"10.1145","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9530-4071","authenticated-orcid":false,"given":"Landon","family":"Brown","sequence":"first","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1081-0790","authenticated-orcid":false,"given":"Jared","family":"Hamilton","sequence":"additional","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8243-7411","authenticated-orcid":false,"given":"Zhao","family":"Han","sequence":"additional","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4752-0383","authenticated-orcid":false,"given":"Albert","family":"Phan","sequence":"additional","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2442-5292","authenticated-orcid":false,"given":"Thao","family":"Phung","sequence":"additional","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2526-5828","authenticated-orcid":false,"given":"Eric","family":"Hansen","sequence":"additional","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6352-3659","authenticated-orcid":false,"given":"Nhan","family":"Tran","sequence":"additional","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7921-771X","authenticated-orcid":false,"given":"Tom","family":"Williams","sequence":"additional","affiliation":[{"name":"Colorado School of Mines, Golden, CO, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,2,15]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.6.1.Admoni"},{"key":"e_1_3_2_3_2","volume-title":"Proceedings of the Annual Meeting of the Cognitive Science Society","volume":"27","author":"Bangerter Adrian","year":"2005","unstructured":"Adrian Bangerter and Max M. Louwerse. 2005. Focusing attention with deictic gestures and linguistic expressions. In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol. 27."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-008-0001-3"},{"key":"e_1_3_2_5_2","volume-title":"Language and Context: The Acquisition of Pragmatics","author":"Bates Elizabeth","year":"1976","unstructured":"Elizabeth Bates. 1976. Language and Context: The Acquisition of Pragmatics. Academic Press."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1162\/105474603322761270"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2005.1545011"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1121241.1121292"},{"key":"e_1_3_2_9_2","first-page":"229","article-title":"Nonverbal signals","volume":"2","author":"Burgoon Judee K.","year":"1994","unstructured":"Judee K. Burgoon and Gregory D. Hoobler. 1994. Nonverbal signals. Handbook of Interpersonal Communication 2 (1994), 229\u2013285.","journal-title":"Handbook of Interpersonal Communication"},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"Rehj Cantrell Paul Schermerhorn and Matthias Scheutz. 2011. Learning actions from human-robot dialogues. In Proceeding of the International Symposium on Robot-Human Interactive Communication (RO-MAN). IEEE 125\u2013130.","DOI":"10.1109\/ROMAN.2011.6005199"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020208"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1561\/2300000057"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ECMR.2015.7403771"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0305000900002099"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1177\/1461445605054404"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1080\/01690965.2011.567074"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781315137421"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/948496.948519"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1037\/xap0000092"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/ISMAR.2017.28","volume-title":"2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR\u201917)","author":"Diaz Catherine","year":"2017","unstructured":"Catherine Diaz, Michael Walker, Danielle Albers Szafir, and Daniel Szafir. 2017. Designing for depth perceptions in augmented reality. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR\u201917). IEEE, 111\u2013122."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/782896.782913"},{"key":"e_1_3_2_22_2","unstructured":"Brian R. Duffy. 2002. Anthropomorphism and robotics. Robotics and Autonomous Systems 20 (2002)."},{"issue":"1","key":"e_1_3_2_23_2","first-page":"1","article-title":"Where to next? The impact of COVID-19 on human-robot interaction research","volume":"10","author":"Feil-Seifer David","year":"2020","unstructured":"David Feil-Seifer, Kerstin S. Haring, Silvia Rossi, Alan R. Wagner, and Tom Williams. 2020. Where to next? The impact of COVID-19 on human-robot interaction research. ACM Transactions on Human-Robot Interaction (THRI) 10, 1 (2020), 1\u20137.","journal-title":"ACM Transactions on Human-Robot Interaction (THRI)"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34103-8_20"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2006.11.005"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(02)00372-X"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2017.00020"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2018.2815655"},{"key":"e_1_3_2_29_2","volume-title":"5th International Workshop on Virtual, Augmented, and Mixed Reality for HRI","author":"Goktan Ipek","year":"2022","unstructured":"Ipek Goktan, Karen Ly, Thomas Roy Groechel, and Maja Mataric. 2022. Augmented reality appendages for robots: Design considerations and recommendations for maximizing social and functional perception. In 5th International Workshop on Virtual, Augmented, and Mixed Reality for HRI."},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(99)01397-2"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN46459.2019.8956458"},{"key":"e_1_3_2_32_2","article-title":"TOKCS: Tool for organizing key characteristics of VAM-HRI systems","author":"Groechel Thomas R.","year":"2021","unstructured":"Thomas R. Groechel, Michael E. Walker, Christine T. Chang, Eric Rosen, and Jessica Zosa Forde. 2021. TOKCS: Tool for organizing key characteristics of VAM-HRI systems. arXiv preprint arXiv:2108.03477 (2021).","journal-title":"arXiv preprint arXiv:2108.03477"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434073.3444676"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811417254"},{"key":"e_1_3_2_35_2","volume-title":"Gesture and Speech in Interaction (GESPIN\u201911)","author":"Harrison Simon","year":"2011","unstructured":"Simon Harrison. 2011. The creation and implementation of a gesture code for factory communication. In Gesture and Speech in Interaction (GESPIN\u201911)."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2006.11.018"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-010-0068-5"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11002-019-09485-9"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2559636.2563710"},{"key":"e_1_3_2_40_2","first-page":"97","article-title":"5 Deixis","author":"Levinson Stephen C.","year":"2004","unstructured":"Stephen C. Levinson. 2004. 5 Deixis. Handbook of Pragmatics (2004), 97.","journal-title":"Handbook of Pragmatics"},{"issue":"2","key":"e_1_3_2_41_2","first-page":"JCMC321","article-title":"At the heart of it all: The concept of presence","volume":"3","author":"Lombard Matthew","year":"1997","unstructured":"Matthew Lombard and Theresa Ditton. 1997. At the heart of it all: The concept of presence. Journal of Computer-mediated Communication 3, 2 (1997), JCMC321.","journal-title":"Journal of Computer-mediated Communication"},{"key":"e_1_3_2_42_2","first-page":"1","volume-title":"2014 IEEE International Symposium on Ethics in Science, Technology and Engineering","author":"Malle Bertram F.","year":"2014","unstructured":"Bertram F. Malle and Matthias Scheutz. 2014. Moral competence in social robots. In 2014 IEEE International Symposium on Ethics in Science, Technology and Engineering. IEEE, 1\u20136."},{"key":"e_1_3_2_43_2","unstructured":"William Marslen-Wilson Elena Levy and Lorraine K. Tyler. 1982. Producing interpretable discourse: The establishment and maintenance of reference. In Proceeding of the Speech Place and Action. Studies in Deixis and Related Topics Robert J. Jarvella and Wolfgang Klein (Eds.). John Wiley & Sons Ltd Chichester 339\u2013378."},{"key":"e_1_3_2_44_2","unstructured":"S. Math\u00f4t. 2017. Bayes Like a Baws: Interpreting Bayesian Repeated Measures in JASP [Blog Post]. https:\/\/www.cogsci.nl\/blog\/interpreting-bayesian-repeated-measures-in-jasp."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2014.09.031"},{"key":"e_1_3_2_46_2","unstructured":"R. D. Morey and J. N. Rouder. 2014. BayesFactor (Version 0.9.9)."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1177\/1470357211398439"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1162\/105474603322761289"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/1514095.1514108"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2010.01102.x"},{"key":"e_1_3_2_51_2","first-page":"1","volume-title":"2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR\u201918)","author":"Reardon Christopher","year":"2018","unstructured":"Christopher Reardon, Kevin Lee, and Jonathan Fink. 2018. Come see this! Augmented reality to enable human-robot cooperative search. In 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR\u201918). IEEE, 1\u20137."},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-009-0028-2"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-25554-5_57"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2012.08.001"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-013-0196-9"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-011-0124-9"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/2559636.2559657"},{"key":"e_1_3_2_58_2","article-title":"Warmth and competence to predict human preference of robot behavior in physical human-robot interaction","author":"Scheunemann Marcus M.","year":"2020","unstructured":"Marcus M. Scheunemann, Raymond H. Cuijpers, and Christoph Salge. 2020. Warmth and competence to predict human preference of robot behavior in physical human-robot interaction. arXiv preprint arXiv:2008.05799 (2020).","journal-title":"arXiv preprint arXiv:2008.05799"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-006-9018-3"},{"key":"e_1_3_2_60_2","first-page":"43","volume-title":"2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201918)","author":"Sibirtseva Elena","year":"2018","unstructured":"Elena Sibirtseva, Dimosthenis Kontogiorgos, Olov Nykvist, Hakan Karaoguz, Iolanda Leite, Joakim Gustafson, and Danica Kragic. 2018. A comparison of visualisation methods for disambiguating verbal requests in human-robot interaction. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201918). IEEE, 43\u201350."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1080\/15213260701533102"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/2696454.2696475"},{"key":"e_1_3_2_63_2","unstructured":"JASP Team. 2018. JASP (Version 0.8.5.1)[Computer Software]."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-control-101119-071628"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-90525-5_69"},{"key":"e_1_3_2_66_2","volume-title":"Proceedings of the 3rd International Workshop on Virtual, Augmented, and Mixed Reality for HRI","author":"Tran Nhan","year":"2019","unstructured":"Nhan Tran, Kai Mizuno, Trevor Grant, Thao Phung, Leanne Hirshfield, and Tom Williams. 2019. Exploring mixed reality robot communication under different types of mental workload. In Proceedings of the 3rd International Workshop on Virtual, Augmented, and Mixed Reality for HRI."},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.3402\/ejpt.v6.25216"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-017-1343-3"},{"key":"e_1_3_2_69_2","article-title":"Virtual, augmented, and mixed reality for human-robot interaction: A survey and virtual design element taxonomy","author":"Walker Michael","year":"2022","unstructured":"Michael Walker, Thao Phung, Tathagata Chakraborti, Tom Williams, and Daniel Szafir. 2022. Virtual, augmented, and mixed reality for human-robot interaction: A survey and virtual design element taxonomy. arXiv preprint arXiv:2202.11249 (2022).","journal-title":"arXiv preprint arXiv:2202.11249"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2015.7354195"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2014.01.005"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793638"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.5555\/3378680.3378710"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-21565-1_12"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-21565-1_12"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.5555\/3016387.3016462"},{"key":"e_1_3_2_77_2","volume-title":"Proceedings of the Oxford Handbook of Reference","author":"Williams Tom","year":"2019","unstructured":"Tom Williams and Matthias Scheutz. 2019. Reference in robotics: A givenness hierarchy theoretic approach. In Proceedings of the Oxford Handbook of Reference, Jeanette Gundel and Barbara Abbott (Eds.). Oxford University Press, 457\u2013474."},{"key":"e_1_3_2_78_2","volume-title":"Proceedings of the 2nd International Workshop on Virtual, Augmented, and Mixed Reality for HRI","author":"Williams Tom","year":"2019","unstructured":"Tom Williams, Daniel Szafir, and Tathagata Chakraborti. 2019. The reality-virtuality interaction cube. In Proceedings of the 2nd International Workshop on Virtual, Augmented, and Mixed Reality for HRI."},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173386.3173561"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3171221.3171246"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91581-4_19"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3563387","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3563387","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:35Z","timestamp":1750182575000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3563387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,15]]},"references-count":80,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3,31]]}},"alternative-id":["10.1145\/3563387"],"URL":"https:\/\/doi.org\/10.1145\/3563387","relation":{},"ISSN":["2573-9522","2573-9522"],"issn-type":[{"value":"2573-9522","type":"print"},{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,15]]},"assertion":[{"value":"2022-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}