{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T06:12:55Z","timestamp":1770531175203,"version":"3.49.0"},"reference-count":81,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T00:00:00Z","timestamp":1724630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2024,9,30]]},"abstract":"<jats:p>The creation of information transparency solutions to enable humans to understand robot perception is a challenging requirement for autonomous and artificially intelligent robots to impact a multitude of domains. By taking advantage of comprehensive and high-volume data from robot teammates\u2019 advanced perception and reasoning capabilities, humans will be able to make better decisions, with significant impacts from safety to functionality. We present a solution to this challenge by coupling augmented reality (AR) with an intelligent mobile robot that is autonomously detecting novel changes in an environment. We show that the human teammate can understand and make decisions based on information shared via AR by the robot. Sharing of robot-perceived information is enabled by the robot\u2019s online calculation of the human\u2019s relative position, making the system robust to environments without external instrumentation such as global positioning system. Our robotic system performs change detection by comparing current metric sensor readings against a previous reading to identify differences. We experimentally explore the design of change detection visualizations and the aggregation of information, the impact of instruction on communication understanding, the effects of visualization and alignment error, and the relationship between situated 3D visualization in AR and human movement in the operational environment on shared situational awareness in human-robot teams. We demonstrate this novel capability and assess the effectiveness of human-robot teaming in crowdsourced data-driven studies, as well as an in-person study where participants are equipped with a commercial off-the-shelf AR headset and teamed with a small ground robot that maneuvers through the environment. The mobile robot scans for changes, which are visualized via AR to the participant. The effectiveness of this communication is evaluated through accuracy and subjective assessment metrics to provide insight into interpretation and experience.<\/jats:p>","DOI":"10.1145\/3611654","type":"journal-article","created":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T12:16:01Z","timestamp":1692620161000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Augmented Reality Visualization of Autonomous Mobile Robot Change Detection in Uninstrumented Environments"],"prefix":"10.1145","volume":"13","author":[{"given":"Christopher","family":"Reardon","sequence":"first","affiliation":[{"name":"University of Denver, USA"}]},{"given":"Jason M.","family":"Gregory","sequence":"additional","affiliation":[{"name":"DEVCOM Army Research Laboratory, Denver, USA"}]},{"given":"Kerstin S.","family":"Haring","sequence":"additional","affiliation":[{"name":"University of Denver, Denver, USA"}]},{"given":"Benjamin","family":"Dossett","sequence":"additional","affiliation":[{"name":"University of Denver, Denver, USA"}]},{"given":"Ori","family":"Miller","sequence":"additional","affiliation":[{"name":"University of Denver, Denver, USA"}]},{"given":"Aniekan","family":"Inyang","sequence":"additional","affiliation":[{"name":"University of Denver, Denver, USA"}]}],"member":"320","published-online":{"date-parts":[[2024,8,26]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"1","volume-title":"Proceedings of the AAAI Fall Symposium","author":"Adams Julie A.","year":"2002","unstructured":"Julie A. Adams. 2002. Critical considerations for human-robot interface development. In Proceedings of the AAAI Fall Symposium. 1\u20138."},{"issue":"5","key":"e_1_3_1_3_2","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1007\/s10514-017-9677-2","article-title":"Progress and prospects of the human\u2013robot collaboration","volume":"42","author":"Ajoudani Arash","year":"2018","unstructured":"Arash Ajoudani, Andrea Maria Zanchettin, Serena Ivaldi, Alin Albu-Sch\u00e4ffer, Kazuhiro Kosuge, and Oussama Khatib. 2018. Progress and prospects of the human\u2013robot collaboration. Auton. Robots 42, 5 (2018), 957\u2013975.","journal-title":"Auton. Robots"},{"key":"e_1_3_1_4_2","first-page":"678","volume-title":"Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction","author":"Angelopoulos Angelos","year":"2022","unstructured":"Angelos Angelopoulos, Austin Hale, Husam Shaik, Akshay Paruchuri, Ken Liu, Randal Tuggle, and Daniel Szafir. 2022. Drone brush: Mixed reality drone path planning. In Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction. 678\u2013682."},{"key":"e_1_3_1_5_2","first-page":"109","volume-title":"Proceedings of the 7th Annual ACM\/IEEE International Conference on Human-Robot Interaction","author":"Billings Deborah R.","year":"2012","unstructured":"Deborah R. Billings, Kristin E. Schaefer, Jessie Y. C. Chen, and Peter A. Hancock. 2012. Human-robot interaction: Developing trust in robots. In Proceedings of the 7th Annual ACM\/IEEE International Conference on Human-Robot Interaction. 109\u2013110."},{"issue":"2","key":"e_1_3_1_6_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MCG.2007.323435","article-title":"Rainbow color map (still) considered harmful","volume":"27","author":"Borland David","year":"2007","unstructured":"David Borland and Russell M. Taylor Ii. 2007. Rainbow color map (still) considered harmful. IEEE Comput. Graph. Appl. 27, 2 (2007), 14\u201317.","journal-title":"IEEE Comput. Graph. Appl."},{"key":"e_1_3_1_7_2","first-page":"708","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Breazeal Cynthia","year":"2005","unstructured":"Cynthia Breazeal, Cory D. Kidd, Andrea Lockerd Thomaz, Guy Hoffman, and Matt Berlin. 2005. Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems. IEEE, 708\u2013713."},{"key":"e_1_3_1_8_2","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1109\/INFVIS.1997.636792","volume-title":"Proceedings of the Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium (VIZ\u201997)","author":"Card Stuart K.","year":"1997","unstructured":"Stuart K. Card and Jock Mackinlay. 1997. The structure of the information visualization design space. In Proceedings of the Visualization Conference, Information Visualization Symposium and Parallel Rendering Symposium (VIZ\u201997). IEEE, 92\u201399."},{"key":"e_1_3_1_9_2","first-page":"3222","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201919)","author":"Chacko Sonia Mary","year":"2019","unstructured":"Sonia Mary Chacko and Vikram Kapila. 2019. An augmented reality interface for human-robot interaction in unconstrained environments. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201919). IEEE, 3222\u20133228."},{"key":"e_1_3_1_10_2","first-page":"3787","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201921)","author":"Chandan Kishan","year":"2021","unstructured":"Kishan Chandan, Vidisha Kudalkar, Xiang Li, and Shiqi Zhang. 2021. ARROCH: Augmented reality for robots collaborating with a human. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201921). IEEE, 3787\u20133793."},{"issue":"6","key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1109\/TSMCC.2007.905819","article-title":"Human performance issues and user interface design for teleoperated robots","volume":"37","author":"Chen Jessie Y. C.","year":"2007","unstructured":"Jessie Y. C. Chen, Ellen C. Haas, and Michael J. Barnes. 2007. Human performance issues and user interface design for teleoperated robots. IEEE Trans. Syst., Man, Cybernet., Part C (Appl. Rev.) 37, 6 (2007), 1231\u20131245.","journal-title":"IEEE Trans. Syst., Man, Cybernet., Part C (Appl. Rev.)"},{"key":"e_1_3_1_12_2","volume-title":"Factor Graphs and GTSAM: A Hands-on Introduction","author":"Dellaert Frank","year":"2012","unstructured":"Frank Dellaert. 2012. Factor Graphs and GTSAM: A Hands-on Introduction. Technical Report. Georgia Institute of Technology."},{"issue":"7","key":"e_1_3_1_13_2","doi-asserted-by":"crossref","first-page":"1171","DOI":"10.1002\/rob.21887","article-title":"The current state and future outlook of rescue robotics","volume":"36","author":"Delmerico Jeffrey","year":"2019","unstructured":"Jeffrey Delmerico, Stefano Mintchev, Alessandro Giusti, Boris Gromov, Kamilo Melo, Tomislav Horvat, Cesar Cadena, Marco Hutter, Auke Ijspeert, Dario Floreano, et\u00a0al. 2019. The current state and future outlook of rescue robotics. J. Field Robot. 36, 7 (2019), 1171\u20131191.","journal-title":"J. Field Robot."},{"key":"e_1_3_1_14_2","doi-asserted-by":"crossref","first-page":"102436","DOI":"10.1016\/j.ijhcs.2020.102436","article-title":"Understanding human-robot teams in light of all-human teams: Aspects of team interaction and shared cognition","volume":"140","author":"Demir Mustafa","year":"2020","unstructured":"Mustafa Demir, Nathan J. McNeese, and Nancy J. Cooke. 2020. Understanding human-robot teams in light of all-human teams: Aspects of team interaction and shared cognition. Int. J. Hum.-Comput. Studies 140 (2020), 102436.","journal-title":"Int. J. Hum.-Comput. Studies"},{"key":"e_1_3_1_15_2","first-page":"114260M","volume-title":"Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations","author":"Dennison Mark","year":"2020","unstructured":"Mark Dennison, Christopher Reardon, Jason Gregory, Theron Trout, and John G. Rogers III. 2020. Creating a mixed reality common operating picture across C2 echelons for human-autonomy teams. In Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations, Vol. 11426. International Society for Optics and Photonics, 114260M."},{"key":"e_1_3_1_16_2","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1007\/s40436-014-0087-9","article-title":"Novel AR-based interface for human-robot interaction and visualization","volume":"2","author":"Fang H. C.","year":"2014","unstructured":"H. C. Fang, Soh-Khim Ong, and Andrew Y. C. Nee. 2014. Novel AR-based interface for human-robot interaction and visualization. Adv. Manufact. 2 (2014), 275\u2013288.","journal-title":"Adv. Manufact."},{"issue":"12","key":"e_1_3_1_17_2","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1287\/mnsc.46.12.1554.12072","article-title":"Coordinating expertise in software development teams","volume":"46","author":"Faraj Samer","year":"2000","unstructured":"Samer Faraj and Lee Sproull. 2000. Coordinating expertise in software development teams. Manage. Sci. 46, 12 (2000), 1554\u20131568.","journal-title":"Manage. Sci."},{"issue":"2","key":"e_1_3_1_18_2","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1145\/1052438.1052462","article-title":"Interaction challenges in human-robot space exploration","volume":"12","author":"Fong Terrence","year":"2005","unstructured":"Terrence Fong and Illah Nourbakhsh. 2005. Interaction challenges in human-robot space exploration. Interactions 12, 2 (2005), 42\u201345.","journal-title":"Interactions"},{"key":"e_1_3_1_19_2","first-page":"117","volume-title":"Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference","volume":"48051","author":"Green Scott A.","year":"2007","unstructured":"Scott A. Green, Mark Billinghurst, XiaoQi Chen, and J. Geoffrey Chase. 2007. Human robot collaboration: An augmented reality approach\u2013a literature review and analysis. In Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Vol. 48051. 117\u2013126."},{"issue":"1","key":"e_1_3_1_20_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5772\/5664","article-title":"Human-robot collaboration: A literature review and augmented reality approach in design","volume":"5","author":"Green Scott A.","year":"2008","unstructured":"Scott A. Green, Mark Billinghurst, XiaoQi Chen, and J. Geoffrey Chase. 2008. Human-robot collaboration: A literature review and augmented reality approach in design. Int. J. Adv. Robot. Syst. 5, 1 (2008), 1.","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/978-3-319-27702-8_42","volume-title":"Field and Service Robotics","author":"Gregory Jason","year":"2016","unstructured":"Jason Gregory, Jonathan Fink, Ethan Stump, Jeffrey Twigg, John Rogers, David Baran, Nicholas Fung, and Stuart Young. 2016. Application of multi-robot systems to disaster-relief scenarios with limited communication. In Field and Service Robotics. Springer, 639\u2013653."},{"key":"e_1_3_1_22_2","article-title":"Enabling intuitive human-robot teaming using augmented reality and gesture control","author":"Gregory Jason M.","year":"2019","unstructured":"Jason M. Gregory, Christopher Reardon, Kevin Lee, Geoffrey White, Ki Ng, and Caitlyn Sims. 2019. Enabling intuitive human-robot teaming using augmented reality and gesture control. Retrieved from https:\/\/arXiv:1909.06415","journal-title":"R"},{"issue":"3","key":"e_1_3_1_23_2","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1075\/is.8.3.10gro","article-title":"Can robots be teammates?: Benchmarks in human\u2013robot teams","volume":"8","author":"Groom Victoria","year":"2007","unstructured":"Victoria Groom and Clifford Nass. 2007. Can robots be teammates?: Benchmarks in human\u2013robot teams. Interact. Studies 8, 3 (2007), 483\u2013500.","journal-title":"Interact. Studies"},{"key":"e_1_3_1_24_2","volume-title":"Proceedings of the 1st International Workshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI\u201918)","author":"Haring Kerstin S.","year":"2018","unstructured":"Kerstin S. Haring, Victor Finomore, Dylan Muramoto, Nathan L. Tenhundfeld, J. Wen, and B. Tidball. 2018. Analysis of using virtual reality (VR) for command and control applications of multi-robot systems. In Proceedings of the 1st International Workshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI\u201918)."},{"key":"e_1_3_1_25_2","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/B978-0-12-819472-0.00017-4","volume-title":"Trust in Human-Robot Interaction","author":"Haring Kerstin S.","year":"2021","unstructured":"Kerstin S. Haring, Elizabeth Phillips, Elizabeth H. Lazzara, Daniel Ullman, Anthony L. Baker, and Joseph R. Keebler. 2021. Applying the swift trust model to human-robot teaming. In Trust in Human-Robot Interaction. Elsevier, 407\u2013427."},{"issue":"4","key":"e_1_3_1_26_2","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1109\/TCDS.2018.2851569","article-title":"FFAB\u2014The form function attribution bias in human\u2013robot interaction","volume":"10","author":"Haring Kerstin S.","year":"2018","unstructured":"Kerstin S. Haring, Katsumi Watanabe, Mari Velonaki, Chad C. Tossell, and Victor Finomore. 2018. FFAB\u2014The form function attribution bias in human\u2013robot interaction. IEEE Trans. Cogn. Dev. Syst. 10, 4 (2018), 843\u2013851.","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"issue":"1","key":"e_1_3_1_27_2","first-page":"1","article-title":"Perspective and agency during video gaming influences spatial presence experience and brain activation patterns","volume":"8","author":"Havranek Michael","year":"2012","unstructured":"Michael Havranek, Nicolas Langer, Marcus Cheetham, and Lutz J\u00e4ncke. 2012. Perspective and agency during video gaming influences spatial presence experience and brain activation patterns. Behav. Brain Funct. 8, 1 (2012), 1\u201313.","journal-title":"Behav. Brain Funct."},{"issue":"9","key":"e_1_3_1_28_2","article-title":"Challenges in shared-environment human-robot collaboration","volume":"8","author":"Hayes Bradley","year":"2013","unstructured":"Bradley Hayes and Brian Scassellati. 2013. Challenges in shared-environment human-robot collaboration. Learning 8, 9 (2013).","journal-title":"Learning"},{"key":"e_1_3_1_29_2","first-page":"6434","volume-title":"Proceedings of the AIAA 1st Intelligent Systems Technical Conference","author":"Hoffman Guy","year":"2004","unstructured":"Guy Hoffman and Cynthia Breazeal. 2004. Collaboration in human-robot teams. In Proceedings of the AIAA 1st Intelligent Systems Technical Conference. 6434."},{"issue":"6","key":"e_1_3_1_30_2","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.5465\/amj.2008.35732995","article-title":"Facing differences with an open mind: Openness to experience, salience of intragroup differences, and performance of diverse work groups","volume":"51","author":"Homan Astrid C.","year":"2008","unstructured":"Astrid C. Homan, John R. Hollenbeck, Stephen E. Humphrey, Daan Van Knippenberg, Daniel R. Ilgen, and Gerben A Van Kleef. 2008. Facing differences with an open mind: Openness to experience, salience of intragroup differences, and performance of diverse work groups. Acad. Manage. J. 51, 6 (2008), 1204\u20131222.","journal-title":"Acad. Manage. J."},{"issue":"3","key":"e_1_3_1_31_2","doi-asserted-by":"crossref","first-page":"531","DOI":"10.2307\/259293","article-title":"The experience and evolution of trust: Implications for cooperation and teamwork","volume":"23","author":"Jones Gareth R.","year":"1998","unstructured":"Gareth R. Jones and Jennifer M. George. 1998. The experience and evolution of trust: Implications for cooperation and teamwork. Acad. Manage. Rev. 23, 3 (1998), 531\u2013546.","journal-title":"Acad. Manage. Rev."},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1145\/1121241.1121285","volume-title":"Proceedings of the 1st ACM SIGCHI\/SIGART Conference on Human-robot Interaction","author":"Kadous M. Waleed","year":"2006","unstructured":"M. Waleed Kadous, Raymond Ka-Man Sheh, and Claude Sammut. 2006. Effective user interface design for rescue robotics. In Proceedings of the 1st ACM SIGCHI\/SIGART Conference on Human-robot Interaction. 250\u2013257."},{"issue":"5","key":"e_1_3_1_33_2","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.robot.2010.02.003","article-title":"Human\u2013robot communication for collaborative decision making\u2013A probabilistic approach","volume":"58","author":"Kaupp Tobias","year":"2010","unstructured":"Tobias Kaupp, Alexei Makarenko, and Hugh Durrant-Whyte. 2010. Human\u2013robot communication for collaborative decision making\u2013A probabilistic approach. Robot. Auton. Syst. 58, 5 (2010), 444\u2013456.","journal-title":"Robot. Auton. Syst."},{"issue":"4","key":"e_1_3_1_34_2","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/s43154-020-00029-y","article-title":"Trust in robots: Challenges and opportunities","volume":"1","author":"Kok Bing Cai","year":"2020","unstructured":"Bing Cai Kok and Harold Soh. 2020. Trust in robots: Challenges and opportunities. Curr. Robot. Rep. 1, 4 (2020), 297\u2013309.","journal-title":"Curr. Robot. Rep."},{"key":"e_1_3_1_35_2","first-page":"160","volume-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"63","author":"Lakhmani Shan G.","year":"2019","unstructured":"Shan G. Lakhmani, Julia L. Wright, Michael R. Schwartz, and Daniel Barber. 2019. Exploring the effect of communication patterns and transparency on performance in a human-robot team. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 63. SAGE Publications, Los Angeles, CA, 160\u2013164."},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.obhdp.2017.08.001","article-title":"Does team communication represent a one-size-fits-all approach?: A meta-analysis of team communication and performance","volume":"144","author":"Marlow Shannon L.","year":"2018","unstructured":"Shannon L. Marlow, Christina N. Lacerenza, Jensine Paoletti, C. Shawn Burke, and Eduardo Salas. 2018. Does team communication represent a one-size-fits-all approach?: A meta-analysis of team communication and performance. Organiz. Behav. Hum. Decis. Process. 144 (2018), 145\u2013170.","journal-title":"Organiz. Behav. Hum. Decis. Process."},{"issue":"2","key":"e_1_3_1_37_2","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.robot.2004.10.006","article-title":"On-line novelty detection for autonomous mobile robots","volume":"51","author":"Marsland Stephen","year":"2005","unstructured":"Stephen Marsland, Ulrich Nehmzow, and Jonathan Shapiro. 2005. On-line novelty detection for autonomous mobile robots. Robot. Auton. Syst. 51, 2-3 (2005), 191\u2013206.","journal-title":"Robot. Auton. Syst."},{"issue":"4","key":"e_1_3_1_38_2","doi-asserted-by":"crossref","first-page":"100","DOI":"10.3390\/robotics8040100","article-title":"Human\u2013robot collaboration in manufacturing applications: A review","volume":"8","author":"Matheson Eloise","year":"2019","unstructured":"Eloise Matheson, Riccardo Minto, Emanuele G. G. Zampieri, Maurizio Faccio, and Giulio Rosati. 2019. Human\u2013robot collaboration in manufacturing applications: A review. Robotics 8, 4 (2019), 100.","journal-title":"Robotics"},{"key":"e_1_3_1_39_2","volume-title":"Proceedings of the 4th International Workshop on Virtual, Augmented, and Mixed Reality for HRI","author":"Mott Terran","year":"2021","unstructured":"Terran Mott, Thomas Williams, Hao Zhang, and Christopher Reardon. 2021. You have time to explore over here!: Augmented reality for enhanced situation awareness in human-robot collaborative exploration. In Proceedings of the 4th International Workshop on Virtual, Augmented, and Mixed Reality for HRI."},{"key":"e_1_3_1_40_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9407.001.0001","volume-title":"Disaster Robotics","author":"Murphy Robin R.","year":"2014","unstructured":"Robin R. Murphy. 2014. Disaster Robotics. MIT Press."},{"issue":"3","key":"e_1_3_1_41_2","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MCG.2006.70","article-title":"Toward measuring visualization insight","volume":"26","author":"North Chris","year":"2006","unstructured":"Chris North. 2006. Toward measuring visualization insight. IEEE Comput. Graph. Appl. 26, 3 (2006), 6\u20139.","journal-title":"IEEE Comput. Graph. Appl."},{"key":"e_1_3_1_42_2","first-page":"4724","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"N\u00fa\u00f1ez P","year":"2009","unstructured":"P N\u00fa\u00f1ez, P. Drews, R. Rocha, M. Campos, and Jorge Dias. 2009. Novelty detection and 3D shape retrieval based on Gaussian mixture models for autonomous surveillance robotics. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems. IEEE, 4724\u20134730."},{"key":"e_1_3_1_43_2","first-page":"1142607","volume-title":"Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations","author":"Paul Savannah","year":"2020","unstructured":"Savannah Paul, Christopher Reardon, Tom Williams, and Hao Zhang. 2020. Designing augmented reality visualizations for synchronized and time-dominant human-robot teaming. In Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations, Vol. 11426. International Society for Optics and Photonics, 1142607."},{"key":"e_1_3_1_44_2","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa F.","year":"2011","unstructured":"F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 12 (2011), 2825\u20132830.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","unstructured":"Elizabeth Kathleen Phillips and Florian G. Jentsch. 2017. Supporting situation awareness through robot-to-human information exchanges under conditions of visuospatial perspective taking. J. Hum.-Robot Interact. 6 3 (Dec 2017) 92\u2013117. 10.5898\/JHRI.6.3.Phillips","DOI":"10.5898\/JHRI.6.3.Phillips"},{"key":"e_1_3_1_46_2","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.sigpro.2013.12.026","article-title":"A review of novelty detection","volume":"99","author":"Pimentel Marco A. F.","year":"2014","unstructured":"Marco A. F. Pimentel, David A. Clifton, Lei Clifton, and Lionel Tarassenko. 2014. A review of novelty detection. Signal Process. 99 (2014), 215\u2013249.","journal-title":"Signal Process."},{"key":"e_1_3_1_47_2","first-page":"11413","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201920)","author":"Qiu Shuwen","year":"2020","unstructured":"Shuwen Qiu, Hangxin Liu, Zeyu Zhang, Yixin Zhu, and Song-Chun Zhu. 2020. Human-robot interaction in a shared augmented reality workspace. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201920). IEEE, 11413\u201311418."},{"key":"e_1_3_1_48_2","volume-title":"Proceedings of the International Conference on Robotics and Automation Workshop on Open Source Software","author":"Quigley Morgan","year":"2009","unstructured":"Morgan Quigley, Josh Faust, Tully Foote, and Jeremy Leibs. 2009. ROS: An open-source robot operating system. In Proceedings of the International Conference on Robotics and Automation Workshop on Open Source Software."},{"key":"e_1_3_1_49_2","first-page":"611","volume-title":"Proceedings of the International Conference on Human-Computer Interaction: Virtual, Augmented, and Mixed Reality","author":"Reardon Christopher","year":"2020","unstructured":"Christopher Reardon, Jason Gregory, Carlos Nieto-Granda, and John G. Rogers. 2020. Enabling situational awareness via augmented reality of autonomous robot-based environmental change detection. In Proceedings of the International Conference on Human-Computer Interaction: Virtual, Augmented, and Mixed Reality. Springer, 611\u2013628."},{"key":"e_1_3_1_50_2","first-page":"117590J","volume-title":"Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations II","author":"Reardon Christopher","year":"2021","unstructured":"Christopher Reardon, Jason Gregory, Carlos Nieto-Granda, and John G. Rogers III. 2021. Designing a mixed reality interface for autonomous robot-based change detection. In Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations II, Vol. 11759. International Society for Optics and Photonics, 117590J."},{"key":"e_1_3_1_51_2","first-page":"132","volume-title":"Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR\u201921)","author":"Reardon Christopher","year":"2021","unstructured":"Christopher Reardon, Kerstin Haring, Jason M. Gregory, and John G. Rogers. 2021. Evaluating human understanding of a mixed reality interface for autonomous robot-based change detection. In Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR\u201921). IEEE, 132\u2013137."},{"key":"e_1_3_1_52_2","volume-title":"Proceedings of the IEEE Symposium on Safety, Security, and Rescue Robotics","author":"Reardon Christopher","year":"2018","unstructured":"Christopher Reardon, Kevin Lee, and Jonathan Fink. 2018. Come see this! Augmented reality to enable human-robot cooperative search. In Proceedings of the IEEE Symposium on Safety, Security, and Rescue Robotics."},{"key":"e_1_3_1_53_2","first-page":"79","volume-title":"Proceedings of the International Conference on Human-Computer Interaction: Virtual, Augmented, and Mixed Reality","author":"Reardon Christopher","year":"2019","unstructured":"Christopher Reardon, Kevin Lee, John G. Rogers, and Jonathan Fink. 2019. Augmented reality for human-robot teaming in field environments. In Proceedings of the International Conference on Human-Computer Interaction: Virtual, Augmented, and Mixed Reality. Springer, 79\u201392."},{"key":"e_1_3_1_54_2","first-page":"94","volume-title":"Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR\u201919)","author":"Reardon Christopher","year":"2019","unstructured":"Christopher Reardon, Kevin Lee, John G. Rogers, and Jonathan Fink. 2019. Communicating via augmented reality for human-robot teaming in field environments. In Proceedings of the IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR\u201919). IEEE, 94\u2013101."},{"key":"e_1_3_1_55_2","first-page":"183","volume-title":"Proceedings of the Conference on Visualization (VIS\u201901).","author":"Rogowitz Bernice E.","year":"2001","unstructured":"Bernice E. Rogowitz and Alan D. Kalvin. 2001. The \u201cWhich Blair Project\u201d: A quick visual method for evaluating perceptual color maps. In Proceedings of the Conference on Visualization (VIS\u201901). IEEE, 183\u2013556."},{"key":"e_1_3_1_56_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/978-3-319-91590-6_2","volume-title":"Proceedings of the Conference on Robot Operating System (ROS\u201919)","author":"Rold\u00e1n Juan Jes\u00fas","year":"2019","unstructured":"Juan Jes\u00fas Rold\u00e1n, Elena Pe\u00f1a-Tapia, David Garz\u00f3n-Ramos, Jorge de Le\u00f3n, Mario Garz\u00f3n, Jaime del Cerro, and Antonio Barrientos. 2019. Multi-robot systems, virtual reality and ROS: Developing a new generation of operator interfaces. In Proceedings of the Conference on Robot Operating System (ROS\u201919). Springer, 29\u201364."},{"key":"e_1_3_1_57_2","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/978-3-030-28619-4_26","volume-title":"Robotics Research","author":"Rosen Eric","year":"2020","unstructured":"Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, and Stefanie Tellex. 2020. Communicating robot arm motion intent through mixed reality head-mounted displays. In Robotics Research. Springer, 301\u2013316."},{"key":"e_1_3_1_58_2","first-page":"375","volume-title":"Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction","author":"Rossi Alessandra","year":"2017","unstructured":"Alessandra Rossi, Kerstin Dautenhahn, Kheng Lee Koay, and Joe Saunders. 2017. Investigating human perceptions of trust in robots for safe HRI in home environments. In Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction. 375\u2013376."},{"key":"e_1_3_1_59_2","first-page":"1","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation","author":"Rusu Radu Bogdan","year":"2011","unstructured":"Radu Bogdan Rusu and Steve Cousins. 2011. 3D is here: Point cloud library PCL. In Proceedings of the IEEE International Conference on Robotics and Automation. IEEE, 1\u20134."},{"key":"e_1_3_1_60_2","first-page":"435","volume-title":"Robotics: Science and Systems","author":"Segal Aleksandr","year":"2009","unstructured":"Aleksandr Segal, Dirk Haehnel, and Sebastian Thrun. 2009. Generalized-ICP. In Robotics: Science and Systems, Vol. 2. 435."},{"key":"e_1_3_1_61_2","first-page":"336","volume-title":"Proceedings of the IEEE Symposium on Visual Languages","author":"Shneiderman Ben","year":"1996","unstructured":"Ben Shneiderman. 1996. The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings of the IEEE Symposium on Visual Languages. IEEE, 336\u2013343."},{"issue":"1","key":"e_1_3_1_62_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/135062800394658","article-title":"Current approaches to change blindness","volume":"7","author":"Simons Daniel J.","year":"2000","unstructured":"Daniel J. Simons. 2000. Current approaches to change blindness. Visual Cogn. 7, 1-3 (2000), 1\u201315.","journal-title":"Visual Cogn."},{"issue":"7","key":"e_1_3_1_63_2","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/S1364-6613(97)01080-2","article-title":"Change blindness","volume":"1","author":"Simons Daniel J.","year":"1997","unstructured":"Daniel J. Simons and Daniel T. Levin. 1997. Change blindness. Trends Cogn. Sci. 1, 7 (1997), 261\u2013267.","journal-title":"Trends Cogn. Sci."},{"issue":"4","key":"e_1_3_1_64_2","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1002\/rob.20396","article-title":"Anytime online novelty and change detection for mobile robots","volume":"28","author":"Sofman Boris","year":"2011","unstructured":"Boris Sofman, Bradford Neuman, Anthony Stentz, and J. Andrew Bagnell. 2011. Anytime online novelty and change detection for mobile robots. J. Field Robot. 28, 4 (2011), 589\u2013618.","journal-title":"J. Field Robot."},{"key":"e_1_3_1_65_2","first-page":"1","volume-title":"Proceedings of the European Conference on Mobile Robots (ECMR\u201917)","author":"Sturari Mirco","year":"2017","unstructured":"Mirco Sturari, Marina Paolanti, Emanuele Frontoni, Adriano Mancini, and Primo Zingaretti. 2017. Robotic platform for deep change detection for rail safety and security. In Proceedings of the European Conference on Mobile Robots (ECMR\u201917). IEEE, 1\u20136."},{"key":"e_1_3_1_66_2","first-page":"124","volume-title":"Proceedings of the International Conference on Human-Computer Interaction","author":"Szafir Daniel","year":"2019","unstructured":"Daniel Szafir. 2019. Mediating human-robot interactions with virtual, augmented, and mixed reality. In Proceedings of the International Conference on Human-Computer Interaction. Springer, 124\u2013149."},{"issue":"5","key":"e_1_3_1_67_2","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1177\/0278364916688256","article-title":"Designing planning and control interfaces to support user collaboration with flying robots","volume":"36","author":"Szafir Daniel","year":"2017","unstructured":"Daniel Szafir, Bilge Mutlu, and Terrence Fong. 2017. Designing planning and control interfaces to support user collaboration with flying robots. Int. J. Robot. Res. 36, 5-7 (2017), 514\u2013542.","journal-title":"Int. J. Robot. Res."},{"key":"e_1_3_1_68_2","first-page":"281","volume-title":"Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction","author":"Szafir Daniel","year":"2021","unstructured":"Daniel Szafir and Danielle Albers Szafir. 2021. Connecting human-robot interaction and data visualization. In Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction. 281\u2013292."},{"key":"e_1_3_1_69_2","first-page":"1256","volume-title":"Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems","author":"Tabrez Aaquib","year":"2022","unstructured":"Aaquib Tabrez, Matthew B. Luebbers, and Bradley Hayes. 2022. Descriptive and prescriptive visual guidance to improve shared situational awareness in human-robot teaming. In Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems. 1256\u20131264."},{"key":"e_1_3_1_70_2","first-page":"412","volume-title":"Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction","author":"Tran Nhan","year":"2021","unstructured":"Nhan Tran, Trevor Grant, Thao Phung, Leanne Hirshfield, Christopher Wickens, and Tom Williams. 2021. Get this!? Mixed reality improves robot communication regardless of mental workload. In Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction. 412\u2013416."},{"key":"e_1_3_1_71_2","first-page":"1983","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201914)","author":"Trevor A. J. B.","year":"2014","unstructured":"A. J. B. Trevor, J. G. Rogers, and H. I. Christensen. 2014. OmniMapper: A modular multimodal mapping framework. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA\u201914). 1983\u20131990. DOI:10.1109\/ICRA.2014.6907122"},{"issue":"3","key":"e_1_3_1_72_2","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1109\/TASE.2013.2294851","article-title":"Spatial density patterns for efficient change detection in 3D environment for autonomous surveillance robots","volume":"11","author":"Vieira Antonio W.","year":"2014","unstructured":"Antonio W. Vieira, Paulo L. J. Drews, and Mario F. M. Campos. 2014. Spatial density patterns for efficient change detection in 3D environment for autonomous surveillance robots. IEEE Trans. Autom. Sci. Eng. 11, 3 (2014), 766\u2013774.","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"e_1_3_1_73_2","first-page":"2345","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201921)","author":"Walker Michael","year":"2021","unstructured":"Michael Walker, Zhaozhong Chen, Matthew Whitlock, David Blair, Danielle Albers Szafir, Christoffer Heckman, and Daniel Szafir. 2021. A mixed reality supervision and telepresence interface for outdoor field robotics. In Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS\u201921). IEEE, 2345\u20132352."},{"key":"e_1_3_1_74_2","first-page":"316","volume-title":"Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction","author":"Walker Michael","year":"2018","unstructured":"Michael Walker, Hooman Hedayati, Jennifer Lee, and Daniel Szafir. 2018. Communicating robot motion intent with augmented reality. In Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction. 316\u2013324."},{"key":"e_1_3_1_75_2","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1007\/978-3-030-69178-3_16","volume-title":"Advanced Human-Robot Collaboration in Manufacturing","author":"Wang Xi Vincent","year":"2021","unstructured":"Xi Vincent Wang and Lihui Wang. 2021. Augmented reality enabled human\u2013robot collaboration. In Advanced Human-Robot Collaboration in Manufacturing. Springer, 395\u2013411."},{"key":"e_1_3_1_76_2","first-page":"3","volume-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting","volume":"44","author":"Wickens Christopher D.","year":"2000","unstructured":"Christopher D. Wickens. 2000. The when and how of using 2-D and 3-D displays for operational tasks. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 44. SAGE Publications, Los Angeles, CA, 3\u2013403."},{"key":"e_1_3_1_77_2","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/978-3-319-41959-6_17","volume-title":"Advances in Human Factors in Robots and Unmanned Systems","author":"Evans A. William","year":"2017","unstructured":"A. William Evans, Matthew Marge, Ethan Stump, Garrett Warnell, Joseph Conroy, Douglas Summers-Stay, and David Baran. 2017. The future of human robot teams in the army: Factors affecting a model of human-system dialogue towards greater team collaboration. In Advances in Human Factors in Robots and Unmanned Systems. Springer, 197\u2013209."},{"issue":"2","key":"e_1_3_1_78_2","first-page":"24","article-title":"Covert robot-robot communication: Human perceptions and implications for human-robot interaction","volume":"4","author":"Williams Tom","year":"2015","unstructured":"Tom Williams, Priscilla Briggs, and Matthias Scheutz. 2015. Covert robot-robot communication: Human perceptions and implications for human-robot interaction. J. Hum.-Robot Interact. 4, 2 (2015), 24\u201349.","journal-title":"J. Hum.-Robot Interact."},{"key":"e_1_3_1_79_2","volume-title":"Proceedings of the 27th AAAI Conference on Artificial Intelligence","author":"Williams Thomas Emrys","year":"2013","unstructured":"Thomas Emrys Williams, Rehj Cantrell, Gordon Briggs, Paul Schermerhorn, and Matthias Scheutz. 2013. Grounding natural language references to unvisited and hypothetical locations. In Proceedings of the 27th AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_1_80_2","first-page":"246","volume-title":"Proceedings of the International Conference on Social Robotics","author":"Wolf Franziska Doris","year":"2020","unstructured":"Franziska Doris Wolf and Ruth Stock-Homburg. 2020. Human-robot teams: A review. In Proceedings of the International Conference on Social Robotics. Springer, 246\u2013258."},{"issue":"8","key":"e_1_3_1_81_2","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1002\/rob.20215","article-title":"Evolving interface design for robot search tasks","volume":"24","author":"Yanco Holly A.","year":"2007","unstructured":"Holly A. Yanco, Brenden Keyes, Jill L. Drury, Curtis W. Nielsen, Douglas A. Few, and David J. Bruemmer. 2007. Evolving interface design for robot search tasks. J. Field Robot. 24, 8-9 (2007), 779\u2013799.","journal-title":"J. Field Robot."},{"issue":"2","key":"e_1_3_1_82_2","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/THMS.2020.2969380","article-title":"Review of human\u2013machine interfaces for small unmanned systems with robotic manipulators","volume":"50","author":"Young Sierra N.","year":"2020","unstructured":"Sierra N. Young and Joshua M. Peschel. 2020. Review of human\u2013machine interfaces for small unmanned systems with robotic manipulators. IEEE Trans. Hum.-Mach. Syst. 50, 2 (2020), 131\u2013143.","journal-title":"IEEE Trans. Hum.-Mach. Syst."}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3611654","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3611654","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:12Z","timestamp":1750178172000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3611654"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,26]]},"references-count":81,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,9,30]]}},"alternative-id":["10.1145\/3611654"],"URL":"https:\/\/doi.org\/10.1145\/3611654","relation":{},"ISSN":["2573-9522"],"issn-type":[{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,26]]},"assertion":[{"value":"2022-07-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}