{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T23:33:04Z","timestamp":1774654384724,"version":"3.50.1"},"reference-count":145,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T00:00:00Z","timestamp":1706572800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/S005099\/1"],"award-info":[{"award-number":["EP\/S005099\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2024,3,31]]},"abstract":"<jats:p>Physically embodied artificial agents, or robots, are being incorporated into various practical and social contexts, from self-driving cars for personal transportation to assistive robotics in social care. To enable these systems to better perform under changing conditions, designers have proposed to endow robots with varying degrees of autonomous capabilities and the capacity to move between them\u2014an approach known as variable autonomy. Researchers are beginning to understand how robots with fixed autonomous capabilities influence a person\u2019s sense of autonomy, social relations, and, as a result, notions of responsibility; however, addressing these topics in scenarios where robot autonomy dynamically changes is underexplored. To establish a research agenda for variable autonomy that emphasises the responsible design and use of robotics, we conduct a developmental review. Based on a sample of 42 papers, we provide a synthesised definition of variable autonomy to connect currently disjointed research efforts, detail research approaches in variable autonomy to strengthen the empirical basis for subsequent work, characterise the dimensions of variable autonomy, and present design guidelines for variable autonomy research based on responsible robotics.<\/jats:p>","DOI":"10.1145\/3636432","type":"journal-article","created":{"date-parts":[[2023,12,7]],"date-time":"2023-12-07T11:53:44Z","timestamp":1701950024000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Variable Autonomy through Responsible Robotics: Design Guidelines and Research Agenda"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9249-7688","authenticated-orcid":false,"given":"Tyler","family":"Reinmund","sequence":"first","affiliation":[{"name":"University of Oxford, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9602-6085","authenticated-orcid":false,"given":"Pericle","family":"Salvini","sequence":"additional","affiliation":[{"name":"University of Oxford, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5302-1938","authenticated-orcid":false,"given":"Lars","family":"Kunze","sequence":"additional","affiliation":[{"name":"University of Oxford, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6088-3955","authenticated-orcid":false,"given":"Marina","family":"Jirotka","sequence":"additional","affiliation":[{"name":"University of Oxford, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1476-3127","authenticated-orcid":false,"given":"Alan F. T.","family":"Winfield","sequence":"additional","affiliation":[{"name":"UWE Bristol, UK"}]}],"member":"320","published-online":{"date-parts":[[2024,1,30]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2018.2791570"},{"key":"e_1_3_2_3_2","volume-title":"Proceedings of the 2021 IEEE\/ACM 1st Workshop on AI Engineering\u2013Software Engineering for AI (WAIN \u201921)","author":"Abraham Sophia","year":"2021","unstructured":"Sophia Abraham, Zachariah Carmichael, Sreya Banerjee, Rosaura VidalMata, Ankit Agrawal, Md. Nafee Al Islam, Walter Scheirer, and Jane Cleland-Huang. 2021. Adaptive autonomy in human-on-the-loop vision-based robotics systems. In Proceedings of the 2021 IEEE\/ACM 1st Workshop on AI Engineering\u2013Software Engineering for AI (WAIN \u201921). IEEE, Los Alamitos, CA, 113\u2013120. 10.1109\/WAIN52551.2021.00025"},{"key":"e_1_3_2_4_2","first-page":"6","volume-title":"Proceedings of the AAAI Workshop on Supervisory Control of Learning and Adaptive Systems","author":"Adams Julie A.","year":"2004","unstructured":"Julie A. Adams, Pramila Rani, and Nilanjan Sarkar. 2004. Mixed initiative interaction and robotic systems. In Proceedings of the AAAI Workshop on Supervisory Control of Learning and Adaptive Systems. 6\u201313."},{"key":"e_1_3_2_5_2","first-page":"1","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI \u201919).","author":"Amershi Saleema","year":"2019","unstructured":"Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. 2019. Guidelines for human-AI interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI \u201919). ACM, New York, NY, 1\u201313. 10.1145\/3290605.3300233"},{"issue":"6","key":"e_1_3_2_6_2","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1016\/0005-1098(83)90046-8","article-title":"Ironies of automation","volume":"19","author":"Bainbridge Lisanne","year":"1983","unstructured":"Lisanne Bainbridge. 1983. Ironies of automation. Automica 19, 6 (1983), 775\u2013779.","journal-title":"Automica"},{"key":"e_1_3_2_7_2","first-page":"2948","volume-title":"Proceedings of the 2004 IEEE International Conference on Systems, Man, and Cybernetics","volume":"3","author":"Baker Michael","year":"2004","unstructured":"Michael Baker and Holly A. Yanco. 2004. Autonomy mode suggestions for improving human-robot interaction. In Proceedings of the 2004 IEEE International Conference on Systems, Man, and Cybernetics, Vol. 3. IEEE, Los Alamitos, CA, 2948\u20132953."},{"key":"e_1_3_2_8_2","first-page":"15","volume-title":"Proceedings of the 19th European Conference on Information Systems (ECIS \u201911)","author":"Bandara Wasana","year":"2011","unstructured":"Wasana Bandara, Suraya Miskon, and Erwin Fielt. 2011. A systematic, tool-supported method for conducting literature reviews in information systems. In Proceedings of the 19th European Conference on Information Systems (ECIS \u201911). 15."},{"key":"e_1_3_2_9_2","volume-title":"Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS \u201920).","author":"Basich Connor","year":"2020","unstructured":"Connor Basich, Justin Svegliato, Kyle Hollins Wray, Stefan Witwicki, Joydeep Biswas, and Shlomo Zilberstein. 2020. Learning to optimize autonomy in competence-aware systems. In Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS \u201920). 123\u2013131."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.3.2.Beer"},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/978-3-030-42307-0_6","article-title":"Qualitative interview techniques for human-robot interactions","author":"Bethel Cindy L.","year":"2020","unstructured":"Cindy L. Bethel, Jessie E. Cossitt, Zachary Henkel, and Kenna Baugus. 2020. Qualitative interview techniques for human-robot interactions. In Human-Robot Interaction: Evaluation Methods and Their Standardization. Springer Series on Bio- and Neurosystems, Vol. 12. Springer, 145\u2013174.","journal-title":"Human-Robot Interaction: Evaluation Methods and Their Standardization."},{"key":"e_1_3_2_12_2","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/978-3-030-42307-0_4","article-title":"Conducting studies in human-robot interaction","author":"Bethel Cindy L.","year":"2020","unstructured":"Cindy L. Bethel, Zachary Henkel, and Kenna Baugus. 2020. Conducting studies in human-robot interaction. In Human-Robot Interaction: Evaluation Methods and Their Standardization. Springer Series on Bio- and Neurosystems, Vol. 12. Springer, 91\u2013124.","journal-title":"Human-Robot Interaction: Evaluation Methods and Their Standardization."},{"key":"e_1_3_2_13_2","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/978-3-319-17308-5_2","volume-title":"Responsible Innovation 2","author":"Blok Vincent","year":"2015","unstructured":"Vincent Blok and Pieter Lemmens. 2015. The emerging concept of responsible innovation. Three reasons why it is questionable and calls for a radical transformation of the concept of innovation. In Responsible Innovation 2. Springer, 19\u201335."},{"issue":"3","key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1080\/23299460.2020.1806451","article-title":"Values in responsible research and innovation: From entities to practices","volume":"7","author":"Boenink Marianne","year":"2020","unstructured":"Marianne Boenink and Olya Kudina. 2020. Values in responsible research and innovation: From entities to practices. Journal of Responsible Innovation 7, 3 (2020), 450\u2013470.","journal-title":"Journal of Responsible Innovation"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1145\/2207676.2208560","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Borning Alan","year":"2012","unstructured":"Alan Borning and Michael Muller. 2012. Next steps for value sensitive design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1125\u20131134. 10.1145\/2207676.2208560"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-25928-2_3"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.70"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4419-9198-0_11"},{"key":"e_1_3_2_19_2","volume-title":"Proceedings of the IJCAI-01 Workshop on Autonomy, Delegation, and Control: Interacting with Autonomous Agents","author":"Bradshaw Jeffrey M.","year":"2001","unstructured":"Jeffrey M. Bradshaw, Maarten Sierhuis, Yuri Gawdiak, Renia Jeffers, Niranjan Suri, and Mark Greaves. 2001. Adjustable autonomy and teamwork for the personal satellite assistant. In Proceedings of the IJCAI-01 Workshop on Autonomy, Delegation, and Control: Interacting with Autonomous Agents. 1\u20136."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2022.937612"},{"key":"e_1_3_2_21_2","first-page":"706","volume-title":"Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201904),","author":"Brookshire J.","year":"2004","unstructured":"J. Brookshire, S. Singh, and R. Simmons. 2004. Preliminary results in sliding autonomy for assembly by coordinated teams. In Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201904), Vol. 1. IEEE, Los Alamitos, CA, 706\u2013711. 10.1109\/IROS.2004.1389435"},{"key":"e_1_3_2_22_2","volume-title":"Proceedings of the AAAI Mobile Robot Competition","author":"Bruemmer David J.","year":"2002","unstructured":"David J. Bruemmer, Donald D. Dudenhoeffer, and Julie L. Marble. 2002. Dynamic-autonomy for urban search and rescue. In Proceedings of the AAAI Mobile Robot Competition. 33\u201337."},{"key":"e_1_3_2_23_2","first-page":"1","volume-title":"Proceedings of the 2012 IEEE Aerospace Conference.","author":"Bush L. A. M.","year":"2012","unstructured":"L. A. M. Bush, A. J. Wang, and B. C. Williams. 2012. Risk-based sensing in support of adjustable autonomy. In Proceedings of the 2012 IEEE Aerospace Conference. IEEE, Los Alamitos, CA, 1\u201318. 10.1109\/AERO.2012.6187312"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3064449"},{"key":"e_1_3_2_25_2","first-page":"1230","volume-title":"Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems.","author":"Cacace Jonathan","year":"2014","unstructured":"Jonathan Cacace, Alberto Finzi, and Vincenzo Lippiello. 2014. A mixed-initiative control system for an aerial service vehicle supported by force feedback. In Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems. IEEE, Los Alamitos, CA, 1230\u20131235. 10.1109\/IROS.2014.6942714"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472206"},{"key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1109\/SMC.2015.190","volume-title":"Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics.","author":"Chiou Manolis","year":"2015","unstructured":"Manolis Chiou, Nick Hawes, Rustam Stolkin, Kimron L. Shapiro, Jess R. Kerlin, and Andrew Clouter. 2015. Towards the principled study of variable autonomy in mobile robots. In Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics. IEEE, Los Alamitos, CA, 1053\u20131059. 10.1109\/SMC.2015.190"},{"key":"e_1_3_2_28_2","first-page":"3581","volume-title":"Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201916).","author":"Chiou Manolis","year":"2016","unstructured":"Manolis Chiou, Rustam Stolkin, Goda Bieksaite, Nick Hawes, Kimron L. Shapiro, and Timothy S. Harrison. 2016. Experimental analysis of a variable autonomy framework for controlling a remotely operating mobile robot. In Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201916). IEEE, Los Alamitos, CA, 3581\u20133588. 10.1109\/IROS.2016.7759527"},{"key":"e_1_3_2_29_2","first-page":"1","volume-title":"Proceedings of SoutheastCon 2017.","author":"Conner David C.","year":"2017","unstructured":"David C. Conner and Justin Willis. 2017. Flexible navigation: Finite state machine-based integrated navigation and control for ROS enabled robots. In Proceedings of SoutheastCon 2017. IEEE, Los Alamitos, CA, 1\u20138. 10.1109\/SECON.2017.7925266"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmsy.2022.04.007"},{"key":"e_1_3_2_31_2","doi-asserted-by":"crossref","first-page":"2135","DOI":"10.1177\/154193121005402503","article-title":"Adaptive automation effects on operator performance during a reconnaissance mission with an unmanned ground vehicle","volume":"54","author":"Cosenzo Keryl","year":"2010","unstructured":"Keryl Cosenzo, Jessie Chen, Lauren Reinerman-Jones, Michael Barnes, and Denise Nicholson. 2010. Adaptive automation effects on operator performance during a reconnaissance mission with an unmanned ground vehicle. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 54 (2010), 2135\u20132139.","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"e_1_3_2_32_2","first-page":"146","volume-title":"Proceedings of the 2012 IEEE\/WIC\/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.","author":"C\u00f4t\u00e9 Nicolas","year":"2012","unstructured":"Nicolas C\u00f4t\u00e9, Arnaud Canu, Maroua Bouzid, and Abdel-Iillah Mouaddib. 2012. Humans-robots sliding collaboration control in complex environments with adjustable autonomy. In Proceedings of the 2012 IEEE\/WIC\/ACM International Conferences on Web Intelligence and Intelligent Agent Technology. IEEE, Los Alamitos, CA, 146\u2013153. 10.1109\/WI-IAT.2012.215"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2853560"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209769"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1177\/1555343411410160"},{"key":"e_1_3_2_36_2","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1177\/154193120805200405","article-title":"Designing an adaptive automation system for human supervision of unmanned vehicles: A bridge from theory to practice","volume":"52","author":"Visser Ewart J. de","year":"2008","unstructured":"Ewart J. de Visser, Melanie LeGoullon, Amos Freedy, Elan Freedy, Gershon Weltman, and Raja Parasuraman. 2008. Designing an adaptive automation system for human supervision of unmanned vehicles: A bridge from theory to practice. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 52 (2008), 221\u2013225.","journal-title":"Proceedings of the Human Factors and Ergonomics Society Annual Meeting"},{"key":"e_1_3_2_37_2","first-page":"537","volume-title":"Proceedings of the 2005 International Workshop on Robot and Human Interactive Communication (ROMAN \u201905).","author":"Desai M.","year":"2005","unstructured":"M. Desai and H. A. Yanco. 2005. Blending human and robot inputs for sliding scale autonomy. In Proceedings of the 2005 International Workshop on Robot and Human Interactive Communication (ROMAN \u201905). IEEE, Los Alamitos, CA, 537\u2013542. 10.1109\/ROMAN.2005.1513835"},{"key":"e_1_3_2_38_2","volume-title":"Adjustable Autonomy for Human-Centered Autonomous Systems","author":"Dorais Gregory A.","year":"1999","unstructured":"Gregory A. Dorais, R. Peter Bonasso, David Kortenkamp, Barney Pell, and Debra Schreckenghost. 1999. Adjustable Autonomy for Human-Centered Autonomous Systems. Technical Report. Scientific Research Publishing."},{"key":"e_1_3_2_39_2","doi-asserted-by":"crossref","first-page":"2858","DOI":"10.1109\/ROBOT.2010.5509530","volume-title":"Proceedings of the 2010 IEEE International Conference on Robotics and Automation.","author":"Doroodgar Barzin","year":"2010","unstructured":"Barzin Doroodgar, Maurizio Ficocelli, Babak Mobedi, and Goldie Nejat. 2010. The search for survivors: Cooperative human-robot interaction in search and rescue environments using semi-autonomous robots. In Proceedings of the 2010 IEEE International Conference on Robotics and Automation. IEEE, Los Alamitos, CA, 2858\u20132863. 10.1109\/ROBOT.2010.5509530"},{"key":"e_1_3_2_40_2","first-page":"15","volume-title":"Proceedings of the 2015 IEEE 24th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises.","author":"Drenjanac Domagoj","year":"2015","unstructured":"Domagoj Drenjanac, Slobodanka Dana Kathrin Tomic, and Eva Kuhn. 2015. A semantic framework for modeling adaptive autonomy in task allocation in robotic fleets. In Proceedings of the 2015 IEEE 24th International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises. IEEE, Los Alamitos, CA, 15\u201320. 10.1109\/WETICE.2015.29"},{"key":"e_1_3_2_41_2","doi-asserted-by":"crossref","first-page":"129","DOI":"10.4324\/9781315087924-9","volume-title":"Situational Awareness","author":"Endsley Mica R.","year":"2017","unstructured":"Mica R. Endsley. 2017. Direct measurement of situation awareness: Validity and use of SAGAT. In Situational Awareness. Routledge, Milton Park, UK, 129\u2013156."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816681350"},{"key":"e_1_3_2_43_2","volume-title":"Anticipate, Reflect, Engage, Act (AREA)","year":"2022","unstructured":"EPSRC. 2022. Anticipate, Reflect, Engage, Act (AREA). Retrieved December 15, 2023 from https:\/\/www.ukri.org\/about-us\/epsrc\/our-policies-and-standards\/framework-for-responsible-innovation\/"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720812443983"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2010.940150"},{"key":"e_1_3_2_46_2","first-page":"150","volume-title":"Proceedings of the 2018 IEEE 12th International Conference on Self-Adaptive and Self-Organizing Systems (SASO \u201918).","author":"Frasheri Mirgita","year":"2018","unstructured":"Mirgita Frasheri, Baran Curuklu, Mikael Esktrom, and Alessandro Vittorio Papadopoulos. 2018. Adaptive autonomy in a search and rescue scenario. In Proceedings of the 2018 IEEE 12th International Conference on Self-Adaptive and Self-Organizing Systems (SASO \u201918). IEEE, Los Alamitos, CA, 150\u2013155. 10.1109\/SASO.2018.00026"},{"key":"e_1_3_2_47_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7585.001.0001","volume-title":"Value Sensitive Design: Shaping Technology with Moral Imagination","author":"Friedman Batya","year":"2019","unstructured":"Batya Friedman and David G. Hendry. 2019. Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Cambridge, MA."},{"key":"e_1_3_2_48_2","first-page":"1624","volume-title":"Proceedings of the 2001 IEEE International Conference on Systems, Man, and Cybernetics: e-Systems and e-Man for Cybernetics in Cyberspace, Vol. 3.","author":"Goodrich M. A.","year":"2001","unstructured":"M. A. Goodrich, Dan R. Olsen, Jacob W. Crandall, and Thomas J. Palmer. 2001. Experiments in adjustable autonomy. In Proceedings of the 2001 IEEE International Conference on Systems, Man, and Cybernetics: e-Systems and e-Man for Cybernetics in Cyberspace, Vol. 3. IEEE, Los Alamitos, CA, 1624\u20131629. 10.1109\/ICSMC.2001.973517"},{"issue":"4","key":"e_1_3_2_49_2","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/s10676-017-9428-2","article-title":"Mind the gap: Responsible robotics and the problem of responsibility","volume":"22","author":"Gunkel David J.","year":"2020","unstructured":"David J. Gunkel. 2020. Mind the gap: Responsible robotics and the problem of responsibility. Ethics and Information Technology 22, 4 (2020), 307\u2013320.","journal-title":"Ethics and Information Technology"},{"key":"e_1_3_2_50_2","first-page":"165","volume-title":"Proceedings of the 4th ACM\/IEEE International Conference on Human Robot Interaction (HRI \u201909).","author":"Hardin Benjamin","year":"2009","unstructured":"Benjamin Hardin and Michael A. Goodrich. 2009. On using mixed-initiative control: A perspective for managing large-scale robotic teams. In Proceedings of the 4th ACM\/IEEE International Conference on Human Robot Interaction (HRI \u201909). ACM, New York, NY, 165. 10.1145\/1514095.1514126"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"e_1_3_2_52_2","first-page":"79","volume-title":"Proceedings of the 2011 IEEE 12th International Symposium on Computational Intelligence and Informatics (CINTI \u201911).","author":"Heerink Marcel","year":"2011","unstructured":"Marcel Heerink. 2011. How elderly users of a socially interactive robot experience adaptiveness, adaptability and user control. In Proceedings of the 2011 IEEE 12th International Symposium on Computational Intelligence and Informatics (CINTI \u201911). IEEE, Los Alamitos, CA, 79\u201384. 10.1109\/CINTI.2011.6108476"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1177\/1541931213601971"},{"issue":"3","key":"e_1_3_2_54_2","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/THMS.2019.2904558","article-title":"Evaluating fluency in human\u2013robot collaboration","volume":"49","author":"Hoffman Guy","year":"2019","unstructured":"Guy Hoffman. 2019. Evaluating fluency in human\u2013robot collaboration. IEEE Transactions on Human-Machine Systems 49, 3 (2019), 209\u2013218.","journal-title":"IEEE Transactions on Human-Machine Systems"},{"key":"e_1_3_2_55_2","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1117\/12.603725","volume-title":"Unmanned Ground Vehicle Technology VII","author":"Huang Hui-Min","year":"2005","unstructured":"Hui-Min Huang, Kerry Pavek, James Albus, and Elena Messina. 2005. Autonomy levels for unmanned systems (ALFUS) framework: An update. In Unmanned Ground Vehicle Technology VII, Vol. 5804. SPIE, 439\u2013448."},{"key":"e_1_3_2_56_2","volume-title":"BS8611:2016 Robots and Robotic Devices, Guide to the Ethical Design and Application of Robots and Robotic Systems","author":"Institute British Standards","year":"2016","unstructured":"British Standards Institute. 2016. BS8611:2016 Robots and Robotic Devices, Guide to the Ethical Design and Application of Robots and Robotic Systems. British Standards Institute."},{"key":"e_1_3_2_57_2","volume-title":"SAE J3016 202104: Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles","author":"International SAE","year":"2021","unstructured":"SAE International. 2021. SAE J3016 202104: Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. SAE International."},{"key":"e_1_3_2_58_2","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1007\/978-3-030-42307-0_11","article-title":"Evaluating human-robot interaction with ethnography","author":"Jacobs An","year":"2020","unstructured":"An Jacobs, Shirley A. Elprama, and Charlotte I. C. Jewell. 2020. Evaluating human-robot interaction with ethnography. Human-Robot Interaction: Evaluation Methods and Their Standardization. Springer Series on Bio- and Neurosystems, Vol. 12. Springer, 269\u2013286.","journal-title":"Human-Robot Interaction: Evaluation Methods and Their Standardization."},{"issue":"5","key":"e_1_3_2_59_2","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1145\/3064940","article-title":"Responsible research and innovation in the digital age","volume":"60","author":"Jirotka Marina","year":"2017","unstructured":"Marina Jirotka, Barbara Grimpe, Bernd Stahl, Grace Eden, and Mark Hartswood. 2017. Responsible research and innovation in the digital age. Communications of the ACM 60, 5 (2017), 62\u201368.","journal-title":"Communications of the ACM"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1080\/1463922021000054335"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1207\/S15327566IJCE0501_3"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-010-9422-y"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1177\/1071181312561096"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209701"},{"key":"e_1_3_2_65_2","doi-asserted-by":"crossref","first-page":"2403","DOI":"10.1016\/j.promfg.2015.07.499","article-title":"Vigilance decrement and passive fatigue caused by monotony in automated driving","volume":"3","author":"K\u00f6rber Moritz","year":"2015","unstructured":"Moritz K\u00f6rber, Andrea Cingel, Markus Zimmermann, and Klaus Bengler. 2015. Vigilance decrement and passive fatigue caused by monotony in automated driving. Procedia Manufacturing 3 (2015), 2403\u20132409.","journal-title":"Procedia Manufacturing"},{"key":"e_1_3_2_66_2","first-page":"89","volume-title":"Proceedings of the AAAI Symposium on Mixed Initiative Interaction","author":"Kortenkamp David","year":"1997","unstructured":"David Kortenkamp, R. Peter Bonasso, Dan Ryan, and Debbie Schreckenghost. 1997. Traded control with autonomous robots as mixed initiative interaction. In Proceedings of the AAAI Symposium on Mixed Initiative Interaction. 89\u201394."},{"key":"e_1_3_2_67_2","first-page":"629","volume-title":"Proceedings of the 2000 IEEE Aerospace Conference","volume":"7","author":"Kortenkamp David","year":"2000","unstructured":"David Kortenkamp, D. Keirn-Schreckenghost, and R. P. Bonasso. 2000. Adjustable control autonomy for manned space flight. In Proceedings of the 2000 IEEE Aerospace Conference, Vol. 7. 629\u2013640. 10.1109\/AERO.2000.879330"},{"issue":"4","key":"e_1_3_2_68_2","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1561\/2300000052","article-title":"A survey of methods for safe human-robot interaction","volume":"5","author":"Lasota Przemyslaw A.","year":"2017","unstructured":"Przemyslaw A. Lasota, Terrence Fong, and Julie A. Shah. 2017. A survey of methods for safe human-robot interaction. Foundations and Trends\u00ae in Robotics 5, 4 (2017), 261\u2013349.","journal-title":"Foundations and Trends\u00ae in Robotics"},{"key":"e_1_3_2_69_2","first-page":"27","volume-title":"Trust: Recent Concepts and Evaluations in Human-Robot Interaction","author":"Law Theresa","year":"2021","unstructured":"Theresa Law and Matthias Scheutz. 2021. Trust: Recent Concepts and Evaluations in Human-Robot Interaction. Academic Press, 27\u201357."},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1080\/00140139208967392"},{"key":"e_1_3_2_71_2","first-page":"1656","volume-title":"Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems.","author":"Lewis Bennie","year":"2013","unstructured":"Bennie Lewis, Bulent Tastan, and Gita Sukthankar. 2013. An adjustable autonomy paradigm for adapting to expert-novice differences. In Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems. IEEE, Los Alamitos, CA, 1656\u20131662. 10.1109\/IROS.2013.6696571"},{"issue":"7","key":"e_1_3_2_72_2","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1080\/10447318.2018.1455307","article-title":"The system usability scale: Past, present, and future","volume":"34","author":"Lewis James R.","year":"2018","unstructured":"James R. Lewis. 2018. The system usability scale: Past, present, and future. International Journal of Human\u2013Computer Interaction 34, 7 (2018), 577\u2013590.","journal-title":"International Journal of Human\u2013Computer Interaction"},{"key":"e_1_3_2_73_2","first-page":"316","volume-title":"Culturally Sustainable Social Robotics: Proceedings of Robophilosophy 2020","author":"LIa Shuhong","year":"2020","unstructured":"Shuhong LIa, A. V. Wynsberghe, and Sabine Roeser. 2020. The complexity of autonomy: A consideration of the impacts of care robots on the autonomy of elderly care receivers. In Culturally Sustainable Social Robotics: Proceedings of Robophilosophy 2020. Frontiers in Artificial Intelligence and Applications, Vol. 335: Culturally Sustainable Social Robotics. IOS Press, 316\u2013325."},{"key":"e_1_3_2_74_2","volume-title":"Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS \u201915).","author":"Lin Lanny","year":"2015","unstructured":"Lanny Lin and Michael A. Goodrich. 2015. Sliding autonomy for UAV path-planning: Adding new dimensions to autonomy management. In Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS \u201915). 10."},{"issue":"5","key":"e_1_3_2_75_2","doi-asserted-by":"crossref","first-page":"721","DOI":"10.3390\/su9050721","article-title":"Lessons for responsible innovation in the business context: A systematic literature review of responsible, social and sustainable innovation practices","volume":"9","author":"Lubberink Rob","year":"2017","unstructured":"Rob Lubberink, Vincent Blok, Johan Van Ophem, and Onno Omta. 2017. Lessons for responsible innovation in the business context: A systematic literature review of responsible, social and sustainable innovation practices. Sustainability 9, 5 (2017), 721.","journal-title":"Sustainability"},{"key":"e_1_3_2_76_2","first-page":"3","volume-title":"A Multidimensional Conception and Measure of Human-Robot Trust","author":"Malle Bertram F.","year":"2021","unstructured":"Bertram F. Malle and Daniel Ullman. 2021. A Multidimensional Conception and Measure of Human-Robot Trust. Academic Press, 3\u201325."},{"key":"e_1_3_2_77_2","first-page":"448","volume-title":"Proceedings of the 2003 IEEEInternational Conference on Systems, Man, and Cybernetics(SMC \u201903), Vol. 1.","author":"Marble J. L.","year":"2003","unstructured":"J. L. Marble, D. J. Bruemmer, and D. A. Few. 2003. Lessons learned from usability tests with a collaborative cognitive workspace for human-robot teams. In Proceedings of the 2003 IEEEInternational Conference on Systems, Man, and Cybernetics(SMC \u201903), Vol. 1. IEEE, Los Alamitos, CA, 448\u2013453. 10.1109\/ICSMC.2003.1243856"},{"key":"e_1_3_2_78_2","volume-title":"Evaluation of supervisory vs. peer-peer interaction for human-robot teams","author":"Marble Julie L.","year":"2004","unstructured":"Julie L. Marble, David J. Bruemmer, Douglas A. Few, and Donald D. Dudenhoeffer. 2004. Evaluation of supervisory vs. peer-peer interaction for human-robot teams. In Proceedings of the 37th Annual Hawaii International Conference on Systems Sciences. 1\u201322."},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3385009"},{"key":"e_1_3_2_80_2","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/HUMANOIDS.2015.7363589","volume-title":"Proceedings of the 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids \u201915).","author":"McGill Stephen","year":"2015","unstructured":"Stephen McGill, Seung-Joon Yi, and Daniel D. Lee. 2015. Team THOR\u2019s adaptive autonomy for disaster response humanoids. In Proceedings of the 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids \u201915). IEEE, Los Alamitos, CA, 453\u2013460. 10.1109\/HUMANOIDS.2015.7363589"},{"key":"e_1_3_2_81_2","first-page":"12008","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation","author":"McGinn Conor","year":"2023","unstructured":"Conor McGinn, Robert Scott, Niamh Donnelly, Michael F. Cullinan, Alan Winfield, and Pat Treusch. 2023. Ethical assessment of a hospital disinfection robot. In Proceedings of the IEEE International Conference on Robotics and Automation. 12008\u201312014."},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3399433"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2021.737072"},{"key":"e_1_3_2_84_2","volume-title":"Qualitative Data Analysis: A Methods Sourcebook (4th ed.)","author":"Miles Matthew B.","year":"2019","unstructured":"Matthew B. Miles, A. Micheal Huberman, and Salada\u00f1a. 2019. Qualitative Data Analysis: A Methods Sourcebook (4th ed.). SAGE Publications."},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1518\/001872007779598037"},{"key":"e_1_3_2_86_2","first-page":"1872","volume-title":"Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201921).","author":"Miller Christopher X.","year":"2021","unstructured":"Christopher X. Miller, Temesgen Gebrekristos, Michael Young, Enid Montague, and Brenna Argall. 2021. An analysis of human-robot information streams to inform dynamic autonomy allocation. In Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201921). IEEE, Los Alamitos, CA, 1872\u20131878. 10.1109\/IROS51168.2021.9636637"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2015.04.002"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-017-9560-8"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1108\/IJICC-02-2017-0013"},{"key":"e_1_3_2_90_2","first-page":"197","volume-title":"Proceedings of the 2013 8th ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201913)","author":"Murphy Robin R.","year":"2013","unstructured":"Robin R. Murphy and Debra Schreckenghost. 2013. Survey of metrics for human-robot interaction. In Proceedings of the 2013 8th ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201913). 197\u2013198. 10.1109\/HRI.2013.6483569"},{"key":"e_1_3_2_91_2","volume-title":"Agents with Adjustable Autonomy: Papers from the 1999 AAAI Symposium, March 22-24, Stanford, California","author":"Musliner David","year":"1999","unstructured":"David Musliner and Barney Pell. 1999. Agents with Adjustable Autonomy: Papers from the 1999 AAAI Symposium, March 22-24, Stanford, California. AAAI Press."},{"key":"e_1_3_2_92_2","first-page":"933","volume-title":"Proceedings of the 2012 21st IEEE International Symposium on Robot and Human Interactive Communication (ROMAN \u201912).","author":"Muszynski Sebastian","year":"2012","unstructured":"Sebastian Muszynski, Jorg Stuckler, and Sven Behnke. 2012. Adjustable autonomy for mobile teleoperation of personal service robots. In Proceedings of the 2012 21st IEEE International Symposium on Robot and Human Interactive Communication (ROMAN \u201912). IEEE, Los Alamitos, CA, 933\u2013940. 10.1109\/ROMAN.2012.6343870"},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2020.2970653"},{"issue":"1","key":"e_1_3_2_94_2","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1080\/23299460.2014.882065","article-title":"The UK Engineering and Physical Sciences Research Council\u2019s commitment to a framework for responsible innovation","volume":"1","author":"Owen Richard","year":"2014","unstructured":"Richard Owen. 2014. The UK Engineering and Physical Sciences Research Council\u2019s commitment to a framework for responsible innovation. Journal of Responsible Innovation 1, 1 (2014), 113\u2013117.","journal-title":"Journal of Responsible Innovation"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720820960865"},{"key":"e_1_3_2_96_2","doi-asserted-by":"crossref","first-page":"105906","DOI":"10.1016\/j.ijsu.2021.105906","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"88","author":"Page Matthew J.","year":"2021","unstructured":"Matthew J. Page, Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer, Jennifer M. Tetzlaff, Elie A. Akl, Sue E. Brennan, et\u00a0al. 2021. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery 88 (2021), 105906.","journal-title":"International Journal of Surgery"},{"issue":"7","key":"e_1_3_2_97_2","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1080\/001401300409125","article-title":"Designing automation for human use: Empirical studies and quantitative models","volume":"43","author":"Parasuraman Raja","year":"2000","unstructured":"Raja Parasuraman. 2000. Designing automation for human use: Empirical studies and quantitative models. Ergonomics 43, 7 (2000), 931\u2013951.","journal-title":"Ergonomics"},{"key":"e_1_3_2_98_2","volume-title":"Theory and Design of Adaptive Automation in Aviation Systems","author":"Parasuraman Raja","year":"1992","unstructured":"Raja Parasuraman, Toufik Bahri, John E. Deaton, Jeffrey G. Morrison, and Michael Barnes. 1992. Theory and Design of Adaptive Automation in Aviation Systems. Technical Report. Cognitive Science Lab, Catholic University of America, Washington, DC."},{"issue":"3","key":"e_1_3_2_99_2","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/3468.844354","article-title":"A model for types and levels of human interaction with automation","volume":"30","author":"Parasuraman Raja","year":"2000","unstructured":"Raja Parasuraman, Thomas B. Sheridan, and Christopher D. Wickens. 2000. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics\u2014Part A: Systems and Humans 30, 3 (2000), 286\u2013297.","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics\u2014Part A: Systems and Humans"},{"issue":"2","key":"e_1_3_2_100_2","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s10676-019-09524-z","article-title":"Could robots strengthen the sense of autonomy of older people residing in assisted living facilities?\u2014A future-oriented study","volume":"22","author":"Pirhonen Jari","year":"2020","unstructured":"Jari Pirhonen, Helin\u00e4 Melkas, Arto Laitinen, and Satu Pekkarinen. 2020. Could robots strengthen the sense of autonomy of older people residing in assisted living facilities?\u2014A future-oriented study. Ethics and Information Technology 22, 2 (2020), 151\u2013162.","journal-title":"Ethics and Information Technology"},{"key":"e_1_3_2_101_2","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1145\/3434074.3447181","volume-title":"Companion of the 2021 ACM\/IEEE International Conference on Human-Robot Interaction.","author":"Ramesh Aniketh","year":"2021","unstructured":"Aniketh Ramesh, Manolis Chiou, and Rustam Stolkin. 2021. Robot vitals and robot health: An intuitive approach to quantifying and communicating predicted robot performance degradation in human-robot teams. In Companion of the 2021 ACM\/IEEE International Conference on Human-Robot Interaction. ACM, New York, NY, 303\u2013307. 10.1145\/3434074.3447181"},{"key":"e_1_3_2_102_2","first-page":"507","volume-title":"Proceedings of the 10th International Symposium on Artificial Intelligence, Robotics, and Automation in Space","author":"Roehr Thomas M.","year":"2010","unstructured":"Thomas M. Roehr and Yuping Shi. 2010. Using a self-confidence measure for a system-initiated switch between autonomy modes. In Proceedings of the 10th International Symposium on Artificial Intelligence, Robotics, and Automation in Space. 507\u2013514."},{"key":"e_1_3_2_103_2","doi-asserted-by":"publisher","DOI":"10.1002\/rob.21671"},{"key":"e_1_3_2_104_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1037"},{"key":"e_1_3_2_105_2","unstructured":"Paul Scerri. 2001. Designing Agents for Systems with Adjustable Autonomy. Ph.D. Dissertation. Linkoping University."},{"key":"e_1_3_2_106_2","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1109\/CTS.2016.0071","volume-title":"Proceedings of the 2016 International Conference on Collaboration Technologies and Systems (CTS \u201916).","author":"Schaefer Kristin E.","year":"2016","unstructured":"Kristin E. Schaefer, Ralph W. Brewer, Joe Putney, Edward Mottern, Jeffrey Barghout, and Edward R. Straub. 2016. Relinquishing manual control: Collaboration requires the capability to understand robot intent. In Proceedings of the 2016 International Conference on Collaboration Technologies and Systems (CTS \u201916). IEEE, Los Alamitos, CA, 359\u2013366. 10.1109\/CTS.2016.0071"},{"key":"e_1_3_2_107_2","doi-asserted-by":"crossref","unstructured":"Ren\u00e9 von Schomberg (Ed.). 2011. Towards Responsible Research and Innovation in the Information and Communication Technologies and Security Technologies Fields. Publications Office of the European Union Luxembourg.","DOI":"10.2139\/ssrn.2436399"},{"key":"e_1_3_2_108_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2010.126"},{"key":"e_1_3_2_109_2","article-title":"Diversifying the deliberative turn: Toward an agonistic RRI","author":"Scott Deborah","year":"2021","unstructured":"Deborah Scott. 2021. Diversifying the deliberative turn: Toward an agonistic RRI. Science, Technology, & Human Values 48, 2 (2021), 1\u201324.","journal-title":"Science, Technology, & Human Values"},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2006.876966"},{"key":"e_1_3_2_111_2","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3100603"},{"key":"e_1_3_2_112_2","doi-asserted-by":"publisher","DOI":"10.3390\/s20205960"},{"issue":"1","key":"e_1_3_2_113_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s10676-010-9234-6","article-title":"Granny and the robots: Ethical issues in robot care for the elderly","volume":"14","author":"Sharkey Amanda","year":"2012","unstructured":"Amanda Sharkey and Noel Sharkey. 2012. Granny and the robots: Ethical issues in robot care for the elderly. Ethics and Information Technology 14, 1 (2012), 27\u201340.","journal-title":"Ethics and Information Technology"},{"issue":"1","key":"e_1_3_2_114_2","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1186\/1471-2288-7-10","article-title":"Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews","volume":"7","author":"Shea Beverley J.","year":"2007","unstructured":"Beverley J. Shea, Jeremy M. Grimshaw, George A. Wells, Maarten Boers, Neil Andersson, Candyce Hamel, Ashley C. Porter, Peter Tugwell, David Moher, and Lex M. Bouter. 2007. Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews. BMC Medical Research Methodology 7, 1 (2007), 10\u201317.","journal-title":"BMC Medical Research Methodology"},{"key":"e_1_3_2_115_2","doi-asserted-by":"crossref","DOI":"10.21236\/ADA057655","volume-title":"Human and Computer Control of Undersea Teleoperators","author":"Sheridan Thomas B.","year":"1978","unstructured":"Thomas B. Sheridan and William L. Verplank. 1978. Human and Computer Control of Undersea Teleoperators. Technical Report. Man-Machine Systems Lab, MIT, Cambridge, MA."},{"key":"e_1_3_2_116_2","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780192845290.001.0001","volume-title":"Human-Centered AI","author":"Shneiderman Ben","year":"2022","unstructured":"Ben Shneiderman. 2022. Human-Centered AI. Oxford University Press, Oxford, UK."},{"key":"e_1_3_2_117_2","doi-asserted-by":"publisher","DOI":"10.1007\/s41315-018-0043-0"},{"key":"e_1_3_2_118_2","volume-title":"IEEE Standard for Transparency of Autonomous Systems","author":"Society IEEE Computer","year":"2021","unstructured":"IEEE Computer Society. 2021. IEEE Standard for Transparency of Autonomous Systems. IEEE, Los Alamitos, CA."},{"key":"e_1_3_2_119_2","volume-title":"IEEE Standard Model Process for Addressing Ethical Concerns during System Design: IEEE Standard 7000-2021","author":"Society IEEE Computer","year":"2021","unstructured":"IEEE Computer Society. 2021. IEEE Standard Model Process for Addressing Ethical Concerns during System Design: IEEE Standard 7000-2021. IEEE, Los Alamitos, CA."},{"key":"e_1_3_2_120_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13408-1_22"},{"key":"e_1_3_2_121_2","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.robot.2016.08.018","article-title":"Ethics of healthcare robotics: Towards responsible research and innovation","volume":"86","author":"Stahl Bernd Carsten","year":"2016","unstructured":"Bernd Carsten Stahl and Mark Coeckelbergh. 2016. Ethics of healthcare robotics: Towards responsible research and innovation. Robotics and Autonomous Systems 86 (2016), 152\u2013161.","journal-title":"Robotics and Autonomous Systems"},{"key":"e_1_3_2_122_2","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/1121241.1121249","volume-title":"Proceedings of the 1st ACM SIGCHI\/SIGART Conference on Human-Robot Interaction (HRI \u201906).","author":"Steinfeld Aaron","year":"2006","unstructured":"Aaron Steinfeld, Terrence Fong, David Kaber, Michael Lewis, Jean Scholtz, Alan Schultz, and Michael Goodrich. 2006. Common metrics for human-robot interaction. In Proceedings of the 1st ACM SIGCHI\/SIGART Conference on Human-Robot Interaction (HRI \u201906). ACM, New York, NY, 33\u201340. 10.1145\/1121241.1121249"},{"key":"e_1_3_2_123_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.respol.2013.05.008"},{"issue":"1","key":"e_1_3_2_124_2","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1080\/01441647.2018.1494640","article-title":"Governing autonomous vehicles: Emerging responses for safety, liability, privacy, cybersecurity, and industry risks","volume":"39","author":"Taeihagh Araz","year":"2019","unstructured":"Araz Taeihagh and Hazel Si Min Lim. 2019. Governing autonomous vehicles: Emerging responses for safety, liability, privacy, cybersecurity, and industry risks. Transport Reviews 39, 1 (2019), 103\u2013128.","journal-title":"Transport Reviews"},{"key":"e_1_3_2_125_2","first-page":"113","volume-title":"Proceedings of the 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM \u201916).","author":"Tang Fang","year":"2016","unstructured":"Fang Tang, Mahmood Mohammed, and Jacob Longazo. 2016. Experiments of human-robot teaming under sliding autonomy. In Proceedings of the 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM \u201916). IEEE, Los Alamitos, CA, 113\u2013118. 10.1109\/AIM.2016.7576752"},{"key":"e_1_3_2_126_2","volume-title":"Proceedings of the AGARD AMP Symposium on Situational Awareness in Aerospace Operations","author":"Taylor R. M.","year":"1989","unstructured":"R. M. Taylor. 1989. Situational awareness rating technique (SART): The development of a tool for aircrew systems design. In Proceedings of the AGARD AMP Symposium on Situational Awareness in Aerospace Operations."},{"key":"e_1_3_2_127_2","doi-asserted-by":"publisher","DOI":"10.17705\/1CAIS.03706"},{"key":"e_1_3_2_128_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrt.2022.100038"},{"key":"e_1_3_2_129_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0263574717000510"},{"key":"e_1_3_2_130_2","volume-title":"Alone Together: Why We Expect More from Technology and Less from Each Other","author":"Turkle Sherry","year":"2011","unstructured":"Sherry Turkle. 2011. Alone Together: Why We Expect More from Technology and Less from Each Other. Basic Books, New York, NY."},{"key":"e_1_3_2_131_2","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1016\/j.apergo.2015.09.013","article-title":"A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed?","volume":"53","author":"Vagia Marialena","year":"2016","unstructured":"Marialena Vagia, Aksel A. Transeth, and Sigurd A. Fjerdingen. 2016. A literature review on the levels of automation during the years. What are the different taxonomies that have been proposed? Applied Ergonomics 53 (2016), 190\u2013202.","journal-title":"Applied Ergonomics"},{"key":"e_1_3_2_132_2","doi-asserted-by":"publisher","DOI":"10.1177\/0018720811420427"},{"issue":"3","key":"e_1_3_2_133_2","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1080\/23299460.2020.1791506","article-title":"Learning to do responsible innovation in industry: Six lessons","volume":"7","author":"Poel Ibo van de","year":"2020","unstructured":"Ibo van de Poel, Lotte Asveld, Steven Flipse, Pim Klaassen, Zenlin Kwee, Maria Maia, Elvio Mantovani, Christopher Nathan, Andrea Porcari, and Emad Yaghmaei. 2020. Learning to do responsible innovation in industry: Six lessons. Journal of Responsible Innovation 7, 3 (2020), 697\u2013707.","journal-title":"Journal of Responsible Innovation"},{"issue":"19","key":"e_1_3_2_134_2","doi-asserted-by":"crossref","first-page":"4769","DOI":"10.1007\/s11229-018-01951-7","article-title":"Varieties of responsibility: Two problems of responsible innovation","volume":"198","author":"Poel Ibo Van de","year":"2021","unstructured":"Ibo Van de Poel and Martin Sand. 2021. Varieties of responsibility: Two problems of responsible innovation. Synthese 198, 19 (2021), 4769\u20134787.","journal-title":"Synthese"},{"key":"e_1_3_2_135_2","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1002\/9781118551424.ch4","article-title":"Value sensitive design and responsible innovation","author":"Hoven Jeroen Van den","year":"2013","unstructured":"Jeroen Van den Hoven. 2013. Value sensitive design and responsible innovation. In Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society, Richard Owen, John Bessant, and Maggy Heintz (Eds.). Wiley, 75\u201383.","journal-title":"Responsible Innovation: Managing the Responsible Emergence of Science and Innovation in Society,"},{"key":"e_1_3_2_136_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2020.02.011"},{"key":"e_1_3_2_137_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-020-09562-y"},{"key":"e_1_3_2_138_2","first-page":"6434","volume-title":"Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201921).","author":"Vanhee Lois","year":"2021","unstructured":"Lois Vanhee, Laurent Jeanpierre, and Abdel-Illah Mouaddib. 2021. Optimizing requests for support in context-restricted autonomy. In Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS \u201921). IEEE, Los Alamitos, CA, 6434\u20136440. 10.1109\/IROS51168.2021.9636240"},{"key":"e_1_3_2_139_2","first-page":"9","volume-title":"Proceeding of the ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201907).","author":"Wang Jijun","year":"2007","unstructured":"Jijun Wang and Michael Lewis. 2007. Human control for cooperating robot teams. In Proceeding of the ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201907). ACM, New York, NY, 9. 10.1145\/1228716.1228719"},{"key":"e_1_3_2_140_2","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1007\/978-3-319-64107-2_21","volume-title":"Proceedings of the Annual Conference Towards Autonomous Robotic Systems","author":"Winfield Alan F. T.","year":"2017","unstructured":"Alan F. T. Winfield and Marina Jirotka. 2017. The case for an ethical black box. In Proceedings of the Annual Conference Towards Autonomous Robotic Systems. 262\u2013273."},{"issue":"2133","key":"e_1_3_2_141_2","article-title":"Ethical governance is essential to building trust in robotics and artificial intelligence systems","volume":"376","author":"Winfield Alan F. T.","year":"2018","unstructured":"Alan F. T. Winfield and Marina Jirotka. 2018. Ethical governance is essential to building trust in robotics and artificial intelligence systems. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences 376, 2133 (2018), 1\u201313.","journal-title":"Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences"},{"key":"e_1_3_2_142_2","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/978-3-030-66494-7_6","volume-title":"Software Engineering for Robotics","author":"Winfield Alan F. T.","year":"2021","unstructured":"Alan F. T. Winfield, Katie Winkle, Helena Webb, Ulrik Lyngs, Marina Jirotka, and Carl Macrae. 2021. Robot accident investigation: A case study in responsible robotics. In Software Engineering for Robotics. Springer, 165\u2013187."},{"key":"e_1_3_2_143_2","first-page":"289","volume-title":"Proceedings of the 2018 13th ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201918)","author":"Winkle Katie","year":"2018","unstructured":"Katie Winkle, Praminda Caleb-Solly, Ailie Turton, and Paul Bremner. 2018. Social robots for engagement in rehabilitative therapies: Design implications from a study with therapists. In Proceedings of the 2018 13th ACM\/IEEE International Conference on Human-Robot Interaction (HRI \u201918). 289\u2013297."},{"key":"e_1_3_2_144_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cja.2020.03.031"},{"key":"e_1_3_2_145_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2010.09.035"},{"key":"e_1_3_2_146_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-009-0134-7"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3636432","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3636432","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:35:42Z","timestamp":1750178142000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3636432"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,30]]},"references-count":145,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3,31]]}},"alternative-id":["10.1145\/3636432"],"URL":"https:\/\/doi.org\/10.1145\/3636432","relation":{},"ISSN":["2573-9522"],"issn-type":[{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,30]]},"assertion":[{"value":"2022-10-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-11-09","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}