{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T10:48:10Z","timestamp":1779101290843,"version":"3.51.4"},"reference-count":84,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000269","name":"Economic and Social Research Council","doi-asserted-by":"publisher","award":["R-DST-HCE \/ D034"],"award-info":[{"award-number":["R-DST-HCE \/ D034"]}],"id":[{"id":"10.13039\/501100000269","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI Ethics"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>This article reviews two main approaches to human control of AI systems: supervisory human control and human\u2013machine teaming. It explores how each approach defines and guides the operational interplay between human behaviour and system behaviour to ensure that AI systems are effective throughout their deployment. Specifically, the article looks at how the two approaches differ in their conceptual and practical adequacy regarding the control of AI systems based on foundation models\u2013\u2013i.e., models trained on vast datasets, exhibiting general capabilities, and producing non-deterministic behaviour. The article focuses on examples from the defence and security domain to highlight practical challenges in terms of human control of automation in general, and AI in particular, and concludes by arguing that approaches to human control are better served by an understanding of control as the product of collaborative agency in a multi-agent system rather than of exclusive human supervision.<\/jats:p>","DOI":"10.1007\/s43681-024-00489-4","type":"journal-article","created":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T21:03:57Z","timestamp":1716930237000},"page":"1535-1548","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["Human control of AI systems: from supervision to teaming"],"prefix":"10.1007","volume":"5","author":[{"given":"Andreas","family":"Tsamados","sequence":"first","affiliation":[]},{"given":"Luciano","family":"Floridi","sequence":"additional","affiliation":[]},{"given":"Mariarosaria","family":"Taddeo","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,5,28]]},"reference":[{"key":"489_CR1","doi-asserted-by":"publisher","unstructured":"Bommasani, R., et al.: On the opportunities and risks of foundation models. arXiv https:\/\/doi.org\/10.48550\/arXiv.2108.07258 (2022)","DOI":"10.48550\/arXiv.2108.07258"},{"key":"489_CR2","unstructured":"Blind"},{"key":"489_CR3","unstructured":"Department of Defence.: DOD Directive 3000.09 autonomy in weapon systems. (2012). [Online]. Available: https:\/\/www.esd.whs.mil\/portals\/54\/documents\/dd\/issuances\/dodd\/300009p.pdf"},{"key":"489_CR4","doi-asserted-by":"publisher","unstructured":"Watts, T.F., Bode, I.: Automation and autonomy in air defence systems catalogue (v.1). (2021). https:\/\/doi.org\/10.5281\/ZENODO.4485695","DOI":"10.5281\/ZENODO.4485695"},{"key":"489_CR5","doi-asserted-by":"publisher","DOI":"10.21236\/ADA596829","volume-title":"The Practice of Military Experimentation","author":"B McCue","year":"2003","unstructured":"McCue, B.: The Practice of Military Experimentation. Defense Technical Information Center, Fort Belvoir (2003). https:\/\/doi.org\/10.21236\/ADA596829"},{"issue":"1","key":"489_CR6","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s11023-020-09532-9","volume":"31","author":"I Verdiesen","year":"2021","unstructured":"Verdiesen, I., Santoni de Sio, F., Dignum, V.: Accountability and control over autonomous weapon systems: a framework for comprehensive human oversight. Minds Mach. 31(1), 137\u2013163 (2021). https:\/\/doi.org\/10.1007\/s11023-020-09532-9","journal-title":"Minds Mach."},{"issue":"3","key":"489_CR7","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/s44206-022-00022-2","volume":"1","author":"M Minkkinen","year":"2022","unstructured":"Minkkinen, M., Laine, J., M\u00e4ntym\u00e4ki, M.: Continuous auditing of artificial intelligence: a conceptualization and assessment of tools and frameworks. Digit. Soc. 1(3), 21 (2022). https:\/\/doi.org\/10.1007\/s44206-022-00022-2","journal-title":"Digit. Soc."},{"key":"489_CR8","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1002\/9781119636113.ch28","volume-title":"Handbook of Human Factors and Ergonomics","author":"TB Sheridan","year":"2021","unstructured":"Sheridan, T.B.: Human supervisory control of automation. In: Salvendy, G., Karwowski, W. (eds.) Handbook of Human Factors and Ergonomics, 1st edn., pp. 736\u2013760. Wiley, New York (2021). https:\/\/doi.org\/10.1002\/9781119636113.ch28","edition":"1"},{"issue":"1","key":"489_CR9","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1177\/1555343417737203","volume":"12","author":"DB Kaber","year":"2018","unstructured":"Kaber, D.B.: Issues in human\u2013automation interaction modeling: presumptive aspects of frameworks of types and levels of automation. J. Cogn. Eng. Decis. Mak. 12(1), 7\u201324 (2018). https:\/\/doi.org\/10.1177\/1555343417737203","journal-title":"J. Cogn. Eng. Decis. Mak."},{"key":"489_CR10","first-page":"1","volume":"1","author":"T Sheridan","year":"1978","unstructured":"Sheridan, T., Verplank, W.: Human and computer control of undersea teleoperators, NASA. Ames Res. Center The 14th Ann. Conf. on Manual. Control (1978)","journal-title":"Control"},{"issue":"10","key":"489_CR11","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1109\/MSPEC.1967.5217126","volume":"4","author":"WR Ferrell","year":"1967","unstructured":"Ferrell, W.R., Sheridan, T.B.: Supervisory control of remote manipulation. IEEE Spectr.Spectr. 4(10), 81\u201388 (1967). https:\/\/doi.org\/10.1109\/MSPEC.1967.5217126","journal-title":"IEEE Spectr.Spectr."},{"key":"489_CR12","first-page":"23","volume":"1","author":"N Sharkey","year":"2016","unstructured":"Sharkey, N.: Staying in the loop: Human supervisory control of weapons. In: Bhuta et al. (eds) Autonomous Weapons Systems 23\u201338 (2016)","journal-title":"Autonomous Weapons Systems"},{"key":"489_CR13","unstructured":"Cummings, M.L.: Human supervisory control challenges in network centric operations. In: Proceedings of the Unmanned Vehicle Systems Canada Conference, Banff (2005)"},{"issue":"1","key":"489_CR14","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1518\/001872007779598037","volume":"49","author":"CA Miller","year":"2007","unstructured":"Miller, C.A., Parasuraman, R.: Designing for flexible interaction between humans and automation: delegation interfaces for supervisory control. Hum. Factors 49(1), 57\u201375 (2007). https:\/\/doi.org\/10.1518\/001872007779598037","journal-title":"Hum. Factors"},{"key":"489_CR15","unstructured":"Lee, J.: Review of a pivotal human factors article: \u201chumans and automation: use, misuse, disuse, abuse\u201d. (2008). https:\/\/journals.sagepub.com\/doi.org\/10.1518\/001872008X288547. Accessed 17 Oct 2022"},{"issue":"2","key":"489_CR16","doi-asserted-by":"publisher","first-page":"10","DOI":"10.3390\/systems8020010","volume":"8","author":"CD Johnson","year":"2020","unstructured":"Johnson, C.D., Miller, M.E., Rusnock, C.F., Jacques, D.R.: Applying control abstraction to the design of human-agent teams. Systems 8(2), 10 (2020). https:\/\/doi.org\/10.3390\/systems8020010","journal-title":"Systems"},{"issue":"4","key":"489_CR17","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1007\/s101110200022","volume":"4","author":"SWA Dekker","year":"2002","unstructured":"Dekker, S.W.A., Woods, D.D.: MABA-MABA or abracadabra? Progress on human-automation co-ordination. Cogn. Technol. Work. Technol. Work 4(4), 240\u2013244 (2002). https:\/\/doi.org\/10.1007\/s101110200022","journal-title":"Cogn. Technol. Work. Technol. Work"},{"issue":"3","key":"489_CR18","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1080\/001401399185595","volume":"42","author":"MR Endsley","year":"1999","unstructured":"Endsley, M.R., Kaber, D.B.: Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics 42(3), 462\u2013492 (1999). https:\/\/doi.org\/10.1080\/001401399185595","journal-title":"Ergonomics"},{"key":"489_CR19","unstructured":"Feigh, K.M., Pritchett, A.R.: Requirements for an effective function allocation: a critical review. J. Cogn. Eng. Decis. Mak. (2014)"},{"issue":"3","key":"489_CR20","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/MIS.2013.70","volume":"28","author":"JM Bradshaw","year":"2013","unstructured":"Bradshaw, J.M., Hoffman, R.R., Johnson, M., Woods, D.D.: The seven deadly myths of \u201cAutonomous Systems.\u201d IEEE Intell. Syst.Intell. Syst. 28(3), 54\u201361 (2013). https:\/\/doi.org\/10.1109\/MIS.2013.70","journal-title":"IEEE Intell. Syst.Intell. Syst."},{"issue":"1","key":"489_CR21","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1145\/3434580","volume":"28","author":"W Xu","year":"2021","unstructured":"Xu, W.: From automation to autonomy and autonomous vehicles: challenges and opportunities for human\u2013computer interaction. Interactions 28(1), 48\u201353 (2021). https:\/\/doi.org\/10.1145\/3434580","journal-title":"Interactions"},{"key":"489_CR22","unstructured":"Greenhouse, S.: US experts warn AI likely to kill off jobs\u2014and widen wealth inequality. The Guardian (2023). [Online]. Available: https:\/\/www.theguardian.com\/technology\/2023\/feb\/08\/ai-chatgpt-jobs-economy-inequality. Accessed: 09 May 2023"},{"key":"489_CR23","doi-asserted-by":"crossref","unstructured":"Malone, T., Kirkpatrick, M., Mallory, K., Eik, D., Johnson, J., Walker, R.: Human factors EVclluation of Control Room Design and Operator performance at Three Mile Island-2. (1980). [Online]. Available: https:\/\/www.osti.gov\/servlets\/purl\/5603680","DOI":"10.2172\/5474764"},{"key":"489_CR24","unstructured":"BEA.: Safety investigation following the accident on 1ST June 2009 to the Airbus A300-203, Flight AF 447 summary, p. 5. (2012). [Online]. Available: https:\/\/humanfactors101.files.wordpress.com\/2020\/12\/summary-report-bea-5-july-2012.pdf"},{"issue":"6","key":"489_CR25","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1016\/0005-1098(83)90046-8","volume":"19","author":"L Bainbridge","year":"1983","unstructured":"Bainbridge, L.: Ironies of automation. Automatica 19(6), 775\u2013779 (1983). https:\/\/doi.org\/10.1016\/0005-1098(83)90046-8","journal-title":"Automatica"},{"key":"489_CR26","doi-asserted-by":"publisher","unstructured":"Donmez, B., Pina, P.E., Cummings, M.L.: Evaluation criteria for human-automation performance metrics. In: Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems-PerMIS \u201908, p. 77. ACM Press, Gaithersburg (2008). https:\/\/doi.org\/10.1145\/1774674.1774687","DOI":"10.1145\/1774674.1774687"},{"issue":"2","key":"489_CR27","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1518\/001872097778543886","volume":"39","author":"R Parasuraman","year":"1997","unstructured":"Parasuraman, R., Riley, V.: Humans and automation: use, misuse, disuse, abuse. Hum. Factors J. Hum. Factors Ergon. Soc. 39(2), 230\u2013253 (1997). https:\/\/doi.org\/10.1518\/001872097778543886","journal-title":"Hum. Factors J. Hum. Factors Ergon. Soc."},{"key":"489_CR28","unstructured":"Endsley, M.: Automation and situational awarness. (1996). [Online]. Available: http:\/\/www.aerohabitat.eu\/uploads\/media\/Automation_and_Situation_Awareness_-_Endsley.pdf"},{"issue":"1","key":"489_CR29","doi-asserted-by":"publisher","first-page":"112","DOI":"10.5898\/JHRI.2.1.Strabala","volume":"2","author":"KW Strabala","year":"2013","unstructured":"Strabala, K.W., et al.: Towards seamless human\u2013robot handovers. J. Hum. Robot Interact. 2(1), 112\u2013132 (2013). https:\/\/doi.org\/10.5898\/JHRI.2.1.Strabala","journal-title":"J. Hum. Robot Interact."},{"key":"489_CR30","unstructured":"Boardman, M., Butcher, F.: An exploration of maintaining human control in ai enabled systems and the challenges of achieving it. (2019)"},{"key":"489_CR31","unstructured":"Siebert, L.C., et al.: Meaningful human control over AI systems: beyond talking the talk. (2021). ArXiv211201298 Cs. [Online]. Available: http:\/\/arxiv.org\/abs\/2112.01298. Accessed: 24 Mar 2022"},{"issue":"4","key":"489_CR32","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3390\/systems6040044","volume":"6","author":"AM Madni","year":"2018","unstructured":"Madni, A.M., Madni, C.C.: Architectural framework for exploring adaptive human\u2013machine teaming options in simulated dynamic environments. Systems 6(4), 4 (2018). https:\/\/doi.org\/10.3390\/systems6040044","journal-title":"Systems"},{"key":"489_CR33","doi-asserted-by":"crossref","unstructured":"Li, K., Wieringa, P.A.: Understanding perceived complexity in human supervisory control. (2000)","DOI":"10.1007\/s101110050029"},{"key":"489_CR34","doi-asserted-by":"crossref","unstructured":"Ullrich, D., Butz, A., Diefenbach, S.: The development of overtrust: an empirical simulation and psychological analysis in the context of human\u2013robot interaction. Front. Robot. AI 8 (2021). [Online]. Available: 17 https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2021.554578. Accessed: Nov 2022","DOI":"10.3389\/frobt.2021.554578"},{"key":"489_CR35","doi-asserted-by":"publisher","unstructured":"Ueno, T., Sawa, Y., Kim, Y., Urakami, J., Oura, H., Seaborn, K.: Trust in human\u2013AI interaction: scoping out models, measures, and methods. In: CHI Conference on Human Factors in Computing Systems Extended Abstracts, pp. 1\u20137. ACM, New Orleans (2022). https:\/\/doi.org\/10.1145\/3491101.3519772","DOI":"10.1145\/3491101.3519772"},{"issue":"2","key":"489_CR36","doi-asserted-by":"publisher","first-page":"205630511876829","DOI":"10.1177\/2056305118768296","volume":"4","author":"T Karppi","year":"2018","unstructured":"Karppi, T.: \u201cThe Computer Said So\u201d: on the ethics, effectiveness, and cultural techniques of predictive policing. Soc. Media Soc. 4(2), 205630511876829 (2018). https:\/\/doi.org\/10.1177\/2056305118768296","journal-title":"Soc. Media Soc."},{"key":"489_CR37","doi-asserted-by":"publisher","unstructured":"Cummings, M.: Automation bias in intelligent time critical decision support systems. In: AIAA 1st Intelligent Systems Technical Conference. American Institute of Aeronautics and Astronautics, Chicago (2012). https:\/\/doi.org\/10.2514\/6.2004-6313","DOI":"10.2514\/6.2004-6313"},{"key":"489_CR38","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2018.00015","author":"F Santoni de Sio","year":"2018","unstructured":"Santoni de Sio, F., van den Hoven, J.: Meaningful human control over autonomous systems: a philosophical account. Front. Robot. AI (2018). https:\/\/doi.org\/10.3389\/frobt.2018.00015","journal-title":"Front. Robot. AI"},{"key":"489_CR39","unstructured":"Docherty, B.: Losing humanity. Hum. Rights Watch. (2012). [Online]. Available: https:\/\/www.hrw.org\/report\/2012\/11\/19\/losing-humanity\/case-against-killer-robots. Accessed: 09 May 2023"},{"key":"489_CR40","volume-title":"A Blanchard","author":"M Taddeo","year":"2022","unstructured":"Taddeo, M. Blanchard A.: A comparative analysis of the definitions of autonomous weapons systems, Science and engineering ethics (2022)"},{"key":"489_CR41","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1016\/j.future.2022.05.014","volume":"135","author":"X Wu","year":"2022","unstructured":"Wu, X., Xiao, L., Sun, Y., Zhang, J., Ma, T., He, L.: A survey of human-in-the-loop for machine learning. Future Gener. Comput. Syst. 135, 364\u2013381 (2022). https:\/\/doi.org\/10.1016\/j.future.2022.05.014","journal-title":"Future Gener. Comput. Syst."},{"key":"489_CR42","unstructured":"OpenAI.: OpenAI safety best practices. (2023). https:\/\/platform.openai.com. Accessed 08 Jul 2023"},{"issue":"3","key":"489_CR43","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1080\/1463922X.2017.1293187","volume":"20","author":"M Kyriakidis","year":"2019","unstructured":"Kyriakidis, M., et al.: A human factors perspective on automated driving. Theor. Issues Ergon. Sci.. Issues Ergon. Sci. 20(3), 223\u2013249 (2019). https:\/\/doi.org\/10.1080\/1463922X.2017.1293187","journal-title":"Theor. Issues Ergon. Sci.. Issues Ergon. Sci."},{"key":"489_CR44","doi-asserted-by":"publisher","first-page":"38637","DOI":"10.1109\/ACCESS.2018.2853560","volume":"6","author":"P Damacharla","year":"2018","unstructured":"Damacharla, P., Javaid, A.Y., Gallimore, J.J., Devabhaktuni, V.K.: Common metrics to benchmark human\u2013machine teams (HMT): a review. IEEE Access 6, 38637\u201338655 (2018). https:\/\/doi.org\/10.1109\/ACCESS.2018.2853560","journal-title":"IEEE Access"},{"key":"489_CR45","doi-asserted-by":"crossref","unstructured":"Pagliari, M., Chambon, V., Berberian, B.: What is new with artificial intelligence? Human\u2013agent interactions through the lens of social agency. (2020)","DOI":"10.31234\/osf.io\/a6fmr"},{"key":"489_CR46","doi-asserted-by":"publisher","unstructured":"Dafoe et al., A.: Open problems in cooperative AI. arXiv https:\/\/doi.org\/10.48550\/arXiv.2012.08630 (2020)","DOI":"10.48550\/arXiv.2012.08630"},{"issue":"2","key":"489_CR47","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2019.103174","volume":"57","author":"I Seeber","year":"2020","unstructured":"Seeber, I., et al.: Machines as teammates: a research agenda on AI in team collaboration. Inf. Manag. 57(2), 103174 (2020). https:\/\/doi.org\/10.1016\/j.im.2019.103174","journal-title":"Inf. Manag."},{"key":"489_CR48","unstructured":"Elliot, J.: Artificial social intelligence for successful teams. (2021). https:\/\/www.darpa.mil\/program\/artificial-social-intelligence-for-successful-teams. Accessed 17 Nov 2022"},{"key":"489_CR49","unstructured":"DARPA. Teaching AI systems to adapt to dynamic environments. (2019). https:\/\/www.darpa.mil\/news-events\/2019-02-14. Accessed 17 Nov 2022"},{"key":"489_CR50","unstructured":"Rudd, L.: Competency-aware machine learning. (2019). https:\/\/www.darpa.mil\/program\/competency-aware-machine-learning. Accessed 17 Nov 2022"},{"key":"489_CR51","unstructured":"Sutton, R.: The bitter lesson. (2019). http:\/\/www.incompleteideas.net\/IncIdeas\/BitterLesson.html. Accessed 31 Aug 2020"},{"issue":"7777","key":"489_CR52","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1038\/d41586-019-03013-5","volume":"574","author":"D Heaven","year":"2019","unstructured":"Heaven, D.: Why deep-learning AIs are so easy to fool. Nature 574(7777), 163\u2013166 (2019). https:\/\/doi.org\/10.1038\/d41586-019-03013-5","journal-title":"Nature"},{"key":"489_CR53","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2021.642201","volume":"8","author":"S Daronnat","year":"2021","unstructured":"Daronnat, S., Azzopardi, L., Halvey, M., Dubiel, M.: Inferring trust from users\u2019 behaviours; agents\u2019 predictability positively affects trust, task performance and cognitive load in human-agent real-time collaboration. Front. Robot. AI 8, 642201 (2021). https:\/\/doi.org\/10.3389\/frobt.2021.642201","journal-title":"Front. Robot. AI"},{"key":"489_CR54","unstructured":"Perrigo, B.: Exclusive: the $2 per hour workers who made ChatGPT safer. Time. (2023). https:\/\/time.com\/6247678\/openai-chatgpt-kenya-workers\/. Accessed 07 July 2023"},{"key":"489_CR55","doi-asserted-by":"publisher","unstructured":"Dell\u2019Acqua, F., et al.: Navigating the jagged technological frontier: field experimental evidence of the effects of AI on knowledge worker productivity and quality. Rochester (2023). https:\/\/doi.org\/10.2139\/ssrn.4573321","DOI":"10.2139\/ssrn.4573321"},{"key":"489_CR56","unstructured":"UNIDIR.: Human\u2013machine interfaces in autonomous weapon systems | UNIDIR\u2019. (2022). https:\/\/www.unidir.org\/human-machine-interfaces. Accessed 17 Nov 2022"},{"issue":"4","key":"489_CR57","doi-asserted-by":"publisher","first-page":"1847","DOI":"10.1016\/j.concog.2011.08.014","volume":"20","author":"G Moretto","year":"2011","unstructured":"Moretto, G., Walsh, E., Haggard, P.: Experience of agency and sense of responsibility. Conscious. Cogn.Cogn. 20(4), 1847\u20131854 (2011). https:\/\/doi.org\/10.1016\/j.concog.2011.08.014","journal-title":"Conscious. Cogn.Cogn."},{"issue":"34","key":"489_CR58","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.ifacol.2019.01.049","volume":"51","author":"B Berberian","year":"2019","unstructured":"Berberian, B.: Man\u2013machine teaming: a problem of agency. IFAC-Pap. 51(34), 118\u2013123 (2019). https:\/\/doi.org\/10.1016\/j.ifacol.2019.01.049","journal-title":"IFAC-Pap."},{"issue":"3","key":"489_CR59","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1038\/d41591-023-00014-w","volume":"29","author":"A Zhavoronkov","year":"2023","unstructured":"Zhavoronkov, A.: Caution with AI-generated content in biomedicine. Nat. Med. 29(3), 532\u2013532 (2023). https:\/\/doi.org\/10.1038\/d41591-023-00014-w","journal-title":"Nat. Med."},{"key":"489_CR60","doi-asserted-by":"publisher","DOI":"10.1177\/0018720820960865","author":"T O\u2019Neill","year":"2020","unstructured":"O\u2019Neill, T., McNeese, N., Barron, A., Schelble, B.: Human\u2013autonomy teaming: a review and analysis of the empirical literature. Hum. Factors J. Hum. Factors Ergon. Soc. (2020). https:\/\/doi.org\/10.1177\/0018720820960865","journal-title":"Hum. Factors J. Hum. Factors Ergon. Soc."},{"key":"489_CR61","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/978-1-4899-7668-0_9","volume-title":"Robust Intelligence and Trust in Autonomous Systems","author":"F Gao","year":"2016","unstructured":"Gao, F., Cummings, M.L., Solovey, E.: Designing for robust and effective teamwork in human\u2013agent teams. In: Mittu, R., Sofge, D., Wagner, A., Lawless, W.F. (eds.) Robust Intelligence and Trust in Autonomous Systems, pp. 167\u2013190. Springer US, Boston (2016). https:\/\/doi.org\/10.1007\/978-1-4899-7668-0_9"},{"issue":"2","key":"489_CR62","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1109\/THMS.2018.2877482","volume":"49","author":"M Demir","year":"2019","unstructured":"Demir, M., Likens, A.D., Cooke, N.J., Amazeen, P.G., McNeese, N.J.: Team coordination and effectiveness in human-autonomy teaming. IEEE Trans. Hum.-Mach. Syst. 49(2), 150\u2013159 (2019). https:\/\/doi.org\/10.1109\/THMS.2018.2877482","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"issue":"s1","key":"489_CR63","doi-asserted-by":"publisher","first-page":"S15","DOI":"10.3233\/WOR-220268","volume":"73","author":"GA Boy","year":"2022","unstructured":"Boy, G.A., Morel, C.: The machine as a partner: human\u2013machine teaming design using the PRODEC method. Work 73(s1), S15\u2013S30 (2022). https:\/\/doi.org\/10.3233\/WOR-220268","journal-title":"Work"},{"key":"489_CR64","doi-asserted-by":"publisher","unstructured":"Shih, A., Sawhney, A., Kondic, J., Ermon, S., Sadigh, D.: On the critical role of conventions in adaptive human\u2013AI collaboration. arXiv (2021). https:\/\/doi.org\/10.48550\/arXiv.2104.02871","DOI":"10.48550\/arXiv.2104.02871"},{"key":"489_CR65","unstructured":"U. M. of D. MoD.: Human\u2013machine teaming (JCN 1\/18)\u2019, GOV.UK, 2018. https:\/\/www.gov.uk\/government\/publications\/human-machine-teaming-jcn-118. Accessed 22 Mar 2022"},{"key":"489_CR66","unstructured":"Shih, A., Sawhney, A., Kondic, J., Ermon, S., Sadigh, D.: On the critical role of conventions in adaptive human\u2013AI collaboration. ArXiv210402871 Cs (2021). [Online]. Available: http:\/\/arxiv.org\/abs\/2104.02871. Accessed: 05 May 2022"},{"issue":"4","key":"489_CR67","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1109\/TSMCC.2010.2056682","volume":"41","author":"JYC Chen","year":"2011","unstructured":"Chen, J.Y.C., Barnes, M.J., Harper-Sciarini, M.: Supervisory control of multiple robots: human-performance issues and user-interface design. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev.Cybern. Part C Appl. Rev. 41(4), 435\u2013454 (2011). https:\/\/doi.org\/10.1109\/TSMCC.2010.2056682","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev.Cybern. Part C Appl. Rev."},{"issue":"34","key":"489_CR68","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1016\/j.ifacol.2019.01.026","volume":"51","author":"K Akash","year":"2019","unstructured":"Akash, K., Reid, T., Jain, N.: Improving human\u2013machine collaboration through transparency-based feedback\u2014Part II: control design and synthesis. IFAC-Pap. 51(34), 322\u2013328 (2019). https:\/\/doi.org\/10.1016\/j.ifacol.2019.01.026","journal-title":"IFAC-Pap."},{"key":"489_CR69","unstructured":"Konaev, M., Chahal, H.: Building trust in human\u2013machine teams. 2021. [Online]. Available: https:\/\/www.brookings.edu\/techstream\/building-trust-in-human-machine-teams\/"},{"key":"489_CR70","doi-asserted-by":"publisher","unstructured":"Tam, D., Mascarenhas, A., Zhang, S., Kwan, S., Bansal, M., Raffel, C.: Evaluating the factual consistency of large language models through summarization. arXiv (2022). https:\/\/doi.org\/10.48550\/arXiv.2211.08412","DOI":"10.48550\/arXiv.2211.08412"},{"key":"489_CR71","unstructured":"Dziri, N., et al.: Faith and fate: limits of transformers on compositionality. arXiv (2023). [Online]. Available: http:\/\/arxiv.org\/abs\/2305.18654. Accessed: 08 July 2023"},{"issue":"4","key":"489_CR72","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1177\/1555343419867563","volume":"13","author":"JC Walliser","year":"2019","unstructured":"Walliser, J.C., de Visser, E.J., Wiese, E., Shaw, T.H.: Team structure and team building improve human\u2013machine teaming with autonomous agents. J. Cogn. Eng. Decis. Mak. 13(4), 258\u2013278 (2019). https:\/\/doi.org\/10.1177\/1555343419867563","journal-title":"J. Cogn. Eng. Decis. Mak."},{"key":"489_CR73","doi-asserted-by":"crossref","unstructured":"Stowers, K., Brady, L.L., MacLellan, C., Wohleber, R., Salas, E.: Improving teamwork competencies in human\u2013machine teams: perspectives from team science. Front. Psychol. 12 (2021). [Online]. Available: https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2021.590290. Accessed: 08 Nov 2022","DOI":"10.3389\/fpsyg.2021.590290"},{"key":"489_CR74","unstructured":"MoD.: Human\u2013machine teaming. Joint Concept Note 1\/18 (2018)"},{"issue":"2","key":"489_CR75","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1016\/S0899-8256(05)80001-6","volume":"8","author":"K Bagwell","year":"1995","unstructured":"Bagwell, K.: Commitment and observability in games. Games Econ. Behav. 8(2), 271\u2013280 (1995). https:\/\/doi.org\/10.1016\/S0899-8256(05)80001-6","journal-title":"Games Econ. Behav."},{"key":"489_CR76","unstructured":"North, D.C.: Institutions and credible commitment. J. Inst. Theor. Econ. JITE Z. F\u00fcr Gesamte Staatswiss. 149(1), 11\u201323 (1993). [Online]. Available: https:\/\/www.jstor.org\/stable\/40751576. Accessed: 18 Oct 2022"},{"key":"489_CR77","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2021.106852","volume":"122","author":"G Musick","year":"2021","unstructured":"Musick, G., O\u2019Neill, T.A., Schelble, B.G., McNeese, N.J., Henke, J.B.: What happens when humans believe their teammate is an AI? An investigation into humans teaming with autonomy. Comput. Hum. Behav.. Hum. Behav. 122, 106852 (2021). https:\/\/doi.org\/10.1016\/j.chb.2021.106852","journal-title":"Comput. Hum. Behav.. Hum. Behav."},{"issue":"2","key":"489_CR78","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1177\/1555343411409323","volume":"5","author":"M Lewis","year":"2011","unstructured":"Lewis, M., Wang, H., Chien, S.Y., Velagapudi, P., Scerri, P., Sycara, K.: Process and performance in human\u2013robot teams. J. Cogn. Eng. Decis. Mak. 5(2), 186\u2013208 (2011). https:\/\/doi.org\/10.1177\/1555343411409323","journal-title":"J. Cogn. Eng. Decis. Mak."},{"issue":"4","key":"489_CR79","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1080\/09592318.2020.1743485","volume":"31","author":"A Warren","year":"2020","unstructured":"Warren, A., Hillas, A.: Friend or frenemy? The role of trust in human\u2013machine teaming and lethal autonomous weapons systems. Small Wars Insur. 31(4), 822\u2013850 (2020). https:\/\/doi.org\/10.1080\/09592318.2020.1743485","journal-title":"Small Wars Insur."},{"key":"489_CR80","unstructured":"DARPA.: ASIST\u2014Artificial Social Intelligence for Successful Teams. 2020. https:\/\/www.darpa.mil\/program\/artificial-social-intelligence-for-successful-teams. Accessed 17 Oct 2022"},{"key":"489_CR81","doi-asserted-by":"publisher","unstructured":"National Academies of Sciences, Engineering, and Medicine.: Human\u2013AI Teaming: State-of-the-Art and Research Needs, p. 26355. National Academies Press, Washington, D.C. (2022). https:\/\/doi.org\/10.17226\/26355","DOI":"10.17226\/26355"},{"key":"489_CR82","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-022-00597-7","volume":"1","author":"KE Henry","year":"2022","unstructured":"Henry, K.E., et al.: Human\u2013machine teaming is key to AI adoption: clinicians experiences with a deployed machine learning system, Npj Digit. Med. 5(1). (2022). https:\/\/doi.org\/10.1038\/s41746-022-00597-7","journal-title":"Med."},{"key":"489_CR83","unstructured":"Cooke, N.J., Demir, M., McNeese, N.: Synthetic teammates as team players: coordination of human and synthetic teammates. Cognitive Engineering Research Institute Mesa United States (2016). [Online]. Available: https:\/\/apps.dtic.mil\/sti\/citations\/AD1017169. Accessed: 21 June 2022"},{"key":"489_CR84","unstructured":"McNeese, N.J., Schelble, B.G., Canonico, L.B., Demir, M.: Who\/what is my teammate? Team composition considerations in human\u2013AI teaming. ArXiv210511000 Cs (2021). [Online]. Available: http:\/\/arxiv.org\/abs\/2105.11000. Accessed: 28 Mar 2022"}],"container-title":["AI and Ethics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-024-00489-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43681-024-00489-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-024-00489-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,7]],"date-time":"2025-05-07T06:00:47Z","timestamp":1746597647000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43681-024-00489-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,28]]},"references-count":84,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["489"],"URL":"https:\/\/doi.org\/10.1007\/s43681-024-00489-4","relation":{},"ISSN":["2730-5953","2730-5961"],"issn-type":[{"value":"2730-5953","type":"print"},{"value":"2730-5961","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,28]]},"assertion":[{"value":"19 July 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}