{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,29]],"date-time":"2026-07-29T02:21:51Z","timestamp":1785291711141,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":105,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3715275.3732157","type":"proceedings-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T17:03:13Z","timestamp":1750698193000},"page":"2302-2317","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Agent Allocation of Moral Decisions in Human-Agent Teams: Raise Human Involvement and Explain Potential Consequences"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2234-0754","authenticated-orcid":false,"given":"Ruben S.","family":"Verhagen","sequence":"first","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8161-5722","authenticated-orcid":false,"given":"Mark A.","family":"Neerincx","sequence":"additional","affiliation":[{"name":"TNO, Soesterberg, Netherlands and Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7826-5821","authenticated-orcid":false,"given":"Myrthe L.","family":"Tielman","sequence":"additional","affiliation":[{"name":"Delft University of Technology, Delft, Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"e_1_3_3_1_2_2","doi-asserted-by":"crossref","unstructured":"Kjersti Aas Martin Jullum and Anders L\u00f8land. 2021. Explaining individual predictions when features are dependent: More accurate approximations to Shapley values. Artificial Intelligence 298 (2021) 103502.","DOI":"10.1016\/j.artint.2021.103502"},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"crossref","unstructured":"David\u00a0A Abbink Tom Carlson Mark Mulder Joost\u00a0CF De\u00a0Winter Farzad Aminravan Tricia\u00a0L Gibo and Erwin\u00a0R Boer. 2018. A topology of shared control systems\u2014finding common ground in diversity. IEEE Transactions on Human-Machine Systems 48 5 (2018) 509\u2013525.","DOI":"10.1109\/THMS.2018.2791570"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"crossref","unstructured":"Zeynep Akata Dan Balliet Maarten De\u00a0Rijke Frank Dignum Virginia Dignum Guszti Eiben Antske Fokkens Davide Grossi Koen Hindriks Holger Hoos et\u00a0al. 2020. A research agenda for hybrid intelligence: augmenting human intellect with collaborative adaptive responsible and explainable artificial intelligence. Computer 53 8 (2020) 18\u201328.","DOI":"10.1109\/MC.2020.2996587"},{"key":"e_1_3_3_1_5_2","unstructured":"Michael Anderson and Susan\u00a0Leigh Anderson. 2007. Machine ethics: Creating an ethical intelligent agent. AI magazine 28 4 (2007) 15\u201315."},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"crossref","unstructured":"Michael Anderson and Susan\u00a0Leigh Anderson. 2018. GenEth: A general ethical dilemma analyzer. Paladyn Journal of Behavioral Robotics 9 1 (2018) 337\u2013357.","DOI":"10.1515\/pjbr-2018-0024"},{"key":"e_1_3_3_1_7_2","first-page":"1078","volume-title":"18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2019), Montreal, Canada, May 13\u201317, 2019","author":"Anjomshoae Sule","year":"2019","unstructured":"Sule Anjomshoae, Amro Najjar, Davide Calvaresi, and Kary Fr\u00e4mling. 2019. Explainable agents and robots: Results from a systematic literature review. In 18th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2019), Montreal, Canada, May 13\u201317, 2019. International Foundation for Autonomous Agents and Multiagent Systems, 1078\u20131088."},{"key":"e_1_3_3_1_8_2","volume-title":"Workshops at the thirty-first AAAI conference on artificial intelligence","author":"Arnold Thomas","year":"2017","unstructured":"Thomas Arnold, Daniel Kasenberg, and Matthias Scheutz. 2017. Value Alignment or Misalignment\u2013What Will Keep Systems Accountable?. In Workshops at the thirty-first AAAI conference on artificial intelligence."},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"crossref","unstructured":"Mohammad\u00a0Q Azhar and Elizabeth\u00a0I Sklar. 2017. A study measuring the impact of shared decision making in a human-robot team. The International Journal of Robotics Research 36 5-7 (2017) 461\u2013482.","DOI":"10.1177\/0278364917710540"},{"key":"e_1_3_3_1_10_2","volume-title":"ISAIM","author":"Baum Kevin","year":"2018","unstructured":"Kevin Baum, Holger Hermanns, and Timo Speith. 2018. From Machine Ethics To Machine Explainability and Back.. In ISAIM."},{"key":"e_1_3_3_1_11_2","doi-asserted-by":"crossref","unstructured":"Kevin Baum Susanne Mantel Eva Schmidt and Timo Speith. 2022. From responsibility to reason-giving explainable artificial intelligence. Philosophy & Technology 35 1 (2022) 12.","DOI":"10.1007\/s13347-022-00510-w"},{"key":"e_1_3_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/2701973.2702059"},{"key":"e_1_3_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-25928-2_3"},{"key":"e_1_3_3_1_14_2","doi-asserted-by":"crossref","unstructured":"Virginia Braun and Victoria Clarke. 2019. Reflecting on reflexive thematic analysis. Qualitative research in sport exercise and health 11 4 (2019) 589\u2013597.","DOI":"10.1080\/2159676X.2019.1628806"},{"key":"e_1_3_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2015.26"},{"key":"e_1_3_3_1_16_2","doi-asserted-by":"crossref","unstructured":"Simeon\u00a0C Calvert Dani\u00ebl\u00a0D Heikoop Giulio Mecacci and Bart Van\u00a0Arem. 2020. A human centric framework for the analysis of automated driving systems based on meaningful human control. TheoreTical issues in ergonomics science 21 4 (2020) 478\u2013506.","DOI":"10.1080\/1463922X.2019.1697390"},{"key":"e_1_3_3_1_17_2","doi-asserted-by":"crossref","unstructured":"Simeon\u00a0C Calvert and Giulio Mecacci. 2020. A conceptual control system description of Cooperative and Automated Driving in mixed urban traffic with Meaningful Human Control for design and evaluation. IEEE Open Journal of Intelligent Transportation Systems 1 (2020) 147\u2013158.","DOI":"10.1109\/OJITS.2020.3021461"},{"key":"e_1_3_3_1_18_2","doi-asserted-by":"crossref","unstructured":"Cristiano Castelfranchi and Rino Falcone. 2003. From automaticity to autonomy: the frontier of artificial agents. Agent autonomy (2003) 103\u2013136.","DOI":"10.1007\/978-1-4419-9198-0_6"},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Luciano Cavalcante\u00a0Siebert Maria\u00a0Luce Lupetti Evgeni Aizenberg Niek Beckers Arkady Zgonnikov Herman Veluwenkamp David Abbink Elisa Giaccardi Geert-Jan Houben Catholijn\u00a0M Jonker et\u00a0al. 2023. Meaningful human control: actionable properties for AI system development. AI and Ethics 3 1 (2023) 241\u2013255.","DOI":"10.1007\/s43681-022-00167-3"},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"crossref","unstructured":"Jos\u00e9-Antonio Cervantes Sonia L\u00f3pez Luis-Felipe Rodr\u00edguez Salvador Cervantes Francisco Cervantes and F\u00e9lix Ramos. 2020. Artificial moral agents: A survey of the current status. Science and engineering ethics 26 2 (2020) 501\u2013532.","DOI":"10.1007\/s11948-019-00151-x"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Jessie\u00a0YC Chen and Michael\u00a0J Barnes. 2014. Human\u2013agent teaming for multirobot control: A review of human factors issues. IEEE Transactions on Human-Machine Systems 44 1 (2014) 13\u201329.","DOI":"10.1109\/THMS.2013.2293535"},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"crossref","unstructured":"Manolis Chiou Nick Hawes and Rustam Stolkin. 2021. Mixed-Initiative variable autonomy for remotely operated mobile robots. ACM Transactions on Human-Robot Interaction (THRI) 10 4 (2021) 1\u201334.","DOI":"10.1145\/3472206"},{"key":"e_1_3_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2016.7759527"},{"key":"e_1_3_3_1_24_2","doi-asserted-by":"crossref","unstructured":"Markus Christen Thomas Burri Serhiy Kandul and Pascal V\u00f6r\u00f6s. 2023. Who is controlling whom? Reframing \u201cmeaningful human control\u201d of AI systems in security. Ethics and Information Technology 25 1 (2023) 10.","DOI":"10.1007\/s10676-023-09686-x"},{"key":"e_1_3_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-01369-5"},{"key":"e_1_3_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.11140"},{"key":"e_1_3_3_1_27_2","unstructured":"Rebecca Crootof. 2016. A meaningful floor for meaningful human control. Temp. Int\u2019l & Comp. LJ 30 (2016) 53."},{"key":"e_1_3_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Jovana Davidovic. 2023. On the purpose of meaningful human control of AI. Frontiers in big data 5 (2023) 1017677.","DOI":"10.3389\/fdata.2022.1017677"},{"key":"e_1_3_3_1_29_2","unstructured":"Filippo\u00a0Santoni de Sio Giulio Mecacci Simeon Calvert Daniel Heikoop Marjan Hagenzieker and Bart van Arem. 2022. Realising meaningful human control over automated driving systems: a multidisciplinary approach. Minds and machines (2022) 1\u201325."},{"key":"e_1_3_3_1_30_2","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1702.08608 (2017)."},{"key":"e_1_3_3_1_31_2","doi-asserted-by":"crossref","unstructured":"Nir Douer and Joachim Meyer. 2020. The responsibility quantification model of human interaction with automation. IEEE Transactions on Automation Science and Engineering 17 2 (2020) 1044\u20131060.","DOI":"10.1109\/TASE.2020.2965466"},{"key":"e_1_3_3_1_32_2","doi-asserted-by":"crossref","unstructured":"Mary\u00a0T Dzindolet Scott\u00a0A Peterson Regina\u00a0A Pomranky Linda\u00a0G Pierce and Hall\u00a0P Beck. 2003. The role of trust in automation reliance. International journal of human-computer studies 58 6 (2003) 697\u2013718.","DOI":"10.1016\/S1071-5819(03)00038-7"},{"key":"e_1_3_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/NAECON.1988.195097"},{"key":"e_1_3_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781315087924-9"},{"key":"e_1_3_3_1_35_2","doi-asserted-by":"crossref","unstructured":"Mica\u00a0R Endsley and Esin\u00a0O Kiris. 1995. The out-of-the-loop performance problem and level of control in automation. Human factors 37 2 (1995) 381\u2013394.","DOI":"10.1518\/001872095779064555"},{"key":"e_1_3_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7585.001.0001"},{"key":"e_1_3_3_1_37_2","doi-asserted-by":"crossref","unstructured":"Matthew\u00a0C Gombolay Reymundo\u00a0A Gutierrez Shanelle\u00a0G Clarke Giancarlo\u00a0F Sturla and Julie\u00a0A Shah. 2015. Decision-making authority team efficiency and human worker satisfaction in mixed human\u2013robot teams. Autonomous Robots 39 (2015) 293\u2013312.","DOI":"10.1007\/s10514-015-9457-9"},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"crossref","unstructured":"Riccardo Guidotti Anna Monreale Salvatore Ruggieri Franco Turini Fosca Giannotti and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51 5 (2018) 1\u201342.","DOI":"10.1145\/3236009"},{"key":"e_1_3_3_1_39_2","unstructured":"David Gunning. 2017. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA) nd Web 2 2 (2017)."},{"key":"e_1_3_3_1_40_2","doi-asserted-by":"crossref","unstructured":"Peter\u00a0A Hancock Deborah\u00a0R Billings Kristin\u00a0E Schaefer Jessie\u00a0YC Chen Ewart\u00a0J De\u00a0Visser and Raja Parasuraman. 2011. A meta-analysis of factors affecting trust in human-robot interaction. Human factors 53 5 (2011) 517\u2013527.","DOI":"10.1177\/0018720811417254"},{"key":"e_1_3_3_1_41_2","doi-asserted-by":"crossref","unstructured":"Pim Haselager and Giulio Mecacci. 2020. Superethics instead of superintelligence: know thyself and apply science accordingly. AJOB neuroscience 11 2 (2020) 113\u2013119.","DOI":"10.1080\/21507740.2020.1740353"},{"key":"e_1_3_3_1_42_2","first-page":"407","volume-title":"Proceedings of the Aristotelian society","volume":"111","author":"Hieronymi Pamela","year":"2011","unstructured":"Pamela Hieronymi. 2011. XIV\u2014Reasons for Action. In Proceedings of the Aristotelian society, Vol.\u00a0111. Oxford University Press Oxford, UK, 407\u2013427."},{"key":"e_1_3_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.8154912"},{"key":"e_1_3_3_1_44_2","unstructured":"Liwei Jiang Jena\u00a0D Hwang Chandra Bhagavatula Ronan\u00a0Le Bras Jenny Liang Jesse Dodge Keisuke Sakaguchi Maxwell Forbes Jon Borchardt Saadia Gabriel et\u00a0al. 2021. Can machines learn morality? the delphi experiment. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2110.07574 (2021)."},{"key":"e_1_3_3_1_45_2","doi-asserted-by":"publisher","unstructured":"Matthew Johnson Jeffrey\u00a0M. Bradshaw Paul\u00a0J. Feltovich Catholijn\u00a0M. Jonker M.\u00a0Birna van Riemsdijk and Maarten Sierhuis. 2014. Coactive Design: Designing Support for Interdependence in Joint Activity. J. Hum.-Robot Interact. 3 1 (Feb. 2014) 43\u201369. 10.5898\/JHRI.3.1.Johnson","DOI":"10.5898\/JHRI.3.1.Johnson"},{"key":"e_1_3_3_1_46_2","doi-asserted-by":"publisher","unstructured":"Matthew Johnson and Alonso Vera. 2019. No AI Is an Island: The Case for Teaming Intelligence. AI Magazine 40 1 (Mar. 2019) 16\u201328. 10.1609\/aimag.v40i1.2842","DOI":"10.1609\/aimag.v40i1.2842"},{"key":"e_1_3_3_1_47_2","doi-asserted-by":"crossref","unstructured":"Marten\u00a0HL Kaas. 2024. The perfect technological storm: artificial intelligence and moral complacency. Ethics and Information Technology 26 3 (2024) 49.","DOI":"10.1007\/s10676-024-09788-0"},{"key":"e_1_3_3_1_48_2","doi-asserted-by":"crossref","unstructured":"Guy Kahane Jim\u00a0AC Everett Brian\u00a0D Earp Lucius Caviola Nadira\u00a0S Faber Molly\u00a0J Crockett and Julian Savulescu. 2018. Beyond sacrificial harm: A two-dimensional model of utilitarian psychology. Psychological review 125 2 (2018) 131.","DOI":"10.1037\/rev0000093"},{"key":"e_1_3_3_1_49_2","unstructured":"Tae\u00a0Wan Kim Thomas Donaldson and John Hooker. 2019. Grounding value alignment with ethical principles. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1907.05447 (2019)."},{"key":"e_1_3_3_1_50_2","doi-asserted-by":"crossref","unstructured":"Gary Klein David\u00a0D Woods Jeffrey\u00a0M Bradshaw Robert\u00a0R Hoffman and Paul\u00a0J Feltovich. 2004. Ten challenges for making automation a\" team player\" in joint human-agent activity. IEEE Intelligent Systems 19 6 (2004) 91\u201395.","DOI":"10.1109\/MIS.2004.74"},{"key":"e_1_3_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i2.19108"},{"key":"e_1_3_3_1_52_2","doi-asserted-by":"crossref","unstructured":"John\u00a0D Lee and Katrina\u00a0A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46 1 (2004) 50\u201380.","DOI":"10.1518\/hfes.46.1.50.30392"},{"key":"e_1_3_3_1_53_2","doi-asserted-by":"crossref","unstructured":"Kristina Lerman Chris Jones Aram Galstyan and Maja\u00a0J Matari\u0107. 2006. Analysis of dynamic task allocation in multi-robot systems. The International Journal of Robotics Research 25 3 (2006) 225\u2013241.","DOI":"10.1177\/0278364906063426"},{"key":"e_1_3_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3534628"},{"key":"e_1_3_3_1_55_2","doi-asserted-by":"crossref","unstructured":"Zachary\u00a0C Lipton. 2018. The Mythos of Model Interpretability: In machine learning the concept of interpretability is both important and slippery. Queue 16 3 (2018) 31\u201357.","DOI":"10.1145\/3236386.3241340"},{"key":"e_1_3_3_1_56_2","first-page":"799","volume-title":"AAMAS","author":"Liscio Enrico","year":"2021","unstructured":"Enrico Liscio, Michiel van\u00a0der Meer, Luciano\u00a0Cavalcante Siebert, Catholijn\u00a0M Jonker, Niek Mouter, and Pradeep\u00a0K Murukannaiah. 2021. Axies: Identifying and Evaluating Context-Specific Values.. In AAMAS. 799\u2013808."},{"key":"e_1_3_3_1_57_2","doi-asserted-by":"crossref","unstructured":"Bertram\u00a0F Malle. 2004. How the mind explains behavior. Folk Explanation Meaning and Social Interaction. Massachusetts: MIT-Press (2004).","DOI":"10.7551\/mitpress\/3586.001.0001"},{"key":"e_1_3_3_1_58_2","unstructured":"Bertram\u00a0F Malle. 2011. Attribution theories: How people make sense of behavior. Theories in social psychology 23 (2011) 72\u201395."},{"key":"e_1_3_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-819472-0.00001-0"},{"key":"e_1_3_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.2003.1243856"},{"key":"e_1_3_3_1_61_2","doi-asserted-by":"crossref","unstructured":"Giulio Mecacci and Filippo Santoni\u00a0de Sio. 2020. Meaningful human control as reason-responsiveness: the case of dual-mode vehicles. Ethics and Information Technology 22 2 (2020) 103\u2013115.","DOI":"10.1007\/s10676-019-09519-w"},{"key":"e_1_3_3_1_62_2","doi-asserted-by":"crossref","unstructured":"Ree\u00a0M Meertens and Rene Lion. 2008. Measuring an individual\u2019s tendency to take risks: the risk propensity scale 1. Journal of applied social psychology 38 6 (2008) 1506\u20131520.","DOI":"10.1111\/j.1559-1816.2008.00357.x"},{"key":"e_1_3_3_1_63_2","doi-asserted-by":"crossref","unstructured":"Siddharth Mehrotra Chadha Degachi Oleksandra Vereschak Catholijn\u00a0M Jonker and Myrthe\u00a0L Tielman. 2024. A Systematic Review on Fostering Appropriate Trust in Human-AI Interaction: Trends Opportunities and Challenges. ACM Journal on Responsible Computing (2024).","DOI":"10.1145\/3696449"},{"key":"e_1_3_3_1_64_2","doi-asserted-by":"crossref","unstructured":"Stephanie\u00a0M Merritt Heather Heimbaugh Jennifer LaChapell and Deborah Lee. 2013. I trust it but I don\u2019t know why: Effects of implicit attitudes toward automation on trust in an automated system. Human factors 55 3 (2013) 520\u2013534.","DOI":"10.1177\/0018720812465081"},{"key":"e_1_3_3_1_65_2","doi-asserted-by":"crossref","unstructured":"Leila Methnani Andrea Aler\u00a0Tubella Virginia Dignum and Andreas Theodorou. 2021. Let me take over: Variable autonomy for meaningful human control. Frontiers in Artificial Intelligence 4 (2021) 737072.","DOI":"10.3389\/frai.2021.737072"},{"key":"e_1_3_3_1_66_2","doi-asserted-by":"publisher","unstructured":"Tim Miller. 2019. Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence 267 (2019) 1\u201338. 10.1016\/j.artint.2018.07.007","DOI":"10.1016\/j.artint.2018.07.007"},{"key":"e_1_3_3_1_67_2","doi-asserted-by":"crossref","unstructured":"James\u00a0H Moor. 2006. The nature importance and difficulty of machine ethics. IEEE intelligent systems 21 4 (2006) 18\u201321.","DOI":"10.1109\/MIS.2006.80"},{"key":"e_1_3_3_1_68_2","doi-asserted-by":"crossref","unstructured":"Yazan Mualla Igor Tchappi Timotheus Kampik Amro Najjar Davide Calvaresi Abdeljalil Abbas-Turki St\u00e9phane Galland and Christophe Nicolle. 2022. The quest of parsimonious XAI: A human-agent architecture for explanation formulation. Artificial Intelligence 302 (2022) 103573.","DOI":"10.1016\/j.artint.2021.103573"},{"key":"e_1_3_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91122-9_18"},{"key":"e_1_3_3_1_70_2","unstructured":"Merel Noorman. 2012. Computing and moral responsibility. (2012)."},{"key":"e_1_3_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11512"},{"key":"e_1_3_3_1_72_2","doi-asserted-by":"crossref","unstructured":"Sven Nyholm. 2018. Attributing agency to automated systems: Reflections on human\u2013robot collaborations and responsibility-loci. Science and engineering ethics 24 4 (2018) 1201\u20131219.","DOI":"10.1007\/s11948-017-9943-x"},{"key":"e_1_3_3_1_73_2","doi-asserted-by":"crossref","unstructured":"Thomas O\u2019Neill Nathan McNeese Amy Barron and Beau Schelble. 2022. Human\u2013autonomy teaming: A review and analysis of the empirical literature. Human factors 64 5 (2022) 904\u2013938.","DOI":"10.1177\/0018720820960865"},{"key":"e_1_3_3_1_74_2","doi-asserted-by":"crossref","unstructured":"Raja Parasuraman and Victor Riley. 1997. Humans and automation: Use misuse disuse abuse. Human factors 39 2 (1997) 230\u2013253.","DOI":"10.1518\/001872097778543886"},{"key":"e_1_3_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781410601162-6"},{"key":"e_1_3_3_1_76_2","doi-asserted-by":"crossref","unstructured":"Scott\u00a0J Reynolds and Jared\u00a0A Miller. 2015. The recognition of moral issues: Moral awareness moral sensitivity and moral attentiveness. Current Opinion in Psychology 6 (2015) 114\u2013117.","DOI":"10.1016\/j.copsyc.2015.07.007"},{"key":"e_1_3_3_1_77_2","unstructured":"Fernando Rudy-Hiller. 2018. The epistemic condition for moral responsibility. (2018)."},{"key":"e_1_3_3_1_78_2","doi-asserted-by":"crossref","unstructured":"Fatai Sado Chu\u00a0Kiong Loo Wei\u00a0Shiung Liew Matthias Kerzel and Stefan Wermter. 2023. Explainable goal-driven agents and robots-a comprehensive review. Comput. Surveys 55 10 (2023) 1\u201341.","DOI":"10.1145\/3564240"},{"key":"e_1_3_3_1_79_2","doi-asserted-by":"crossref","unstructured":"Eduardo Salas Dana\u00a0E Sims and C\u00a0Shawn Burke. 2005. Is there a \u201cbig five\u201d in teamwork? Small group research 36 5 (2005) 555\u2013599.","DOI":"10.1177\/1046496405277134"},{"key":"e_1_3_3_1_80_2","unstructured":"Lindsay Sanneman and Julie\u00a0A Shah. 2022. The Situation Awareness Framework for Explainable AI (SAFE-AI) and Human Factors Considerations for XAI Systems. International Journal of Human\u2013Computer Interaction (2022) 1\u201317."},{"key":"e_1_3_3_1_81_2","doi-asserted-by":"crossref","unstructured":"Filippo Santoni\u00a0de Sio and Giulio Mecacci. 2021. Four responsibility gaps with artificial intelligence: Why they matter and how to address them. Philosophy & Technology 34 4 (2021) 1057\u20131084.","DOI":"10.1007\/s13347-021-00450-x"},{"key":"e_1_3_3_1_82_2","doi-asserted-by":"crossref","unstructured":"Filippo Santoni\u00a0de Sio and Jeroen Van\u00a0den Hoven. 2018. Meaningful human control over autonomous systems: A philosophical account. Frontiers in Robotics and AI 5 (2018) 15.","DOI":"10.3389\/frobt.2018.00015"},{"key":"e_1_3_3_1_83_2","doi-asserted-by":"crossref","unstructured":"Marc Steen Jurriaan van Diggelen Tjerk Timan and Nanda van\u00a0der Stap. 2023. Meaningful human control of drones: exploring human\u2013machine teaming informed by four different ethical perspectives. AI and Ethics 3 1 (2023) 281\u2013293.","DOI":"10.1007\/s43681-022-00168-2"},{"key":"e_1_3_3_1_84_2","doi-asserted-by":"crossref","unstructured":"Ashley Suh Isabelle Hurley Nora Smith and Ho\u00a0Chit Siu. 2025. Fewer Than 1% of Explainable AI Papers Validate Explainability with Humans. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2503.16507 (2025).","DOI":"10.1145\/3706599.3719964"},{"key":"e_1_3_3_1_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450662"},{"key":"e_1_3_3_1_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517732"},{"key":"e_1_3_3_1_87_2","doi-asserted-by":"crossref","first-page":"50","DOI":"10.4324\/9781315734217","volume-title":"Moral responsibility and the problem of many hands","author":"Poel Ibo Van\u00a0de","year":"2015","unstructured":"Ibo Van\u00a0de Poel. 2015. The problem of many hands. In Moral responsibility and the problem of many hands. Routledge, 50\u201392."},{"key":"e_1_3_3_1_88_2","doi-asserted-by":"crossref","unstructured":"Jasper van\u00a0der Waa Elisabeth Nieuwburg Anita Cremers and Mark Neerincx. 2021. Evaluating XAI: A comparison of rule-based and example-based explanations. Artificial Intelligence 291 (2021) 103404.","DOI":"10.1016\/j.artint.2020.103404"},{"key":"e_1_3_3_1_89_2","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/978-3-030-49183-3_16","volume-title":"Engineering Psychology and Cognitive Ergonomics. Cognition and Design: 17th International Conference, EPCE 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19\u201324, 2020, Proceedings, Part II 22","author":"Waa Jasper van\u00a0der","year":"2020","unstructured":"Jasper van\u00a0der Waa, Jurriaan van Diggelen, Luciano Cavalcante\u00a0Siebert, Mark Neerincx, and Catholijn Jonker. 2020. Allocation of moral decision-making in human-agent teams: a pattern approach. In Engineering Psychology and Cognitive Ergonomics. Cognition and Design: 17th International Conference, EPCE 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19\u201324, 2020, Proceedings, Part II 22. Springer, 203\u2013220."},{"key":"e_1_3_3_1_90_2","doi-asserted-by":"crossref","unstructured":"Jasper van\u00a0der Waa Sabine Verdult Karel van\u00a0den Bosch Jurriaan van Diggelen Tjalling Haije Birgit van\u00a0der Stigchel and Ioana Cocu. 2021. Moral decision making in human-agent teams: Human control and the role of explanations. Frontiers in Robotics and AI 8 (2021) 640647.","DOI":"10.3389\/frobt.2021.640647"},{"key":"e_1_3_3_1_91_2","doi-asserted-by":"crossref","unstructured":"Jasper van\u00a0der Waa Sabine Verdult Karel van\u00a0den Bosch Jurriaan van Diggelen Tjalling Haije Birgit van\u00a0der Stigchel and Ioana Cocu. 2021. Moral decision making in human-agent teams: Human control and the role of explanations. Frontiers in Robotics and AI 8 (2021) 640647.","DOI":"10.3389\/frobt.2021.640647"},{"key":"e_1_3_3_1_92_2","unstructured":"Jurriaan van Diggelen JS Barnhoorn Marieke\u00a0MM Peeters Wessel van Staal ML Stolk Bob van\u00a0der Vecht Jasper van\u00a0der Waa and Jan\u00a0Maarten Schraagen. 2019. Pluggable social artificial intelligence for enabling human-agent teaming. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/1909.04492 (2019)."},{"key":"e_1_3_3_1_93_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-68017-6_2"},{"key":"e_1_3_3_1_94_2","doi-asserted-by":"publisher","DOI":"10.1145\/3349537.3351892"},{"key":"e_1_3_3_1_95_2","doi-asserted-by":"publisher","DOI":"10.4337\/9781802204131.00021"},{"key":"e_1_3_3_1_96_2","doi-asserted-by":"crossref","unstructured":"Aimee Van\u00a0Wynsberghe and Scott Robbins. 2019. Critiquing the reasons for making artificial moral agents. Science and engineering ethics 25 (2019) 719\u2013735.","DOI":"10.1007\/s11948-018-0030-8"},{"key":"e_1_3_3_1_97_2","doi-asserted-by":"crossref","unstructured":"Herman Veluwenkamp. 2022. Reasons for meaningful human control. Ethics and Information Technology 24 4 (2022) 51.","DOI":"10.1007\/s10676-022-09673-8"},{"key":"e_1_3_3_1_98_2","doi-asserted-by":"publisher","unstructured":"Ruben Verhagen. 2024. Explainable AI for Meaningful Human Control. 10.17605\/OSF.IO\/DMHQ9","DOI":"10.17605\/OSF.IO\/DMHQ9"},{"key":"e_1_3_3_1_99_2","volume-title":"Explainable AI for Meaningful Human Control","author":"Verhagen Ruben","year":"2024","unstructured":"Ruben Verhagen. 2024. Explainable AI for Meaningful Human Control. https:\/\/github.com\/rsverhagen94\/XAI4MHC"},{"key":"e_1_3_3_1_100_2","doi-asserted-by":"publisher","DOI":"10.3233\/FAIA240203"},{"key":"e_1_3_3_1_101_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-82017-6_8"},{"key":"e_1_3_3_1_102_2","doi-asserted-by":"crossref","unstructured":"Ruben\u00a0S Verhagen Mark\u00a0A Neerincx and Myrthe\u00a0L Tielman. 2022. The influence of interdependence and a transparent or explainable communication style on human-robot teamwork. Frontiers in Robotics and AI 9 (2022) 243.","DOI":"10.3389\/frobt.2022.993997"},{"key":"e_1_3_3_1_103_2","doi-asserted-by":"crossref","unstructured":"Ruben\u00a0S Verhagen Mark\u00a0A Neerincx and Myrthe\u00a0L Tielman. 2024. Meaningful human control and variable autonomy in human-robot teams for firefighting. Frontiers in Robotics and AI 11 (2024) 1323980.","DOI":"10.3389\/frobt.2024.1323980"},{"key":"e_1_3_3_1_104_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781003074991-23"},{"key":"e_1_3_3_1_105_2","doi-asserted-by":"crossref","unstructured":"Adam Waytz Joy Heafner and Nicholas Epley. 2014. The mind in the machine: Anthropomorphism increases trust in an autonomous vehicle. Journal of experimental social psychology 52 (2014) 113\u2013117.","DOI":"10.1016\/j.jesp.2014.01.005"},{"key":"e_1_3_3_1_106_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2013.6630718"}],"event":{"name":"FAccT '25: The 2025 ACM Conference on Fairness, Accountability, and Transparency","location":"Athens Greece","acronym":"FAccT '25"},"container-title":["Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715275.3732157","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T11:13:48Z","timestamp":1750763628000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715275.3732157"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":105,"alternative-id":["10.1145\/3715275.3732157","10.1145\/3715275"],"URL":"https:\/\/doi.org\/10.1145\/3715275.3732157","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-06-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}