{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T14:39:22Z","timestamp":1775745562555,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T00:00:00Z","timestamp":1675987200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T00:00:00Z","timestamp":1675987200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["407740_187494"],"award-info":[{"award-number":["407740_187494"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]},{"name":"armasuisse","award":["armasuisse"],"award-info":[{"award-number":["armasuisse"]}]},{"DOI":"10.13039\/501100006447","name":"University of Zurich","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006447","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006447","name":"University of Zurich","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006447","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2023,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Decisions in security contexts, including armed conflict, law enforcement, and disaster relief, often need to be taken under circumstances of limited information, stress, and time pressure. Since AI systems are capable of providing a certain amount of relief in such contexts, such systems will become increasingly important, be it as decision-support or decision-making systems. However, given that human life may be at stake in such situations, moral responsibility for such decisions should remain with humans. Hence the idea of \u201cmeaningful human control\u201d of intelligent systems. In this opinion paper, we outline generic configurations of control of AI and we present an alternative to human control of AI, namely the inverse idea of having AI control humans, and we discuss the normative consequences of this alternative.<\/jats:p>","DOI":"10.1007\/s10676-023-09686-x","type":"journal-article","created":{"date-parts":[[2023,2,10]],"date-time":"2023-02-10T15:52:13Z","timestamp":1676044333000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Who is controlling whom? Reframing \u201cmeaningful human control\u201d of AI systems in security"],"prefix":"10.1007","volume":"25","author":[{"given":"Markus","family":"Christen","sequence":"first","affiliation":[]},{"given":"Thomas","family":"Burri","sequence":"additional","affiliation":[]},{"given":"Serhiy","family":"Kandul","sequence":"additional","affiliation":[]},{"given":"Pascal","family":"V\u00f6r\u00f6s","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,2,10]]},"reference":[{"key":"9686_CR1","doi-asserted-by":"crossref","unstructured":"Altmann, J. (2019). Autonomous Weapons Systems \u2013 Dangers and Need for an International Prohibition. In C. Benzm\u00fcller & H. Stuckenschmidt (eds), KI 2019, (LNAI 11793, 1\u201317)","DOI":"10.1007\/978-3-030-30179-8_1"},{"key":"9686_CR2","doi-asserted-by":"publisher","first-page":"123","DOI":"10.2307\/256633","volume":"39","author":"AC Amason","year":"2001","unstructured":"Amason, A. C. (2001). Distinguishing the effects of functional and dysfunctional conflict onstrategic decision-making: resolving a paradox for the top management team. Academy of Management Journal, 39, 123\u2013148.","journal-title":"Academy of Management Journal"},{"key":"9686_CR3","unstructured":"Asilomar, A. I., & Principles (2017). https:\/\/futureoflife.org\/aiprinciples\/."},{"key":"9686_CR4","first-page":"91","volume-title":"International Law and Artificial Intelligence","author":"T Burri","year":"2019","unstructured":"Burri, T. (2019). International Law and Artificial Intelligence (pp. 91\u2013108). Berlin: German Yearbook of International Law."},{"key":"9686_CR5","unstructured":"Campaign to Stop Killer Robots (2019).: https:\/\/www.stopkillerrobots.org"},{"key":"9686_CR6","doi-asserted-by":"crossref","unstructured":"Canellas, M. C., & Haga, R. A. (2015). Toward Meaningful Human Control of Autonomous Weapons Systems through Function Allocation. In: IEEE International Symposium on Technology in Society (ISTAS) Proceedings (p.\u00a07), https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=2927702.","DOI":"10.1109\/ISTAS.2015.7439432"},{"key":"9686_CR7","doi-asserted-by":"crossref","unstructured":"Christen, M., Burri, T., Chapa, J., Salvi, R., Santoni de Sio, F., & Sullins, J. (2017). : An Evaluation Schema for the Ethical Use of Autonomous Robotic Systems in Security Applications. UZH Digital Society Initiative White Paper Series No. 1, University of Zurich: https:\/\/ssrn.com\/abstract=3063617","DOI":"10.2139\/ssrn.3063617"},{"key":"9686_CR8","unstructured":"Council of Europe (2020). Recommendation to member States on the human rights impacts of algorithmic systems, Council of Europe Committee of Ministers, 2020, CM\/Rec(2020)1, 8 April 2020."},{"key":"9686_CR9","first-page":"53","volume":"30","author":"R Crootof","year":"2016","unstructured":"Crootof, R. (2016). A meaningful floor for \u201cMeaningful Human Control\u201d. Temple Int & Comp L J, 30, 53.","journal-title":"Temple Int & Comp L J"},{"issue":"7","key":"9686_CR10","first-page":"56","volume":"62","author":"HW de Czege","year":"1982","unstructured":"de Czege, H. W., & Holder, L. D. (1982). The New FM 100-5. Military Review, 62(7), 56.","journal-title":"Military Review"},{"key":"9686_CR11","unstructured":"EU (2019). The European Commission\u2019s Independent High-Level Expert Group on Artificial Intelligence, Ethics Guidelines for Trustworthy AI, 8 April 2019, https:\/\/ec.europa.eu\/newsroom\/dae\/document.cfm?doc_id=58477"},{"key":"9686_CR12","doi-asserted-by":"crossref","unstructured":"Fischer, J. M., & Mark Ravizza. (2000). & Responsibility and control:A theory of moral responsibility, CUP","DOI":"10.2307\/2653660"},{"key":"9686_CR13","unstructured":"Google (2018). Google, Artificial Intelligence at Google: Our Priniciples, Google: https:\/\/ai.google\/principles\/"},{"key":"9686_CR14","doi-asserted-by":"crossref","unstructured":"Green, B. (2022). The flaws of policies requiring Human Oversight of Government Algorithms (45 vol.). Computer Law & Security Review.","DOI":"10.1016\/j.clsr.2022.105681"},{"key":"9686_CR15","unstructured":"Human Rights Watch (2012). Human Rights Watch and Harvard International Human Rights Clinic, Losing Humanity: The Case against Killer Robots, New York, November 2012."},{"key":"9686_CR16","unstructured":"IBM (2018). IBM, Everyday Ethics for Artificial Intelligence, IBM, 2018, https:\/\/www.ibm.com\/watson\/assets\/duo\/pdf\/everydayethics.pdf"},{"key":"9686_CR17","unstructured":"ICJ Nicaragua v. US (1986). International Court of Justice, Military and Paramilitary Activities in and against Nicaragua (Nicaragua v. United States of America), Merits, 1986, ICJ Reports 1986, p.\u00a014."},{"key":"9686_CR18","unstructured":"ICRC (2018). International Committee of the Red Cross (ICRC): Ethics and autonomous weapons systems: an ethical basis for human control?, 18 https:\/\/www.icrc.org\/en\/download\/file\/69961\/icrc_ethics_and_autonomous_weapon_systems_report_3_april_2018.pdf"},{"key":"9686_CR19","unstructured":"ICTY Tadic (1999). International Tribunal for the Prosecution of Persons Responsible for Serious Violations of International Humanitarian Law Committed in the Territory of the Former Yugoslavia since 1991 (ICTY) (Appeals Chamber), Prosecutor v. Dusko Tadi\u0107, 1999, IT-94-I-A."},{"key":"9686_CR20","unstructured":"IEEE (2019). IEEE, Ethically Aligned Design, The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems, 2019, https:\/\/ethicsinaction.ieee.org."},{"key":"9686_CR21","unstructured":"Intel (2017). Intel, AI Public Policy Principles Intel, 2017, https:\/\/blogs.intel.com\/policy\/files\/2017\/10\/Intel-Artificial-Intelligence-Public-Policy-White-Paper-2017.pdf."},{"key":"9686_CR22","unstructured":"Kipp, J. (1992). Soviet Military Doctrine and the Origins of Operational Art, 1917\u20131936. In Soviet Doctrine from Lenin to Gorbachev, 1915\u20131991, ed. William C. Frank Jr. and Philip S. Gillette (Westport, CT: Greenwood, 1992), 88."},{"key":"9686_CR23","doi-asserted-by":"crossref","unstructured":"Marauhn, T. (2018). Meaningful Human Control \u2013 and the Politics of International Law. In Heintschel von Heinegg et al. (eds), The Dehumanization of Warfare \u2013 Legal Implications of New Weapon Technologies, Springer, 2018, 207\u2013218","DOI":"10.1007\/978-3-319-67266-3_11"},{"key":"9686_CR24","doi-asserted-by":"publisher","first-page":"1587","DOI":"10.2307\/3312464","volume":"142","author":"SJ Morse","year":"1994","unstructured":"Morse, S. J. (1994). Culpability and control. U Penn Law Rev, 142, 1587\u20131621.","journal-title":"U Penn Law Rev"},{"key":"9686_CR25","unstructured":"OECD (2019). OECD, Recommendation of the Council on Artificial Intelligence, 2019, OECD\/LEGAL\/0449, https:\/\/legalinstruments.oecd.org\/en\/instruments\/OECD-LEGAL-0449"},{"issue":"3","key":"9686_CR26","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1080\/15027570.2014.975010","volume":"13","author":"H Roff","year":"2014","unstructured":"Roff, H. (2014). The Strategic Robot Problem: Lethal Autonomous Weapons in War. Journal of Military Ethics, 13(3), 211\u2013227.","journal-title":"Journal of Military Ethics"},{"key":"9686_CR27","volume-title":"Artificial Intelligence \u2013 A Modern Approach","author":"SJ Russell","year":"2010","unstructured":"Russell, S. J., & Norvig, P. (2010). Artificial Intelligence \u2013 A Modern Approach. London: Pearson Education."},{"key":"9686_CR28","unstructured":"Sassoli, M. (2014). Autonomous Weapons and International Humanitarian Law: advantages, open technical questions and legal issues to be clarified (90 vol., p. 308). International Law Studies \/ Naval War College."},{"key":"9686_CR29","unstructured":"Scharre, P., & Horowitz, M. C. (2015). Meaningful Human Control in Weapon Systems: A Primer. CNAS Working Paper (March 2015) 16 \u2014 https:\/\/www.files.ethz.ch\/isn\/189786\/Ethical_Autonomy_Working_Paper_031315.pdf"},{"key":"9686_CR30","unstructured":"Singer, P. (2009). Military Robots and the Laws of War (11February vol.). Brookings. https:\/\/www.brookings.edu\/articles\/military-robots-and-the-laws-of-war\/."},{"key":"9686_CR31","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s10676-020-09528-0","volume":"22","author":"M Skerker","year":"2020","unstructured":"Skerker, M., Purves, D., & Jenkins, R. (2020). Autonomous Weapons Systems and the Moral Equality of Combatants. Ethics and Information Technology, 22, 197\u2013209.","journal-title":"Ethics and Information Technology"},{"issue":"1","key":"9686_CR32","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1111\/j.1468-5930.2007.00346.x","volume":"24","author":"R Sparrow","year":"2007","unstructured":"Sparrow, R. (2007). Killer Robots. Journal of Applied Philosophy, 24(1), 62\u201377.","journal-title":"Journal of Applied Philosophy"},{"key":"9686_CR33","doi-asserted-by":"publisher","unstructured":"Tolmeijer, S., Christen, M., Kandul, S., Kneer, M., & Bernstein, A. (2022). Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making. 2022 ACM Conference on Human Factors in Computing Systems (CHI\u201922), https:\/\/doi.org\/10.1145\/3491102.3517732","DOI":"10.1145\/3491102.3517732"},{"key":"9686_CR34","unstructured":"UN Secretary General (2019). UN Secretary General\u2019s High Level Panel on Digital Cooperation, The Age of Digital Interdependence, 2019, https:\/\/www.un.org\/en\/pdfs\/DigitalCooperation-report-forweb.pdf."},{"key":"9686_CR35","unstructured":"von Clausewitz, C. (2008). On War. Princeton University Press."},{"key":"9686_CR340","doi-asserted-by":"crossref","unstructured":"Wagner, M. (2011). Taking Humans Out of the Loop: Implications for International Humanitarian Law. Journal of Law Information and Science, 21, Available at SSRN: https:\/\/ssrn.com\/abstract=1874039","DOI":"10.5778\/JLIS.2011.21.Wagner.1"},{"key":"9686_CR36","unstructured":"Winfield, A. (2019). An Updated Roundup of Ethical Principles of Robotics and AI: https:\/\/alanwinfield.blogspot.com\/2019\/04\/an-updated-round-up-of-ethical.html"}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09686-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10676-023-09686-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-023-09686-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,28]],"date-time":"2023-03-28T06:24:25Z","timestamp":1679984665000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10676-023-09686-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,10]]},"references-count":37,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["9686"],"URL":"https:\/\/doi.org\/10.1007\/s10676-023-09686-x","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,10]]},"assertion":[{"value":"10 February 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"10"}}