{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T20:02:57Z","timestamp":1773777777405,"version":"3.50.1"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2019,11,19]],"date-time":"2019-11-19T00:00:00Z","timestamp":1574121600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,19]],"date-time":"2019-11-19T00:00:00Z","timestamp":1574121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["MVI.16.044"],"award-info":[{"award-number":["MVI.16.044"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ethics Inf Technol"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, in line with the general framework of value-sensitive design, we aim to operationalize the general concept of \u201cMeaningful Human Control\u201d (MHC) in order to pave the way for its translation into more specific design\u00a0requirements. In particular, we focus on the operationalization of the first of the two conditions (Santoni de Sio and Van den Hoven 2018) investigated: the so-called \u2018tracking\u2019 condition. Our investigation is led in relation to one specific subcase of automated system: dual-mode driving systems (e.g. Tesla \u2018autopilot\u2019). First, we connect and compare meaningful human control with a concept of control very popular in engineering and traffic psychology (Michon 1985), and we explain to what extent tracking resembles and differs from it. This will help clarifying the extent to which the idea of meaningful human control is connected to, but also goes beyond, current notions of control in engineering and psychology. Second, we take the systematic analysis of practical reasoning as\u00a0traditionally presented in the philosophy of human action (Anscombe, Bratman, Mele)\u00a0and we adapt it to offer a general framework where different types of reasons and\u00a0agents are identified according to their relation to an automated system\u2019s behaviour.\u00a0This framework is meant to help explaining what reasons and what agents (should) play a role in controlling a given system, thereby enabling policy makers to produce\u00a0usable guidelines and engineers to design systems that properly respond to selected\u00a0human reasons. In the final part, we discuss a practical example of how our framework\u00a0could be employed in designing automated driving systems.<\/jats:p>","DOI":"10.1007\/s10676-019-09519-w","type":"journal-article","created":{"date-parts":[[2019,11,19]],"date-time":"2019-11-19T16:03:42Z","timestamp":1574179422000},"page":"103-115","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":70,"title":["Meaningful human control as reason-responsiveness: the case of dual-mode vehicles"],"prefix":"10.1007","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9092-8923","authenticated-orcid":false,"given":"Giulio","family":"Mecacci","sequence":"first","affiliation":[]},{"given":"Filippo","family":"Santoni de Sio","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,11,19]]},"reference":[{"key":"9519_CR1","volume-title":"Intention","author":"GEM Anscombe","year":"1957","unstructured":"Anscombe, G. E. M. (1957). Intention. Oxford: Basil Blackwell."},{"key":"9519_CR2","unstructured":"Article 36. (2014). Autonomous weapons, meaningful human control and the CCW."},{"key":"9519_CR3","unstructured":"Bellon, T. (2018). Fatal U.S. self-driving auto accident raises novel legal questions [WWW Document]. Reuters. Retrieved September 18, 2018 from https:\/\/www.reuters.com\/article\/us-autos-selfdriving-uber-liability-anal\/fatal-u-s-self-driving-auto-accident-raises-novel-legal-questions-idUSKBN1GW2SP."},{"key":"9519_CR4","doi-asserted-by":"publisher","first-page":"375","DOI":"10.2307\/2184542","volume":"93","author":"M Bratman","year":"1984","unstructured":"Bratman, M. (1984a). Two faces of intention. Philosophical Review,93, 375\u2013405.","journal-title":"Philosophical Review"},{"key":"9519_CR5","doi-asserted-by":"publisher","first-page":"375","DOI":"10.2307\/2184542","volume":"93","author":"ME Bratman","year":"1984","unstructured":"Bratman, M. E. (1984b). Two faces of intention. Philosophical Review,93, 375\u2013405.","journal-title":"Philosophical Review"},{"key":"9519_CR6","volume-title":"Intentions, plans and practical reason","author":"ME Bratman","year":"1987","unstructured":"Bratman, M. E. (1987). Intentions, plans and practical reason. Cambridge, MA: Harvard University Press."},{"key":"9519_CR7","doi-asserted-by":"crossref","unstructured":"Calvert, S., Mecacci, G., Van Arem, B., Santoni de Sio, F., Heikoop, D., Hagenzieker, M. (2019). Gaps in the control of automated vehicles on roads. IEEE intelligent transportation systems magazine","DOI":"10.1109\/MITS.2019.2926278"},{"key":"9519_CR8","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1093\/0199246270.003.0001","volume-title":"Essays on actions and events","author":"D Davidson","year":"2001","unstructured":"Davidson, D. (2001). Actions, reasons, and causes. In D. Davidson (Ed.), Essays on actions and events (pp. 3\u201320). Oxford: Oxford University Press. https:\/\/doi.org\/10.1093\/0199246270.003.0001."},{"key":"9519_CR9","unstructured":"Heyns, C. (2013). Report of the special rapporteur on extra-judicial, summary or arbitrary executions."},{"key":"9519_CR10","volume-title":"Mind the gap: The lack of accountability for killer robots","author":"Human Right Watch","year":"2015","unstructured":"Human Right Watch. (2015). Mind the gap: The lack of accountability for killer robots. New York: Human Right Watch."},{"key":"9519_CR11","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1007\/s10676-004-3422-1","volume":"6","author":"A Matthias","year":"2004","unstructured":"Matthias, A. (2004). The responsibility gap: Ascribing responsibility for the actions of learning automata. Ethics and Information Technology,6, 175\u2013183. https:\/\/doi.org\/10.1007\/s10676-004-3422-1.","journal-title":"Ethics and Information Technology"},{"key":"9519_CR12","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195071146.001.0001","volume-title":"Springs of action: Understanding intentional behavior","author":"AR Mele","year":"1992","unstructured":"Mele, A. R. (1992). Springs of action: Understanding intentional behavior. New York: Oxford University Press Inc."},{"key":"9519_CR13","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4613-2173-6","volume-title":"Human behavior and traffic safety, human behavior and traffic safety","author":"JA Michon","year":"1985","unstructured":"Michon, J. A. (1985). Human behavior and traffic safety, human behavior and traffic safety. Boston, MA: Springer US. https:\/\/doi.org\/10.1007\/978-1-4613-2173-6."},{"key":"9519_CR14","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1093\/mind\/LXXXIV.1.481","volume":"84","author":"J Raz","year":"1975","unstructured":"Raz, J. (1975). Reasons for action, decisions and norms. Mind,84, 481\u2013499.","journal-title":"Mind"},{"key":"9519_CR15","unstructured":"Santoni de Sio, F. (2016). Ethics and self-driving cars. A white paper on responsible innovation in automated driving systems. Dutch Minist. Infrastruct. Water Manag. Rijkswaterstaat."},{"key":"9519_CR16","doi-asserted-by":"publisher","first-page":"15","DOI":"10.3389\/frobt.2018.00015","volume":"5","author":"F Santoni de Sio","year":"2018","unstructured":"Santoni de Sio, F., & van den Hoven, J. (2018). Meaningful human control over autonomous systems: A philosophical account. Frontiers Robotics AI,5, 15. https:\/\/doi.org\/10.3389\/frobt.2018.00015.","journal-title":"Frontiers Robotics AI"},{"key":"9519_CR17","unstructured":"Schweikard, D.P., Schmid, H.B. (2013). Collective intentionality. Stanford Encyclopedia of Philosophy"},{"key":"9519_CR18","unstructured":"Shepardson, D. (2018). Tesla, NTSB clash over autopilot investigation | Reuters [WWW Document]. Retrieved September 18, 2018, from https:\/\/www.reuters.com\/article\/us-tesla-crash-autopilot\/tesla-ntsb-clash-over-autopilot-investigation-idUSKBN1HJ2JS."},{"key":"9519_CR19","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1111\/j.1468-5930.2007.00346.x","volume":"24","author":"R Sparrow","year":"2007","unstructured":"Sparrow, R. (2007). Killer robots. Journal of Applied Philosophy,24, 62\u201377. https:\/\/doi.org\/10.1111\/j.1468-5930.2007.00346.x.","journal-title":"Journal of Applied Philosophy"},{"key":"9519_CR20","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1016\/j.trc.2017.04.014","volume":"80","author":"R Sparrow","year":"2017","unstructured":"Sparrow, R., & Howard, M. (2017). When human beings are like drunk robots: Driverless vehicles, ethics, and the future of transport. Transportation Research Part C: Emerging Technologies,80, 206\u2013215. https:\/\/doi.org\/10.1016\/j.trc.2017.04.014.","journal-title":"Transportation Research Part C: Emerging Technologies"},{"key":"9519_CR21","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-007-7762-0","volume-title":"Philosophy and engineering: Reflections on practice, principles and process, philosophy of engineering and technology","author":"I Van De Poel","year":"2013","unstructured":"Van De Poel, I. (2013). Philosophy and engineering: Reflections on practice, principles and process, philosophy of engineering and technology. Dordrecht: Springer. https:\/\/doi.org\/10.1007\/978-94-007-7762-0."},{"key":"9519_CR22","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1002\/9781118551424.ch4","volume-title":"Responsible innovation","author":"J van den Hoven","year":"2013","unstructured":"van den Hoven, J. (2013). Value sensitive design and responsible innovation. In R. Owen, J. Bessant, & M. Heintz (Eds.), Responsible innovation (pp. 75\u201383). Chichester: Wiley. https:\/\/doi.org\/10.1002\/9781118551424.ch4."},{"key":"9519_CR23","unstructured":"Yadron, D., Tynan, D. (2016). Tesla driver dies in first fatal crash while using autopilot mode | Technology | The Guardian [WWW Document]. Retrieved September 28, 2018, from https:\/\/www.theguardian.com\/technology\/2016\/jun\/30\/tesla-autopilot-death-self-driving-car-elon-musk."}],"container-title":["Ethics and Information Technology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-019-09519-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10676-019-09519-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10676-019-09519-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,27]],"date-time":"2024-07-27T10:04:55Z","timestamp":1722074695000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10676-019-09519-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,19]]},"references-count":23,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["9519"],"URL":"https:\/\/doi.org\/10.1007\/s10676-019-09519-w","relation":{},"ISSN":["1388-1957","1572-8439"],"issn-type":[{"value":"1388-1957","type":"print"},{"value":"1572-8439","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,19]]},"assertion":[{"value":"19 November 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"All authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}