{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T11:23:58Z","timestamp":1781522638854,"version":"3.54.1"},"reference-count":101,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,5,18]],"date-time":"2022-05-18T00:00:00Z","timestamp":1652832000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,18]],"date-time":"2022-05-18T00:00:00Z","timestamp":1652832000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI Ethics"],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>How can humans remain in control of artificial intelligence (AI)-based systems designed to perform tasks autonomously? Such systems are increasingly ubiquitous, creating benefits - but also undesirable situations where moral responsibility for their actions cannot be properly attributed to any particular person or group. The concept of meaningful human control has been proposed to address responsibility gaps and mitigate them by establishing conditions that enable a proper attribution of responsibility for humans; however, clear requirements for researchers, designers, and engineers are yet inexistent, making the development of AI-based systems that remain under meaningful human control challenging. In this paper, we address the gap between philosophical theory and engineering practice by identifying, through an iterative process of abductive thinking, four actionable properties for AI-based systems under meaningful human control, which we discuss making use of two applications scenarios: automated vehicles and AI-based hiring. First, a system in which humans and AI algorithms interact should have an explicitly defined domain of morally loaded situations within which the system ought to operate. Second, humans and AI agents within the system should have appropriate and mutually compatible representations. Third, responsibility attributed to a human should be commensurate with that human\u2019s ability and authority to control the system. Fourth, there should be explicit links between the actions of the AI agents and actions of humans who are aware of their moral responsibility. We argue that these four properties will support practically minded professionals to take concrete steps toward designing and engineering for AI systems that facilitate meaningful human control.<\/jats:p>","DOI":"10.1007\/s43681-022-00167-3","type":"journal-article","created":{"date-parts":[[2022,5,18]],"date-time":"2022-05-18T13:02:26Z","timestamp":1652878946000},"page":"241-255","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":97,"title":["Meaningful human control: actionable properties for AI system development"],"prefix":"10.1007","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7531-3154","authenticated-orcid":false,"given":"Luciano","family":"Cavalcante Siebert","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria Luce","family":"Lupetti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Evgeni","family":"Aizenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niek","family":"Beckers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arkady","family":"Zgonnikov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Herman","family":"Veluwenkamp","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Abbink","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisa","family":"Giaccardi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geert-Jan","family":"Houben","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catholijn M.","family":"Jonker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeroen","family":"van den Hoven","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deborah","family":"Forster","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Reginald L.","family":"Lagendijk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,5,18]]},"reference":[{"issue":"3","key":"167_CR1","doi-asserted-by":"publisher","first-page":"1771","DOI":"10.1007\/s11948-020-00213-5","volume":"26","author":"L Floridi","year":"2020","unstructured":"Floridi, L., Cowls, J., King, T.C., Taddeo, M.: How to design AI for social good: seven essential factors. Sci. Eng. Ethics 26(3), 1771\u20131796 (2020). https:\/\/doi.org\/10.1007\/s11948-020-00213-5","journal-title":"Sci. Eng. Ethics"},{"key":"167_CR2","unstructured":"Stinson, C.: Algorithms are not neutral. AI and Ethics, 1\u20138 (2022)"},{"key":"167_CR3","series-title":"The MIT press essential knowledge series","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/12549.001.0001","volume-title":"AI Ethics","author":"M Coeckelbergh","year":"2020","unstructured":"Coeckelbergh, M.: AI Ethics. The MIT press essential knowledge series, The MIT Press, Cambridge, MA (2020)"},{"key":"167_CR4","doi-asserted-by":"crossref","unstructured":"Cruz, J.: Shared Moral Foundations of Embodied Artificial Intelligence. In: Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society, pp. 139\u2013146 (2019)","DOI":"10.1145\/3306618.3314280"},{"issue":"9","key":"167_CR5","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","volume":"1","author":"A Jobin","year":"2019","unstructured":"Jobin, A., Ienca, M., Vayena, E.: The global landscape of AI ethics guidelines. Nat. Mach. Intell. 1(9), 389\u2013399 (2019). https:\/\/doi.org\/10.1038\/s42256-019-0088-2","journal-title":"Nat. Mach. Intell."},{"key":"167_CR6","doi-asserted-by":"crossref","unstructured":"Umbrello, S., De\u00a0Bellis, A.F.: A value-sensitive design approach to intelligent agents. In: Roman Y (ed.), Artificial Intelligence Safety and Security (2018) CRC Press (2018)","DOI":"10.1201\/9781351251389-26"},{"issue":"3","key":"167_CR7","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1007\/s10676-004-3422-1","volume":"6","author":"A Matthias","year":"2004","unstructured":"Matthias, A.: The responsibility gap: ascribing responsibility for the actions of learning automata. Ethics Inf. Technol. 6(3), 175\u2013183 (2004). https:\/\/doi.org\/10.1007\/s10676-004-3422-1","journal-title":"Ethics Inf. Technol."},{"issue":"8","key":"167_CR8","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MC.2020.2996587","volume":"53","author":"Z Akata","year":"2020","unstructured":"Akata, Z., Balliet, D., de Rijke, M., Dignum, F., Dignum, V., Eiben, G., Fokkens, A., Grossi, D., Hindriks, K., Hoos, H., Hung, H., Jonker, C., Monz, C., Neerincx, M., Oliehoek, F., Prakken, H., Schlobach, S., Van der Gaag, L., van Harmelen, F., Van Hoof, H., Van Riemsdijk, B., van Wynsberghe, A., Verbrugge, R., Verheij, B., Vossen, P., Welling, M.: A research agenda for hybrid intelligence: augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence. Computer 53(8), 18\u201328 (2020). https:\/\/doi.org\/10.1109\/MC.2020.2996587","journal-title":"Computer"},{"key":"167_CR9","doi-asserted-by":"publisher","unstructured":"Dignum, V., Baldoni, M., Baroglio, C., Caon, M., Chatila, R., Dennis, L., G\u00e9nova, G., Haim, G., Klie\u00df, M.S., Lopez-Sanchez, M., Micalizio, R., Pav\u00f3n, J., Slavkovik, M., Smakman, M., Van Steenbergen, M., Tedeschi, S., Van der Toree, L., Villata, S., de Wildt, T.: Ethics by Design: Necessity or Curse? In: Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society, pp. 60\u201366. ACM, New Orleans LA USA (2018). https:\/\/doi.org\/10.1145\/3278721.3278745","DOI":"10.1145\/3278721.3278745"},{"issue":"3","key":"167_CR10","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/MIS.2013.70","volume":"28","author":"JM Bradshaw","year":"2013","unstructured":"Bradshaw, J.M., Hoffman, R.R., Woods, D.D., Johnson, M.: The seven deadly myths of \u201cautonomous systems\u2019\u2019. IEEE Intell. Syst. 28(3), 54\u201361 (2013)","journal-title":"IEEE Intell. Syst."},{"key":"167_CR11","doi-asserted-by":"crossref","unstructured":"Santoni de Sio, F., Van den Hoven, J.: Meaningful human control over autonomous systems: a philosophical account. Front. Robot. AI 5, 15 (2018)","DOI":"10.3389\/frobt.2018.00015"},{"issue":"2","key":"167_CR12","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/s10676-019-09519-w","volume":"22","author":"G Mecacci","year":"2020","unstructured":"Mecacci, G., Santoni de Sio, F.: Meaningful human control as reason-responsiveness: the case of dual-mode vehicles. Ethics Inf. Technol. 22(2), 103\u2013115 (2020). https:\/\/doi.org\/10.1007\/s10676-019-09519-w","journal-title":"Ethics Inf. Technol."},{"issue":"1","key":"167_CR13","doi-asserted-by":"publisher","first-page":"2627","DOI":"10.1038\/srep02627","volume":"3","author":"N Johnson","year":"2013","unstructured":"Johnson, N., Zhao, G., Hunsader, E., Qi, H., Johnson, N., Meng, J., Tivnan, B.: Abrupt rise of new machine ecology beyond human response time. Sci. Rep. 3(1), 2627 (2013). https:\/\/doi.org\/10.1038\/srep02627","journal-title":"Sci. Rep."},{"key":"167_CR14","doi-asserted-by":"crossref","unstructured":"Rahwan, I., Cebrian, M., Obradovich, N., Bongard, J., Bonnefon, J.-F., Breazeal, C., Crandall, J.W., Christakis, N.A., Couzin, I.D., Jackson, M.O., Jennings, N.R., Kamar, E., Kloumann, I.M., Larochelle, H., Lazer, D., McElreath, R., Mislove, A., Parkes, D.C., Pentland, A.S., Roberts, M.E., Shariff, A., Tenenbaum, J.B., Wellman, M.: Machine behaviour. Nature 568(7753), 477\u2013486 (2019)","DOI":"10.1038\/s41586-019-1138-y"},{"key":"167_CR15","unstructured":"European Parliamentary Research Service (EPRS): The ethics of artificial intelligence: Issues and initiatives. Panel for the Future of Science and Technology PE 634.452 (2020)"},{"key":"167_CR16","doi-asserted-by":"crossref","unstructured":"Giaccardi, E., Redstr\u00f6m, J.: Technology and more-than-human design. Design Issue 36(4) (2020)","DOI":"10.1162\/desi_a_00612"},{"issue":"2","key":"167_CR17","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1145\/3055589.3055594","volume":"15","author":"L Chen","year":"2017","unstructured":"Chen, L., Wilson, C.: Observing algorithmic marketplaces in-the-wild. ACM SIGecom Exchang 15(2), 34\u201339 (2017). https:\/\/doi.org\/10.1145\/3055589.3055594","journal-title":"ACM SIGecom Exchang"},{"key":"167_CR18","volume-title":"Move Fast and Break Things: How Facebook, Google, and Amazon Have Cornered Culture and What It Means For all of us","author":"J Taplin","year":"2017","unstructured":"Taplin, J.: Move Fast and Break Things: How Facebook, Google, and Amazon Have Cornered Culture and What It Means For all of us. Pan Macmillan, New York (2017)"},{"issue":"3","key":"167_CR19","first-page":"4","volume":"21","author":"P Johnston","year":"2019","unstructured":"Johnston, P., Harris, R.: The Boeing 737 MAX saga: lessons for software organizations. Softw. Qua. Profession. 21(3), 4\u201312 (2019)","journal-title":"Softw. Qua. Profession."},{"key":"167_CR20","doi-asserted-by":"crossref","unstructured":"Serter, B., Beul, C., Lang, M., Schmidt, W.: Foreseeable Misuse in Automated Driving Vehicles-The Human Factor in Fatal Accidents of Complex Automation. Technical Report 0148-7191, SAE Technical Paper (2017)","DOI":"10.4271\/2017-01-0059"},{"key":"167_CR21","doi-asserted-by":"crossref","unstructured":"Korinek, A., Stiglitz, J.E.: Artificial intelligence and its implications for income distribution and unemployment. Technical Report 0898-2937, National Bureau of Economic Research (2017)","DOI":"10.3386\/w24174"},{"key":"167_CR22","unstructured":"Angwin, J.: Jeff Larson, Surya Mattu, Lauren Kirchner: Machine Bias There\u2019s software used across the country to predict future criminals. ProPublica, And it\u2019s biased against blacks (2016)"},{"issue":"3","key":"167_CR23","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1145\/2460276.2460278","volume":"11","author":"L Sweeney","year":"2013","unstructured":"Sweeney, L.: Discrimination in online ad delivery. Queue 11(3), 10\u201329 (2013). https:\/\/doi.org\/10.1145\/2460276.2460278","journal-title":"Queue"},{"key":"167_CR24","unstructured":"Article 36: Key areas for debate on autonomous weapons systems: Memorandum for delegates at the Convention on Certain Conventional Weapons (CCW) Meeting of Experts on Lethal Autonomous Weapons Systems (LAWS) (2014)"},{"key":"167_CR25","unstructured":"Article 36: Killing by Machine: Key Issues for Understanding Meaningful Human Control (2015)"},{"key":"167_CR26","unstructured":"Horowitz, M.C., Scharre, P.: Meaningful Human Control in Weapon Systems: A Primer. working paper, 15 (2015)"},{"issue":"2","key":"167_CR27","first-page":"105","volume":"2","author":"KJ Behymer","year":"2016","unstructured":"Behymer, K.J., Flach, J.M.: From autonomous systems to sociotechnical systems: designing effective collaborations. She Ji: J. Des. Econ. Innovat. 2(2), 105\u2013114 (2016)","journal-title":"She Ji: J. Des. Econ. Innovat."},{"key":"167_CR28","doi-asserted-by":"crossref","unstructured":"Santoni de Sio, F., Mecacci, G.: Four responsibility gaps with artificial intelligence: Why they matter and how to address them. Philos. Technol. pp. 1\u201328 (2021)","DOI":"10.1007\/s13347-021-00450-x"},{"issue":"4","key":"167_CR29","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1109\/MTS.2019.2948438","volume":"38","author":"M Cummings","year":"2019","unstructured":"Cummings, M.: Lethal autonomous weapons: meaningful human control or meaningful human certification? IEEE Technol. Soc. Magn. 38(4), 20\u201326 (2019). https:\/\/doi.org\/10.1109\/MTS.2019.2948438","journal-title":"IEEE Technol. Soc. Magn."},{"issue":"3","key":"167_CR30","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1111\/1758-5899.12665","volume":"10","author":"M Ekelhof","year":"2019","unstructured":"Ekelhof, M.: Moving beyond semantics on autonomous weapons: meaningful human control in operation. Global Pol. 10(3), 343\u2013348 (2019). https:\/\/doi.org\/10.1111\/1758-5899.12665","journal-title":"Global Pol."},{"key":"167_CR31","doi-asserted-by":"crossref","unstructured":"Beckers, G., Sijs, J., Van Diggelen, J., van Dijk, R.J.E., Bouma, H., Lomme, M., Hommes, R., Hillerstrom, F., Van der Waa, J., Van Velsen, A., Mannucci, T., Voogd, J., Van Staal, W., Veltman, K., Wessels, P., Huizing, A.: Intelligent autonomous vehicles with an extendable knowledge base and meaningful human control. In: Bouma, H., Stokes, R.J., Yitzhaky, Y., Prabhu, R. (eds.) Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III, p. 11. SPIE, Strasbourg, France (2019). doi: 10.1117\/12.2533740","DOI":"10.1117\/12.2533740"},{"key":"167_CR32","doi-asserted-by":"publisher","unstructured":"Calvert, S.C., Heikoop, D.D., Mecacci, G., Van Arem, B.: A human centric framework for the analysis of automated driving systems based on meaningful human control. Theor. Issues Ergonom. Sci. 1\u201329 (2019). https:\/\/doi.org\/10.1080\/1463922X.2019.1697390","DOI":"10.1080\/1463922X.2019.1697390"},{"key":"167_CR33","doi-asserted-by":"publisher","unstructured":"Calvert, S.C., Mecacci, G., Heikoop, D.D., de Sio, F.S.: Full platoon control in Truck Platooning: A Meaningful Human Control perspective. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pp. 3320\u20133326. IEEE, Maui, HI (2018). https:\/\/doi.org\/10.1109\/ITSC.2018.8570013","DOI":"10.1109\/ITSC.2018.8570013"},{"issue":"1","key":"167_CR34","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1515\/pjbr-2019-0002","volume":"10","author":"F Ficuciello","year":"2019","unstructured":"Ficuciello, F., Tamburrini, G., Arezzo, A., Villani, L., Siciliano, B.: Autonomy in surgical robots and its meaningful human control. Paladyn. J. Behav. Robot. 10(1), 30\u201343 (2019)","journal-title":"Paladyn. J. Behav. Robot."},{"key":"167_CR35","unstructured":"Umbrello, S.: Meaningful human control over smart home systems: a value sensitive design approach. Hum. Mente J. Philos. Stud. 12(37) (2020)"},{"key":"167_CR36","doi-asserted-by":"publisher","unstructured":"Braun, M., Hummel, P., Beck, S., Dabrock, P.: Primer on an ethics of AI-based decision support systems in the clinic. J. Med. Ethics 2019\u2013105860 (2020). https:\/\/doi.org\/10.1136\/medethics-2019-105860","DOI":"10.1136\/medethics-2019-105860"},{"issue":"1","key":"167_CR37","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1002\/poi3.198","volume":"11","author":"B Wagner","year":"2019","unstructured":"Wagner, B.: Liable, but not in control? Ensuring meaningful human agency in automated decision-making systems. Policy Internet 11(1), 104\u2013122 (2019)","journal-title":"Policy Internet"},{"key":"167_CR38","doi-asserted-by":"crossref","unstructured":"Fischer, J.M., Ravizza, M.: Responsibility and control: a theory of moral responsibility. Cambridge University Press, Cambridge (1998)","DOI":"10.1017\/CBO9780511814594"},{"key":"167_CR39","doi-asserted-by":"publisher","unstructured":"Van den Hoven, J.: Value Sensitive Design and Responsible Innovation. In: Owen, R., Bessant, J., Heintz, M. (eds.) Responsible Innovation, pp. 75\u201383. Wiley, Chichester, UK (2013). https:\/\/doi.org\/10.1002\/9781118551424.ch4","DOI":"10.1002\/9781118551424.ch4"},{"key":"167_CR40","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/7585.001.0001","volume-title":"Value Sensitive Design: Shaping Technology with Moral Imagination","author":"B Friedman","year":"2019","unstructured":"Friedman, B., Hendry, D.G.: Value Sensitive Design: Shaping Technology with Moral Imagination. MIT Press, Cambridge (2019)"},{"issue":"6","key":"167_CR41","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1080\/1463922X.2019.1574931","volume":"20","author":"DD Heikoop","year":"2019","unstructured":"Heikoop, D.D., Hagenzieker, M., Mecacci, G., Calvert, S., Santoni De Sio, F., Van Arem, B.: Human behaviour with automated driving systems: a quantitative framework for meaningful human control. Theor. Issues Ergon. Sci. 20(6), 711\u2013730 (2019). https:\/\/doi.org\/10.1080\/1463922X.2019.1574931","journal-title":"Theor. Issues Ergon. Sci."},{"key":"167_CR42","doi-asserted-by":"publisher","unstructured":"Calvert, S.C., Mecacci, G.: A conceptual control system description of Cooperative and Automated Driving in mixed urban traffic with Meaningful Human Control for design and evaluation. IEEE Open Journal of Intelligent Transportation Systems, 1\u20131 (2020). https:\/\/doi.org\/10.1109\/OJITS.2020.3021461","DOI":"10.1109\/OJITS.2020.3021461"},{"key":"167_CR43","doi-asserted-by":"crossref","unstructured":"Wallach, W., Allen, C., Smit, I.: Machine morality: bottom-up and top-down approaches for modelling human moral faculties. In: Machine Ethics and Robot Ethics, pp. 249\u2013266. Routledge (2020)","DOI":"10.4324\/9781003074991-23"},{"issue":"3","key":"167_CR44","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1177\/0735275112457914","volume":"30","author":"S Timmermans","year":"2012","unstructured":"Timmermans, S., Tavory, I.: Theory construction in qualitative research: from grounded theory to abductive analysis. Sociol. Theory 30(3), 167\u2013186 (2012)","journal-title":"Sociol. Theory"},{"key":"167_CR45","unstructured":"Dorst, K.: The nature of design thinking. In: Design Thinking Research Symposium (2010). DAB Documents"},{"key":"167_CR46","doi-asserted-by":"publisher","unstructured":"SAE: Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Technical report, SAE International (2018). https:\/\/doi.org\/10.4271\/J3016_201806","DOI":"10.4271\/J3016_201806"},{"key":"167_CR47","unstructured":"Czarnecki, K.: Operational Design Domain for Automated Driving Systems - Taxonomy of Basic Terms (2018)"},{"key":"167_CR48","unstructured":"Koopman, P., Fratrik, F.: How Many Operational Design Domains, Objects, and Events? 4 (2019)"},{"key":"167_CR49","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2019.103201","volume":"279","author":"S Burton","year":"2020","unstructured":"Burton, S., Habli, I., Lawton, T., McDermid, J., Morgan, P., Porter, Z.: Mind the gaps: assuring the safety of autonomous systems from an engineering, ethical, and legal perspective. Artif. Intell. 279, 103201 (2020). https:\/\/doi.org\/10.1016\/j.artint.2019.103201","journal-title":"Artif. Intell."},{"issue":"2","key":"167_CR50","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.pmcj.2009.06.002","volume":"6","author":"C Bettini","year":"2010","unstructured":"Bettini, C., Brdiczka, O., Henricksen, K., Indulska, J., Nicklas, D., Ranganathan, A., Riboni, D.: A survey of context modelling and reasoning techniques. Pervasive Mob. Comput. 6(2), 161\u2013180 (2010). https:\/\/doi.org\/10.1016\/j.pmcj.2009.06.002","journal-title":"Pervasive Mob. Comput."},{"issue":"2","key":"167_CR51","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1007\/s10270-017-0611-z","volume":"18","author":"O Cabrera","year":"2019","unstructured":"Cabrera, O., Franch, X., Marco, J.: 3LConOnt: a three-level ontology for context modelling in context-aware computing. Softw. Syst. Model. 18(2), 1345\u20131378 (2019). https:\/\/doi.org\/10.1007\/s10270-017-0611-z","journal-title":"Softw. Syst. Model."},{"issue":"2","key":"167_CR52","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1007\/s10676-013-9313-6","volume":"15","author":"M Coeckelbergh","year":"2013","unstructured":"Coeckelbergh, M.: Drones, information technology, and distance: mapping the moral epistemology of remote fighting. Ethics Inf. Technol. 15(2), 87\u201398 (2013). https:\/\/doi.org\/10.1007\/s10676-013-9313-6","journal-title":"Ethics Inf. Technol."},{"key":"167_CR53","volume-title":"Military Robots: Mapping the Moral Landscape","author":"J Galliott","year":"2015","unstructured":"Galliott, J.: Military Robots: Mapping the Moral Landscape. Ashgate Publishing Ltd, London (2015)"},{"issue":"2","key":"167_CR54","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1111\/j.1748-720X.2002.tb00384.x","volume":"30","author":"JF Childress","year":"2002","unstructured":"Childress, J.F., Faden, R.R., Gaare, R.D., Gostin, L.O., Kahn, J., Bonnie, R.J., Kass, N.E., Mastroianni, A.C., Moreno, J.D., Nieburg, P.: Public health ethics: mapping the terrain. .J. Law Med. Ethics 30(2), 170\u2013178 (2002). https:\/\/doi.org\/10.1111\/j.1748-720X.2002.tb00384.x","journal-title":".J. Law Med. Ethics"},{"key":"167_CR55","unstructured":"Liscio, E., Van der Meer, M., Siebert, L.C., Jonker, C.M., Mouter, N., Murukannaiah, P.K.: Axies: Identifying and evaluating context-specific values. In: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, pp. 799\u2013808 (2021)"},{"key":"167_CR56","doi-asserted-by":"publisher","unstructured":"Primatesta, S., Scanavino, M., Guglieri, G., Rizzo, A.: A Risk-based Path Planning Strategy to Compute Optimum Risk Path for Unmanned Aircraft Systems over Populated Areas. In: 2020 International Conference on Unmanned Aircraft Systems (ICUAS), pp. 641\u2013650. IEEE, Athens, Greece (2020). https:\/\/doi.org\/10.1109\/ICUAS48674.2020.9213982","DOI":"10.1109\/ICUAS48674.2020.9213982"},{"issue":"4","key":"167_CR57","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/MWC.2019.1800544","volume":"26","author":"M Maiouak","year":"2019","unstructured":"Maiouak, M., Taleb, T.: Dynamic Maps for Automated Driving and UAV Geofencing. IEEE Wirel. Commun. 26(4), 54\u201359 (2019). https:\/\/doi.org\/10.1109\/MWC.2019.1800544","journal-title":"IEEE Wirel. Commun."},{"issue":"1","key":"167_CR58","doi-asserted-by":"publisher","first-page":"248","DOI":"10.2514\/1.35265","volume":"32","author":"I Yavrucuk","year":"2009","unstructured":"Yavrucuk, I., Prasad, J.V.R., Unnikrishnan, S.: Envelope Protection for Autonomous Unmanned Aerial Vehicles. J. Guid. Control. Dyn. 32(1), 248\u2013261 (2009). https:\/\/doi.org\/10.2514\/1.35265","journal-title":"J. Guid. Control. Dyn."},{"issue":"2","key":"167_CR59","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/s00146-019-00891-1","volume":"35","author":"S Robbins","year":"2020","unstructured":"Robbins, S.: AI and the path to envelopment: knowledge as a first step towards the responsible regulation and use of AI-powered machines. AI & Soc. 35(2), 391\u2013400 (2020). https:\/\/doi.org\/10.1007\/s00146-019-00891-1","journal-title":"AI & Soc."},{"issue":"6468","key":"167_CR60","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1126\/science.aag3311","volume":"366","author":"PS Thomas","year":"2019","unstructured":"Thomas, P.S., da Silva, B.C., Barto, A.G., Giguere, S., Brun, Y., Brunskill, E.: Preventing undesirable behavior of intelligent machines. Science 366(6468), 999\u20131004 (2019)","journal-title":"Science"},{"issue":"1","key":"167_CR61","doi-asserted-by":"publisher","first-page":"43","DOI":"10.5898\/JHRI.3.1.Johnson","volume":"3","author":"M Johnson","year":"2014","unstructured":"Johnson, M., Bradshaw, J.M., Feltovich, P.J., Jonker, C.M., Van Riemsdijk, M.B., Sierhuis, M.: Coactive design: designing support for interdependence in joint activity. J. Hum.-Robot Interact. 3(1), 43 (2014). https:\/\/doi.org\/10.5898\/JHRI.3.1.Johnson","journal-title":"J. Hum.-Robot Interact."},{"key":"167_CR62","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1007\/978-3-642-21268-0_8","volume-title":"Coordination, Organizations, Institutions, and Norms in Agent Systems VI","author":"CM Jonker","year":"2011","unstructured":"Jonker, C.M., Van Riemsdijk, M.B., Vermeulen, B.: Shared Mental Models. In: De Vos, M., Fornara, N., Pitt, J.V., Vouros, G. (eds.) Coordination, Organizations, Institutions, and Norms in Agent Systems VI, pp. 132\u2013151. Springer, Berlin (2011)"},{"issue":"6","key":"167_CR63","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1177\/001872088903100601","volume":"31","author":"JR Wilson","year":"1989","unstructured":"Wilson, J.R., Rutherford, A.: Mental models: theory and application in human factors. Hum. Factors 31(6), 617\u2013634 (1989)","journal-title":"Hum. Factors"},{"key":"167_CR64","doi-asserted-by":"crossref","unstructured":"Lee, J.D., See, K.A.: Trust in Automation: Designing for Appropriate Reliance. Human Factors, 31 (2004)","DOI":"10.1518\/hfes.46.1.50.30392"},{"issue":"1","key":"167_CR65","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s10111-011-0191-6","volume":"14","author":"F Flemisch","year":"2012","unstructured":"Flemisch, F., Heesen, M., Hesse, T., Kelsch, J., Schieben, A., Beller, J.: Towards a dynamic balance between humans and automation: authority, ability, responsibility and control in shared and cooperative control situations. Cognit. Technol. Work 14(1), 3\u201318 (2012)","journal-title":"Cognit. Technol. Work"},{"key":"167_CR66","doi-asserted-by":"publisher","unstructured":"Aler\u00a0Tubella, A., Theodorou, A., Dignum, F., Dignum, V.: Governance by glass-box: implementing transparent moral bounds for AI behaviour. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, pp. 5787\u20135793. International Joint Conferences on Artificial Intelligence Organization, Macao, China (2019). https:\/\/doi.org\/10.24963\/ijcai.2019\/802","DOI":"10.24963\/ijcai.2019\/802"},{"issue":"4","key":"167_CR67","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1109\/21.156574","volume":"22","author":"KJ Vicente","year":"1992","unstructured":"Vicente, K.J., Rasmussen, J.: Ecological interface design: theoretical foundations. IEEE Trans. Syst. Man Cybern. 22(4), 589\u2013606 (1992). https:\/\/doi.org\/10.1109\/21.156574","journal-title":"IEEE Trans. Syst. Man Cybern."},{"issue":"7","key":"167_CR68","doi-asserted-by":"publisher","first-page":"1405","DOI":"10.1007\/s10514-018-9746-1","volume":"42","author":"D Sadigh","year":"2018","unstructured":"Sadigh, D., Landolfi, N., Sastry, S.S., Seshia, S.A., Dragan, A.D.: Planning for cars that coordinate with people: leveraging effects on human actions for planning and active information gathering over human internal state. Auton. Robot. 42(7), 1405\u20131426 (2018). https:\/\/doi.org\/10.1007\/s10514-018-9746-1","journal-title":"Auton. Robot."},{"key":"167_CR69","doi-asserted-by":"publisher","first-page":"8","DOI":"10.3389\/fpsyg.2020.561510","volume":"11","author":"T Sch\u00fcrmann","year":"2020","unstructured":"Sch\u00fcrmann, T., Beckerle, P.: Personalizing human-agent interaction through cognitive models. Front. Psychol. 11, 8 (2020). https:\/\/doi.org\/10.3389\/fpsyg.2020.561510","journal-title":"Front. Psychol."},{"key":"167_CR70","doi-asserted-by":"crossref","unstructured":"Siebinga, O., Zgonnikov, A., Abbink, D.: Validating human driver models for interaction-aware automated vehicle controllers: A human factors approach. arXiv:2109.13077 [cs] (2021)","DOI":"10.1145\/3538705"},{"key":"167_CR71","doi-asserted-by":"crossref","unstructured":"Van Bekkum, M., de Boer, M., Van Harmelen, F., Meyer-Vitali, A., ten Teije, A.: Modular design patterns for hybrid learning and reasoning systems: a taxonomy, patterns and use cases. arXiv:2102.11965 [cs] (2021)","DOI":"10.1007\/s10489-021-02394-3"},{"key":"167_CR72","unstructured":"Marcus, G.: The next decade in AI: four steps towards robust artificial intelligence. arXiv:2002.06177 [cs] (2020)"},{"issue":"3","key":"167_CR73","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/s11023-020-09539-2","volume":"30","author":"I Gabriel","year":"2020","unstructured":"Gabriel, I.: Artificial intelligence, values, and alignment. Mind. Mach. 30(3), 411\u2013437 (2020)","journal-title":"Mind. Mach."},{"key":"167_CR74","unstructured":"Hadfield-Menell, D., Russell, S.J., Abbeel, P., Dragan, A.: Cooperative inverse reinforcement learning. Adv. Neural Inf. Process. Syst. 29 (2016)"},{"key":"167_CR75","unstructured":"Armstrong, S., Mindermann, S.: Occam\u2019s razor is insufficient to infer the preferences of irrational agents. In: Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 31. Curran Associates, Inc., (2018). https:\/\/proceedings.neurips.cc\/paper\/2018\/file\/d89a66c7c80a29b1bdbab0f2a1a94af8-Paper.pdf"},{"key":"167_CR76","doi-asserted-by":"publisher","unstructured":"Peysakhovich, A.: Reinforcement Learning and Inverse Reinforcement Learning with System 1 and System 2. In: Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society. AIES \u201919, pp. 409\u2013415. Association for Computing Machinery, New York, NY, USA (2019). https:\/\/doi.org\/10.1145\/3306618.3314259","DOI":"10.1145\/3306618.3314259"},{"issue":"3","key":"167_CR77","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1109\/3468.844354","volume":"30","author":"R Parasuraman","year":"2000","unstructured":"Parasuraman, R., Sheridan, T.B., Wickens, C.D.: A model for types and levels of human interaction with automation. IEEE Trans. Syst. Man. Cybern. Part A: Syst. Hum. 30(3), 286\u2013297 (2000)","journal-title":"IEEE Trans. Syst. Man. Cybern. Part A: Syst. Hum."},{"issue":"26","key":"167_CR78","first-page":"179","volume":"7","author":"F Santoni de Sio","year":"2014","unstructured":"Santoni de Sio, F., Robichaud, P., Vincent, N.A.: Who should enhance? Conceptual and normative dimensions of cognitive enhancement. HUMANA.MENTE J. Philos. Stud. 7(26), 179\u2013197 (2014)","journal-title":"HUMANA.MENTE J. Philos. Stud."},{"issue":"6","key":"167_CR79","doi-asserted-by":"publisher","first-page":"1745","DOI":"10.1007\/s11948-015-9715-4","volume":"22","author":"F Santoni de Sio","year":"2016","unstructured":"Santoni de Sio, F., Van Wynsberghe, A.: When should we use care robots? The nature-of-activities approach. Sci. Eng. Ethics 22(6), 1745\u20131760 (2016)","journal-title":"Sci. Eng. Ethics"},{"key":"167_CR80","doi-asserted-by":"publisher","unstructured":"Van Diggelen, J., Johnson, M.: Team Design Patterns. In: Proceedings of the 7th International Conference on Human-Agent Interaction, pp. 118\u2013126. ACM, Kyoto Japan (2019). https:\/\/doi.org\/10.1145\/3349537.3351892","DOI":"10.1145\/3349537.3351892"},{"key":"167_CR81","doi-asserted-by":"publisher","unstructured":"Van der Waa, J., Van Diggelen, J., Cavalcante\u00a0Siebert, L., Neerincx, M., Jonker, C.: Allocation of Moral Decision-Making in Human-Agent Teams: A Pattern Approach. In: Harris, D., Li, W.-C. (eds.) Engineering Psychology and Cognitive Ergonomics. Cognition and Design vol. 12187, pp. 203\u2013220. Springer International Publishing, Cham (2020). https:\/\/doi.org\/10.1007\/978-3-030-49183-3_16","DOI":"10.1007\/978-3-030-49183-3_16"},{"issue":"3","key":"167_CR82","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1080\/1463922X.2017.1293187","volume":"20","author":"M Kyriakidis","year":"2019","unstructured":"Kyriakidis, M., de Winter, J.C.F., Stanton, N., Bellet, T., Van Arem, B., Brookhuis, K., Martens, M.H., Bengler, K., Andersson, J., Merat, N., Reed, N., Flament, M., Hagenzieker, M., Happee, R.: A human factors perspective on automated driving. Theor. Issues Ergon. Sci. 20(3), 223\u2013249 (2019). https:\/\/doi.org\/10.1080\/1463922X.2017.1293187","journal-title":"Theor. Issues Ergon. Sci."},{"key":"167_CR83","doi-asserted-by":"publisher","unstructured":"Salvendy, G. (ed.): Handbook of Human Factors and Ergonomics: Salvendy\/Handbook of Human Factors 4e. Wiley, Hoboken, NJ (2012). https:\/\/doi.org\/10.1002\/9781118131350","DOI":"10.1002\/9781118131350"},{"issue":"1","key":"167_CR84","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2019-100081","volume":"26","author":"M Sujan","year":"2019","unstructured":"Sujan, M., Furniss, D., Grundy, K., Grundy, H., Nelson, D., Elliott, M., White, S., Habli, I., Reynolds, N.: Human factors challenges for the safe use of artificial intelligence in patient care. BMJ Health Care Inf. 26(1), 100081 (2019). https:\/\/doi.org\/10.1136\/bmjhci-2019-100081","journal-title":"BMJ Health Care Inf."},{"key":"167_CR85","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1007\/s10462-016-9505-7","volume":"48","author":"Jos\u00e9 Hern\u00e1ndez-Orallo","year":"2017","unstructured":"Hern\u00e1ndez-Orallo, Jos\u00e9: Evaluation in artificial intelligence: from task-oriented to ability-oriented measurement. Artif. Intell. Rev. 48, 397\u2013447 (2017)","journal-title":"Artif. Intell. Rev."},{"issue":"4","key":"167_CR86","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2523813","volume":"46","author":"J Gama","year":"2014","unstructured":"Gama, J., \u017dliobait\u0117, I., Bifet, A., Pechenizkiy, M., Bouchachia, A.: A survey on concept drift adaptation. ACM Comput. Surv. 46(4), 1\u201337 (2014). https:\/\/doi.org\/10.1145\/2523813","journal-title":"ACM Comput. Surv."},{"key":"167_CR87","doi-asserted-by":"publisher","unstructured":"Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., Zhang, G.: Learning under Concept Drift: A Review. IEEE Trans. Knowl. Data Eng. pp. 1\u20131 (2018). https:\/\/doi.org\/10.1109\/TKDE.2018.2876857","DOI":"10.1109\/TKDE.2018.2876857"},{"key":"167_CR88","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1016\/j.aap.2016.10.016","volume":"98","author":"T Melman","year":"2017","unstructured":"Melman, T., de Winter, J.C.F., Abbink, D.A.: Does haptic steering guidance instigate speeding? A driving simulator study into causes and remedies. Accident Anal. Prevent. 98, 372\u2013387 (2017). https:\/\/doi.org\/10.1016\/j.aap.2016.10.016","journal-title":"Accident Anal. Prevent."},{"key":"167_CR89","unstructured":"Christian, G.: Partially automated driving as a fallback level of high automation. In: 6. Tagung Fahrerassistenzsysteme (2013)"},{"issue":"5","key":"167_CR90","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1109\/THMS.2018.2791570","volume":"48","author":"DA Abbink","year":"2018","unstructured":"Abbink, D.A., Carlson, T., Mulder, M., de Winter, J.C.F., Aminravan, F., Gibo, T.L., Boer, E.R.: A topology of shared control systems\u2014finding common ground in diversity. IEEE Trans. Hum.-Mach. Syst. 48(5), 509\u2013525 (2018)","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"issue":"1","key":"167_CR91","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s10111-011-0192-5","volume":"14","author":"DA Abbink","year":"2012","unstructured":"Abbink, D.A., Mulder, M., Boer, E.R.: Haptic shared control: smoothly shifting control authority? Cognit. Technol. Work 14(1), 19\u201328 (2012). https:\/\/doi.org\/10.1007\/s10111-011-0192-5","journal-title":"Cognit. Technol. Work"},{"key":"167_CR92","doi-asserted-by":"crossref","unstructured":"Aristotle: Nicomachean Ethics, 2nd ed edn. Hackett Pub. Co, Indianapolis, Ind (1999)","DOI":"10.1093\/oseo\/instance.00258595"},{"key":"167_CR93","doi-asserted-by":"publisher","unstructured":"Van de Poel, I.: Translating Values into Design Requirements. In: Michelfelder, D.P., McCarthy, N., Goldberg, D.E. (eds.) Philosophy and Engineering: Reflections on Practice, Principles and Process, pp. 253\u2013266. Springer, New York (2013). https:\/\/doi.org\/10.1007\/978-94-007-7762-0_20","DOI":"10.1007\/978-94-007-7762-0_20"},{"key":"167_CR94","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","volume":"58","author":"A Barredo Arrieta","year":"2020","unstructured":"Barredo Arrieta, A., D\u00edaz-Rodr\u00edguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins, R., Chatila, R., Herrera, F.: Explainable artificial intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inf. Fusion 58, 82\u2013115 (2020)","journal-title":"Inf. Fusion"},{"key":"167_CR95","volume-title":"Ethics, Technology, and Engineering: An Introduction","author":"I Van de Poel","year":"2011","unstructured":"Van de Poel, I., Royakkers, L.: Ethics, Technology, and Engineering: An Introduction. Wiley-Blackwell, Hoboken (2011)"},{"key":"167_CR96","doi-asserted-by":"publisher","DOI":"10.1007\/s11948-019-00146-8","author":"M Coeckelbergh","year":"2019","unstructured":"Coeckelbergh, M.: Artificial intelligence, responsibility attribution, and a relational justification of explainability. Sci. Eng. Ethics (2019). https:\/\/doi.org\/10.1007\/s11948-019-00146-8","journal-title":"Sci. Eng. Ethics"},{"issue":"2","key":"167_CR97","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.1109\/TASE.2020.2965466","volume":"17","author":"N Douer","year":"2020","unstructured":"Douer, N., Meyer, J.: The responsibility quantification model of human interaction with automation. IEEE Trans. Autom. Sci. Eng. 17(2), 1044\u20131060 (2020). https:\/\/doi.org\/10.1109\/TASE.2020.2965466","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"167_CR98","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199256044.001.0001","volume-title":"Reassembling the Social: An Introduction to Actor-Network-Theory","author":"B Latour","year":"2005","unstructured":"Latour, B., et al.: Reassembling the Social: An Introduction to Actor-Network-Theory. Oxford University Press, Oxford (2005)"},{"issue":"3","key":"167_CR99","doi-asserted-by":"publisher","first-page":"298","DOI":"10.2307\/800624","volume":"35","author":"J Johnson","year":"1988","unstructured":"Johnson, J.: Mixing humans and nonhumans together: the sociology of a door-closer. Soc. Probl. 35(3), 298\u2013310 (1988)","journal-title":"Soc. Probl."},{"key":"167_CR100","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11801.001.0001","volume-title":"Design Unbound: Designing for Emergence in a White Water World","author":"AM Pendleton-Jullian","year":"2018","unstructured":"Pendleton-Jullian, A.M., Brown, J.S.: Design Unbound: Designing for Emergence in a White Water World. MIT Press, Cambridge (2018)"},{"issue":"3","key":"167_CR101","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1016\/j.sheji.2020.06.001","volume":"6","author":"M Van der Bijl-Brouwer","year":"2020","unstructured":"Van der Bijl-Brouwer, M., Malcolm, B.: Systemic design principles in social innovation: a study of expert practices and design rationales. She Ji: J. Des. Econ. Innovat. 6(3), 386\u2013407 (2020). https:\/\/doi.org\/10.1016\/j.sheji.2020.06.001","journal-title":"She Ji: J. Des. Econ. Innovat."}],"container-title":["AI and Ethics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-022-00167-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43681-022-00167-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-022-00167-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,21]],"date-time":"2023-11-21T19:59:32Z","timestamp":1700596772000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43681-022-00167-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,18]]},"references-count":101,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["167"],"URL":"https:\/\/doi.org\/10.1007\/s43681-022-00167-3","relation":{},"ISSN":["2730-5953","2730-5961"],"issn-type":[{"value":"2730-5953","type":"print"},{"value":"2730-5961","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,18]]},"assertion":[{"value":"7 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}