{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T22:58:23Z","timestamp":1784242703539,"version":"3.55.0"},"reference-count":66,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T00:00:00Z","timestamp":1715904000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T00:00:00Z","timestamp":1715904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["Gravitation Programme - Hybrid Intelligence"],"award-info":[{"award-number":["Gravitation Programme - Hybrid Intelligence"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Minds &amp; Machines"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper provides an empirical and conceptual account on seeing machine learning models as part of a sociotechnical system to identify relevant vulnerabilities emerging in the context of use. As ML is increasingly adopted in socially sensitive and safety-critical domains, many ML applications end up not delivering on their promises, and contributing to new forms of algorithmic harm. There is still a lack of empirical insights as well as conceptual tools and frameworks to properly understand and design for the impact of ML models in their sociotechnical context. In this paper, we follow a design science research approach to work towards such insights and tools. We center our study in the financial industry, where we first empirically map recently emerging MLOps practices to govern ML applications, and corroborate our insights with recent literature. We then perform an integrative literature research to identify a long list of vulnerabilities that emerge in the sociotechnical context of ML applications, and we theorize these along eight dimensions. We then perform semi-structured interviews in two real-world use cases and across a broad set of relevant actors and organizations, to validate the conceptual dimensions and identify challenges to address sociotechnical vulnerabilities in the design and governance of ML-based systems. The paper proposes a set of guidelines to proactively and integrally address both the dimensions of sociotechnical vulnerability, as well as the challenges identified in the empirical use case research, in the organization of MLOps practices.<\/jats:p>","DOI":"10.1007\/s11023-024-09668-y","type":"journal-article","created":{"date-parts":[[2024,5,17]],"date-time":"2024-05-17T15:01:58Z","timestamp":1715958118000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Toward Sociotechnical AI: Mapping Vulnerabilities for Machine Learning in Context"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4633-7023","authenticated-orcid":false,"given":"Roel","family":"Dobbe","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anouk","family":"Wolters","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,17]]},"reference":[{"issue":"2\u20133","key":"9668_CR1","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1207\/S15327051HCI1523_5","volume":"15","author":"MS Ackerman","year":"2000","unstructured":"Ackerman, M. S. (2000). The intellectual challenge of CSCW: The gap between social requirements and technical feasibility. Human\u2013Computer Interaction, 15(2\u20133), 179\u2013203.","journal-title":"Human\u2013Computer Interaction"},{"key":"9668_CR2","unstructured":"AFM (n.d.). Wet ter voorkoming van witwassen en financieren van terrorisme (Wwft) Onderwerpinformatie van de AFM AFM Professionals. Retrieved from https:\/\/www.afm.nl\/nlnl\/professionals\/onderwerpen\/wwft-wet"},{"key":"9668_CR3","unstructured":"Alter, S. (2010). BRIDGING THE CHASM BETWEEN SOCIOTECHNICAL AND TECHNICAL VIEWS OF SYSTEMS IN ORGANIZATIONS. In International conference of information systems (Vol. 54, pp. 1\u201323)."},{"key":"9668_CR4","unstructured":"Balayn, A., & G\u00fcrses, S. (2021). Beyond debiasing regulating AI and its inequalities (Tech. Rep.). EDRi."},{"issue":"2","key":"9668_CR5","first-page":"105","volume":"2","author":"KJ Behymer","year":"2016","unstructured":"Behymer, K. J., & Flach, J. M. (2016). From autonomous systems to sociotechnical systems: Designing effective collaborations. She Ji: The Journal of Design, Economics, and Innovation, 2(2), 105\u2013114.","journal-title":"She Ji: The Journal of Design, Economics, and Innovation"},{"key":"9668_CR6","unstructured":"Brom, D. (2021). AI Governance in the City of Amsterdam: Scrutinising vulnerabilities of public sector AI systems (Tech. Rep.). TU Delft."},{"issue":"5","key":"9668_CR7","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1109\/TSMCA.2009.2025452","volume":"39","author":"H de Bruijn","year":"2009","unstructured":"de Bruijn, H., & Herder, P. M. (2009). System and actor perspectives on sociotechnical systems. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans, 39(5), 981\u2013992. https:\/\/doi.org\/10.1109\/TSMCA.2009.2025452","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans"},{"key":"9668_CR8","doi-asserted-by":"publisher","DOI":"10.4324\/9781315251271","volume-title":"Just culture: Balancing safety and accountability","author":"S Dekker","year":"2016","unstructured":"Dekker, S. (2016). Just culture: Balancing safety and accountability. CRC Press. https:\/\/doi.org\/10.4324\/9781315251271"},{"key":"9668_CR9","doi-asserted-by":"crossref","unstructured":"Dobbe, R. (2022). System safety and artificial intelligence. In Oxford handbook on AI governance. Retrieved from arXiv:2202.09292","DOI":"10.1093\/oxfordhb\/9780197579329.013.67"},{"key":"9668_CR10","unstructured":"Dobbe, R., Dean, S., Gilbert, T., & Kohli, N. (2018). A broader view on bias in automated decision-making: Reflecting on epistemology and dynamics. Retrieved from arXiv:1807.00553v2"},{"key":"9668_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103555","author":"R Dobbe","year":"2021","unstructured":"Dobbe, R., Gilbert, T. K., & Mintz, Y. (2021). Hard choices in artificial intelligence. Artificial Intelligence. https:\/\/doi.org\/10.1016\/j.artint.2021.103555","journal-title":"Artificial Intelligence"},{"key":"9668_CR12","unstructured":"Ensign, D., Friedler, S.A., Neville, S., Scheidegger, C., & Venkatasubramanian, S. (2018, February). Runaway feedback loops in predictive policing. In Conference on fairness, accountability and transparency, New York."},{"key":"9668_CR13","unstructured":"European Commission. (2021). EUR-Lex-52021PC0206-EN-EUR-Lex. European Union."},{"key":"9668_CR14","unstructured":"Financial Intelligence Unit. (n.d.). Banken, FIU-Nederland. Retrieved from https:\/\/www.fiu-nederland.nl\/nl\/meldergroep\/8"},{"key":"9668_CR15","unstructured":"Friese, S., Soratto, J., & Pires, D. (2018). Carrying out a computer-aided thematic content analysis with ATLAS.ti. G\u00f6ttingen. Retrieved from http:\/\/www.mmg.mpg.de\/workingpapers"},{"key":"9668_CR16","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1002\/(SICI)1099-0771(199903)12:1","volume":"12","author":"P Goodwin","year":"1999","unstructured":"Goodwin, P., & Fildes, R. (1999). Judgmental forecasts of time series affected by special events: Does providing a statistical forecast improve accuracy? Journal of Behavioral Decision Making, 12, 37\u201353. https:\/\/doi.org\/10.1002\/(SICI)1099-0771(199903)12:1","journal-title":"Journal of Behavioral Decision Making"},{"issue":"3","key":"9668_CR17","doi-asserted-by":"publisher","first-page":"209","DOI":"10.23919\/JSC.2021.0018","volume":"2","author":"B Green","year":"2021","unstructured":"Green, B. (2021). The contestation of tech ethics: A sociotechnical approach to technology ethics in practice. Journal of Social Computing, 2(3), 209\u2013225.","journal-title":"Journal of Social Computing"},{"key":"9668_CR18","doi-asserted-by":"publisher","unstructured":"Green, B., & Chen, Y. (2019a). Disparate interactions: An algorithm-in-theloop analysis of fairness in risk assessments. In FAT* 2019\u2014proceedings of the 2019 conference on fairness, accountability, and transparency (pp. 90\u201399). https:\/\/doi.org\/10.1145\/3287560.3287563","DOI":"10.1145\/3287560.3287563"},{"key":"9668_CR19","doi-asserted-by":"publisher","unstructured":"Green, B., & Chen, Y. (2019b). The principles and limits of algorithm-in-the-loop decision making. Proceedings of the ACM on Human-Computer Interaction. https:\/\/doi.org\/10.1145\/3359152","DOI":"10.1145\/3359152"},{"key":"9668_CR20","doi-asserted-by":"publisher","unstructured":"Green, B., & Chen, Y. (2020). Algorithm-in-the-loop decision making. In Proceedings of the AAAI conference on artificial intelligence (pp. 13663\u201313664). https:\/\/doi.org\/10.1609\/aaai.v34i09.7115","DOI":"10.1609\/aaai.v34i09.7115"},{"key":"9668_CR21","doi-asserted-by":"crossref","unstructured":"Hevner, A., Chatterjee, S., Hevner, A., & Chatterjee, S. (2010). Design research in information systems: theory and practice (pp. 9\u201322). Springer.","DOI":"10.1007\/978-1-4419-5653-8_2"},{"key":"9668_CR22","doi-asserted-by":"crossref","unstructured":"Jabbari, R., bin Ali, N., Petersen, K., & Tanveer, B. (2016). What is DevOps? A systematic mapping study on definitions and practices. In Proceedings of the scientific workshop proceedings of XP2016 (pp. 1\u201311).","DOI":"10.1145\/2962695.2962707"},{"key":"9668_CR23","doi-asserted-by":"publisher","DOI":"10.1177\/0894439320980118","author":"M Janssen","year":"2020","unstructured":"Janssen, M., Hartog, M., Matheus, R., Yi Ding, A., & Kuk, G. (2020). Will algorithms blind people? The effect of explainable AI and decision-makers\u2019 experience on ai-supported decision-making in government. Social Science Computer Review. https:\/\/doi.org\/10.1177\/0894439320980118","journal-title":"Social Science Computer Review"},{"issue":"9","key":"9668_CR24","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","volume":"1","author":"A Jobin","year":"2019","unstructured":"Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of AI ethics guidelines. Nature Machine Intelligence, 1(9), 389\u2013399.","journal-title":"Nature Machine Intelligence"},{"key":"9668_CR25","unstructured":"Kahneman, D., Rosenfield, A.M., Gandhi, L., & Blaser, T. (2016). Noise: How to overcome the high, hidden cost of inconsistent decision making. Retrieved from https:\/\/hbr.org\/2016\/10\/noise"},{"key":"9668_CR26","unstructured":"Kohli, N., Barreto, R., & Kroll, J. A. (2018). Translation tutorial: A shared lexicon for research and practice in human-centered software systems. In 1st conference on fairness, accountability, and transparance."},{"issue":"1","key":"9668_CR27","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1080\/17579961.2021.1898299","volume":"13","author":"B-J Koops","year":"2021","unstructured":"Koops, B.-J. (2021). The concept of function creep. Law, Innovation and Technology, 13(1), 29\u201356. https:\/\/doi.org\/10.1080\/17579961.2021.1898299","journal-title":"Law, Innovation and Technology"},{"issue":"5","key":"9668_CR28","doi-asserted-by":"publisher","first-page":"1103","DOI":"10.1007\/s10994-020-05872-w","volume":"109","author":"H Kuwajima","year":"2020","unstructured":"Kuwajima, H., Yasuoka, H., & Nakae, T. (2020). Engineering problems in machine learning systems. Machine Learning, 109(5), 1103\u20131126. https:\/\/doi.org\/10.1007\/s10994-020-05872-w","journal-title":"Machine Learning"},{"key":"9668_CR29","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/8179.001.0001","volume-title":"Engineering a safer world","author":"N Leveson","year":"2012","unstructured":"Leveson, N. (2012). Engineering a safer world. MIT."},{"key":"9668_CR30","doi-asserted-by":"publisher","unstructured":"Loi, M., & Spielkamp, M. (2021). Towards accountability in the use of artificial intelligence for public administrations. In Proceedings of the 2021 AAAI\/ACM conference on AI, ethics, and society (pp. 757\u2013766). Association for Computing Machinery. Retrieved March 7, 2023, from https:\/\/doi.org\/10.1145\/3461702.3462631","DOI":"10.1145\/3461702.3462631"},{"key":"9668_CR31","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1016\/j.jbusres.2020.07.045","volume":"120","author":"EE Makarius","year":"2020","unstructured":"Makarius, E. E., Mukherjee, D., Fox, J. D., & Fox, A. K. (2020). Rising with the machines: A sociotechnical framework for bringing artificial intelligence into the organization. Journal of Business Research, 120, 262\u2013273. https:\/\/doi.org\/10.1016\/j.jbusres.2020.07.045","journal-title":"Journal of Business Research"},{"key":"9668_CR32","unstructured":"Martin, Jr., D., Prabhakaran, V., Kuhlberg, J., Smart, A., & Isaac, W. S. (2020). Extending the machine learning abstraction boundary: A Complex systems approach to incorporate societal context. arXiv preprint. arXiv:2006.09663."},{"key":"9668_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/J.ARTINT.2018.07.007","volume":"267","author":"T Miller","year":"2019","unstructured":"Miller, T. (2019). Explanation in artificial intelligence: Insights from the social sciences. Artificial Intelligence, 267, 1\u201338. https:\/\/doi.org\/10.1016\/J.ARTINT.2018.07.007","journal-title":"Artificial Intelligence"},{"key":"9668_CR34","doi-asserted-by":"publisher","unstructured":"Milli, S., Miller, J., Dragan, A. D., & Hardt, M. (2019, January). The social cost of strategic classification. In Proceedings of the conference on fairness, accountability, and transparency (pp. 230\u2013239). ACM. Retrieved October 6, 2023, from https:\/\/doi.org\/10.1145\/3287560.3287576","DOI":"10.1145\/3287560.3287576"},{"key":"9668_CR35","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1007\/s13347-020-00405-8","volume":"33","author":"S Mohamed","year":"2020","unstructured":"Mohamed, S., Png, M.-T., & Isaac, W. (2020). Decolonial AI: Decolonial theory as sociotechnical foresight in artificial intelligence. Philosophy & Technology, 33, 659\u2013684.","journal-title":"Philosophy & Technology"},{"issue":"2","key":"9668_CR36","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1037\/1089-2680.2.2.175","volume":"2","author":"RS Nickerson","year":"1998","unstructured":"Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175\u2013220.","journal-title":"Review of General Psychology"},{"key":"9668_CR37","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1007\/978-3-031-15086-9_20","volume-title":"Electronic government","author":"S Nouws","year":"2022","unstructured":"Nouws, S., Janssen, M., & Dobbe, R. (2022). Dismantling digital cages: Examining design practices for public algorithmic systems. In M. Janssen (Ed.), Electronic government (pp. 307\u2013322). Springer. https:\/\/doi.org\/10.1007\/978-3-031-15086-9_20"},{"key":"9668_CR38","doi-asserted-by":"publisher","unstructured":"Offermann, P., Blom, S., Sch\u00f6nherr, M., & Bub, U. (2010). Artifact types in information systems design science \u2014a literature review. In International conference on design science research in information systems 2010. LNCS (Vol. 6105, pp. 77\u201392). Springer. https:\/\/doi.org\/10.1007\/978-3-642-13335-0_6","DOI":"10.1007\/978-3-642-13335-0_6"},{"key":"9668_CR39","unstructured":"Oosthuizen, R., & Van\u2019t Wout, M. C. (2019). Sociotechnical system perspective on artificial intelligence implementation for a modern intelligence system. In International command and control research & technology symposium."},{"issue":"5","key":"9668_CR40","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1080\/1369118X.2020.1713842","volume":"23","author":"W Orr","year":"2020","unstructured":"Orr, W., & Davis, J. L. (2020). Attributions of ethical responsibility by artificial intelligence practitioners. Information, Communication & Society, 23(5), 719\u2013735.","journal-title":"Information, Communication & Society"},{"issue":"3","key":"9668_CR41","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1177\/0018720810376055","volume":"52","author":"R Parasuraman","year":"2010","unstructured":"Parasuraman, R., & Manzey, D. H. (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52(3), 381\u2013410.","journal-title":"Human Factors"},{"issue":"2","key":"9668_CR42","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/j.giq.2018.02.003","volume":"35","author":"R Peeters","year":"2018","unstructured":"Peeters, R., & Widlak, A. (2018). The digital cage: Administrative exclusion through information architecture\u2014the case of the Dutch civil registry\u2019s master data management system. Government Information Quarterly, 35(2), 175\u2013183. https:\/\/doi.org\/10.1016\/j.giq.2018.02.003","journal-title":"Government Information Quarterly"},{"key":"9668_CR43","unstructured":"Perdomo, J., Zrnic, T., Mendler-D\u00fcnner, C., & Hardt, M. (2020). Performative prediction. In Proceedings of the 37th international conference on machine learning (pp. 7599\u20137609). Retrieved October 6, 2023, from https:\/\/proceedings.mlr.press\/v119\/perdomo20a.html"},{"key":"9668_CR44","doi-asserted-by":"crossref","unstructured":"Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., & Barnes, P. (2020). Closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing. In Proceedings of the 2020 conference on fairness, accountability, and transparency (pp. 33\u201344).","DOI":"10.1145\/3351095.3372873"},{"key":"9668_CR45","doi-asserted-by":"crossref","unstructured":"Rasmussen, J. (2000). Designing to support adaptation. In Proceedings of the human factors and ergonomics society annual meeting (pp. 554\u2013557).","DOI":"10.1177\/154193120004402215"},{"issue":"5","key":"9668_CR46","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/S42256-019-0048-X","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206\u2013215. https:\/\/doi.org\/10.1038\/S42256-019-0048-X","journal-title":"Nature Machine Intelligence"},{"key":"9668_CR47","doi-asserted-by":"publisher","DOI":"10.3390\/app11198861","author":"P Ruf","year":"2021","unstructured":"Ruf, P., Madan, M., Reich, C., & Ould-Abdeslam, D. (2021). Demystifying MLOPS and presenting a recipe for the selection of open-source tools. Applied Sciences (Switzerland). https:\/\/doi.org\/10.3390\/app11198861","journal-title":"Applied Sciences (Switzerland)"},{"issue":"4","key":"9668_CR48","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1177\/15553434221097357","volume":"16","author":"ME Salwei","year":"2022","unstructured":"Salwei, M. E., & Carayon, P. (2022). A sociotechnical systems framework for the application of artificial intelligence in health care delivery. Journal of Cognitive Engineering and Decision Making, 16(4), 194\u2013206.","journal-title":"Journal of Cognitive Engineering and Decision Making"},{"key":"9668_CR49","doi-asserted-by":"publisher","unstructured":"Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. (2021). \u201cEveryone wants to do the model work, not the data work\u201d: Data cascades in high-stakes AI (Tech. Rep.). Retrieved from https:\/\/doi.org\/10.1145\/3411764.3445518","DOI":"10.1145\/3411764.3445518"},{"key":"9668_CR50","doi-asserted-by":"publisher","first-page":"1057","DOI":"10.1007\/s13347-021-00450-x","volume":"34","author":"F Santoni de Sio","year":"2021","unstructured":"Santoni de Sio, F., & Mecacci, G. (2021). Four responsibility gaps with artificial intelligence: Why they matter and how to address them. Philosophy & Technology, 34, 1057\u20131084.","journal-title":"Philosophy & Technology"},{"key":"9668_CR51","doi-asserted-by":"crossref","unstructured":"Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019). Fairness and abstraction in sociotechnical systems. In Proceedings of the conference on fairness, accountability, and transparency (pp. 59\u201368).","DOI":"10.1145\/3287560.3287598"},{"key":"9668_CR52","doi-asserted-by":"publisher","unstructured":"Selbst, A. D., Friedler, S. A., Venkatasubramanian, S., Vertesi, J., Boyd, D., & Venkatasubrama, S. (2019). Fairness and abstraction in sociotechnical systems. In Fat* \u201919: Proceedings of the conference on fairness, accountability, and transparency (pp. 59\u201368). https:\/\/doi.org\/10.1145\/3287560.3287598","DOI":"10.1145\/3287560.3287598"},{"key":"9668_CR53","doi-asserted-by":"publisher","unstructured":"Suresh, H., & Guttag, J. (2021). A framework for understanding sources of harm throughout the machine learning life cycle; A framework for understanding sources of harm throughout the machine learning life cycle. In ACM conference on equity and access in algorithms, mechanisms, and optimization, EAAMO. https:\/\/doi.org\/10.1145\/3465416.3483305","DOI":"10.1145\/3465416.3483305"},{"key":"9668_CR54","doi-asserted-by":"crossref","unstructured":"Torraco, R. J. (2002). Research methods for theory building in applied disciplines: A comparative analysis. In Advances in developing human resources (Vol. 4, pp. 355\u2013376). SAGE.","DOI":"10.1177\/1523422302043008"},{"key":"9668_CR55","unstructured":"Treveil, M. (2020). Introducing MLOps: How to scale machine learning in the enterprise. O\u2019Reilly Media. Retrieved from http:\/\/www.dataiku.com"},{"key":"9668_CR56","volume-title":"The problem of concept drift: Definitions and related work","author":"A Tsymbal","year":"2004","unstructured":"Tsymbal, A. (2004). The problem of concept drift: Definitions and related work. Trinity College."},{"key":"9668_CR57","doi-asserted-by":"crossref","unstructured":"Van de Poel, I. (2015). Conflicting values in design for values. In Handbook of ethics, values, and technological design: Sources, theory, values and application domains (pp. 89\u2013116). Springer.","DOI":"10.1007\/978-94-007-6970-0_5"},{"issue":"3","key":"9668_CR58","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/s11023-020-09537-4","volume":"30","author":"I Van de Poel","year":"2020","unstructured":"Van de Poel, I. (2020). Embedding values in artificial intelligence (AI) systems. Minds and Machines, 30(3), 385\u2013409.","journal-title":"Minds and Machines"},{"key":"9668_CR59","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717743530","author":"M Veale","year":"2017","unstructured":"Veale, M., & Binns, R. (2017). Fairer machine learning in the real world: Mitigating discrimination without collecting sensitive data. Big Data & Society. https:\/\/doi.org\/10.1177\/2053951717743530","journal-title":"Big Data & Society"},{"key":"9668_CR60","doi-asserted-by":"publisher","unstructured":"Veale, M., Kleek, M. V., & Binns, R. (2018). Fairness and accountability design needs for algorithmic support in high-stakes public sector decision-making. In CHI \u201918: Proceedings of the 2018 CHI conference on human factors in computing systems. https:\/\/doi.org\/10.1145\/3173574.3174014","DOI":"10.1145\/3173574.3174014"},{"key":"9668_CR61","doi-asserted-by":"crossref","unstructured":"Wagner, B. (2018). Ethics as an escape from regulation. From \u201cethics-washing\u201d to ethics-shopping? In Being profiling. Cogitas ergo sum. Legal and political theory in data-driven environments. Amsterdam University Press.","DOI":"10.2307\/j.ctvhrd092.18"},{"key":"9668_CR62","unstructured":"Whittaker, M., Crawford, K., Dobbe, R., Fried, G., Kazunias, E., Mathur, V., & Schwartz, O. (2018, December). AI Now Report 2018 (Annual report). New York City: AI Now Institute, New York University."},{"issue":"4","key":"9668_CR63","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1177\/0021886318781581","volume":"54","author":"S Winby","year":"2018","unstructured":"Winby, S., & Mohrman, S. A. (2018). Digital sociotechnical system design. The Journal of Applied Behavioral Science, 54(4), 399\u2013423.","journal-title":"The Journal of Applied Behavioral Science"},{"key":"9668_CR64","unstructured":"Wolters, A. (2022). Guiding the specification of sociotechnical Machine Learning systems: Addressing vulnerabilities and challenges in Machine Learning practice (Published master\u2019s thesis). Delft University of Technology."},{"key":"9668_CR65","doi-asserted-by":"crossref","unstructured":"Zejnilovi\u0107, L., Lavado, S., Soares, C., Mart\u00ednez De Rituero de Troya, I., Bell, A., & Ghani, R. (2021). Machine learning informed decision-making with interpreted model\u2019s outputs: A field intervention. In 81st Annual meeting of the academy of management 2021: Bringing the manager back in management, AoM 2021","DOI":"10.5465\/AMBPP.2021.264"},{"issue":"3","key":"9668_CR66","doi-asserted-by":"publisher","DOI":"10.1016\/j.giq.2021.101577","volume":"38","author":"A Zuiderwijk","year":"2021","unstructured":"Zuiderwijk, A., Chen, Y.-C., & Salem, F. (2021). Implications of the use of artificial intelligence in public governance: A systematic literature review and a research agenda. Government Information Quarterly, 38(3), 101577. https:\/\/doi.org\/10.1016\/j.giq.2021.101577","journal-title":"Government Information Quarterly"}],"updated-by":[{"DOI":"10.1007\/s11023-024-09687-9","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T00:00:00Z","timestamp":1721692800000}}],"container-title":["Minds and Machines"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-024-09668-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11023-024-09668-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11023-024-09668-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T06:06:02Z","timestamp":1721714762000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11023-024-09668-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,17]]},"references-count":66,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["9668"],"URL":"https:\/\/doi.org\/10.1007\/s11023-024-09668-y","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s11023-024-09687-9","asserted-by":"object"}]},"ISSN":["1572-8641"],"issn-type":[{"value":"1572-8641","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,17]]},"assertion":[{"value":"18 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 July 2024","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s11023-024-09687-9","URL":"https:\/\/doi.org\/10.1007\/s11023-024-09687-9","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This work was supported by the Gravitation Programme Hybrid Intelligence, funded by Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO) Financial interests: Anouk Wolters was employed as a research intern and received research support from Deeploy, including access to the use cases. Roel Dobbe declares to have no financial interest in the research project, and has no further relevant financial or non-financial interests to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"For all interview data used in this study, informed consent was received from the interviewees.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed Consent"}},{"value":"The research plan for the interviews performed as part of this paper study was approved by the Research Ethics board of Delft University of Technology.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Research Involving Human Participants and\/or Animals"}}],"article-number":"12"}}