{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T20:46:36Z","timestamp":1782938796921,"version":"3.54.5"},"reference-count":137,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010269","name":"The Welcome Trust","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"crossref"}]},{"name":"The Society of Swedish Engineers in Great Britain","award":["2021"],"award-info":[{"award-number":["2021"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Eng Ethics"],"published-print":{"date-parts":[[2021,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Important decisions that impact humans lives, livelihoods, and the natural environment are increasingly being automated. Delegating tasks to so-called <jats:italic>automated decision-making systems<\/jats:italic> (ADMS) can improve efficiency and enable new solutions. However, these benefits are coupled with ethical challenges. For example, ADMS may produce discriminatory outcomes, violate individual privacy, and undermine human self-determination. New governance mechanisms are thus needed that help organisations design and deploy ADMS in ways that are ethical, while enabling society to reap the full economic and social benefits of automation. In this article, we consider the feasibility and efficacy of <jats:italic>ethics-based auditing<\/jats:italic> (EBA) as a governance mechanism that allows organisations to validate claims made about their ADMS. Building on previous work, we define EBA as a structured process whereby an entity\u2019s present or past behaviour is assessed for consistency with relevant principles or norms. We then offer three contributions to the existing literature. First, we provide a theoretical explanation of how EBA can contribute to good governance by promoting procedural regularity and transparency. Second, we propose seven criteria for how to design and implement EBA procedures successfully. Third, we identify and discuss the conceptual, technical, social, economic, organisational, and institutional constraints associated with EBA. We conclude that EBA should be considered an integral component of multifaced approaches to managing the ethical risks posed by ADMS.<\/jats:p>","DOI":"10.1007\/s11948-021-00319-4","type":"journal-article","created":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T16:02:43Z","timestamp":1625587363000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":132,"title":["Ethics-Based Auditing of Automated Decision-Making Systems: Nature, Scope, and Limitations"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8691-2582","authenticated-orcid":false,"given":"Jakob","family":"M\u00f6kander","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5221-4770","authenticated-orcid":false,"given":"Jessica","family":"Morley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1181-649X","authenticated-orcid":false,"given":"Mariarosaria","family":"Taddeo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5444-2280","authenticated-orcid":false,"given":"Luciano","family":"Floridi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,7,6]]},"reference":[{"key":"319_CR1","volume-title":"Autonomous systems and the law","year":"2019","unstructured":"Aggarwal, N., Eidenm\u00fcller, H., Enriques, L., Payne, J., & Zwieten, K. (2019). Autonomous systems and the law. M\u00fcnchen: Baden-Baden."},{"key":"319_CR2","unstructured":"AI HLEG. 2019. European Commission\u2019s ethics guidelines for trustworthy artificial intelligence. https:\/\/ec.europa.eu\/futurium\/en\/ai-alliance-consultation\/guidelines\/1."},{"key":"319_CR3","doi-asserted-by":"publisher","unstructured":"AIEIG. 2020. From principles to practice\u2009\u2014\u2009An interdisciplinary framework to operationalise AI ethics. AI Ethics Impact Group, VDE Association for Electrical Electronic & Information Technologies e.V., Bertelsmann Stiftung, 1\u201356. https:\/\/doi.org\/10.11586\/2020013.","DOI":"10.11586\/2020013"},{"key":"319_CR4","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720949566","author":"E Aizenberg","year":"2020","unstructured":"Aizenberg, E., & van den Hoven, J. (2020). Designing for human rights in AI. Big Data and Society. https:\/\/doi.org\/10.1177\/2053951720949566","journal-title":"Big Data and Society"},{"key":"319_CR5","unstructured":"AlgorithmWatch. 2019. Automating society: Taking stock of automated decision-making in the EU. Bertelsmann Stiftung, 73\u201383. https:\/\/algorithmwatch.org\/wp-content\/uploads\/2019\/01\/Automating_Society_Report_2019.pdf."},{"issue":"3","key":"319_CR6","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1177\/1461444816676645","volume":"20","author":"M Ananny","year":"2018","unstructured":"Ananny, M., & Crawford, K. (2018). Seeing without knowing: limitations of the transparency ideal and its application to algorithmic accountability. New Media and Society, 20(3), 973\u2013989. https:\/\/doi.org\/10.1177\/1461444816676645","journal-title":"New Media and Society"},{"key":"319_CR8","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-018-0848-2","author":"M Arvan","year":"2018","unstructured":"Arvan, M. (2018). Mental time-travel, semantic flexibility, and A.I. ethics. AI and Society. https:\/\/doi.org\/10.1007\/s00146-018-0848-2","journal-title":"AI and Society"},{"key":"319_CR9","unstructured":"Assessment List for Trustworthy AI. 2020. Assessment list for trustworthy AI (ALTAI). https:\/\/ec.europa.eu\/digital-single-market\/en\/news\/assessment-list-trustworthy-artificial-intelligence-altai-self-assessment."},{"key":"319_CR10","unstructured":"Auer, F., & Felderer, M. (2018). Shifting quality assurance of machine learning algorithms to live systems. In M. Tichy, E. Bodden, M. Kuhrmann, S. Wagner, & J.-P. Stegh\u00f6fer (Eds.), Software Engineering und Software Management 2018 (S. 211\u2013212). Bonn: Gesellschaft f\u00fcr Informatik."},{"key":"319_CR7","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","volume":"58","author":"A Barredo Arrieta","year":"2020","unstructured":"Barredo Arrieta, A., Del Ser, J., Gil-Lopez, S., D\u00edaz-Rodr\u00edguez, N., Bennetot, A., Chatila, R., et al. (2020). Explainable explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82\u2013115. https:\/\/doi.org\/10.1016\/j.inffus.2019.12.012","journal-title":"Information Fusion"},{"key":"319_CR12","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287","author":"RKE Bellamy","year":"2019","unstructured":"Bellamy, R. K. E., Mojsilovic, A., Nagar, S., Natesan Ramamurthy, K., Richards, J., Saha, D., Sattigeri, P., et al. (2019). AI fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias. IBM Journal of Research and Development. https:\/\/doi.org\/10.1147\/JRD.2019.2942287","journal-title":"IBM Journal of Research and Development"},{"issue":"3","key":"319_CR13","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1109\/MSP.2018.2701147","volume":"16","author":"R Binns","year":"2018","unstructured":"Binns, R. (2018). What can political philosophy teach us about algorithmic fairness? IEEE Security & Privacy, 16(3), 73\u201380.","journal-title":"IEEE Security & Privacy"},{"issue":"4","key":"319_CR14","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1007\/s11023-017-9449-y","volume":"27","author":"P Boddington","year":"2017","unstructured":"Boddington, P., Millican, P., & Wooldridge, M. (2017). Minds and machines special issue: Ethics and artificial intelligence. Minds and Machines, 27(4), 569\u2013574. https:\/\/doi.org\/10.1007\/s11023-017-9449-y","journal-title":"Minds and Machines"},{"issue":"1","key":"319_CR15","doi-asserted-by":"publisher","first-page":"205395172098386","DOI":"10.1177\/2053951720983865","volume":"8","author":"S Brown","year":"2021","unstructured":"Brown, S., Davidovic, J., & Hasan, A. (2021). The algorithm audit: Scoring the algorithms that score us. Big Data & Society, 8(1), 205395172098386. https:\/\/doi.org\/10.1177\/2053951720983865","journal-title":"Big Data & Society"},{"key":"319_CR16","unstructured":"Brundage, M., Avin, S., Wang, J., Belfield, H., Krueger, G., Hadfield, G., Khlaaf, H., et al. 2020. Toward trustworthy AI development: Mechanisms for supporting verifiable claims. ArXiv, no. 2004.07213[cs.CY]. http:\/\/arxiv.org\/abs\/2004.07213."},{"issue":"5","key":"319_CR17","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1109\/MC.2017.154","volume":"50","author":"J Bryson","year":"2017","unstructured":"Bryson, J., & Winfield, A. (2017). Standardizing ethical design for artificial intelligence and autonomous systems. Computer, 50(5), 116\u201319.","journal-title":"Computer"},{"key":"319_CR18","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715622512","author":"Jenna Burrell","year":"2016","unstructured":"Burrell, Jenna. (2016). How the machine \u2018thinks\u2019: Understanding opacity in machine learning algorithms. Big Data & Society. https:\/\/doi.org\/10.1177\/2053951715622512","journal-title":"Big Data & Society"},{"key":"319_CR19","doi-asserted-by":"crossref","unstructured":"Cabrera, \u00c1. A., Epperson, W., Hohman, F., Kahng, M., Morgenstern, J., Chau, D. H. 2019. FairVis: Visual analytics for discovering intersectional bias in machine learning. http:\/\/arxiv.org\/abs\/1904.05419.","DOI":"10.1109\/VAST47406.2019.8986948"},{"key":"319_CR20","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2018.0080","author":"C Cath","year":"2018","unstructured":"Cath, C., Cowls, J., Taddeo, M., & Floridi, L. (2018). Governing artificial intelligence: Ethical, legal and technical opportunities and challenges. Philosophical Transactions of the Royal Society A Mathematical, Physical and Engineering Sciences. https:\/\/doi.org\/10.1098\/rsta.2018.0080","journal-title":"Philosophical Transactions of the Royal Society A Mathematical, Physical and Engineering Sciences"},{"key":"319_CR21","doi-asserted-by":"publisher","unstructured":"Chopra, A. K., Singh, M. P. 2018. Sociotechnical systems and ethics in the large. In AIES 2018\u2014Proceedings of the 2018 AAAI\/ACM conference on AI, ethics, and society (pp. 48\u201353). https:\/\/doi.org\/10.1145\/3278721.3278740.","DOI":"10.1145\/3278721.3278740"},{"key":"319_CR22","volume-title":"The alignment problem: Machine learning and human values","author":"B Christian","year":"2020","unstructured":"Christian, B. (2020). The alignment problem: Machine learning and human values. W.W. Norton & Company Ltd."},{"key":"319_CR23","first-page":"1","volume":"1","author":"DK Citron","year":"2014","unstructured":"Citron, D. K., & Pasquale, F. (2014). The scored society: Due process for automated predictions. HeinOnline, 1, 1\u201334.","journal-title":"HeinOnline"},{"key":"319_CR24","unstructured":"CNIL. 2019. Privacy impact assessment\u2014Methodology. Commision Nationale Informatique & Libert\u00e9s, 400."},{"issue":"4","key":"319_CR25","doi-asserted-by":"publisher","first-page":"2051","DOI":"10.1007\/s11948-019-00146-8","volume":"26","author":"M Coeckelbergh","year":"2020","unstructured":"Coeckelbergh, M. (2020). Artificial intelligence, responsibility attribution, and a relational justification of explainability. Science and Engineering Ethics, 26(4), 2051\u20132068. https:\/\/doi.org\/10.1007\/s11948-019-00146-8","journal-title":"Science and Engineering Ethics"},{"key":"319_CR26","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91575-3","volume-title":"Business ethics\u2014A philosophical and behavioral approach","author":"CA Conrad","year":"2018","unstructured":"Conrad, C. A. (2018). Business ethics\u2014A philosophical and behavioral approach. Springer. https:\/\/doi.org\/10.1007\/978-3-319-91575-3"},{"key":"319_CR27","unstructured":"Cookson, C. 2018. Artificial intelligence faces public backlash, warns scientist. Financial Times, June 9, 2018. https:\/\/www.ft.com\/content\/0b301152-b0f8-11e8-99ca-68cf89602132."},{"key":"319_CR28","unstructured":"Council of Europe. 2018. Algorithms and human rights. www.coe.int\/freedomofexpression."},{"key":"319_CR141","doi-asserted-by":"crossref","unstructured":"Cowls, J., & Floridi, L. (2018). Prolegomena to a white paper on an ethical framework for a good AI society. SSRN Electronic Journal.","DOI":"10.2139\/ssrn.3198732"},{"key":"319_CR29","doi-asserted-by":"crossref","unstructured":"Cummings, M. L. 2004. Automation bias in intelligent time critical decision support systems. In Collection of technical papers\u2014AIAA 1st intelligent systems technical conference (Vol. 2, pp. 557\u201362).","DOI":"10.2514\/6.2004-6313"},{"key":"319_CR30","doi-asserted-by":"publisher","DOI":"10.1176\/ajp.134.8.aj1348938","author":"A Dafoe","year":"2017","unstructured":"Dafoe, A. (2017). AI governance: A research agenda. American Journal of Psychiatry. https:\/\/doi.org\/10.1176\/ajp.134.8.aj1348938","journal-title":"American Journal of Psychiatry"},{"issue":"4","key":"319_CR31","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1007\/s13347-018-0337-z","volume":"31","author":"M D\u2019Agostino","year":"2018","unstructured":"D\u2019Agostino, M., & Durante, M. (2018). Introduction: The governance of algorithms. Philosophy and Technology, 31(4), 499\u2013505. https:\/\/doi.org\/10.1007\/s13347-018-0337-z","journal-title":"Philosophy and Technology"},{"key":"319_CR32","unstructured":"Dawson, D., Schleiger, E., Horton, J., McLaughlin, J., Robinson, C., Quezada, G., Scowcroft J, and Hajkowicz S. 2019. Artificial intelligence: Australia\u2019s ethics framework."},{"key":"319_CR33","unstructured":"Deloitte. 2020. Deloitte introduces trustworthy AI framework to guide organizations in ethical application of technology. Press Release. 2020. https:\/\/www2.deloitte.com\/us\/en\/pages\/about-deloitte\/articles\/press-releases\/deloitte-introduces-trustworthy-ai-framework.html."},{"issue":"3","key":"319_CR34","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1007\/s10515-014-0168-9","volume":"23","author":"LA Dennis","year":"2016","unstructured":"Dennis, L. A., Fisher, M., Lincoln, N. K., Lisitsa, A., & Veres, S. M. (2016). Practical verification of decision-making in agent-based autonomous systems. Automated Software Engineering, 23(3), 305\u2013359. https:\/\/doi.org\/10.1007\/s10515-014-0168-9","journal-title":"Automated Software Engineering"},{"issue":"3","key":"319_CR35","doi-asserted-by":"publisher","first-page":"273","DOI":"10.3390\/systems2030273","volume":"2","author":"P Di Maio","year":"2014","unstructured":"Di Maio, P. (2014). Towards a metamodel to support the joint optimization of socio technical systems. Systems, 2(3), 273\u2013296. https:\/\/doi.org\/10.3390\/systems2030273","journal-title":"Systems"},{"issue":"3","key":"319_CR36","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1080\/21670811.2014.976411","volume":"3","author":"N Diakopoulos","year":"2015","unstructured":"Diakopoulos, N. (2015). Algorithmic accountability: Journalistic investigation of computational power structures. Digital Journalism, 3(3), 398\u2013415. https:\/\/doi.org\/10.1080\/21670811.2014.976411","journal-title":"Digital Journalism"},{"key":"319_CR37","doi-asserted-by":"publisher","unstructured":"Dignum, V. 2017. Responsible autonomy. In Proceedings of the international joint conference on autonomous agents and multiagent systems, AAMAS 1: 5. https:\/\/doi.org\/10.24963\/ijcai.2017\/655.","DOI":"10.24963\/ijcai.2017\/655"},{"key":"319_CR38","unstructured":"ECP. 2018. Artificial intelligence impact assessment."},{"issue":"4","key":"319_CR39","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1177\/1088868318811759","volume":"23","author":"N Ellemers","year":"2019","unstructured":"Ellemers, N., van der Toorn, J., Paunov, Y., & van Leeuwen, T. (2019). The psychology of morality: A review and analysis of empirical studies published From 1940 Through 2017. Personality and Social Psychology Review, 23(4), 332\u2013366. https:\/\/doi.org\/10.1177\/1088868318811759","journal-title":"Personality and Social Psychology Review"},{"key":"319_CR40","doi-asserted-by":"publisher","unstructured":"Epstein, Z., Payne, B. H., Shen, J. H., Hong, C. J., Felbo, B., Dubey, A., Groh, M., Obradovich, N., Cebrian, M., Rahwan, I. 2018. Turingbox: An experimental platform for the evaluation of AI systems. In IJCAI international joint conference on artificial intelligence 2018-July (pp. 5826\u201328). https:\/\/doi.org\/10.24963\/ijcai.2018\/851.","DOI":"10.24963\/ijcai.2018\/851"},{"key":"319_CR41","doi-asserted-by":"crossref","unstructured":"Erdelyi, O. J., Goldsmith, J. 2018. Regulating artificial intelligence P. In AAAI\/ACM conference on artificial intelligence, ethics and society. http:\/\/www.aies-conference.com\/wp-content\/papers\/main\/AIES_2018_paper_13.pdf.","DOI":"10.1145\/3278721.3278731"},{"issue":"2","key":"319_CR42","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1007\/s10676-016-9400-6","volume":"18","author":"A Etzioni","year":"2016","unstructured":"Etzioni, A., & Etzioni, O. (2016). AI assisted ethics. Ethics and Information Technology, 18(2), 149\u2013156. https:\/\/doi.org\/10.1007\/s10676-016-9400-6","journal-title":"Ethics and Information Technology"},{"key":"319_CR43","unstructured":"European Commission. 2021. Proposal for regulation of the European Parliament and of the council. COM(2021) 206 final. Brussels."},{"issue":"6","key":"319_CR44","doi-asserted-by":"publisher","first-page":"3285","DOI":"10.1007\/s11948-020-00272-8","volume":"26","author":"K Evans","year":"2020","unstructured":"Evans, K., de Moura, N., Chauvier, S., Chatila, R., & Dogan, E. (2020). Ethical decision making in autonomous vehicles: The AV ethics project. Science and Engineering Ethics, 26(6), 3285\u20133312. https:\/\/doi.org\/10.1007\/s11948-020-00272-8","journal-title":"Science and Engineering Ethics"},{"key":"319_CR45","doi-asserted-by":"publisher","unstructured":"Fagerholm, F., Guinea, A. S., M\u00e4enp\u00e4\u00e4, H., M\u00fcnch, J. 2014. Building blocks for continuous experimentation. In Proceedings of the 1st international workshop on rapid continuous software engineering (pp. 26\u201335). RCoSE 2014. ACM. https:\/\/doi.org\/10.1145\/2593812.2593816.","DOI":"10.1145\/2593812.2593816"},{"issue":"2","key":"319_CR46","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1007\/BF00872018","volume":"14","author":"L Falkenberg","year":"1995","unstructured":"Falkenberg, L., & Herremans, I. (1995). Ethical behaviours in organizations: Directed by the formal or informal systems? Journal of Business Ethics, 14(2), 133\u2013143. https:\/\/doi.org\/10.1007\/BF00872018","journal-title":"Journal of Business Ethics"},{"issue":"6","key":"319_CR47","doi-asserted-by":"publisher","first-page":"3333","DOI":"10.1007\/s11948-020-00276-4","volume":"26","author":"H Felzmann","year":"2020","unstructured":"Felzmann, H., Fosch-Villaronga, E., Lutz, C., & Tam\u00f2-Larrieux, A. (2020). Towards transparency by design for artificial intelligence. Science and Engineering Ethics, 26(6), 3333\u20133361. https:\/\/doi.org\/10.1007\/s11948-020-00276-4","journal-title":"Science and Engineering Ethics"},{"issue":"3","key":"319_CR133","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1007\/s11948-012-9413-4","volume":"19","author":"L Floridi","year":"2013","unstructured":"Floridi, L. (2013). Distributed morality in an information society. Science and Engineering Ethics, 19(3), 727\u2013743. https:\/\/doi.org\/10.1007\/s11948-012-9413-4.","journal-title":"Science and Engineering Ethics"},{"key":"319_CR132","doi-asserted-by":"publisher","unstructured":"Floridi, L. (2016a). Faultless responsibility: On the nature and allocation of moral responsibility for distributed moral actions. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 374(2083). https:\/\/doi.org\/10.1098\/rsta.2016.0112.","DOI":"10.1098\/rsta.2016.0112"},{"issue":"6","key":"319_CR140","doi-asserted-by":"publisher","first-page":"1669","DOI":"10.1007\/s11948-015-9733-2","volume":"22","author":"L Floridi","year":"2016","unstructured":"Floridi, L. (2016b). Tolerant paternalism: Pro-ethical design as a resolution of the dilemma of toleration. Science and Engineering Ethics, 22(6), 1669\u20131688. https:\/\/doi.org\/10.1007\/s11948-015-9733-2.","journal-title":"Science and Engineering Ethics"},{"issue":"4","key":"319_CR130","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/s13347-017-0291-1","volume":"30","author":"L Floridi","year":"2017","unstructured":"Floridi, L. (2017a). Infraethics\u2013On the conditions of possibility of morality. Philosophy and Technology, 30(4), 391\u2013394. https:\/\/doi.org\/10.1007\/s13347-017-0291-1.","journal-title":"Philosophy and Technology"},{"issue":"3","key":"319_CR143","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1007\/s11023-017-9438-1","volume":"27","author":"L Floridi","year":"2017","unstructured":"Floridi, L. (2017b). The logic of design as a conceptual logic of information. Minds and Machines, 27(3), 495\u2013519. https:\/\/doi.org\/10.1007\/s11023-017-9438-1.","journal-title":"Minds and Machines"},{"key":"319_CR129","doi-asserted-by":"publisher","unstructured":"Floridi, L. (2018). Soft ethics and the governance of the digital. Philosophy and Technology, 31(1). https:\/\/doi.org\/10.1007\/s13347-018-0303-9.","DOI":"10.1007\/s13347-018-0303-9"},{"issue":"2","key":"319_CR124","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1007\/s13347-019-00354-x","volume":"32","author":"L Floridi","year":"2019","unstructured":"Floridi, L. (2019). Translating principles into practices of digital ethics: Five risks of being unethical. Philosophy and Technology, 32(2), 185\u2013193. https:\/\/doi.org\/10.1007\/s13347-019-00354-x.","journal-title":"Philosophy and Technology"},{"key":"319_CR123","doi-asserted-by":"publisher","unstructured":"Floridi, L., & Cowls, J. (2019). A unified framework of five principles for AI in society. Harvard Data Science Review, (1), 1\u201313. https:\/\/doi.org\/10.1162\/99608f92.8cd550d1.","DOI":"10.1162\/99608f92.8cd550d1"},{"issue":"4","key":"319_CR126","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1007\/s11023-018-9482-5","volume":"28","author":"L Floridi","year":"2018","unstructured":"Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C. et al. (2018). AI4People\u2014An ethical framework for a good AI society: Opportunities, risks, principles, and recommendations. Minds and Machines, 28(4), 689\u2013707. https:\/\/doi.org\/10.1007\/s11023-018-9482-5.","journal-title":"Minds and Machines"},{"key":"319_CR48","unstructured":"ForHumanity. 2021. Independent audit of AI systems. 2021. https:\/\/forhumanity.center\/independent-audit-of-ai-systems."},{"key":"319_CR49","unstructured":"Friedler, S. A., Scheidegger, C., Venkatasubramanian, Suresh. 2016. On the (im)possibility of fairness, no. im: 1\u201316. http:\/\/arxiv.org\/abs\/1609.07236."},{"issue":"3","key":"319_CR50","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1007\/s11023-020-09539-2","volume":"30","author":"I Gabriel","year":"2020","unstructured":"Gabriel, I. (2020). Artificial intelligence, values, and alignment. Minds and Machines, 30(3), 411\u2013437. https:\/\/doi.org\/10.1007\/s11023-020-09539-2","journal-title":"Minds and Machines"},{"key":"319_CR51","unstructured":"Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daum\u00e9, Hal., Crawford, K. 2018. Datasheets for datasets. http:\/\/arxiv.org\/abs\/1803.09010."},{"key":"319_CR52","unstructured":"Goodman, B. 2016. A step towards accountable algorithms?\u202f: Algorithmic discrimination and the European Union general data protection. In:29th conference on neural information processing systems (NIPS 2016), Barcelona, Spain., no. Nips (pp. 1\u20137)."},{"key":"319_CR53","unstructured":"Google. 2020. What-If-Tool. Partnership on AI. 2020. https:\/\/pair-code.github.io\/what-if-tool\/index.html."},{"key":"319_CR54","unstructured":"Gov. of Canada. 2019. Algorithmic impact assessment (AIA). Responsible use of artificial intelligence (AI). 2019. https:\/\/www.canada.ca\/en\/government\/system\/digital-government\/modern-emerging-technologies\/responsible-use-ai\/algorithmic-impact-assessment.html."},{"issue":"3","key":"319_CR55","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1136\/medethics-2019-105586","volume":"46","author":"T Grote","year":"2020","unstructured":"Grote, T., & Berens, P. (2020). On the ethics of algorithmic decision-making in healthcare. Journal of Medical Ethics, 46(3), 205\u2013211. https:\/\/doi.org\/10.1136\/medethics-2019-105586","journal-title":"Journal of Medical Ethics"},{"key":"319_CR56","doi-asserted-by":"publisher","unstructured":"Hagendorff, T. 2020. The ethics of AI ethics: An evaluation of guidelines. Minds and Machines, no. January. https:\/\/doi.org\/10.1007\/s11023-020-09517-8.","DOI":"10.1007\/s11023-020-09517-8"},{"key":"319_CR57","unstructured":"IAF. 2019. Ethical data impact assessments and oversight models. Information Accountability Foundation, no. January. https:\/\/www.immd.gov.hk\/pdf\/PCAReport.pdf."},{"key":"319_CR58","doi-asserted-by":"publisher","unstructured":"ICO. 2018. Guide to the general data protection regulation (GDPR). Guide to the general data protection regulation, n\/a. https:\/\/doi.org\/10.1111\/j.1751-1097.1994.tb09662.x.","DOI":"10.1111\/j.1751-1097.1994.tb09662.x"},{"key":"319_CR59","unstructured":"ICO. 2020. Guidance on the AI auditing framework: Draft guidance for consultation. Information Commissioner\u2019s Office. https:\/\/ico.org.uk\/media\/about-the-ico\/consultations\/2617219\/guidance-on-the-ai-auditing-framework-draft-for-consultation.pdf."},{"key":"319_CR60","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1007\/978-3-030-12524-0_2","volume":"95","author":"IEEE","year":"2019","unstructured":"IEEE. (2019). Ethically aligned design. Intelligent Systems, Control and Automation: Science and Engineering, 95, 11\u201316. https:\/\/doi.org\/10.1007\/978-3-030-12524-0_2","journal-title":"Intelligent Systems, Control and Automation: Science and Engineering"},{"key":"319_CR61","unstructured":"IIA. 2017. The institute of internal auditors\u2019s artificial intelligence auditing framework: Practical applications Part A. Global Perspectives and Insights. www.theiia.org\/gpi."},{"key":"319_CR62","doi-asserted-by":"crossref","unstructured":"Jobin, A., Ienca, M., Vayena, E. 2019. Artificial intelligence: The global landscape of ethics guidelines.","DOI":"10.1038\/s42256-019-0088-2"},{"issue":"5","key":"319_CR63","doi-asserted-by":"publisher","first-page":"2455","DOI":"10.1007\/s11948-020-00241-1","volume":"26","author":"F Jotterand","year":"2020","unstructured":"Jotterand, F., & Bosco, C. (2020). Keeping the \u2018human in the loop\u2019 in the age of artificial intelligence: Accompanying commentary for \u2018correcting the brain?\u2019 By Rainey and Erden. Science and Engineering Ethics, 26(5), 2455\u20132460. https:\/\/doi.org\/10.1007\/s11948-020-00241-1","journal-title":"Science and Engineering Ethics"},{"issue":"2","key":"319_CR64","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1080\/13600869.2017.1298499","volume":"31","author":"AP Karanasiou","year":"2017","unstructured":"Karanasiou, A. P., & Pinotsis, D. A. (2017). A Study into the layers of automated decision-making: emergent normative and legal aspects of deep learning. International Review of Law, Computers & Technology, 31(2), 170\u2013187. https:\/\/doi.org\/10.1080\/13600869.2017.1298499","journal-title":"International Review of Law, Computers & Technology"},{"key":"319_CR128","doi-asserted-by":"publisher","unstructured":"Kazim, E., Denny, D. M. T., & Koshiyama, A. (2021). AI auditing and impact assessment: According to the UK information commissioner\u2019s office. AI and Ethics, no. 0123456789. https:\/\/doi.org\/10.1007\/s43681-021-00039-2.","DOI":"10.1007\/s43681-021-00039-2"},{"key":"319_CR65","doi-asserted-by":"publisher","unstructured":"Keyes, O., Hutson, J., Durbin, M. 2019. A mulching proposal no. May 2019 (pp. 1\u201311). https:\/\/doi.org\/10.1145\/3290607.3310433.","DOI":"10.1145\/3290607.3310433"},{"key":"319_CR66","unstructured":"Kim, P. 2017. Auditing algorithms for discrimination. University of Pennsylvania Law Review, 166, 189\u2013203."},{"key":"319_CR67","doi-asserted-by":"publisher","unstructured":"Kleinberg, J., Mullainathan, S., Raghavan, M. 2017. Inherent trade-offs in the fair determination of risk scores. In Leibniz International Proceedings in Informatics, LIPIcs 67 (pp 1\u201323). https:\/\/doi.org\/10.4230\/LIPIcs.ITCS.2017.43.","DOI":"10.4230\/LIPIcs.ITCS.2017.43"},{"key":"319_CR68","doi-asserted-by":"publisher","unstructured":"Koene, A., Clifton, C., Hatada, Y., Webb, H., Richardson, R. 2019. A governance framework for algorithmic accountability and transparency. https:\/\/doi.org\/10.2861\/59990.","DOI":"10.2861\/59990"},{"issue":"1","key":"319_CR69","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1109\/MSP.2017.16","volume":"15","author":"M Kolhar","year":"2017","unstructured":"Kolhar, M., Abu-Alhaj, M. M., & El-Atty, S. M. A. (2017). Cloud data auditing techniques with a focus on privacy and security. IEEE Security and Privacy, 15(1), 42\u201351. https:\/\/doi.org\/10.1109\/MSP.2017.16","journal-title":"IEEE Security and Privacy"},{"key":"319_CR70","unstructured":"Koshiyama, A. 2019. Algorithmic impact assessment: Fairness, robustness and explainability in automated decision-making."},{"key":"319_CR71","doi-asserted-by":"publisher","DOI":"10.1111\/rego.12369","author":"TD Krafft","year":"2020","unstructured":"Krafft, T. D., Zweig, K. A., & K\u00f6nig, P. D. (2020). How to regulate algorithmic decision-making: A framework of regulatory requirements for different applications. Regulation and Governance. https:\/\/doi.org\/10.1111\/rego.12369","journal-title":"Regulation and Governance"},{"key":"319_CR72","doi-asserted-by":"crossref","unstructured":"Kroll, J. A. (2018). The fallacy of inscrutability. Philosophical Transactions. Mathematical, Physical and Engineering Sciences, 376(2133).","DOI":"10.1098\/rsta.2018.0084"},{"key":"319_CR73","doi-asserted-by":"publisher","unstructured":"Kroll, J. A., Huey, J., Barocas, S., Felten, E. W., Reidenberg, J. R., Robinson, D. G., Yu, H. 2016. Accountable algorithms. University of Pennsylvania Law Review, no. 633: 66. https:\/\/doi.org\/10.1002\/ejoc.201200111.","DOI":"10.1002\/ejoc.201200111"},{"key":"319_CR74","unstructured":"Kusner, M., Loftus, J., Russell, C., Silva, R. 2017. Counterfactual fairness. In Advances in neural information processing systems December (pp. 4067\u201377)."},{"key":"319_CR75","unstructured":"LaBrie, R. C., Steinke, G. H. 2019. Towards a framework for ethical audits of AI algorithms. In 25th americas conference on information systems, AMCIS 2019 (pp 1\u20135)."},{"key":"319_CR76","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s43681-020-00013-4","volume":"0123456789","author":"D Lauer","year":"2020","unstructured":"Lauer, D. (2020). You cannot have AI ethics without ethics. AI and Ethics, 0123456789, 1\u20135. https:\/\/doi.org\/10.1007\/s43681-020-00013-4","journal-title":"AI and Ethics"},{"issue":"2","key":"319_CR78","first-page":"1","volume":"34","author":"M Lee","year":"2020","unstructured":"Lee, M., Floridi, L., & Denev, A. (2020). Innovating with confidence: Embedding governance and fairness in a financial services risk management framework. Berkeley Technology Law Journal, 34(2), 1\u201319.","journal-title":"Berkeley Technology Law Journal"},{"issue":"4","key":"319_CR79","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1007\/s13347-017-0279-x","volume":"31","author":"B Lepri","year":"2018","unstructured":"Lepri, B., Oliver, N., Letouz\u00e9, E., Pentland, A., & Vinck, P. (2018). Fair, transparent, and accountable algorithmic decision-making processes: The premise, the proposed solutions, and the open challenges. Philosophy and Technology, 31(4), 611\u2013627. https:\/\/doi.org\/10.1007\/s13347-017-0279-x","journal-title":"Philosophy and Technology"},{"key":"319_CR80","unstructured":"Leslie, D. (2019). Understanding artificial intelligence ethics and safety. The Alan Turing Institute (June, 2019)."},{"key":"319_CR81","volume-title":"Engineering a safer world : Systems thinking applied to safety. Engineering systems","author":"Nancy Leveson","year":"2011","unstructured":"Leveson, Nancy. (2011). Engineering a safer world\u202f: Systems thinking applied to safety. Engineering systems. MIT Press."},{"issue":"1","key":"319_CR82","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3317287.3328534","volume":"17","author":"ZC Lipton","year":"2019","unstructured":"Lipton, Z. C., & Steinhardt, J. (2019). Troubling trends in machine-learning scholarship. Queue, 17(1), 1\u201315. https:\/\/doi.org\/10.1145\/3317287.3328534","journal-title":"Queue"},{"key":"319_CR83","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-020-09564-w","author":"M Loi","year":"2020","unstructured":"Loi, M., Ferrario, A., & Vigan\u00f2, E. (2020). Transparency as design publicity: Explaining and justifying inscrutable algorithms. Ethics and Information Technology. https:\/\/doi.org\/10.1007\/s10676-020-09564-w","journal-title":"Ethics and Information Technology"},{"issue":"1","key":"319_CR142","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.acra.2019.09.009","volume":"27","author":"V Mahajan","year":"2020","unstructured":"Mahajan, V., Venugopal, V. K., Murugavel, M., & Mahajan, H. (2020). The algorithmic audit: Working with vendors to validate radiology-AI algorithms\u2014How we do it. Academic Radiology, 27(1), 132\u2013135. https:\/\/doi.org\/10.1016\/j.acra.2019.09.009.","journal-title":"Academic Radiology"},{"key":"319_CR84","volume-title":"The metric society: On the quantification of the social","author":"S Mau","year":"2019","unstructured":"Mau, S., & Howe, S. (2019). The metric society: On the quantification of the social. Ebook Central."},{"key":"319_CR85","unstructured":"Microsoft. 2020. Fairlearn: A toolkit for assessing and improving fairness in AI (pp. 1\u20136)."},{"key":"319_CR86","doi-asserted-by":"publisher","unstructured":"Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., Gebru, T. 2019. Model cards for model reporting. In FAT* 2019\u2014Proceedings of the 2019 Conference on fairness, accountability, and transparency, no. Figure 2 (pp. 220\u201329). https:\/\/doi.org\/10.1145\/3287560.3287596.","DOI":"10.1145\/3287560.3287596"},{"issue":"June","key":"319_CR87","first-page":"4991","volume":"10","author":"B Mittelstadt","year":"2016","unstructured":"Mittelstadt, B. (2016). Auditing for transparency in content personalization systems. International Journal of Communication, 10(June), 4991\u20135002.","journal-title":"International Journal of Communication"},{"key":"319_CR88","doi-asserted-by":"publisher","unstructured":"M\u00f6kander, J., & Floridi, L. (2021). Ethics\u2014Based auditing to develop trustworthy AI. Minds and Machines, no. 0123456789, 2\u20136. https:\/\/doi.org\/10.1007\/s11023-021-09557-8.","DOI":"10.1007\/s11023-021-09557-8"},{"issue":"4","key":"319_CR125","doi-asserted-by":"publisher","first-page":"2141","DOI":"10.1007\/s11948-019-00165-5","volume":"26","author":"J Morley","year":"2020","unstructured":"Morley, J., Floridi, L., Kinsey, L., & Elhalal, A. (2020). From what to how: An initial review of publicly available AI ethics tools, methods and research to translate principles into practices. Science and Engineering Ethics, 26(4), 2141. https:\/\/doi.org\/10.1007\/s11948-019-00165-5.","journal-title":"Science and Engineering Ethics"},{"key":"319_CR89","unstructured":"OECD. 2019. Recommendation of the council on artificial intelligence. OECD\/LEGAL\/0449."},{"key":"319_CR90","unstructured":"ORCAA. 2020. It\u2019s the age of the algorithm and we have arrived unprepared. https:\/\/orcaarisk.com\/."},{"key":"319_CR91","unstructured":"Oxborough, C., Cameron, E., Rao, A., Birchall, A., Townsend, A., Westermann, Christian. 2018. Explainable AI. https:\/\/www.pwc.co.uk\/audit-assurance\/assets\/explainable-ai.pdf."},{"key":"319_CR92","unstructured":"PDPC. 2020. Model artificial intelligence governance framework second edition. Personal data protection commission of Singapore."},{"key":"319_CR93","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780198296034.001.0001","volume-title":"The audit society [electronic resource] : Rituals of verification","author":"M Power","year":"1999","unstructured":"Power, M. (1999). The audit society [electronic resource]\u202f: Rituals of verification. Oxford University Press. Oxford Scholarship Online."},{"key":"319_CR94","unstructured":"PwC. 2019. A practical guide to responsible artificial intelligence (AI). https:\/\/www.pwc.com\/gx\/en\/issues\/data-and-analytics\/artificial-intelligence\/what-is-responsible-ai\/responsible-ai-practical-guide.pdf."},{"issue":"1","key":"319_CR95","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s10676-017-9430-8","volume":"20","author":"I Rahwan","year":"2018","unstructured":"Rahwan, I. (2018). Society-in-the-loop: Programming the algorithmic social contract. Ethics and Information Technology, 20(1), 5\u201314. https:\/\/doi.org\/10.1007\/s10676-017-9430-8","journal-title":"Ethics and Information Technology"},{"key":"319_CR96","doi-asserted-by":"publisher","unstructured":"Raji, I. D., & Buolamwini, J. (2019). Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products. In AIES 2019\u2014Proceedings of the 2019 AAAI\/ACM conference on AI, ethics, and society (pp. 429\u2013435). https:\/\/doi.org\/10.1145\/3306618.3314244.","DOI":"10.1145\/3306618.3314244"},{"key":"319_CR97","doi-asserted-by":"publisher","unstructured":"Raji, I. D., Smart, A., White R. N., Mitchell, M., Gebru, T., Hutchinson, B., Smith-Loud, J., Theron, D., Barnes, P. 2020. \u201closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing. In FAT* 2020\u2014Proceedings of the 2020 conference on fairness, accountability, and transparency (pp. 33\u201344). https:\/\/doi.org\/10.1145\/3351095.3372873.","DOI":"10.1145\/3351095.3372873"},{"key":"319_CR98","unstructured":"Responsible AI Licenses. 2021. AI licenses. https:\/\/www.licenses.ai\/about."},{"key":"319_CR99","unstructured":"Saleiro, P., Kuester, B., Hinkson, L., London, J., Stevens, A., Anisfeld, A., Rodolfa, K. T., Ghani, R. 2018. Aequitas: A bias and fairness audit toolkit, no. 2018. http:\/\/arxiv.org\/abs\/1811.05577."},{"key":"319_CR100","doi-asserted-by":"publisher","unstructured":"S\u00e1nchez-Monedero, J., Dencik, L., Edwards, L. 2020. What does it mean to \u2018solve\u2019 the problem of discrimination in hiring? Social, technical and legal perspectives from the UK on automated hiring systems. In Proceedings of the 2020 conference on fairness, accountability, and transparency (pp 458\u201368). https:\/\/doi.org\/10.1145\/3351095.3372849.","DOI":"10.1145\/3351095.3372849"},{"key":"319_CR101","doi-asserted-by":"publisher","unstructured":"Sandvig, C., Hamilton, K., Karahalios, K., Langbort, C. 2014. Auditing algorithms. In ICA 2014 data and discrimination preconference. (pp. 1\u201323). https:\/\/doi.org\/10.1109\/DEXA.2009.55.","DOI":"10.1109\/DEXA.2009.55"},{"issue":"2","key":"319_CR137","first-page":"353","volume":"29","author":"M Scherer","year":"2016","unstructured":"Scherer, M. (2016). Regulating artificial intelligence systems: Risks, challenges, competencies, and strategies. Harvard Journal of Law & Technology, 29(2), 353.","journal-title":"Harvard Journal of Law & Technology"},{"key":"319_CR102","unstructured":"Schulam, P., Saria, S. 2019. Can you trust this prediction? Auditing pointwise reliability after learning 89. http:\/\/arxiv.org\/abs\/1901.00403."},{"key":"319_CR103","doi-asserted-by":"crossref","unstructured":"Sharma, S, Henderson, J, Ghosh, J. 2019. CERTIFAI: Counterfactual explanations for robustness, transparency, interpretability, and fairness of artificial intelligence models. http:\/\/arxiv.org\/abs\/1905.07857.","DOI":"10.1145\/3375627.3375812"},{"key":"319_CR104","unstructured":"Smart Dubai. 2019. AI ethics principles & guidelines. Smart Dubai Office."},{"key":"319_CR105","unstructured":"Springer, A., Whittaker, S. 2019. Making transparency clear."},{"key":"319_CR106","doi-asserted-by":"publisher","unstructured":"Stegh\u00f6fer, J. P., Knauss, E., Horkoff, J., Wohlrab, R. 2019. Challenges of scaled agile for safety-critical systems. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) 11915 LNCS (pp. 350\u201366). https:\/\/doi.org\/10.1007\/978-3-030-35333-9_26.","DOI":"10.1007\/978-3-030-35333-9_26"},{"issue":"2","key":"319_CR107","doi-asserted-by":"publisher","first-page":"851","DOI":"10.1007\/s11948-019-00133-z","volume":"26","author":"B Strenge","year":"2020","unstructured":"Strenge, B., & Schack, T. (2020). AWOSE\u2014A process model for incorporating ethical analyses in agile systems engineering. Science and Engineering Ethics, 26(2), 851\u2013870. https:\/\/doi.org\/10.1007\/s11948-019-00133-z","journal-title":"Science and Engineering Ethics"},{"key":"319_CR108","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198713395.001.0001","volume-title":"The future of the professions: How technology will transform the work of human experts","author":"R Susskind","year":"2015","unstructured":"Susskind, R., & Susskind, D. (2015). The future of the professions: How technology will transform the work of human experts. Oxford University Press."},{"key":"319_CR131","doi-asserted-by":"publisher","unstructured":"Taddeo, M. (2016). Data philanthropy and the design of the infraethics for information societies. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 374(2083). https:\/\/doi.org\/10.1098\/rsta.2016.0113.","DOI":"10.1098\/rsta.2016.0113"},{"issue":"6404","key":"319_CR121","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1126\/science.aat5991","volume":"361","author":"M Taddeo","year":"2018","unstructured":"Taddeo, M., & Floridi, L. (2018). How AI can be a force for good. Science, 361(6404), 751\u2013752. https:\/\/doi.org\/10.1126\/science.aat5991.","journal-title":"Science"},{"issue":"1","key":"319_CR109","doi-asserted-by":"publisher","first-page":"61","DOI":"10.2139\/ssrn.3172840","volume":"7","author":"J Tasioulas","year":"2018","unstructured":"Tasioulas, J. (2018). First steps towards an ethics of robots and artificial intelligence. SSRN Electronic Journal, 7(1), 61\u201395. https:\/\/doi.org\/10.2139\/ssrn.3172840","journal-title":"SSRN Electronic Journal"},{"key":"319_CR110","volume-title":"Nudge: Improving decisions about health, wealth, and happiness","author":"R Thaler","year":"2008","unstructured":"Thaler, R., & Sunstein, C. (2008). Nudge: Improving decisions about health, wealth, and happiness. New Haven, Conn.: Yale University Press."},{"key":"319_CR122","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3662302","author":"A Tsamados","year":"2020","unstructured":"Tsamados, A., Aggarwal, N., Cowls, J., Morley, J., Roberts, H., Taddeo, M., et al. (2020). The ethics of algorithms: Key problems and solutions. SSRN Electronic Journal. https:\/\/doi.org\/10.2139\/ssrn.3662302.","journal-title":"SSRN Electronic Journal"},{"issue":"3","key":"319_CR77","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1108\/JICES-06-2018-0056","volume":"16","author":"N Turner Lee","year":"2018","unstructured":"Turner Lee, N. (2018). Detecting racial bias in algorithms and machine learning. Journal of Information, Communication and Ethics in Society, 16(3), 252\u2013260. https:\/\/doi.org\/10.1108\/JICES-06-2018-0056","journal-title":"Journal of Information, Communication and Ethics in Society"},{"key":"319_CR111","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2747994","author":"A Tutt","year":"2017","unstructured":"Tutt, A. (2017). An FDA for algorithms. SSRN Electronic Journal. https:\/\/doi.org\/10.2139\/ssrn.2747994","journal-title":"SSRN Electronic Journal"},{"key":"319_CR11","unstructured":"Ulrich, B., Bauberger, S., Damm, T., Engels, R., Rehbein, M. 2018. Policy paper on the asilomar principles on artificial intelligence."},{"key":"319_CR112","unstructured":"Vakkuri, V., Kemell, K. K., Kultanen, J., Siponen, M., Abrahamsson, P. 2019. Ethically aligned design of autonomous systems: Industry viewpoint and an empirical study. ArXiv."},{"issue":"3","key":"319_CR113","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/s11023-020-09537-4","volume":"30","author":"I van de Poel","year":"2020","unstructured":"van de Poel, I. (2020). Embedding values in artificial intelligence (AI) systems. Minds and Machines, 30(3), 385\u2013409. https:\/\/doi.org\/10.1007\/s11023-020-09537-4","journal-title":"Minds and Machines"},{"key":"319_CR114","doi-asserted-by":"crossref","unstructured":"Wachter, S., Mittelstadt, B., Russell, C. 2017. Counterfactual explanations without opening the black box: Automated decisions and the GDPR.","DOI":"10.2139\/ssrn.3063289"},{"key":"319_CR115","unstructured":"WEF. 2020. White paper a framework for responsible limits on facial recognition. World Economic Forum, no. February."},{"issue":"4","key":"319_CR116","doi-asserted-by":"publisher","first-page":"39","DOI":"10.2307\/248959","volume":"4","author":"IR Weiss","year":"1980","unstructured":"Weiss, I. R. (1980). Auditability of software: A survey of techniques and costs. MIS Quarterly: Management Information Systems, 4(4), 39\u201350. https:\/\/doi.org\/10.2307\/248959","journal-title":"MIS Quarterly: Management Information Systems"},{"key":"319_CR117","doi-asserted-by":"publisher","unstructured":"Whittlestone, J., Alexandrova, A., Nyrup, R., Cave, S. 2019. The role and limits of principles in AI ethics: Towards a focus on tensions. In AIES 2019\u2014Proceedings of the 2019 AAAI\/ACM conference on AI, ethics, and society (pp. 195\u2013200). https:\/\/doi.org\/10.1145\/3306618.3314289.","DOI":"10.1145\/3306618.3314289"},{"key":"319_CR118","unstructured":"Whittlestone, J., Nyrup, R., Alexandrova, A., Dihal, K. 2019. Ethical and societal implications of algorithms, data, and artificial intelligence: A roadmap for research. http:\/\/www.nuffieldfoundation.org\/sites\/default\/files\/files\/Ethical-and-Societal-Implications-of-Data-and-AI-report-Nuffield-Foundat.pdf."},{"key":"319_CR119","volume-title":"The human use of human beings: cybernetics and society","author":"N Wiener","year":"1988","unstructured":"Wiener, N. (1988). The human use of human beings: Cybernetics and society. Da Capo Series in Science."},{"issue":"1","key":"319_CR120","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1177\/0162243915605575","volume":"41","author":"T Zarsky","year":"2016","unstructured":"Zarsky, T. (2016). The trouble with algorithmic decisions: An analytic road map to examine efficiency and fairness in automated and opaque decision making. Science Technology and Human Values, 41(1), 118\u2013132. https:\/\/doi.org\/10.1177\/0162243915605575","journal-title":"Science Technology and Human Values"}],"container-title":["Science and Engineering Ethics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11948-021-00319-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11948-021-00319-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11948-021-00319-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,20]],"date-time":"2021-08-20T10:34:07Z","timestamp":1629455647000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11948-021-00319-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,6]]},"references-count":137,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8]]}},"alternative-id":["319"],"URL":"https:\/\/doi.org\/10.1007\/s11948-021-00319-4","relation":{},"ISSN":["1353-3452","1471-5546"],"issn-type":[{"value":"1353-3452","type":"print"},{"value":"1471-5546","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,6]]},"assertion":[{"value":"18 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"We hereby declare that this article is our original work and has not been submitted to any other journal for publication. Further, we have acknowledged all sources used and cited these in the reference section.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"No conflicts of interest to report.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"44"}}