{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T23:07:52Z","timestamp":1780960072029,"version":"3.54.1"},"reference-count":48,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T00:00:00Z","timestamp":1660780800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T00:00:00Z","timestamp":1660780800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001858","name":"VINNOVA","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009244","name":"Stockholm University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100009244","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["DISO"],"published-print":{"date-parts":[[2022,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The AI landscape demands a broad set of legal, ethical, and societal considerations to be accounted for in order to develop ethical AI (eAI) solutions which sustain human values and rights. Currently, a variety of guidelines and a handful of niche tools exist to account for and tackle individual challenges. However, it is also well established that many organizations face practical challenges in navigating these considerations from a risk management perspective within AI governance. Therefore, new methodologies are needed to provide a well-vetted and real-world applicable structure and path through the checks and balances needed for ethically assessing and guiding the development of AI. In this paper, we show that a multidisciplinary research approach, spanning cross-sectional viewpoints, is the foundation of a pragmatic definition of ethical and societal risks faced by organizations using AI. Equally important are the findings of cross-structural governance for implementing eAI successfully. Based on evidence acquired from our multidisciplinary research investigation, we propose a novel data-driven risk assessment methodology, entitled DRESS-eAI. In addition, through the evaluation of our methodological implementation, we demonstrate its state-of-the-art relevance as a tool for sustaining human values in the data-driven AI era.<\/jats:p>","DOI":"10.1007\/s44206-022-00016-0","type":"journal-article","created":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T04:03:33Z","timestamp":1660795413000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Achieving a Data-Driven Risk Assessment Methodology for Ethical AI"],"prefix":"10.1007","volume":"1","author":[{"given":"Anna","family":"Fell\u00e4nder","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8509-5376","authenticated-orcid":false,"given":"Jonathan","family":"Rebane","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Larsson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mattias","family":"Wiggberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fredrik","family":"Heintz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,18]]},"reference":[{"key":"16_CR1","unstructured":"Analytica, O. (2018). Us fatality could slow down self-driving car testing. Emerald Expert Briefings."},{"key":"16_CR2","doi-asserted-by":"publisher","unstructured":"Bellamy, R., Dey, K., Hind, M., Hoffman, S., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., Nagar, S., Ramamurthy, K., Richards, J., Saha, D., Sattigeri, P., Singh, M., Varshney, K., & Zhang, Y. (2019). Ai fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias. IBM Journal of Research and Development, 1. https:\/\/doi.org\/10.1147\/JRD.2019.2942287","DOI":"10.1147\/JRD.2019.2942287"},{"key":"16_CR3","doi-asserted-by":"publisher","unstructured":"Brendel, A., Mirbabaie, M., Lembcke, T.-B., & Hofeditz, L. (2021). Ethical management of artificial intelligence. Sustainability, 13,. https:\/\/doi.org\/10.3390\/su13041974","DOI":"10.3390\/su13041974"},{"key":"16_CR4","doi-asserted-by":"publisher","unstructured":"Brown, S., Davidovic, J., & Hasan, A. (2021). The algorithm audit: Scoring the algorithms that score us. Big Data & Society. https:\/\/doi.org\/10.1177\/2053951720983865","DOI":"10.1177\/2053951720983865"},{"key":"16_CR5","unstructured":"Brundage, M., Avin, S., Clark, J., Toner, H., Eckersley, P., Garfinkel, B., Dafoe, A., Scharre, P., Zeitzoff, T., Filar, B. et\u00a0al. (2018). The malicious use of artificial intelligence: Forecasting, prevention, and mitigation arXiv preprint. https:\/\/doi.org\/10.48550\/arXiv.1802.07228"},{"key":"16_CR6","unstructured":"Buolamwini, J., & Gebru, T. (2018). Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency (pp. 77\u201391). PMLR."},{"key":"16_CR7","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1007\/s00146-021-01308-8","volume":"63","author":"C Canca","year":"2020","unstructured":"Canca, C. (2020). Operationalizing ai ethics principles. Communications of the ACM, 63, 18\u201321. https:\/\/doi.org\/10.1007\/s00146-021-01308-8","journal-title":"Communications of the ACM"},{"key":"16_CR8","doi-asserted-by":"publisher","unstructured":"Cath, C. (2018). Governing artificial intelligence: ethical, legal and technical opportunities and challenges. https:\/\/doi.org\/10.1098\/rsta.2018.0080","DOI":"10.1098\/rsta.2018.0080"},{"key":"16_CR9","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/j.clsr.2019.04.006","volume":"35","author":"R Clarke","year":"2019","unstructured":"Clarke, R. (2019). Why the world wants controls over artificial intelligence. Computer Law and Security Review, 35, 423\u2013433. https:\/\/doi.org\/10.1016\/j.clsr.2019.04.006","journal-title":"Computer Law and Security Review"},{"key":"16_CR10","unstructured":"Commission, E. (2021). Proposal for a regulation of the european parliament and the council laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts. EUR-Lex-52021PC0206."},{"key":"16_CR11","doi-asserted-by":"publisher","unstructured":"Costanza-Chock, S., Raji, I.\u00a0D., & Buolamwini, J. (2022). Who audits the auditors? recommendations from a field scan of the algorithmic auditing ecosystem. In 2022 ACM Conference on Fairness, Accountability, and Transparency FAccT \u201922 (p. 1571\u20131583). New York, NY, USA: Association for Computing Machinery. https:\/\/doi.org\/10.1145\/3531146.3533213","DOI":"10.1145\/3531146.3533213"},{"key":"16_CR12","doi-asserted-by":"publisher","unstructured":"d\u2019Aquin, M., Troullinou, P., O\u2019Connor, N.\u00a0E., Cullen, A., Faller, G., & Holden, L. (2018). Towards an \u201cethics by design\u201d methodology for ai research projects. In Proceedings of the 2018 AAAI\/ACM Conference on AI, Ethics, and Society (pp. 54\u201359). https:\/\/doi.org\/10.1145\/3278721.3278765","DOI":"10.1145\/3278721.3278765"},{"key":"16_CR13","doi-asserted-by":"publisher","unstructured":"Desouza, K., Dawson, G., & Chenok, D. (2019). Designing, developing, and deploying artificial intelligence systems: Lessons from and for the public sector. Business Horizons, 63. https:\/\/doi.org\/10.1016\/j.bushor.2019.11.004","DOI":"10.1016\/j.bushor.2019.11.004"},{"key":"16_CR14","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1145\/3375637.3375644","volume":"5","author":"V Dignum","year":"2020","unstructured":"Dignum, V. (2020). Ai is multidisciplinary. AI Matters, 5, 18\u201321. https:\/\/doi.org\/10.1145\/3375637.3375644","journal-title":"Ai is multidisciplinary. AI Matters"},{"key":"16_CR15","unstructured":"Ezeani, G., Koene, A., Kumar, R., Santiago, N., & Wright, D. (2021). A survey of artificial intelligence risk assessment methodologies - The global state of play and leading practices identified. Technical Report Trilateral Research."},{"key":"16_CR16","doi-asserted-by":"publisher","DOI":"10.1162\/99608f92.8cd550d1","author":"L Floridi","year":"2019","unstructured":"Floridi, L., & Cowls, J. (2019). A Unified Framework of Five Principles for AI in Society. Harvard Data Science Review. https:\/\/doi.org\/10.1162\/99608f92.8cd550d1","journal-title":"Harvard Data Science Review"},{"key":"16_CR17","unstructured":"General Assembly, U. G. (1948). Universal declaration of human rights. UN General Assembly, 302, 14\u201325."},{"key":"16_CR18","doi-asserted-by":"publisher","unstructured":"Glauner, P. (2021). An assessment of the ai regulation proposed by the european commission. arXiv preprint. https:\/\/doi.org\/10.48550\/ARXIV.2105.15133","DOI":"10.48550\/ARXIV.2105.15133"},{"key":"16_CR19","doi-asserted-by":"publisher","unstructured":"Groshev, M., Guimar\u00e3es, C., Mart\u00edn-P\u00e9rez, J., & de la Oliva, A. (2021). Toward intelligent cyber-physical systems: Digital twin meets artificial intelligence. IEEE Communications Magazine, 59, 14\u201320. https:\/\/doi.org\/10.1109\/MCOM.001.2001237","DOI":"10.1109\/MCOM.001.2001237"},{"key":"16_CR20","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s11023-020-09517-8","volume":"30","author":"T Hagendorff","year":"2020","unstructured":"Hagendorff, T. (2020). The ethics of ai ethics: An evaluation of guidelines. Minds and Machines, 30, 99\u2013120. https:\/\/doi.org\/10.1007\/s11023-020-09517-8","journal-title":"Minds and Machines"},{"key":"16_CR21","unstructured":"HLEGAI (2020). Assessment list for trustworthy artificial intelligence. European Commission."},{"key":"16_CR22","doi-asserted-by":"publisher","unstructured":"IEEE (2021). Ieee standard model process for addressing ethical concerns during system design. IEEE Std 7000-2021, (pp. 1\u201382). https:\/\/doi.org\/10.1109\/IEEESTD.2021.9536679","DOI":"10.1109\/IEEESTD.2021.9536679"},{"key":"16_CR23","unstructured":"Jameson, A., Konstan, J., & Riedl, J. (2002). Ai techniques for personalized recommendation. In Tutorial at 18th National Conference on Artificial Intelligence (AAAI)."},{"key":"16_CR24","doi-asserted-by":"publisher","unstructured":"Javaid, M., Haleem, A., Singh, R. P., & Suman, R. (2022). Artificial intelligence applications for industry 4.0: A literature-based study. Journal of Industrial Integration and Management, 7, 83\u2013111. https:\/\/doi.org\/10.1142\/S2424862221300040","DOI":"10.1142\/S2424862221300040"},{"key":"16_CR25","doi-asserted-by":"publisher","unstructured":"Jobin, A., Ienca, M., & Vayena, E. (2019). The global landscape of ai ethics guidelines. Nature Machine Intelligence, 1, 389\u2013399. https:\/\/doi.org\/10.1038\/s42256-019-0088-2","DOI":"10.1038\/s42256-019-0088-2"},{"key":"16_CR26","unstructured":"Kalis, B., Collier, M., & Fu, R. (2018). 10 promising ai applications in health care. Harvard business review."},{"key":"16_CR27","doi-asserted-by":"publisher","unstructured":"Larsson, S. (2019). The socio-legal relevance of artificial intelligence. Droit et societe, 573\u2013593. https:\/\/doi.org\/10.3917\/drs1.103.0573","DOI":"10.3917\/drs1.103.0573"},{"key":"16_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/als.2020.19","volume":"7","author":"S Larsson","year":"2020","unstructured":"Larsson, S. (2020). On the governance of artificial intelligence through ethics guidelines. Asian Journal of Law and Society, 7, 1\u201323. https:\/\/doi.org\/10.1017\/als.2020.19","journal-title":"Asian Journal of Law and Society"},{"key":"16_CR29","doi-asserted-by":"publisher","unstructured":"Larsson, S. (2021). Ai in the eu: Ethical guidelines as a governance tool. (pp. 85\u2013111). https:\/\/doi.org\/10.1007\/978-3-030-63672-2_4","DOI":"10.1007\/978-3-030-63672-2_4"},{"key":"16_CR30","unstructured":"Larsson, S., Anneroth, M., Fell\u00e4nder, A., Fell\u00e4nder-Tsai, L., Heintz, F., & \u00c5ngstr\u00f6m, R.\u00a0C. (2019). Sustainable ai: An inventory of the state of knowledge of ethical, social, and legal challenges related to artificial intelligence."},{"key":"16_CR31","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/s43681-020-00013-4","volume":"1","author":"D Lauer","year":"2021","unstructured":"Lauer, D. (2021). You cannot have ai ethics without ethics. AI and Ethics, 1, 21\u201325. https:\/\/doi.org\/10.1007\/s43681-020-00013-4","journal-title":"AI and Ethics"},{"key":"16_CR32","doi-asserted-by":"publisher","unstructured":"Lopez, P. (2021). Bias does not equal bias: A socio-technical typology of bias in data-based algorithmic systems. Internet Policy Review, 10, 1\u201329. https:\/\/doi.org\/10.14763\/2021.4.1598","DOI":"10.14763\/2021.4.1598"},{"key":"16_CR33","doi-asserted-by":"crossref","unstructured":"McGregor, S. (2020). Preventing repeated real world ai failures by cataloging incidents: The ai incident database. arXiv preprint arXiv:2011.08512","DOI":"10.1609\/aaai.v35i17.17817"},{"key":"16_CR34","doi-asserted-by":"publisher","unstructured":"Meek, T., Barham, H., Beltaif, N., Kaadoor, A., & Akhter, T. (2016). Managing the ethical and risk implications of rapid advances in artificial intelligence: a literature review. In 2016 Portland International Conference on Management of Engineering and Technology (PICMET) (pp. 682\u2013693). https:\/\/doi.org\/10.1109\/PICMET.2016.7806752. IEEE.","DOI":"10.1109\/PICMET.2016.7806752"},{"key":"16_CR35","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1038\/s42256-019-0114-4","volume":"1","author":"B Mittelstadt","year":"2019","unstructured":"Mittelstadt, B. (2019). Principles alone cannot guarantee ethical ai. Nature Machine Intelligence, 1, 501\u2013507. https:\/\/doi.org\/10.1038\/s42256-019-0114-4","journal-title":"Nature Machine Intelligence"},{"key":"16_CR36","doi-asserted-by":"publisher","unstructured":"M\u00f6kander, J., Axente, M., Casolari, F., & Floridi, L. (2021). Conformity assessments and post-market monitoring: a guide to the role of auditing in the proposed european ai regulation. Minds and Machines, (pp. 1\u201328). https:\/\/doi.org\/10.1007\/s11023-021-09577-4","DOI":"10.1007\/s11023-021-09577-4"},{"key":"16_CR37","doi-asserted-by":"publisher","unstructured":"Noble, S.\u00a0U. (2018). Algorithms of oppression: How search engines reinforce racism. nyu Press. https:\/\/doi.org\/10.18574\/9781479833641","DOI":"10.18574\/9781479833641"},{"key":"16_CR38","doi-asserted-by":"crossref","unstructured":"Pandey, S. K. (2012). A comparative study of risk assessment methodologies for information systems. Bulletin of Electrical Engineering and Informatics, 1, 111\u2013122. https:\/\/doi.org\/10.12928\/eei.v1i2.231","DOI":"10.12928\/eei.v1i2.231"},{"key":"16_CR39","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1111\/j.1539-6924.2010.01442.x","volume":"30","author":"G Purdy","year":"2010","unstructured":"Purdy, G. (2010). Iso 31000: 2009 setting a new standard for risk management. Risk Analysis: An International Journal, 30, 881\u2013886. https:\/\/doi.org\/10.1111\/j.1539-6924.2010.01442.x","journal-title":"Risk Analysis: An International Journal"},{"key":"16_CR40","doi-asserted-by":"publisher","unstructured":"Rakova, B., Yang, J., Cramer, H., & Chowdhury, R. (2021). Where responsible ai meets reality: Practitioner perspectives on enablers for shifting organizational practices. Proceedings of the ACM on Human-Computer Interaction, 5, 1\u201323. https:\/\/doi.org\/10.1145\/3449081","DOI":"10.1145\/3449081"},{"key":"16_CR41","doi-asserted-by":"crossref","unstructured":"Rodrigues, R. (2020). Legal and human rights issues of ai: Gaps, challenges and vulnerabilities. Journal of Responsible Technology, 4. https:\/\/doi.org\/10.1016\/j.jrt.2020.100005","DOI":"10.1016\/j.jrt.2020.100005"},{"key":"16_CR42","doi-asserted-by":"publisher","unstructured":"Shankar, S., Halpern, Y., Breck, E., Atwood, J., Wilson, J., & Sculley, D. (2017). No classification without representation: Assessing geodiversity issues in open data sets for the developing world. https:\/\/doi.org\/10.48550\/arXiv.1711.08536","DOI":"10.48550\/arXiv.1711.08536"},{"key":"16_CR43","doi-asserted-by":"publisher","unstructured":"Theodorou, A., & Dignum, V. (2020). Towards ethical and socio-legal governance in ai. Nature Machine Intelligence, 2. https:\/\/doi.org\/10.1038\/s42256-019-0136-y","DOI":"10.1038\/s42256-019-0136-y"},{"key":"16_CR44","doi-asserted-by":"publisher","first-page":"1178","DOI":"10.3390\/su11041178","volume":"11","author":"B Tiganoaia","year":"2019","unstructured":"Tiganoaia, B., Niculescu, A., Negoita, O., & Popescu, M. (2019). A new sustainable model for risk managementrimm. Sustainability, 11, 1178. https:\/\/doi.org\/10.3390\/su11041178","journal-title":"Sustainability"},{"key":"16_CR45","doi-asserted-by":"publisher","unstructured":"Tseng, M.-L., Tran, T. P. T., Ha, H. M., Bui, T.-D., & Lim, M. K. (2021). Sustainable industrial and operation engineering trends and challenges toward industry 4.0: A data driven analysis. Journal of Industrial and Production Engineering, 38, 581\u2013598. https:\/\/doi.org\/10.1080\/21681015.2021.1950227","DOI":"10.1080\/21681015.2021.1950227"},{"key":"16_CR46","unstructured":"Whittaker, M., Alper, M., Bennett, C.\u00a0L., Hendren, S., Kaziunas, L., Mills, M., Morris, M.\u00a0R., Rankin, J., Rogers, E., Salas, M. et\u00a0al. (2019). Disability, bias, and ai. AI Now Institute, November."},{"key":"16_CR47","doi-asserted-by":"crossref","unstructured":"Wolf, M., Miller, K., Grodzinsky, F. (2017). Why we should have seen that coming: Comments on microsoft tay \u201cexperiment\u201d, and wider implications. The ORBIT Journal, 1, 1\u201312. https:\/\/doi.org\/10.29297\/orbit.v1i2.49","DOI":"10.29297\/orbit.v1i2.49"},{"key":"16_CR48","doi-asserted-by":"publisher","unstructured":"Wright, S.\u00a0A. (2020). Ai in the law: Towards assessing ethical risks. In 2020 IEEE International Conference on Big Data (Big Data) (pp. 2160\u20132169). https:\/\/doi.org\/10.1109\/BigData50022.2020.9377950","DOI":"10.1109\/BigData50022.2020.9377950"}],"container-title":["Digital Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44206-022-00016-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44206-022-00016-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44206-022-00016-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,12]],"date-time":"2022-10-12T16:22:41Z","timestamp":1665591761000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44206-022-00016-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,18]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,9]]}},"alternative-id":["16"],"URL":"https:\/\/doi.org\/10.1007\/s44206-022-00016-0","relation":{},"ISSN":["2731-4650","2731-4669"],"issn-type":[{"value":"2731-4650","type":"print"},{"value":"2731-4669","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,18]]},"assertion":[{"value":"2 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}],"article-number":"13"}}