{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T02:10:48Z","timestamp":1777342248934,"version":"3.51.4"},"reference-count":64,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T00:00:00Z","timestamp":1712966400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T00:00:00Z","timestamp":1712966400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Fundae a Tecnologia","doi-asserted-by":"publisher","award":["UIDP\/04728\/2020"],"award-info":[{"award-number":["UIDP\/04728\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NextGeneration EU","award":["C645808870-00000067 - projeto de investimento n\u00ba 60"],"award-info":[{"award-number":["C645808870-00000067 - projeto de investimento n\u00ba 60"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Data Sci Anal"],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The field of AI Ethics has recently gained considerable attention, yet much of the existing academic research lacks practical and objective contributions for the development of ethical AI systems. This systematic literature review aims to identify and map objective metrics documented in literature between January 2018 and June 2023, specifically focusing on the ethical principles outlined in the Ethics Guidelines for Trustworthy AI. The review was based on 66 articles retrieved from the Scopus and World of Science databases. The articles were categorized based on their alignment with seven ethical principles: Human Agency and Oversight, Technical Robustness and Safety, Privacy and Data Governance, Transparency, Diversity, Non-Discrimination and Fairness, Societal and Environmental Well-being, and Accountability. Of the identified articles, only a minority presented objective metrics to assess AI ethics, with the majority being purely theoretical works. Moreover, existing metrics are primarily concentrating on Diversity, Non-Discrimination and Fairness, with a clear under-representation of the remaining principles. This lack of practical contributions makes it difficult for Data Scientists to devise systems that can be deemed Ethical, or to monitor the alignment of existing systems with current guidelines and legislation. With this work, we lay out the current panorama concerning objective metrics to quantify AI Ethics in Data Science and highlight the areas in which future developments are needed to align Data Science projects with the human values widely posited in the literature.<\/jats:p>","DOI":"10.1007\/s41060-024-00541-w","type":"journal-article","created":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T09:01:42Z","timestamp":1712998902000},"page":"247-267","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Objective metrics for ethical AI: a systematic literature review"],"prefix":"10.1007","volume":"20","author":[{"given":"Guilherme","family":"Palumbo","sequence":"first","affiliation":[]},{"given":"Davide","family":"Carneiro","sequence":"additional","affiliation":[]},{"given":"Victor","family":"Alves","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,4,13]]},"reference":[{"issue":"6","key":"541_CR1","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1016\/S2589-7500(22)00063-2","volume":"4","author":"JW Gichoya","year":"2022","unstructured":"Gichoya, J.W., Banerjee, I., Bhimireddy, A.R., Burns, J.L., Celi, L.A., Chen, L.-C., Correa, R., Dullerud, N., Ghassemi, M., Huang, S.-C., et al.: AI recognition of patient race in medical imaging: a modelling study. Lancet Digit. Health 4(6), 406\u2013414 (2022)","journal-title":"Lancet Digit. Health"},{"key":"541_CR2","doi-asserted-by":"publisher","first-page":"977","DOI":"10.1007\/s10551-022-05049-6","volume":"178","author":"AL Hunkenschroer","year":"2022","unstructured":"Hunkenschroer, A.L., Luetge, C.: Ethics of AI-enabled recruiting and selection: a review and research agenda. J. Bus. Ethics 178, 977\u20131007 (2022). https:\/\/doi.org\/10.1007\/s10551-022-05049-6","journal-title":"J. Bus. Ethics"},{"issue":"1","key":"541_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/3300000041","volume":"6","author":"C Barrett","year":"2023","unstructured":"Barrett, C., Boyd, B., Bursztein, E., Carlini, N., Chen, B., Choi, J., Chowdhury, A.R., Christodorescu, M., Datta, A., Feizi, S., Fisher, K., Hashimoto, T., Hendrycks, D., Jha, S., Kang, D., Kerschbaum, F., Mitchell, E., Mitchell, J., Ramzan, Z., Shams, K., Song, D., Taly, A., Yang, D.: Identifying and mitigating the security risks of generative AI. Found. Trends Privacy Secur. 6(1), 1\u201352 (2023). https:\/\/doi.org\/10.1561\/3300000041","journal-title":"Found. Trends Privacy Secur."},{"key":"541_CR4","unstructured":"CDEI: The roadmap to an effective AI assurance ecosystem - GOV.UK (2021)"},{"key":"541_CR5","unstructured":"BridgeAI, I.U.: Report on the core principles and opportunities for responsible and trustworthy AI (2023)"},{"key":"541_CR6","unstructured":"European Commision: Ethics guidelines for trustworthy AI | Shaping Europe\u2019s digital future (2019). https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai"},{"key":"541_CR7","unstructured":"Bellamy, R.K.E., Dey, K., Hind, M., Hoffman, S.C., Houde, S., Kannan, K., Lohia, P., Martino, J., Mehta, S., Mojsilovic, A., Nagar, S., Ramamurthy, K.N., Richards, J., Saha, D., Sattigeri, P., Singh, M., Varshney, K.R., Zhang, Y.: AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias (2018). https:\/\/arxiv.org\/abs\/1810.01943"},{"key":"541_CR8","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1146\/annurev-psych-010418","volume":"70","author":"AP Siddaway","year":"2019","unstructured":"Siddaway, A.P., Wood, A.M., Hedges, L.V.: How to do a systematic review: a best practice guide for conducting and reporting narrative reviews, meta-analyses, and meta-syntheses. Annu. Rev. Psychol. 70, 747\u2013770 (2019). https:\/\/doi.org\/10.1146\/annurev-psych-010418","journal-title":"Annu. Rev. Psychol."},{"key":"541_CR9","unstructured":"PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses. http:\/\/prisma-statement.org\/"},{"key":"541_CR10","doi-asserted-by":"publisher","unstructured":"Kaul, A., Soofastaei, A.: Advanced analytics for ethical considerations in mining industry. In Advanced Analytics in Mining Engineering: Leverage Advanced Analytics in Mining Industry to Make Better Business Decisions, pp. 55\u201380. (2022) https:\/\/doi.org\/10.1007\/978-3-030-91589-6_3\/COVER","DOI":"10.1007\/978-3-030-91589-6_3\/COVER"},{"key":"541_CR11","doi-asserted-by":"publisher","unstructured":"Kasirzadeh, A.: Algorithmic fairness and structural injustice: insights from feminist political philosophy. In: AIES 2022 - Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society, pp. 349\u2013356. (2022)https:\/\/doi.org\/10.1145\/3514094.3534188","DOI":"10.1145\/3514094.3534188"},{"key":"541_CR12","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1007\/S11892-022-01467-Y\/METRICS","volume":"22","author":"S Zafar","year":"2022","unstructured":"Zafar, S., Mahjoub, H., Mehta, N., Domalpally, A., Channa, R.: Artificial intelligence algorithms in diabetic retinopathy screening. Curr. Diabet. Rep. 22, 267\u2013274 (2022). https:\/\/doi.org\/10.1007\/S11892-022-01467-Y\/METRICS","journal-title":"Curr. Diabet. Rep."},{"key":"541_CR13","doi-asserted-by":"publisher","unstructured":"Bae, A., Xu, S.: Discovering and understanding algorithmic biases in autonomous pedestrian trajectory predictions. In: SenSys 2022 - Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, pp. 1155\u20131161. (2022) https:\/\/doi.org\/10.1145\/3560905.3568433","DOI":"10.1145\/3560905.3568433"},{"key":"541_CR14","doi-asserted-by":"publisher","unstructured":"Kasirzadeh, A., Clifford, D.: Fairness and data protection impact assessments. In: AIES 2021 - Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society, pp. 146\u2013153. (2021) https:\/\/doi.org\/10.1145\/3461702.3462528","DOI":"10.1145\/3461702.3462528"},{"key":"541_CR15","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1111\/BJET.13224","volume":"53","author":"R Marshall","year":"2022","unstructured":"Marshall, R., Pardo, A., Smith, D., Watson, T.: Implementing next generation privacy and ethics research in education technology. Br. J. Educ. Technol. 53, 737\u2013755 (2022). https:\/\/doi.org\/10.1111\/BJET.13224","journal-title":"Br. J. Educ. Technol."},{"key":"541_CR16","doi-asserted-by":"publisher","unstructured":"Cort\u00e9s, E.C., Rajtmajer, S., Ghosh, D.: Locality of technical objects and the role of structural interventions for systemic change. In: ACM International Conference Proceeding Series, pp. 2327\u20132341. (2022) https:\/\/doi.org\/10.1145\/3531146.3534646","DOI":"10.1145\/3531146.3534646"},{"issue":"2","key":"541_CR17","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1145\/3479645.3479709","volume":"32","author":"B Abedin","year":"2021","unstructured":"Abedin, B.: Managing the tension between opposing effects of explainability of artificial intelligence: a contingency theory perspective. Internet Res. 32(2), 425\u2013453 (2021). https:\/\/doi.org\/10.1145\/3479645.3479709","journal-title":"Internet Res."},{"key":"541_CR18","doi-asserted-by":"publisher","first-page":"848","DOI":"10.1109\/TEVC.2022.3209544","volume":"27","author":"Q Zhang","year":"2023","unstructured":"Zhang, Q., Liu, J., Zhang, Z., Wen, J., Mao, B., Yao, X.: Mitigating unfairness via evolutionary multiobjective ensemble learning. IEEE Trans. Evolut. Comput. 27, 848\u2013862 (2023). https:\/\/doi.org\/10.1109\/TEVC.2022.3209544","journal-title":"IEEE Trans. Evolut. Comput."},{"key":"541_CR19","doi-asserted-by":"publisher","unstructured":"Schedl, M., Rekabsaz, N., Lex, E., Grosz, T., Greif, E.: Multiperspective and multidisciplinary treatment of fairness in recommender systems research. In: UMAP2022 - Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization, pp. 90\u201394. (2022) https:\/\/doi.org\/10.1145\/3511047.3536400","DOI":"10.1145\/3511047.3536400"},{"key":"541_CR20","doi-asserted-by":"publisher","DOI":"10.1007\/S10994-023-06319-8\/FIGURES\/10","author":"S Goethals","year":"2023","unstructured":"Goethals, S., Martens, D., Calders, T.: Precof: counterfactual explanations for fairness. Mach. Learn. (2023). https:\/\/doi.org\/10.1007\/S10994-023-06319-8\/FIGURES\/10","journal-title":"Mach. Learn."},{"key":"541_CR21","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1007\/S10676-021-09583-1\/TABLES\/7","volume":"23","author":"M Tomalin","year":"2021","unstructured":"Tomalin, M., Byrne, B., Concannon, S., Saunders, D., Ullmann, S.: The practical ethics of bias reduction in machine translation: why domain adaptation is better than data debiasing. Ethics Inform. Technol. 23, 419\u2013433 (2021). https:\/\/doi.org\/10.1007\/S10676-021-09583-1\/TABLES\/7","journal-title":"Ethics Inform. Technol."},{"key":"541_CR22","doi-asserted-by":"publisher","unstructured":"Fleisher, W.: What\u2019s fair about individual fairness? In: AIES 2021 - Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society, pp. 480\u2013490. (2021) https:\/\/doi.org\/10.1145\/3461702.3462621","DOI":"10.1145\/3461702.3462621"},{"key":"541_CR23","doi-asserted-by":"publisher","DOI":"10.2139\/SSRN.3547922","author":"S Wachter","year":"2020","unstructured":"Wachter, S., Mittelstadt, B., Russell, C.: Why fairness cannot be automated: bridging the gap between EU non-discrimination law and AI. SSRN Electron. J. (2020). https:\/\/doi.org\/10.2139\/SSRN.3547922","journal-title":"SSRN Electron. J."},{"key":"541_CR24","doi-asserted-by":"publisher","first-page":"8503","DOI":"10.3390\/SU13158503","volume":"13","author":"HS Saetra","year":"2021","unstructured":"Saetra, H.S., Wynsberghe, Bolte, L., Nachid, J.: A framework for evaluating and disclosing the esg related impacts of AI with the sdgs. Sustainability 13, 8503 (2021). https:\/\/doi.org\/10.3390\/SU13158503","journal-title":"Sustainability"},{"key":"541_CR25","doi-asserted-by":"publisher","unstructured":"Ruf, B., Detyniecki, M.: A tool bundle for ai fairness in practice. In: Conference on Human Factors in Computing Systems - Proceedings (2022). https:\/\/doi.org\/10.1145\/3491101.3519878","DOI":"10.1145\/3491101.3519878"},{"key":"541_CR26","doi-asserted-by":"publisher","unstructured":"Raji, I.D., Buolamwini, J.: Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products. In: AIES 2019 - Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society, pp. 429\u2013435. (2019) https:\/\/doi.org\/10.1145\/3306618.3314244","DOI":"10.1145\/3306618.3314244"},{"key":"541_CR27","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.1007\/S00146-021-01256-3\/METRICS","volume":"37","author":"J Krijger","year":"2022","unstructured":"Krijger, J.: Enter the metrics: critical theory and organizational operationalization of AI ethics. AI Soc. 37, 1427\u20131437 (2022). https:\/\/doi.org\/10.1007\/S00146-021-01256-3\/METRICS","journal-title":"AI Soc."},{"key":"541_CR28","doi-asserted-by":"publisher","unstructured":"Wylde, V., Prakash, E., Hewage, C., Platts, J.: Ethical challenges in the use of digital technologies: Ai and big data. In: Advanced Sciences and Technologies for Security Applications, pp. 33\u201358. (2023) https:\/\/doi.org\/10.1007\/978-3-031-09691-4_3\/COVER","DOI":"10.1007\/978-3-031-09691-4_3\/COVER"},{"key":"541_CR29","doi-asserted-by":"publisher","unstructured":"Sahu, S., Singh, S.K.: Ethics in ai: Collaborative filtering based approach to alleviate strong user biases and prejudices. In: 2019 12th International Conference on Contemporary Computing, IC3 2019 (2019) https:\/\/doi.org\/10.1109\/IC3.2019.8844875","DOI":"10.1109\/IC3.2019.8844875"},{"key":"541_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/J.ADVENGSOFT.2022.103339","volume":"175","author":"AT Keleko","year":"2023","unstructured":"Keleko, A.T., Kamsu-Foguem, B., Ngouna, R.H., Tongne, A.: Health condition monitoring of a complex hydraulic system using deep neural network and deepshap explainable xai. Adv. Eng. Softw. 175, 103339 (2023). https:\/\/doi.org\/10.1016\/J.ADVENGSOFT.2022.103339","journal-title":"Adv. Eng. Softw."},{"key":"541_CR31","doi-asserted-by":"publisher","first-page":"2024","DOI":"10.1093\/JAMIA\/OCAA085","volume":"27","author":"MD McCradden","year":"2020","unstructured":"McCradden, M.D., Joshi, S., Anderson, J.A., Mazwi, M., Goldenberg, A., Shaul, R.Z.: Patient safety and quality improvement: ethical principles for a regulatory approach to bias in healthcare machine learning. J. Am. Med. Inform. Assoc. JAMIA 27, 2024\u20132027 (2020). https:\/\/doi.org\/10.1093\/JAMIA\/OCAA085","journal-title":"J. Am. Med. Inform. Assoc. JAMIA"},{"key":"541_CR32","doi-asserted-by":"publisher","first-page":"200","DOI":"10.33430\/V29N3THIE-2022-0037","volume":"29","author":"WW Lee","year":"2022","unstructured":"Lee, W.W.: Tools adapted to ethical analysis of data bias. HKIE Trans. Hong Kong Inst. Eng. 29, 200\u2013209 (2022). https:\/\/doi.org\/10.33430\/V29N3THIE-2022-0037","journal-title":"HKIE Trans. Hong Kong Inst. Eng."},{"key":"541_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/S00146-022-01415-0\/TABLES\/5","volume":"1","author":"M Minkkinen","year":"2022","unstructured":"Minkkinen, M., Niukkanen, A., M\u00e4ntym\u00e4ki, M.: What about investors? esg analyses as tools for ethics-based AI auditing. AI Soc. 1, 1\u201315 (2022). https:\/\/doi.org\/10.1007\/S00146-022-01415-0\/TABLES\/5","journal-title":"AI Soc."},{"key":"541_CR34","doi-asserted-by":"publisher","unstructured":"Edwards, A.: IEEE P7010-2020 Standard: Use Cases in Ethical Impact on Human Wellbeing Studies (2020). https:\/\/doi.org\/10.13140\/RG.2.2.21769.88168","DOI":"10.13140\/RG.2.2.21769.88168"},{"key":"541_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/S12880-022-00918-Y\/FIGURES\/2","volume":"22","author":"I Fasterholdt","year":"2022","unstructured":"Fasterholdt, I., Naghavi-Behzad, M., Rasmussen, B.S.B., Kj\u00f8lhede, T., Skj\u00f8th, M.M., Hildebrandt, M.G., Kidholm, K.: Value assessment of artificial intelligence in medical imaging: a scoping review. BMC Med. Imag. 22, 1\u201311 (2022). https:\/\/doi.org\/10.1186\/S12880-022-00918-Y\/FIGURES\/2","journal-title":"BMC Med. Imag."},{"key":"541_CR36","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1080\/17579961.2022.2113669","volume":"14","author":"H Etienne","year":"2022","unstructured":"Etienne, H.: Solving moral dilemmas with AI: how it helps us address the social implications of the covid-19 crisis and enhance human responsibility to tackle meta-dilemmas. Law Innov. Technol. 14, 305\u2013324 (2022). https:\/\/doi.org\/10.1080\/17579961.2022.2113669","journal-title":"Law Innov. Technol."},{"key":"541_CR37","doi-asserted-by":"publisher","first-page":"40","DOI":"10.3390\/BDCC3030040","volume":"3","author":"KW Carlson","year":"2019","unstructured":"Carlson, K.W.: Safe artificial general intelligence via distributed ledger technology. Big Data Cogn. Comput. 3, 40 (2019). https:\/\/doi.org\/10.3390\/BDCC3030040","journal-title":"Big Data Cogn. Comput."},{"key":"541_CR38","doi-asserted-by":"publisher","DOI":"10.1016\/J.CPPEDS.2021.101065","volume":"51","author":"RW Steele","year":"2021","unstructured":"Steele, R.W.: Pediatric quality measures: the leap from process to outcomes. Curr. Probl. Pediatr. Adolesc. Health Care 51, 101065 (2021). https:\/\/doi.org\/10.1016\/J.CPPEDS.2021.101065","journal-title":"Curr. Probl. Pediatr. Adolesc. Health Care"},{"key":"541_CR39","doi-asserted-by":"publisher","unstructured":"Avelar, P.H.C., Audibert, R.B., Lamb, L.C.: Measuring ethics in ai with ai: A methodology and dataset construction. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 13653 LNAI, pp. 370\u2013384. (2021) https:\/\/doi.org\/10.1007\/978-3-031-21686-2_26","DOI":"10.1007\/978-3-031-21686-2_26"},{"key":"541_CR40","doi-asserted-by":"publisher","unstructured":"Riley, P.C., Deshpande, S.V., Ince, B.S., Dereje, R., Davidson, C.E., O\u2019Donnell, K.P., Hauck, B.C.: Interpreting chemical detection alarms with live analysis of ml algorithms. In: Defense + Commercial Sensing, vol. 23 (2022) https:\/\/doi.org\/10.1117\/12.2619166","DOI":"10.1117\/12.2619166"},{"key":"541_CR41","doi-asserted-by":"publisher","unstructured":"Claure, H., Chang, M.L., Kim, S., Omeiza, D., Brandao, M., Lee, M.K., Jung, M.: Fairness and transparency in human-robot interaction. In: ACM\/IEEE International Conference on Human-Robot Interaction 2022-March, pp. 1244\u20131246. (2022) https:\/\/doi.org\/10.1109\/HRI53351.2022.9889421","DOI":"10.1109\/HRI53351.2022.9889421"},{"key":"541_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/j.ebiom.2021.103358","volume":"67","author":"J Zou","year":"2021","unstructured":"Zou, J., Schiebinger, L.: Ensuring that biomedical ai benefits diverse populations. EBioMedicine 67, 103358 (2021). https:\/\/doi.org\/10.1016\/j.ebiom.2021.103358","journal-title":"EBioMedicine"},{"key":"541_CR43","doi-asserted-by":"publisher","first-page":"644","DOI":"10.1186\/S12887-022-03727-Y","volume":"22","author":"K Zhao","year":"2022","unstructured":"Zhao, K., Ma, S., Sun, Z., Liu, X., Zhu, Y., Xu, Y., Wang, X.: Effect of ai-assisted software on inter- and intra-observer variability for the x-ray bone age assessment of preschool children. BMC Pediatrics 22, 644 (2022). https:\/\/doi.org\/10.1186\/S12887-022-03727-Y","journal-title":"BMC Pediatrics"},{"key":"541_CR44","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1016\/j.jid.2020.02.026","volume":"140","author":"AT Young","year":"2020","unstructured":"Young, A.T., Xiong, M., Pfau, J., Keiser, M.J., Wei, M.L.: Artificial intelligence in dermatology: a primer. J. Invest. Dermatol. 140, 1504\u20131512 (2020). https:\/\/doi.org\/10.1016\/j.jid.2020.02.026","journal-title":"J. Invest. Dermatol."},{"key":"541_CR45","doi-asserted-by":"publisher","first-page":"327","DOI":"10.3233\/ISU-220178","volume":"42","author":"B Lawlor","year":"2022","unstructured":"Lawlor, B.: An overview of the 2022 niso plus conference: global conversations\/global connections. Inf. Serv. Use 42, 327\u2013376 (2022). https:\/\/doi.org\/10.3233\/ISU-220178","journal-title":"Inf. Serv. Use"},{"key":"541_CR46","doi-asserted-by":"publisher","unstructured":"Antikainen, J., Agbese, M., Alanen, H.-K., Halme, E., Isom\u00e4ki, H., Jantunen, M., Kemell, K.-K., Rousi, R., Vainio-Pekka, H., Vakkuri, V.: A deployment model to extend ethically aligned ai implementation method eccola. In: Proceedings of the IEEE International Conference on Requirements Engineering 2021-September, pp. 230\u2013235. (2021) https:\/\/doi.org\/10.1109\/REW53955.2021.00043","DOI":"10.1109\/REW53955.2021.00043"},{"key":"541_CR47","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1097\/RLI.0000000000000664","volume":"55","author":"C Germann","year":"2020","unstructured":"Germann, C., Marbach, G., Civardi, F., Fucentese, S.F., Fritz, J., Sutter, R., Pfirrmann, C.W.A., Fritz, B.: Deep convolutional neural network-based diagnosis of anterior cruciate ligament tears: performance comparison of homogenous versus heterogeneous knee mri cohorts with different pulse sequence protocols and 15-t and 3-t magnetic field strengths. Invest. Radiol. 55, 499\u2013506 (2020). https:\/\/doi.org\/10.1097\/RLI.0000000000000664","journal-title":"Invest. Radiol."},{"issue":"6","key":"541_CR48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3457607","volume":"54","author":"N Mehrabi","year":"2021","unstructured":"Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., Galstyan, A.: A survey on bias and fairness in machine learning. ACM Comput. Surv. 54(6), 1\u201335 (2021). https:\/\/doi.org\/10.1145\/3457607","journal-title":"ACM Comput. Surv."},{"key":"541_CR49","unstructured":"R\u00e4z, T.: Group fairness: Independence revisited 10(1145\/3442188), 3445876 (2021)"},{"key":"541_CR50","doi-asserted-by":"crossref","unstructured":"Dwork, C., Hardt, M., Pitassi, T., Reingold, O., Zemel, R.: Fairness Through Awareness. (2011) arXiv:1104.3913","DOI":"10.1145\/2090236.2090255"},{"key":"541_CR51","unstructured":"Tang, Z., Zhang, K.: Attainability and optimality: The equalized odds fairness revisited. In: Sch\u00f6lkopf, B., Uhler, C., Zhang, K. (eds.) Proceedings of the First Conference on Causal Learning and Reasoning. Proceedings of Machine Learning Research, vol. 177, pp. 754\u2013786. (2022). https:\/\/proceedings.mlr.press\/v177\/tang22a.html"},{"key":"541_CR52","doi-asserted-by":"publisher","unstructured":"Verma, S., Rubin, J.: Fairness definitions explained. In: IEEE\/ACM International Workshop on Software Fairness , vol. 18 (2018) https:\/\/doi.org\/10.1145\/3194770.3194776","DOI":"10.1145\/3194770.3194776"},{"key":"541_CR53","doi-asserted-by":"publisher","unstructured":"Verma, S., Rubin, J.: Fairness definitions explained. In: Proceedings - International Conference on Software Engineering, pp. 1\u20137. (2018) https:\/\/doi.org\/10.1145\/3194770.3194776","DOI":"10.1145\/3194770.3194776"},{"key":"541_CR54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-022-07939-1","volume":"12","author":"A Castelnovo","year":"2022","unstructured":"Castelnovo, A., Crupi, R., Greco, G., Regoli, D., Penco, I.G., Cosentini, A.C.: A clarification of the nuances in the fairness metrics landscape. Sci. Rep. 12, 1\u201321 (2022). https:\/\/doi.org\/10.1038\/s41598-022-07939-1","journal-title":"Sci. Rep."},{"key":"541_CR55","unstructured":"Kusner, M., Loftus, J., Russell, C., Silva, R.: Counterfactual fairness. In: Conference on Neural Information Processing Systems. (2017) arXiv:1703.06856"},{"key":"541_CR56","doi-asserted-by":"publisher","unstructured":"Zafar, M.B., Valera, I., Gomez\u00a0Rodriguez, M., Gummadi, K.P.: Fairness beyond disparate treatment disparate impact: Learning classification without disparate mistreatment. In: Proceedings of the 26th International Conference on World Wide Web. WWW \u201917, pp. 1171\u20131180. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE (2017). https:\/\/doi.org\/10.1145\/3038912.3052660","DOI":"10.1145\/3038912.3052660"},{"key":"541_CR57","doi-asserted-by":"publisher","unstructured":"Speicher, T., Heidari, H., Grgic-Hlaca, N., Gummadi, K.P., Singla, A., Weller, A., Zafar, M.B.: A unified approach to quantifying algorithmic unfairness: Measuring individual and group unfairness via inequality indices, vol. 12 (2018) https:\/\/doi.org\/10.1145\/3219819.3220046","DOI":"10.1145\/3219819.3220046"},{"key":"541_CR58","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102646","volume":"58","author":"A Ashokan","year":"2021","unstructured":"Ashokan, A., Haas, C.: Fairness metrics and bias mitigation strategies for rating predictions. Inf. Process. Manag. 58, 102646 (2021). https:\/\/doi.org\/10.1016\/j.ipm.2021.102646","journal-title":"Inf. Process. Manag."},{"key":"541_CR59","unstructured":"Bell\u00f9, L.G., Liberati, P.: Describing income inequality describing income inequality theil index and entropy class indexes. (2006)"},{"key":"541_CR60","doi-asserted-by":"publisher","unstructured":"Sitthiyot, T., Holasut, K.: A simple method for measuring inequality (2020). https:\/\/doi.org\/10.1057\/s41599-020-0484-6","DOI":"10.1057\/s41599-020-0484-6"},{"key":"541_CR61","unstructured":"Zhang, Y., Bellamy, R.K.E., Varshney, K.R.: Joint optimization of ai fairness and utility: a human-centered approach. vol. 10 (1145\/3375627), 3375862 (2020)"},{"key":"541_CR62","doi-asserted-by":"crossref","unstructured":"Jobin, A., Ienca, M., Vayena, E.: Artificial intelligence: the global landscape of ethics guidelines (2019)","DOI":"10.1038\/s42256-019-0088-2"},{"key":"541_CR63","doi-asserted-by":"crossref","unstructured":"Floridi, L., Cowls, J.: A Unified Framework of Five Principles for AI in Society. Harvard Data Science Review 1(1) (2019). https:\/\/hdsr.mitpress.mit.edu\/pub\/l0jsh9d1","DOI":"10.1162\/99608f92.8cd550d1"},{"key":"541_CR64","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s11023-020-09517-8","volume":"30","author":"T Hagendorff","year":"2020","unstructured":"Hagendorff, T.: The ethics of ai ethics: an evaluation of guidelines. Minds Mach. 30, 99\u2013120 (2020). https:\/\/doi.org\/10.1007\/s11023-020-09517-8","journal-title":"Minds Mach."}],"container-title":["International Journal of Data Science and Analytics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41060-024-00541-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41060-024-00541-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41060-024-00541-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,5]],"date-time":"2025-09-05T18:55:58Z","timestamp":1757098558000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41060-024-00541-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,13]]},"references-count":64,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["541"],"URL":"https:\/\/doi.org\/10.1007\/s41060-024-00541-w","relation":{},"ISSN":["2364-415X","2364-4168"],"issn-type":[{"value":"2364-415X","type":"print"},{"value":"2364-4168","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,13]]},"assertion":[{"value":"19 January 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Author Guilherme Palumbo has received research support from FCT\u2014Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia under Grant Agreement No[UIDP\/04728\/2020]. Author Davide Carneiro and Victor Alves declare they have no financial interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"All authors consent to participate.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All authors consent for publication.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}