{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T17:32:45Z","timestamp":1780507965198,"version":"3.54.1"},"reference-count":82,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T00:00:00Z","timestamp":1681257600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T00:00:00Z","timestamp":1681257600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["BE5601\/4-1; Cluster of Excellence \u201cMachine Learning\u2014New Perspectives for Science\u201d"],"award-info":[{"award-number":["BE5601\/4-1; Cluster of Excellence \u201cMachine Learning\u2014New Perspectives for Science\u201d"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["EXC 2064"],"award-info":[{"award-number":["EXC 2064"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["project number 390727645"],"award-info":[{"award-number":["project number 390727645"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007569","name":"Carl-Zeiss-Stiftung","doi-asserted-by":"publisher","award":["Certification"],"award-info":[{"award-number":["Certification"]}],"id":[{"id":"10.13039\/100007569","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007569","name":"Carl-Zeiss-Stiftung","doi-asserted-by":"publisher","award":["Foundations of Safe Machine Learning Systems in Healthcare"],"award-info":[{"award-number":["Foundations of Safe Machine Learning Systems in Healthcare"]}],"id":[{"id":"10.13039\/100007569","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002345","name":"Eberhard Karls Universit\u00e4t T\u00fcbingen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002345","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI Ethics"],"published-print":{"date-parts":[[2024,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper develops an account of model evaluation\u2014with an emphasis on fairness concerns\u2014that takes the social situatedness of ML models as its starting point. Such a view entails that ML models are not deemed isolated entities, but rather tools, used for specific purposes and potentially impacting their social environment in manifold ways. This shift of perspective opens up a new problem space and facilitates rethinking criteria for model evaluation. By drawing on the adequacy-for-purpose view in philosophy of science, epistemic norms and desiderata for an adequate deployment of ML models along the dimensions of Social Objectives, Measurement, Social Dynamics, and interaction are then identified. The account thus developed also highlights why any auditing of ML models that ought to assist in consequential decision-making cannot be limited to an assessment of statistical properties, but needs to incorporate a variety of methods from the social sciences instead. Moreover, while the process of model evaluation might be deemed as a mere technical exercise, it is in fact riddled by epistemic and morally normative considerations.\n<\/jats:p>","DOI":"10.1007\/s43681-023-00280-x","type":"journal-article","created":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T08:15:30Z","timestamp":1681287330000},"page":"427-440","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Fairness as adequacy: a sociotechnical view on model evaluation in machine learning"],"prefix":"10.1007","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9832-6046","authenticated-orcid":false,"given":"Thomas","family":"Grote","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,4,12]]},"reference":[{"issue":"3","key":"280_CR1","first-page":"310","volume":"20","author":"M Adams","year":"2021","unstructured":"Adams, M.: Nonideal justice, fairness, and affirmative action. J Ethics Soc Philos 20(3), 310 (2021)","journal-title":"J Ethics Soc Philos"},{"issue":"22","key":"280_CR2","doi-asserted-by":"publisher","first-page":"2189","DOI":"10.1001\/jama.2022.8587","volume":"327","author":"L Agha","year":"2022","unstructured":"Agha, L., Skinner, J., Chan, D.: Improving efficiency in medical diagnosis. JAMA 327(22), 2189\u20132190 (2022). https:\/\/doi.org\/10.1001\/jama.2022.8587","journal-title":"JAMA"},{"issue":"3\/4","key":"280_CR3","doi-asserted-by":"publisher","first-page":"295","DOI":"10.5840\/schoolman2010873\/411","volume":"87","author":"A Alexandrova","year":"2010","unstructured":"Alexandrova, A.: Adequacy for purpose: the best deal a model can get. Mod Schoolman 87(3\/4), 295\u2013301 (2010). https:\/\/doi.org\/10.5840\/schoolman2010873\/411","journal-title":"Mod Schoolman"},{"issue":"5","key":"280_CR4","doi-asserted-by":"publisher","first-page":"1098","DOI":"10.1086\/687941","volume":"83","author":"A Alexandrova","year":"2016","unstructured":"Alexandrova, A., Haybron, D.M.: Is Construct validation valid? Philos Sci 83(5), 1098\u20131109 (2016). https:\/\/doi.org\/10.1086\/687941","journal-title":"Philos Sci"},{"key":"280_CR5","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1007\/s13194-021-00437-7","volume":"12","author":"A Alexandrova","year":"2022","unstructured":"Alexandrova, A., Fabian, M.: Democratising Measurement: or why thick concepts call for coproduction. Euro Jnl Phil Sci 12, 7 (2022). https:\/\/doi.org\/10.1007\/s13194-021-00437-7","journal-title":"Euro Jnl Phil Sci"},{"key":"280_CR6","doi-asserted-by":"publisher","DOI":"10.1515\/9781400836826","volume-title":"The imperative of integration","author":"E Anderson","year":"2010","unstructured":"Anderson, E.: The imperative of integration. Princeton University Press, Princeton, New Jersey (2010)"},{"key":"280_CR7","unstructured":"Angwin, J., Larson, J., Kirchner, L (2016): Machine bias. there\u2019s software used across the country to predict future criminals. And it\u2019s biased against blacks. https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing. Accessed 2 Jan 2023"},{"key":"280_CR8","unstructured":"Barocas, S., Hardt, M., Narayanan, A (2019): Fairness and machine learning: fairmlbook.org. Available online at http:\/\/www.fairmlbook.org. Accessed 2 Jan 2023"},{"key":"280_CR9","doi-asserted-by":"publisher","DOI":"10.1017\/can.2020.27","author":"JB Biddle","year":"2020","unstructured":"Biddle, J.B.: On predicting recidivism: epistemic risk, tradeoffs, and values in machine learning. Can J Philos (2020). https:\/\/doi.org\/10.1017\/can.2020.27","journal-title":"Can J Philos"},{"key":"280_CR10","unstructured":"Binns, R (2018): Fairness in machine learning: lessons from political philosophy. In Sorelle A. Friedler, Christo Wilson (eds): Proceedings of the 1st Conference on fairness, accountability and transparency, vol. 81: PMLR (Proceedings of Machine Learning Research), pp.\u00a0149\u2013159. Available online at https:\/\/proceedings.mlr.press\/v81\/binns18a.html."},{"issue":"1","key":"280_CR11","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1086\/684173","volume":"83","author":"LK Bright","year":"2016","unstructured":"Bright, L.K., Malinsky, D., Thompson, M.: Causally interpreting intersectionality theory. Philos Sci 83(1), 60\u201381 (2016). https:\/\/doi.org\/10.1086\/684173","journal-title":"Philos Sci"},{"key":"280_CR12","unstructured":"Buolamwini, J., Gebru, T (2018): Gender shades: intersectional accuracy disparities in commercial gender classification. In: Sorelle A. Friedler, Christo Wilson (eds): Proceedings of the 1st conference on fairness, accountability and transparency, vol. 81: PMLR (Proceedings of Machine Learning Research), pp.\u00a077\u201391. Available online at https:\/\/proceedings.mlr.press\/v81\/buolamwini18a.html."},{"issue":"1","key":"280_CR13","doi-asserted-by":"publisher","first-page":"205395171562251","DOI":"10.1177\/2053951715622512","volume":"3","author":"J Burrell","year":"2016","unstructured":"Burrell, J.: How the machine \u2018thinks\u2019: understanding opacity in machine learning algorithms. Big Data Soc 3(1), 2053951715622512 (2016). https:\/\/doi.org\/10.1177\/2053951715622512","journal-title":"Big Data Soc"},{"issue":"1","key":"280_CR14","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1146\/annurev-soc-090820-020800","volume":"47","author":"J Burrell","year":"2021","unstructured":"Burrell, J., Fourcade, M.: The society of algorithms. Ann Rev Sociol 47(1), 213\u2013237 (2021). https:\/\/doi.org\/10.1146\/annurev-soc-090820-020800","journal-title":"Ann Rev Sociol"},{"key":"280_CR15","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:osobl\/9780199841608.001.0001","volume-title":"Evidence-based policy: a practical guide to doing it better","author":"N Cartwright","year":"2012","unstructured":"Cartwright, N., Hardie, J.: Evidence-based policy: a practical guide to doing it better. Oxford University Press (2012)"},{"key":"280_CR16","doi-asserted-by":"publisher","DOI":"10.1017\/9781009047081","volume-title":"We, the robots?","author":"S Chesterman","year":"2021","unstructured":"Chesterman, S.: We, the robots? Cambridge University Press (2021)"},{"key":"280_CR17","unstructured":"Chouldechova, A., Benavides-Prado, D., Fialko, O., Vaithianathan, R (2018): A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In: Sorelle A. Friedler, Christo Wilson (eds): Proceedings of the 1st Conference on fairness, accountability and transparency, vol. 81: PMLR (Proceedings of Machine Learning Research), pp.\u00a0134\u2013148. Available online at https:\/\/proceedings.mlr.press\/v81\/chouldechova18a.html."},{"key":"280_CR18","unstructured":"Corbett-Davies, S., Goel, S (2018): The measure and mismeasure of fairness: a critical review of fair machine learning. arXiv:1808.00023 [cs.CY]."},{"key":"280_CR19","doi-asserted-by":"crossref","unstructured":"Cossette-Lefebvre, H., & Maclure, J. (2022). AI\u2019s fairness problem: understanding wrongful discrimination in the context of automated decision-making.\u00a0AI and Ethics. 1\u201315.","DOI":"10.1007\/s43681-022-00233-w"},{"issue":"4","key":"280_CR20","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1086\/709729","volume":"87","author":"KA Creel","year":"2020","unstructured":"Creel, K.A.: Transparency in complex computational systems. Philos Sci 87(4), 568\u2013589 (2020). https:\/\/doi.org\/10.1086\/709729","journal-title":"Philos Sci"},{"key":"280_CR21","doi-asserted-by":"crossref","unstructured":"Creel, K. A., Hellmann, D (2021): The Algorithmic leviathan: arbitrariness, fairness, and opportunity in algorithmic decision making systems. In Virginia Public Law and Legal Theory Research Paper No. 2021-13. https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=3786377.","DOI":"10.1145\/3442188.3445942"},{"key":"280_CR22","doi-asserted-by":"publisher","DOI":"10.3998\/ergo.12405314.0004.027","author":"A Currie","year":"2017","unstructured":"Currie, A.: From models-as-fictions to models-as-tools. Ergo (2017). https:\/\/doi.org\/10.3998\/ergo.12405314.0004.027","journal-title":"Ergo"},{"key":"280_CR23","doi-asserted-by":"crossref","unstructured":"D\u2019Amour, A., Srinivasan, H., Atwood, J., Baljekar, P., Sculley, D., Halpern, Y (2020): Fairness is Not static: deeper understanding of long term fairness via simulation studies. In: Proceedings of the 2020 conference on fairness, accountability, and transparency. New York, NY, USA: Association for Computing Machinery (FAT* \u201920), pp.\u00a0525\u2013534.","DOI":"10.1145\/3351095.3372878"},{"issue":"1","key":"280_CR24","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1037\/xge0000033","volume":"144","author":"BJ Dietvorst","year":"2015","unstructured":"Dietvorst, B.J., Simmons, J.P., Massey, C.: Algorithm aversion: people erroneously avoid algorithms after seeing them err. J Experiment Psychol 144(1), 114\u2013126 (2015)","journal-title":"J Experiment Psychol"},{"key":"280_CR25","doi-asserted-by":"crossref","unstructured":"Dodge, J., Liao, Q. V., Zhang, Y. B., Rachel K. E.; Dugan, C (2019): Explaining models: an empirical study of how explanations impact fairness judgment. In: Proceedings of the 24th international conference on intelligent user interfaces. New York, NY, USA: Association for Computing Machinery (IUI \u201919), pp.\u00a0275\u2013285.","DOI":"10.1145\/3301275.3302310"},{"key":"280_CR26","volume-title":"Automating inequality. How high-tech tools profile, police, and punish the poor","author":"V Eubanks","year":"2018","unstructured":"Eubanks, V.: Automating inequality. How high-tech tools profile, police, and punish the poor. St. Martin\u2019s Press, New York (2018)"},{"issue":"8","key":"280_CR27","doi-asserted-by":"publisher","first-page":"e12760","DOI":"10.1111\/phc3.12760","volume":"16","author":"S Fazelpour","year":"2021","unstructured":"Fazelpour, S., Danks, D.: Algorithmic bias: senses, sources, solutions. Philos Compass 16(8), e12760 (2021). https:\/\/doi.org\/10.1111\/phc3.12760","journal-title":"Philos Compass"},{"key":"280_CR28","doi-asserted-by":"publisher","DOI":"10.1017\/can.2021.24","author":"S Fazelpour","year":"2021","unstructured":"Fazelpour, S., Lipton, Z.C., Danks, D.: Algorithmic fairness and the situated dynamics of justice. Can J Philos (2021). https:\/\/doi.org\/10.1017\/can.2021.24","journal-title":"Can J Philos"},{"issue":"1","key":"280_CR29","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1007\/s13194-019-0270-8","volume":"10","author":"U Feest","year":"2020","unstructured":"Feest, U.: Construct validity in psychological tests\u2014the case of implicit social cognition. Euro J Philos Sci 10(1), 4 (2020). https:\/\/doi.org\/10.1007\/s13194-019-0270-8","journal-title":"Euro J Philos Sci"},{"issue":"3","key":"280_CR30","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1056\/NEJMc2104626","volume":"385","author":"SG Finlayson","year":"2021","unstructured":"Finlayson, S.G., Subbaswamy, A., Singh, K., Bowers, J., Kupke, A., Zittrain, J., et al.: The clinician and dataset shift in artificial intelligence. N Engl J Med 385(3), 283\u2013286 (2021). https:\/\/doi.org\/10.1056\/NEJMc2104626","journal-title":"N Engl J Med"},{"key":"280_CR31","doi-asserted-by":"publisher","DOI":"10.5195\/philmed.2021.27","author":"K Genin","year":"2021","unstructured":"Genin, K., Grote, T.: Randomized controlled trials in medical AI A methodological critique. Pom (2021). https:\/\/doi.org\/10.5195\/philmed.2021.27","journal-title":"Pom"},{"key":"280_CR32","doi-asserted-by":"crossref","unstructured":"Green, B., Chen, Y (2019a): Disparate interactions: an algorithm-in-the-loop analysis of fairness in risk assessments. In: Proceedings of the conference on fairness, accountability, and transparency. New York, NY, USA: Association for Computing Machinery (FAT* \u201919), pp.\u00a090\u201399.","DOI":"10.1145\/3287560.3287563"},{"key":"280_CR33","doi-asserted-by":"publisher","DOI":"10.1145\/3359152","author":"B Green","year":"2019","unstructured":"Green, B., Chen, Y.: The Principles and limits of algorithm-in-the-loop decision making. Proc ACM Hum-Comput Interact (2019). https:\/\/doi.org\/10.1145\/3359152","journal-title":"Proc ACM Hum-Comput Interact"},{"key":"280_CR34","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-022-00584-6","author":"B Green","year":"2022","unstructured":"Green, B.: Escaping the impossibility of fairness: from formal to substantive algorithmic fairness. Philos Technol (2022). https:\/\/doi.org\/10.1007\/s13347-022-00584-6","journal-title":"Philos Technol"},{"issue":"3","key":"280_CR35","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1007\/s10676-022-09658-7","volume":"24","author":"T Grote","year":"2022","unstructured":"Grote, T., Keeling, G.: Enabling fairness in healthcare through machine learning. Ethics Inf Technol 24(3), 39 (2022)","journal-title":"Ethics Inf Technol"},{"key":"280_CR36","unstructured":"Hardt, M., Price, E., Srebo, N (2016): Equality of opportunity in supervised learning. arXiv:1610.02413 [cs.LG]."},{"key":"280_CR37","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1007\/s11098-014-0434-5","volume":"173","author":"S Haslanger","year":"2016","unstructured":"Haslanger, S.: What is a (social) structural explanation? Philos Stud 173, 113\u2013130 (2016)","journal-title":"Philos Stud"},{"key":"280_CR38","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-021-01357-z","author":"J Himmelreich","year":"2022","unstructured":"Himmelreich, J.: Against \u201cdemocratizing AI.\u201d AI Soc (2022). https:\/\/doi.org\/10.1007\/s00146-021-01357-z","journal-title":"AI Soc"},{"key":"280_CR39","doi-asserted-by":"crossref","unstructured":"Hu, L., Chen, Y (2018): A short-term intervention for long-term fairness in the labor market. In: Proceedings of the 2018 world wide web conference. Republic and canton of Geneva, CHE: international world wide web conferences steering committee (WWW \u201918), pp.\u00a01389\u20131398.","DOI":"10.1145\/3178876.3186044"},{"key":"280_CR40","doi-asserted-by":"crossref","unstructured":"Hu, L., Immorlica, N., Vaughan, JW (2019): The Disparate effects of strategic manipulation. In: Proceedings of the conference on fairness, accountability, and transparency. New York, NY, USA: Association for Computing Machinery (FAT* \u201919), pp.\u00a0259\u2013268.","DOI":"10.1145\/3287560.3287597"},{"key":"280_CR41","doi-asserted-by":"crossref","unstructured":"Hu, L., Kohler-Hausmann, I (2020): What\u2019s sex got to do with machine learning? In: Proceedings of the 2020 conference on fairness, accountability, and transparency. New York, NY, USA: Association for Computing Machinery (FAT* \u201920), p.\u00a0513.","DOI":"10.1145\/3351095.3375674"},{"key":"280_CR42","doi-asserted-by":"crossref","unstructured":"Jacobs, AZ., Wallach, H (2021): Measurement and fairness. In: Proceedings of the 2021 ACM conference on fairness, accountability, and transparency. New York, NY, USA: Association for Computing Machinery (FAccT \u201921), pp.\u00a0375\u2013385.","DOI":"10.1145\/3442188.3445901"},{"key":"280_CR43","unstructured":"Jagadeesan, M., Mendler-D\u00fcnner, C., Hardt, M (2021): Alternative microfoundations for strategic classification. arXiv:2106.12705 [cs.LG]."},{"key":"280_CR44","volume-title":"Noise: a flaw in human judgment","author":"D Kahneman","year":"2021","unstructured":"Kahneman, D., Sibony, O., Sunstein, C.R.: Noise: a flaw in human judgment. Hachette, London (2021)"},{"key":"280_CR45","unstructured":"Kizilec, F., Lee, H (2020): Algorithmic fairness in education. arXiv:2007.05443 [cs.CY]."},{"issue":"1","key":"280_CR46","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1093\/qje\/qjx032","volume":"133","author":"J Kleinberg","year":"2017","unstructured":"Kleinberg, J., Lakkaraju, H., Leskovec, J., Ludwig, J., Mullainathan, S.: Human decisions and machine predictions*. Q J Econ 133(1), 237\u2013293 (2017). https:\/\/doi.org\/10.1093\/qje\/qjx032","journal-title":"Q J Econ"},{"key":"280_CR47","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1093\/jla\/laz001","volume":"10","author":"J Kleinberg","year":"2018","unstructured":"Kleinberg, J., Ludwig, J., Mullainathan, S., Sunstein, C.R.: Discrimination in the age of algorithms. J Legal Anal 10, 113\u2013174 (2018). https:\/\/doi.org\/10.1093\/jla\/laz001","journal-title":"J Legal Anal"},{"key":"280_CR48","doi-asserted-by":"crossref","unstructured":"Lakkaraju, H., Kleinberg, J., Leskovec, J., Ludwig, J., Mullainathan, S (2017): The selective labels problem: evaluating algorithmic predictions in the presence of unobservables. In: Proceedings of the 23rd ACM SIGKDD International conference on knowledge discovery and data mining. New York, NY, USA: Association for Computing Machinery (KDD \u201917), pp.\u00a0275\u2013284.","DOI":"10.1145\/3097983.3098066"},{"key":"280_CR49","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199796113.001.0001","volume-title":"Born free and equal?: A philosophical inquiry into the nature of discrimination","author":"K Lippert-Rasmussen","year":"2013","unstructured":"Lippert-Rasmussen, K.: Born free and equal?: A philosophical inquiry into the nature of discrimination. Oxford University Press, Princeton, New Jersey (2013)"},{"issue":"3","key":"280_CR50","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3236386.3241340","volume":"16","author":"ZC Lipton","year":"2018","unstructured":"Lipton, Z.C.: The mythos of model interpretability: in machine learning, the concept of interpretability is both important and slippery. Queue 16(3), 31\u201357 (2018). https:\/\/doi.org\/10.1145\/3236386.3241340","journal-title":"Queue"},{"key":"280_CR51","unstructured":"Liu, LT., Dean, S., Rolf, E., Simchowitz, M., Hardt, M (2018): Delayed Impact of fair machine learning. In: Jennifer Dy, Andreas Krause (eds): Proceedings of the 35th international conference on machine learning, vol. 80: PMLR (Proceedings of Machine Learning Research), pp.\u00a03150\u20133158. Available online at https:\/\/proceedings.mlr.press\/v80\/liu18c.html."},{"issue":"3","key":"280_CR52","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1007\/s11023-021-09570-x","volume":"31","author":"J Maclure","year":"2021","unstructured":"Maclure, J.: AI, explainability and public reason: the argument from the limitations of the human mind. Mind Mach 31(3), 421\u2013438 (2021)","journal-title":"Mind Mach"},{"key":"280_CR53","doi-asserted-by":"crossref","unstructured":"Milli, S., Miller, J., Dragan, AD., Hardt, M (2019): The Social cost of strategic classification. In: proceedings of the conference on fairness, accountability, and transparency. New York, NY, USA: Association for Computing Machinery (FAT* \u201919), pp.\u00a0230\u2013239.","DOI":"10.1145\/3287560.3287576"},{"issue":"1","key":"280_CR54","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1146\/annurev-statistics-042720-125902","volume":"8","author":"S Mitchell","year":"2021","unstructured":"Mitchell, S., Potash, E., Barocas, S., D\u2019Amour, A., Lum, K.: Algorithmic fairness: choices, assumptions, and definitions. Ann Rev Stat Appl 8(1), 141\u2013163 (2021). https:\/\/doi.org\/10.1146\/annurev-statistics-042720-125902","journal-title":"Ann Rev Stat Appl"},{"key":"280_CR55","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1257\/pandp.20211078","volume":"111","author":"S Mullainathan","year":"2021","unstructured":"Mullainathan, S., Obermeyer, Z.: On the inequity of predicting A while hoping for B. AEA Papers Proc 111, 37\u201342 (2021). https:\/\/doi.org\/10.1257\/pandp.20211078","journal-title":"AEA Papers Proc"},{"key":"280_CR56","doi-asserted-by":"publisher","DOI":"10.18574\/nyu\/9781479833641.001.0001","volume-title":"Algorithms of oppression. How search engines reinforce racism","author":"SU Noble","year":"2018","unstructured":"Noble, S.U.: Algorithms of oppression. How search engines reinforce racism. NYU Press, New York (2018)"},{"key":"280_CR57","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.shpsa.2019.09.002","volume":"81","author":"R Northcott","year":"2020","unstructured":"Northcott, R.: Big data and prediction: four case studies. Stud History Philos Sci Part A 81, 96\u2013104 (2020)","journal-title":"Stud History Philos Sci Part A"},{"issue":"6464","key":"280_CR58","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1126\/science.aax2342","volume":"366","author":"Z Obermeyer","year":"2019","unstructured":"Obermeyer, Z., Powers, B., Vogeli, C., Mullainathan, S.: Dissecting racial bias in an algorithm used to manage the health of populations. Science 366(6464), 447\u2013453 (2019). https:\/\/doi.org\/10.1126\/science.aax2342","journal-title":"Science"},{"key":"280_CR59","volume-title":"The difference: how the power of diversity creates better groups, firms, schools, and societies","author":"SE Page","year":"2007","unstructured":"Page, S.E.: The difference: how the power of diversity creates better groups, firms, schools, and societies. Princeton University Press, Princeton, New Jersey (2007)"},{"issue":"3","key":"280_CR60","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1086\/708691","volume":"87","author":"WS Parker","year":"2020","unstructured":"Parker, W.S.: Model evaluation: an adequacy-for-purpose view. Philos Sci 87(3), 457\u2013477 (2020). https:\/\/doi.org\/10.1086\/708691","journal-title":"Philos Sci"},{"key":"280_CR61","doi-asserted-by":"crossref","unstructured":"Passi, S., Barocas, S (2019): Problem formulation and fairness. In: proceedings of the conference on fairness, accountability, and transparency. New York, NY, USA: Association for Computing Machinery (FAT* \u201919), pp.\u00a039\u201348.","DOI":"10.1145\/3287560.3287567"},{"key":"280_CR62","unstructured":"Perdomo, J., Zrnic, T., Mendler-D\u00fcnner, C., Hardt, M (2020): Performative prediction. In Hal Daum\u00e9 III, Aarti Singh (Eds.): Proceedings of the 37th international conference on machine learning, vol. 119: PMLR (Proceedings of Machine Learning Research), pp.\u00a07599\u20137609. Available online at https:\/\/proceedings.mlr.press\/v119\/perdomo20a.html."},{"issue":"7","key":"280_CR63","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1038\/s41562-020-0858-1","volume":"4","author":"E Pierson","year":"2020","unstructured":"Pierson, E., Simoiu, C., Overgoor, J., Corbett-Davies, S., Jenson, D., Shoemaker, A., et al.: A large-scale analysis of racial disparities in police stops across the United States. Nat Human Behav 4(7), 736\u2013745 (2020). https:\/\/doi.org\/10.1038\/s41562-020-0858-1","journal-title":"Nat Human Behav"},{"key":"280_CR64","doi-asserted-by":"crossref","unstructured":"Poursabzi-Sangdeh, F., Goldstein, DG., Hofman, JM., Wortman Vaughan, JW., Wallach, H (2021): Manipulating and measuring model interpretability. In: Proceedings of the 2021 CHI conference on human factors in computing systems. New York, NY, USA: Association for Computing Machinery (CHI \u201921).","DOI":"10.1145\/3411764.3445315"},{"issue":"5","key":"280_CR65","doi-asserted-by":"publisher","first-page":"1101","DOI":"10.1086\/715512","volume":"88","author":"D Pruss","year":"2021","unstructured":"Pruss, D.: Mechanical jurisprudence and domain distortion: how predictive algorithms warp the law. Philos Sci 88(5), 1101\u20131112 (2021). https:\/\/doi.org\/10.1086\/715512","journal-title":"Philos Sci"},{"key":"280_CR66","doi-asserted-by":"crossref","unstructured":"Raji, I. D., Smart, A., White, R. N., Mitchell, M., Gebru, T., Hutchinson, B., & Barnes, P. (2020). Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing. In\u00a0Proceedings of the 2020 conference on fairness, accountability, and transparency\u00a0(pp. 33\u201344).","DOI":"10.1145\/3351095.3372873"},{"issue":"15","key":"280_CR67","doi-asserted-by":"publisher","first-page":"8398","DOI":"10.1073\/pnas.1915006117","volume":"117","author":"MJ Salganik","year":"2020","unstructured":"Salganik, M.J., et al.: Measuring the predictability of life outcomes with a scientific mass collaboration. Proc Natl Acad Sci 117(15), 8398\u20138403 (2020)","journal-title":"Proc Natl Acad Sci"},{"issue":"3","key":"280_CR68","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1111\/j.1468-5930.2012.00563.x","volume":"29","author":"G Schouten","year":"2012","unstructured":"Schouten, G.: Educational justice: closing gaps or paying debts? J Appl Philos 29(3), 231\u2013242 (2012). https:\/\/doi.org\/10.1111\/j.1468-5930.2012.00563.x","journal-title":"J Appl Philos"},{"key":"280_CR69","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1007\/s13194-021-00415-z","volume":"11","author":"Y Shan","year":"2021","unstructured":"Shan, Y., Williamson, J.: Applying evidential pluralism to the social sciences. Euro Jnl Phil Sci 11, 96 (2021). https:\/\/doi.org\/10.1007\/s13194-021-00415-z","journal-title":"Euro Jnl Phil Sci"},{"issue":"3","key":"280_CR70","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1007\/s13194-018-0209-5","volume":"8","author":"D Steel","year":"2018","unstructured":"Steel, D., Fazelpour, S., Gillette, K., Crewe, B., Burgess, M.: Multiple diversity concepts and their ethical-epistemic implications. Eur J Philos Sci 8(3), 761\u2013780 (2018). https:\/\/doi.org\/10.1007\/s13194-018-0209-5","journal-title":"Eur J Philos Sci"},{"key":"280_CR71","unstructured":"Stevenson, Megan; Doleac, Jennifer L. (2021): Algorithmic Risk Assessment in the Hands of Humans. https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=3489440. Accessed 2 Jan 2023"},{"issue":"7","key":"280_CR72","first-page":"1851","volume":"119","author":"KJ Strandburg","year":"2019","unstructured":"Strandburg, K.J.: Rulemaking and inscrutable automated decision tools. Columbia Law Rev 119(7), 1851\u20131886 (2019)","journal-title":"Columbia Law Rev"},{"key":"280_CR73","doi-asserted-by":"publisher","DOI":"10.1093\/bjps\/axz035","author":"E Sullivan","year":"2020","unstructured":"Sullivan, E.: Understanding from machine learning models. British J Philos Sci (2020). https:\/\/doi.org\/10.1093\/bjps\/axz035","journal-title":"British J Philos Sci"},{"key":"280_CR74","unstructured":"Tal, Eran, \"Measurement in Science\",\u00a0The Stanford Encyclopedia of Philosophy\u00a0(Fall 2020 Edition), Edward N. Zalta\u00a0(eds), URL = <https:\/\/plato.stanford.edu\/archives\/fall2020\/entries\/measurement-science\/>"},{"key":"280_CR75","doi-asserted-by":"publisher","unstructured":"Tasioulas, J.: The rule of algorithm and the rule of law.\u00a0Vienna Lectures on Legal Philosophy. Available at SSRN: https:\/\/ssrn.com\/abstract=4319969 or https:\/\/doi.org\/10.2139\/ssrn.4319969 (2023).","DOI":"10.2139\/ssrn.4319969"},{"issue":"8","key":"280_CR76","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1038\/s41591-020-0942-0","volume":"26","author":"P Tschandl","year":"2020","unstructured":"Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., et al.: Human\u2013computer collaboration for skin cancer recognition. Nature Med 26(8), 1229\u20131234 (2020). https:\/\/doi.org\/10.1038\/s41591-020-0942-0","journal-title":"Nature Med"},{"issue":"4157","key":"280_CR77","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1126\/science.185.4157.1124","volume":"185","author":"T Amos","year":"1974","unstructured":"Amos, T., Daniel, K.: Judgment under uncertainty: heuristics and biases. Science 185(4157), 1124\u20131131 (1974). https:\/\/doi.org\/10.1126\/science.185.4157.1124","journal-title":"Science"},{"key":"280_CR78","unstructured":"V\u00e4yrynen, P (2021): Thick ethical concepts. The Stanford Encyclopedia of Philosophy. In: Edward N. Zalta\u00a0(eds) Springer, URL = <https:\/\/plato.stanford.edu\/archives\/spr2021\/entries\/thick-ethical-concepts\/>"},{"issue":"10","key":"280_CR79","doi-asserted-by":"publisher","first-page":"e12624","DOI":"10.1111\/phc3.12624","volume":"14","author":"E Vessonen","year":"2019","unstructured":"Vessonen, E.: Operationalism and realism in psychometrics. Philos Compass 14(10), e12624 (2019). https:\/\/doi.org\/10.1111\/phc3.12624","journal-title":"Philos Compass"},{"key":"280_CR80","doi-asserted-by":"publisher","first-page":"639","DOI":"10.5840\/jphil20071041240","volume":"104","author":"M Weisberg","year":"2007","unstructured":"Weisberg, M.: Three kinds of idealization. J Philo 104, 639\u2013659 (2007)","journal-title":"J Philo"},{"issue":"2","key":"280_CR81","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1086\/644786","volume":"76","author":"M Weisberg","year":"2009","unstructured":"Weisberg, M., Muldoon, R.: Epistemic landscapes and the division of cognitive labor. Philos Sci 76(2), 225\u2013252 (2009). https:\/\/doi.org\/10.1086\/644786","journal-title":"Philos Sci"},{"key":"280_CR82","doi-asserted-by":"publisher","DOI":"10.1017\/can.2021.17","author":"A Zimmermann","year":"2021","unstructured":"Zimmermann, A., Lee-Stronach, C.: Proceed with Caution. Can J of Philos (2021). https:\/\/doi.org\/10.1017\/can.2021.17","journal-title":"Can J of Philos"}],"container-title":["AI and Ethics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-023-00280-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43681-023-00280-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-023-00280-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,8]],"date-time":"2024-05-08T06:09:41Z","timestamp":1715148581000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43681-023-00280-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,12]]},"references-count":82,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,5]]}},"alternative-id":["280"],"URL":"https:\/\/doi.org\/10.1007\/s43681-023-00280-x","relation":{},"ISSN":["2730-5953","2730-5961"],"issn-type":[{"value":"2730-5953","type":"print"},{"value":"2730-5961","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,12]]},"assertion":[{"value":"5 January 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"None.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}