{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T11:16:14Z","timestamp":1773141374801,"version":"3.50.1"},"reference-count":81,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T00:00:00Z","timestamp":1690156800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T00:00:00Z","timestamp":1690156800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Institut f\u00fcr angewandte Forschung Berlin e.V."},{"name":"Hochschule f\u00fcr Technik und Wirtschaft Berlin"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The use of technologies in personnel selection has come under increased scrutiny in recent years, revealing their potential to amplify existing inequalities in recruitment processes. To date, however, there has been a lack of comprehensive assessments of respective discriminatory potentials and no legal or practical standards have been explicitly established for fairness auditing. The current proposal of the Artificial Intelligence Act classifies numerous applications in personnel selection and recruitment as high-risk technologies, and while it requires quality standards to protect the fundamental rights of those involved, particularly during development, it does not provide concrete guidance on how to ensure this, especially once the technologies are commercially available. We argue that comprehensive and reliable auditing of personnel selection technologies must be contextual, that is, embedded in existing processes and based on real data, as well as participative, involving various stakeholders beyond technology vendors and customers, such as advocacy organizations and researchers. We propose an architectural draft that employs a data trustee to provide independent, fiduciary management of personal and corporate data to audit the fairness of technologies used in personnel selection. Drawing on a case study conducted with two state-owned companies in Berlin, Germany, we discuss challenges and approaches related to suitable fairness metrics, operationalization of vague concepts such as migration* and applicable legal foundations that can be utilized to overcome the fairness-privacy-dilemma arising from uncertainties associated with current laws. We highlight issues that require further interdisciplinary research to enable a prototypical implementation of the auditing concept in the mid-term.<\/jats:p>","DOI":"10.1007\/s00146-023-01726-w","type":"journal-article","created":{"date-parts":[[2023,7,24]],"date-time":"2023-07-24T20:31:43Z","timestamp":1690230703000},"page":"2507-2523","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["More or less discrimination? Practical feasibility of fairness auditing of technologies for personnel selection"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0782-5382","authenticated-orcid":false,"given":"Helena","family":"Mihaljevi\u0107","sequence":"first","affiliation":[]},{"given":"Ivana","family":"M\u00fcller","sequence":"additional","affiliation":[]},{"given":"Katja","family":"Dill","sequence":"additional","affiliation":[]},{"given":"Aysel","family":"Yollu-Tok","sequence":"additional","affiliation":[]},{"given":"Maximilian","family":"von Grafenstein","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,7,24]]},"reference":[{"key":"1726_CR1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3437631","author":"I Ajunwa","year":"2019","unstructured":"Ajunwa I (2019) An auditing imperative for automated hiring. Harv J Law Technol. https:\/\/doi.org\/10.2139\/ssrn.3437631","journal-title":"Harv J Law Technol."},{"key":"1726_CR2","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2746078","author":"I Ajunwa","year":"2020","unstructured":"Ajunwa I (2020) The Paradox of Automation as Anti-Bias Intervention. Cardozo Law Rev. https:\/\/doi.org\/10.2139\/ssrn.2746078","journal-title":"Cardozo Law Rev"},{"key":"1726_CR3","unstructured":"Algorithm Watch (2020) Data Trusts. Sovereignty in handling your personal data. https:\/\/algorithmwatch.org\/en\/data-trusts\/. Accessed on 15 Feb 2023"},{"key":"1726_CR4","doi-asserted-by":"publisher","first-page":"5","DOI":"10.3389\/fdata.2020.00005","volume":"3","author":"D Allhutter","year":"2020","unstructured":"Allhutter D, Cech F, Fischer F et al (2020) Algorithmic Profiling of Job Seekers in Austria: How Austerity Politics Are Made Effective. Front Big Data 3:5. https:\/\/doi.org\/10.3389\/fdata.2020.00005","journal-title":"Front Big Data"},{"key":"1726_CR5","unstructured":"Angwin J, Scheiber N, Tobin A (2020) Dozens of Companies Are Using Facebook to Exclude Older Workers From Job Ads. https:\/\/www.propublica.org\/article\/facebook-ads-age-discrimination-targeting. Accessed on 15 Feb 2023"},{"key":"1726_CR6","unstructured":"Aronson E, Wilson TD, Akert RM, et\u00a0al (2008) Sozialpsychologie, 6th edn. Pearson Studium"},{"key":"1726_CR7","first-page":"421","volume-title":"Universalit\u00e4t - Schutzmechanismen - Diskriminierungsverbote","author":"S Baer","year":"2008","unstructured":"Baer S (2008) Ungleichheit der Gleichheiten? Zur Hierarchisierung von Diskriminierungsverboten. In: Klein E, Menke C (eds) Universalit\u00e4t - Schutzmechanismen - Diskriminierungsverbote. Berliner Wissenschafts-Verlag, Berlin, pp 421\u2013450"},{"key":"1726_CR8","unstructured":"Beigang S, Fetz K, Kalkum D, et al (2017) Diskriminierungserfahrungen in Deutschland. Ergebnisse einer Repr\u00e4sentativ- und einer Betroffenenbefragung. Tech. rep., Nomos, Baden-Baden, https:\/\/www.antidiskriminierungsstelle.de\/SharedDocs\/downloads\/DE\/publikationen\/Expertisen\/expertise_diskriminierungserfahrungen_in_deutschland.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR9","unstructured":"Benjamins R (2019) Is your AI system discriminating without knowing it?: The paradox between fairness and privacy. https:\/\/business.blogthinkbig.com\/is-your-ai-system-discriminating-without-knowing-it-the-paradox-between-fairness-and-privacy\/. Accessed on 15 Feb 2023"},{"key":"1726_CR10","volume-title":"What regulation for data trusts should look like","author":"A Blankertz","year":"2021","unstructured":"Blankertz A, Specht L (2021) What regulation for data trusts should look like. Tech. rep, Stiftung Neue Verantwortung"},{"key":"1726_CR11","unstructured":"Bogen M (2019) All the Ways Hiring Algorithms Can Introduce Bias. Harvard Business Review, https:\/\/hbr.org\/2019\/05\/all-the-ways-hiring-algorithms-can-introduce-bias. Accessed on 15 Feb 2023"},{"key":"1726_CR12","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720935146","author":"B Brevini","year":"2020","unstructured":"Brevini B, Pasquale F (2020) Revisiting the Black Box Society by rethinking the political economy of big data. Big Data Soc. https:\/\/doi.org\/10.1177\/2053951720935146","journal-title":"Big Data Soc"},{"key":"1726_CR13","unstructured":"Center for Intersectional Justice (2019) Intersektionalit\u00e4t in Deutschland. Chancen, L\u00fccken und Herausforderungen. Tech. rep., Berlin, https:\/\/www.dezim-institut.de\/fileadmin\/PDF-Download\/CIJ_Broschuere_190917_web.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR14","doi-asserted-by":"crossref","unstructured":"Chen L, Hartmann V, West R (2023) DiPPS: Differentially Private Propensity Scores for Bias Correction. In: Lin YR, Cha M, Quercia D (eds) Proceedings of the Seventeenth International AAAI Conference on Web and Social Media, Association for the Advancement of Artificial Intelligence (AAAI), vol\u00a017. Association for the Advancement of Artificial Intelligence (AAAI)","DOI":"10.1609\/icwsm.v17i1.22131"},{"key":"1726_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.techfore.2021.121459","author":"J Cloos","year":"2022","unstructured":"Cloos J, Mohr S (2022) Acceptance of data sharing in smartphone apps from key industries of the digital transformation: a representative population survey for Germany. Technol Forecast Soc Change. https:\/\/doi.org\/10.1016\/j.techfore.2021.121459","journal-title":"Technol Forecast Soc Change"},{"key":"1726_CR16","unstructured":"Crawford K, Dobbe R, Dryer T, et\u00a0al (2019) AI Now 2019 Report. Tech. rep., AI Now Institute, New York, https:\/\/ainowinstitute.org\/AI_Now_2019_Report.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR01","unstructured":"Creative Diversity Network (2022) Diamond\u2014Creative Diversity Network. https:\/\/creativediversitynetwork.com\/diamond\/"},{"key":"1726_CR17","doi-asserted-by":"publisher","unstructured":"Dastin J (2018) Amazon Scraps Secret AI Recruiting Tool that Showed Bias against Women. In: Ethics of Data and Analytics. Kirsten Martin, Auerbach Publications, p 269\u2013299, https:\/\/doi.org\/10.1201\/9781003278290-44","DOI":"10.1201\/9781003278290-44"},{"key":"1726_CR18","unstructured":"Digital Regulation Cooperation Forum-DRCF (2022) Auditing algorithms: the existing landscape, role of regulators and future outlook. Findings from the DRCF Algorithmic Processing workstream-Spring 2022 https:\/\/assets.publishing.service.gov.uk\/government\/uploads\/system\/uploads\/attachment_data\/file\/1071554\/DRCF_Algorithmic_audit.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR19","unstructured":"Dobbe R, Dean S, Gilbert T, et\u00a0al (2018) A broader view on bias in automated decision-making: Reflecting on epistemology and dynamics. ArXiv abs\/1807.00553"},{"key":"1726_CR20","doi-asserted-by":"publisher","unstructured":"El-Mafaalani A (2017) Diskriminierung von Menschen mit Migrationshintergrund. In: Scherr A, El-Mafaalani A, Y\u00fcksel G (eds) Handbuch Diskriminierung. Springer Reference Sozialwissenschaften, Springer Fachmedien, Wiesbaden, p 465\u2013478, https:\/\/doi.org\/10.1007\/978-3-658-10976-9_26","DOI":"10.1007\/978-3-658-10976-9_26"},{"key":"1726_CR21","unstructured":"Engler A (2021a) Auditing employment algorithms for discrimination. Brookins, https:\/\/www.brookings.edu\/research\/auditing-employment-algorithms-for-discrimination\/. Accessed on 15 Feb 2023"},{"key":"1726_CR22","unstructured":"Engler A (2021b) Independent auditors are struggling to hold AI companies accountable. Fast Company, https:\/\/www.fastcompany.com\/90597594\/ai-algorithm-auditing-hirevue. Accessed on 15 Feb 2023"},{"key":"1726_CR23","unstructured":"Fiske ST, Taylor SE (1984) Social Cognition. Topics in social psychology, Addison-Wesley Pub. Co, Reading, Mass"},{"key":"1726_CR24","unstructured":"Funke M (2020) Die Vereinbarkeit von Data Trusts mit der DSGVO. Tech. rep., Algorithm Watch, Berlin, https:\/\/algorithmwatch.org\/de\/wp-content\/uploads\/2020\/11\/Die-Vereinbarkeit-von-Data-Trusts-mit-der-DSGVO-Michael-Funke-AlgorithmWatch-2020-1.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR25","volume-title":"Social Psychology","author":"T Gilovich","year":"2010","unstructured":"Gilovich T, Keltner D, Nisbett RE (2010) Social Psychology, 2nd edn. Norton, New York, NY","edition":"2"},{"key":"1726_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3479562","volume":"5","author":"B Green","year":"2021","unstructured":"Green B, Chen Y (2021) Algorithmic Risk Assessments Can Alter Human Decision-Making Processes in High-Stakes Government Contexts. Proc ACM Hum-Comput Interact 5:1\u201333. https:\/\/doi.org\/10.1145\/3479562","journal-title":"Proc ACM Hum-Comput Interact"},{"key":"1726_CR27","unstructured":"Guijarro\u00a0Santos V (2023) Nicht besser als nichts. Ein Kommentar zum KI-Verordnungsentwurf der EU Kommission und des Rats der EU. Zeitschrift f\u00fcr Digitalisierung und Recht 1"},{"key":"1726_CR28","doi-asserted-by":"publisher","unstructured":"Haeri MA, Zweig KA (2020) The Crucial Role of Sensitive Attributes in Fair Classification. In: 2020 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, Canberra, ACT, Australia, pp 2993\u20133002, https:\/\/doi.org\/10.1109\/SSCI47803.2020.9308585","DOI":"10.1109\/SSCI47803.2020.9308585"},{"key":"1726_CR29","doi-asserted-by":"publisher","DOI":"10.1016\/j.clsr.2021.105583","author":"MP Hauer","year":"2021","unstructured":"Hauer MP, Kevekordes J, Haeri MA (2021) Legal perspective on possible fairness measures\u2014a legal discussion using the example of hiring decisions. Comput Law Secur Rev. https:\/\/doi.org\/10.1016\/j.clsr.2021.105583","journal-title":"Comput Law Secur Rev"},{"key":"1726_CR30","unstructured":"Hu J (2019) Report: 99% of Fortune 500 companies use Applicant Tracking Systems. https:\/\/www.jobscan.co\/blog\/99-percent-fortune-500-ats\/. Accessed on 15 Feb 2023"},{"key":"1726_CR31","doi-asserted-by":"publisher","unstructured":"Hutchinson B, Mitchell M (2019) 50 Years of Test (Un)fairness: Lessons for Machine Learning. In: Proceedings of the Conference on Fairness, Accountability, and Transparency - FAT* \u201919. ACM Press, Atlanta, GA, USA, pp 49\u201358, https:\/\/doi.org\/10.1145\/3287560.3287600","DOI":"10.1145\/3287560.3287600"},{"key":"1726_CR32","doi-asserted-by":"publisher","unstructured":"Jacobs AZ, Wallach H (2021) Measurement and Fairness. In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. ACM, Virtual Event Canada, pp 375\u2013385, https:\/\/doi.org\/10.1145\/3442188.3445901","DOI":"10.1145\/3442188.3445901"},{"key":"1726_CR33","doi-asserted-by":"publisher","DOI":"10.1177\/20539517221113772","author":"O Keyes","year":"2022","unstructured":"Keyes O, Austin J (2022) Feeling fixes: Mess and emotion in algorithmic audits. Big Data Soc. https:\/\/doi.org\/10.1177\/20539517221113772","journal-title":"Big Data Soc"},{"key":"1726_CR34","unstructured":"Kim PT (2017) Auditing Algorithms for Discrimination. 166 University of Pennsylvania Law Review Online. Legal Studies Research Paper No. 17-12-03"},{"key":"1726_CR35","doi-asserted-by":"publisher","unstructured":"Knapp GA (2012) Verh\u00e4ltnisbestimmungen: Geschlecht, klasse, ethnizit\u00e4t in gesellschaftstheoretischer perspektive1. In: Im Widerstreit: Feministische Theorie in Bewegung. VS Verlag f\u00fcr Sozialwissenschaften, Wiesbaden, p 429\u2013460, https:\/\/doi.org\/10.1007\/978-3-531-94139-4_16","DOI":"10.1007\/978-3-531-94139-4_16"},{"key":"1726_CR36","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3778998","author":"A Koshiyama","year":"2021","unstructured":"Koshiyama A, Kazim E, Treleaven P et al (2021) Towards Algorithm Auditing: A Survey on Managing Legal. SSRN Electronic J Ethical Technol Risks of AI ML Assoc Algorithms. https:\/\/doi.org\/10.2139\/ssrn.3778998","journal-title":"SSRN Electronic J Ethical Technol Risks of AI ML Assoc Algorithms"},{"key":"1726_CR37","unstructured":"Krafft TD, Zweig KA (2018) Wie Gesellschaft algorithmischen Entscheidungen auf den Zahn f\u00fchlen kann. In: Mohabbat Kar R, Thapa BEP, Parycek P (eds) (Un)berechenbar? Algorithmen und Automatisierung in Staat und Gesellschaft, Fraunhofer-Institut f\u00fcr Offene Kommunikationssysteme FOKUS, Kompetenzzentrum \u00d6ffentliche IT (\u00d6FIT), Berlin, pp 471\u2013492"},{"key":"1726_CR38","unstructured":"Kusner MJ, Loftus J, Russell C, et\u00a0al (2017) Counterfactual Fairness. In: Proceedings of the 31th International Conference on Neural Information Processing Systems, NIPS\u201917, pp 4069\u20134079"},{"key":"1726_CR39","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.ijinfomgt.2019.05.004","volume":"50","author":"X Lin","year":"2020","unstructured":"Lin X, Wang X (2020) Examining gender differences in people\u2019s information-sharing decisions on social networking sites. Int J Inform Manag 50:45\u201356. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2019.05.004","journal-title":"Int J Inform Manag"},{"key":"1726_CR40","unstructured":"Makkonen T (2007) Die Bemessung von Diskriminierung: Datenerhebung und EU-Rechtsvorschriften zur Gleichstellung. Tech. rep., Europ\u00e4ischen Netzwerks von Rechtsexperten im Bereich der Nichtdiskriminierung, http:\/\/op.europa.eu\/de\/publication-detail\/-\/publication\/7d20295d-212c-4acb-bd9f-6f67f4c7ce67. Accessed on 15 Feb 2023"},{"key":"1726_CR41","unstructured":"Michot S, Mollen A, Wulf J (2022) Algorithmenbasierte Diskriminierung. Warum Antidiskriminierungsgesetze jetzt angepasst werden m\u00fcssen. Tech. rep., AW AlgorithmWatch gGmbH und Gesellschaft f\u00fcr Informatik e.V. (GI), https:\/\/algorithmwatch.org\/de\/digital-autonomy-policy-brief-5\/. Accessed on 15 Feb 2023"},{"key":"1726_CR42","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0274312","author":"H Mihaljevi\u0107","year":"2022","unstructured":"Mihaljevi\u0107 H, M\u00fcller I, Dill K et al (2022) Towards gender-inclusive job postings: a data-driven comparison of augmented writing technologies. PLOS ONE. https:\/\/doi.org\/10.1371\/journal.pone.0274312","journal-title":"PLOS ONE"},{"key":"1726_CR43","doi-asserted-by":"publisher","unstructured":"Mulligan DK, Kroll JA, Kohli N, et\u00a0al (2019) This Thing Called Fairness. In: Proceedings of the ACM on Human-Computer Interaction, vol\u00a03. ACM, New York, pp 1\u201336, https:\/\/doi.org\/10.1145\/3359221","DOI":"10.1145\/3359221"},{"key":"1726_CR44","doi-asserted-by":"publisher","unstructured":"Nadeem M, Bethke A, Reddy S (2021) StereoSet: Measuring stereotypical bias in pretrained language models. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Association for Computational Linguistics, Online, pp 5356\u20135371, https:\/\/doi.org\/10.18653\/v1\/2021.acl-long.416","DOI":"10.18653\/v1\/2021.acl-long.416"},{"key":"1726_CR45","unstructured":"O\u2019Neil Risk Consulting and Algorithmic Auditing (ORCAA) (2020) Description of Algorithmic Audit: Pre-built Assessments. Tech. rep., https:\/\/techinquiry.org\/HireVue-ORCAA.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR46","unstructured":"Open Data Institute (2018) Defining a \u2018data trust\u2019. https:\/\/theodi.org\/article\/defining-a-data-trust\/. Accessed on 15 Feb 2023"},{"key":"1726_CR47","unstructured":"Open Data Institute (2020) Data trusts in 2020. https:\/\/theodi.org\/article\/data-trusts-in-2020\/. Accessed on 15 Feb 2023"},{"key":"1726_CR48","volume-title":"Diskriminierungsrisiken durch Verwendung von Algorithmen: eine Studie, erstellt mit einer Zuwendung der Antidiskriminierungsstelle des Bundes","author":"C Orwat","year":"2019","unstructured":"Orwat C (2019) Diskriminierungsrisiken durch Verwendung von Algorithmen: eine Studie, erstellt mit einer Zuwendung der Antidiskriminierungsstelle des Bundes, 1st edn. Nomos, Baden-Baden","edition":"1"},{"issue":"4","key":"1726_CR49","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1177\/0038038520904918","volume":"54","author":"R Pearce","year":"2020","unstructured":"Pearce R (2020) A Methodology for the Marginalised: Surviving Oppression and Traumatic Fieldwork in the Neoliberal Academy. Sociology 54(4):806\u2013824. https:\/\/doi.org\/10.1177\/0038038520904918","journal-title":"Sociology"},{"key":"1726_CR50","doi-asserted-by":"publisher","unstructured":"Raghavan M, Barocas S, Kleinberg J, et\u00a0al (2020) Mitigating bias in algorithmic hiring: evaluating claims and practices. In: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. Association for Computing Machinery, New York, pp 469\u2013481, https:\/\/doi.org\/10.1145\/3351095.3372828","DOI":"10.1145\/3351095.3372828"},{"key":"1726_CR51","doi-asserted-by":"publisher","unstructured":"Raji ID, Buolamwini J (2019) Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products. In: Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society. ACM, Honolulu, pp 429\u2013435, https:\/\/doi.org\/10.1145\/3306618.3314244","DOI":"10.1145\/3306618.3314244"},{"key":"1726_CR52","doi-asserted-by":"publisher","unstructured":"Raji ID, Smart A, White RN, et\u00a0al (2020) Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing. In: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. ACM, Barcelona, pp 33\u201344, https:\/\/doi.org\/10.1145\/3351095.3372873","DOI":"10.1145\/3351095.3372873"},{"key":"1726_CR53","unstructured":"Raji ID, O\u2019Neill C, Patil D, et\u00a0al (2021) Radical Proposal: Third-Party Auditor Access for AI Accountability. In: 2021 HAI Fall Conference. Policy & AI: Four Radical Proposals for a Better Society, Stanford Institute for Human-Centered AI, https:\/\/hai.stanford.edu\/news\/radical-proposal-third-party-auditor-access-ai-accountability, video recording. Accessed on 15 Feb 2023"},{"key":"1726_CR54","unstructured":"Rieke A, Bogen M (2018) Help Wanted. An Examination of Hiring Algorithms, Equity, and Bias. Tech. rep., Upturn, https:\/\/upturn.org\/work\/help-wanted\/. Accessed on 15 Feb 2023"},{"key":"1726_CR55","first-page":"153","volume-title":"Psychologie und Rassismus","author":"B Rommelspacher","year":"1997","unstructured":"Rommelspacher B (1997) Psychologische Erkl\u00e4rungsmuster zum Rassismus. In: Mecheril P, Teo T (eds) Psychologie und Rassismus. Rowohlt, Reinbek, pp 153\u2013172"},{"key":"1726_CR56","unstructured":"Rottleuthner H, Mahlmann M (2011) Diskriminierung in Deutschland. Vermutungen und Fakten, 1st edn. Recht und Gesellschaft - Law and Society, Nomos, Baden-Baden"},{"key":"1726_CR57","unstructured":"Sacksofsky U (2010) Mittelbare Diskriminierung und das Allgemeine Gleichbehandlungsgesetz. Expertise, Antidiskriminierungsstelle des Bundes, https:\/\/www.antidiskriminierungsstelle.de\/SharedDocs\/downloads\/DE\/publikationen\/Expertisen\/expertise_mittelbare_diskriminierung.pdf?__blob=publicationFile &v=2. Accessed on 15 Feb 2023"},{"key":"1726_CR58","volume-title":"Orientalism","author":"EW Said","year":"1978","unstructured":"Said EW (1978) Orientalism, 1st edn. Pantheon Books, New York","edition":"1"},{"issue":"3","key":"1726_CR59","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1016\/j.ajhg.2017.01.021","volume":"100","author":"SC Sanderson","year":"2017","unstructured":"Sanderson SC, Brothers KB, Mercaldo ND et al (2017) Public Attitudes toward Consent and Data Sharing in Biobank Research: A Large Multi-site Experimental Survey in the US. The American Journal of Human Genetics 100(3):414\u2013427. https:\/\/doi.org\/10.1016\/j.ajhg.2017.01.021","journal-title":"The American Journal of Human Genetics"},{"key":"1726_CR60","unstructured":"Sandvig C, Hamilton K, Karahalios K, et\u00a0al (2014) Auditing Algorithms: Research Methods for Detecting Discrimination on Internet Platforms. In: Data and Discrimination: Converting Critical Concerns into Productive Inquiry, a preconference at the 64th Annual Meeting of the International Communication Association, Seattle, WA, USA"},{"key":"1726_CR61","unstructured":"Schumann C, Foster JS, Mattei N, et\u00a0al (2020) We Need Fairness and Explainability in Algorithmic Hiring. In: An B, Yorke-Smith N, El\u00a0Fallah\u00a0Seghrouchni A, et\u00a0al (eds) Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2020). IFAAMAS, Auckland, New Zealand"},{"key":"1726_CR62","unstructured":"Sinanoglu C (2022) Arbeitsdefinitionen und Begriffe in der Forschungspraxis - Zwischen Rassifizierung und Race als Analysekategorie. NaDiRa, DeZIM, https:\/\/www.hwr-berlin.de\/fileadmin\/institut-htmi\/Veranstaltungen\/Sonstige_Veranstaltungen\/Vortrag_Migrationshintergrund.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR63","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2021.100425","author":"M Sloane","year":"2022","unstructured":"Sloane M, Moss E, Chowdhury R (2022) A Silicon Valley love triangle: Hiring algorithms, pseudo-science, and the quest for auditability. Patterns. https:\/\/doi.org\/10.1016\/j.patter.2021.100425","journal-title":"Patterns"},{"key":"1726_CR64","unstructured":"Smith G (2020) What does \u201cfairness\u201d mean for machine learning systems? https:\/\/haas.berkeley.edu\/wp-content\/uploads\/What-is-fairness_-EGAL2.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR65","doi-asserted-by":"publisher","unstructured":"S\u00e1nchez-Monedero J, Dencik L, Edwards L (2020) What does it mean to \u2019solve\u2019 the problem of discrimination in hiring?: social, technical and legal perspectives from the UK on automated hiring systems. In: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. ACM, Barcelona, pp 458\u2013468, https:\/\/doi.org\/10.1145\/3351095.3372849","DOI":"10.1145\/3351095.3372849"},{"key":"1726_CR66","volume-title":"Statistik und Rassismus: das Dilemma der Erfassung von Ethnizit\u00e4t","author":"L Supik","year":"2014","unstructured":"Supik L (2014) Statistik und Rassismus: das Dilemma der Erfassung von Ethnizit\u00e4t. Campus Forschung, Frankfurt a. M"},{"key":"1726_CR67","first-page":"33","volume-title":"The Social Psychology of Intergroup Relations","author":"H Tajfel","year":"1979","unstructured":"Tajfel H, Turner JC (1979) An Integrative Theory of Intergroup Conflict. In: Austin WG, Worchel S (eds) The Social Psychology of Intergroup Relations. Brooks\/Cole, Monterey, pp 33\u201347"},{"key":"1726_CR68","doi-asserted-by":"publisher","unstructured":"Tallgauer M, Festing M, Fleischmann F (2020) Big Data im Recruiting. In: Verhoeven T (ed) Digitalisierung im Recruiting. Springer Fachmedien, Wiesbaden, p 25\u201339, https:\/\/doi.org\/10.1007\/978-3-658-25885-6_3","DOI":"10.1007\/978-3-658-25885-6_3"},{"key":"1726_CR69","volume-title":"Rediscovering the Social Group: A Self-categorization Theory","author":"JC Turner","year":"1987","unstructured":"Turner JC, Hogg MA (1987) Rediscovering the Social Group: A Self-categorization Theory. Blackwell, Oxford"},{"key":"1726_CR70","doi-asserted-by":"publisher","unstructured":"Verma S, Rubin J (2018) Fairness definitions explained. In: Proceedings of the International Workshop on Software Fairness. ACM, Gothenburg Sweden, pp 1\u20137, https:\/\/doi.org\/10.1145\/3194770.3194776","DOI":"10.1145\/3194770.3194776"},{"key":"1726_CR71","doi-asserted-by":"crossref","unstructured":"Von Grafenstein M (2022) Co-Regulation and the Competitive Advantage in the GDPR: Data protection certification mechanisms, codes of conduct and the \u201cstate of the art\u201d of data protection-by-design. In: Gonz\u00e1lez-Fuster G, van Brakel R, De\u00a0Hert P (eds) Research Handbook on Privacy and Data Protection Law. Values, Norms and Global Politics, 1st edn. Edward Elgar Publishing., Cheltenham","DOI":"10.4337\/9781786438515.00027"},{"key":"1726_CR72","doi-asserted-by":"publisher","unstructured":"Von Grafenstein M (2022) Reconciling Conflicting Interests in Data through Data Governance. HIIG Discussion Series, An Analytical Framework. https:\/\/doi.org\/10.5281\/ZENODO.7390542","DOI":"10.5281\/ZENODO.7390542"},{"key":"1726_CR73","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3547922","author":"S Wachter","year":"2020","unstructured":"Wachter S, Mittelstadt B, Russell C (2020) Why Fairness Cannot Be Automated: Bridging the Gap Between EU Non-Discrimination Law and AI. SSRN Electronic J. https:\/\/doi.org\/10.2139\/ssrn.3547922","journal-title":"SSRN Electronic J"},{"key":"1726_CR74","unstructured":"Wagner F, Alarcon-Rubio D, Grigali\u016bnas S, et\u00a0al (2021) On Data Privacy, Governance and Portability: Turning Obstacles into Opportunities. Tech. rep., www.trafi.com\/wp-content\/uploads\/2021\/01\/Trafi-Whitepaper-On-Data-Privacy-Governance-and-Portability-Turning-obstacles-into-opportunities.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR75","unstructured":"Waltl B, Becker N (2022) KI-Audit in der Arbeitswelt. Ein integratives Framework zum Auditieren und Testen von KI-Systemen. Tech. rep., https:\/\/gi.de\/fileadmin\/PR\/Testing-AI\/ExamAI_Framework_KI-Audit.pdf. Accessed on 15 Feb 2023"},{"key":"1726_CR76","doi-asserted-by":"publisher","unstructured":"Wilson C, Ghosh A, Jiang S, et\u00a0al (2021) Building and Auditing Fair Algorithms: A Case Study in Candidate Screening. In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. ACM, Virtual Event Canada, pp 666\u2013677, https:\/\/doi.org\/10.1145\/3442188.3445928","DOI":"10.1145\/3442188.3445928"},{"key":"1726_CR77","doi-asserted-by":"crossref","unstructured":"Winker G, Degele N (2009) Intersektionalit\u00e4t: zur Analyse sozialer Ungleichheiten. Sozialtheorie, transcript Verlag, Bielefeld","DOI":"10.14361\/9783839411490"},{"key":"1726_CR78","doi-asserted-by":"publisher","unstructured":"Wolf C, Hoffmeyer-Zlotnik JHP (2003) How to Measure Sex\/Gender and Age. In: Hoffmeyer-Zlotnik JHP, Wolf C (eds) Advances in Cross-National Comparison: A European Working Book for Demographic and Socio-Economic Variables. Springer US, Boston, MA, p 259\u2013265, https:\/\/doi.org\/10.1007\/978-1-4419-9186-7_13","DOI":"10.1007\/978-1-4419-9186-7_13"},{"key":"1726_CR79","unstructured":"Zeide E (2023) The Silicon Ceiling: How Artificial Intelligence Constructs an Invisible Barrier to Opportunity. University of Missouri-Kansas City Law Review 91(403). https:\/\/papers.ssrn.com\/abstract=4318860. Accessed on 15 Feb 2023"},{"key":"1726_CR80","doi-asserted-by":"publisher","unstructured":"Zygmuntowski JJ, Zoboli L, Nemitz PF (2021) Embedding European values in data governance: a case for public data commons. Internet Policy Review 10(3). https:\/\/doi.org\/10.14763\/2021.3.1572, https:\/\/policyreview.info\/articles\/analysis\/embedding-european-values-data-governance-case-public-data-commons. Accessed on 15 Feb 2023","DOI":"10.14763\/2021.3.1572"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-023-01726-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-023-01726-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-023-01726-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T04:10:46Z","timestamp":1726805446000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-023-01726-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,24]]},"references-count":81,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["1726"],"URL":"https:\/\/doi.org\/10.1007\/s00146-023-01726-w","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,24]]},"assertion":[{"value":"15 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}