{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T12:35:59Z","timestamp":1792154159146,"version":"4.4.0"},"reference-count":65,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T00:00:00Z","timestamp":1726444800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T00:00:00Z","timestamp":1726444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100023863","name":"Munich Center for Machine Learning","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100023863","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005722","name":"Ludwig-Maximilians-Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005722","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI Ethics"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>As artificial intelligence becomes increasingly pervasive, it is essential that we understand the implications of bias in machine learning. Many developers rely on crowd workers to generate and annotate datasets for machine learning applications. However, this step risks embedding training data with labeler bias, leading to biased decision-making in systems trained on these datasets. To characterize labeler bias, we created a face dataset and conducted two studies where labelers of different ethnicity and sex completed annotation tasks. In the first study, labelers annotated subjective characteristics of faces. In the second, they annotated images using bounding boxes. Our results demonstrate that labeler demographics significantly impact both subjective and accuracy-based annotations, indicating that collecting a diverse set of labelers may not be enough to solve the problem. We discuss the consequences of these findings for current machine learning practices to create fair and unbiased systems.<\/jats:p>","DOI":"10.1007\/s43681-024-00572-w","type":"journal-article","created":{"date-parts":[[2024,9,16]],"date-time":"2024-09-16T12:03:35Z","timestamp":1726488215000},"page":"2515-2528","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Uncovering labeler bias in machine learning annotation tasks"],"prefix":"10.1007","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5654-2453","authenticated-orcid":false,"given":"Luke","family":"Haliburton","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Leusmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robin","family":"Welsch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sinksar","family":"Ghebremedhin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Petros","family":"Isaakidis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albrecht","family":"Schmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sven","family":"Mayer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,9,16]]},"reference":[{"key":"572_CR1","doi-asserted-by":"publisher","unstructured":"Eickhoff, C.: Cognitive biases in crowdsourcing. In: Proceedings of the Eleventh ACM International Conference on Web Search And Data Mining. WSDM \u201918, pp. 162\u2013170. Association for Computing Machinery, New York (2018). https:\/\/doi.org\/10.1145\/3159652.3159654","DOI":"10.1145\/3159652.3159654"},{"key":"572_CR2","doi-asserted-by":"publisher","unstructured":"Bender, E.M., Gebru, T., McMillan-Major, A., Shmitchell, S.: On the dangers of stochastic parrots: can language models be too big? In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. FAccT \u201921. ACM, New York (2021). https:\/\/doi.org\/10.1145\/3442188.3445922","DOI":"10.1145\/3442188.3445922"},{"issue":"GROUP","key":"572_CR3","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1145\/3492853","volume":"6","author":"M Miceli","year":"2022","unstructured":"Miceli, M., Posada, J., Yang, T.: Studying up machine learning data: why talk about bias when we mean power? Proc. ACM Hum. Comput. Interact. 6(GROUP), 34\u201313414 (2022). https:\/\/doi.org\/10.1145\/3492853","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"572_CR4","doi-asserted-by":"publisher","unstructured":"Moss, A.J., Rosenzweig, C., Robinson, J., Jaffe, S.N., LItman, L.: Is it ethical to use mechanical turk for behavioral research? Relevant Data from a Representative Survey of MTurk Participants and Wages. PsyArXiv (2020). https:\/\/doi.org\/10.31234\/osf.io\/jbc9d","DOI":"10.31234\/osf.io\/jbc9d"},{"key":"572_CR5","doi-asserted-by":"publisher","DOI":"10.1177\/2158244016636433","author":"KE Levay","year":"2016","unstructured":"Levay, K.E., Freese, J., Druckman, J.N.: The demographic and political composition of mechanical turk samples. SAGE Open (2016). https:\/\/doi.org\/10.1177\/2158244016636433","journal-title":"SAGE Open"},{"key":"572_CR6","doi-asserted-by":"publisher","unstructured":"Abid, A., Farooqi, M., Zou, J.: Persistent anti-muslim bias in large language models. In: Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society. AIES \u201921, pp. 298\u2013306. Association for Computing Machinery, New York (2021). https:\/\/doi.org\/10.1145\/3461702.3462624","DOI":"10.1145\/3461702.3462624"},{"issue":"CSCW2","key":"572_CR7","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1145\/3415186","volume":"4","author":"M Miceli","year":"2020","unstructured":"Miceli, M., Schuessler, M., Yang, T.: Between subjectivity and imposition: power dynamics in data annotation for computer vision. Proc. ACM Hum. Comput. Interact. 4(CSCW2), 115\u2013111525 (2020). https:\/\/doi.org\/10.1145\/3415186","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"572_CR8","doi-asserted-by":"publisher","DOI":"10.1145\/3555088","author":"N Goyal","year":"2022","unstructured":"Goyal, N., Kivlichan, I.D., Rosen, R., Vasserman, L.: Is your toxicity my toxicity? exploring the impact of rater identity on toxicity annotation. Proc. ACM Hum. Comput. Interact. (2022). https:\/\/doi.org\/10.1145\/3555088","journal-title":"Proc. ACM Hum. Comput. Interact."},{"issue":"4","key":"572_CR9","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1007\/s43681-021-00049-0","volume":"1","author":"S Kaplan","year":"2021","unstructured":"Kaplan, S., Handelman, D., Handelman, A.: Sensitivity of neural networks to corruption of image classification. AI Ethics 1(4), 425\u2013434 (2021). https:\/\/doi.org\/10.1007\/s43681-021-00049-0","journal-title":"AI Ethics"},{"key":"572_CR10","unstructured":"Jiang, H., Nachum, O.: Identifying and correcting label bias in machine learning. In: Proceedings of the Twenty Third International Conference on Artificial Intelligence and Statistics. Proceedings of Machine Learning Research, vol. 108, pp. 702\u2013712. PMLR, Virtual (2020). https:\/\/proceedings.mlr.press\/v108\/jiang20a.html"},{"key":"572_CR11","unstructured":"Wauthier, F.L., Jordan, M.: Bayesian bias mitigation for crowdsourcing. In: Shawe-Taylor, J., Zemel, R., Bartlett, P., Pereira, F., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 24. Curran Associates, Inc., Granada (2011). https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2011\/file\/0768281a05da9f27df178b5c39a51263-Paper.pdf"},{"key":"572_CR12","unstructured":"Cohn, T., Specia, L.: Modelling annotator bias with multi-task Gaussian processes: an application to machine translation quality estimation. In: Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 32\u201342. Association for Computational Linguistics, Sofia (2013). https:\/\/aclanthology.org\/P13-1004"},{"key":"572_CR13","doi-asserted-by":"crossref","unstructured":"Geva, M., Goldberg, Y., Berant, J.: Are we modeling the task or the annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets (2019). arXiv:1908.07898","DOI":"10.18653\/v1\/D19-1107"},{"key":"572_CR14","doi-asserted-by":"crossref","unstructured":"Sap, M., Swayamdipta, S., Vianna, L., Zhou, X., Choi, Y., Smith, N.A.: Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection (2022). arXiv:2111.07997","DOI":"10.18653\/v1\/2022.naacl-main.431"},{"key":"572_CR15","doi-asserted-by":"publisher","unstructured":"Haliburton, L., Ghebremedhin, S., Welsch, R., Schmidt, A., Mayer, S.: Investigating labeler bias in face annotation for machine learning. In: HHAI 2024: Hybrid Human AI Systems for the Social Good. Frontiers in Artificial Intelligence and Applications, vol. 386, pp. 145\u2013161. IOS Press, Amsterdam (2024). https:\/\/doi.org\/10.3233\/FAIA240191","DOI":"10.3233\/FAIA240191"},{"key":"572_CR16","doi-asserted-by":"publisher","unstructured":"Karkkainen, K., Joo, J.: Fairface: Face attribute dataset for balanced race, gender, and age for bias measurement and mitigation. In: Winter Conference on Applications of Computer Vision (WACV). IEEE, Waikoloa (2021). https:\/\/doi.org\/10.1109\/WACV48630.2021.00159","DOI":"10.1109\/WACV48630.2021.00159"},{"key":"572_CR17","doi-asserted-by":"publisher","unstructured":"Engelmann, S., Ullstein, C., Papakyriakopoulos, O., Grossklags, J.: What People think AI should infer from faces. In: 2022 ACM Conference on Fairness, Accountability, and Transparency. FAccT \u201922, pp. 128\u2013141. Association for Computing Machinery, New York (2022). https:\/\/doi.org\/10.1145\/3531146.3533080","DOI":"10.1145\/3531146.3533080"},{"key":"572_CR18","doi-asserted-by":"crossref","unstructured":"Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., Vasudevan, V., Han, W., Ngiam, J., Zhao, H., Timofeev, A., Ettinger, S., Krivokon, M., Gao, A., Joshi, A., Zhang, Y., Shlens, J., Chen, Z., Anguelov, D.: Scalability in perception for autonomous driving: Waymo open dataset, pp. 2446\u20132454 (2020). https:\/\/openaccess.thecvf.com\/content_CVPR_2020\/html\/Sun_Scalability_in_Perception_for_Autonomous_Driving_Waymo_Open_Dataset_CVPR_2020_paper.html","DOI":"10.1109\/CVPR42600.2020.00252"},{"key":"572_CR19","volume-title":"Why the Power of the Crowd is Driving the Future Of Business","author":"J Howe","year":"2008","unstructured":"Howe, J.: Why the Power of the Crowd is Driving the Future Of Business. Random House, New York (2008)"},{"key":"572_CR20","doi-asserted-by":"publisher","unstructured":"Eickhoff, C., Harris, C.G., Vries, A.P., Srinivasan, P.: Quality through flow and immersion: gamifying crowdsourced relevance assessments. In: Proceedings of the 35th International ACM SIGIR Conference on Research and Development in Information Retrieval. SIGIR \u201912, pp. 871\u2013880. Association for Computing Machinery, New York (2012). https:\/\/doi.org\/10.1145\/2348283.2348400","DOI":"10.1145\/2348283.2348400"},{"issue":"2","key":"572_CR21","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1145\/1480506.1480508","volume":"42","author":"O Alonso","year":"2008","unstructured":"Alonso, O., Rose, D.E., Stewart, B.: Crowdsourcing for relevance evaluation. ACM SIGIR Forum 42(2), 9\u201315 (2008). https:\/\/doi.org\/10.1145\/1480506.1480508","journal-title":"ACM SIGIR Forum"},{"key":"572_CR22","unstructured":"Grady, C., Lease, M.: Crowdsourcing document relevance assessment with mechanical turk. In: Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon\u2019s Mechanical Turk, pp. 172\u2013179. Association for Computational Linguistics, Los Angeles (2010). https:\/\/aclanthology.org\/W10-0727"},{"key":"572_CR23","doi-asserted-by":"publisher","unstructured":"Kittur, A., Chi, E.H., Suh, B.: Crowdsourcing user studies with mechanical turk. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI \u201908, pp. 453\u2013456. Association for Computing Machinery, New York (2008). https:\/\/doi.org\/10.1145\/1357054.1357127","DOI":"10.1145\/1357054.1357127"},{"issue":"01","key":"572_CR24","doi-asserted-by":"publisher","first-page":"9837","DOI":"10.1609\/aaai.v33i01.33019837","volume":"33","author":"VS Sheng","year":"2019","unstructured":"Sheng, V.S., Zhang, J.: Machine learning with crowdsourcing: a brief summary of the past research and future directions. Proc. AAAI Conf. Artif. Intell. 33(01), 9837\u20139843 (2019). https:\/\/doi.org\/10.1609\/aaai.v33i01.33019837","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"issue":"2","key":"572_CR25","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/s10791-011-9181-9","volume":"16","author":"C Eickhoff","year":"2013","unstructured":"Eickhoff, C., Vries, A.P.: Increasing cheat robustness of crowdsourcing tasks. Inf. Retr. 16(2), 121\u2013137 (2013). https:\/\/doi.org\/10.1007\/s10791-011-9181-9","journal-title":"Inf. Retr."},{"key":"572_CR26","doi-asserted-by":"publisher","unstructured":"Difallah, D.E., Demartini, G., Cudr\u00e9-Mauroux, P.: Pick-a-crowd: tell me what you like, and i\u2019ll tell you what to do. In: Proceedings of the 22nd International Conference on World Wide Web. WWW \u201913, pp. 367\u2013374. Association for Computing Machinery, New York (2013). https:\/\/doi.org\/10.1145\/2488388.2488421","DOI":"10.1145\/2488388.2488421"},{"key":"572_CR27","unstructured":"Fleischmann, M., Amirpur, M., Benlian, A., Hess, T.: Cognitive biases in information systems research: a scientometric analysis. In: Proceedings of the European Conference on Information Systems (ECIS) Tel Aviv, Israel (2014)"},{"key":"572_CR28","doi-asserted-by":"publisher","unstructured":"Difallah, D., Filatova, E., Ipeirotis, P.: Demographics and dynamics of mechanical turk workers. In: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining. WSDM \u201918. ACM, New York (2018). https:\/\/doi.org\/10.1145\/3159652.3159661","DOI":"10.1145\/3159652.3159661"},{"key":"572_CR29","unstructured":"Ipeirotis, P.G.: Demographics of mechanical turk. Technical Report 1585030, Rochester, New York (2010). https:\/\/papers.ssrn.com\/abstract=1585030"},{"key":"572_CR30","doi-asserted-by":"publisher","unstructured":"Ross, J., Irani, L., Silberman, M.S., Zaldivar, A., Tomlinson, B.: Who are the crowdworkers? shifting demographics in mechanical turk. In: CHI \u201910 Extended Abstracts on Human Factors in Computing Systems. CHI EA \u201910. ACM, New York (2010). https:\/\/doi.org\/10.1145\/1753846.1753873","DOI":"10.1145\/1753846.1753873"},{"key":"572_CR31","doi-asserted-by":"publisher","unstructured":"Chen, C., Sundar, S.S.: Is this AI trained on Credible Data? The Effects of Labeling Quality and Performance Bias on User Trust. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. CHI \u201923, pp. 1\u201311. Association for Computing Machinery, New York (2023). https:\/\/doi.org\/10.1145\/3544548.3580805","DOI":"10.1145\/3544548.3580805"},{"key":"572_CR32","doi-asserted-by":"publisher","unstructured":"Fruchard, B., Malacria, S., Casiez, G., Huot, S.: User Preference and Performance using Tagging and Browsing for Image Labeling. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. CHI \u201923, pp. 1\u201313. Association for Computing Machinery, New York (2023). https:\/\/doi.org\/10.1145\/3544548.3580926","DOI":"10.1145\/3544548.3580926"},{"key":"572_CR33","doi-asserted-by":"publisher","unstructured":"Stureborg, R., Dhingra, B., Yang, J.: Interface design for crowdsourcing hierarchical multi-label text annotations. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. CHI \u201923, pp. 1\u201317. Association for Computing Machinery, New York (2023). https:\/\/doi.org\/10.1145\/3544548.3581431 . https:\/\/dl.acm.org\/doi\/10.1145\/3544548.3581431","DOI":"10.1145\/3544548.3581431"},{"key":"572_CR34","doi-asserted-by":"publisher","unstructured":"Oyshi, M.T., Vogt, S., Gumhold, S.: TmoTA: simple, highly responsive tool for multiple object tracking annotation. In: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. CHI \u201923, pp. 1\u201311. Association for Computing Machinery, New York (2023). https:\/\/doi.org\/10.1145\/3544548.3581185","DOI":"10.1145\/3544548.3581185"},{"key":"572_CR35","doi-asserted-by":"publisher","unstructured":"Hirth, M., Borchert, K., De\u00a0Moor, K., Borst, V., Ho\u00df\u00dffeld, T.: Personal task design preferences of crowdworkers. In: 2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), pp. 1\u20136 (2020). https:\/\/doi.org\/10.1109\/QoMEX48832.2020.9123094","DOI":"10.1109\/QoMEX48832.2020.9123094"},{"key":"572_CR36","doi-asserted-by":"crossref","unstructured":"Parmar, M., Mishra, S., Geva, M., Baral, C.: Don\u2019t blame the annotator: bias already starts in the annotation instructions (2022). arXiv:2205.00415","DOI":"10.18653\/v1\/2023.eacl-main.130"},{"key":"572_CR37","doi-asserted-by":"publisher","unstructured":"Barbosa, N.M., Chen, M.: Rehumanized crowdsourcing: a labeling framework addressing bias and ethics in machine learning. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. CHI \u201919, pp. 1\u201312. Association for Computing Machinery, New York (2019). https:\/\/doi.org\/10.1145\/3290605.3300773","DOI":"10.1145\/3290605.3300773"},{"key":"572_CR38","doi-asserted-by":"publisher","unstructured":"Hube, C., Fetahu, B., Gadiraju, U.: Understanding and mitigating worker biases in the crowdsourced collection of subjective judgments. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. CHI \u201919, pp. 1\u201312. Association for Computing Machinery, New York (2019). https:\/\/doi.org\/10.1145\/3290605.3300637","DOI":"10.1145\/3290605.3300637"},{"key":"572_CR39","doi-asserted-by":"crossref","unstructured":"Miceli, M., Posada, J.: The Data-Production Dispositif (2022). arXiv:2205.11963","DOI":"10.1145\/3555561"},{"key":"572_CR40","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.82.6.878","author":"ST Fiske","year":"2002","unstructured":"Fiske, S.T., Cuddy, A.J.C., Glick, P., Xu, J.: A model of (often mixed) stereotype content: competence and warmth respectively follow from perceived status and competition. J. Personal. Soc. Psychol. (2002). https:\/\/doi.org\/10.1037\/0022-3514.82.6.878","journal-title":"J. Personal. Soc. Psychol."},{"key":"572_CR41","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2006.11.005","author":"ST Fiske","year":"2007","unstructured":"Fiske, S.T., Cuddy, A.J.C., Glick, P.: Universal dimensions of social cognition: warmth and competence. Trends Cogn. Sci. (2007). https:\/\/doi.org\/10.1016\/j.tics.2006.11.005","journal-title":"Trends Cogn. Sci."},{"key":"572_CR42","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/S0065-2601(07)00002-0","volume":"40","author":"AJC Cuddy","year":"2008","unstructured":"Cuddy, A.J.C., Fiske, S.T., Glick, P.: Warmth and competence as universal dimensions of social perception: the stereotype content model and the bias map. Adv. Exp. Soc. Psychol. 40, 61\u2013149 (2008). https:\/\/doi.org\/10.1016\/S0065-2601(07)00002-0","journal-title":"Adv. Exp. Soc. Psychol."},{"key":"572_CR43","doi-asserted-by":"publisher","DOI":"10.1111\/josi.12208","author":"F Durante","year":"2017","unstructured":"Durante, F., Tablante, C.B., Fiske, S.T.: Poor but warm, rich but cold (and competent): social classes in the stereotype content model. J. Soc. Issues (2017). https:\/\/doi.org\/10.1111\/josi.12208","journal-title":"J. Soc. Issues"},{"key":"572_CR44","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.01643","author":"D Grigoryev","year":"2019","unstructured":"Grigoryev, D., Fiske, S.T., Batkhina, A.: Mapping ethnic stereotypes and their antecedents in Russia: the stereotype content model. Front. Psychol. (2019). https:\/\/doi.org\/10.3389\/fpsyg.2019.01643","journal-title":"Front. Psychol."},{"key":"572_CR45","doi-asserted-by":"publisher","unstructured":"McKee, K., Bai, X., Fiske, S.: Understanding human impressions of artificial intelligence. Technical report, PsyArXiv (2021). https:\/\/doi.org\/10.31234\/osf.io\/5ursp","DOI":"10.31234\/osf.io\/5ursp"},{"key":"572_CR46","doi-asserted-by":"publisher","unstructured":"Schwind, V., Deierlein, N., Poguntke, R., Henze, N.: Understanding the social acceptability of mobile devices using the stereotype content model. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York (2019). https:\/\/doi.org\/10.1145\/3290605.3300591","DOI":"10.1145\/3290605.3300591"},{"key":"572_CR47","doi-asserted-by":"publisher","unstructured":"Marsden, N., Haag, M.: Stereotypes and politics: reflections on personas. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. CHI \u201916, pp. 4017\u20134031. Association for Computing Machinery, New York (2016). https:\/\/doi.org\/10.1145\/2858036.2858151","DOI":"10.1145\/2858036.2858151"},{"key":"572_CR48","doi-asserted-by":"crossref","unstructured":"Fraser, K.C., Nejadgholi, I., Kiritchenko, S.: Understanding and countering stereotypes: a computational approach to the stereotype content model (2021). arXiv:2106.02596 [cs]","DOI":"10.18653\/v1\/2021.acl-long.50"},{"key":"572_CR49","doi-asserted-by":"publisher","DOI":"10.1177\/1077699020932304","author":"AC Kroon","year":"2021","unstructured":"Kroon, A.C., Trilling, D., Raats, T.: Guilty by association: using word embeddings to measure ethnic stereotypes in news coverage. J. Mass Commun. Q. (2021). https:\/\/doi.org\/10.1177\/1077699020932304","journal-title":"J. Mass Commun. Q."},{"key":"572_CR50","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.51.9.918","author":"JS Phinney","year":"1996","unstructured":"Phinney, J.S.: When we talk about American ethnic groups, what do we mean? Am. Psychol. (1996). https:\/\/doi.org\/10.1037\/0003-066X.51.9.918","journal-title":"Am. Psychol."},{"key":"572_CR51","doi-asserted-by":"crossref","unstructured":"Das, A., Dantcheva, A., Bremond, F.: Mitigating bias in gender, age and ethnicity classification: a multi-task convolution neural network approach (2018). https:\/\/openaccess.thecvf.com\/content_eccv_2018_workshops\/w5\/html\/Das_Mitigating_Bias_in_Gender_Age_and_Ethnicity_Classification_a_Multi-Task_ECCVW_2018_paper.html","DOI":"10.1007\/978-3-030-11009-3_35"},{"issue":"1","key":"572_CR52","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1609\/icwsm.v11i1.14894","volume":"11","author":"A Chakraborty","year":"2017","unstructured":"Chakraborty, A., Messias, J., Benevenuto, F., Ghosh, S., Ganguly, N., Gummadi, K.: Who makes trends? Understanding demographic biases in crowdsourced recommendations. Proc. Int. AAAI Conf. Web Soc. Media 11(1), 22\u201331 (2017). https:\/\/doi.org\/10.1609\/icwsm.v11i1.14894","journal-title":"Proc. Int. AAAI Conf. Web Soc. Media"},{"key":"572_CR53","volume-title":"Social Cognition","author":"ST Fiske","year":"1991","unstructured":"Fiske, S.T., Taylor, S.E.: Social Cognition, 2nd edn. Mcgraw-Hill Book Company, New York (1991)","edition":"2"},{"key":"572_CR54","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/11805.001.0001","volume-title":"Data Feminism","author":"C D\u2019Ignazio","year":"2020","unstructured":"D\u2019Ignazio, C., Klein, L.F.: Data Feminism. MIT Press, Cambridge (2020)"},{"key":"572_CR55","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1007\/978-3-031-19818-2_4","volume-title":"Computer Vision\u2014ECCV 2022","author":"J Mei","year":"2022","unstructured":"Mei, J., Zhu, A.Z., Yan, X., Yan, H., Qiao, S., Chen, L.-C., Kretzschmar, H.: Waymo open dataset: panoramic video panoptic segmentation. In: Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., Hassner, T. (eds.) Computer Vision\u2014ECCV 2022, pp. 53\u201372. Springer, Cham (2022)"},{"issue":"6","key":"572_CR56","doi-asserted-by":"publisher","first-page":"2046","DOI":"10.3390\/app10062046","volume":"10","author":"Z Gu","year":"2020","unstructured":"Gu, Z., Li, Z., Di, X., Shi, R.: An LSTM-based autonomous driving model using a Waymo open dataset. Appl. Sci. 10(6), 2046 (2020). https:\/\/doi.org\/10.3390\/app10062046","journal-title":"Appl. Sci."},{"key":"572_CR57","unstructured":"Rashtchian, C., Young, P., Hodosh, M., Hockenmaier, J.: Collecting image annotations using Amazon\u2019s mechanical turk. In: Proceedings of the NAACL HLT 2010 Workshop on Creating Speech and Language Data with Amazon\u2019s Mechanical Turk, pp. 139\u2013147. Association for Computational Linguistics, Los Angeles (2010). https:\/\/aclanthology.org\/W10-0721"},{"key":"572_CR58","doi-asserted-by":"crossref","unstructured":"Rezatofighi, S.H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I.D., Savarese, S.: Generalized intersection over union: a metric and A loss for bounding box regression. CoRR (2019). arXiv:1902.09630","DOI":"10.1109\/CVPR.2019.00075"},{"key":"572_CR59","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S.J., Bourdev, L.D., Girshick, R.B., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., Zitnick, C.L.: Microsoft COCO: common objects in context. CoRR (2014). arXiv:1405.0312","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"572_CR60","unstructured":"Leal-Taix\u00e9, L., Milan, A., Reid, I.D., Roth, S., Schindler, K.: Motchallenge 2015: Towards a benchmark for multi-target tracking. CoRR (2015). arXiv:1504.01942"},{"key":"572_CR61","doi-asserted-by":"publisher","unstructured":"Wobbrock, J.O., Findlater, L., Gergle, D., Higgins, J.J.: The aligned rank transform for nonparametric factorial analyses using only anova procedures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI \u201911, pp. 143\u2013146. Association for Computing Machinery, New York (2011). https:\/\/doi.org\/10.1145\/1978942.1978963","DOI":"10.1145\/1978942.1978963"},{"issue":"22","key":"572_CR62","doi-asserted-by":"publisher","first-page":"2970","DOI":"10.3390\/math9222970","volume":"9","author":"AM Rahmani","year":"2021","unstructured":"Rahmani, A.M., Yousefpoor, E., Yousefpoor, M.S., Mehmood, Z., Haider, A., Hosseinzadeh, M., Ali Naqvi, R.: Machine learning (ML) in medicine: review, applications, and challenges. Mathematics 9(22), 2970 (2021). https:\/\/doi.org\/10.3390\/math9222970","journal-title":"Mathematics"},{"key":"572_CR63","doi-asserted-by":"publisher","unstructured":"Ahsan, M.N.I., Nahian, T., Kafi, A.A., Hossain, M.I., Shah, F.M.: Review spam detection using active learning. In: 2016 IEEE 7th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), pp. 1\u20137 (2016). https:\/\/doi.org\/10.1109\/IEMCON.2016.7746279","DOI":"10.1109\/IEMCON.2016.7746279"},{"key":"572_CR64","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/9781119821908.ch1","volume-title":"Fundamentals and Methods of Machine and Deep Learning","author":"SH Shetty","year":"2022","unstructured":"Shetty, S.H., Shetty, S., Singh, C., Rao, A.: Supervised machine learning: algorithms and applications. In: Fundamentals and Methods of Machine and Deep Learning, pp. 1\u201316. Wiley, New York (2022). https:\/\/doi.org\/10.1002\/9781119821908.ch1"},{"issue":"3","key":"572_CR65","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1007\/s42979-021-00592-x","volume":"2","author":"IH Sarker","year":"2021","unstructured":"Sarker, I.H.: Machine learning: algorithms, real-world applications and research directions. SN Comput. Sci. 2(3), 160 (2021). https:\/\/doi.org\/10.1007\/s42979-021-00592-x","journal-title":"SN Comput. Sci."}],"container-title":["AI and Ethics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-024-00572-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43681-024-00572-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43681-024-00572-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,24]],"date-time":"2025-05-24T05:11:01Z","timestamp":1748063461000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43681-024-00572-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,16]]},"references-count":65,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["572"],"URL":"https:\/\/doi.org\/10.1007\/s43681-024-00572-w","relation":{},"ISSN":["2730-5953","2730-5961"],"issn-type":[{"value":"2730-5953","type":"print"},{"value":"2730-5961","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,16]]},"assertion":[{"value":"15 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 August 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 September 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The study was approved by the ethics committee within the LMU Munich Faculty for Mathematics, Informatics, and Statistics","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors affirm that human research participants provided informed consent for the publication of their images.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to publish"}},{"value":"Researchers who wish to access the dataset should contact the corresponding author and briefly describe their use case. The dataset is available for research purposes only.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Materials availability"}}]}}