{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:39:53Z","timestamp":1776116393517,"version":"3.50.1"},"reference-count":126,"publisher":"Association for Computing Machinery (ACM)","issue":"7","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,18]]},"abstract":"<jats:p>Data workers play a key role in the big data industry. Clients hire data workers to collect and annotate data with human identity concepts, like demographic categories or clothing items. Often, such workers are treated as computational-they are expected to quickly and objectively conduct their work, with the goal of having huge, unbiased datasets for training models. Computer vision is especially interested in fair and impartial data due to biases and unethical practices in the field. However, far from impartial, data workers imbue computer vision data with ''biases'' beyond correct versus incorrect answers. Data workers embed their own specific positional perspectives about identity concepts in both collection and annotation processes. Through interviews and ethnographic observations of data workers (freelance and business process outsourcing (BPO) employees), we show how worker positionality influences decisions during data work. We also show the unintended outcomes, like social biases, that occur when positionality is not explicitly attended to in client instructions. We discuss how employing a lens of positionality in data work reveals the gulfs between data worker perspectives and client expectations, which are colored by a web of positional actors beyond isolated data workers. We propose positional (il)legibility as an approach to data work that embraces the reality of positionality in classification practices and addresses the failures of positivist bias mitigation practices.<\/jats:p>","DOI":"10.1145\/3757481","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:32:00Z","timestamp":1760635920000},"page":"1-42","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["How Data Workers Shape Datasets: The Role of Positionality in Data Collection and Annotation for Computer Vision"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6049-3965","authenticated-orcid":false,"given":"Morgan Klaus","family":"Scheuerman","sequence":"first","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5745-7103","authenticated-orcid":false,"given":"Allison","family":"Woodruff","sequence":"additional","affiliation":[{"name":"Unaffiliated, Mountain View, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4826-8324","authenticated-orcid":false,"given":"Jed R.","family":"Brubaker","sequence":"additional","affiliation":[{"name":"University of Colorado Boulder, Boulder, CO, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/smds53860.2021.00016"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-94102-4_8\/COVER"},{"key":"e_1_2_1_3_1","volume-title":"Facial Recognition Leads To False Arrest Of Black Man In Detroit. National Public Radio","author":"Allyn Bobby","year":"2020","unstructured":"Bobby Allyn. 2020. Facial Recognition Leads To False Arrest Of Black Man In Detroit. National Public Radio (2020)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/0309816819899410"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/1024529420914473"},{"key":"e_1_2_1_6_1","first-page":"141","volume-title":"Proceedings of FG-MoL","author":"Artstein Ron","year":"2005","unstructured":"Ron Artstein and Massimo Poesio. 2005. Bias Decreases in Proportion to the Number of Annotators. Proceedings of FG-MoL (2005), 141-150."},{"key":"e_1_2_1_7_1","volume-title":"Google Mistakenly Tags Black People, as `Gorillas, ,' Showing Limits, of Algorithms. Wall Street Journal","author":"Barr Alistair","year":"2015","unstructured":"Alistair Barr. 2015. Google Mistakenly Tags Black People, as `Gorillas, ,' Showing Limits, of Algorithms. Wall Street Journal (2015)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","unstructured":"Martin Beraja David Y Yang Noam Yuchtman Andrew Kao Shuhao Lu Wenwei Peng We Shiyun Hu Junxi Liu Shengqi Ni Yucheng Quan Linchuan Xu Peilin Yang Guoli Yin Daron Acemoglu Dominick Bartelme Ryan Bubb Paco Buera Ernesto Dal B\u00f3 Dave Donaldson Ruben Enikolopov Raquel Fern\u00e1ndez Richard Freeman Chad Jones Pete Klenow Monica Martinez-Bravo Andy Neumeyer Juan Pablo Nicolini Arianna Ornaghi Maria Petrova Torsten Persson Nancy Qian Andrei Shleifer Chris Tonetti Dan Trefler John Van Reenen and Daniel Xu. 2020. Data-Intensive Innovation and the State : Evidence from AI Firms in China. (Aug. 2020). https:\/\/doi.org\/10.3386\/W27723","DOI":"10.3386\/W27723"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.2966\/scrip.170220.389"},{"key":"e_1_2_1_10_1","volume-title":"Bowker and Susan Leigh Star","author":"Geoffrey","year":"1999","unstructured":"Geoffrey C. Bowker and Susan Leigh Star. 1999. Sorting Things Out, : Classification, and Its Consequences. MIT Press."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.606"},{"key":"e_1_2_1_12_1","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender Shades : Intersectional Accuracy Disparities in Commercial Gender Classification *. Technical Report. 1-15 pages."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501998"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780198843498.003.0018"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00012"},{"key":"e_1_2_1_16_1","unstructured":"Kathy Charmaz. 2006. Constructing Grounded Theory : A Practical Guide Through Qualitative Analysis."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01471"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2481492.2481519"},{"key":"e_1_2_1_19_1","volume-title":"Situated Standpoints, and Black Feminist Thought. In Fighting Words Black Women, and the Search, for Justice","author":"Collins Patricia Hill","unstructured":"Patricia Hill Collins. 1998. Some Group Matters, : Intersectionality, Situated Standpoints, and Black Feminist Thought. In Fighting Words Black Women, and the Search, for Justice. University of Minnesota Press."},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","first-page":"1241","DOI":"10.2307\/1229039","article-title":"Mapping the Margins, : Intersectionality, Identity Politics, and Violence Against Women, of Color. Source","volume":"43","author":"Crenshaw Kimberle","year":"1991","unstructured":"Kimberle Crenshaw. 1991. Mapping the Margins, : Intersectionality, Identity Politics, and Violence Against Women, of Color. Source: Stanford Law Review, Vol. 43, 6 (1991), 1241-1299. showeprint[jstor]1229039","journal-title":"Stanford Law Review"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","unstructured":"Sofia Marques da Silva and Joan Parker Webster. 2018. Positionality and Standpoint. https:\/\/doi.org\/10.1002\/9781118933732.ch22","DOI":"10.1002\/9781118933732.ch22"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-11009-3_35"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00449"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the Sixth Linguistic Annotation Workshop. Association for Computational Linguistics, USA, 31-39","author":"Ihsan Yalcinkaya Isin Demirc","year":"2012","unstructured":"Isin Demirc sahin.Ihsan Yalcinkaya, and Deniz Zeyrek. 2012. Pair Annotation, : Adaption, of Pair Programming, to Corpus Annotation. In Proceedings of the Sixth Linguistic Annotation Workshop. Association for Computational Linguistics, USA, 31-39."},{"key":"e_1_2_1_25_1","volume-title":"Hilary Nicole, and Morgan Klaus Scheuerman.","author":"Denton Emily","year":"2020","unstructured":"Emily Denton, Alex Hanna, Razvan Amironesei, Andrew Smart, Hilary Nicole, and Morgan Klaus Scheuerman. 2020. Bringing the People Back In, : Contesting Benchmark Machine Learning Datasets. (July 2020). arXiv:2007.07399"},{"key":"e_1_2_1_26_1","volume-title":"CVPR Workshops. 52-59","author":"DeVries Terrance","year":"1906","unstructured":"Terrance DeVries, Ishan Misra, Changhan Wang, and Laurens van der Maaten. 2019. Does Object Recognition Work, for Everyone?. In CVPR Workshops. 52-59. arXiv:1906.02659"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v6i1.14258"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.393"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025837"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1093\/ser\/mww033"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2321570"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3078714.3078715"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458723"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372862"},{"key":"e_1_2_1_35_1","unstructured":"Dave Gershgorn. 2021. The A. I. Industry Is Exploiting Gig Workers Around the World textemdash Sometimes for Just $8 a Day. https:\/\/onezero.medium.com\/the-a-i-industry-is-exploiting-gig-workers-around-the-world-sometimes-for-just-8-a-day-288dcce9c047."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d19-1107"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.7208\/chicago\/9780226292144.001.0001"},{"key":"e_1_2_1_38_1","volume-title":"Jain","author":"Gong Sixue","year":"2019","unstructured":"Sixue Gong, Xiaoming Liu, and Anil K. Jain. 2019. DebFace, : De-biasing Face Recognition. (Nov. 2019). arXiv:1911.08080"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1177\/1024258916687250"},{"key":"e_1_2_1_40_1","volume-title":"Gray and Suri Siddharth","author":"Mary","year":"2019","unstructured":"Mary L. Gray and Suri Siddharth. 2019. Ghost Work, : How, to Stop Silicon Valley, from Building, a New Global Underclass."},{"key":"e_1_2_1_41_1","volume-title":"in Whose World? Papers from the Fourth Nordic Conference on Middle Eastern Studies","author":"Hanafi Hassan","year":"1998","unstructured":"Hassan Hanafi. 1998. Middle East, in Whose World? Papers from the Fourth Nordic Conference on Middle Eastern Studies (1998), 1-9."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372826"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174023"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.2307\/3178066"},{"key":"e_1_2_1_45_1","volume-title":"The Feminist Standpoint Theory Reader, : Intellectual, and Political Controversies","author":"Harding Sandra","unstructured":"Sandra Harding. 2004. The Feminist Standpoint Theory Reader, : Intellectual, and Political Controversies. Routledge."},{"key":"e_1_2_1_46_1","unstructured":"Sasha Harrison and Boxiao Pan. 2020. Mitigating Bias in Facial Recognition with FairGAN. (2020)."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3645151"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01219-9_47"},{"key":"e_1_2_1_49_1","unstructured":"Patricia Hill Collins and Sirma Bilge. 2016. Intersectionality. Polity."},{"key":"e_1_2_1_50_1","volume-title":"The Dataset Nutrition Label, : A Framework To Drive Higher Data Quality Standards. (May","author":"Holland Sarah","year":"2018","unstructured":"Sarah Holland, Ahmed Hosny, Sarah Newman, Joshua Joseph, and Kasia Chmielinski. 2018. The Dataset Nutrition Label, : A Framework To Drive Higher Data Quality Standards. (May 2018). arXiv:1805.03677"},{"key":"e_1_2_1_51_1","volume-title":"Navigating Multi-Stakeholder Incentives, and Preferences, : Co-Designing Alternatives, for the Future, of Gig Worker Well-Being. (Feb","author":"Hsieh Jane","year":"2023","unstructured":"Jane Hsieh, Miranda Karger, Lucas Zagal, and Haiyi Zhu. 2023. Navigating Multi-Stakeholder Incentives, and Preferences, : Co-Designing Alternatives, for the Future, of Gig Worker Well-Being. (Feb. 2023). arXiv:2302.13436"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.487"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4225003"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2470742"},{"key":"e_1_2_1_56_1","unstructured":"Sonam Jindal. 2021. Responsible Sourcing of Data Enrichment Services. https:\/\/partnershiponai.org\/responsible-sourcing-considerations\/."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/INAPR.2018.8626999"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","unstructured":"Amba Kak. 2020. ''The Global South Is Everywhere but Also Always Somewhere'': National Policy Narratives & AI Justice. In vphantom Proceedings vphantomvphantom of the vphantom AAAI vphantomvphantom\/vphantom ACM Conference vphantomvphantom on vphantom AI vphantomvphantom vphantom Ethics vphantomvphantom and vphantom Society vphantomvphantomvphantom. ACM New York NY USA 307-312. https:\/\/doi.org\/10.1145\/3375627.3375859","DOI":"10.1145\/3375627.3375859"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1177\/0019793918820008"},{"key":"e_1_2_1_60_1","volume-title":"Su Lin Blodgett, Kristen Laird, Hanna Wallach, and Solon Barocas.","author":"Katzman Jared","year":"2023","unstructured":"Jared Katzman, Angelina Wang, Morgan Klaus Scheuerman, Su Lin Blodgett, Kristen Laird, Hanna Wallach, and Solon Barocas. 2023. Taxonomizing and Measuring Representational Harms, : A Look, at Image Tagging. In Proceedings of the Thirty-Seventh AAAI Conference, on Artificial Intelligence, and Thirty-Fifth Conference, on Innovative Applications, of Artificial Intelligence, and Thirteenth Symposium, on Educational Advances, in Artificial Intelligence."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274357"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533114"},{"key":"e_1_2_1_63_1","unstructured":"Anastassia Kornilova. 2022. Data Annotation Guidelines and Best Practices. https:\/\/snorkel.ai\/data-annotation\/."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11186-020-09404-2"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00436"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.822"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3443686"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-014-0483-x"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544013"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531663"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.2307\/622707"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449100"},{"key":"e_1_2_1_73_1","volume-title":"Annotation Instructions, for Computer Vision. (May","author":"Miceli Milagros","year":"2021","unstructured":"Milagros Miceli and Julian Posada. 2021. Wisdom for the Crowd, : Discoursive Power, in Annotation Instructions, for Computer Vision. (May 2021). arXiv:2105.10990"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.2205.11963"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415186"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445880"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.22409\/contracampo.v39i1.38252"},{"key":"e_1_2_1_79_1","unstructured":"J. W. Moses and T. L. Knutsen. 2019. Ways of Knowing: Competing Methodologies in Social and Political Research. Bloomsbury Publishing."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3279996.3280036"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1177\/20539517211016026"},{"key":"e_1_2_1_82_1","volume-title":"Moderators in America. The Verge","author":"Newton Casey","year":"2019","unstructured":"Casey Newton. 2019. The Secret Lives of Facebook, Moderators in America. The Verge (2019)."},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-015-0499-6"},{"key":"e_1_2_1_84_1","unstructured":"Abimbola Oshodi. 2022. How to Write Better Annotation Guidelines for Human Labelers : 4 Top Tips. https:\/\/superb-ai.com\/blog\/how-to-write-better-annotation-guidelines-for-human-labelers-4-top-tips\/."},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.24251\/hicss.2019.260"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2021.100336"},{"key":"e_1_2_1_87_1","volume-title":"Time (Feb","author":"Perrigo Billy","year":"2022","unstructured":"Billy Perrigo. 2022. Inside Facebook, 's African Sweatshop. Time (Feb. 2022)."},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1080\/23736992.2016.1228811"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.14763\/2019.4.1425"},{"key":"e_1_2_1_90_1","volume-title":"The Tacit Dimension","author":"Polanyi Michael","unstructured":"Michael Polanyi. 2009. The Tacit Dimension. The University of Chicago Press."},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2022.2049849"},{"key":"e_1_2_1_92_1","volume-title":"Google Research, and Alex Hanna","author":"Raji Inioluwa Deborah","year":"2021","unstructured":"Inioluwa Deborah Raji, Emily M Bender, Amandalynne Paullada, Emily Denton, Google Research, and Alex Hanna. 2021. AI, and the Everything, in the Whole Wide World Benchmark. (Nov. 2021). arXiv:2111.15366"},{"key":"e_1_2_1_93_1","volume-title":"Becoming a Technology Built on Worker Exploitation? Analytics India Mag","author":"Ramnani Meeta","year":"2022","unstructured":"Meeta Ramnani. 2022. Is AI, Becoming a Technology Built on Worker Exploitation? Analytics India Mag (2022)."},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/242206.242212"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.3366\/epi.2006.3.1-2.125"},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1527-2001.2009.01070.x"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1191\/030913297673302122"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0940-3"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445518"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517578"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476058"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1177\/20539517211053712"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359246"},{"key":"e_1_2_1_104_1","volume-title":"Proc. ACM Hum.-Comput. Interact.","volume":"4","author":"Scheuerman Morgan Klaus","year":"2020","unstructured":"Morgan Klaus Scheuerman, Kandrea Wade, Caitlin Lustig, and Jed R. Brubaker. 2020. How We, 've Taught Algorithms, to See Identity, : Constructing Race, and Gender, in Image Databases, for Facial Analysis. Proc. ACM Hum.-Comput. Interact., Vol. 4, CSCW1 (2020)."},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675285"},{"key":"e_1_2_1_106_1","unstructured":"Shreya Shankar Yoni Halpern Eric Breck James Atwood Jimbo Wilson and D. Sculley. 2017. No Classification without Representation : Assessing Geodiversity Issues in Open Data Sets for the Developing World. (Nov. 2017). arXiv:1711.08536"},{"key":"e_1_2_1_107_1","volume-title":"Replacing the `View, from Nowhere, ': A Pragmatist-Feminist Science Classroom. Electronic Journal of Science Education (Jan","author":"Stitzlein Sarah","year":"2004","unstructured":"Sarah Stitzlein. 2004. Replacing the `View, from Nowhere, ': A Pragmatist-Feminist Science Classroom. Electronic Journal of Science Education (Jan. 2004)."},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/1274892.1274909"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1177\/1024258917701381"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951720919776"},{"key":"e_1_2_1_111_1","volume-title":"in the Flickr30K Dataset. (May","author":"van Miltenburg Emiel","year":"2016","unstructured":"Emiel van Miltenburg. 2016. Stereotyping and Bias, in the Flickr30K Dataset. (May 2016), 24. arXiv:1605.06083"},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1145\/1958824.1958906"},{"key":"e_1_2_1_113_1","volume-title":"Proceedings of the Twenty-Ninth International Joint Conference, on Artificial Intelligence.","author":"Wang Ziwei","year":"2020","unstructured":"Ziwei Wang, Zi Huang, and Yadan Luo. 2020. Human Consensus-Oriented Image Captioning. In Proceedings of the Twenty-Ninth International Joint Conference, on Artificial Intelligence."},{"key":"e_1_2_1_114_1","volume-title":"Advances in Neural Information Processing Systems, J Shawe-Taylor","author":"Wauthier Fabian L","unstructured":"Fabian L Wauthier and Michael Jordan. 2011. Bayesian Bias Mitigation, for Crowdsourcing. In Advances in Neural Information Processing Systems, J Shawe-Taylor, R Zemel, P Bartlett, F Pereira, and K Q Weinberger (Eds.), Vol. 24. Curran Associates, Inc."},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512940"},{"key":"e_1_2_1_116_1","volume-title":"The Exploited Labor behind Artificial Intelligence. NOEMA","author":"Williams Adrienne","year":"2022","unstructured":"Adrienne Williams, Milagros Miceli, and Timnit Gebru. 2022. The Exploited Labor behind Artificial Intelligence. NOEMA (2022), 1-11."},{"key":"e_1_2_1_117_1","volume-title":"Contractors Allege Wage Theft. The Guardian","author":"Wong Julia Carrie","year":"2019","unstructured":"Julia Carrie Wong. 2019. 'A, White-Collar Sweatshop': Google Assistant, Contractors Allege Wage Theft. The Guardian (2019)."},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1080\/00130095.2020.1831908"},{"key":"e_1_2_1_119_1","volume-title":"Science and Other Cultures, : Issues, in Philosophies, of Science","author":"Wylie Alison","unstructured":"Alison Wylie. 2003. Why Standpoint Matters. In Science and Other Cultures, : Issues, in Philosophies, of Science, and Technology, Robert Figueroa and Sandra G Harding (Eds.). Routledge."},{"key":"e_1_2_1_120_1","volume-title":"Justice and the Politics of Difference","author":"Young Iris Marion","unstructured":"Iris Marion Young. 1990. Five Faces, of Oppression. In Justice and the Politics of Difference. Princeton University Press, 39-65."},{"key":"e_1_2_1_121_1","volume-title":"How Cheap Labor Drives China, 's A. I. Ambitions. New York Times","author":"Yuan L.","year":"2018","unstructured":"L. Yuan. 2018. How Cheap Labor Drives China, 's A. I. Ambitions. New York Times (2018), 1-5."},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581354"},{"key":"e_1_2_1_123_1","doi-asserted-by":"publisher","DOI":"10.3390\/foods9060823"},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11633-017-1085-8"},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d17-1323"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.3390\/soc11030086"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757481","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:45:42Z","timestamp":1760636742000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3757481"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":126,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,10,18]]}},"alternative-id":["10.1145\/3757481"],"URL":"https:\/\/doi.org\/10.1145\/3757481","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2025-10-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}