{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T04:08:08Z","timestamp":1750824488917,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3715275.3732189","type":"proceedings-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T17:03:13Z","timestamp":1750698193000},"page":"2934-2973","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Social Bias in Vision Transformers: A Comparative Study Across Architectures and Learning Paradigms"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-1405-3853","authenticated-orcid":false,"given":"Takehiro","family":"Tsurumi","sequence":"first","affiliation":[{"name":"Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6090-2765","authenticated-orcid":false,"given":"Elena","family":"Beretta","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"e_1_3_3_1_2_2","doi-asserted-by":"publisher","unstructured":"Hangbo Bao Li Dong and Furu Wei. 2021. BEIT: BERT Pre-Training of Image Transformers. 10.48550\/arxiv.2106.08254","DOI":"10.48550\/arxiv.2106.08254"},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"publisher","unstructured":"Elena Beretta. 2024. Gender in Pixels: Pathways to Non-binary Representation in Computer Vision. Proceedings of the AAAI\/ACM Conference on AI Ethics and Society 7 1 (Oct. 2024) 107\u2013119. 10.1609\/aies.v7i1.31622","DOI":"10.1609\/aies.v7i1.31622"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00453"},{"key":"e_1_3_3_1_5_2","first-page":"1877","volume-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems","volume":"33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared\u00a0D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Proceedings of the 34th International Conference on Neural Information Processing Systems, H.\u00a0Larochelle, M.\u00a0Ranzato, R.\u00a0Hadsell, M.F. Balcan, and H.\u00a0Lin (Eds.), Vol.\u00a033. Curran Associates, Inc., online, 1877\u20131901. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/file\/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf"},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/MetroXRAINE58569.2023.10405669"},{"key":"e_1_3_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00951"},{"key":"e_1_3_3_1_8_2","unstructured":"Ben Casselman and Dana Goldstein. 2015. The new science of sentencing. https:\/\/www.themarshallproject.org\/2015\/08\/04\/the-new-science-of-sentencing"},{"key":"e_1_3_3_1_9_2","series-title":"Proceedings of Machine Learning Research","first-page":"1691","volume-title":"Proceedings of the 37th International Conference on Machine Learning","volume":"119","author":"Chen Mark","year":"2020","unstructured":"Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Heewoo Jun, David Luan, and Ilya Sutskever. 2020. Generative Pretraining From Pixels. In Proceedings of the 37th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol.\u00a0119), Hal\u00a0Daum\u00e9 III and Aarti Singh (Eds.). PMLR, online, 1691\u20131703. https:\/\/proceedings.mlr.press\/v119\/chen20s.html"},{"key":"e_1_3_3_1_10_2","first-page":"1597","volume-title":"Proceedings of the 37th International Conference on Machine Learning (ICML)","volume":"119","author":"Chen Ting","year":"2020","unstructured":"Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey Hinton. 2020. A Simple Framework for Contrastive Learning of Visual Representations. In Proceedings of the 37th International Conference on Machine Learning (ICML), Vol.\u00a0119. JMLR.org, online, 1597\u20131607. https:\/\/proceedings.mlr.press\/v119\/chen20j\/chen20j.pdf"},{"key":"e_1_3_3_1_11_2","series-title":"(NIPS \u201920)","volume-title":"Proceedings of the 34th International Conference on Neural Information Processing Systems","author":"Chen Ting","year":"2020","unstructured":"Ting Chen, Simon Kornblith, Kevin Swersky, Mohammad Norouzi, and Geoffrey Hinton. 2020. Big self-supervised models are strong semi-supervised learners. In Proceedings of the 34th International Conference on Neural Information Processing Systems(NIPS \u201920). Curran Associates Inc., online, Article 1865, 13\u00a0pages."},{"key":"e_1_3_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00950"},{"key":"e_1_3_3_1_13_2","doi-asserted-by":"publisher","unstructured":"Kate Crawford and Trevor Paglen. 2021. Excavating AI: the politics of images in machine learning training sets. AI & Society 36 (2021) 1105\u20131116. 10.1007\/s00146-021-01162-8","DOI":"10.1007\/s00146-021-01162-8"},{"key":"e_1_3_3_1_14_2","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly Jakob Uszkoreit and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. https:\/\/arxiv.org\/pdf\/2010.11929.pdf"},{"key":"e_1_3_3_1_15_2","doi-asserted-by":"publisher","unstructured":"Eleanor Drage and Kerry Mackereth. 2022. Does AI Debias Recruitment? Race Gender and AI\u2019s \u201cEradication of Difference\u201d. Philosophy & Technology 35 4 (2022) 1\u201325. 10.1007\/s13347-022-00543-1","DOI":"10.1007\/s13347-022-00543-1"},{"key":"e_1_3_3_1_16_2","first-page":"226","volume-title":"KDD\u201996: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining","volume":"96","author":"Ester Martin","year":"1996","unstructured":"Martin Ester, Hans-Peter Kriegel, Jorg Sander, Xiaowei Xu, et\u00a0al. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In KDD\u201996: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, Vol.\u00a096. AAAI press, Portland Oregon, 226\u2013231."},{"key":"e_1_3_3_1_17_2","doi-asserted-by":"publisher","unstructured":"Anthony\u00a0G. Greenwald Debbie\u00a0E. McGhee and Jordan L.\u00a0K. Schwartz. 1998. Measuring Individual Differences in Implicit Cognition: The Implicit Association Test. Journal of Personality and Social Psychology 74 6 (1 1998) 1464\u20131480. 10.1037\/0022-3514.74.6.1464","DOI":"10.1037\/0022-3514.74.6.1464"},{"key":"e_1_3_3_1_18_2","volume-title":"Risk as a proxy for race","author":"Harcourt Bernard\u00a0E.","year":"2010","unstructured":"Bernard\u00a0E. Harcourt. 2010. Risk as a proxy for race. Working Paper University of Chicago Law & Economics Olin Working Paper No. 535, University of Chicago Public Law Working Paper No. 323. University of Chicago Law School. https:\/\/papers.ssrn.com\/sol3\/Delivery.cfm\/SSRN_ID1677654_code249436.pdf?abstractid=1677654&mirid=1"},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00975"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01309"},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"publisher","unstructured":"Os Keyes. 2018. The misgendering machines. Proceedings of the ACM on Human-Computer Interaction 2 CSCW (11 2018) 1\u201322. 10.1145\/3274357","DOI":"10.1145\/3274357"},{"key":"e_1_3_3_1_23_2","volume-title":"Learning Multiple Layers of Features from Tiny Images","author":"Krizhevsky Alex","year":"2009","unstructured":"Alex Krizhevsky. 2009. Learning Multiple Layers of Features from Tiny Images. Technical Report. University of Toronto. https:\/\/www.cs.toronto.edu\/\u00a0kriz\/learning-features-2009-TR.pdf"},{"key":"e_1_3_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"e_1_3_3_1_25_2","doi-asserted-by":"publisher","unstructured":"Sungho Park Jewook Lee Pilhyeon Lee Sunhee Hwang Dohyung Kim and Hyeran Byun. 2022. Fair contrastive learning for facial attribute classification. 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (6 2022) 10379\u201310388. 10.1109\/cvpr52688.2022.01014","DOI":"10.1109\/cvpr52688.2022.01014"},{"key":"e_1_3_3_1_26_2","doi-asserted-by":"publisher","unstructured":"Zhiliang Peng Dong Liu Hangbo Bao Qixiang Ye and Furu Wei. 2022. BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers. 10.48550\/arxiv.2208.06366","DOI":"10.48550\/arxiv.2208.06366"},{"key":"e_1_3_3_1_27_2","doi-asserted-by":"publisher","unstructured":"Sreeraj Ramachandran and Ajita Rattani. 2024. A Self-Supervised Learning Pipeline for demographically fair facial attribute classification. arXiv (Cornell University) (7 2024). 10.48550\/arxiv.2407.10104","DOI":"10.48550\/arxiv.2407.10104"},{"key":"e_1_3_3_1_28_2","doi-asserted-by":"publisher","unstructured":"Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Siying Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael\u00a0S. Bernstein Alexander\u00a0C. Berg and Feifei Li. 2015. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision 115 3 (4 2015) 211\u2013252. 10.1007\/s11263-015-0816-y","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_3_1_29_2","doi-asserted-by":"publisher","unstructured":"Morgan\u00a0Klaus Scheuerman Jacob\u00a0M. Paul and Jed\u00a0R. Brubaker. 2019. How computers see gender. Proceedings of the ACM on Human-Computer Interaction 3 CSCW (11 2019) 1\u201333. 10.1145\/3359246","DOI":"10.1145\/3359246"},{"key":"e_1_3_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_3_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01019"},{"key":"e_1_3_3_1_32_2","doi-asserted-by":"publisher","unstructured":"Jennifer\u00a0L. Skeem and Christopher\u00a0T. Lowenkamp. 2016. RISK RACE AND RECIDIVISM: PREDICTIVE BIAS AND DISPARATE IMPACT*. Criminology (Beverly Hills) 54 4 (11 2016) 680\u2013712. 10.1111\/1745-9125.12123","DOI":"10.1111\/1745-9125.12123"},{"key":"e_1_3_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445932"},{"key":"e_1_3_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.97"},{"key":"e_1_3_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01424-7_27"},{"key":"e_1_3_3_1_36_2","series-title":"Proceedings of Machine Learning Research","first-page":"10347","volume-title":"Proceedings of the 38th International Conference on Machine Learning","volume":"139","author":"Touvron Hugo","year":"2021","unstructured":"Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, and Herve Jegou. 2021. Training data-efficient image transformers and distillation through attention. In Proceedings of the 38th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol.\u00a0139), Marina Meila and Tong Zhang (Eds.). PMLR, online, 10347\u201310357. https:\/\/proceedings.mlr.press\/v139\/touvron21a.html"},{"key":"e_1_3_3_1_37_2","unstructured":"Laurens van\u00a0der Maaten and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9 86 (2008) 2579\u20132605. http:\/\/jmlr.org\/papers\/v9\/vandermaaten08a.html"},{"key":"e_1_3_3_1_38_2","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan\u00a0N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. https:\/\/arxiv.org\/abs\/1706.03762"},{"key":"e_1_3_3_1_39_2","unstructured":"Fei Wang Han Zhang Ziyu Guo Jianfeng Gao Wei Shen and Baining Guo. 2022. MILAN: Masked Image Pretraining on Language Assisted Representation."},{"key":"e_1_3_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01426"},{"key":"e_1_3_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00943"},{"key":"e_1_3_3_1_42_2","series-title":"Proceedings of Machine Learning Research","first-page":"25313","volume-title":"Proceedings of the 39th International Conference on Machine Learning (ICML)","volume":"162","author":"Yang Kaiyu","year":"2022","unstructured":"Kaiyu Yang, Jacqueline Yau, Li Fei-Fei, Jia Deng, and Olga Russakovsky. 2022. A study of face obfuscation in ImageNet. In Proceedings of the 39th International Conference on Machine Learning (ICML)(Proceedings of Machine Learning Research, Vol.\u00a0162). PMLR, Baltimore, Maryland, USA, 25313\u201325330. https:\/\/proceedings.mlr.press\/v162\/yang22c.html"},{"key":"e_1_3_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3375709"},{"key":"e_1_3_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d17-1323"},{"key":"e_1_3_3_1_45_2","doi-asserted-by":"publisher","unstructured":"Aylin \u00c7al\u0131\u015fkan Joanna\u00a0J. Bryson and Arvind Narayanan. 2017. Semantics Derived Automatically from Language Corpora Contain Human-like Biases. Science (New York N.Y.) 356 6334 (4 2017) 183\u2013186. 10.1126\/science.aal4230","DOI":"10.1126\/science.aal4230"}],"event":{"name":"FAccT '25: The 2025 ACM Conference on Fairness, Accountability, and Transparency","acronym":"FAccT '25","location":"Athens Greece"},"container-title":["Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715275.3732189","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T11:18:37Z","timestamp":1750763917000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715275.3732189"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":44,"alternative-id":["10.1145\/3715275.3732189","10.1145\/3715275"],"URL":"https:\/\/doi.org\/10.1145\/3715275.3732189","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-06-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}