{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T01:23:37Z","timestamp":1785893017994,"version":"3.56.0"},"publisher-location":"New York, NY, USA","reference-count":58,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T00:00:00Z","timestamp":1750636800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS-1956435, CNS-2344925, CNS-2319409"],"award-info":[{"award-number":["CNS-1956435, CNS-2344925, CNS-2319409"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,6,23]]},"DOI":"10.1145\/3715275.3732172","type":"proceedings-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T17:03:13Z","timestamp":1750698193000},"page":"2640-2656","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Auditing for Bias in Ad Delivery Using Inferred Demographic Attributes"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6645-7850","authenticated-orcid":false,"given":"Basileal","family":"Imana","sequence":"first","affiliation":[{"name":"Princeton University, Princeton, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8237-9058","authenticated-orcid":false,"given":"Aleksandra","family":"Korolova","sequence":"additional","affiliation":[{"name":"Princeton University, Princeton, New Jersey, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1225-7562","authenticated-orcid":false,"given":"John","family":"Heidemann","sequence":"additional","affiliation":[{"name":"USC\/Information Sciences Institute, Los Angeles, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,23]]},"reference":[{"key":"e_1_3_3_1_2_2","doi-asserted-by":"publisher","unstructured":"Dzifa Adjaye-Gbewonyo Robert\u00a0A. Bednarczyk Robert\u00a0L. Davis and Saad\u00a0B. Omer. 2014. Using the Bayesian Improved Surname Geocoding Method (BISG) to create a working classification of race and ethnicity in a diverse managed care population: a validation study. Health Serv Res 49 1 (2014) 268\u201383. https:\/\/doi.org\/10.1111\/1475-6773.12089","DOI":"10.1111\/1475-6773.12089"},{"key":"e_1_3_3_1_3_2","unstructured":"Rachad Alao Miranda Bogen Jingang Miao Ilya Mironov and Jonathan Tannen. 2021. How Meta is working to assess fairness in relation to race in the U.S. across its products and systems. Technical Report https:\/\/ai.facebook.com\/research\/publications\/how-meta-is-working-to-assess-fairness-in-relation-to-race-in-the-us-across-its-products-and-systems."},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359301"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441801"},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445888"},{"key":"e_1_3_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3617694.3623234"},{"key":"e_1_3_3_1_8_2","unstructured":"Roy\u00a0L. Austin. 2023. An Update on Our Ads Fairness Efforts. https:\/\/about.fb.com\/news\/2023\/01\/an-update-on-our-ads-fairness-efforts\/."},{"key":"e_1_3_3_1_9_2","volume-title":"International Conference on Artificial Intelligence and Statistics","author":"Awasthi Pranjal","year":"2019","unstructured":"Pranjal Awasthi, Matth\u00e4us Kleindessner, and Jamie Morgenstern. 2019. Equalized odds postprocessing under imperfect group information. In International Conference on Artificial Intelligence and Statistics. https:\/\/api.semanticscholar.org\/CorpusID:204008443"},{"key":"e_1_3_3_1_10_2","unstructured":"Arthur\u00a0P. Baines and Marsha\u00a0J. Courchane. 2014. Fair Lending: Implications for the Indirect Auto Finance Market. Technical Report: https:\/\/media.crai.com\/sites\/default\/files\/publications\/Fair-Lending-Implications-for-the-Indirect-Auto-Finance-Market.pdf."},{"key":"e_1_3_3_1_11_2","unstructured":"Siddhartha Basu Ruthie Berman Adam Bloomston John Campbell Anne Diaz Nanako Era Benjamin Evans Sukhada Palkar and Skyler Wharton. 2022. Measuring Discrepancies in Airbnb Guest Acceptance Rates Using Anonymized Demographic Data. Technical Report. (2022). arXiv:https:\/\/arXiv.org\/abs\/2204.12001"},{"key":"e_1_3_3_1_12_2","unstructured":"Miranda Bogen. 2024. Navigating Demographic Measurement for Fairness and Equity. Technical Report: https:\/\/cdt.org\/insights\/report-navigating-demographic-measurement-for-fairness-and-equity\/. (2024)."},{"key":"e_1_3_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372877"},{"key":"e_1_3_3_1_14_2","unstructured":"Consumer Financial\u00a0Protection Bureau. 2014. Using publicly available information to proxy for unidentified race and ethnicity. Technical Report: https:\/\/files.consumerfinance.gov\/f\/201409_cfpb_report_proxy-methodology.pdf."},{"key":"e_1_3_3_1_15_2","series-title":"Proceedings of Machine Learning Research","first-page":"1349","volume-title":"Proceedings of the 38th International Conference on Machine Learning","volume":"139","author":"Celis L.\u00a0Elisa","year":"2021","unstructured":"L.\u00a0Elisa Celis, Lingxiao Huang, Vijay Keswani, and Nisheeth\u00a0K. Vishnoi. 2021. Fair Classification with Noisy Protected Attributes: A Framework with Provable Guarantees. In Proceedings of the 38th International Conference on Machine Learning(Proceedings of Machine Learning Research, Vol.\u00a0139), Marina Meila and Tong Zhang (Eds.). PMLR, 1349\u20131361. https:\/\/proceedings.mlr.press\/v139\/celis21a.html"},{"key":"e_1_3_3_1_16_2","unstructured":"Fumian Chen Dayu Yang and Hui Fang. 2024. Toward Automatic Group Membership Annotation for Group Fairness Evaluation. arxiv:https:\/\/arXiv.org\/abs\/2407.08926https:\/\/arxiv.org\/abs\/2407.08926"},{"key":"e_1_3_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287594"},{"key":"e_1_3_3_1_18_2","unstructured":"U.S. Election\u00a0Assistance Commission. 2020. Availability of State Voter File and Confidential Information. https:\/\/www.eac.gov\/sites\/default\/files\/voters\/Available_Voter_File_Information.pdf."},{"key":"e_1_3_3_1_19_2","unstructured":"Amit Datta Anupam Datta Jael Makagon Deirdre\u00a0K Mulligan and Michael\u00a0Carl Tschantz. 2018. Discrimination in Online Personalization: A Multidisciplinary Inquiry. Proceedings of the 2018 ACM Conference on Fairness Accountability and Transparency 81 (2018) 20\u201334."},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.4230\/LIPIcs.ITCS.2019.33"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1475-6773.2008.00854.x"},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10742-009-0047-1"},{"key":"e_1_3_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/SaTML59370.2024.00016"},{"key":"e_1_3_3_1_24_2","doi-asserted-by":"crossref","unstructured":"Hadi Elzayn Evelyn Smith Thomas Hertz Arun Ramesh Robin Fisher Daniel\u00a0E. Ho and Jacob Goldin. 2023. Measuring and Mitigating Racial Disparities in Tax Audits. https:\/\/siepr.stanford.edu\/publications\/measuring-and-mitigating-racial-disparities-tax-audits.","DOI":"10.1093\/qje\/qjae027"},{"key":"e_1_3_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3534641"},{"key":"e_1_3_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462850"},{"key":"e_1_3_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3600211.3604707"},{"key":"e_1_3_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3450077"},{"key":"e_1_3_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3659041"},{"key":"e_1_3_3_1_31_2","doi-asserted-by":"publisher","unstructured":"Rashidul Islam Huiyuan Chen and Yiwei Cai. 2024. Fairness without Demographics through Shared Latent Space-Based Debiasing. Proceedings of the AAAI Conference on Artificial Intelligence 38 11 (Mar. 2024) 12717\u201312725. https:\/\/doi.org\/10.1609\/aaai.v38i11.29167","DOI":"10.1609\/aaai.v38i11.29167"},{"key":"e_1_3_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3517745.3561450"},{"key":"e_1_3_3_1_33_2","doi-asserted-by":"crossref","unstructured":"Anja Lambrecht and Catherine Tucker. 2019. Algorithmic bias? An empirical study of apparent gender-based discrimination in the display of STEM career ads. Management Science 65 7 (2019) 2966\u20132981.","DOI":"10.1287\/mnsc.2018.3093"},{"key":"e_1_3_3_1_34_2","unstructured":"Alex Lamy Ziyuan Zhong Aditya\u00a0K Menon and Nakul Verma. 2019. Noise-tolerant fair classification. Advances in Neural Information Processing Systems 32 (2019)."},{"key":"e_1_3_3_1_35_2","unstructured":"LinkedIn. [n. d.]. Inferred Age or Gender on LinkedIn. https:\/\/www.linkedin.com\/help\/linkedin\/answer\/a517610\/inferred-age-or-gender-on-linkedin?lang=en."},{"key":"e_1_3_3_1_36_2","unstructured":"LinkedIn. 2022. Together we can improve equal access to opportunity. https:\/\/members.linkedin.com\/equal-access."},{"key":"e_1_3_3_1_37_2","volume-title":"2013 AAAI spring symposium series","author":"Liu Wendy","year":"2013","unstructured":"Wendy Liu and Derek Ruths. 2013. What\u2019s in a name? using first names as features for gender inference in twitter. In 2013 AAAI spring symposium series."},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"crossref","unstructured":"Jeffrey\u00a0W Lockhart Molly\u00a0M King and Christin Munsch. 2023. Name-based demographic inference and the unequal distribution of misrecognition. Nature Human Behaviour (2023) 1\u201312.","DOI":"10.31235\/osf.io\/vedq6"},{"key":"e_1_3_3_1_39_2","unstructured":"Benjamin Lu Jia Wan Derek Ouyang Jacob Goldin and Daniel\u00a0E. Ho. 2024. Quantifying the Uncertainty of Imputed Demographic Disparity Estimates: The Dual-Bootstrap. arxiv:https:\/\/arXiv.org\/abs\/2403.06238https:\/\/arxiv.org\/abs\/2403.06238"},{"key":"e_1_3_3_1_40_2","doi-asserted-by":"publisher","unstructured":"Feixiong Luo Guofeng Cao Kevin Mulligan and Xiang Li. 2016. Explore spatiotemporal and demographic characteristics of human mobility via Twitter: A case study of Chicago. Applied Geography 70 (2016) 11\u201325. https:\/\/doi.org\/10.1016\/j.apgeog.2016.03.001","DOI":"10.1016\/j.apgeog.2016.03.001"},{"key":"e_1_3_3_1_41_2","doi-asserted-by":"crossref","unstructured":"Cory McCartan Robin Fisher Jacob Goldin Daniel\u00a0E. Ho and Kosuke Imai. 2024. Estimating Racial Disparities When Race is Not Observed. arxiv:https:\/\/arXiv.org\/abs\/2303.02580https:\/\/arxiv.org\/abs\/2303.02580","DOI":"10.3386\/w32373"},{"key":"e_1_3_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445887"},{"key":"e_1_3_3_1_43_2","first-page":"31711","volume-title":"Advances in Neural Information Processing Systems","volume":"35","author":"Mehrotra Anay","year":"2022","unstructured":"Anay Mehrotra and Nisheeth Vishnoi. 2022. Fair Ranking with Noisy Protected Attributes. In Advances in Neural Information Processing Systems, Vol.\u00a035. Curran Associates, Inc., 31711\u201331725. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/cdd0640218a27e9e2c0e52e324e25db0-Paper-Conference.pdf"},{"key":"e_1_3_3_1_44_2","unstructured":"Meta\u2019s Civil Rights Team. 2021. Meta\u2019s Progress on Civil Rights Audit Commitments. Retrieved November 22 2021 from https:\/\/about.fb.com\/wp-content\/uploads\/2021\/11\/Metas-Progress-on-Civil-Rights-Audit-Commitments.pdf"},{"key":"e_1_3_3_1_45_2","unstructured":"Mozilla. [n. d.]. Mozilla Rally. https:\/\/rally.mozilla.org\/."},{"key":"e_1_3_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3659014"},{"key":"e_1_3_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533140"},{"key":"e_1_3_3_1_48_2","doi-asserted-by":"crossref","unstructured":"Aruna Sankaranarayanan Erik Hemberg and Una-May O\u2019Reilly. 2023. The Facebook Algorithm\u2019s Active Role in Climate Advertisement Delivery. https:\/\/arxiv.org\/abs\/2308.03191","DOI":"10.21203\/rs.3.rs-4204078\/v1"},{"key":"e_1_3_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534135"},{"key":"e_1_3_3_1_50_2","unstructured":"Abhin Shah Maohao Shen Jongha\u00a0Jon Ryu Subhro Das Prasanna Sattigeri Yuheng Bu and Gregory\u00a0W. Wornell. 2023. Group Fairness with Uncertainty in Sensitive Attributes. arxiv:https:\/\/arXiv.org\/abs\/2302.08077https:\/\/arxiv.org\/abs\/2302.08077"},{"key":"e_1_3_3_1_51_2","first-page":"5","volume-title":"Proceedings of Machine Learning Research","volume":"81","author":"Speicher Till","year":"2018","unstructured":"Till Speicher, Muhammad Ali, Giridhari Venkatadri, Filipe\u00a0Nunes Ribeiro, George Arvanitakis, Fabr\u00edcio Benevenuto, Krishna\u00a0P. Gummadi, Patrick Loiseau, and Alan Mislove. 2018. Potential for Discrimination in Online Targeted Advertising. In Proceedings of Machine Learning Research, Sorelle\u00a0A. Friedler and Christo Wilson (Eds.), Vol.\u00a081. PMLR, New York, NY, USA, 5\u201319. http:\/\/proceedings.mlr.press\/v81\/speicher18a.html"},{"key":"e_1_3_3_1_52_2","doi-asserted-by":"publisher","unstructured":"Latanya Sweeney. 2013. Discrimination in Online Ad Delivery: Google Ads Black Names and White Names Racial Discrimination and Click Advertising. Queue (2013) 20\u00a0pages. https:\/\/doi.org\/10.1145\/2460276.2460278","DOI":"10.1145\/2460276.2460278"},{"key":"e_1_3_3_1_53_2","unstructured":"The US Department of Justice. 2022. Justice Department Secures Groundbreaking Settlement Agreement with Meta Platforms Formerly Known as Facebook to Resolve Allegations of Discriminatory Advertising. https:\/\/www.justice.gov\/opa\/pr\/justice-department-secures-groundbreaking-settlement-agreement-meta-platforms-formerly-known."},{"key":"e_1_3_3_1_54_2","unstructured":"The US Department of Justice. 2022. United States v. Meta Platforms Inc. f\/k\/a Facebook Inc. (S.D.N.Y.). https:\/\/www.justice.gov\/crt\/case\/united-states-v-meta-platforms-inc-fka-facebook-inc-sdny."},{"key":"e_1_3_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3580305.3599916"},{"key":"e_1_3_3_1_56_2","unstructured":"Sarah Villenueve Tina Park and Eliza McCullough. 2023. Eyes Off My Data Exploring Differentially Private Federated Statistics to Support Algorithmic Bias Assessments Across Demographic Groups. Technical Report: https:\/\/partnershiponai.org\/paper\/eyes-off-my-data\/. (2023)."},{"key":"e_1_3_3_1_57_2","doi-asserted-by":"crossref","unstructured":"Solvejg Wastvedt Joshua Snoke Denis Agniel Julie Lai Marc\u00a0N. Elliott and Steven\u00a0C. Martino. 2024. De-Biasing the Bias: Methods for Improving Disparity Assessments with Noisy Group Measurements. arxiv:https:\/\/arXiv.org\/abs\/2402.13391https:\/\/arxiv.org\/abs\/2402.13391","DOI":"10.1093\/biomtc\/ujae155"},{"key":"e_1_3_3_1_58_2","doi-asserted-by":"publisher","unstructured":"Yan Zhang. 2018. Assessing Fair Lending Risks Using Race\/Ethnicity Proxies. Management Science 64 1 (2018) 178\u2013197. https:\/\/doi.org\/10.1287\/mnsc.2016.2579 arXiv:10.1287\/mnsc.2016.2579","DOI":"10.1287\/mnsc.2016.2579"},{"key":"e_1_3_3_1_59_2","first-page":"43258","volume-title":"International Conference on Machine Learning","author":"Zhu Zhaowei","year":"2023","unstructured":"Zhaowei Zhu, Yuanshun Yao, Jiankai Sun, Hang Li, and Yang Liu. 2023. Weak proxies are sufficient and preferable for fairness with missing sensitive attributes. In International Conference on Machine Learning. PMLR, 43258\u201343288."}],"event":{"name":"FAccT '25: The 2025 ACM Conference on Fairness, Accountability, and Transparency","location":"Athens Greece","acronym":"FAccT '25"},"container-title":["Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715275.3732172","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3715275.3732172","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T11:20:57Z","timestamp":1750764057000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3715275.3732172"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,23]]},"references-count":58,"alternative-id":["10.1145\/3715275.3732172","10.1145\/3715275"],"URL":"https:\/\/doi.org\/10.1145\/3715275.3732172","relation":{},"subject":[],"published":{"date-parts":[[2025,6,23]]},"assertion":[{"value":"2025-06-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}