{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T16:37:41Z","timestamp":1770741461231,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":32,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,1]],"date-time":"2021-03-01T00:00:00Z","timestamp":1614556800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,3]]},"DOI":"10.1145\/3442188.3445884","type":"proceedings-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T01:26:24Z","timestamp":1614734784000},"page":"206-214","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information"],"prefix":"10.1145","author":[{"given":"Pranjal","family":"Awasthi","sequence":"first","affiliation":[{"name":"Rutgers University & Google"}]},{"given":"Alex","family":"Beutel","sequence":"additional","affiliation":[{"name":"Google"}]},{"given":"Matth\u00e4us","family":"Kleindessner","sequence":"additional","affiliation":[{"name":"Amazon"}]},{"given":"Jamie","family":"Morgenstern","sequence":"additional","affiliation":[{"name":"University of Washington & Google"}]},{"given":"Xuezhi","family":"Wang","sequence":"additional","affiliation":[{"name":"Google"}]}],"member":"320","published-online":{"date-parts":[[2021,3]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International Conference on Artificial Intelligence and Statistics.","author":"Awasthi Pranjal","year":"2020","unstructured":"Pranjal Awasthi, Matth\u00e4us Kleindessner, and Jamie Morgenstern. 2020. Equalized odds postprocessing under imperfect group information. In International Conference on Artificial Intelligence and Statistics."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330745"},{"key":"e_1_3_2_1_3_1","unstructured":"Avrim Blum Suriya Gunasekar Thodoris Lykouris and Nati Srebro. 2018. On preserving non-discrimination when combining expert advice. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_4_1","volume-title":"Using Bayesian imputation to assess racial and ethnic disparities in pediatric performance measures. Health services research 51, 3","author":"Brown David P","year":"2016","unstructured":"David P Brown, Caprice Knapp, Kimberly Baker, and Meggen Kaufmann. 2016. Using Bayesian imputation to assess racial and ethnic disparities in pediatric performance measures. Health services research 51, 3 (2016), 1095--1108."},{"key":"e_1_3_2_1_5_1","volume-title":"Using publicly available information to proxy for unidentified race and ethnicity: A methodology and assessment","author":"Consumer Financial Protection Bureau","year":"2014","unstructured":"Consumer Financial Protection Bureau. 2014. Using publicly available information to proxy for unidentified race and ethnicity: A methodology and assessment. Washington, DC: CFPB, Summer (2014)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2009.83"},{"key":"e_1_3_2_1_7_1","unstructured":"L Elisa Celis Damian Straszak and Nisheeth K Vishnoi. 2018. Ranking with fairness constraints. In International Colloquium on Automata Languages and Programming (ICALP)."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287594"},{"key":"e_1_3_2_1_9_1","unstructured":"Flavio Chierichetti Ravi Kumar Silvio Lattanzi and Sergei Vassilvitskii. 2017. Fair clustering through fairlets. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_10_1","volume-title":"Fair Transfer Learning with Missing Protected Attributes. In AAAI \/ ACM Conference on Artificial Intelligence, Ethics, and Society.","author":"Coston Amanda","year":"2019","unstructured":"Amanda Coston, Karthikeyan N Ramamurthy, Dennis Wei, Kush R Varshney, Skyler Speakman, Zairah Mustahsan, and Supriyo Chakraborty. 2019. Fair Transfer Learning with Missing Protected Attributes. In AAAI \/ ACM Conference on Artificial Intelligence, Ethics, and Society."},{"key":"e_1_3_2_1_11_1","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1377\/hlthaff.24.2.516"},{"key":"e_1_3_2_1_14_1","first-page":"1","article-title":"When race\/ethnicity data are lacking","volume":"6","author":"Fremont Allen M","year":"2016","unstructured":"Allen M Fremont, Joel S Weissman, Emily Hoch, and Marc N Elliott. 2016. When race\/ethnicity data are lacking. RAND Health Q 6 (2016), 1--6.","journal-title":"RAND Health Q"},{"key":"e_1_3_2_1_15_1","unstructured":"Stephen Gillen Christopher Jung Michael Kearns and Aaron Roth. 2018. Online learning with an unknown fairness metric. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_16_1","volume-title":"arXiv:1806.11212 [cs.LG]","author":"Gupta Maya","year":"2018","unstructured":"Maya Gupta, Andrew Cotter, Mahdi M Fard, and Serena Wang. 2018. Proxy Fairness. (2018). arXiv:1806.11212 [cs.LG]."},{"key":"e_1_3_2_1_17_1","unstructured":"Moritz Hardt Eric Price and Nathan Srebro. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_18_1","volume-title":"Long Short-term Memory. Neural computation 9 (12","author":"Hochreiter Sepp","year":"1997","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long Short-term Memory. Neural computation 9 (12 1997), 1735--80."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_2_1_20_1","volume-title":"International Conference on Machine Learning.","author":"Jabbari Shahin","year":"2017","unstructured":"Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, and Aaron Roth. 2017. Fairness in reinforcement learning. In International Conference on Machine Learning."},{"key":"e_1_3_2_1_21_1","unstructured":"Matthew Joseph Michael Kearns Jamie H Morgenstern and Aaron Roth. 2016. Fairness in learning: Classic and contextual bandits. In Advances in Neural Information Processing Systems. 325--333."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3373154"},{"key":"e_1_3_2_1_23_1","volume-title":"Inherent Trade-Offs in the Fair Determination of Risk Scores. In Innovations in Theoretical Computer Science Conference (ITCS).","author":"Kleinberg Jon","year":"2017","unstructured":"Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent Trade-Offs in the Fair Determination of Risk Scores. In Innovations in Theoretical Computer Science Conference (ITCS)."},{"key":"e_1_3_2_1_24_1","volume-title":"International Conference on Machine Learning.","author":"Kleindessner Matth\u00e4us","year":"2019","unstructured":"Matth\u00e4us Kleindessner, Pranjal Awasthi, and Jamie Morgenstern. 2019. Fair k-center clustering for data summarization. In International Conference on Machine Learning."},{"key":"e_1_3_2_1_25_1","unstructured":"Alexandre L Lamy Ziyuan Zhong Aditya K Menon and Nakul Verma. 2019. Noise-tolerant fair classification. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_26_1","unstructured":"Geoff Pleiss Manish Raghavan Felix Wu Jon Kleinberg and Kilian Q Weinberger. 2017. On fairness and calibration. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_27_1","unstructured":"Samira Samadi Uthaipon Tantipongpipat Jamie H Morgenstern Mohit Singh and Santosh Vempala. 2018. The price of fair PCA: One extra dimension. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_28_1","volume-title":"H Chi","author":"Schumann Candice","year":"2019","unstructured":"Candice Schumann, Xuezhi Wang, Alex Beutel, Jilin Chen, Hai Qian, and Ed H Chi. 2019. Transfer of machine learning fairness across domains. (2019). arXiv:1906.09688 [cs.LG]."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1103069"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052660"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2016.2579"},{"key":"e_1_3_2_1_32_1","unstructured":"Indre Zliobaite. 2015. On the relation between accuracy and fairness in binary classification. (2015). arXiv:1505.05723 [cs.LG]."}],"event":{"name":"FAccT '21: 2021 ACM Conference on Fairness, Accountability, and Transparency","location":"Virtual Event Canada","acronym":"FAccT '21","sponsor":["ACM Association for Computing Machinery"]},"container-title":["Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442188.3445884","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442188.3445884","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:56Z","timestamp":1750193336000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442188.3445884"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3]]},"references-count":32,"alternative-id":["10.1145\/3442188.3445884","10.1145\/3442188"],"URL":"https:\/\/doi.org\/10.1145\/3442188.3445884","relation":{},"subject":[],"published":{"date-parts":[[2021,3]]},"assertion":[{"value":"2021-03-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}