{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:08Z","timestamp":1750220348129,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":35,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,7,21]],"date-time":"2021-07-21T00:00:00Z","timestamp":1626825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,21]]},"DOI":"10.1145\/3461702.3462603","type":"proceedings-article","created":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T01:21:38Z","timestamp":1627694498000},"page":"873-883","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Measuring Model Fairness under Noisy Covariates: A Theoretical Perspective"],"prefix":"10.1145","author":[{"given":"Flavien","family":"Prost","sequence":"first","affiliation":[{"name":"Google, New York, NY, USA"}]},{"given":"Pranjal","family":"Awasthi","sequence":"additional","affiliation":[{"name":"Google, New York, NY, USA"}]},{"given":"Nick","family":"Blumm","sequence":"additional","affiliation":[{"name":"Google, Mountain View, CA, USA"}]},{"given":"Aditee","family":"Kumthekar","sequence":"additional","affiliation":[{"name":"Google, Mountain View, CA, USA"}]},{"given":"Trevor","family":"Potter","sequence":"additional","affiliation":[{"name":"Google, San Bruno, CA, USA"}]},{"given":"Li","family":"Wei","sequence":"additional","affiliation":[{"name":"Google, Mountain View, CA, USA"}]},{"given":"Xuezhi","family":"Wang","sequence":"additional","affiliation":[{"name":"Google, New York, NY, USA"}]},{"given":"Ed H.","family":"Chi","sequence":"additional","affiliation":[{"name":"Google, Mountain View, CA, USA"}]},{"given":"Jilin","family":"Chen","sequence":"additional","affiliation":[{"name":"Google, Mountain View, CA, USA"}]},{"given":"Alex","family":"Beutel","sequence":"additional","affiliation":[{"name":"Google, New York, NY, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,7,30]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13672-6_40"},{"volume-title":"Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information. In ACM Conference on Fairness, Accountability, and Transparency (FAccT).","author":"Awasthi P.","key":"e_1_3_2_1_2_1","unstructured":"P. Awasthi , A. Beutel , M. Kleindessner , J. Morgenstern , and X. Wang . 2021 . Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information. In ACM Conference on Fairness, Accountability, and Transparency (FAccT). P. Awasthi, A. Beutel, M. Kleindessner, J. Morgenstern, and X. Wang. 2021. Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information. In ACM Conference on Fairness, Accountability, and Transparency (FAccT)."},{"key":"e_1_3_2_1_3_1","unstructured":"S. Barocas M. Hardt and A. Narayanan. 2018. Fairness and Machine Learning .fairmlbook.org. http:\/\/www.fairmlbook.org.  S. Barocas M. Hardt and A. Narayanan. 2018. Fairness and Machine Learning .fairmlbook.org. http:\/\/www.fairmlbook.org."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314234"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287594"},{"volume-title":"Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobserved. In Conference on Fairness, Accountability, and Transparency (ACM FAT*).","author":"Chen J.","key":"e_1_3_2_1_6_1","unstructured":"J. Chen , N. Kallus , X. Mao , G. Svacha , and M. Udell . 2019 b . Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobserved. In Conference on Fairness, Accountability, and Transparency (ACM FAT*). J. Chen, N. Kallus, X. Mao, G. Svacha, and M. Udell. 2019 b. Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobserved. In Conference on Fairness, Accountability, and Transparency (ACM FAT*)."},{"key":"e_1_3_2_1_7_1","volume-title":"Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data","author":"Chouldechova Alexandra","year":"2017","unstructured":"Alexandra Chouldechova . 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data , Vol. 5 , 2 ( 2017 ), 153--163. Alexandra Chouldechova. 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data, Vol. 5, 2 (2017), 153--163."},{"key":"e_1_3_2_1_8_1","volume-title":"Algorithmic decision making and the cost of fairness. CoRR","author":"Corbett-Davies Sam","year":"2017","unstructured":"Sam Corbett-Davies , Emma Pierson , Avi Feller , Sharad Goel , and Aziz Huq . 2017. Algorithmic decision making and the cost of fairness. CoRR , Vol. abs\/ 1701 .08230 ( 2017 ). arxiv: 1701.08230 http:\/\/arxiv.org\/abs\/1701.08230 Sam Corbett-Davies, Emma Pierson, Avi Feller, Sharad Goel, and Aziz Huq. 2017. Algorithmic decision making and the cost of fairness. CoRR, Vol. abs\/1701.08230 (2017). arxiv: 1701.08230 http:\/\/arxiv.org\/abs\/1701.08230"},{"key":"e_1_3_2_1_9_1","volume-title":"Fair Transfer Learning with Missing Protected Attributes. In AAAI \/ ACM Conference on Artificial Intelligence, Ethics, and Society.","author":"Coston Amanda","year":"2019","unstructured":"Amanda Coston , Karthikeyan N Ramamurthy , Dennis Wei , Kush R Varshney , Skyler Speakman , Zairah Mustahsan , and Supriyo Chakraborty . 2019 . Fair Transfer Learning with Missing Protected Attributes. In AAAI \/ ACM Conference on Artificial Intelligence, Ethics, and Society. Amanda Coston, Karthikeyan N Ramamurthy, Dennis Wei, Kush R Varshney, Skyler Speakman, Zairah Mustahsan, and Supriyo Chakraborty. 2019. Fair Transfer Learning with Missing Protected Attributes. In AAAI \/ ACM Conference on Artificial Intelligence, Ethics, and Society."},{"key":"e_1_3_2_1_10_1","unstructured":"W. Dieterich C. Mendoza and T. Brennan. 2016. COMPAS Risk Scales: Demonstrating Accuracy Equity and Predictive Parity. Technical Report. Northpointe Inc. https:\/\/www.equivant.com\/response-to-propublica-demonstrating-accuracy-equity-and-predictive-parity\/.  W. Dieterich C. Mendoza and T. Brennan. 2016. COMPAS Risk Scales: Demonstrating Accuracy Equity and Predictive Parity. Technical Report. Northpointe Inc. https:\/\/www.equivant.com\/response-to-propublica-demonstrating-accuracy-equity-and-predictive-parity\/."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278729"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_1_13_1","volume-title":"Fairness Evaluation in Presence of Biased Noisy Labels. In International Conference on Artificial Intelligence and Statistics. PMLR, 2325--2336","author":"Fogliato Riccardo","year":"2020","unstructured":"Riccardo Fogliato , Alexandra Chouldechova , and Max G'Sell . 2020 . Fairness Evaluation in Presence of Biased Noisy Labels. In International Conference on Artificial Intelligence and Statistics. PMLR, 2325--2336 . Riccardo Fogliato, Alexandra Chouldechova, and Max G'Sell. 2020. Fairness Evaluation in Presence of Biased Noisy Labels. In International Conference on Artificial Intelligence and Statistics. PMLR, 2325--2336."},{"key":"e_1_3_2_1_14_1","volume-title":"arXiv:1806.11212 [cs.LG]","author":"Gupta Maya","year":"2018","unstructured":"Maya Gupta , Andrew Cotter , Mahdi M Fard , and Serena Wang . 2018. Proxy Fairness . ( 2018 ). arXiv:1806.11212 [cs.LG] . Maya Gupta, Andrew Cotter, Mahdi M Fard, and Serena Wang. 2018. Proxy Fairness. (2018). arXiv:1806.11212 [cs.LG]."},{"key":"e_1_3_2_1_15_1","unstructured":"Moritz Hardt Eric Price and Nathan Srebro. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems.  Moritz Hardt Eric Price and Nathan Srebro. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems."},{"volume-title":"Fairness Without Demographics in Repeated Loss Minimization. In International Conference on Machine Learning (ICML). Code available on https:\/\/bit.ly\/2sFkDpE.","author":"Hashimoto T.","key":"e_1_3_2_1_16_1","unstructured":"T. Hashimoto , M. Srivastava , H. Namkoong , and P. Liang . 2018 . Fairness Without Demographics in Repeated Loss Minimization. In International Conference on Machine Learning (ICML). Code available on https:\/\/bit.ly\/2sFkDpE. T. Hashimoto, M. Srivastava, H. Namkoong, and P. Liang. 2018. Fairness Without Demographics in Repeated Loss Minimization. In International Conference on Machine Learning (ICML). Code available on https:\/\/bit.ly\/2sFkDpE."},{"key":"e_1_3_2_1_17_1","volume-title":"Calibration for the (Computationally-Identifiable) Masses. CoRR abs\/1711.08513","author":"H\u00e9bert-Johnson \u00darsula","year":"2017","unstructured":"\u00darsula H\u00e9bert-Johnson , Michael P Kim , Omer Reingold , and Guy N Rothblum . 2017. Calibration for the (Computationally-Identifiable) Masses. CoRR abs\/1711.08513 ( 2017 ). arXiv preprint arXiv:1711.08513 (2017). \u00darsula H\u00e9bert-Johnson, Michael P Kim, Omer Reingold, and Guy N Rothblum. 2017. Calibration for the (Computationally-Identifiable) Masses. CoRR abs\/1711.08513 (2017). arXiv preprint arXiv:1711.08513 (2017)."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v11i1.14976"},{"key":"e_1_3_2_1_19_1","volume-title":"Deceiving Google's Perspective API Built for Detecting Toxic Comments. CoRR","author":"Hosseini Hossein","year":"2017","unstructured":"Hossein Hosseini , Sreeram Kannan , Baosen Zhang , and Radha Poovendran . 2017. Deceiving Google's Perspective API Built for Detecting Toxic Comments. CoRR , Vol. abs\/ 1702 .08138 ( 2017 ). arxiv: 1702.08138 http:\/\/arxiv.org\/abs\/1702.08138 Hossein Hosseini, Sreeram Kannan, Baosen Zhang, and Radha Poovendran. 2017. Deceiving Google's Perspective API Built for Detecting Toxic Comments. CoRR, Vol. abs\/1702.08138 (2017). arxiv: 1702.08138 http:\/\/arxiv.org\/abs\/1702.08138"},{"key":"e_1_3_2_1_20_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 702--712","author":"Jiang Heinrich","year":"2020","unstructured":"Heinrich Jiang and Ofir Nachum . 2020 . Identifying and correcting label bias in machine learning . In International Conference on Artificial Intelligence and Statistics. PMLR, 702--712 . Heinrich Jiang and Ofir Nachum. 2020. Identifying and correcting label bias in machine learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 702--712."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3373154"},{"volume-title":"Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In International Conference on Machine Learning (ICML).","author":"Kearns Michael","key":"e_1_3_2_1_22_1","unstructured":"Michael Kearns , S. Neel , Roth A., and Z. S. Wu . 2018a . Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In International Conference on Machine Learning (ICML). Michael Kearns, S. Neel, Roth A., and Z. S. Wu. 2018a. Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In International Conference on Machine Learning (ICML)."},{"key":"e_1_3_2_1_23_1","volume-title":"International Conference on Machine Learning. PMLR, 2564--2572","author":"Kearns Michael","year":"2018","unstructured":"Michael Kearns , Seth Neel , Aaron Roth , and Zhiwei Steven Wu . 2018 b. Preventing fairness gerrymandering: Auditing and learning for subgroup fairness . In International Conference on Machine Learning. PMLR, 2564--2572 . Michael Kearns, Seth Neel, Aaron Roth, and Zhiwei Steven Wu. 2018b. Preventing fairness gerrymandering: Auditing and learning for subgroup fairness. In International Conference on Machine Learning. PMLR, 2564--2572."},{"key":"e_1_3_2_1_24_1","volume-title":"Giambattista Parascandolo, Moritz Hardt, Dominik Janzing, and Bernhard Sch\u00f6lkopf.","author":"Kilbertus Niki","year":"2017","unstructured":"Niki Kilbertus , Mateo Rojas Carulla , Giambattista Parascandolo, Moritz Hardt, Dominik Janzing, and Bernhard Sch\u00f6lkopf. 2017 . Avoiding discrimination through causal reasoning. In Advances in Neural Information Processing Systems . 656--666. Niki Kilbertus, Mateo Rojas Carulla, Giambattista Parascandolo, Moritz Hardt, Dominik Janzing, and Bernhard Sch\u00f6lkopf. 2017. Avoiding discrimination through causal reasoning. In Advances in Neural Information Processing Systems. 656--666."},{"key":"e_1_3_2_1_25_1","volume-title":"Inherent Trade-Offs in the Fair Determination of Risk Scores. In Innovations in Theoretical Computer Science Conference (ITCS).","author":"Kleinberg Jon","year":"2017","unstructured":"Jon Kleinberg , Sendhil Mullainathan , and Manish Raghavan . 2017 . Inherent Trade-Offs in the Fair Determination of Risk Scores. In Innovations in Theoretical Computer Science Conference (ITCS). Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent Trade-Offs in the Fair Determination of Risk Scores. In Innovations in Theoretical Computer Science Conference (ITCS)."},{"key":"e_1_3_2_1_26_1","volume-title":"False information on web and social media: A survey. arXiv preprint arXiv:1804.08559","author":"Kumar Srijan","year":"2018","unstructured":"Srijan Kumar and Neil Shah . 2018. False information on web and social media: A survey. arXiv preprint arXiv:1804.08559 ( 2018 ). Srijan Kumar and Neil Shah. 2018. False information on web and social media: A survey. arXiv preprint arXiv:1804.08559 (2018)."},{"key":"e_1_3_2_1_27_1","volume-title":"H","author":"Kumthekar Aditee Ajit","year":"2019","unstructured":"Aditee Ajit Kumthekar , Aniruddh Nath , Ed H . Chi, Ed H. Chi, Jilin Chen , Li Wei, Lichan Hong, Mahesh Sathiamoorthy, Shawn Andrews, Xinyang Yi, and Zhe Zhao. 2019 . Recommending What Video to Watch Next : A Multitask Ranking System . Aditee Ajit Kumthekar, Aniruddh Nath, Ed H. Chi, Ed H. Chi, Jilin Chen, Li Wei, Lichan Hong, Mahesh Sathiamoorthy, Shawn Andrews, Xinyang Yi, and Zhe Zhao. 2019. Recommending What Video to Watch Next: A Multitask Ranking System."},{"key":"e_1_3_2_1_28_1","volume-title":"Chi","author":"Lahoti Preethi","year":"2020","unstructured":"Preethi Lahoti , Alex Beutel , Jilin Chen , Kang Lee , Flavien Prost , Nithum Thain , Xuezhi Wang , and Ed H . Chi . 2020 . Fairness without Demographics through Adversarially Reweighted Learning . arxiv: 2006.13114 [cs.LG] Preethi Lahoti, Alex Beutel, Jilin Chen, Kang Lee, Flavien Prost, Nithum Thain, Xuezhi Wang, and Ed H. Chi. 2020. Fairness without Demographics through Adversarially Reweighted Learning. arxiv: 2006.13114 [cs.LG]"},{"key":"e_1_3_2_1_29_1","unstructured":"Alexandre L Lamy Ziyuan Zhong Aditya K Menon and Nakul Verma. 2019. Noise-tolerant fair classification. In Advances in Neural Information Processing Systems.  Alexandre L Lamy Ziyuan Zhong Aditya K Menon and Nakul Verma. 2019. Noise-tolerant fair classification. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-3008"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1302"},{"key":"e_1_3_2_1_32_1","volume-title":"On conditional parity as a notion of non-discrimination in machine learning. arXiv preprint arXiv:1706.08519","author":"Ritov Ya'acov","year":"2017","unstructured":"Ya'acov Ritov , Yuekai Sun , and Ruofei Zhao . 2017. On conditional parity as a notion of non-discrimination in machine learning. arXiv preprint arXiv:1706.08519 ( 2017 ). Ya'acov Ritov, Yuekai Sun, and Ruofei Zhao. 2017. On conditional parity as a notion of non-discrimination in machine learning. arXiv preprint arXiv:1706.08519 (2017)."},{"volume-title":"Graphical models, exponential families, and variational inference","author":"Wainwright Martin J","key":"e_1_3_2_1_33_1","unstructured":"Martin J Wainwright and Michael Irwin Jordan . 2008. Graphical models, exponential families, and variational inference . Now Publishers Inc . Martin J Wainwright and Michael Irwin Jordan. 2008. Graphical models, exponential families, and variational inference .Now Publishers Inc."},{"key":"e_1_3_2_1_34_1","unstructured":"Michael Wick Swetasudha Panda and Jean-Baptiste Tristan. 2019. Unlocking fairness: a trade-off revisited. (2019).  Michael Wick Swetasudha Panda and Jean-Baptiste Tristan. 2019. Unlocking fairness: a trade-off revisited. (2019)."},{"key":"e_1_3_2_1_35_1","volume-title":"Fairness Constraints: Mechanisms for Fair Classification. In International Conference on Artificial Intelligence and Statistics (AISTATS).","author":"Zafar Muhammad B","year":"2017","unstructured":"Muhammad B Zafar , Isabel Valera , Manuel G Rodriguez , and Krishna Gummadi . 2017 . Fairness Constraints: Mechanisms for Fair Classification. In International Conference on Artificial Intelligence and Statistics (AISTATS). Muhammad B Zafar, Isabel Valera, Manuel G Rodriguez, and Krishna Gummadi. 2017. Fairness Constraints: Mechanisms for Fair Classification. In International Conference on Artificial Intelligence and Statistics (AISTATS)."}],"event":{"name":"AIES '21: AAAI\/ACM Conference on AI, Ethics, and Society","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"],"location":"Virtual Event USA","acronym":"AIES '21"},"container-title":["Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462603","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461702.3462603","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:06Z","timestamp":1750191426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461702.3462603"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,21]]},"references-count":35,"alternative-id":["10.1145\/3461702.3462603","10.1145\/3461702"],"URL":"https:\/\/doi.org\/10.1145\/3461702.3462603","relation":{},"subject":[],"published":{"date-parts":[[2021,7,21]]},"assertion":[{"value":"2021-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}