{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,12]],"date-time":"2025-08-12T21:33:24Z","timestamp":1755034404850,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,8,8]],"date-time":"2023-08-08T00:00:00Z","timestamp":1691452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"IBM Corporation","award":["W1771793"],"award-info":[{"award-number":["W1771793"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,8]]},"DOI":"10.1145\/3600211.3604713","type":"proceedings-article","created":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T18:41:37Z","timestamp":1693334497000},"page":"764-774","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Stress-Testing Bias Mitigation Algorithms to Understand Fairness Vulnerabilities"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4791-5796","authenticated-orcid":false,"given":"Karan","family":"Bhanot","sequence":"first","affiliation":[{"name":"Rensselaer Polytechnic Institute, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8257-9866","authenticated-orcid":false,"given":"Ioana","family":"Baldini","sequence":"additional","affiliation":[{"name":"IBM Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6510-1537","authenticated-orcid":false,"given":"Dennis","family":"Wei","sequence":"additional","affiliation":[{"name":"IBM Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2927-5916","authenticated-orcid":false,"given":"Jiaming","family":"Zeng","sequence":"additional","affiliation":[{"name":"AKASA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8782-105X","authenticated-orcid":false,"given":"Kristin","family":"Bennett","sequence":"additional","affiliation":[{"name":"Rensselaer Polytechnic Institute, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,8,29]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Intl Conf on Machine Learning. PMLR, 60\u201369","author":"Agarwal A","year":"2018","unstructured":"A Agarwal, A Beygelzimer, Mv Dud\u00edk, J Langford, and H Wallach. 2018. A Reductions Approach to Fair Classification. In Intl Conf on Machine Learning. PMLR, 60\u201369."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.24432\/C5XW20"},{"key":"e_1_3_2_2_3_1","unstructured":"R\u00a0K\u00a0E Bellamy K Dey M Hind S\u00a0C Hoffman S Houde K Kannan P Lohia J Martino S Mehta A Mojsilovic S Nagar K\u00a0Natesan Ramamurthy J Richards D Saha P Sattigeri M Singh K\u00a0. Varshney and Y Zhang. 2018. AI Fairness 360: An Extensible Toolkit for Detecting Understanding and Mitigating Unwanted Algorithmic Bias. arxiv:1810.01943"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","unstructured":"Karan Bhanot Ioana Baldini Dennis Wei Jiaming Zeng and Kristin\u00a0P. Bennett. 2022. Downstream Fairness Caveats with Synthetic Healthcare Data. https:\/\/doi.org\/10.48550\/ARXIV.2203.04462 arxiv:2203.04462","DOI":"10.48550\/ARXIV.2203.04462"},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of the 20th International Conference on Machine Learning (ICML-03)","author":"Bi Jinbo","year":"2003","unstructured":"Jinbo Bi and Kristin\u00a0P Bennett. 2003. Regression Error Characteristic Curves. In Proceedings of the 20th International Conference on Machine Learning (ICML-03). 43\u201350."},{"key":"e_1_3_2_2_6_1","volume-title":"Discriminative learning under Covariate Shift.Journal of Machine Learning Research 10, 9","author":"Bickel Steffen","year":"2009","unstructured":"Steffen Bickel, Michael Br\u00fcckner, and Tobias Scheffer. 2009. Discriminative learning under Covariate Shift.Journal of Machine Learning Research 10, 9 (2009)."},{"key":"e_1_3_2_2_7_1","volume-title":"Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Conf on Fairness, Accountability and Transparency. PMLR, 77\u201391","author":"Buolamwini J","year":"2018","unstructured":"J Buolamwini and T Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Conf on Fairness, Accountability and Transparency. PMLR, 77\u201391."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2009.83"},{"key":"e_1_3_2_2_9_1","unstructured":"Cntrs for Disease Cont and Prev. 2018. Health Insurance Portability and Accountability Act of 1996 (HIPAA). Centers for Disease Control and Prevention. https:\/\/www.cdc.gov\/phlp\/publications\/topic\/hipaa.html"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314236"},{"key":"e_1_3_2_2_11_1","volume-title":"https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX:32016R0679 Accessed","author":"European Parliament and of the Council (2016, Apr. 27). 2016. Regulation (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95\/46\/EC (General Data Protection Regulation) (Text with EEA relevance). Official Journal, L119 (May 2016), 1\u201388.","year":"2022","unstructured":"European Parliament and of the Council (2016, Apr. 27). 2016. Regulation (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95\/46\/EC (General Data Protection Regulation) (Text with EEA relevance). Official Journal, L119 (May 2016), 1\u201388. https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX:32016R0679 Accessed: Jan 26, 2022."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1161\/01.CIR.101.23.e215"},{"key":"e_1_3_2_2_14_1","volume-title":"Generative Adversarial Nets. Advances in Neural Information Processing Systems 27","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. Advances in Neural Information Processing Systems 27 (2014)."},{"key":"e_1_3_2_2_15_1","volume-title":"The meaning and Use of the Area Under a Receiver Operating Characteristic (ROC) Curve.Radiology 143, 1","author":"Hanley A","year":"1982","unstructured":"James\u00a0A Hanley and Barbara\u00a0J McNeil. 1982. The meaning and Use of the Area Under a Receiver Operating Characteristic (ROC) Curve.Radiology 143, 1 (1982), 29\u201336."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.13026\/C2XW26"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/00330124.2015.1099449"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468507.3468511"},{"volume-title":"Putting Iterative Proportional Fitting on the Researcher\u2019s Desk. School of Geography","author":"Norman Paul","key":"e_1_3_2_2_20_1","unstructured":"Paul Norman. 1999. Putting Iterative Proportional Fitting on the Researcher\u2019s Desk. School of Geography, University of Leeds (1999)."},{"key":"e_1_3_2_2_21_1","volume-title":"On fairness and calibration. Advances in neural information processing systems 30","author":"Pleiss Geoff","year":"2017","unstructured":"Geoff Pleiss, Manish Raghavan, Felix Wu, Jon Kleinberg, and Kilian\u00a0Q Weinberger. 2017. On fairness and calibration. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_3_2_2_22_1","volume-title":"Advances in Neural Information Processing Systems, S.\u00a0Koyejo, S.\u00a0Mohamed, A.\u00a0Agarwal, D.\u00a0Belgrave, K.\u00a0Cho, and A.\u00a0Oh (Eds.). Vol.\u00a035. Curran Associates","author":"Schrouff Jessica","year":"1930","unstructured":"Jessica Schrouff, Natalie Harris, Sanmi Koyejo, Ibrahim\u00a0M Alabdulmohsin, Eva Schnider, Krista Opsahl-Ong, Alexander Brown, Subhrajit Roy, Diana Mincu, Christina Chen, Awa Dieng, Yuan Liu, Vivek Natarajan, Alan Karthikesalingam, Katherine\u00a0A Heller, Silvia Chiappa, and Alexander D'\u00a0Amour. 2022. Diagnosing failures of fairness transfer across distribution shift in real-world medical settings. In Advances in Neural Information Processing Systems, S.\u00a0Koyejo, S.\u00a0Mohamed, A.\u00a0Agarwal, D.\u00a0Belgrave, K.\u00a0Cho, and A.\u00a0Oh (Eds.). Vol.\u00a035. Curran Associates, Inc., 19304\u201319318. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/file\/7a969c30dc7e74d4e891c8ffb217cf79-Paper-Conference.pdf"},{"key":"e_1_3_2_2_23_1","unstructured":"S Shankar Y Halpern E Breck J Atwood J Wilson and D Sculley. 2017. No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing World. arxiv:1711.08536"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-61146-0_26"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2019.12.136"}],"event":{"name":"AIES '23: AAAI\/ACM Conference on AI, Ethics, and Society","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence"],"location":"Montr\u00e9al QC Canada","acronym":"AIES '23"},"container-title":["Proceedings of the 2023 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3600211.3604713","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3600211.3604713","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:37:39Z","timestamp":1750178259000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3600211.3604713"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,8]]},"references-count":25,"alternative-id":["10.1145\/3600211.3604713","10.1145\/3600211"],"URL":"https:\/\/doi.org\/10.1145\/3600211.3604713","relation":{},"subject":[],"published":{"date-parts":[[2023,8,8]]},"assertion":[{"value":"2023-08-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}