{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T15:06:23Z","timestamp":1785769583135,"version":"3.56.0"},"reference-count":225,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,2,3]],"date-time":"2022-02-03T00:00:00Z","timestamp":1643846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Koret foundation grant for Smart Cities and Digital Living","award":["2030"],"award-info":[{"award-number":["2030"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2023,3,31]]},"abstract":"<jats:p>An increasing number of decisions regarding the daily lives of human beings are being controlled by artificial intelligence and machine learning (ML) algorithms in spheres ranging from healthcare, transportation, and education to college admissions, recruitment, provision of loans, and many more realms. Since they now touch on many aspects of our lives, it is crucial to develop ML algorithms that are not only accurate but also objective and fair. Recent studies have shown that algorithmic decision making may be inherently prone to unfairness, even when there is no intention for it. This article presents an overview of the main concepts of identifying, measuring, and improving algorithmic fairness when using ML algorithms, focusing primarily on classification tasks. The article begins by discussing the causes of algorithmic bias and unfairness and the common definitions and measures for fairness. Fairness-enhancing mechanisms are then reviewed and divided into pre-process, in-process, and post-process mechanisms. A comprehensive comparison of the mechanisms is then conducted, toward a better understanding of which mechanisms should be used in different scenarios. The article ends by reviewing several emerging research sub-fields of algorithmic fairness, beyond classification.<\/jats:p>","DOI":"10.1145\/3494672","type":"journal-article","created":{"date-parts":[[2022,2,3]],"date-time":"2022-02-03T10:02:04Z","timestamp":1643882524000},"page":"1-44","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":511,"title":["A Review on Fairness in Machine Learning"],"prefix":"10.1145","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1806-0066","authenticated-orcid":false,"given":"Dana","family":"Pessach","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, Tel-Aviv University, Tel-Aviv, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3193-5768","authenticated-orcid":false,"given":"Erez","family":"Shmueli","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Tel-Aviv University, Tel-Aviv, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,2,3]]},"reference":[{"key":"e_1_3_3_2_2","article-title":"Beyond personalization: Research directions in multistakeholder recommendation","author":"Abdollahpouri Himan","year":"2019","unstructured":"Himan Abdollahpouri, Gediminas Adomavicius, Robin Burke, Ido Guy, Dietmar Jannach, Toshihiro Kamishima, Jan Krasnodebski, and Luiz Pizzato. 2019. Beyond personalization: Research directions in multistakeholder recommendation. arXiv preprint arXiv:1905.01986 (2019).","journal-title":"arXiv preprint arXiv:1905.01986"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-019-09256-1"},{"key":"e_1_3_3_4_2","article-title":"Generative adversarial networks for mitigating biases in machine learning systems","author":"Abusitta Adel","year":"2019","unstructured":"Adel Abusitta, Esma A\u00efmeur, and Omar Abdel Wahab. 2019. Generative adversarial networks for mitigating biases in machine learning systems. arXiv preprint arXiv:1905.09972 (2019).","journal-title":"arXiv preprint arXiv:1905.09972"},{"key":"e_1_3_3_5_2","first-page":"60","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal, Alina Beygelzimer, Miroslav Dudik, John Langford, and Hanna Wallach. 2018. A reductions approach to fair classification. In Proceedings of the International Conference on Machine Learning. 60\u201369."},{"key":"e_1_3_3_6_2","first-page":"120","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Agarwal Alekh","year":"2019","unstructured":"Alekh Agarwal, Miroslav Dudik, and Zhiwei Steven Wu. 2019. Fair regression: Quantitative definitions and reduction-based algorithms. In Proceedings of the International Conference on Machine Learning. 120\u2013129."},{"key":"e_1_3_3_7_2","unstructured":"Julia Angwin. 2016. Machine Bias: ProPublica. Retrieved June 5 2019 from https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2017.8296650"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.5555\/2588335"},{"key":"e_1_3_3_10_2","first-page":"405","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Backurs Arturs","year":"2019","unstructured":"Arturs Backurs, Piotr Indyk, Krzysztof Onak, Baruch Schieber, Ali Vakilian, and Tal Wagner. 2019. Scalable fair clustering. In Proceedings of the International Conference on Machine Learning. 405\u2013413."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455674"},{"key":"e_1_3_3_12_2","volume-title":"Proceedings of the Workshop on Artificial Intelligence Safety, Co-Located with the 34th AAAI Conference on Artificial Intelligence (SafeAI@AAAI\u201920)","author":"Bakker Michiel A.","year":"2020","unstructured":"Michiel A. Bakker, Humberto River\u00f3n Vald\u00e9s, Duy Patrick Tu, Krishna P. Gummadi, Kush R. Varshney, Adrian Weller, and Alex Pentland. 2020. Fair enough: Improving fairness in budget-constrained decision making using confidence thresholds. In Proceedings of the Workshop on Artificial Intelligence Safety, Co-Located with the 34th AAAI Conference on Artificial Intelligence (SafeAI@AAAI\u201920)."},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.299"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1510507113"},{"key":"e_1_3_3_15_2","unstructured":"Solon Barocas Moritz Hardt and Arvind Narayanan. 2019. Fairness and machine learning. fairmlbook.org."},{"key":"e_1_3_3_16_2","first-page":"671","article-title":"Big data\u2019s disparate impact","volume":"104","author":"Barocas Solon","year":"2016","unstructured":"Solon Barocas and Andrew D. Selbst. 2016. Big data\u2019s disparate impact. California Law Review 104 (2016), 671.","journal-title":"California Law Review"},{"key":"e_1_3_3_17_2","article-title":"Learning fair classifiers: A regularization-inspired approach","author":"Bechavod Yahav","year":"2017","unstructured":"Yahav Bechavod and Katrina Ligett. 2017. Learning fair classifiers: A regularization-inspired approach. arXiv preprint arXiv:1707.00044 (2017).","journal-title":"arXiv preprint arXiv:1707.00044"},{"key":"e_1_3_3_18_2","article-title":"Penalizing unfairness in binary classification","author":"Bechavod Yahav","year":"2017","unstructured":"Yahav Bechavod and Katrina Ligett. 2017. Penalizing unfairness in binary classification. arXiv preprint arXiv:1707.00044 (2017).","journal-title":"arXiv preprint arXiv:1707.00044"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1903070116"},{"key":"e_1_3_3_20_2","article-title":"A convex framework for fair regression","author":"Berk Richard","year":"2017","unstructured":"Richard Berk, Hoda Heidari, Shahin Jabbari, Matthew Joseph, Michael Kearns, Jamie Morgenstern, Seth Neel, and Aaron Roth. 2017. A convex framework for fair regression. arXiv preprint arXiv:1706.02409 (2017).","journal-title":"arXiv preprint arXiv:1706.02409"},{"key":"e_1_3_3_21_2","first-page":"004912411878253","article-title":"Fairness in criminal justice risk assessments: The state of the art","author":"Berk Richard","year":"2018","unstructured":"Richard Berk, Hoda Heidari, Shahin Jabbari, Michael Kearns, and Aaron Roth. 2018. Fairness in criminal justice risk assessments: The state of the art. Sociological Methods & Research 50, 6 (2018), 0049124118782533.","journal-title":"Sociological Methods & Research"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330745"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314234"},{"key":"e_1_3_3_24_2","article-title":"Data decisions and theoretical implications when adversarially learning fair representations","author":"Beutel Alex","year":"2017","unstructured":"Alex Beutel, Jilin Chen, Zhe Zhao, and Ed H. Chi. 2017. Data decisions and theoretical implications when adversarially learning fair representations. arXiv preprint arXiv:1707.00075 (2017).","journal-title":"arXiv preprint arXiv:1707.00075"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.187.4175.398"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210063"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157584"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-3002"},{"key":"e_1_3_3_29_2","first-page":"715","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Bose Avishek","year":"2019","unstructured":"Avishek Bose and William Hamilton. 2019. Compositional fairness constraints for graph embeddings. In Proceedings of the International Conference on Machine Learning. 715\u2013724."},{"key":"e_1_3_3_30_2","article-title":"Fair pipelines","author":"Bower Amanda","year":"2017","unstructured":"Amanda Bower, Sarah N. Kitchen, Laura Niss, Martin J. Strauss, Alexander Vargas, and Suresh Venkatasubramanian. 2017. Fair pipelines. arXiv preprint arXiv:1707.00391 (2017).","journal-title":"arXiv preprint arXiv:1707.00391"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.5555\/3504035.3504149"},{"key":"e_1_3_3_32_2","unstructured":"Phil Brierley David Vogel and Randy Axelrod. 2011. Heritage Provider Network Health Prize Round 1 Milestone Prize: How we did iTeam \u201cMarket Makers.\u201d Retrieved on 16 Dec. 2021 from https:\/\/foreverdata.org\/1015\/content\/milestone1-2.pdf."},{"key":"e_1_3_3_33_2","first-page":"803","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Brunet Marc-Etienne","year":"2019","unstructured":"Marc-Etienne Brunet, Colleen Alkalay-Houlihan, Ashton Anderson, and Richard Zemel. 2019. Understanding the origins of bias in word embeddings. In Proceedings of the International Conference on Machine Learning. 803\u2013811."},{"key":"e_1_3_3_34_2","first-page":"77","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 77\u201391."},{"key":"e_1_3_3_35_2","article-title":"Multisided fairness for recommendation","author":"Burke Robin","year":"2017","unstructured":"Robin Burke. 2017. Multisided fairness for recommendation. arXiv preprint arXiv:1707.00093 (2017).","journal-title":"arXiv preprint arXiv:1707.00093"},{"key":"e_1_3_3_36_2","article-title":"Balanced neighborhoods for fairness-aware collaborative recommendation","author":"Burke Robin","year":"2017","unstructured":"Robin Burke, Nasim Sonboli, Masoud Mansoury, and Aldo Ordo\u00f1ez-Gauger. 2017. Balanced neighborhoods for fairness-aware collaborative recommendation. In Proceedings of the ACM FATRec Workshop.","journal-title":"Proceedings of the ACM FATRec Workshop."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-010-0190-x"},{"key":"e_1_3_3_38_2","article-title":"Semantics derived automatically from language corpora necessarily contain human biases","author":"Caliskan Aylin","year":"2016","unstructured":"Aylin Caliskan, Joanna J. Bryson, and Arvind Narayanan. 2016. Semantics derived automatically from language corpora necessarily contain human biases. CoRR abs\/1608.07187 (2016).","journal-title":"CoRR abs\/1608.07187"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.5555\/3294996.3295155"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.5555\/3304415.3304437"},{"key":"e_1_3_3_41_2","article-title":"Improved adversarial learning for fair classification","author":"Celis L. Elisa","year":"2019","unstructured":"L. Elisa Celis and Vijay Keswani. 2019. Improved adversarial learning for fair classification. arXiv preprint arXiv:1901.10443 (2019).","journal-title":"arXiv preprint arXiv:1901.10443"},{"key":"e_1_3_3_42_2","volume-title":"Proceedings of the 45th International Colloquium on Automata, Languages, and Programming (ICALP\u201918)","author":"Celis L. Elisa","year":"2018","unstructured":"L. Elisa Celis, Damian Straszak, and Nisheeth K. Vishnoi. 2018. Ranking with fairness constraints. In Proceedings of the 45th International Colloquium on Automata, Languages, and Programming (ICALP\u201918)."},{"key":"e_1_3_3_43_2","unstructured":"Minnesota Population Center. 2015. Integrated Public Use Microdata Series International: Version 6.4 [The Dutch Virtual Census of 2001]. Retrieved November 10 2019 from https:\/\/doi.org\/10.18128\/D020.V6.4"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017801"},{"key":"e_1_3_3_45_2","first-page":"3","volume-title":"IFIP International Summer School on Privacy and Identity Management","author":"Chiappa Silvia","year":"2018","unstructured":"Silvia Chiappa and William S. Isaac. 2018. A causal Bayesian networks viewpoint on fairness. In IFIP International Summer School on Privacy and Identity Management. Springer, 3\u201320."},{"key":"e_1_3_3_46_2","article-title":"A causal Bayesian networks viewpoint on fairness","author":"Chiappa Silvia","year":"2019","unstructured":"Silvia Chiappa and William S. Isaac. 2019. A causal Bayesian networks viewpoint on fairness. arXiv preprint arXiv:1907.06430 (2019).","journal-title":"arXiv preprint arXiv:1907.06430"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295256"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_3_3_49_2","article-title":"The frontiers of fairness in machine learning","author":"Chouldechova Alexandra","year":"2018","unstructured":"Alexandra Chouldechova and Aaron Roth. 2018. The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810 (2018).","journal-title":"arXiv preprint arXiv:1810.08810"},{"key":"e_1_3_3_50_2","unstructured":"UCI Machine Learning Repository: Communities and Crime Data Set. 2009. Retrieved October 7 2021 from http:\/\/archive.ics.uci.edu\/ml\/datasets\/communities+and+crime."},{"key":"e_1_3_3_51_2","article-title":"The measure and mismeasure of fairness: A critical review of fair machine learning","author":"Corbett-Davies Sam","year":"2018","unstructured":"Sam Corbett-Davies and Sharad Goel. 2018. The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023 (2018).","journal-title":"arXiv preprint arXiv:1808.00023"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3314183.3323847"},{"key":"e_1_3_3_54_2","first-page":"429","article-title":"Towards a methodology for statistical disclosure control","volume":"15","author":"Dalenius Tore","year":"1977","unstructured":"Tore Dalenius. 1977. Towards a methodology for statistical disclosure control. Statistik Tidskrift 15 (1977), 429\u2013444.","journal-title":"Statistik Tidskrift"},{"key":"e_1_3_3_55_2","unstructured":"Jeffrey Dastin. 2018. Amazon scraps secret AI recruiting tool that showed bias against women. Reuters . Retrieved June 6 2019 from https:\/\/www.reuters.com\/article\/us-amazon-com-jobs-automation-insight\/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G."},{"key":"e_1_3_3_56_2","unstructured":"Heritage Health Prize Contest Data. 2013. Collection 1015. Retrieved January 29 2021 fromhttps:\/\/foreverdata.org\/1015\/index.html."},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2015-0007"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-29053-5_14"},{"key":"e_1_3_3_60_2","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. Retrieved October 7 2021 from http:\/\/archive.ics.uci.edu\/ml."},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_3_62_2","volume-title":"Proceedings of the 10th Innovations in Theoretical Computer Science Conference (ITCS\u201919)","author":"Dwork Cynthia","year":"2018","unstructured":"Cynthia Dwork and Christina Ilvento. 2018. Fairness under composition. In Proceedings of the 10th Innovations in Theoretical Computer Science Conference (ITCS\u201919)."},{"key":"e_1_3_3_63_2","first-page":"119","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency","author":"Dwork Cynthia","year":"2018","unstructured":"Cynthia Dwork, Nicole Immorlica, Adam Tauman Kalai, and Max Leiserson. 2018. Decoupled classifiers for group-fair and efficient machine learning. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 119\u2013133."},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/11681878_14"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.29012\/jpc.v2i1.585"},{"key":"e_1_3_3_66_2","first-page":"197","article-title":"FaiRecSys: Mitigating algorithmic bias in recommender systems","author":"Edizel Bora","year":"2019","unstructured":"Bora Edizel, Francesco Bonchi, Sara Hajian, Andr\u00e9 Panisson, and Tamir Tassa. 2019. FaiRecSys: Mitigating algorithmic bias in recommender systems. International Journal of Data Science and Analytics 9 (2019), 197\u2013213.","journal-title":"International Journal of Data Science and Analytics"},{"key":"e_1_3_3_67_2","article-title":"Censoring representations with an adversary","author":"Edwards Harrison","year":"2015","unstructured":"Harrison Edwards and Amos Storkey. 2015. Censoring representations with an adversary. arXiv preprint arXiv:1511.05897 (2015).","journal-title":"arXiv preprint arXiv:1511.05897"},{"key":"e_1_3_3_68_2","unstructured":"Michael D. Ekstrand and Maria Soledad Pera. 2017. The demographics of cool. In Poster Proceedings at ACM RecSys . ACM New York NY. ."},{"key":"e_1_3_3_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240373"},{"key":"e_1_3_3_70_2","volume-title":"Proceedings of the 22nd International Conference on Extending Database Technology (EDBT\u201919)","author":"Elbassuoni Shady","year":"2019","unstructured":"Shady Elbassuoni, Sihem Amer-Yahia, Ahmad Ghizzawi, and Christine Atie. 2019. Exploring fairness of ranking in online job marketplaces. In Proceedings of the 22nd International Conference on Extending Database Technology (EDBT\u201919)."},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287571"},{"key":"e_1_3_3_72_2","article-title":"The price of local fairness in multistage selection","author":"Emelianov Vitalii","year":"2019","unstructured":"Vitalii Emelianov, George Arvanitakis, Nicolas Gast, Krishna Gummadi, and Patrick Loiseau. 2019. The price of local fairness in multistage selection. arXiv preprint arXiv:1906.06613 (2019).","journal-title":"arXiv preprint arXiv:1906.06613"},{"key":"e_1_3_3_73_2","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency","author":"Ensign Danielle","year":"2018","unstructured":"Danielle Ensign, Sorelle A. Friedler, Scott Neville, Carlos Scheidegger, and Suresh Venkatasubramanian. 2018. Runaway feedback loops in predictive policing. In Proceedings of the Conference on Fairness, Accountability, and Transparency."},{"key":"e_1_3_3_74_2","unstructured":"James Fantin. 2020. A Distributed Fair Random Forest. University of Wyoming. Retrieved on 16 Dec. 2021 https:\/\/mountainscholar.org\/bitstream\/handle\/20.500.11919\/7072\/STUW_HT_COSC_2020_Fantin_James?sequence=1."},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_3_76_2","article-title":"Equalizing gender biases in neural machine translation with word embeddings techniques","author":"Font Joel Escud\u00e9","year":"2019","unstructured":"Joel Escud\u00e9 Font and Marta R. Costa-Jussa. 2019. Equalizing gender biases in neural machine translation with word embeddings techniques. arXiv preprint arXiv:1901.03116 (2019).","journal-title":"arXiv preprint arXiv:1901.03116"},{"key":"e_1_3_3_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/238061.238163"},{"key":"e_1_3_3_78_2","article-title":"On the (im)possibility of fairness","author":"Friedler Sorelle A.","year":"2016","unstructured":"Sorelle A. Friedler, Carlos Scheidegger, and Suresh Venkatasubramanian. 2016. On the (im)possibility of fairness. arXiv preprint arXiv:1609.07236 (2016).","journal-title":"arXiv preprint arXiv:1609.07236"},{"key":"e_1_3_3_79_2","article-title":"Comparing fairness-aware machine learning techniques","author":"Friedler Sorelle A.","year":"2018","unstructured":"Sorelle A. Friedler, Carlos Scheidegger, Suresh Venkatasubramanian, Sonam Choudhary, Evan P. Hamilton, and Derek Roth. 2018. Comparing fairness-aware machine learning techniques. Retrieved October 7, 2021 from https:\/\/github.com\/algofairness\/fairness-comparison\/tree\/master\/fairness\/data.","journal-title":"https:\/\/github.com\/algofairness\/fairness-comparison\/tree\/master\/fairness\/data"},{"key":"e_1_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287589"},{"key":"e_1_3_3_81_2","volume-title":"The Stanford Encyclopedia of Philosophy (summer 2018 ed.)","author":"Fullinwider Robert","year":"2018","unstructured":"Robert Fullinwider. 2018. Affirmative action. In The Stanford Encyclopedia of Philosophy (summer 2018 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University."},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3106237.3106277"},{"key":"e_1_3_3_83_2","article-title":"Inferential privacy guarantees for differentially private mechanisms","author":"Ghosh Arpita","year":"2016","unstructured":"Arpita Ghosh and Robert Kleinberg. 2016. Inferential privacy guarantees for differentially private mechanisms. arXiv preprint arXiv:1603.01508 (2016).","journal-title":"arXiv preprint arXiv:1603.01508"},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287573"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157096.3157367"},{"key":"e_1_3_3_86_2","first-page":"609","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Gonen Hila","year":"2019","unstructured":"Hila Gonen and Yoav Goldberg. 2019. Lipstick on a pig: Debiasing methods cover up systematic gender biases in word embeddings but do not remove them. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 609\u2013614."},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.5555\/2969033.2969125"},{"key":"e_1_3_3_88_2","article-title":"Ranking for individual and group fairness simultaneously","author":"Gorantla Sruthi","year":"2020","unstructured":"Sruthi Gorantla, Amit Deshpande, and Anand Louis. 2020. Ranking for individual and group fairness simultaneously. arXiv preprint arXiv:2010.06986 (2020).","journal-title":"arXiv preprint arXiv:2010.06986"},{"key":"e_1_3_3_89_2","volume-title":"Proceedings of Machine Learning: The Debates Workshop at the 35th International Conference on Machine Learning (ICML\u201918)","author":"Green Ben","year":"2018","unstructured":"Ben Green and Lily Hu. 2018. The myth in the methodology: Towards a recontextualization of fairness in machine learning. In Proceedings of Machine Learning: The Debates Workshop at the 35th International Conference on Machine Learning (ICML\u201918)."},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.5555\/2503308.2188410"},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186138"},{"key":"e_1_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.5555\/3504035.3504042"},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-018-2958-5"},{"key":"e_1_3_3_94_2","volume-title":"Benchmarking Four Approaches to Fairness-Aware Machine Learning","author":"Hamilton Evan","year":"2017","unstructured":"Evan Hamilton. 2017. Benchmarking Four Approaches to Fairness-Aware Machine Learning. Ph.D. Dissertation. Haverford College."},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157469"},{"key":"e_1_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.5555\/3304889.3304972"},{"key":"e_1_3_3_97_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01219-9_47"},{"key":"e_1_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_3_99_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2019.00131"},{"key":"e_1_3_3_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186044"},{"key":"e_1_3_3_101_2","unstructured":"Chong Huang Xiao Chen Peter Kairouz Lalitha Sankar and Ram Rajagopal. 2018. Generative adversarial models for learning private and fair representations. Retrieved on 16 Dec. 2021 https:\/\/openreview.net\/pdf?id=H1xAH2RqK7."},{"key":"e_1_3_3_102_2","unstructured":"Elle Hunt. 2016. Tay Microsoft\u2019s AI chatbot gets a crash course in racism from Twitter. Retrieved October 19 2019 from https:\/\/goo.gl\/mE8p3J."},{"key":"e_1_3_3_103_2","doi-asserted-by":"crossref","unstructured":"Pablo Ibarrar\u00e1n Nadin Medell\u00edn Ferdinando Regalia Marco Stampini Sandro Parodi Luis Tejerina Pedro Cueva et\u00a0al. 2017. How Conditional Cash Tansfers Work . IDB Books.","DOI":"10.18235\/0000746"},{"key":"e_1_3_3_104_2","unstructured":"Northpointe Inc.2012. Practitioners Guide to COMPAS. Retrieved November 18 2021 from http:\/\/www.northpointeinc.com\/files\/technical_documents\/FieldGuide2_081412.pdf."},{"key":"e_1_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.5555\/2999792.2999884"},{"key":"e_1_3_3_106_2","doi-asserted-by":"publisher","DOI":"10.5555\/3305381.3305548"},{"key":"e_1_3_3_107_2","first-page":"3000","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Jagielski Matthew","year":"2019","unstructured":"Matthew Jagielski, Michael Kearns, Jieming Mao, Alina Oprea, Aaron Roth, Saeed Sharifi-Malvajerdi, and Jonathan Ullman. 2019. Differentially private fair learning. In Proceedings of the International Conference on Machine Learning. 3000\u20133008."},{"key":"e_1_3_3_108_2","doi-asserted-by":"publisher","DOI":"10.5555\/3157096.3157133"},{"key":"e_1_3_3_109_2","article-title":"Eliciting and enforcing subjective individual fairness","author":"Jung Christopher","year":"2019","unstructured":"Christopher Jung, Michael Kearns, Seth Neel, Aaron Roth, Logan Stapleton, and Zhiwei Steven Wu. 2019. Eliciting and enforcing subjective individual fairness. arXiv preprint arXiv:1905.10660 (2019).","journal-title":"arXiv preprint arXiv:1905.10660"},{"key":"e_1_3_3_110_2","article-title":"Assessing algorithmic fairness with unobserved protected class using data combination","author":"Kallus Nathan","year":"2019","unstructured":"Nathan Kallus, Xiaojie Mao, and Angela Zhou. 2019. Assessing algorithmic fairness with unobserved protected class using data combination. arXiv preprint arXiv:1906.00285 (2019).","journal-title":"arXiv preprint arXiv:1906.00285"},{"key":"e_1_3_3_111_2","doi-asserted-by":"publisher","DOI":"10.1109\/IC4.2009.4909197"},{"key":"e_1_3_3_112_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-011-0463-8"},{"key":"e_1_3_3_113_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2010.50"},{"key":"e_1_3_3_114_2","unstructured":"Toshihiro Kamishima Shotaro Akaho Hideki Asoh and Jun Sakuma. 2012. Enhancement of the neutrality in recommendation. In Proceedings of the Workshop on Human Decision Making in Conjunction with the 6th ACM Conference on Recommender Systems (Decisions@RecSys\u201912) . 8\u201314."},{"key":"e_1_3_3_115_2","doi-asserted-by":"publisher","DOI":"10.5555\/3120007.3120011"},{"key":"e_1_3_3_116_2","doi-asserted-by":"publisher","DOI":"10.5555\/3327144.3327150"},{"key":"e_1_3_3_117_2","article-title":"FairFace: Face attribute dataset for balanced race, gender, and age","author":"K\u00e4rkk\u00e4inen Kimmo","year":"2019","unstructured":"Kimmo K\u00e4rkk\u00e4inen and Jungseock Joo. 2019. FairFace: Face attribute dataset for balanced race, gender, and age. arXiv preprint arXiv:1908.04913 (2019).","journal-title":"arXiv preprint arXiv:1908.04913"},{"key":"e_1_3_3_118_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702520"},{"key":"e_1_3_3_119_2","first-page":"2549","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Kazemi Ehsan","year":"2018","unstructured":"Ehsan Kazemi, Morteza Zadimoghaddam, and Amin Karbasi. 2018. Scalable deletion-robust submodular maximization: Data summarization with privacy and fairness constraints. In Proceedings of the International Conference on Machine Learning. 2549\u20132558."},{"key":"e_1_3_3_120_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0093949"},{"key":"e_1_3_3_121_2","doi-asserted-by":"publisher","DOI":"10.5555\/3294771.3294834"},{"key":"e_1_3_3_122_2","first-page":"2635","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML\u201918)","volume":"80","author":"Kilbertus Niki","year":"2018","unstructured":"Niki Kilbertus, Adri\u00e0 Gasc\u00f3n, Matt J. Kusner, Michael Veale, Krishna P. Gummadi, and Adrian Weller. 2018. Blind justice: Fairness with encrypted sensitive attributes. In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918), Vol. 80. 2635\u20132644."},{"key":"e_1_3_3_123_2","first-page":"277","volume-title":"Proceedings of the International Conference on Artificial Intelligence and Statistics","author":"Kilbertus Niki","year":"2020","unstructured":"Niki Kilbertus, Manuel Gomez Rodriguez, Bernhard Sch\u00f6lkopf, Krikamol Muandet, and Isabel Valera. 2020. Fair decisions despite imperfect predictions. In Proceedings of the International Conference on Artificial Intelligence and Statistics. 277\u2013287."},{"key":"e_1_3_3_124_2","first-page":"241","volume-title":"Multi-Objective Machine Learning","author":"Kim DaeEun","year":"2006","unstructured":"DaeEun Kim. 2006. Minimizing structural risk on decision tree classification. In Multi-Objective Machine Learning. Springer, 241\u2013260."},{"key":"e_1_3_3_125_2","article-title":"Preference-informed fairness","author":"Kim Michael P.","year":"2019","unstructured":"Michael P. Kim, Aleksandra Korolova, Guy N. Rothblum, and Gal Yona. 2019. Preference-informed fairness. arXiv preprint arXiv:1904.01793 (2019).","journal-title":"arXiv preprint arXiv:1904.01793"},{"key":"e_1_3_3_126_2","volume-title":"Proceedings of the 8th Innovations in Theoretical Computer Science Conference (ITCS\u201917)","author":"Kleinberg Jon","year":"2017","unstructured":"Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent trade-offs in the fair determination of risk scores. In Proceedings of the 8th Innovations in Theoretical Computer Science Conference (ITCS\u201917)."},{"key":"e_1_3_3_127_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313443"},{"key":"e_1_3_3_128_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2017.02.009"},{"key":"e_1_3_3_129_2","doi-asserted-by":"publisher","DOI":"10.5555\/3294996.3295162"},{"key":"e_1_3_3_130_2","doi-asserted-by":"publisher","DOI":"10.14778\/3372716.3372723"},{"key":"e_1_3_3_131_2","unstructured":"Jeff Larson Surya Mattu Lauren Kirchner and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. Retrieved August 28 2019 from https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm."},{"key":"e_1_3_3_132_2","article-title":"ProPublica Compas Analysis\u2014Data and Analysis for \u2018Machine Bias.\u2019","author":"Larson Jeff","year":"2016","unstructured":"Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. ProPublica Compas Analysis\u2014Data and Analysis for \u2018Machine Bias.\u2019Retrieved October 7, 2021 from https:\/\/github.com\/propublica\/compas-analysis.","journal-title":"https:\/\/github.com\/propublica\/compas-analysis"},{"key":"e_1_3_3_133_2","doi-asserted-by":"publisher","DOI":"10.1145\/2639968.2640064"},{"key":"e_1_3_3_134_2","volume-title":"Testing Statistical Hypotheses","author":"Lehmann Erich L.","year":"2006","unstructured":"Erich L. Lehmann and Joseph P. Romano. 2006. Testing Statistical Hypotheses. Springer Science & Business Media."},{"key":"e_1_3_3_135_2","doi-asserted-by":"publisher","DOI":"10.5555\/646765.704129"},{"key":"e_1_3_3_136_2","first-page":"19","article-title":"Does mitigating ML\u2019s disparate impact require disparate treatment?","volume":"1050","author":"Lipton Zachary C.","year":"2017","unstructured":"Zachary C. Lipton, Alexandra Chouldechova, and Julian McAuley. 2017. Does mitigating ML\u2019s disparate impact require disparate treatment?Stat 1050 (2017), 19.","journal-title":"Stat"},{"key":"e_1_3_3_137_2","article-title":"Personalizing fairness-aware re-ranking","author":"Liu Weiwen","year":"2018","unstructured":"Weiwen Liu and Robin Burke. 2018. Personalizing fairness-aware re-ranking. arXiv preprint arXiv:1809.02921 (2018).","journal-title":"arXiv preprint arXiv:1809.02921"},{"key":"e_1_3_3_138_2","article-title":"Causal reasoning for algorithmic fairness","author":"Loftus Joshua R.","year":"2018","unstructured":"Joshua R. Loftus, Chris Russell, Matt J. Kusner, and Ricardo Silva. 2018. Causal reasoning for algorithmic fairness. arXiv preprint arXiv:1805.05859 (2018).","journal-title":"arXiv preprint arXiv:1805.05859"},{"key":"e_1_3_3_139_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8682620"},{"key":"e_1_3_3_140_2","article-title":"The variational fair autoencoder","author":"Louizos Christos","year":"2016","unstructured":"Christos Louizos, Kevin Swersky, Yujia Li, Max Welling, and Richard Zemel. 2016. The variational fair autoencoder. In Proceedings of the International Conference on Learning Representations (ICLR\u201916).","journal-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201916)."},{"key":"e_1_3_3_141_2","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020488"},{"key":"e_1_3_3_142_2","article-title":"Learning adversarially fair and transferable representations","author":"Madras David","year":"2018","unstructured":"David Madras, Elliot Creager, Toniann Pitassi, and Richard Zemel. 2018. Learning adversarially fair and transferable representations. arXiv preprint arXiv:1802.06309 (2018).","journal-title":"arXiv preprint arXiv:1802.06309"},{"key":"e_1_3_3_143_2","doi-asserted-by":"publisher","DOI":"10.5555\/3327345.3327513"},{"key":"e_1_3_3_144_2","article-title":"Survey on causal-based machine learning fairness notions","author":"Makhlouf Karima","year":"2020","unstructured":"Karima Makhlouf, Sami Zhioua, and Catuscia Palamidessi. 2020. Survey on causal-based machine learning fairness notions. arXiv preprint arXiv:2010.09553 (2020).","journal-title":"arXiv preprint arXiv:2010.09553"},{"key":"e_1_3_3_145_2","unstructured":"Rowland Manthorpe. 2017. Beauty.AI\u2019s \u2018robot beauty contest\u2019 is back\u2014And this time it promises not to be racist. Wired . Retrieved November 12 2019 from https:\/\/www.wired.co.uk\/article\/robot-beauty-contest-beauty-ai."},{"key":"e_1_3_3_146_2","article-title":"Fairness and missing values","author":"Mart\u00ednez-Plumed Fernando","year":"2019","unstructured":"Fernando Mart\u00ednez-Plumed, C\u00e8sar Ferri, David Nieves, and Jos\u00e9 Hern\u00e1ndez-Orallo. 2019. Fairness and missing values. arXiv preprint arXiv:1905.12728 (2019).","journal-title":"arXiv preprint arXiv:1905.12728"},{"key":"e_1_3_3_147_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1063"},{"key":"e_1_3_3_148_2","article-title":"A survey on bias and fairness in machine learning","author":"Mehrabi Ninareh","year":"2019","unstructured":"Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2019. A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635 (2019).","journal-title":"arXiv preprint arXiv:1908.09635"},{"key":"e_1_3_3_149_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3272027"},{"key":"e_1_3_3_150_2","first-page":"107","volume-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency","author":"Menon Aditya Krishna","year":"2018","unstructured":"Aditya Krishna Menon and Robert C. Williamson. 2018. The cost of fairness in binary classification. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 107\u2013118."},{"key":"e_1_3_3_151_2","article-title":"Did the results of promotion exams have a disparate impact on minorities? Using statistical evidence in Ricci\n                  v","volume":"18","author":"Miao Weiwen","year":"2010","unstructured":"Weiwen Miao. 2010. Did the results of promotion exams have a disparate impact on minorities? Using statistical evidence in Ricciv. DeStefano. Journal of Statistics Education 18, 3 (2010), 1\u201326.","journal-title":"DeStefano. Journal of Statistics Education"},{"key":"e_1_3_3_152_2","volume-title":"The Need for Biases in Learning Generalizations","author":"Mitchell Tom M.","year":"1980","unstructured":"Tom M. Mitchell. 1980. The Need for Biases in Learning Generalizations. Technical Report CBM-TR-117. Department of Computer Science, Laboratory for Computer Science Research, Rutgers University."},{"key":"e_1_3_3_153_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2014.03.001"},{"key":"e_1_3_3_154_2","article-title":"Fair learning with private demographic data","author":"Mozannar Hussein","year":"2020","unstructured":"Hussein Mozannar, Mesrob I. Ohannessian, and Nathan Srebro. 2020. Fair learning with private demographic data. arXiv preprint arXiv:2002.11651 (2020).","journal-title":"arXiv preprint arXiv:2002.11651"},{"key":"e_1_3_3_155_2","unstructured":"Sendhil Mullainathan. 2019. Biased Algorithms Are Easier to Fix Than Biased People. Retrieved December 26 2019 from https:\/\/www.nytimes.com\/2019\/12\/06\/business\/algorithm-bias-fix.html?smid=nytcore-ios-share."},{"key":"e_1_3_3_156_2","doi-asserted-by":"publisher","DOI":"10.5555\/3504035.3504270"},{"key":"e_1_3_3_157_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i04.5970"},{"key":"e_1_3_3_158_2","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314277"},{"key":"e_1_3_3_159_2","doi-asserted-by":"crossref","unstructured":"NYPD. 2017. Stop Question and Frisk (SQF) Data. Retrieved February 14 2021 from https:\/\/www1.nyc.gov\/site\/nypd\/stats\/reports-analysis\/stopfrisk.page.","DOI":"10.1145\/3460533"},{"key":"e_1_3_3_160_2","unstructured":"UCI Machine Learning Repository. 2016. Default of Credit Card Clients Data Set. Retrieved October 7 2021 from https:\/\/archive.ics.uci.edu\/ml\/datasets\/default+of+credit+card+clients."},{"key":"e_1_3_3_161_2","unstructured":"Pete Pachal. 2015. Google Photos identified two black people as \u2018gorillas.\u2019 Mashable . Retrieved November 9 2019 from https:\/\/mashable.com\/2015\/07\/01\/google-photos-black-people-gorillas\/."},{"key":"e_1_3_3_162_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_3_3_163_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380196"},{"key":"e_1_3_3_164_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5349"},{"key":"e_1_3_3_165_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_3_166_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115667"},{"key":"e_1_3_3_167_2","article-title":"Fairness-driven private collaborative machine learning","author":"Pessach Dana","year":"2021","unstructured":"Dana Pessach, Tamir Tassa, and Erez Shmueli. 2021. Fairness-driven private collaborative machine learning. arXiv preprint arXiv:2109.14376 (2021).","journal-title":"arXiv preprint arXiv:2109.14376"},{"key":"e_1_3_3_168_2","unstructured":"Lizzie Plaugic. 2017. FaceApp\u2019s creator apologizes for the app\u2019s skin-lightening \u2018hot\u2019 filter. The Verge . Retrieved November 12 2019 from https:\/\/www.theverge.com\/2017\/4\/25\/15419522\/faceapp-hot-filter-racist-apology."},{"key":"e_1_3_3_169_2","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295319"},{"key":"e_1_3_3_170_2","doi-asserted-by":"publisher","DOI":"10.5555\/3294771.3294836"},{"key":"e_1_3_3_171_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00842"},{"key":"e_1_3_3_172_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(01)00264-8"},{"key":"e_1_3_3_173_2","volume-title":"A Comparison of Fairness-Aware Machine Learning Algorithms","author":"Roth Derek","year":"2018","unstructured":"Derek Roth. 2018. A Comparison of Fairness-Aware Machine Learning Algorithms. Ph.D. Dissertation. Haverford College."},{"key":"e_1_3_3_174_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-2002"},{"key":"e_1_3_3_175_2","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295388"},{"key":"e_1_3_3_176_2","doi-asserted-by":"publisher","DOI":"10.2307\/1072940"},{"key":"e_1_3_3_177_2","doi-asserted-by":"publisher","DOI":"10.1086\/653644"},{"key":"e_1_3_3_178_2","article-title":"InclusiveFaceNet: Improving face attribute detection with race and gender diversity","author":"Ryu Hee Jung","year":"2017","unstructured":"Hee Jung Ryu, Hartwig Adam, and Margaret Mitchell. 2017. InclusiveFaceNet: Improving face attribute detection with race and gender diversity. arXiv preprint arXiv:1712.00193 (2017).","journal-title":"arXiv preprint arXiv:1712.00193"},{"key":"e_1_3_3_179_2","first-page":"24","article-title":"Data management for causal algorithmic fairness","author":"Salimi Babak","year":"2019","unstructured":"Babak Salimi, Bill Howe, and Dan Suciu. 2019. Data management for causal algorithmic fairness. IEEE Data Engineering Bulletin 2019 (2019), 24.","journal-title":"IEEE Data Engineering Bulletin"},{"key":"e_1_3_3_180_2","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3319901"},{"key":"e_1_3_3_181_2","doi-asserted-by":"publisher","DOI":"10.5555\/3327546.3327755"},{"key":"e_1_3_3_182_2","first-page":"367","article-title":"A systemic analysis of affirmative action in American law schools","volume":"57","author":"Sander Richard H.","year":"2004","unstructured":"Richard H. Sander. 2004. A systemic analysis of affirmative action in American law schools. Stanford Law Review 57 (2004), 367.","journal-title":"Stanford Law Review"},{"key":"e_1_3_3_183_2","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2945519"},{"key":"e_1_3_3_184_2","unstructured":"UCI Machine Learning Repository. 1996. Adult Data Set. Retrieved October 7 2021 from https:\/\/archive.ics.uci.edu\/ml\/datasets\/adult."},{"key":"e_1_3_3_185_2","unstructured":"UCI Machine Learning Repository. 2012. Bank Marketing Data Set. Retrieved October 7 2021 from https:\/\/archive.ics.uci.edu\/ml\/datasets\/bank+marketing."},{"key":"e_1_3_3_186_2","unstructured":"UCI Machine Learning Repository. n.d. Diabetes Data Set. Retrieved October 7 2021 from https:\/\/archive.ics.uci.edu\/ml\/datasets\/diabetes."},{"key":"e_1_3_3_187_2","unstructured":"UCI Machine Learning Repository. 1994. Statlog (German Credit Data) Data Set. Retrieved October 7 2021 from https:\/\/archive.ics.uci.edu\/ml\/datasets\/statlog+(german+credit+data)."},{"key":"e_1_3_3_188_2","unstructured":"Tom Simonite. 2015. Probing the Dark Side of Google\u2019s Ad-Targeting System. Retrieved July 31 2019 from https:\/\/www.technologyreview.com\/s\/539021\/probing-the-dark-side-of-googles-ad-targeting-system\/."},{"key":"e_1_3_3_189_2","unstructured":"Tom Simonite. 2018. When It Comes to Gorillas Google Photos Remains Blind. Retrieved September 17 2019 from https:\/\/www.wired.com\/story\/when-it-comes-to-gorillas-google-photos-remains-blind\/."},{"key":"e_1_3_3_190_2","article-title":"Policy learning for fairness in ranking","author":"Singh Ashudeep","year":"2019","unstructured":"Ashudeep Singh and Thorsten Joachims. 2019. Policy learning for fairness in ranking. arXiv preprint arXiv:1902.04056 (2019).","journal-title":"arXiv preprint arXiv:1902.04056"},{"key":"e_1_3_3_191_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220046"},{"key":"e_1_3_3_192_2","doi-asserted-by":"publisher","DOI":"10.5555\/2074158.2074215"},{"key":"e_1_3_3_193_2","article-title":"Mathematical notions vs. human perception of fairness: A descriptive approach to fairness for machine learning","author":"Srivastava Megha","year":"2019","unstructured":"Megha Srivastava, Hoda Heidari, and Andreas Krause. 2019. Mathematical notions vs. human perception of fairness: A descriptive approach to fairness for machine learning. arXiv preprint arXiv:1902.04783 (2019).","journal-title":"arXiv preprint arXiv:1902.04783"},{"key":"e_1_3_3_194_2","article-title":"ConvNets and ImageNet beyond accuracy: Explanations, bias detection, adversarial examples and model criticism","author":"Stock Pierre","year":"2017","unstructured":"Pierre Stock and Moustapha Cisse. 2017. ConvNets and ImageNet beyond accuracy: Explanations, bias detection, adversarial examples and model criticism. arXiv preprint arXiv:1711.11443 (2017).","journal-title":"arXiv preprint arXiv:1711.11443"},{"key":"e_1_3_3_195_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330793"},{"key":"e_1_3_3_196_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240350"},{"key":"e_1_3_3_197_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.10091808"},{"key":"e_1_3_3_198_2","first-page":"368","volume-title":"Proceedings of the 37th Annual Allerton Conference on Communications, Control, and Computing","author":"Tishby Naftali","year":"1999","unstructured":"Naftali Tishby, Fernando C. Pereira, and William Bialek. 1999. The information bottleneck method. In Proceedings of the 37th Annual Allerton Conference on Communications, Control, and Computing. 368\u2013377."},{"key":"e_1_3_3_199_2","doi-asserted-by":"publisher","DOI":"10.1109\/EuroSP.2017.29"},{"key":"e_1_3_3_200_2","first-page":"6373","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Ustun Berk","year":"2019","unstructured":"Berk Ustun, Yang Liu, and David Parkes. 2019. Fairness without harm: Decoupled classifiers with preference guarantees. In Proceedings of the International Conference on Machine Learning. 6373\u20136382."},{"key":"e_1_3_3_201_2","doi-asserted-by":"publisher","DOI":"10.5664\/jcsm.5476"},{"key":"e_1_3_3_202_2","doi-asserted-by":"publisher","DOI":"10.5555\/3326943.3327106"},{"key":"e_1_3_3_203_2","unstructured":"Emiel Van Miltenburg. 2016. Stereotyping and bias in the Flickr30k dataset. In Proceedings of the Workshop on Multimodal Corpora (MMC\u201916) . 1\u20134."},{"key":"e_1_3_3_204_2","article-title":"Getting gender right in neural machine translation","author":"Vanmassenhove Eva","year":"2019","unstructured":"Eva Vanmassenhove, Christian Hardmeier, and Andy Way. 2019. Getting gender right in neural machine translation. arXiv preprint arXiv:1909.05088 (2019).","journal-title":"arXiv preprint arXiv:1909.05088"},{"key":"e_1_3_3_205_2","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2886814"},{"key":"e_1_3_3_206_2","first-page":"93","volume-title":"Controlling the Generalization Ability of Learning Processes","author":"Vapnik Vladimir N.","year":"2000","unstructured":"Vladimir N. Vapnik. 2000. Controlling the Generalization Ability of Learning Processes. Springer New York, New York, NY, 93\u2013122. https:\/\/doi.org\/10.1007\/978-1-4757-3264-1_5"},{"key":"e_1_3_3_207_2","doi-asserted-by":"publisher","DOI":"10.1145\/3194770.3194776"},{"key":"e_1_3_3_208_2","article-title":"Achieving fairness through adversarial learning: An application to recidivism prediction","author":"Wadsworth Christina","year":"2018","unstructured":"Christina Wadsworth, Francesca Vera, and Chris Piech. 2018. Achieving fairness through adversarial learning: An application to recidivism prediction. arXiv preprint arXiv:1807.00199 (2018).","journal-title":"arXiv preprint arXiv:1807.00199"},{"key":"e_1_3_3_209_2","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455075"},{"key":"e_1_3_3_210_2","first-page":"1920","volume-title":"Proceedings of the Conference on Learning Theory","author":"Woodworth Blake","year":"2017","unstructured":"Blake Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, and Nathan Srebro. 2017. Learning non-discriminatory predictors. In Proceedings of the Conference on Learning Theory. 1920\u20131953."},{"key":"e_1_3_3_211_2","doi-asserted-by":"publisher","DOI":"10.1145\/3308560.3317584"},{"key":"e_1_3_3_212_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8622525"},{"key":"e_1_3_3_213_2","article-title":"New fairness metrics for recommendation that embrace differences","author":"Yao Sirui","year":"2017","unstructured":"Sirui Yao and Bert Huang. 2017. New fairness metrics for recommendation that embrace differences. arXiv preprint arXiv:1706.09838 (2017).","journal-title":"arXiv preprint arXiv:1706.09838"},{"key":"e_1_3_3_214_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2007.12.020"},{"key":"e_1_3_3_215_2","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052660"},{"key":"e_1_3_3_216_2","first-page":"962","volume-title":"Proceedings of the 20th International Conference on Artificial Intelligence and Statistics","author":"Zafar Muhammad Bilal","year":"2017","unstructured":"Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rodriguez, and Krishna P. Gummadi. 2017. Fairness constraints: Mechanisms for fair classification. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics. 962\u2013970."},{"key":"e_1_3_3_217_2","doi-asserted-by":"publisher","DOI":"10.5555\/3294771.3294793"},{"key":"e_1_3_3_218_2","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3132938"},{"key":"e_1_3_3_219_2","doi-asserted-by":"publisher","DOI":"10.5555\/3042817.3042973"},{"key":"e_1_3_3_220_2","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278779"},{"key":"e_1_3_3_221_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1064"},{"key":"e_1_3_3_222_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1323"},{"key":"e_1_3_3_223_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-2003"},{"key":"e_1_3_3_224_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1521"},{"key":"e_1_3_3_225_2","first-page":"563","article-title":"Emerging uniform structure of disparate treatment discrimination litigation","volume":"30","author":"Zimmer Michael J.","year":"1995","unstructured":"Michael J. Zimmer. 1995. Emerging uniform structure of disparate treatment discrimination litigation. Georgia Law Review 30 (1995), 563.","journal-title":"Georgia Law Review"},{"key":"e_1_3_3_226_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-017-0506-1"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494672","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3494672","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:18Z","timestamp":1750188678000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3494672"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,3]]},"references-count":225,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,3,31]]}},"alternative-id":["10.1145\/3494672"],"URL":"https:\/\/doi.org\/10.1145\/3494672","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,3]]},"assertion":[{"value":"2020-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}