{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T14:51:05Z","timestamp":1773154265478,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":69,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,26]]},"DOI":"10.1145\/3514094.3534147","type":"proceedings-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T22:25:13Z","timestamp":1658960713000},"page":"396-410","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Data-Centric Factors in Algorithmic Fairness"],"prefix":"10.1145","author":[{"given":"Nianyun","family":"Li","sequence":"first","affiliation":[{"name":"ETH Zurich, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Naman","family":"Goel","sequence":"additional","affiliation":[{"name":"University of Oxford, Oxford, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elliott","family":"Ash","sequence":"additional","affiliation":[{"name":"ETH Zurich, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"A Sandbox Tool to Bias (Stress)-Test Fairness Algorithms. arXiv preprint arXiv:2204.10233","author":"Akpinar Nil-Jana","year":"2022","unstructured":"Nil-Jana Akpinar , Manish Nagireddy , Logan Stapleton , Hao-Fei Cheng , Haiyi Zhu , Steven Wu , and Hoda Heidari . 2022. A Sandbox Tool to Bias (Stress)-Test Fairness Algorithms. arXiv preprint arXiv:2204.10233 ( 2022 ). Nil-Jana Akpinar, Manish Nagireddy, Logan Stapleton, Hao-Fei Cheng, Haiyi Zhu, Steven Wu, and Hoda Heidari. 2022. A Sandbox Tool to Bias (Stress)-Test Fairness Algorithms. arXiv preprint arXiv:2204.10233 (2022)."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1093\/qje\/qjy012"},{"key":"e_1_3_2_2_5_1","volume-title":"Ideas have consequences: The impact of law and economics on american justice","author":"Ash Elliott","year":"2019","unstructured":"Elliott Ash , Daniel L Chen , and Suresh Naidu . 2019. Ideas have consequences: The impact of law and economics on american justice . Center for Law & Economics Working Paper Series , Vol . 4 ( 2019 ). Elliott Ash, Daniel L Chen, and Suresh Naidu. 2019. Ideas have consequences: The impact of law and economics on american justice. Center for Law & Economics Working Paper Series, Vol. 4 (2019)."},{"key":"e_1_3_2_2_6_1","volume-title":"The effect of Fox News on health behavior during COVID-19. Available at SSRN 3636762","author":"Ash Elliott","year":"2020","unstructured":"Elliott Ash , Sergio Galletta , Dominik Hangartner , Yotam Margalit , and Matteo Pinna . 2020. The effect of Fox News on health behavior during COVID-19. Available at SSRN 3636762 ( 2020 ). Elliott Ash, Sergio Galletta, Dominik Hangartner, Yotam Margalit, and Matteo Pinna. 2020. The effect of Fox News on health behavior during COVID-19. Available at SSRN 3636762 (2020)."},{"key":"e_1_3_2_2_7_1","volume-title":"Why Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairness. arXiv preprint arXiv:2202.10816","author":"Ashurst Carolyn","year":"2022","unstructured":"Carolyn Ashurst , Ryan Carey , Silvia Chiappa , and Tom Everitt . 2022. Why Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairness. arXiv preprint arXiv:2202.10816 ( 2022 ). Carolyn Ashurst, Ryan Carey, Silvia Chiappa, and Tom Everitt. 2022. Why Fair Labels Can Yield Unfair Predictions: Graphical Conditions for Introduced Unfairness. arXiv preprint arXiv:2202.10816 (2022)."},{"key":"e_1_3_2_2_8_1","unstructured":"Michelle Bao Angela Zhou Samantha Zottola Brian Brubach Sarah Desmarais Aaron Horowitz Kristian Lum and Suresh Venkatasubramanian. 2021. It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness Benchmarks. (2021).  Michelle Bao Angela Zhou Samantha Zottola Brian Brubach Sarah Desmarais Aaron Horowitz Kristian Lum and Suresh Venkatasubramanian. 2021. It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness Benchmarks. (2021)."},{"key":"e_1_3_2_2_9_1","first-page":"671","article-title":"Big data's disparate impact","volume":"104","author":"Barocas Solon","year":"2016","unstructured":"Solon Barocas and Andrew D. Selbst . 2016 . Big data's disparate impact . California Law Review 104 (2016), 671 -- 732 . https:\/\/doi.org\/10.15779\/Z38BG31 10.15779\/Z38BG31 Solon Barocas and Andrew D. Selbst. 2016. Big data's disparate impact. California Law Review 104 (2016), 671--732. https:\/\/doi.org\/10.15779\/Z38BG31","journal-title":"California Law Review"},{"key":"e_1_3_2_2_10_1","volume-title":"The role of race in forecasts of violent crime. Race and social problems","author":"Berk Richard","year":"2009","unstructured":"Richard Berk . 2009. The role of race in forecasts of violent crime. Race and social problems , Vol. 1 , 4 ( 2009 ), 231--242. Richard Berk. 2009. The role of race in forecasts of violent crime. Race and social problems, Vol. 1, 4 (2009), 231--242."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/0049124118782533"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314234"},{"key":"e_1_3_2_2_13_1","volume-title":"H Chi","author":"Beutel Alex","year":"2017","unstructured":"Alex Beutel , Jilin Chen , Zhe Zhao , and Ed H Chi . 2017 . Data Decisions and Theoretical Implications when Adversarially Learning Fair Representations. FATML ( 2017). Alex Beutel, Jilin Chen, Zhe Zhao, and Ed H Chi. 2017. Data Decisions and Theoretical Implications when Adversarially Learning Fair Representations. FATML (2017)."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3378393.3402507"},{"key":"e_1_3_2_2_15_1","volume-title":"Conference on Fairness, Accountability, and Transparency (FAT*).","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru . 2018 . Gender shades: Intersectional accuracy disparities in commercial gender classification . In Conference on Fairness, Accountability, and Transparency (FAT*). Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on Fairness, Accountability, and Transparency (FAT*)."},{"key":"e_1_3_2_2_16_1","volume-title":"Science","volume":"356","author":"Caliskan Aylin","year":"2017","unstructured":"Aylin Caliskan , Joanna J. Bryson , and Arvind Narayanan . 2017 . Semantics derived automatically from language corpora contain human-like biases . Science , Vol. 356 , 6334 (2017), 183--186. https:\/\/doi.org\/10.1126\/science.aal4230 10.1126\/science.aal4230 Aylin Caliskan, Joanna J. Bryson, and Arvind Narayanan. 2017. Semantics derived automatically from language corpora contain human-like biases. Science, Vol. 356, 6334 (2017), 183--186. https:\/\/doi.org\/10.1126\/science.aal4230"},{"key":"e_1_3_2_2_17_1","volume-title":"Advances in Neural Information Processing Systems","volume":"31","author":"Chen Irene","year":"2018","unstructured":"Irene Chen , Fredrik D Johansson , and David Sontag . 2018 . Why is my classifier discriminatory ? Advances in Neural Information Processing Systems , Vol. 31 (2018). Irene Chen, Fredrik D Johansson, and David Sontag. 2018. Why is my classifier discriminatory? Advances in Neural Information Processing Systems, Vol. 31 (2018)."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_2_19_1","volume-title":"IFIP International Summer School on Privacy and Identity Management","author":"Chiappa Silvia","unstructured":"Silvia Chiappa and William S Isaac . 2018. A causal Bayesian networks viewpoint on fairness . In IFIP International Summer School on Privacy and Identity Management . Springer , 3--20. Silvia Chiappa and William S Isaac. 2018. A causal Bayesian networks viewpoint on fairness. In IFIP International Summer School on Privacy and Identity Management. Springer, 3--20."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_3_2_2_22_1","volume-title":"International Conference on Machine Learning. PMLR, 2144--2155","author":"Coston Amanda","year":"2021","unstructured":"Amanda Coston , Ashesh Rambachan , and Alexandra Chouldechova . 2021 . Characterizing fairness over the set of good models under selective labels . In International Conference on Machine Learning. PMLR, 2144--2155 . Amanda Coston, Ashesh Rambachan, and Alexandra Chouldechova. 2021. Characterizing fairness over the set of good models under selective labels. In International Conference on Machine Learning. PMLR, 2144--2155."},{"key":"e_1_3_2_2_23_1","volume-title":"Algorithmic fairness and economics. Columbia Business School Research Paper","author":"Cowgill Bo","year":"2020","unstructured":"Bo Cowgill and Catherine E Tucker . 2020. Algorithmic fairness and economics. Columbia Business School Research Paper ( 2020 ). Bo Cowgill and Catherine E Tucker. 2020. Algorithmic fairness and economics. Columbia Business School Research Paper (2020)."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372878"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_2_2_26_1","volume-title":"Advances in Neural Information Processing Systems","volume":"34","author":"Ding Frances","year":"2021","unstructured":"Frances Ding , Moritz Hardt , John Miller , and Ludwig Schmidt . 2021 . Retiring adult: New datasets for fair machine learning . Advances in Neural Information Processing Systems , Vol. 34 (2021). Frances Ding, Moritz Hardt, John Miller, and Ludwig Schmidt. 2021. Retiring adult: New datasets for fair machine learning. Advances in Neural Information Processing Systems, Vol. 34 (2021)."},{"key":"e_1_3_2_2_27_1","volume-title":"Algorithmic Fairness Datasets: the Story so Far. arXiv preprint arXiv:2202.01711","author":"Fabris Alessandro","year":"2022","unstructured":"Alessandro Fabris , Stefano Messina , Gianmaria Silvello , and Gian Antonio Susto . 2022. Algorithmic Fairness Datasets: the Story so Far. arXiv preprint arXiv:2202.01711 ( 2022 ). Alessandro Fabris, Stefano Messina, Gianmaria Silvello, and Gian Antonio Susto. 2022. Algorithmic Fairness Datasets: the Story so Far. arXiv preprint arXiv:2202.01711 (2022)."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3433949"},{"key":"e_1_3_2_2_30_1","volume-title":"False dreams of algorithmic fairness: The case of credit pricing. Available at SSRN 3571266","author":"Gillis Talia B","year":"2020","unstructured":"Talia B Gillis . 2020. False dreams of algorithmic fairness: The case of credit pricing. Available at SSRN 3571266 ( 2020 ). Talia B Gillis. 2020. False dreams of algorithmic fairness: The case of credit pricing. Available at SSRN 3571266 (2020)."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-33-6546-9"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314282"},{"key":"e_1_3_2_2_33_1","unstructured":"Moritz Hardt and Eric Price. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems (NIPS).  Moritz Hardt and Eric Price. 2016. Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems (NIPS)."},{"key":"e_1_3_2_2_34_1","volume-title":"Equality of opportunity in supervised learning. Advances in neural information processing systems","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt , Eric Price , and Nati Srebro . 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems , Vol. 29 ( 2016 ). Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems, Vol. 29 (2016)."},{"key":"e_1_3_2_2_35_1","unstructured":"Hans Hofmann. 1994. UCI Statlog (German Credit Data) Data Set. (1994).  Hans Hofmann. 1994. UCI Statlog (German Credit Data) Data Set. (1994)."},{"key":"e_1_3_2_2_36_1","unstructured":"Kim Steven Hunt and Robert Dumville. 2016. Recidivism among federal offenders: A comprehensive overview. United States Sentencing Commission.  Kim Steven Hunt and Robert Dumville. 2016. Recidivism among federal offenders: A comprehensive overview. United States Sentencing Commission."},{"key":"e_1_3_2_2_37_1","volume-title":"Predictive Power at What Cost? Economic and Racial Justice of Data-Driven Algorithms. Economic and Racial Justice of Data-Driven Algorithms (July 1","author":"Jabri Ranae","year":"2019","unstructured":"Ranae Jabri . 2019. Predictive Power at What Cost? Economic and Racial Justice of Data-Driven Algorithms. Economic and Racial Justice of Data-Driven Algorithms (July 1 , 2019 ) (2019). Ranae Jabri. 2019. Predictive Power at What Cost? Economic and Racial Justice of Data-Driven Algorithms. Economic and Racial Justice of Data-Driven Algorithms (July 1, 2019) (2019)."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3314327"},{"key":"e_1_3_2_2_39_1","volume-title":"Lauren Kirchner and Julia Angwin","author":"Larson Jeff","year":"2016","unstructured":"Jeff Larson , Surya Mattu , Lauren Kirchner and Julia Angwin . 2016 . How We Analyzed the COMPAS Recidivism Algorithm . https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm Jeff Larson, Surya Mattu, Lauren Kirchner and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372829"},{"key":"e_1_3_2_2_41_1","volume-title":"International Conference on Machine Learning. PMLR, 2439--2448","author":"Kallus Nathan","year":"2018","unstructured":"Nathan Kallus and Angela Zhou . 2018 . Residual unfairness in fair machine learning from prejudiced data . In International Conference on Machine Learning. PMLR, 2439--2448 . Nathan Kallus and Angela Zhou. 2018. Residual unfairness in fair machine learning from prejudiced data. In International Conference on Machine Learning. PMLR, 2439--2448."},{"key":"e_1_3_2_2_42_1","volume-title":"Learning The Difference That Makes A Difference With Counterfactually-Augmented Data. In International Conference on Learning Representations.","author":"Kaushik Divyansh","year":"2020","unstructured":"Divyansh Kaushik , Eduard Hovy , and Zachary Lipton . 2020 . Learning The Difference That Makes A Difference With Counterfactually-Augmented Data. In International Conference on Learning Representations. Divyansh Kaushik, Eduard Hovy, and Zachary Lipton. 2020. Learning The Difference That Makes A Difference With Counterfactually-Augmented Data. In International Conference on Learning Representations."},{"key":"e_1_3_2_2_43_1","volume-title":"Human decisions and machine predictions. The quarterly journal of economics","author":"Kleinberg Jon","year":"2018","unstructured":"Jon Kleinberg , Himabindu Lakkaraju , Jure Leskovec , Jens Ludwig , and Sendhil Mullainathan . 2018. Human decisions and machine predictions. The quarterly journal of economics , Vol. 133 , 1 ( 2018 ), 237--293. Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2018. Human decisions and machine predictions. The quarterly journal of economics, Vol. 133, 1 (2018), 237--293."},{"key":"e_1_3_2_2_44_1","volume-title":"Conference on Innovations in Theoretical Computer Science (ITCS).","author":"Kleinberg Jon","year":"2017","unstructured":"Jon Kleinberg , Sendhil Mullainathan , and Manish Raghavan . 2017 . Inherent trade-offs in the fair determination of risk scores . In Conference on Innovations in Theoretical Computer Science (ITCS). Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent trade-offs in the fair determination of risk scores. In Conference on Innovations in Theoretical Computer Science (ITCS)."},{"key":"e_1_3_2_2_45_1","unstructured":"Ronny Kohavi and Barry Becker. 1996. UCI ADULT Data Set. (1996).  Ronny Kohavi and Barry Becker. 1996. UCI ADULT Data Set. (1996)."},{"key":"e_1_3_2_2_46_1","volume-title":"Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society. 437--444","author":"Cardoso Rodrigo L.","unstructured":"Rodrigo L. Cardoso , Wagner Meira Jr , Virgilio Almeida , and Mohammed J. Zaki . 2019. A framework for benchmarking discrimination-aware models in machine learning . In Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society. 437--444 . Rodrigo L. Cardoso, Wagner Meira Jr, Virgilio Almeida, and Mohammed J. Zaki. 2019. A framework for benchmarking discrimination-aware models in machine learning. In Proceedings of the 2019 AAAI\/ACM Conference on AI, Ethics, and Society. 437--444."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098066"},{"key":"e_1_3_2_2_48_1","unstructured":"J. Larson S. Mattu L. Kirchner and J. Angwin. 2016. https:\/\/github.com\/propublica\/compas-analysis 2016. (2016).  J. Larson S. Mattu L. Kirchner and J. Angwin. 2016. https:\/\/github.com\/propublica\/compas-analysis 2016. (2016)."},{"key":"e_1_3_2_2_49_1","volume-title":"Feature-Wise Bias Amplification. In International Conference on Learning Representations (ICLR).","author":"Leino Klas","year":"2019","unstructured":"Klas Leino , Matt Fredrikson , Emily Black , Shayak Sen , and Anupam Datta . 2019 . Feature-Wise Bias Amplification. In International Conference on Learning Representations (ICLR). Klas Leino, Matt Fredrikson, Emily Black, Shayak Sen, and Anupam Datta. 2019. Feature-Wise Bias Amplification. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_2_50_1","first-page":"579","article-title":"How copyright law can fix artificial intelligence's implicit bias problem","volume":"93","author":"Levendowski Amanda","year":"2018","unstructured":"Amanda Levendowski . 2018 . How copyright law can fix artificial intelligence's implicit bias problem . Wash. L. Rev. , Vol. 93 (2018), 579 . Amanda Levendowski. 2018. How copyright law can fix artificial intelligence's implicit bias problem. Wash. L. Rev., Vol. 93 (2018), 579.","journal-title":"Wash. L. Rev."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1093\/aler\/ahw006"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1740-9713.2016.00960.x"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3457607"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.14778\/3476249.3476299"},{"key":"e_1_3_2_2_55_1","volume-title":"MLOps: From Model-Centric to Data-Centric AI. DeepLearning AI","author":"Andrew Ng.","year":"2021","unstructured":"Andrew Ng. 2021. MLOps: From Model-Centric to Data-Centric AI. DeepLearning AI ( 2021 ). Andrew Ng. 2021. MLOps: From Model-Centric to Data-Centric AI. DeepLearning AI (2021)."},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2021.100336"},{"key":"e_1_3_2_2_57_1","volume-title":"Scikit-learn: Machine learning in Python. the Journal of machine Learning research","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa , Ga\u00ebl Varoquaux , Alexandre Gramfort , Vincent Michel , Bertrand Thirion , Olivier Grisel , Mathieu Blondel , Peter Prettenhofer , Ron Weiss , Vincent Dubourg , 2011 . Scikit-learn: Machine learning in Python. the Journal of machine Learning research , Vol. 12 (2011), 2825--2830. Fabian Pedregosa, Ga\u00ebl Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in Python. the Journal of machine Learning research, Vol. 12 (2011), 2825--2830."},{"key":"e_1_3_2_2_58_1","unstructured":"Inioluwa Deborah Raji Emily M Bender Amandalynne Paullada Emily Denton and Alex Hanna. 2021. AI and the Everything in the Whole Wide World Benchmark. (2021).  Inioluwa Deborah Raji Emily M Bender Amandalynne Paullada Emily Denton and Alex Hanna. 2021. AI and the Everything in the Whole Wide World Benchmark. (2021)."},{"key":"e_1_3_2_2_59_1","volume-title":"Evaluating the Folk Wisdom. In 1st Symposium on Foundations of Responsible Computing.","author":"Rambachan Ashesh","year":"2020","unstructured":"Ashesh Rambachan and Jonathan Roth . 2020 . Bias In, Bias Out? Evaluating the Folk Wisdom. In 1st Symposium on Foundations of Responsible Computing. Ashesh Rambachan and Jonathan Roth. 2020. Bias In, Bias Out? Evaluating the Folk Wisdom. In 1st Symposium on Foundations of Responsible Computing."},{"key":"e_1_3_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.170"},{"key":"e_1_3_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476058"},{"key":"e_1_3_2_2_62_1","volume-title":"Beyond leaderboards: A survey of methods for revealing weaknesses in natural language inference data and models. arXiv preprint arXiv:2005.14709","author":"Schlegel Viktor","year":"2020","unstructured":"Viktor Schlegel , Goran Nenadic , and Riza Batista-Navarro . 2020. Beyond leaderboards: A survey of methods for revealing weaknesses in natural language inference data and models. arXiv preprint arXiv:2005.14709 ( 2020 ). Viktor Schlegel, Goran Nenadic, and Riza Batista-Navarro. 2020. Beyond leaderboards: A survey of methods for revealing weaknesses in natural language inference data and models. arXiv preprint arXiv:2005.14709 (2020)."},{"key":"e_1_3_2_2_63_1","unstructured":"David Sculley Jasper Snoek Alex Wiltschko and Ali Rahimi. 2018. Winner's curse? On pace progress and empirical rigor. (2018).  David Sculley Jasper Snoek Alex Wiltschko and Ali Rahimi. 2018. Winner's curse? On pace progress and empirical rigor. (2018)."},{"key":"e_1_3_2_2_64_1","volume-title":"Algorithmic bias and data bias: Understanding the relation between distributionally robust optimization and data curation. arXiv preprint arXiv:2106.09467","author":"S\u0142owik Agnieszka","year":"2021","unstructured":"Agnieszka S\u0142owik and L\u00e9on Bottou . 2021. Algorithmic bias and data bias: Understanding the relation between distributionally robust optimization and data curation. arXiv preprint arXiv:2106.09467 ( 2021 ). Agnieszka S\u0142owik and L\u00e9on Bottou. 2021. Algorithmic bias and data bias: Understanding the relation between distributionally robust optimization and data curation. arXiv preprint arXiv:2106.09467 (2021)."},{"key":"e_1_3_2_2_65_1","first-page":"1521","article-title":"Unbiased Look at Dataset Bias","volume":"2011","author":"A","year":"2011","unstructured":"A TORRALBA. 2011 . Unbiased Look at Dataset Bias . Proc. of IEEE Computer Vision and Pattern Recognition , 2011 (2011), 1521 -- 1528 . A TORRALBA. 2011. Unbiased Look at Dataset Bias. Proc. of IEEE Computer Vision and Pattern Recognition, 2011 (2011), 1521--1528.","journal-title":"Proc. of IEEE Computer Vision and Pattern Recognition"},{"key":"e_1_3_2_2_66_1","volume-title":"International Conference on Machine Learning. PMLR, 9625--9635","author":"Tsipras Dimitris","year":"2020","unstructured":"Dimitris Tsipras , Shibani Santurkar , Logan Engstrom , Andrew Ilyas , and Aleksander Madry . 2020 . From imagenet to image classification: Contextualizing progress on benchmarks . In International Conference on Machine Learning. PMLR, 9625--9635 . Dimitris Tsipras, Shibani Santurkar, Logan Engstrom, Andrew Ilyas, and Aleksander Madry. 2020. From imagenet to image classification: Contextualizing progress on benchmarks. In International Conference on Machine Learning. PMLR, 9625--9635."},{"key":"e_1_3_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00541"},{"key":"e_1_3_2_2_68_1","unstructured":"Michael Wick Jean-Baptiste Tristan etal 2019. Unlocking fairness: a trade-off revisited. Advances in neural information processing systems Vol. 32 (2019).  Michael Wick Jean-Baptiste Tristan et al. 2019. Unlocking fairness: a trade-off revisited. Advances in neural information processing systems Vol. 32 (2019)."},{"key":"e_1_3_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3375709"},{"key":"e_1_3_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462574"},{"key":"e_1_3_2_2_71_1","volume-title":"Men also like shopping: Reducing gender bias amplification using corpus-level constraints. arXiv preprint arXiv:1707.09457","author":"Zhao Jieyu","year":"2017","unstructured":"Jieyu Zhao , Tianlu Wang , Mark Yatskar , Vicente Ordonez , and Kai-Wei Chang . 2017. Men also like shopping: Reducing gender bias amplification using corpus-level constraints. arXiv preprint arXiv:1707.09457 ( 2017 ). Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2017. Men also like shopping: Reducing gender bias amplification using corpus-level constraints. arXiv preprint arXiv:1707.09457 (2017)."}],"event":{"name":"AIES '22: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Oxford United Kingdom","acronym":"AIES '22","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"]},"container-title":["Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534147","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534147","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:36Z","timestamp":1750186956000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534147"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":69,"alternative-id":["10.1145\/3514094.3534147","10.1145\/3514094"],"URL":"https:\/\/doi.org\/10.1145\/3514094.3534147","relation":{},"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2022-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}