{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T11:35:47Z","timestamp":1760441747730,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1950885"],"award-info":[{"award-number":["1950885"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,26]]},"DOI":"10.1145\/3514094.3534169","type":"proceedings-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T22:25:13Z","timestamp":1658960713000},"page":"831-844","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Identifying Bias in Data Using Two-Distribution Hypothesis Tests"],"prefix":"10.1145","author":[{"given":"William","family":"Yik","sequence":"first","affiliation":[{"name":"Harvey Mudd College, Claremont, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Limnanthes","family":"Serafini","sequence":"additional","affiliation":[{"name":"Harvey Mudd College, Claremont, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timothy","family":"Lindsey","sequence":"additional","affiliation":[{"name":"Biola University, La Mirada, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George D.","family":"Monta\u00f1ez","sequence":"additional","affiliation":[{"name":"Harvey Mudd College, Claremont, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"Julia Angwin Jeff Larson Surya Mattu and Lauren Kirchner. 2016. Machine Bias. ProPublica. https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing Accessed 07\/05\/2021.  Julia Angwin Jeff Larson Surya Mattu and Lauren Kirchner. 2016. Machine Bias. ProPublica. https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing Accessed 07\/05\/2021."},{"key":"e_1_3_2_2_2_1","unstructured":"Arthur Asuncion and David Newman. 2007. UCI Machine Learning Repository.  Arthur Asuncion and David Newman. 2007. UCI Machine Learning Repository."},{"key":"e_1_3_2_2_3_1","volume-title":"A Review of Vibration-Based Damage Detection in Civil Structures: From Traditional Methods to Machine Learning and Deep Learning Applications. Mechanical systems and signal processing","author":"Avci Onur","year":"2021","unstructured":"Onur Avci , Osama Abdeljaber , Serkan Kiranyaz , Mohammed Hussein , Moncef Gabbouj , and Daniel J Inman . 2021. A Review of Vibration-Based Damage Detection in Civil Structures: From Traditional Methods to Machine Learning and Deep Learning Applications. Mechanical systems and signal processing , Vol. 147 ( 2021 ), 107077. Onur Avci, Osama Abdeljaber, Serkan Kiranyaz, Mohammed Hussein, Moncef Gabbouj, and Daniel J Inman. 2021. A Review of Vibration-Based Damage Detection in Civil Structures: From Traditional Methods to Machine Learning and Deep Learning Applications. Mechanical systems and signal processing, Vol. 147 (2021), 107077."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Agathe Balayn Christoph Lofi and Geert-Jan Houben. 2021. Managing Bias and Unfairness in Data for Decision Support: A Survey of Machine Learning and Data Engineering Approaches to Identify and Mitigate Bias and Unfairness within Data Management and Analytics Systems. The VLDB Journal (2021) 1--30.  Agathe Balayn Christoph Lofi and Geert-Jan Houben. 2021. Managing Bias and Unfairness in Data for Decision Support: A Survey of Machine Learning and Data Engineering Approaches to Identify and Mitigate Bias and Unfairness within Data Management and Analytics Systems. The VLDB Journal (2021) 1--30.","DOI":"10.1007\/s00778-021-00671-8"},{"key":"e_1_3_2_2_5_1","volume-title":"ProPublica's COMPAS Data Revisited. arXiv preprint arXiv:1906.04711","author":"Barenstein Matias","year":"2019","unstructured":"Matias Barenstein . 2019. ProPublica's COMPAS Data Revisited. arXiv preprint arXiv:1906.04711 ( 2019 ). Matias Barenstein. 2019. ProPublica's COMPAS Data Revisited. arXiv preprint arXiv:1906.04711 (2019)."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287"},{"key":"e_1_3_2_2_7_1","volume-title":"Fairness in Machine Learning: A Survey. arXiv preprint arXiv:2010.04053","author":"Caton Simon","year":"2020","unstructured":"Simon Caton and Christian Haas . 2020. Fairness in Machine Learning: A Survey. arXiv preprint arXiv:2010.04053 ( 2020 ). Simon Caton and Christian Haas. 2020. Fairness in Machine Learning: A Survey. arXiv preprint arXiv:2010.04053 (2020)."},{"key":"e_1_3_2_2_8_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research","author":"Celis L. Elisa","year":"2020","unstructured":"L. Elisa Celis , Vijay Keswani , and Nisheeth Vishnoi . 2020 . Data Preprocessing to Mitigate Bias: A Maximum Entropy Based Approach . In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 119), Hal Daum\u00e9 III and Aarti Singh (Eds.). PMLR, 1349--1359. L. Elisa Celis, Vijay Keswani, and Nisheeth Vishnoi. 2020. Data Preprocessing to Mitigate Bias: A Maximum Entropy Based Approach. In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 119), Hal Daum\u00e9 III and Aarti Singh (Eds.). PMLR, 1349--1359."},{"key":"e_1_3_2_2_9_1","first-page":"1","article-title":"Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goals","volume":"20","author":"Cotter Andrew","year":"2019","unstructured":"Andrew Cotter , Heinrich Jiang , Maya R Gupta , Serena Wang , Taman Narayan , Seungil You , and Karthik Sridharan . 2019 . Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goals . J. Mach. Learn. Res. , Vol. 20 , 172 (2019), 1 -- 59 . Andrew Cotter, Heinrich Jiang, Maya R Gupta, Serena Wang, Taman Narayan, Seungil You, and Karthik Sridharan. 2019. Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goals. J. Mach. Learn. Res., Vol. 20, 172 (2019), 1--59.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.spl.2020.108742"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403199"},{"key":"e_1_3_2_2_12_1","volume-title":"Certifying and Removing Disparate Impact. In proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 259--268","author":"Feldman Michael","year":"2015","unstructured":"Michael Feldman , Sorelle A Friedler , John Moeller , Carlos Scheidegger , and Suresh Venkatasubramanian . 2015 . Certifying and Removing Disparate Impact. In proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 259--268 . Michael Feldman, Sorelle A Friedler, John Moeller, Carlos Scheidegger, and Suresh Venkatasubramanian. 2015. Certifying and Removing Disparate Impact. In proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 259--268."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0701744104"},{"key":"e_1_3_2_2_14_1","volume-title":"The Extent and Consequences of P-Hacking in Science. PLoS biology","author":"Head Megan L","year":"2015","unstructured":"Megan L Head , Luke Holman , Rob Lanfear , Andrew T Kahn , and Michael D Jennions . 2015. The Extent and Consequences of P-Hacking in Science. PLoS biology , Vol. 13 , 3 ( 2015 ), e1002106. Megan L Head, Luke Holman, Rob Lanfear, Andrew T Kahn, and Michael D Jennions. 2015. The Extent and Consequences of P-Hacking in Science. PLoS biology, Vol. 13, 3 (2015), e1002106."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5220\/0010207502050215"},{"key":"e_1_3_2_2_16_1","volume-title":"Identifying and Correcting Label Bias in Machine Learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 702--712","author":"Jiang Heinrich","year":"2020","unstructured":"Heinrich Jiang and Ofir Nachum . 2020 . Identifying and Correcting Label Bias in Machine Learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 702--712 . Heinrich Jiang and Ofir Nachum. 2020. Identifying and Correcting Label Bias in Machine Learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 702--712."},{"key":"e_1_3_2_2_17_1","volume-title":"Machine Learning Applications in Cancer Prognosis and Prediction. Computational and structural biotechnology journal","author":"Kourou Konstantina","year":"2015","unstructured":"Konstantina Kourou , Themis P Exarchos , Konstantinos P Exarchos , Michalis V Karamouzis , and Dimitrios I Fotiadis . 2015. Machine Learning Applications in Cancer Prognosis and Prediction. Computational and structural biotechnology journal , Vol. 13 ( 2015 ), 8--17. Konstantina Kourou, Themis P Exarchos, Konstantinos P Exarchos, Michalis V Karamouzis, and Dimitrios I Fotiadis. 2015. Machine Learning Applications in Cancer Prognosis and Prediction. Computational and structural biotechnology journal, Vol. 13 (2015), 8--17."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3457607"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.5048\/BIO-C.2018.4"},{"key":"e_1_3_2_2_21_1","unstructured":"Razieh Nabi-Abdolyousefi etal 2021. Causal Inference Methods for Bias Correction in Data Analyses. Ph. D. Dissertation. Johns Hopkins University.  Razieh Nabi-Abdolyousefi et al. 2021. Causal Inference Methods for Bias Correction in Data Analyses. Ph. D. Dissertation. Johns Hopkins University."},{"key":"e_1_3_2_2_22_1","volume-title":"Aequitas: A Bias and Fairness Audit Toolkit. arXiv preprint arXiv:1811.05577","author":"Saleiro Pedro","year":"2018","unstructured":"Pedro Saleiro , Benedict Kuester , Loren Hinkson , Jesse London , Abby Stevens , Ari Anisfeld , Kit T Rodolfa , and Rayid Ghani . 2018 . Aequitas: A Bias and Fairness Audit Toolkit. arXiv preprint arXiv:1811.05577 (2018). Pedro Saleiro, Benedict Kuester, Loren Hinkson, Jesse London, Abby Stevens, Ari Anisfeld, Kit T Rodolfa, and Rayid Ghani. 2018. Aequitas: A Bias and Fairness Audit Toolkit. arXiv preprint arXiv:1811.05577 (2018)."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445927"},{"key":"e_1_3_2_2_24_1","volume-title":"Fairtest: Discovering Unwarranted Associations in Data-Driven Applications. In 2017 IEEE European Symposium on Security and Privacy (EuroS&P). IEEE, 401--416","author":"Tramer Florian","year":"2017","unstructured":"Florian Tramer , Vaggelis Atlidakis , Roxana Geambasu , Daniel Hsu , Jean-Pierre Hubaux , Mathias Humbert , Ari Juels , and Huang Lin . 2017 . Fairtest: Discovering Unwarranted Associations in Data-Driven Applications. In 2017 IEEE European Symposium on Security and Privacy (EuroS&P). IEEE, 401--416 . Florian Tramer, Vaggelis Atlidakis, Roxana Geambasu, Daniel Hsu, Jean-Pierre Hubaux, Mathias Humbert, Ari Juels, and Huang Lin. 2017. Fairtest: Discovering Unwarranted Associations in Data-Driven Applications. In 2017 IEEE European Symposium on Security and Privacy (EuroS&P). IEEE, 401--416."},{"key":"e_1_3_2_2_25_1","volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC","author":"Tsuchiya Masatoshi","year":"2018","unstructured":"Masatoshi Tsuchiya . 2018 . Performance Impact Caused by Hidden Bias of Training Data for Recognizing Textual Entailment . In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). Masatoshi Tsuchiya. 2018. Performance Impact Caused by Hidden Bias of Training Data for Recognizing Textual Entailment. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)."},{"key":"e_1_3_2_2_26_1","unstructured":"Jesse Vig Sebastian Gehrmann Yonatan Belinkov Sharon Qian Daniel Nevo Yaron Singer and Stuart M Shieber. 2020. Investigating Gender Bias in Language Models Using Causal Mediation Analysis.. In NeurIPS.  Jesse Vig Sebastian Gehrmann Yonatan Belinkov Sharon Qian Daniel Nevo Yaron Singer and Stuart M Shieber. 2020. Investigating Gender Bias in Language Models Using Causal Mediation Analysis.. In NeurIPS."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/549"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098167"}],"event":{"name":"AIES '22: AAAI\/ACM Conference on AI, Ethics, and Society","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"],"location":"Oxford United Kingdom","acronym":"AIES '22"},"container-title":["Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534169","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534169","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534169","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:36Z","timestamp":1750186956000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534169"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":27,"alternative-id":["10.1145\/3514094.3534169","10.1145\/3514094"],"URL":"https:\/\/doi.org\/10.1145\/3514094.3534169","relation":{},"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2022-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}