{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,10]],"date-time":"2025-11-10T21:08:57Z","timestamp":1762808937516,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":24,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1762045"],"award-info":[{"award-number":["1762045"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,8,23]]},"DOI":"10.1145\/3394486.3406708","type":"proceedings-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T23:03:53Z","timestamp":1597964633000},"page":"3513-3514","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Dealing with Bias and Fairness in Data Science Systems"],"prefix":"10.1145","author":[{"given":"Pedro","family":"Saleiro","sequence":"first","affiliation":[{"name":"Feedzai, Lisbon, Portugal"}]},{"given":"Kit T.","family":"Rodolfa","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Rayid","family":"Ghani","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Kit T. Rodolfa Pedro Saleiro and Rayid Ghani. Chapter 11: Bias and fairness. In Ian Foster Rayid Ghani Ron S Jarmin Frauke Kreuter and Julia Lane editors Big data and social science: A practical guide to methods and tools. crc Press 2020.  Kit T. Rodolfa Pedro Saleiro and Rayid Ghani. Chapter 11: Bias and fairness. In Ian Foster Rayid Ghani Ron S Jarmin Frauke Kreuter and Julia Lane editors Big data and social science: A practical guide to methods and tools. crc Press 2020.","DOI":"10.1201\/9780429324383-11"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372863"},{"key":"e_1_3_2_1_3_1","volume-title":"Aequitas: A Bias and Fairness Audit Toolkit. (2018), nov","author":"Saleiro Pedro","year":"2018","unstructured":"Pedro Saleiro , Benedict Kuester , Loren Hinkson , Jesse London , Abby Stevens , Ari Anisfeld , Kit T. Rodolfa , and Rayid Ghani . Aequitas: A Bias and Fairness Audit Toolkit. (2018), nov 2018 . Pedro Saleiro, Benedict Kuester, Loren Hinkson, Jesse London, Abby Stevens, Ari Anisfeld, Kit T. Rodolfa, and Rayid Ghani. Aequitas: A Bias and Fairness Audit Toolkit. (2018), nov 2018."},{"key":"e_1_3_2_1_4_1","volume-title":"Equality of Opportunity in Supervised Learning. Advances in Neural Information Processing Systems, (Nips):1--22","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt , Eric Price , and Nathan Srebro . Equality of Opportunity in Supervised Learning. Advances in Neural Information Processing Systems, (Nips):1--22 , 2016 . Moritz Hardt, Eric Price, and Nathan Srebro. Equality of Opportunity in Supervised Learning. Advances in Neural Information Processing Systems, (Nips):1--22, 2016."},{"issue":"3","key":"e_1_3_2_1_5_1","first-page":"671","volume":"104","author":"Barocas Solon","year":"2016","unstructured":"Solon Barocas and Andrew D . Selbst. Big Data's Disparate Impact. California Law Review , 104 ( 3 ): 671 -- 732 , 2016 . Solon Barocas and Andrew D. Selbst. Big Data's Disparate Impact. California Law Review, 104(3):671--732, 2016.","journal-title":"Selbst. Big Data's Disparate Impact. California Law Review"},{"key":"e_1_3_2_1_6_1","volume-title":"Prediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions. nov","author":"Mitchell Shira","year":"2018","unstructured":"Shira Mitchell , Eric Potash , Solon Barocas , Alexander D'Amour , and Kristian Lum . Prediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions. nov 2018 . Shira Mitchell, Eric Potash, Solon Barocas, Alexander D'Amour, and Kristian Lum. Prediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions. nov 2018."},{"key":"e_1_3_2_1_7_1","first-page":"134","volume-title":"Conference on Fairness, Accountability and Transparency","author":"Chouldechova Alexandra","year":"2018","unstructured":"Alexandra Chouldechova , Diana Benavides-Prado , Oleksandr Fialko , and Rhema Vaithianathan . A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions . In Conference on Fairness, Accountability and Transparency , pages 134 -- 148 , 2018 . Alexandra Chouldechova, Diana Benavides-Prado, Oleksandr Fialko, and Rhema Vaithianathan. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Conference on Fairness, Accountability and Transparency, pages 134--148, 2018."},{"key":"e_1_3_2_1_8_1","volume-title":"The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810","author":"Chouldechova Alexandra","year":"2018","unstructured":"Alexandra Chouldechova and Aaron Roth . The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810 , 2018 . Alexandra Chouldechova and Aaron Roth. The frontiers of fairness in machine learning. arXiv preprint arXiv:1810.08810, 2018."},{"key":"e_1_3_2_1_9_1","first-page":"5680","volume-title":"Advances in Neural Information Processing Systems 30","author":"Pleiss Geoff","year":"2017","unstructured":"Geoff Pleiss , Manish Raghavan , Felix Wu , Jon Kleinberg , and Kilian Q Weinberger . On Fairness and Calibration. In I Guyon, U V Luxburg, S Bengio, H Wallach, R Fergus, S Vishwanathan, and R Garnett, editors , Advances in Neural Information Processing Systems 30 , pages 5680 -- 5689 . Curran Associates, Inc. , 2017 . Geoff Pleiss, Manish Raghavan, Felix Wu, Jon Kleinberg, and Kilian Q Weinberger. On Fairness and Calibration. In I Guyon, U V Luxburg, S Bengio, H Wallach, R Fergus, S Vishwanathan, and R Garnett, editors, Advances in Neural Information Processing Systems 30, pages 5680--5689. Curran Associates, Inc., 2017."},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017, 54","author":"Zafar Muhammad Bilal","year":"2017","unstructured":"Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , and Krishna P. Gummadi . Fairness constraints: Mechanisms for fair classification . Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017, 54 , 2017 . Muhammad Bilal Zafar, Isabel Valera, Manuel Gomez Rodriguez, and Krishna P. Gummadi. Fairness constraints: Mechanisms for fair classification. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017, 54, 2017."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052660"},{"key":"e_1_3_2_1_12_1","first-page":"1397","volume-title":"Seungil You. Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints. In Proceedings of the 36th International Conference on Machine Learning","volume":"97","author":"Cotter Andrew","year":"2019","unstructured":"Andrew Cotter , Maya Gupta , Heinrich Jiang , Nathan Srebro , Karthik Sridharan , Serena Wang , Blake Woodworth , and Seungil You. Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints. In Proceedings of the 36th International Conference on Machine Learning , volume 97 , pages 1397 -- 1405 , Long Beach, California, USA, jun 2019 . PMLR. Andrew Cotter, Maya Gupta, Heinrich Jiang, Nathan Srebro, Karthik Sridharan, Serena Wang, Blake Woodworth, and Seungil You. Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints. In Proceedings of the 36th International Conference on Machine Learning, volume 97, pages 1397--1405, Long Beach, California, USA, jun 2019. PMLR."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-017-0506-1"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194770.3194776"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3386\/w23180"},{"key":"e_1_3_2_1_17_1","first-page":"6414","volume-title":"Advances in Neural Information Processing Systems 30","author":"Russell Chris","year":"2017","unstructured":"Chris Russell , Matt J Kusner , Joshua Loftus , and Ricardo Silva . When Worlds Collide: Integrating Different Counterfactual Assumptions in Fairness. In I Guyon, U V Luxburg, S Bengio, H Wallach, R Fergus, S Vishwanathan, and R Garnett, editors , Advances in Neural Information Processing Systems 30 , pages 6414 -- 6423 . Curran Associates, Inc. , 2017 . Chris Russell, Matt J Kusner, Joshua Loftus, and Ricardo Silva. When Worlds Collide: Integrating Different Counterfactual Assumptions in Fairness. In I Guyon, U V Luxburg, S Bengio, H Wallach, R Fergus, S Vishwanathan, and R Garnett, editors, Advances in Neural Information Processing Systems 30, pages 6414--6423. Curran Associates, Inc., 2017."},{"key":"e_1_3_2_1_18_1","first-page":"4066","volume":"30","author":"Kusner Matt J","unstructured":"Matt J Kusner , Joshua Loftus , Chris Russell , and Ricardo Silva . Counterfactual Fairness . In I Guyon , U V Luxburg , S Bengio , H Wallach , R Fergus , S Vishwanathan , and R Garnett , editors , Advances in Neural Information Processing Systems 30 , pages 4066 -- 4076 . Curran Associates, Inc., 2017. Matt J Kusner, Joshua Loftus, Chris Russell, and Ricardo Silva. Counterfactual Fairness. In I Guyon, U V Luxburg, S Bengio, H Wallach, R Fergus, S Vishwanathan, and R Garnett, editors, Advances in Neural Information Processing Systems 30, pages 4066--4076. Curran Associates, Inc., 2017.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_19_1","volume-title":"May, 23","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin , Jeff Larson , Surya Mattu , and Lauren Kirchner . Machine bias. ProPublica , May, 23 : 2016 , 2016. Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. Machine bias. ProPublica, May, 23:2016, 2016."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2783311"},{"key":"e_1_3_2_1_21_1","volume-title":"35th International Conference on Machine Learning, ICML 2018, 1: 102--119","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal , Aliiia Beygelzimer , Miroslav Dudfk , John Langford , and Wallach Hanna . A reductions approach to fair classification . 35th International Conference on Machine Learning, ICML 2018, 1: 102--119 , 2018 . Alekh Agarwal, Aliiia Beygelzimer, Miroslav Dudfk, John Langford, and Wallach Hanna. A reductions approach to fair classification. 35th International Conference on Machine Learning, ICML 2018, 1:102--119, 2018."},{"key":"e_1_3_2_1_22_1","volume-title":"Penalizing Unfairness in Binary Classification. jun","author":"Bechavod Yahav","year":"2017","unstructured":"Yahav Bechavod and Katrina Ligett . Penalizing Unfairness in Binary Classification. jun 2017 . Yahav Bechavod and Katrina Ligett. Penalizing Unfairness in Binary Classification. jun 2017."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3278721.3278722"},{"key":"e_1_3_2_1_24_1","first-page":"1920","volume-title":"Proceedings of the 2017 Conference on Learning Theory","volume":"65","author":"Woodworth Blake","year":"2017","unstructured":"Blake Woodworth , Suriya Gunasekar , Mesrob I. Ohannessian , and Nathan Srebro . Learning Non-Discriminatory Predictors. In Satyen Kale and Ohad Shamir, editors , Proceedings of the 2017 Conference on Learning Theory , volume 65 , pages 1920 -- 1953 , Amsterdam, Netherlands, jul 2017 . PMLR. Blake Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, and Nathan Srebro. Learning Non-Discriminatory Predictors. In Satyen Kale and Ohad Shamir, editors, Proceedings of the 2017 Conference on Learning Theory, volume 65, pages 1920--1953, Amsterdam, Netherlands, jul 2017. PMLR."}],"event":{"name":"KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"],"location":"Virtual Event CA USA","acronym":"KDD '20"},"container-title":["Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery &amp; Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3406708","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3406708","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3406708","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:30Z","timestamp":1750195890000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3406708"}},"subtitle":["A Practical Hands-on Tutorial"],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":24,"alternative-id":["10.1145\/3394486.3406708","10.1145\/3394486"],"URL":"https:\/\/doi.org\/10.1145\/3394486.3406708","relation":{},"subject":[],"published":{"date-parts":[[2020,8,20]]},"assertion":[{"value":"2020-08-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}