{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T07:38:34Z","timestamp":1770881914780,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,27]],"date-time":"2022-04-27T00:00:00Z","timestamp":1651017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,27]]},"DOI":"10.1145\/3491101.3503568","type":"proceedings-article","created":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T16:49:48Z","timestamp":1651250988000},"page":"1-7","source":"Crossref","is-referenced-by-count":17,"title":["A Case Study of Integrating Fairness Visualization Tools in Machine Learning Education"],"prefix":"10.1145","author":[{"given":"Afra","family":"Mashhadi","sequence":"first","affiliation":[{"name":"Computing and Software Systems, University of Washington, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Annuska","family":"Zolyomi","sequence":"additional","affiliation":[{"name":"Computing and Software Systems, University of Washington, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jay","family":"Quedado","sequence":"additional","affiliation":[{"name":"Computing and Software Systems, University of Washington, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,4,28]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"[\n  1\n  ]  2021. https:\/\/www.kaggle.com\/c\/boston-housing  [1] 2021. https:\/\/www.kaggle.com\/c\/boston-housing"},{"key":"e_1_3_2_2_2_1","unstructured":"[\n  2\n  ]  2021. https:\/\/docs.responsibly.ai\/notebooks\/demo-fico-analysis.html  [2] 2021. https:\/\/docs.responsibly.ai\/notebooks\/demo-fico-analysis.html"},{"key":"e_1_3_2_2_3_1","unstructured":"[\n  3\n  ]  2021. https:\/\/github.com\/propublica\/compas-analysis\/  [3] 2021. https:\/\/github.com\/propublica\/compas-analysis\/"},{"key":"e_1_3_2_2_4_1","unstructured":"2021. Coded Bias.  2021. Coded Bias."},{"key":"e_1_3_2_2_5_1","volume-title":"International Conference on Machine Learning. PMLR, 60\u201369","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal , Alina Beygelzimer , Miroslav Dud\u00edk , John Langford , and Hanna Wallach . 2018 . A reductions approach to fair classification . In International Conference on Machine Learning. PMLR, 60\u201369 . Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\u00edk, John Langford, and Hanna Wallach. 2018. A reductions approach to fair classification. In International Conference on Machine Learning. PMLR, 60\u201369."},{"key":"e_1_3_2_2_6_1","volume-title":"International Conference on Machine Learning. PMLR, 120\u2013129","author":"Agarwal Alekh","year":"2019","unstructured":"Alekh Agarwal , Miroslav Dudik , and Zhiwei\u00a0Steven Wu . 2019 . Fair regression: Quantitative definitions and reduction-based algorithms . In International Conference on Machine Learning. PMLR, 120\u2013129 . Alekh Agarwal, Miroslav Dudik, and Zhiwei\u00a0Steven Wu. 2019. Fair regression: Quantitative definitions and reduction-based algorithms. In International Conference on Machine Learning. PMLR, 120\u2013129."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.intcom.2007.08.003"},{"key":"e_1_3_2_2_8_1","unstructured":"Hubert Baniecki Wojciech Kretowicz Piotr Piatyszek Jakub Wisniewski and Przemyslaw Biecek. 2020. dalex: Responsible Machine Learning with Interactive Explainability and Fairness in Python. arXiv preprint arXiv:2012.14406(2020).  Hubert Baniecki Wojciech Kretowicz Piotr Piatyszek Jakub Wisniewski and Przemyslaw Biecek. 2020. dalex: Responsible Machine Learning with Interactive Explainability and Fairness in Python. arXiv preprint arXiv:2012.14406(2020)."},{"key":"e_1_3_2_2_9_1","unstructured":"Niels Bantilan. 2017. scikit-ml. https:\/\/themis-ml.readthedocs.io\/en\/latest\/  Niels Bantilan. 2017. scikit-ml. https:\/\/themis-ml.readthedocs.io\/en\/latest\/"},{"key":"e_1_3_2_2_10_1","unstructured":"Solon Barocas Moritz Hardt and Arvind Narayanan. 2019. Fairness and Machine Learning. fairmlbook.org. http:\/\/www.fairmlbook.org.  Solon Barocas Moritz Hardt and Arvind Narayanan. 2019. Fairness and Machine Learning. fairmlbook.org. http:\/\/www.fairmlbook.org."},{"key":"e_1_3_2_2_11_1","unstructured":"Benjamin\u00a0S Baumer Randi\u00a0L Garcia Albert\u00a0Y Kim Katherine\u00a0M Kinnaird and Miles\u00a0Q Ott. 2020. Integrating data science ethics into an undergraduate major. arXiv preprint arXiv:2001.07649(2020).  Benjamin\u00a0S Baumer Randi\u00a0L Garcia Albert\u00a0Y Kim Katherine\u00a0M Kinnaird and Miles\u00a0Q Ott. 2020. Integrating data science ethics into an undergraduate major. arXiv preprint arXiv:2001.07649(2020)."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3291125.3309646"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Huili Chen Cheng Fu Jishen Zhao and Farinaz Koushanfar. 2019. DeepInspect: A Black-box Trojan Detection and Mitigation Framework for Deep Neural Networks.. In IJCAI. 4658\u20134664.  Huili Chen Cheng Fu Jishen Zhao and Farinaz Koushanfar. 2019. DeepInspect: A Black-box Trojan Detection and Mitigation Framework for Deep Neural Networks.. In IJCAI. 4658\u20134664.","DOI":"10.24963\/ijcai.2019\/647"},{"key":"e_1_3_2_2_14_1","volume-title":"Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data 5, 2","author":"Chouldechova Alexandra","year":"2017","unstructured":"Alexandra Chouldechova . 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data 5, 2 ( 2017 ), 153\u2013163. Alexandra Chouldechova. 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data 5, 2 (2017), 153\u2013163."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3376898"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_3_2_2_17_1","unstructured":"Kate Crawford. 2017. \u201cThe Trouble with Bias\u201d.  Kate Crawford. 2017. \u201cThe Trouble with Bias\u201d."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11948-006-0066-z"},{"key":"e_1_3_2_2_19_1","first-page":"7","article-title":"COMPAS risk scales: Demonstrating accuracy equity and predictive parity","volume":"7","author":"Dieterich William","year":"2016","unstructured":"William Dieterich , Christina Mendoza , and Tim Brennan . 2016 . COMPAS risk scales: Demonstrating accuracy equity and predictive parity . Northpoint Inc 7 , 7 .4 (2016), 1. William Dieterich, Christina Mendoza, and Tim Brennan. 2016. COMPAS risk scales: Demonstrating accuracy equity and predictive parity. Northpoint Inc 7, 7.4 (2016), 1.","journal-title":"Northpoint Inc"},{"key":"e_1_3_2_2_20_1","unstructured":"Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml  Dheeru Dua and Casey Graff. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_2_22_1","unstructured":"Facebook. 2020. FairFlow. https:\/\/www.facebook.com\/FairFlowTech\/  Facebook. 2020. FairFlow. https:\/\/www.facebook.com\/FairFlowTech\/"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3330794"},{"key":"e_1_3_2_2_24_1","unstructured":"Moritz Hardt Eric Price and Nathan Srebro. 2016. Equality of opportunity in supervised learning. arXiv preprint arXiv:1610.02413(2016).  Moritz Hardt Eric Price and Nathan Srebro. 2016. Equality of opportunity in supervised learning. arXiv preprint arXiv:1610.02413(2016)."},{"key":"e_1_3_2_2_25_1","unstructured":"Shlomi Hod. 2018\u2013. Responsibly: Toolkit for Auditing and Mitigating Bias and Fairness of Machine Learning Systems. http:\/\/docs.responsibly.ai\/  Shlomi Hod. 2018\u2013. Responsibly: Toolkit for Auditing and Mitigating Bias and Fairness of Machine Learning Systems. http:\/\/docs.responsibly.ai\/"},{"key":"e_1_3_2_2_26_1","unstructured":"Anna\u00a0Lauren Hoffmann and Katherine\u00a0Alejandra Cross. 2021. Teaching Data Ethics: Foundations and Possibilities from Engineering and Computer Science Ethics Education. (2021).  Anna\u00a0Lauren Hoffmann and Katherine\u00a0Alejandra Cross. 2021. Teaching Data Ethics: Foundations and Possibilities from Engineering and Computer Science Ethics Education. (2021)."},{"key":"e_1_3_2_2_27_1","volume-title":"The ethical algorithm: The science of socially aware algorithm design","author":"Kearns Michael","unstructured":"Michael Kearns and Aaron Roth . 2019. The ethical algorithm: The science of socially aware algorithm design . Oxford University Press . Michael Kearns and Aaron Roth. 2019. The ethical algorithm: The science of socially aware algorithm design. Oxford University Press."},{"key":"e_1_3_2_2_28_1","unstructured":"Jon Kleinberg Sendhil Mullainathan and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807(2016).  Jon Kleinberg Sendhil Mullainathan and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807(2016)."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1556262.1556278"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445261"},{"key":"e_1_3_2_2_31_1","volume-title":"OKCupid data release fiasco: It\u2019s time to rethink ethics education","author":"Markham A","year":"2016","unstructured":"A Markham . 2016. OKCupid data release fiasco: It\u2019s time to rethink ethics education . Points : Data & Society( 2016 ). A Markham. 2016. OKCupid data release fiasco: It\u2019s time to rethink ethics education. Points: Data & Society(2016)."},{"key":"e_1_3_2_2_32_1","volume-title":"Pedagogical approaches to data ethics","author":"Metcalf Jacob","year":"2015","unstructured":"Jacob Metcalf , Kate Crawford , and Emily\u00a0 F Keller . 2015. Pedagogical approaches to data ethics . Council for Big Data , Ethics , and Society( 2015 ). Jacob Metcalf, Kate Crawford, and Emily\u00a0F Keller. 2015. Pedagogical approaches to data ethics. Council for Big Data, Ethics, and Society(2015)."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Thomas\u00a0L Naps Guido R\u00f6\u00dfling Vicki Almstrum Wanda Dann Rudolf Fleischer Chris Hundhausen Ari Korhonen Lauri Malmi Myles McNally Susan Rodger 2002. Exploring the role of visualization and engagement in computer science education. In Working group reports from ITiCSE on Innovation and technology in computer science education. 131\u2013152.  Thomas\u00a0L Naps Guido R\u00f6\u00dfling Vicki Almstrum Wanda Dann Rudolf Fleischer Chris Hundhausen Ari Korhonen Lauri Malmi Myles McNally Susan Rodger 2002. Exploring the role of visualization and engagement in computer science education. In Working group reports from ITiCSE on Innovation and technology in computer science education. 131\u2013152.","DOI":"10.1145\/782941.782998"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168931.2168945"},{"key":"e_1_3_2_2_35_1","unstructured":"Cathy O\u2019neil. 2016. Weapons of math destruction: How big data increases inequality and threatens democracy. Crown.  Cathy O\u2019neil. 2016. Weapons of math destruction: How big data increases inequality and threatens democracy. Crown."},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121341.1121514"},{"key":"e_1_3_2_2_37_1","unstructured":"Jay Quedado. 2021. Fairness Visualization Tools in ML Education. https:\/\/molochxte.github.io\/ML-Fairness-Tools-in-Education\/  Jay Quedado. 2021. Fairness Visualization Tools in ML Education. https:\/\/molochxte.github.io\/ML-Fairness-Tools-in-Education\/"},{"key":"e_1_3_2_2_38_1","unstructured":"Google\u00a0Brain Team. 2015. Tensorflow. https:\/\/themis-ml.readthedocs.io\/en\/latest\/  Google\u00a0Brain Team. 2015. Tensorflow. https:\/\/themis-ml.readthedocs.io\/en\/latest\/"},{"key":"e_1_3_2_2_39_1","volume-title":"September 19","author":"Varshney K","year":"2018","unstructured":"K Varshney . 2018. Introducing AI fairness 360. IBM Research blog , September 19 ( 2018 ). K Varshney. 2018. Introducing AI fairness 360. IBM Research blog, September 19 (2018)."},{"key":"e_1_3_2_2_40_1","unstructured":"Matthijs Vincent. 2019. scikit-fairness. https:\/\/github.com\/koaning\/scikit-fairness  Matthijs Vincent. 2019. scikit-fairness. https:\/\/github.com\/koaning\/scikit-fairness"},{"key":"e_1_3_2_2_41_1","volume-title":"The what-if tool: Interactive probing of machine learning models","author":"Wexler James","year":"2019","unstructured":"James Wexler , Mahima Pushkarna , Tolga Bolukbasi , Martin Wattenberg , Fernanda Vi\u00e9gas , and Jimbo Wilson . 2019. The what-if tool: Interactive probing of machine learning models . IEEE transactions on visualization and computer graphics 26, 1( 2019 ), 56\u201365. James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics 26, 1(2019), 56\u201365."},{"key":"e_1_3_2_2_42_1","volume-title":"Conference on Learning Theory. PMLR","author":"Woodworth Blake","year":"2017","unstructured":"Blake Woodworth , Suriya Gunasekar , Mesrob\u00a0 I Ohannessian , and Nathan Srebro . 2017 . Learning non-discriminatory predictors . In Conference on Learning Theory. PMLR , 1920\u20131953. Blake Woodworth, Suriya Gunasekar, Mesrob\u00a0I Ohannessian, and Nathan Srebro. 2017. Learning non-discriminatory predictors. In Conference on Learning Theory. PMLR, 1920\u20131953."},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"crossref","unstructured":"Matthew Zook Solon Barocas Danah Boyd Kate Crawford Emily Keller Seeta\u00a0Pe\u00f1a Gangadharan Alyssa Goodman Rachelle Hollander Barbara\u00a0A Koenig Jacob Metcalf 2017. Ten simple rules for responsible big data research.  Matthew Zook Solon Barocas Danah Boyd Kate Crawford Emily Keller Seeta\u00a0Pe\u00f1a Gangadharan Alyssa Goodman Rachelle Hollander Barbara\u00a0A Koenig Jacob Metcalf 2017. Ten simple rules for responsible big data research.","DOI":"10.1371\/journal.pcbi.1005399"}],"event":{"name":"CHI '22: CHI Conference on Human Factors in Computing Systems","location":"New Orleans LA USA","acronym":"CHI '22","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["CHI Conference on Human Factors in Computing Systems Extended Abstracts"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491101.3503568","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491101.3503568","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:08Z","timestamp":1750188668000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491101.3503568"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,27]]},"references-count":43,"alternative-id":["10.1145\/3491101.3503568","10.1145\/3491101"],"URL":"https:\/\/doi.org\/10.1145\/3491101.3503568","relation":{},"subject":[],"published":{"date-parts":[[2022,4,27]]}}}