{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T15:43:51Z","timestamp":1787586231829,"version":"build-2736575974"},"publisher-location":"New York, NY, USA","reference-count":64,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,26]]},"DOI":"10.1145\/3514094.3534157","type":"proceedings-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T22:25:13Z","timestamp":1658960713000},"page":"307-316","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["FairCanary"],"prefix":"10.1145","author":[{"given":"Avijit","family":"Ghosh","sequence":"first","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aalok","family":"Shanbhag","sequence":"additional","affiliation":[{"name":"Snap Inc., Mountain View, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christo","family":"Wilson","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Congress (2019--2020)","year":"2019","unstructured":"116th Congress (2019--2020) . [n.,d.]. H.R.2231 - Algorithmic Accountability Act of 2019 . https:\/\/www.congress.gov\/bill\/116th-congress\/house-bill\/2231. 116th Congress (2019--2020). [n.,d.]. H.R.2231 - Algorithmic Accountability Act of 2019. https:\/\/www.congress.gov\/bill\/116th-congress\/house-bill\/2231."},{"key":"e_1_3_2_2_2_1","volume-title":"Jennifer Wortman Vaughan, Duncan Wadsworth, and Hanna Wallach.","author":"Barocas Solon","year":"2021","unstructured":"Solon Barocas , Anhong Guo , Ece Kamar , Jacquelyn Krones , Meredith Ringel Morris , Jennifer Wortman Vaughan, Duncan Wadsworth, and Hanna Wallach. 2021 . Designing Disaggregated Evaluations of AI Systems: Choices, Considerations , and Tradeoffs . arXiv preprint arXiv:2103.06076 (2021). Solon Barocas, Anhong Guo, Ece Kamar, Jacquelyn Krones, Meredith Ringel Morris, Jennifer Wortman Vaughan, Duncan Wadsworth, and Hanna Wallach. 2021. Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs. arXiv preprint arXiv:2103.06076 (2021)."},{"key":"e_1_3_2_2_3_1","unstructured":"Rachel KE Bellamy Kuntal Dey Michael Hind Samuel C Hoffman Stephanie Houde Kalapriya Kannan Pranay Lohia Jacquelyn Martino Sameep Mehta Aleksandra Mojsilovic etal 2018. AI Fairness 360: An extensible toolkit for detecting understanding and mitigating unwanted algorithmic bias. arXiv preprint arXiv:1810.01943 (2018).  Rachel KE Bellamy Kuntal Dey Michael Hind Samuel C Hoffman Stephanie Houde Kalapriya Kannan Pranay Lohia Jacquelyn Martino Sameep Mehta Aleksandra Mojsilovic et al. 2018. AI Fairness 360: An extensible toolkit for detecting understanding and mitigating unwanted algorithmic bias. arXiv preprint arXiv:1810.01943 (2018)."},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445922"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3375624"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972771.42"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-44781-0_8"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372845"},{"key":"e_1_3_2_2_9_1","unstructured":"Miranda Bogen and Aaron Rieke. 2018. Help wanted: An examination of hiring algorithms equity and bias. (2018).  Miranda Bogen and Aaron Rieke. 2018. Help wanted: An examination of hiring algorithms equity and bias. (2018)."},{"key":"e_1_3_2_2_10_1","unstructured":"Eric Breck Neoklis Polyzotis Sudip Roy Steven Whang and Martin Zinkevich. 2019. Data Validation for Machine Learning.. In MLSys.  Eric Breck Neoklis Polyzotis Sudip Roy Steven Whang and Martin Zinkevich. 2019. Data Validation for Machine Learning.. In MLSys."},{"key":"e_1_3_2_2_11_1","unstructured":"European Commission. [n. d.]. Proposal for a Regulation laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). https:\/\/digital-strategy.ec.europa.eu\/en\/library\/proposal-regulation-laying-down-harmonised-rules-artificial-intelligence-artificial-intelligence.  European Commission. [n. d.]. Proposal for a Regulation laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). https:\/\/digital-strategy.ec.europa.eu\/en\/library\/proposal-regulation-laying-down-harmonised-rules-artificial-intelligence-artificial-intelligence."},{"key":"e_1_3_2_2_12_1","volume-title":"The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023","author":"Corbett-Davies Sam","year":"2018","unstructured":"Sam Corbett-Davies and Sharad Goel . 2018. The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023 ( 2018 ). Sam Corbett-Davies and Sharad Goel. 2018. The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023 (2018)."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_3_2_2_14_1","unstructured":"Jakub Czakon. 2022. Best Tools to Do ML Model Monitoring. (2022). https:\/\/neptune.ai\/blog\/ml-model-monitoring-best-tools  Jakub Czakon. 2022. Best Tools to Do ML Model Monitoring. (2022). https:\/\/neptune.ai\/blog\/ml-model-monitoring-best-tools"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.3905\/jfds.2021.1.075"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2016.42"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939836"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_2_19_1","first-page":"38290","article-title":"Uniform guidelines on employee selection procedures","volume":"43","author":"Equal Employment Opportunity Commission","year":"1978","unstructured":"Equal Employment Opportunity Commission , Civil Service Commission , 1978 . Uniform guidelines on employee selection procedures . Federal Register , Vol. 43 , 166 (1978), 38290 -- 38315 . Equal Employment Opportunity Commission, Civil Service Commission, et al. 1978. Uniform guidelines on employee selection procedures. Federal Register, Vol. 43, 166 (1978), 38290--38315.","journal-title":"Federal Register"},{"key":"e_1_3_2_2_20_1","unstructured":"UK Office for Artificial Intelligence. [n. d.]. Ethics Transparency and Accountability Framework for Automated Decision-Making. https:\/\/www.gov.uk\/government\/publications\/ethics-transparency-and-accountability-framework-for-automated-decision-making.  UK Office for Artificial Intelligence. [n. d.]. Ethics Transparency and Accountability Framework for Automated Decision-Making. https:\/\/www.gov.uk\/government\/publications\/ethics-transparency-and-accountability-framework-for-automated-decision-making."},{"key":"e_1_3_2_2_21_1","unstructured":"Center for Data Science and Public Policy. [n. d.]. Aequitas: Fairness Tree. http:\/\/www.datasciencepublicpolicy.org\/projects\/aequitas\/.  Center for Data Science and Public Policy. [n. d.]. Aequitas: Fairness Tree. http:\/\/www.datasciencepublicpolicy.org\/projects\/aequitas\/."},{"key":"e_1_3_2_2_22_1","volume-title":"On evaluating stream learning algorithms. Machine learning","author":"Gama Joao","year":"2013","unstructured":"Joao Gama , Raquel Sebastiao , and Pedro Pereira Rodrigues . 2013. On evaluating stream learning algorithms. Machine learning , Vol. 90 , 3 ( 2013 ), 317--346. Joao Gama, Raquel Sebastiao, and Pedro Pereira Rodrigues. 2013. On evaluating stream learning algorithms. Machine learning, Vol. 90, 3 (2013), 317--346."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330691"},{"key":"e_1_3_2_2_24_1","volume-title":"ML Health: Fitness Tracking for Production Models. CoRR","author":"Ghanta Sindhu","year":"2019","unstructured":"Sindhu Ghanta , Sriram Subramanian , Lior Khermosh , Swaminathan Sundararaman , Harshil Shah , Yakov Goldberg , Drew S. Roselli , and Nisha Talagala . 2019. ML Health: Fitness Tracking for Production Models. CoRR , Vol. abs\/ 1902 .02808 ( 2019 ). arxiv: 1902.02808 http:\/\/arxiv.org\/abs\/1902.02808 Sindhu Ghanta, Sriram Subramanian, Lior Khermosh, Swaminathan Sundararaman, Harshil Shah, Yakov Goldberg, Drew S. Roselli, and Nisha Talagala. 2019. ML Health: Fitness Tracking for Production Models. CoRR, Vol. abs\/1902.02808 (2019). arxiv: 1902.02808 http:\/\/arxiv.org\/abs\/1902.02808"},{"key":"e_1_3_2_2_25_1","volume-title":"Characterizing Intersectional Group Fairness with Worst-Case Comparisons. arXiv preprint arXiv:2101.01673","author":"Ghosh Avijit","year":"2021","unstructured":"Avijit Ghosh , Lea Genuit , and Mary Reagan . 2021. Characterizing Intersectional Group Fairness with Worst-Case Comparisons. arXiv preprint arXiv:2101.01673 ( 2021 ). Avijit Ghosh, Lea Genuit, and Mary Reagan. 2021. Characterizing Intersectional Group Fairness with Worst-Case Comparisons. arXiv preprint arXiv:2101.01673 (2021)."},{"key":"e_1_3_2_2_26_1","volume-title":"Fairness-Aware Neural R\u00e9yni Minimization for Continuous Features. arXiv preprint arXiv:1911.04929","author":"Grari Vincent","year":"2019","unstructured":"Vincent Grari , Boris Ruf , Sylvain Lamprier , and Marcin Detyniecki . 2019. Fairness-Aware Neural R\u00e9yni Minimization for Continuous Features. arXiv preprint arXiv:1911.04929 ( 2019 ). Vincent Grari, Boris Ruf, Sylvain Lamprier, and Marcin Detyniecki. 2019. Fairness-Aware Neural R\u00e9yni Minimization for Continuous Features. arXiv preprint arXiv:1911.04929 (2019)."},{"key":"e_1_3_2_2_27_1","volume-title":"Equality of opportunity in supervised learning. arXiv preprint arXiv:1610.02413","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt , Eric Price , and Nathan Srebro . 2016. Equality of opportunity in supervised learning. arXiv preprint arXiv:1610.02413 ( 2016 ). Moritz Hardt, Eric Price, and Nathan Srebro. 2016. Equality of opportunity in supervised learning. arXiv preprint arXiv:1610.02413 (2016)."},{"key":"e_1_3_2_2_28_1","volume-title":"A benchmark for interpretability methods in deep neural networks. Advances in neural information processing systems","author":"Hooker Sara","year":"2019","unstructured":"Sara Hooker , Dumitru Erhan , Pieter-Jan Kindermans , and Been Kim . 2019. A benchmark for interpretability methods in deep neural networks. Advances in neural information processing systems , Vol. 32 ( 2019 ). Sara Hooker, Dumitru Erhan, Pieter-Jan Kindermans, and Been Kim. 2019. A benchmark for interpretability methods in deep neural networks. Advances in neural information processing systems, Vol. 32 (2019)."},{"key":"e_1_3_2_2_29_1","unstructured":"Ray Jiang Aldo Pacchiano Tom Stepleton Heinrich Jiang and Silvia Chiappa. 2020. Wasserstein fair classification. In Uncertainty in Artificial Intelligence. PMLR 862--872.  Ray Jiang Aldo Pacchiano Tom Stepleton Heinrich Jiang and Silvia Chiappa. 2020. Wasserstein fair classification. In Uncertainty in Artificial Intelligence. PMLR 862--872."},{"key":"e_1_3_2_2_30_1","volume-title":"Data preprocessing techniques for classification without discrimination. Knowledge and information systems","author":"Kamiran Faisal","year":"2012","unstructured":"Faisal Kamiran and Toon Calders . 2012. Data preprocessing techniques for classification without discrimination. Knowledge and information systems , Vol. 33 , 1 ( 2012 ), 1--33. Faisal Kamiran and Toon Calders. 2012. Data preprocessing techniques for classification without discrimination. Knowledge and information systems, Vol. 33, 1 (2012), 1--33."},{"key":"e_1_3_2_2_31_1","volume-title":"A survey of algorithmic recourse: definitions, formulations, solutions, and prospects. arXiv preprint arXiv:2010.04050","author":"Karimi Amir-Hossein","year":"2020","unstructured":"Amir-Hossein Karimi , Gilles Barthe , Bernhard Sch\u00f6lkopf , and Isabel Valera . 2020. A survey of algorithmic recourse: definitions, formulations, solutions, and prospects. arXiv preprint arXiv:2010.04050 ( 2020 ). Amir-Hossein Karimi, Gilles Barthe, Bernhard Sch\u00f6lkopf, and Isabel Valera. 2020. A survey of algorithmic recourse: definitions, formulations, solutions, and prospects. arXiv preprint arXiv:2010.04050 (2020)."},{"key":"e_1_3_2_2_32_1","unstructured":"Niki Kilbertus Philip J Ball Matt J Kusner Adrian Weller and Ricardo Silva. 2020. The sensitivity of counterfactual fairness to unmeasured confounding. In Uncertainty in artificial intelligence. PMLR 616--626.  Niki Kilbertus Philip J Ball Matt J Kusner Adrian Weller and Ricardo Silva. 2020. The sensitivity of counterfactual fairness to unmeasured confounding. In Uncertainty in artificial intelligence. PMLR 616--626."},{"key":"e_1_3_2_2_33_1","volume-title":"Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807","author":"Kleinberg Jon","year":"2016","unstructured":"Jon Kleinberg , Sendhil Mullainathan , and Manish Raghavan . 2016. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807 ( 2016 ). Jon Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807 (2016)."},{"key":"e_1_3_2_2_34_1","unstructured":"Alistair Knott. [n. d.]. Moving Towards Responsible Government Use of AI in New Zealand). https:\/\/digitaltechitp.nz\/2021\/03\/22\/moving-towards-responsible-government-use-of-ai-in-new-zealand\/.  Alistair Knott. [n. d.]. Moving Towards Responsible Government Use of AI in New Zealand). https:\/\/digitaltechitp.nz\/2021\/03\/22\/moving-towards-responsible-government-use-of-ai-in-new-zealand\/."},{"key":"e_1_3_2_2_35_1","volume-title":"International Conference on Machine Learning. PMLR, 5491--5500","author":"Kumar I Elizabeth","year":"2020","unstructured":"I Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , and Sorelle Friedler . 2020 a. Problems with Shapley-value-based explanations as feature importance measures . In International Conference on Machine Learning. PMLR, 5491--5500 . I Elizabeth Kumar, Suresh Venkatasubramanian, Carlos Scheidegger, and Sorelle Friedler. 2020 a. Problems with Shapley-value-based explanations as feature importance measures. In International Conference on Machine Learning. PMLR, 5491--5500."},{"key":"e_1_3_2_2_36_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research","author":"Kumar I. Elizabeth","year":"2020","unstructured":"I. Elizabeth Kumar , Suresh Venkatasubramanian , Carlos Scheidegger , and Sorelle Friedler . 2020 b. Problems with Shapley-value-based explanations as feature importance measures . In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 119), Hal Daum\u00e9 III and Aarti Singh (Eds.). PMLR, 5491--5500. https:\/\/proceedings.mlr.press\/v119\/kumar20e.html I. Elizabeth Kumar, Suresh Venkatasubramanian, Carlos Scheidegger, and Sorelle Friedler. 2020 b. Problems with Shapley-value-based explanations as feature importance measures. In Proceedings of the 37th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 119), Hal Daum\u00e9 III and Aarti Singh (Eds.). PMLR, 5491--5500. https:\/\/proceedings.mlr.press\/v119\/kumar20e.html"},{"key":"e_1_3_2_2_37_1","volume-title":"Counterfactual fairness. arXiv preprint arXiv:1703.06856","author":"Kusner Matt J","year":"2017","unstructured":"Matt J Kusner , Joshua R Loftus , Chris Russell , and Ricardo Silva . 2017. Counterfactual fairness. arXiv preprint arXiv:1703.06856 ( 2017 ). Matt J Kusner, Joshua R Loftus, Chris Russell, and Ricardo Silva. 2017. Counterfactual fairness. arXiv preprint arXiv:1703.06856 (2017)."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/18.61115"},{"key":"e_1_3_2_2_39_1","volume-title":"International Conference on Machine Learning. PMLR, 3150--3158","author":"Liu Lydia T","year":"2018","unstructured":"Lydia T Liu , Sarah Dean , Esther Rolf , Max Simchowitz , and Moritz Hardt . 2018 . Delayed impact of fair machine learning . In International Conference on Machine Learning. PMLR, 3150--3158 . Lydia T Liu, Sarah Dean, Esther Rolf, Max Simchowitz, and Moritz Hardt. 2018. Delayed impact of fair machine learning. In International Conference on Machine Learning. PMLR, 3150--3158."},{"key":"e_1_3_2_2_40_1","first-page":"I","article-title":"A Unified Approach to Interpreting Model Predictions","volume":"30","author":"Lundberg Scott M","year":"2017","unstructured":"Scott M Lundberg and Su-In Lee . 2017 . A Unified Approach to Interpreting Model Predictions . In Advances in Neural Information Processing Systems 30 , I . Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 4765--4774. http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-model-predictions.pdf Scott M Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems 30, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 4765--4774. http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-model-predictions.pdf","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2020.103655"},{"key":"e_1_3_2_2_42_1","volume-title":"A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635","author":"Mehrabi Ninareh","year":"2019","unstructured":"Ninareh Mehrabi , Fred Morstatter , Nripsuta Saxena , Kristina Lerman , and Aram Galstyan . 2019. A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635 ( 2019 ). Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2019. A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635 (2019)."},{"key":"e_1_3_2_2_43_1","volume-title":"The Explanation Game: Explaining Machine Learning Models Using Shapley Values. In International Cross-Domain Conference for Machine Learning and Knowledge Extraction. Springer, 17--38","author":"Merrick Luke","year":"2020","unstructured":"Luke Merrick and Ankur Taly . 2020 . The Explanation Game: Explaining Machine Learning Models Using Shapley Values. In International Cross-Domain Conference for Machine Learning and Knowledge Extraction. Springer, 17--38 . Luke Merrick and Ankur Taly. 2020. The Explanation Game: Explaining Machine Learning Models Using Shapley Values. In International Cross-Domain Conference for Machine Learning and Knowledge Extraction. Springer, 17--38."},{"key":"e_1_3_2_2_44_1","volume-title":"Wasserstein-based fairness interpretability framework for machine learning models. arXiv preprint arXiv:2011.03156","author":"Miroshnikov Alexey","year":"2020","unstructured":"Alexey Miroshnikov , Konstandinos Kotsiopoulos , Ryan Franks , and Arjun Ravi Kannan . 2020. Wasserstein-based fairness interpretability framework for machine learning models. arXiv preprint arXiv:2011.03156 ( 2020 ). Alexey Miroshnikov, Konstandinos Kotsiopoulos, Ryan Franks, and Arjun Ravi Kannan. 2020. Wasserstein-based fairness interpretability framework for machine learning models. arXiv preprint arXiv:2011.03156 (2020)."},{"key":"e_1_3_2_2_45_1","volume-title":"Achieving Fairness via Post-Processing in Web-Scale Recommender Systems. arxiv","author":"Nandy Preetam","year":"2006","unstructured":"Preetam Nandy , Cyrus Diciccio , Divya Venugopalan , Heloise Logan , Kinjal Basu , and Noureddine El Karoui . 2021. Achieving Fairness via Post-Processing in Web-Scale Recommender Systems. arxiv : 2006 .11350 [stat.ML] Preetam Nandy, Cyrus Diciccio, Divya Venugopalan, Heloise Logan, Kinjal Basu, and Noureddine El Karoui. 2021. Achieving Fairness via Post-Processing in Web-Scale Recommender Systems. arxiv: 2006.11350 [stat.ML]"},{"key":"e_1_3_2_2_46_1","unstructured":"Arvind Narayanan. [n. d.]. 21 fairness definitions and their politics. https:\/\/fairmlbook.org\/tutorial2.html.  Arvind Narayanan. [n. d.]. 21 fairness definitions and their politics. https:\/\/fairmlbook.org\/tutorial2.html."},{"key":"e_1_3_2_2_47_1","volume-title":"Raghu Ramesha, Alan Tan, Michele Donini, and Krishnaram Kenthapadi.","author":"Nigenda David","year":"2021","unstructured":"David Nigenda , Zohar Karnin , Muhammad Bilal Zafar , Raghu Ramesha, Alan Tan, Michele Donini, and Krishnaram Kenthapadi. 2021 . Amazon SageMaker Model Monitor: A System for Real-Time Insights into Deployed Machine Learning Models . arXiv preprint arXiv:2111.13657 (2021). David Nigenda, Zohar Karnin, Muhammad Bilal Zafar, Raghu Ramesha, Alan Tan, Michele Donini, and Krishnaram Kenthapadi. 2021. Amazon SageMaker Model Monitor: A System for Real-Time Insights into Deployed Machine Learning Models. arXiv preprint arXiv:2111.13657 (2021)."},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSMC.2008.4811799"},{"key":"e_1_3_2_2_49_1","unstructured":"Government of Canada. [n. d.]. Responsible use of artificial intelligence (AI). https:\/\/www.canada.ca\/en\/government\/system\/digital-government\/digital-government-innovations\/responsible-use-ai.html.  Government of Canada. [n. d.]. Responsible use of artificial intelligence (AI). https:\/\/www.canada.ca\/en\/government\/system\/digital-government\/digital-government-innovations\/responsible-use-ai.html."},{"key":"e_1_3_2_2_50_1","volume-title":"Marco OP Sampaio, and Pedro Bizarro","author":"Pinto F\u00e1bio","year":"2019","unstructured":"F\u00e1bio Pinto , Marco OP Sampaio, and Pedro Bizarro . 2019 . Automatic model monitoring for data streams. arXiv preprint arXiv:1908.04240 (2019). F\u00e1bio Pinto, Marco OP Sampaio, and Pedro Bizarro. 2019. Automatic model monitoring for data streams. arXiv preprint arXiv:1908.04240 (2019)."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372828"},{"key":"e_1_3_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_2_53_1","volume-title":"Lazy learning","author":"Salganicoff Marcos","unstructured":"Marcos Salganicoff . 1997. Tolerating concept and sampling shift in lazy learning using prediction error context switching . In Lazy learning . Springer , 133--155. Marcos Salganicoff. 1997. Tolerating concept and sampling shift in lazy learning using prediction error context switching. In Lazy learning. Springer, 133--155."},{"key":"e_1_3_2_2_54_1","unstructured":"Sebastian Schelter Felix Biessmann Tim Januschowski David Salinas Stephan Seufert and Gyuri Szarvas. 2018. On challenges in machine learning model management. (2018).  Sebastian Schelter Felix Biessmann Tim Januschowski David Salinas Stephan Seufert and Gyuri Szarvas. 2018. On challenges in machine learning model management. (2018)."},{"key":"e_1_3_2_2_55_1","volume-title":"Hidden technical debt in machine learning systems. Advances in neural information processing systems","author":"Sculley David","year":"2015","unstructured":"David Sculley , Gary Holt , Daniel Golovin , Eugene Davydov , Todd Phillips , Dietmar Ebner , Vinay Chaudhary , Michael Young , Jean-Francois Crespo , and Dan Dennison . 2015. Hidden technical debt in machine learning systems. Advances in neural information processing systems , Vol. 28 ( 2015 ). David Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young, Jean-Francois Crespo, and Dan Dennison. 2015. Hidden technical debt in machine learning systems. Advances in neural information processing systems, Vol. 28 (2015)."},{"key":"e_1_3_2_2_56_1","volume-title":"Conference on Fairness, Accountability and Transparency. PMLR, 48--48","author":"Selbst Andrew","year":"2018","unstructured":"Andrew Selbst and Julia Powles . 2018 . \" Meaningful Information\" and the Right to Explanation . In Conference on Fairness, Accountability and Transparency. PMLR, 48--48 . Andrew Selbst and Julia Powles. 2018. \"Meaningful Information\" and the Right to Explanation. In Conference on Fairness, Accountability and Transparency. PMLR, 48--48."},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287598"},{"key":"e_1_3_2_2_58_1","volume-title":"Unified Shapley Framework to Explain Prediction Drift. arXiv preprint arXiv:2102.07862","author":"Shanbhag Aalok","year":"2021","unstructured":"Aalok Shanbhag , Avijit Ghosh , and Josh Rubin . 2021. Unified Shapley Framework to Explain Prediction Drift. arXiv preprint arXiv:2102.07862 ( 2021 ). Aalok Shanbhag, Avijit Ghosh, and Josh Rubin. 2021. Unified Shapley Framework to Explain Prediction Drift. arXiv preprint arXiv:2102.07862 (2021)."},{"key":"e_1_3_2_2_59_1","volume-title":"International conference on machine learning. PMLR, 3145--3153","author":"Shrikumar Avanti","year":"2017","unstructured":"Avanti Shrikumar , Peyton Greenside , and Anshul Kundaje . 2017 . Learning important features through propagating activation differences . In International conference on machine learning. PMLR, 3145--3153 . Avanti Shrikumar, Peyton Greenside, and Anshul Kundaje. 2017. Learning important features through propagating activation differences. In International conference on machine learning. PMLR, 3145--3153."},{"key":"e_1_3_2_2_60_1","volume-title":"Department of Computer Sciences","author":"Stanley Kenneth O","year":"2003","unstructured":"Kenneth O Stanley . 2003. Learning concept drift with a committee of decision trees. Informe t\u00e9cnico: UT-AI-TR-03-302 , Department of Computer Sciences , University of Texas at Austin , USA ( 2003 ). Kenneth O Stanley. 2003. Learning concept drift with a committee of decision trees. Informe t\u00e9cnico: UT-AI-TR-03-302, Department of Computer Sciences, University of Texas at Austin, USA (2003)."},{"key":"e_1_3_2_2_61_1","volume-title":"International Conference on Machine Learning. PMLR, 3319--3328","author":"Sundararajan Mukund","year":"2017","unstructured":"Mukund Sundararajan , Ankur Taly , and Qiqi Yan . 2017 . Axiomatic attribution for deep networks . In International Conference on Machine Learning. PMLR, 3319--3328 . Mukund Sundararajan, Ankur Taly, and Qiqi Yan. 2017. Axiomatic attribution for deep networks. In International Conference on Machine Learning. PMLR, 3319--3328."},{"key":"e_1_3_2_2_62_1","volume-title":"Optimal transport","author":"Villani C\u00e9dric","unstructured":"C\u00e9dric Villani . 2009. The wasserstein distances . In Optimal transport . Springer , 93--111. C\u00e9dric Villani. 2009. The wasserstein distances. In Optimal transport. Springer, 93--111."},{"key":"e_1_3_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445928"},{"key":"e_1_3_2_2_64_1","volume-title":"2010 IEEE International Conference on Data Mining Workshops. IEEE, 843--850","author":"Indre","year":"2010","unstructured":"Indre vZ liobaite. 2010 . Change with delayed labeling: When is it detectable? . In 2010 IEEE International Conference on Data Mining Workshops. IEEE, 843--850 . Indre vZ liobaite. 2010. Change with delayed labeling: When is it detectable?. In 2010 IEEE International Conference on Data Mining Workshops. IEEE, 843--850."}],"event":{"name":"AIES '22: AAAI\/ACM Conference on AI, Ethics, and Society","location":"Oxford United Kingdom","acronym":"AIES '22","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence","AAAI"]},"container-title":["Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534157","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3514094.3534157","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:36Z","timestamp":1750186956000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3514094.3534157"}},"subtitle":["Rapid Continuous Explainable Fairness"],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":64,"alternative-id":["10.1145\/3514094.3534157","10.1145\/3514094"],"URL":"https:\/\/doi.org\/10.1145\/3514094.3534157","relation":{},"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"2022-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}