{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T08:54:31Z","timestamp":1775638471964,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":26,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,9]],"date-time":"2021-06-09T00:00:00Z","timestamp":1623196800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,9]]},"DOI":"10.1145\/3448016.3457284","type":"proceedings-article","created":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T17:22:39Z","timestamp":1624036959000},"page":"1400-1412","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":44,"title":["Looking for Trouble: Analyzing Classifier Behavior via Pattern Divergence"],"prefix":"10.1145","author":[{"given":"Eliana","family":"Pastor","sequence":"first","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]},{"given":"Luca","family":"de Alfaro","sequence":"additional","affiliation":[{"name":"University of California, Santa Cruz, Santa Cruz, CA, USA"}]},{"given":"Elena","family":"Baralis","sequence":"additional","affiliation":[{"name":"Politecnico di Torino, Torino, Italy"}]}],"member":"320","published-online":{"date-parts":[[2021,6,18]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/645920.672836"},{"key":"e_1_3_2_2_2_1","unstructured":"TensorFlow Model Analysis. 2018. Introducing TensorFlow Model Analysis: Scaleable Sliced and Full-Pass Metrics. https:\/\/medium.com\/tensorflow\/introducing-tensorflow-model-analysis-scaleable-sliced-and-full-pass-metrics-5cde7baf0b7b .  TensorFlow Model Analysis. 2018. Introducing TensorFlow Model Analysis: Scaleable Sliced and Full-Pass Metrics. https:\/\/medium.com\/tensorflow\/introducing-tensorflow-model-analysis-scaleable-sliced-and-full-pass-metrics-5cde7baf0b7b ."},{"key":"e_1_3_2_2_3_1","unstructured":"Julia Angwin Jeff Larson Surya Mattu and Lauren Kirchner. 2016. Machine Bias. https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing  Julia Angwin Jeff Larson Surya Mattu and Lauren Kirchner. 2016. Machine Bias. https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00056"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098021"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST47406.2019.8986948"},{"key":"e_1_3_2_2_8_1","volume-title":"Ki Hyun Tae, and Steven Euijong Whang. 2019 a. Automated Data Slicing for Model Validation: A Big data - AI Integration Approach","author":"Chung Yeounoh","year":"2019","unstructured":"Yeounoh Chung , Tim Kraska , Neoklis Polyzotis , Ki Hyun Tae, and Steven Euijong Whang. 2019 a. Automated Data Slicing for Model Validation: A Big data - AI Integration Approach . IEEE Transactions on Knowledge and Data Engineering ( 2019 ). https:\/\/doi.org\/10.1109\/TKDE.2019.2916074 10.1109\/TKDE.2019.2916074 Yeounoh Chung, Tim Kraska, Neoklis Polyzotis, Ki Hyun Tae, and Steven Euijong Whang. 2019 a. Automated Data Slicing for Model Validation: A Big data - AI Integration Approach. IEEE Transactions on Knowledge and Data Engineering (2019). https:\/\/doi.org\/10.1109\/TKDE.2019.2916074"},{"key":"e_1_3_2_2_9_1","volume-title":"Slice Finder: Automated Data Slicing for Model Validation. In 2019 IEEE 35th International Conference on Data Engineering (ICDE). 1550--1553","author":"Chung Yeounoh","year":"2019","unstructured":"Yeounoh Chung , Tim Kraska , Neoklis Polyzotis , Ki Hyun Tae , and Steven Euijong Whang . 2019 b . Slice Finder: Automated Data Slicing for Model Validation. In 2019 IEEE 35th International Conference on Data Engineering (ICDE). 1550--1553 . Yeounoh Chung, Tim Kraska, Neoklis Polyzotis, Ki Hyun Tae, and Steven Euijong Whang. 2019 b. Slice Finder: Automated Data Slicing for Model Validation. In 2019 IEEE 35th International Conference on Data Engineering (ICDE). 1550--1553."},{"key":"e_1_3_2_2_10_1","volume-title":"Proceedings of the 2018 Conference on Fairness, Accountability, and Transparency (FAT* 2018)","author":"Dwork Cynthia","year":"2018","unstructured":"Cynthia Dwork and Christina Ilvento . 2018 . Group fairness under composition . In Proceedings of the 2018 Conference on Fairness, Accountability, and Transparency (FAT* 2018) . Cynthia Dwork and Christina Ilvento. 2018. Group fairness under composition. In Proceedings of the 2018 Conference on Fairness, Accountability, and Transparency (FAT* 2018) ."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00203"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236009"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/342009.335372"},{"key":"e_1_3_2_2_14_1","volume-title":"Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data","author":"Jin Zhongjun","year":"1846","unstructured":"Zhongjun Jin , Mengjing Xu , Chenkai Sun , Abolfazl Asudeh , and H. V. Jagadish . 2020. MithraCoverage: A System for Investigating Population Bias for Intersectional Fairness . In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data ( Portland, OR, USA) (SIGMOD '20). Association for Computing Machinery, New York, NY, USA, 2721--2724. https:\/\/doi.org\/10.1145\/33 1846 4.3384689 10.1145\/3318464.3384689 Zhongjun Jin, Mengjing Xu, Chenkai Sun, Abolfazl Asudeh, and H. V. Jagadish. 2020. MithraCoverage: A System for Investigating Population Bias for Intersectional Fairness. In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data (Portland, OR, USA) (SIGMOD '20). Association for Computing Machinery, New York, NY, USA, 2721--2724. https:\/\/doi.org\/10.1145\/3318464.3384689"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939502.2939503"},{"key":"e_1_3_2_2_16_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018","author":"Kearns Michael J.","year":"2018","unstructured":"Michael J. Kearns , Seth Neel , Aaron Roth , and Zhiwei Steven Wu . 2018 . Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018 , Stockholmsmassan, Stockholm, Sweden, July 10--15 , 2018 (Proceedings of Machine Learning Research, Vol. 80). PMLR, 2569--2577. http:\/\/proceedings.mlr.press\/v80\/kearns18a.html Michael J. Kearns, Seth Neel, Aaron Roth, and Zhiwei Steven Wu. 2018. Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsmassan, Stockholm, Sweden, July 10--15, 2018 (Proceedings of Machine Learning Research, Vol. 80). PMLR, 2569--2577. http:\/\/proceedings.mlr.press\/v80\/kearns18a.html"},{"key":"e_1_3_2_2_17_1","unstructured":"M. Lichman. 2013. UCI Machine Learning Repository.  M. Lichman. 2013. UCI Machine Learning Repository."},{"key":"e_1_3_2_2_18_1","first-page":"I","article-title":"A Unified Approach to Interpreting Model Predictions","volume":"30","author":"Lundberg Scott M","year":"2017","unstructured":"Scott M Lundberg and Su-In Lee . 2017 . A Unified Approach to Interpreting Model Predictions . In Advances in Neural Information Processing Systems 30 , I . Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 4765--4774. http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-model-predictions.pdf Scott M Lundberg and Su-In Lee. 2017. A Unified Approach to Interpreting Model Predictions. In Advances in Neural Information Processing Systems 30, I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.). Curran Associates, Inc., 4765--4774. http:\/\/papers.nips.cc\/paper\/7062-a-unified-approach-to-interpreting-model-predictions.pdf","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_19_1","volume-title":"Auditing and Achieving Intersectional Fairness in Classification Problems. arxiv","author":"Morina Giulio","year":"1911","unstructured":"Giulio Morina , Viktoriia Oliinyk , Julian Waton , Ines Marusic , and Konstantinos Georgatzis . 2019. Auditing and Achieving Intersectional Fairness in Classification Problems. arxiv : 1911 .01468 [cs.LG] Giulio Morina, Viktoriia Oliinyk, Julian Waton, Ines Marusic, and Konstantinos Georgatzis. 2019. Auditing and Achieving Intersectional Fairness in Classification Problems. arxiv: 1911.01468 [cs.LG]"},{"key":"e_1_3_2_2_20_1","unstructured":"Eliana Pastor Luca de Alfaro and Elena Baralis. 2021. DivExplorer project page. https:\/\/divexplorer.github.io\/  Eliana Pastor Luca de Alfaro and Elena Baralis. 2021. DivExplorer project page. https:\/\/divexplorer.github.io\/"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_2_22_1","volume-title":"Anchors: High-Precision Model-Agnostic Explanations. In AAAI Conference on Artificial Intelligence (AAAI) .","author":"Ribeiro Marco Tulio","year":"2018","unstructured":"Marco Tulio Ribeiro , Sameer Singh , and Carlos Guestrin . 2018 . Anchors: High-Precision Model-Agnostic Explanations. In AAAI Conference on Artificial Intelligence (AAAI) . Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2018. Anchors: High-Precision Model-Agnostic Explanations. In AAAI Conference on Artificial Intelligence (AAAI) ."},{"key":"e_1_3_2_2_23_1","volume-title":"Aequitas: A Bias and Fairness Audit Toolkit. arXiv preprint arXiv:1811.05577","author":"Saleiro Pedro","year":"2018","unstructured":"Pedro Saleiro , Benedict Kuester , Abby Stevens , Ari Anisfeld , Loren Hinkson , Jesse London , and Rayid Ghani . 2018 . Aequitas: A Bias and Fairness Audit Toolkit. arXiv preprint arXiv:1811.05577 (2018). Pedro Saleiro, Benedict Kuester, Abby Stevens, Ari Anisfeld, Loren Hinkson, Jesse London, and Rayid Ghani. 2018. Aequitas: A Bias and Fairness Audit Toolkit. arXiv preprint arXiv:1811.05577 (2018)."},{"key":"e_1_3_2_2_24_1","volume-title":"A value for n-person games. Contributions to the Theory of Games","author":"Shapley Lloyd S","year":"1953","unstructured":"Lloyd S Shapley . 1953. A value for n-person games. Contributions to the Theory of Games , Vol. 2 , 28 ( 1953 ), 307--317. Lloyd S Shapley. 1953. A value for n-person games. Contributions to the Theory of Games, Vol. 2, 28 (1953), 307--317."},{"key":"e_1_3_2_2_25_1","volume-title":"Introduction to Data Mining","author":"Tan Pang-Ning","unstructured":"Pang-Ning Tan , Michael Steinbach , Anuj Karpatne , and Vipin Kumar . 2018. Introduction to Data Mining ( 2nd Edition) 2 nd ed.). Pearson . Pang-Ning Tan, Michael Steinbach, Anuj Karpatne, and Vipin Kumar. 2018. Introduction to Data Mining (2nd Edition) 2nd ed.). Pearson.","edition":"2"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1073"}],"event":{"name":"SIGMOD\/PODS '21: International Conference on Management of Data","location":"Virtual Event China","acronym":"SIGMOD\/PODS '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data"]},"container-title":["Proceedings of the 2021 International Conference on Management of Data"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448016.3457284","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448016.3457284","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:06Z","timestamp":1750195686000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448016.3457284"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,9]]},"references-count":26,"alternative-id":["10.1145\/3448016.3457284","10.1145\/3448016"],"URL":"https:\/\/doi.org\/10.1145\/3448016.3457284","relation":{},"subject":[],"published":{"date-parts":[[2021,6,9]]},"assertion":[{"value":"2021-06-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}