{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T00:08:19Z","timestamp":1782346099109,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":56,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,1,27]],"date-time":"2020-01-27T00:00:00Z","timestamp":1580083200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,1,27]]},"DOI":"10.1145\/3351095.3372870","type":"proceedings-article","created":{"date-parts":[[2020,1,23]],"date-time":"2020-01-23T13:43:02Z","timestamp":1579786982000},"page":"56-67","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":226,"title":["Explainability fact sheets"],"prefix":"10.1145","author":[{"given":"Kacper","family":"Sokol","sequence":"first","affiliation":[{"name":"University of Bristol, Bristol, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Flach","sequence":"additional","affiliation":[{"name":"University of Bristol, Bristol, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,1,27]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942288"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00041"},{"key":"e_1_3_2_2_3_1","volume-title":"Proceedings of the AutoML workshop at ICML","volume":"2014","author":"Biran Or","year":"2014"},{"key":"e_1_3_2_2_4_1","unstructured":"Dimitri Bohlender and Maximilian A K\u00f6hl. 2019. Towards a Characterization of Explainable Systems. arXiv preprint arXiv:1902.03096 (2019).  Dimitri Bohlender and Maximilian A K\u00f6hl. 2019. Towards a Characterization of Explainable Systems. arXiv preprint arXiv:1902.03096 (2019)."},{"key":"e_1_3_2_2_5_1","unstructured":"Mark Craven and Jude W Shavlik. 1996. Extracting tree-structured representations of trained networks. In Advances in neural information processing systems. 24--30.  Mark Craven and Jude W Shavlik. 1996. Extracting tree-structured representations of trained networks. In Advances in neural information processing systems. 24--30."},{"key":"e_1_3_2_2_6_1","unstructured":"Christian Davenport. 2010. Rashomon effect observation and data generation. Media bias perspective and state repression (2010).  Christian Davenport. 2010. Rashomon effect observation and data generation. Media bias perspective and state repression (2010)."},{"key":"e_1_3_2_2_7_1","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017).  Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017)."},{"key":"e_1_3_2_2_8_1","unstructured":"Phan Minh Dung Robert A Kowalski and Francesca Toni. 2009. Assumption-Based Argumentation.  Phan Minh Dung Robert A Kowalski and Francesca Toni. 2009. Assumption-Based Argumentation."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172961"},{"key":"e_1_3_2_2_10_1","unstructured":"Jerome H Friedman. 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics (2001) 1189--1232.  Jerome H Friedman. 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics (2001) 1189--1232."},{"key":"e_1_3_2_2_11_1","volume-title":"Datasheets for Datasets. 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning (FAT\/ML 2018) at the 35th International Conference on Machine Learning (ICML 2018","author":"Gebru Timnit","year":"2018"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/10618600.2014.907095"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"crossref","unstructured":"H Paul Grice Peter Cole Jerry Morgan etal 1975. Logic and conversation. 1975 (1975) 41--58.  H Paul Grice Peter Cole Jerry Morgan et al. 1975. Logic and conversation. 1975 (1975) 41--58.","DOI":"10.1163\/9789004368811_003"},{"key":"e_1_3_2_2_14_1","volume-title":"Proceedings of the IJCAI Workshop on eXplainable Artificial Intelligence (XAI","author":"Hall Mark","year":"2019"},{"key":"e_1_3_2_2_15_1","volume-title":"Interpretable ML Symposium at the 31st Conference on Neural Information Processing Systems (NIPS 2017","author":"Herman Bernease","year":"2017"},{"key":"e_1_3_2_2_16_1","unstructured":"Sarah Holland Ahmed Hosny Sarah Newman Joshua Joseph and Kasia Chmielinski. 2018. The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards. arXiv preprint arXiv:1805.03677 (2018).  Sarah Holland Ahmed Hosny Sarah Newman Joshua Joseph and Kasia Chmielinski. 2018. The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards. arXiv preprint arXiv:1805.03677 (2018)."},{"key":"e_1_3_2_2_17_1","unstructured":"People + AI Research (PAIR) initiative at Google. 2019. People + AI Guidebook: Designing human-centered AI products. https:\/\/pair.withgoogle.com  People + AI Research (PAIR) initiative at Google. 2019. People + AI Guidebook: Designing human-centered AI products. https:\/\/pair.withgoogle.com"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/169891.169951"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1572532.1572538"},{"key":"e_1_3_2_2_20_1","unstructured":"Been Kim Rajiv Khanna and Oluwasanmi O Koyejo. 2016. Examples are not enough learn to criticize! criticism for interpretability. In Advances in Neural Information Processing Systems. 2280--2288.  Been Kim Rajiv Khanna and Oluwasanmi O Koyejo. 2016. Examples are not enough learn to criticize! criticism for interpretability. In Advances in Neural Information Processing Systems. 2280--2288."},{"key":"e_1_3_2_2_21_1","unstructured":"Been Kim Cynthia Rudin and Julie A Shah. 2014. The Bayesian case model: A generative approach for case-based reasoning and prototype classification. In Advances in Neural Information Processing Systems. 1952--1960.  Been Kim Cynthia Rudin and Julie A Shah. 2014. The Bayesian case model: A generative approach for case-based reasoning and prototype classification. In Advances in Neural Information Processing Systems. 1952--1960."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Derek J Koehler. 1991. Explanation imagination and confidence in judgment. Psychological bulletin 110 3 (1991) 499.  Derek J Koehler. 1991. Explanation imagination and confidence in judgment. Psychological bulletin 110 3 (1991) 499.","DOI":"10.1037\/0033-2909.110.3.499"},{"key":"e_1_3_2_2_23_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning (Proceedings of Machine Learning Research), Doina Precup and Yee Whye Teh (Eds.)","volume":"70","author":"Koh Pang Wei","year":"2017"},{"key":"e_1_3_2_2_24_1","volume-title":"2016 ICML Workshop on Human Interpretability in Machine Learning (WHI 2016)","author":"Krause Josua","year":"2016"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858529"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207678"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2013.6645235"},{"key":"e_1_3_2_2_29_1","volume-title":"4th Workshop on Fairness, Accountability, and Transparency in Machine Learning (FAT\/ML 2017) at the 23rd SIGKDD conference on Knowledge Discovery and Data Mining (KDD 2017","author":"Lakkaraju Himabindu","year":"2017"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/388"},{"key":"e_1_3_2_2_31_1","volume-title":"3rd Workshop on Human Interpretability in Machine Learning (WHI 2018) at the 35th International Conference on Machine Learning (ICML 2018","author":"Laugel Thibault","year":"2018"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236386.3241340"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Tania Lombrozo. 2007. Simplicity and probability in causal explanation. Cognitive psychology 55 3 (2007) 232--257.  Tania Lombrozo. 2007. Simplicity and probability in causal explanation. Cognitive psychology 55 3 (2007) 232--257.","DOI":"10.1016\/j.cogpsych.2006.09.006"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.07.007"},{"key":"e_1_3_2_2_35_1","volume-title":"Explainable AI: Beware of Inmates Running the Asylum. In IJCAI-17 Workshop on Explainable AI (XAI). 36","author":"Miller Tim","year":"2017"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_3_2_2_37_1","unstructured":"The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. 2017. Ethically Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems. http:\/\/standards.ieee.org\/develop\/indconn\/ec\/autonomous_systems.html  The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. 2017. Ethically Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems. http:\/\/standards.ieee.org\/develop\/indconn\/ec\/autonomous_systems.html"},{"key":"e_1_3_2_2_38_1","unstructured":"Judea Pearl and Dana Mackenzie. 2018. The book of why: the new science of cause and effect. Basic Books.  Judea Pearl and Dana Mackenzie. 2018. The book of why: the new science of cause and effect. Basic Books."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2016.0150"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3375627.3375850"},{"key":"e_1_3_2_2_41_1","volume-title":"Stakeholders in Explainable AI. 2018 AAAI Fall Symposium Series: Artificial Intelligence in Government and Public Sector","author":"Preece Alun","year":"2018"},{"key":"e_1_3_2_2_42_1","unstructured":"Dillon Reisman Jason Schultz Kate Crawford and Meredith Whittaker. 2018. Algorithmic impact assessments: A practical framework for public agency accountability. AI Now Institute (2018).  Dillon Reisman Jason Schultz Kate Crawford and Meredith Whittaker. 2018. Algorithmic impact assessments: A practical framework for public agency accountability. AI Now Institute (2018)."},{"key":"e_1_3_2_2_43_1","volume-title":"1st Workshop on Human Interpretability in Machine Learning (WHI 2016) at the 33rd International Conference on Machine Learning (ICML 2016","author":"Ribeiro Marco Tulio","year":"2016"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_2_45_1","volume-title":"Human and Machine Learning","author":"Robnik-\u0160ikonja Marko"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Leonid Rozenblit and Frank Keil. 2002. The misunderstood limits of folk science: An illusion of explanatory depth. Cognitive science 26 5 (2002) 521--562.  Leonid Rozenblit and Frank Keil. 2002. The misunderstood limits of folk science: An illusion of explanatory depth. Cognitive science 26 5 (2002) 521--562.","DOI":"10.1207\/s15516709cog2605_1"},{"key":"e_1_3_2_2_48_1","unstructured":"Johanes Schneider and Joshua Handali. 2019. Personalized Explanation for Machine Learning: a Conceptualization. In ECIS.  Johanes Schneider and Joshua Handali. 2019. Personalized Explanation for Machine Learning: a Conceptualization. In ECIS."},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"crossref","unstructured":"Daniel J Simons. 2000. Current approaches to change blindness. Visual cognition 7 1-3 (2000) 1--15.  Daniel J Simons. 2000. Current approaches to change blindness. Visual cognition 7 1-3 (2000) 1--15.","DOI":"10.1080\/135062800394658"},{"key":"e_1_3_2_2_50_1","unstructured":"Kacper Sokol Alexander Hepburn Raul Santos-Rodriguez and Peter Flach. 2019. bLIMEy: Surrogate Prediction Explanations Beyond LIME. 2019 Workshop on Human-Centric Machine Learning (HCML 2019) at the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019) Vancouver Canada (2019). https:\/\/arxiv.org\/abs\/1910.13016 arXiv preprint arXiv:1910.13016.  Kacper Sokol Alexander Hepburn Raul Santos-Rodriguez and Peter Flach. 2019. bLIMEy: Surrogate Prediction Explanations Beyond LIME. 2019 Workshop on Human-Centric Machine Learning (HCML 2019) at the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019) Vancouver Canada (2019). https:\/\/arxiv.org\/abs\/1910.13016 arXiv preprint arXiv:1910.13016."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098039"},{"key":"e_1_3_2_2_52_1","volume-title":"3rd Workshop on Human Interpretability in Machine Learning (WHI 2018) at the 35th International Conference on Machine Learning (ICML 2018","author":"Tomsett Richard","year":"2018"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"crossref","unstructured":"Sandra Wachter Brent Mittelstadt and Chris Russell. 2018. Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR. Harvard Journal of Law & Technology 31 (2) (2018).  Sandra Wachter Brent Mittelstadt and Chris Russell. 2018. Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPR. Harvard Journal of Law & Technology 31 (2) (2018).","DOI":"10.2139\/ssrn.3063289"},{"key":"e_1_3_2_2_54_1","first-page":"1","article-title":"Dialogical Models of Explanation","volume":"2007","author":"Walton Douglas","year":"2007","journal-title":"ExaCt"},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3282486"},{"key":"e_1_3_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3193568"},{"key":"e_1_3_2_2_57_1","volume-title":"AI for Social Good Workshop at the 36th International Conference on Machine Learning (ICML 2019","author":"Zhang Yujia","year":"2019"}],"event":{"name":"FAT* '20: Conference on Fairness, Accountability, and Transparency","location":"Barcelona Spain","acronym":"FAT* '20","sponsor":["ACM Association for Computing Machinery"]},"container-title":["Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351095.3372870","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3351095.3372870","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:22Z","timestamp":1750200082000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3351095.3372870"}},"subtitle":["a framework for systematic assessment of explainable approaches"],"short-title":[],"issued":{"date-parts":[[2020,1,27]]},"references-count":56,"alternative-id":["10.1145\/3351095.3372870","10.1145\/3351095"],"URL":"https:\/\/doi.org\/10.1145\/3351095.3372870","relation":{},"subject":[],"published":{"date-parts":[[2020,1,27]]},"assertion":[{"value":"2020-01-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}