{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T19:34:53Z","timestamp":1784921693138,"version":"3.55.0"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,2,14]],"date-time":"2023-02-14T00:00:00Z","timestamp":1676332800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,14]],"date-time":"2023-02-14T00:00:00Z","timestamp":1676332800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["2017\/27\/B\/ST6\/01307"],"award-info":[{"award-number":["2017\/27\/B\/ST6\/01307"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["NCN Sonata Bis-9 grant 2019\/34\/E\/ST6\/00052"],"award-info":[{"award-number":["NCN Sonata Bis-9 grant 2019\/34\/E\/ST6\/00052"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Min Knowl Disc"],"published-print":{"date-parts":[[2024,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The growing need for in-depth analysis of predictive models leads to a series of new methods for explaining their local and global properties. Which of these methods is the best? It turns out that this is an ill-posed question. One cannot sufficiently explain a black-box machine learning model using a single method that gives only one perspective. Isolated explanations are prone to misunderstanding, leading to wrong or simplistic reasoning. This problem is known as the <jats:italic>Rashomon effect<\/jats:italic> and refers to diverse, even contradictory, interpretations of the same phenomenon. Surprisingly, most methods developed for explainable and responsible machine learning focus on a single-aspect of the model behavior. In contrast, we showcase the problem of explainability as an interactive and sequential analysis of a model. This paper proposes how different Explanatory Model Analysis (EMA) methods complement each other and discusses why it is essential to juxtapose them. The introduced process of Interactive EMA (IEMA) derives from the algorithmic side of explainable machine learning and aims to embrace ideas developed in cognitive sciences. We formalize the grammar of IEMA to describe human-model interaction. It is implemented in a widely used human-centered open-source software framework that adopts interactivity, customizability and automation as its main traits. We conduct a user study to evaluate the usefulness of IEMA, which indicates that an interactive sequential analysis of a model may increase the accuracy and confidence of human decision making.<\/jats:p>","DOI":"10.1007\/s10618-023-00924-w","type":"journal-article","created":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T05:48:08Z","timestamp":1676612888000},"page":"2596-2632","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["The grammar of interactive explanatory model analysis"],"prefix":"10.1007","volume":"38","author":[{"given":"Hubert","family":"Baniecki","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dariusz","family":"Parzych","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8423-1823","authenticated-orcid":false,"given":"Przemyslaw","family":"Biecek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,2,14]]},"reference":[{"key":"924_CR1","unstructured":"ACM US Public Policy Council (2017) Statement on algorithmic transparency and accountability. https:\/\/www.acm.org\/binaries\/content\/assets\/public-policy\/2017_usacm_statement_algorithms.pdf"},{"key":"924_CR2","doi-asserted-by":"publisher","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","volume":"6","author":"A Adadi","year":"2018","unstructured":"Adadi A, Berrada M (2018) Peeking inside the black-box: a survey on Explainable Artificial Intelligence (XAI). IEEE Access 6:52138\u201352160","journal-title":"IEEE Access"},{"key":"924_CR3","unstructured":"Adebayo J, Muelly M, Liccardi I, Kim B (2020) Debugging tests for model explanations. In: Conference on Neural Information Processing Systems (NeurIPS), vol 33, pp 700\u2013712"},{"issue":"93","key":"924_CR4","first-page":"1","volume":"20","author":"M Alber","year":"2019","unstructured":"Alber M, Lapuschkin S, Seegerer P, H\u00e4gele M, Sch\u00fctt KT, Montavon G, Samek W, M\u00fcller KR, D\u00e4hne S, Kindermans PJ (2019) iNNvestigate neural networks! J Mach Learn Res 20(93):1\u20138","journal-title":"J Mach Learn Res"},{"issue":"4","key":"924_CR5","doi-asserted-by":"publisher","first-page":"1059","DOI":"10.1111\/rssb.12377","volume":"82","author":"DW Apley","year":"2020","unstructured":"Apley DW, Zhu J (2020) Visualizing the effects of predictor variables in black box supervised learning models. J R Stat Soc Ser B (Stat Methodol) 82(4):1059\u20131086","journal-title":"J R Stat Soc Ser B (Stat Methodol)"},{"issue":"130","key":"924_CR6","first-page":"1","volume":"21","author":"V Arya","year":"2020","unstructured":"Arya V, Bellamy RKE, Chen PY, Dhurandhar A, Hind M, Hoffman SC, Houde S, Liao QV, Luss R, Mojsilovi\u0107 A, Mourad S, Pedemonte P, Raghavendra R, Richards JT, Sattigeri P, Shanmugam K, Singh M, Varshney KR, Wei D, Zhang Y (2020) AI explainability 360: an extensible toolkit for understanding data and machine learning models. J Mach Learn Res 21(130):1\u20136","journal-title":"J Mach Learn Res"},{"issue":"61","key":"924_CR7","first-page":"1803","volume":"11","author":"D Baehrens","year":"2010","unstructured":"Baehrens D, Schroeter T, Harmeling S, Kawanabe M, Hansen K, M\u00fcller KR (2010) How to explain individual classification decisions. J Mach Learn Res 11(61):1803\u20131831","journal-title":"J Mach Learn Res"},{"key":"924_CR8","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1038\/533452a","volume":"533","author":"M Baker","year":"2016","unstructured":"Baker M (2016) Is there a reproducibility crisis? Nature 533:452\u2013454","journal-title":"Nature"},{"issue":"43","key":"924_CR9","doi-asserted-by":"publisher","first-page":"1798","DOI":"10.21105\/joss.01798","volume":"4","author":"H Baniecki","year":"2019","unstructured":"Baniecki H, Biecek P (2019) modelStudio: interactive studio with explanations for ML predictive models. J Open Source Softw 4(43):1798","journal-title":"J Open Source Softw"},{"issue":"18","key":"924_CR10","first-page":"15755","volume":"35","author":"H Baniecki","year":"2021","unstructured":"Baniecki H, Biecek P (2021) Responsible prediction making of COVID-19 mortality (student abstract). AAAI Conf Artif Intell (AAAI) 35(18):15755\u201315756","journal-title":"AAAI Conf Artif Intell (AAAI)"},{"key":"924_CR11","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","volume":"58","author":"A Barredo Arrieta","year":"2020","unstructured":"Barredo Arrieta A, D\u00edaz-Rodr\u00edguez N, Del Ser J, Bennetot A, Tabik S, Barbado A, Garcia S, Gil-Lopez S, Molina D, Benjamins R, Chatila R, Herrera F (2020) Explainable Artificial Intelligence (XAI): concepts, taxonomies, opportunities and challenges toward responsible AI. Inf Fusion 58:82\u2013115","journal-title":"Inf Fusion"},{"key":"924_CR12","doi-asserted-by":"crossref","unstructured":"Bhatt U, Xiang A, Sharma S, Weller A, Taly A, Jia Y, Ghosh J, Puri R, Moura JMF, Eckersley P (2020) Explainable machine learning in deployment. In: ACM conference on Fairness, Accountability, and Transparency (ACM FAccT), pp 648\u2013657","DOI":"10.1145\/3351095.3375624"},{"issue":"84","key":"924_CR13","first-page":"1","volume":"19","author":"P Biecek","year":"2018","unstructured":"Biecek P (2018) DALEX: explainers for complex predictive models in R. J Mach Learn Res 19(84):1\u20135","journal-title":"J Mach Learn Res"},{"key":"924_CR14","doi-asserted-by":"publisher","DOI":"10.1201\/9780429027192","volume-title":"Explanatory model analysis","author":"P Biecek","year":"2021","unstructured":"Biecek P, Burzykowski T (2021) Explanatory model analysis. Chapman and Hall"},{"issue":"3","key":"924_CR15","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1214\/ss\/1009213726","volume":"16","author":"L Breiman","year":"2001","unstructured":"Breiman L (2001) Statistical modeling: the two cultures. Stat Sci 16(3):199\u2013231","journal-title":"Stat Sci"},{"key":"924_CR16","doi-asserted-by":"publisher","first-page":"75","DOI":"10.3389\/frai.2020.507973","volume":"3","author":"S Bruckert","year":"2020","unstructured":"Bruckert S, Finzel B, Schmid U (2020) The next generation of medical decision support: a roadmap toward transparent expert companions. Front Artif Intell 3:75","journal-title":"Front Artif Intell"},{"key":"924_CR17","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1109\/TIT.1956.1056813","volume":"2","author":"N Chomsky","year":"1956","unstructured":"Chomsky N (1956) Three models for the description of language. IRE Trans Inf Theory 2:113\u2013124","journal-title":"IRE Trans Inf Theory"},{"issue":"5\u20136","key":"924_CR18","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1080\/07370024.2020.1744146","volume":"35","author":"MD Choudhury","year":"2020","unstructured":"Choudhury MD, Lee MK, Zhu H, Shamma DA (2020) Introduction to this special issue on unifying human computer interaction and artificial intelligence. Hum-Comput Interact 35(5\u20136):355\u2013361","journal-title":"Hum-Comput Interact"},{"key":"924_CR19","doi-asserted-by":"crossref","unstructured":"Eiband M, Schneider H, Bilandzic M, Fazekas-Con J, Haug M, Hussmann H (2018) Bringing transparency design into practice. In: International Conference on Intelligent User Interfaces (IUI), pp 211\u2013223","DOI":"10.1145\/3172944.3172961"},{"key":"924_CR20","unstructured":"European Commission (2020) White paper on artificial intelligence: a European approach to excellence and trust. https:\/\/ec.europa.eu\/info\/publications\/white-paper-artificial-intelligence-european-approach-excellence-and-trust"},{"key":"924_CR21","doi-asserted-by":"crossref","unstructured":"Feldman M, Friedler SA, Moeller J, Scheidegger C, Venkatasubramanian S (2015) Certifying and removing disparate impact. In: ACM SIGKDD international conference on Knowledge Discovery and Data Mining (KDD), pp 259\u2014268","DOI":"10.1145\/2783258.2783311"},{"issue":"177","key":"924_CR22","first-page":"1","volume":"20","author":"A Fisher","year":"2019","unstructured":"Fisher A, Rudin C, Dominici F (2019) All models are wrong, but many are useful: learning a variable\u2019s importance by studying an entire class of prediction models simultaneously. J Mach Learn Res 20(177):1\u201381","journal-title":"J Mach Learn Res"},{"issue":"5","key":"924_CR23","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1214\/aos\/1013203451","volume":"29","author":"JH Friedman","year":"2001","unstructured":"Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 29(5):1189\u20131232","journal-title":"Ann Stat"},{"issue":"4","key":"924_CR24","doi-asserted-by":"publisher","first-page":"853","DOI":"10.1007\/s10994-019-05856-5","volume":"109","author":"J F\u00fcrnkranz","year":"2020","unstructured":"F\u00fcrnkranz J, Kliegr T, Paulheim H (2020) On cognitive preferences and the plausibility of rule-based models. Mach Learn 109(4):853\u2013898","journal-title":"Mach Learn"},{"issue":"3","key":"924_CR25","doi-asserted-by":"publisher","first-page":"137","DOI":"10.3390\/info11030137","volume":"11","author":"N Gill","year":"2020","unstructured":"Gill N, Hall P, Montgomery K, Schmidt N (2020) A responsible machine learning workflow with focus on interpretable models, post-hoc explanation, and discrimination testing. Information 11(3):137","journal-title":"Information"},{"key":"924_CR26","unstructured":"Golhen Y, Bidault S, Lagre Y, Gendre M (2021) shapash: a Python library which aims to make machine learning interpretable and understandable by everyone. https:\/\/github.com\/MAIF\/shapash, v1.2.0"},{"issue":"3","key":"924_CR27","first-page":"50","volume":"38","author":"B Goodman","year":"2017","unstructured":"Goodman B, Flaxman S (2017) European Union regulations on algorithmic decision-making and a \u201cRight to Explanation\". AI Mag 38(3):50\u201357","journal-title":"AI Mag"},{"key":"924_CR28","unstructured":"Google, Tang Y (2020) TensorBoard. https:\/\/github.com\/tensorflow\/tensorboard, v2.1.0"},{"issue":"1","key":"924_CR29","doi-asserted-by":"publisher","first-page":"421","DOI":"10.32614\/RJ-2017-016","volume":"9","author":"BM Greenwell","year":"2017","unstructured":"Greenwell BM (2017) pdp: an R package for constructing partial dependence plots. R Journal 9(1):421\u2013436","journal-title":"R Journal"},{"issue":"1","key":"924_CR30","doi-asserted-by":"publisher","first-page":"343","DOI":"10.32614\/RJ-2020-013","volume":"12","author":"BM Greenwell","year":"2020","unstructured":"Greenwell BM, Boehmke BC (2020) Variable importance plots\u2014an introduction to the vip package. R Journal 12(1):343\u2013366","journal-title":"R Journal"},{"key":"924_CR31","unstructured":"Hall P, Gill N, Kurka M, Phan W (2019) Machine learning interpretability with H2O driverless AI. http:\/\/docs.h2o.ai, v1.8.0"},{"key":"924_CR32","unstructured":"Hoffman RR, Mueller ST, Klein G, Litman J (2018) Metrics for explainable AI: challenges and prospects. arXiv preprint, arXiv:1812.04608"},{"issue":"8","key":"924_CR33","doi-asserted-by":"publisher","first-page":"2674","DOI":"10.1109\/TVCG.2018.2843369","volume":"25","author":"F Hohman","year":"2018","unstructured":"Hohman F, Kahng M, Pienta R, Chau DH (2018) Visual analytics in deep learning: an interrogative survey for the next frontiers. IEEE Trans Visual Comput Graph 25(8):2674\u20132693","journal-title":"IEEE Trans Visual Comput Graph"},{"key":"924_CR34","doi-asserted-by":"crossref","unstructured":"Hoover B, Strobelt H, Gehrmann S (2020) exBERT: a visual analysis tool to explore learned representations in transformer models. In: Annual meeting of the Association for Computational Linguistics: System Demonstrations (ACL), pp 187\u2013196","DOI":"10.18653\/v1\/2020.acl-demos.22"},{"key":"924_CR35","doi-asserted-by":"crossref","unstructured":"Jesus S, Bel\u00e9m C, Balayan V, Bento J, Saleiro P, Bizarro P, Gama J (2021) How can I choose an explainer? An application-grounded evaluation of post-hoc explanations. In: ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT), pp 805\u2013815","DOI":"10.1145\/3442188.3445941"},{"key":"924_CR36","doi-asserted-by":"publisher","first-page":"444","DOI":"10.2307\/420301","volume":"28","author":"G King","year":"1995","unstructured":"King G (1995) Replication, replication. Polit Sci Polit 28:444\u2013452","journal-title":"Polit Sci Polit"},{"key":"924_CR37","unstructured":"Kluyver T, Ragan-Kelley B, P\u00e9rez F, Granger B, Bussonnier M, Frederic J, Kelley K, Hamrick J, Grout J, Corlay S, Ivanov P, Avila D, Abdalla S, Willing C, development team J (2016) Jupyter Notebooks\u2014a publishing format for reproducible computational workflows. In: Positioning and power in Academic Publishing: players, agents and agendas, pp 87\u201390"},{"key":"924_CR38","doi-asserted-by":"crossref","unstructured":"Kuzba M, Biecek P (2020) What would you ask the machine learning model? ECML PKDD Workshop on eXplainable Knowledge Discovery in Data Mining (ECML XKDD), vol 1323, pp 447\u2013459","DOI":"10.1007\/978-3-030-65965-3_30"},{"issue":"523","key":"924_CR39","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1080\/01621459.2017.1307116","volume":"113","author":"J Lei","year":"2018","unstructured":"Lei J, G\u2019Sell M, Rinaldo A, Tibshirani RJ, Wasserman L (2018) Distribution-free predictive inference for regression. J Am Stat Assoc 113(523):1094\u20131111","journal-title":"J Am Stat Assoc"},{"key":"924_CR40","unstructured":"Leone S (2020) FIFA-20 dataset on Kaggle.com. https:\/\/www.kaggle.com\/stefanoleone992\/fifa-20-complete-player-dataset"},{"issue":"3","key":"924_CR41","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3236386.3241340","volume":"16","author":"ZC Lipton","year":"2018","unstructured":"Lipton ZC (2018) The mythos of model interpretability. Queue 16(3):31\u201357","journal-title":"Queue"},{"issue":"1","key":"924_CR42","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.visinf.2017.01.006","volume":"1","author":"S Liu","year":"2017","unstructured":"Liu S, Wang X, Liu M, Zhu J (2017) Towards better analysis of machine learning models: a visual analytics perspective. Visual Inform 1(1):48\u201356","journal-title":"Visual Inform"},{"key":"924_CR43","unstructured":"Lundberg SM, Lee SI (2017) A unified approach to interpreting model predictions. In: Conference on Neural Information Processing Systems (NeurIPS), vol 30, pp 4765\u20134774"},{"issue":"1","key":"924_CR44","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1038\/s42256-019-0138-9","volume":"2","author":"SM Lundberg","year":"2020","unstructured":"Lundberg SM, Erion G, Chen H, DeGrave A, Prutkin JM, Nair B, Katz R, Himmelfarb J, Bansal N, Lee SI (2020) From local explanations to global understanding with explainable AI for trees. Nat Mach Intell 2(1):56\u201367","journal-title":"Nat Mach Intell"},{"key":"924_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","volume":"267","author":"T Miller","year":"2019","unstructured":"Miller T (2019) Explanation in artificial intelligence: insights from the social sciences. Artif Intell 267:1\u201338","journal-title":"Artif Intell"},{"key":"924_CR46","unstructured":"Miller T, Howe P, Sonenberg L (2017) Explainable AI: beware of inmates running the asylum or: how I learnt to stop worrying and love the social and behavioural sciences. IJCAI Workshop on Explainable Artificial Intelligence (IJCAI XAI)"},{"key":"924_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3449213","volume":"5","author":"S Mishra","year":"2021","unstructured":"Mishra S, Rzeszotarski JM (2021) Crowdsourcing and evaluating concept-driven explanations of machine learning models. ACM Hum-Comput Interact 5:1\u201326","journal-title":"ACM Hum-Comput Interact"},{"key":"924_CR48","doi-asserted-by":"crossref","unstructured":"Mitchell M, Wu S, Zaldivar A, Barnes P, Vasserman L, Hutchinson B, Spitzer E, Raji ID, Gebru T (2019) Model cards for model reporting. In: ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT), pp 220\u2013229","DOI":"10.1145\/3287560.3287596"},{"key":"924_CR49","unstructured":"Molnar C (2020) Interpretable machine learning. Lulu"},{"key":"924_CR50","doi-asserted-by":"crossref","unstructured":"Nguyen G, Dlugolinsky S, Bob\u00e1k M, Tran V, L\u00f3pez Garc\u00eda A, Heredia I, Mal\u00edk P, Hluch? L (2019) Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey. Artif Intell Rev 52(1):77\u2013124","DOI":"10.1007\/s10462-018-09679-z"},{"key":"924_CR51","unstructured":"Nori H, Jenkins S, Koch P, Caruana R (2019) InterpretML: a unified framework for machine learning interpretability. arXiv:1909.09223"},{"key":"924_CR52","doi-asserted-by":"crossref","unstructured":"Piatyszek P, Biecek P (2021) Arena: interactive dashboard for the exploration and comparison of any machine learning models. https:\/\/arena.drwhy.ai\/docs, v0.3.0","DOI":"10.32614\/CRAN.package.arenar"},{"key":"924_CR53","doi-asserted-by":"crossref","unstructured":"Poursabzi-Sangdeh F, Goldstein DG, Hofman JM, Wortman\u00a0Vaughan JW, Wallach H (2021) Manipulating and measuring model interpretability. In: CHI conference on human factors in computing systems (CHI)","DOI":"10.1145\/3411764.3445315"},{"key":"924_CR54","volume-title":"Quasi-experimentation: a guide to design and analysis","author":"CS Reichardt","year":"2019","unstructured":"Reichardt CS (2019) Quasi-experimentation: a guide to design and analysis. Guilford Publications"},{"key":"924_CR55","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) \u201cWhy Should I Trust You?\u201d: Explaining the predictions of any classifier. In: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD), pp 1135\u20141144","DOI":"10.1145\/2939672.2939778"},{"key":"924_CR56","doi-asserted-by":"publisher","first-page":"42200","DOI":"10.1109\/ACCESS.2020.2976199","volume":"8","author":"R Roscher","year":"2020","unstructured":"Roscher R, Bohn B, Duarte MF, Garcke J (2020) Explainable machine learning for scientific insights and discoveries. IEEE Access 8:42200\u201342216","journal-title":"IEEE Access"},{"key":"924_CR57","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin C (2019) Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell 1:206\u2013215","journal-title":"Nat Mach Intell"},{"key":"924_CR58","unstructured":"Samuel SZS, Kamakshi V, Lodhi N, Krishnan NC (2021) Evaluation of saliency-based explainability method. In: ICML Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI (ICML XAI)"},{"key":"924_CR59","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1007\/s13218-020-00633-2","volume":"34","author":"U Schmid","year":"2020","unstructured":"Schmid U, Finzel B (2020) Mutual explanations for cooperative decision making in medicine. KI K\u00fcnstliche Intelligenz 34:227\u2013233","journal-title":"KI K\u00fcnstliche Intelligenz"},{"key":"924_CR60","volume-title":"Experimental and quasi-experimental designs for generalized causal inference","author":"WR Shadish","year":"2002","unstructured":"Shadish WR, Cook TD, Campbell DT (2002) Experimental and quasi-experimental designs for generalized causal inference. Houghton, Mifflin and Company"},{"issue":"2","key":"924_CR61","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1007\/s13218-020-00637-y","volume":"34","author":"K Sokol","year":"2020","unstructured":"Sokol K, Flach P (2020) One explanation does not fit all. KI K\u00fcnstliche Intelligenz 34(2):235\u2013250","journal-title":"KI K\u00fcnstliche Intelligenz"},{"issue":"1","key":"924_CR62","first-page":"1064","volume":"26","author":"T Spinner","year":"2019","unstructured":"Spinner T, Schlegel U, Sch\u00e4fer H, El-Assady M (2019) explAIner: a visual analytics framework for interactive and explainable machine learning. IEEE Trans Visual Comput Graph 26(1):1064\u20131074","journal-title":"IEEE Trans Visual Comput Graph"},{"key":"924_CR63","doi-asserted-by":"crossref","unstructured":"Srinivasan R, Chander A (2020) Explanation perspectives from the cognitive sciences\u2014a survey. In: International Joint Conference on Artificial Intelligence (IJCAI), pp 4812\u20134818","DOI":"10.24963\/ijcai.2020\/670"},{"issue":"2","key":"924_CR64","doi-asserted-by":"publisher","first-page":"395","DOI":"10.32614\/RJ-2018-072","volume":"10","author":"M Staniak","year":"2018","unstructured":"Staniak M, Biecek P (2018) Explanations of model predictions with live and breakDown packages. R Journal 10(2):395\u2013409","journal-title":"R Journal"},{"key":"924_CR65","volume-title":"Exploratory data analysis","author":"JW Tukey","year":"1977","unstructured":"Tukey JW (1977) Exploratory data analysis. Addison-Wesley"},{"key":"924_CR66","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.inffus.2021.05.009","volume":"76","author":"G Vilone","year":"2021","unstructured":"Vilone G, Longo L (2021) Notions of explainability and evaluation approaches for explainable artificial intelligence. Inf Fusion 76:89\u2013106","journal-title":"Inf Fusion"},{"key":"924_CR67","doi-asserted-by":"crossref","unstructured":"Wang D, Yang Q, Abdul A, Lim BY (2019) Designing theory-driven user-centric explainable AI. In: CHI Conference on Human Factors in Computing Systems (CHI), pp 1\u201315","DOI":"10.1145\/3290605.3300831"},{"issue":"1","key":"924_CR68","first-page":"56","volume":"26","author":"J Wexler","year":"2019","unstructured":"Wexler J, Pushkarna M, Bolukbasi T, Wattenberg M, Vi\u00e9gas F, Wilson J (2019) The what-if tool: interactive probing of machine learning models. IEEE Trans Visual Comput Graph 26(1):56\u201365","journal-title":"IEEE Trans Visual Comput Graph"},{"key":"924_CR69","volume-title":"The grammar of graphics (statistics and computing)","author":"L Wilkinson","year":"2005","unstructured":"Wilkinson L (2005) The grammar of graphics (statistics and computing). Springer"},{"key":"924_CR70","doi-asserted-by":"crossref","unstructured":"Wolf CT (2019) Explainability scenarios: towards scenario-based XAI design. In: International Conference on Intelligent User Interfaces (IUI), pp 252\u2013257","DOI":"10.1145\/3301275.3302317"},{"key":"924_CR71","volume-title":"Dynamic documents with R and knitr","author":"Y Xie","year":"2017","unstructured":"Xie Y (2017) Dynamic documents with R and knitr. Chapman and Hall"},{"issue":"5","key":"924_CR72","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1038\/s42256-020-0180-7","volume":"2","author":"L Yan","year":"2020","unstructured":"Yan L, Zhang HT, Goncalves J, Xiao Y, Wang M, Guo Y, Sun C, Tang X, Jing L, Zhang M et al (2020) An interpretable mortality prediction model for COVID-19 patients. Nat Mach Intell 2(5):283\u2013288","journal-title":"Nat Mach Intell"},{"issue":"1","key":"924_CR73","first-page":"2","volume":"19","author":"R Yu","year":"2019","unstructured":"Yu R, Al\u00ec GS (2019) What\u2019s inside the black box? AI challenges for lawyers and researchers. Leg Inf Manag 19(1):2\u201313","journal-title":"Leg Inf Manag"},{"issue":"13","key":"924_CR74","first-page":"11691","volume":"35","author":"X Zhang","year":"2021","unstructured":"Zhang X, Pang R, Ji S, Ma F, Wang T (2021) i-Algebra: towards interactive interpretability of deep neural networks. AAAI Conf Artif Intell (AAAI) 35(13):11691\u201311698","journal-title":"AAAI Conf Artif Intell (AAAI)"}],"container-title":["Data Mining and Knowledge Discovery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-023-00924-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10618-023-00924-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-023-00924-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,31]],"date-time":"2024-08-31T12:14:08Z","timestamp":1725106448000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10618-023-00924-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,14]]},"references-count":74,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,9]]}},"alternative-id":["924"],"URL":"https:\/\/doi.org\/10.1007\/s10618-023-00924-w","relation":{},"ISSN":["1384-5810","1573-756X"],"issn-type":[{"value":"1384-5810","type":"print"},{"value":"1573-756X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,14]]},"assertion":[{"value":"30 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}