{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T14:41:59Z","timestamp":1780324919018,"version":"3.54.1"},"reference-count":103,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T00:00:00Z","timestamp":1683590400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Many Explainable AI (XAI) systems provide explanations that are just clues or hints about the computational models-Such things as feature lists, decision trees, or saliency images. However, a user might want answers to deeper questions such as <jats:italic>How does it work?, Why did it do that instead of something else? What things can it get wrong?<\/jats:italic> How might XAI system developers evaluate existing XAI systems with regard to the depth of support they provide for the user's sensemaking? How might XAI system developers shape new XAI systems so as to support the user's sensemaking? What might be a useful conceptual terminology to assist developers in approaching this challenge?<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>Based on cognitive theory, a scale was developed reflecting depth of explanation, that is, the degree to which explanations support the user's sensemaking. The seven levels of this scale form the Explanation Scorecard.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results and discussion<\/jats:title><jats:p>The Scorecard was utilized in an analysis of recent literature, showing that many systems still present low-level explanations. The Scorecard can be used by developers to conceptualize how they might extend their machine-generated explanations to support the user in developing a mental model that instills appropriate trust and reliance. The article concludes with recommendations for how XAI systems can be improved with regard to the cognitive considerations, and recommendations regarding the manner in which results on the evaluation of XAI systems are reported.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fcomp.2023.1114806","type":"journal-article","created":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T05:43:59Z","timestamp":1683611039000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Evaluating machine-generated explanations: a \u201cScorecard\u201d method for XAI measurement science"],"prefix":"10.3389","volume":"5","author":[{"given":"Robert R.","family":"Hoffman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohammadreza","family":"Jalaeian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Connor","family":"Tate","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gary","family":"Klein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shane T.","family":"Mueller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,5,9]]},"reference":[{"key":"B1","unstructured":"AbdollahiB.\n            NasraouiO.\n          Explainable Restricted Boltzmann Machines for Collaborative Filtering2016"},{"key":"B2","doi-asserted-by":"publisher","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking inside the black-box: a survey on explainable artificial intelligence","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"key":"B3","unstructured":"\u201cSanity checks for saliency maps,\u201dp. 95259536\n            AdebayoJ.\n            GilmerJ.\n            MuellyM.\n            GoodfellowI.\n            HardtM.\n            KimB.\n          Proceedings of the 32nd International Conference on Neural Information Processing Systems.2018"},{"key":"B4","first-page":"2594","article-title":"\u201cCoCoX: Generating conceptual and counterfactual explanations via fault-Lines,\u201d","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Akula","year":"2020"},{"key":"B5","unstructured":"AmarasingheK.\n            RodolfaK. T.\n            JesusS.\n            ChenV.\n            BalayanV.\n            SaleiroP.\n          On the Importance of Application-Grounded Experimental Design for Evaluating Explainable AL methods2022"},{"key":"B6","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1609\/aimag.v35i4.2513","article-title":"Power to the People: the role of humans in interactive machine learning","volume":"35","author":"Amershi","year":"2014","journal-title":"AI Magazine."},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/184","article-title":"Explaining reinforcement learning to mere mortals: an empirical study","author":"Anderson","year":"2019","journal-title":"arXiv"},{"key":"B8","volume-title":"A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives.","author":"Anderson","year":"2001"},{"key":"B9","doi-asserted-by":"publisher","first-page":"e1007792","DOI":"10.1371\/journal.pcbi.1007792","article-title":"eX-plainable Artificial Intelligence (XAI) for the identification of biologically relevant gene expression patterns in longitudinal human studies, insights from obesity research","volume":"16","author":"Anguita-Ruiz","year":"2020","journal-title":"PLoS Comput. Biol."},{"key":"B10","doi-asserted-by":"publisher","first-page":"966","DOI":"10.1080\/00140130210166951","article-title":"Subjective rating scales: science or art?","volume":"45","author":"Annett","year":"2002","journal-title":"Ergonomics."},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2021.688969","article-title":"Principles and practice of explainable machine learning","author":"Belle","year":"2020","journal-title":"arXiv"},{"key":"B12","doi-asserted-by":"publisher","first-page":"p. 5","DOI":"10.1007\/1-4020-4454-2_2","article-title":"\u201cBeyond Bloom's Taxonomy: Rethinking Knowledge for the Knowledge Age,\u201d","author":"Bereiter","year":"2005","journal-title":"International Handbook of Educational Change: Fundamental Change"},{"key":"B13","unstructured":"BhattU.\n            AndrusM.\n            WellerA.\n            XiangA.\n          Machine Learning Explainability for External Stakeholders2020"},{"key":"B14","article-title":"\u201cTaxonomy of educational objectives: The classification of educational goals, by a committee of college and university examiners,\u201d","volume-title":"Handbook 1: Cognitive Domain","author":"Bloom","year":"1956"},{"key":"B15","first-page":"p. 454","article-title":"\u201cProxy tasks and subjective measures can be misleading in evaluating explainable AI systems,\u201d","volume-title":"Proceedings of the ACM International Conference on Intelligent User Interfaces","author":"Bu\u00e7inca","year":"2020"},{"key":"B16","doi-asserted-by":"crossref","unstructured":"\u201cQuod erat demonstrandum? - Toward a typology of the concept of explanation for the design of explainable AI,\u201d\n            CabitzaF.\n            CampagnerA.\n            MalgieriG.\n            NataliC.\n            ScheenbergerD.\n            StoegerK.\n          Expert systems with Applications, 313, Part 118888.2023","DOI":"10.1016\/j.eswa.2022.118888"},{"key":"B17","unstructured":"\u201cProceedings of the 20th Workshop \u201cFrom Objects to Agents,\u201dp. 105112\n            CalegariR.\n            CiattoG.\n            DellaluceJ.\n            OmiciniA.\n          Volume 2404 of the CEUR Workshop Proceedings2019"},{"key":"B18","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1207\/s1532690xci2304_4","article-title":"The role of encoding in the self-explanation effect.\u201d","volume":"23","author":"Calin-Jageman","year":"2005","journal-title":"Cogn. Instr."},{"key":"B19","doi-asserted-by":"publisher","first-page":"1064","DOI":"10.1145\/48529.48531","article-title":"Learning by doing with simulated intelligent help","volume":"31","author":"Carroll","year":"1988","journal-title":"Commun. ACM."},{"key":"B20","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-62466-8_15","article-title":"\u201cExplanation ontology: a model of explanations for user-centered AI,\u201d","volume-title":"The Semantic Web \u2013 ISWC 2020","author":"Chari","year":"2020"},{"key":"B21","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1109\/TVCG.2021.3114836","article-title":"Vbridge: Connecting the dots between features and data to explain healthcare models","volume":"28","author":"Cheng","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"B22","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1207\/s15327809jls0101_4","article-title":"The content of physics self-explanations","volume":"1","author":"Chi","year":"1991","journal-title":"J. Learn. Sci."},{"key":"B23","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1109\/MCG.2018.042731661","article-title":"Visual analytics for explainable deep learning","volume":"38","author":"Choo","year":"2018","journal-title":"IEEE Comput. Graph. Appl."},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1002\/ail2.53","article-title":"Methods and standards for research on explainable artificial intelligence: lessons from Intelligent Tutoring Systems","author":"Clancey","year":"2022","journal-title":"Applied AI Letters downloaded"},{"key":"B25","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/BF00988593","article-title":"Grounded theory research: procedures, canons, and evaluative criteria","volume":"13","author":"Corbin","year":"1990","journal-title":"Qual. Sociol."},{"key":"B26","first-page":"1","article-title":"Explaining by removing: a unified framework for model explanations","volume":"22","author":"Covert","year":"2021","journal-title":"J. Machine Learn. Res."},{"key":"B27","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1037\/0096-3445.104.3.268","article-title":"Depth of processing and the retention of words in episodic memory","volume":"104","author":"Craik","year":"1975","journal-title":"J. Exp. Psychol: General."},{"key":"B28","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1016\/S0022-5371(72)80001-X","article-title":"Levels of processing: a framework for memory research","volume":"11","author":"Craik","year":"1972","journal-title":"J. Verbal Learning Verbal Behav."},{"key":"B29","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7304.001.0001","volume-title":"Working Minds: A Practitioner's Guide to cognitive task analysis.","author":"Crandall","year":"2006"},{"key":"B30","unstructured":"\u201cAnalytics and the EU courts: the case of trademark disputes,\u201d\n            DahanS.\n          Hart PublishingThe changing European Union: A critical view on the role of the courts2020"},{"key":"B31","author":"David","year":"2012","journal-title":"Explainable AI and Adoption of Algorithmic Advisors: An Experimental Study."},{"key":"B32","unstructured":"Explainable AI Program. DARPA-BAA-16-53, Dr. Matt Turek, Program Manager. Arlington, VA: U.S. Defense Advanced Research Projects Agency2018"},{"key":"B33","doi-asserted-by":"publisher","first-page":"94","DOI":"10.18820\/2519593X\/pie.v36i1.7","article-title":"Inter-rater agreement in assigning cognitive demand to life sciences examination questions","volume":"36","author":"Dempster","year":"2018","journal-title":"Persp. Educ."},{"key":"B34","doi-asserted-by":"crossref","first-page":"p. 275","DOI":"10.1145\/3301275.3302310","article-title":"\u201cExplaining models: an empirical study of how explanations impact fairness judgment,\u201d","volume-title":"Proceedings of the 24th International Conference on Intelligent User Interfaces","author":"Dodge","year":"2019"},{"key":"B35","unstructured":"Doshi-VelezF.\n            KimB.\n          Towards a Rigorous Science of Interpretable Machine Learning2017"},{"key":"B36","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1145\/3301275.3302316","article-title":"\u201cAutomated rationale generation: a technique for explainable AI and its effects on human perceptions,\u201d","volume-title":"Proceedings of the 24th International Conference on Intelligent User Interfaces","author":"Ehsan","year":"2019"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.177\/2053951719860542","article-title":"Transparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns","volume":"6","author":"Felzmann","year":"2019","journal-title":"Big Data Soc."},{"key":"B38","doi-asserted-by":"crossref","unstructured":"GajosK. Z.\n            MamykinaL.\n          Do People Engage Cognitively With AI? Impact of AI Assistance on Incidental Learning2022","DOI":"10.1145\/3490099.3511138"},{"key":"B39","article-title":"Counterfactual visual explanations","author":"Goyal","year":"2019","journal-title":"arXiv"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3236009","article-title":"A survey of methods for explaining black box models","volume":"51","author":"Guidotti","year":"2018","journal-title":"ACM Computing Surv."},{"key":"B41","unstructured":"\u201cIntegrating learning and reasoning services for explainable information fusion,\u201d\n            HarboneD.\n            WillisC.\n            TomsettR.\n            PreeceA.\n          Proceedings of the 1st International Conference on Pattern Recognition and Artificial Intelligence2018"},{"key":"B42","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1007\/s10462-016-9505-7","article-title":"Evaluation in artificial intelligence: From task-oriented to ability-oriented measurement","volume":"48","author":"Hernandez-Orallo","year":"2017","journal-title":"Artif. Intell. Rev."},{"key":"B43","doi-asserted-by":"crossref","unstructured":"HindM.\n            WeiD.\n            CampbellM.\n            CodellaN. C. F.\n            DhurandharA.\n            MojsilovicA.\n          TED: Teaching AI to Explain its Decisions2019","DOI":"10.1145\/3306618.3314273"},{"key":"B44","unstructured":"HoffmanR. H.\n            KleinG.\n            MuellerS. T.\n            JalaeianM.\n            TateC.\n          The Stakeholder Playbook. Technical Report, DARPA Explainable AI Program2021"},{"key":"B45","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4613-9733-5","volume-title":"The Psychology of Expertise: Cognitive Research and Empirical AI","author":"Hoffman","year":"1992"},{"key":"B46","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1518\/001872098779480442","article-title":"A case study in cognitive task analysis methodology: the Critical Decision Method for the elicitation of expert knowledge","volume":"40","author":"Hoffman","year":"1998","journal-title":"Hum. Factors"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1096257","DOI":"10.3389\/fcomp.2023.1096257","article-title":"Measures for explainable AI: Explanation goodness, User satisfaction, mental models, curiosity, trust and human-AI performance","volume":"5","author":"Hoffman","year":"2023","journal-title":"Front. Comput. Sci."},{"key":"B48","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1109\/VISUAL.2019.8933695","article-title":"\u201cTeleGam: Combining visualization and verbalization for interpretable machine learning,\u201d","author":"Hohman","year":"2019","journal-title":"Presentation at the 2019 IEEE Visualization Conference"},{"key":"B49","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/s13218-020-00636-z","article-title":"Measuring the quality of explanations","volume":"34","author":"Holzinger","year":"2020","journal-title":"KI-K\u00fcnstliche Intell."},{"key":"B50","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1111\/1467-6303.00048","article-title":"An empirical model of the information systems development process: a case study of an automotive manufacturer","volume":"24","author":"Hughes","year":"2000","journal-title":"Accounting Forum."},{"key":"B51","doi-asserted-by":"crossref","DOI":"10.1145\/3442188.3445941","article-title":"\u201cHow can I choose an explainer? An application-grounded evaluation of post-hoc explanations.,\u201d","volume-title":"Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency.","author":"Jesus","year":"2021"},{"key":"B52","unstructured":"\u201cReasoning explanation capability of expert system a new framework for explanation,\u201dp. 836838\n            JinggeW.\n          Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics1988"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.22541\/au.163284810.09140868\/v1","article-title":"Qualitative investigation in Explainable Artificial Intelligence: a bit more insight from social science","author":"Johs","year":"2020","journal-title":"arXiv"},{"key":"B54","unstructured":"\u201cInterpreting Interpretability: understanding Data Scientists' Use of Interpretability Tools for Machine Learning,\u201d\n            KaurH.\n            NoriH.\n            JenkinsS.\n            CaruanaR.\n            WallachH.\n            WortmanV. J.\n          Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems2020"},{"key":"B55","first-page":"11575","article-title":"\u201cOn generating plausible counterfactuals and semi-factual explanations for deep learning,\u201d","volume-title":"Proceedings of The Thirty-Fifth AAAI Conference on Artificial Intelligence","author":"Kenny","year":"2009"},{"key":"B56","unstructured":"\u201cExamples are not enough, learn to criticize! criticism for,\u201d22882296\n            KimB.\n            KhannaR.\n            KoyejoO. O.\n          New York, NYAssociation for Computing MachineryProceedings of the 30th Annual Conference on Neural Information Processing Systems, NIPS 20162016"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1002\/ail2.56","article-title":"Toward explainable and advisable model for self-driving cars","author":"Kim","year":"2021","journal-title":"Applied AI Letters"},{"key":"B58","unstructured":"\u201cThe Scorecard for Self-Explaining Capabilities of AI Systems,\u201d\n            KleinG.\n            HoffmanR. R.\n            MuellerS. T.\n          Technical Report from Task Area 2, DARPA XAI Program2020"},{"key":"B59","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1177\/15553434211045154","article-title":"Modeling the process by which people try to explain complex things to others","volume":"15","author":"Klein","year":"2021","journal-title":"J. Cognitive Eng. Decis. Making."},{"key":"B60","doi-asserted-by":"publisher","first-page":"1380","DOI":"10.1177\/0018720814530427","article-title":"Influencing preferences for different types of causal explanation for complex events","volume":"56","author":"Klein","year":"2014","journal-title":"Hum. Factors."},{"key":"B61","first-page":"1885","article-title":"\u201cUnderstanding black-box predictions via influence functions,\u201d","volume-title":"Proceedings of ICML 17: The 34th International Conference on Machine Learning, Volume 70","author":"Koh","year":"2017"},{"key":"B62","unstructured":"\u201cUsing visual analytics to interpret predictive machine learning models,\u201d\n            KrauseJ.\n            PererA.\n            BertiniE.\n          Presentation at the International Conference on Machine Learning: Workshop on Human Interpretability in Machine Learning2016"},{"key":"B63","article-title":"\u201cAn evaluation of the human-interpretability of explanation,\u201d","volume-title":"Proceedings of the 32nd Conference on Neural Information Processing Systems (NIPS 2018)","author":"Lage","year":"2019"},{"key":"B64","doi-asserted-by":"crossref","DOI":"10.1145\/3313831.3376590","article-title":"\u201cQuestioning the AI: Informing design practices for explainable Ai user experiences,\u201d","volume-title":"Proceedings of the ACM\/CHI Conference on Human Factors in Computing Systems","author":"Liao","year":"2020"},{"key":"B65","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1017\/S1358246100005130","article-title":"Contrastive explanation","volume":"27","author":"Lipton","year":"1990","journal-title":"R. Inst. Philos. Suppl."},{"key":"B66","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1016\/j.visinf.2017.01.006","article-title":"Towards better analysis of machine learning models: a visual analytics perspective","volume":"1","author":"Liu","year":"2017","journal-title":"Visual Infor."},{"key":"B67","doi-asserted-by":"publisher","first-page":"748","DOI":"10.1016\/j.tics.2016.08.001","article-title":"Explanatory preferences shape learning and inference","volume":"20","author":"Lombrozo","year":"2016","journal-title":"Trends Cogn. Sci."},{"key":"B68","doi-asserted-by":"publisher","first-page":"4768","DOI":"10.5555\/3295222.3295230","article-title":"\u201cA unified approach to interpreting model predictions,\u201d","author":"Lundberg","year":"2017","journal-title":"Proceedings of Advances in Neural Information Processing Systems 30 (NIPS 2017)"},{"key":"B69","author":"Marzano","year":"2007","journal-title":"The New Taxonomy of Educational Objectives"},{"key":"B70","unstructured":"MillerT.\n          Explanation in Artificial Intelligence: Insights From the Social Sciences2017"},{"key":"B71","article-title":"Contrastive explanation: a structural-model approach","author":"Miller","year":"2018","journal-title":"arXiv"},{"key":"B72","volume-title":"The Subjective Side of Science","author":"Mitroff","year":"1974"},{"key":"B73","article-title":"A multidisciplinary survey and framework for design and evaluation of explainable AI Systems","author":"Mohseni","year":"2020","journal-title":"arXiv"},{"key":"B74","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1111\/j.1741-5446.1982.tb00981.x","article-title":"Reconsidering bloom's taxonomy of educational objectives: cognitive domain","volume":"32","author":"Moore","year":"1982","journal-title":"Educ. Theory"},{"key":"B75","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1177\/001872089203400406","article-title":"Selecting performance measures: \u201cobjective\u201d versus \u201csubjective\u201d measurement","volume":"34","author":"Muckler","year":"1992","journal-title":"Hum. Factors."},{"key":"B76","volume-title":"Explanation in Human-AI Systems: A Literature Meta-Review, Synopsis of Key Ideas and Publications and Bibliography for Explainable AI","author":"Mueller","year":"2019"},{"key":"B77","doi-asserted-by":"crossref","first-page":"p. 204","DOI":"10.1007\/978-3-319-91122-9_18","article-title":"\u201cUsing perceptual and cognitive explanations for enhanced human-agent team performance,\u201d","author":"Neerincx","year":"2018","journal-title":"Proceedings of the International Conference on Engineering Psychology and Cognitive Ergonomics"},{"key":"B78","unstructured":"PetsiukV.\n            DasA.\n            SaenkoK.\n          RISE: Randomized Input Sampling for Explanation of Black-box Models2018"},{"key":"B79","doi-asserted-by":"crossref","first-page":"p. 1","DOI":"10.1109\/FUZZ-IEEE.2018.8491538","article-title":"\u201cLearning fuzzy relations and properties for explainable artificial intelligence,\u201d","volume-title":"Proceedings of 2018 IEEE International Conference on Fuzzy Systems","author":"Pierrard","year":"2018"},{"key":"B80","unstructured":"\u201cA new approach for explainable multiple organ annotation with few data,\u201d101107\n            PierrardR.\n            PoliJ. P.\n            HudelotC.\n          Somerset, NJInternational Joint Conferences on Artificial IntelligenceProceedings of the IJCAI 2019 Workshop on Explainable AI2019"},{"key":"B81","unstructured":"\u201cManipulating and measuring model interpretability,\u201d152\n            Poursabzi-SangdehF.\n            GoldsteinD. G.\n            HofmanJ. M.\n            VaughanJ. W.\n            WallachH.\n          New YorkAssociation for Computing MachineryProceedings of the 2021 CHI conference on Human Factors in Computing Systems2021"},{"key":"B82","unstructured":"PreeceA.\n            HarborneD.\n            BrainesD.\n            TomsettR.\n            ChakrabortyS.\n          Stakeholders in Explainable AI2018"},{"key":"B83","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/j.1467-8624.2006.00852.x","article-title":"Promoting transfer: Effects of self-explanation and direct instruction","volume":"77","author":"Rittle-Johnson","year":"2006","journal-title":"Child Dev."},{"key":"B84","doi-asserted-by":"crossref","unstructured":"RussellC.\n          Efficient Search for Diverse Coherent Explanations2019","DOI":"10.1145\/3287560.3287569"},{"key":"B85","unstructured":"Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models3948\n            SamekW.\n            WiegandT.\n            M\u00fcllerK. R.\n          Int. Telecommun. J. ICT Discover.12017"},{"key":"B86","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s13218-018-0559-3","article-title":"Defining explainable AI for requirements analysis","volume":"32","author":"Sheh","year":"2018","journal-title":"KI - K\u00fcnstliche Intelligenz."},{"key":"B87","unstructured":"\u201cPrograms as black-box explanations,\u201d\n            SinghS.\n            RibeiroM. T.\n            GuestrinC.\n          New York, NYAssociation for Computing MachineryPresentation at the Conference on Neural Information Processing Systems, 1st Workshop on Neural Abstract Machines & Program Induction (NAMPI)2016"},{"key":"B88","doi-asserted-by":"publisher","first-page":"e54","DOI":"10.1002\/ail2.15","article-title":"Explaining Autonomous Drones: An XAI Journey","volume":"2","author":"Stefik","year":"2021","journal-title":"Appl. AI Lett"},{"key":"B89","unstructured":"SugrueB.\n          33065290Problems with Bloom's Taxonomy. Performance Express2002"},{"key":"B90","unstructured":"\u201cA survey on explainable Artificial Intelligence (XAI): Toward medical XAI,\u201d\n            TjoaE.\n            GuanC.\n          33079674IEEE Transactions on Neural Networks and Learning Systems2020"},{"key":"B91","article-title":"\u201cInterpretable to whom? A role-based model for analyzing interpretable machine learning systems,\u201d","author":"Tomsett","year":"2018","journal-title":"Proceedings of the 2018 ICML workshop on Human Interpretability in Machine Learning (WHI 2018)."},{"key":"B92","unstructured":"\u201cIntegrating an Adjusted Conversational Agent into a Mobile-Assisted Language Learning Application,\u201d\n            TroussasC.\n            KrouskaA.\n            VirvouM.\n          Proceedings of the IEEE 29th International Conference on Tools with Artificial Intelligence.2017"},{"key":"B93","doi-asserted-by":"publisher","first-page":"1940005","DOI":"10.1142\/S0218213019400050","article-title":"MACE: mobile artificial conversational entity for adapting domain knowledge and generating personalized advice","volume":"28","author":"Troussas","year":"2019","journal-title":"Int. J Artif. Intell. Tools."},{"key":"B94","doi-asserted-by":"publisher","DOI":"10.1109\/MLSP.2016.7738872","article-title":"A model explanation system: Latest updates and extensions","author":"Turner","year":"2016","journal-title":"arXiv"},{"key":"B95","doi-asserted-by":"publisher","first-page":"e41","DOI":"10.1002\/ail2.41","article-title":"Explainable, interactive content-based image retrieval","volume":"2","author":"Vasu","year":"2021","journal-title":"Appl. AI Lett."},{"key":"B96","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2006.00093","author":"Vilone","year":"2020","journal-title":"Explainable Artificial Intelligence: A Systematic Review."},{"key":"B97","unstructured":"\u201cBayesian teaching of image categories,\u201d\n            VongW. K.\n            SojitraR. B.\n            ReyesA.\n            YangS. C.\n            ShaftoP.\n          Proceedings of the 40th Annual Conference of the Cognitive Science Society.2018"},{"key":"B98","doi-asserted-by":"publisher","first-page":"841","DOI":"10.2139\/ssrn.3063289","article-title":"Counter-factual explanations without opening the black box: automated decisions and the GDPR","volume":"31","author":"Wachter","year":"2017","journal-title":"Harvard J Law Technol."},{"key":"B99","doi-asserted-by":"crossref","DOI":"10.1145\/3290605.3300831","article-title":"\u201cDesigning theory-driven user-centric explainable AI,\u201d","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems.","author":"Wang","year":"2019"},{"key":"B100","unstructured":"\u201cWhen, where and how does it fail? A Spatial-temporal visual analytics approach for interpretable object detection in autonomous driving,\u201d\n            WangJ.\n            LiY.\n            ZhouZ.\n            WangC.\n            HouY.\n            ZhangL.\n          36040948IEEE Transactions on Visualization and Computer Graphics2022"},{"key":"B101","unstructured":"WhiteA.\n            GarcezA.d'A.\n          Counterfactual Instances Explain Little2021"},{"key":"B102","first-page":"409","article-title":"\u201cClose-To-Practice: Qualitative research methods,\u201d","volume-title":"The Oxford Handbook of Expertise","author":"Yardley","year":"2020"},{"key":"B103","first-page":"10935","article-title":"\u201cOn the (in)fidelity and sensitivity of explanations,\u201d","volume-title":"Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019)","author":"Yeh","year":"2019"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1114806\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T05:44:36Z","timestamp":1683611076000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1114806\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,9]]},"references-count":103,"alternative-id":["10.3389\/fcomp.2023.1114806"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2023.1114806","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,9]]},"article-number":"1114806"}}