{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T07:51:30Z","timestamp":1782287490780,"version":"3.54.5"},"reference-count":80,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,3,8]],"date-time":"2023-03-08T00:00:00Z","timestamp":1678233600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Italian Ministry of Health"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>The emergence of black-box, subsymbolic, and statistical AI systems has motivated a rapid increase in the interest regarding explainable AI (XAI), which encompasses both inherently explainable techniques, as well as approaches to make black-box AI systems explainable to human decision makers. Rather than always making black boxes transparent, these approaches are at risk of painting the black boxes white, thus failing to provide a level of transparency that would increase the system\u2019s usability and comprehensibility, or even at risk of generating new errors (i.e., white-box paradox). To address these usability-related issues, in this work we focus on the cognitive dimension of users\u2019 perception of explanations and XAI systems. We investigated these perceptions in light of their relationship with users\u2019 characteristics (e.g., expertise) through a questionnaire-based user study involved 44 cardiology residents and specialists in an AI-supported ECG reading task. Our results point to the relevance and correlation of the dimensions of trust, perceived quality of explanations, and tendency to defer the decision process to automation (i.e., technology dominance). This contribution calls for the evaluation of AI-based support systems from a human\u2013AI interaction-oriented perspective, laying the ground for further investigation of XAI and its effects on decision making and user experience.<\/jats:p>","DOI":"10.3390\/make5010017","type":"journal-article","created":{"date-parts":[[2023,3,8]],"date-time":"2023-03-08T03:59:32Z","timestamp":1678247972000},"page":"269-286","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Painting the Black Box White: Experimental Findings from Applying XAI to an ECG Reading Setting"],"prefix":"10.3390","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4065-3415","authenticated-orcid":false,"given":"Federico","family":"Cabitza","sequence":"first","affiliation":[{"name":"Department of Computer Science, Systems and Communication, University of Milano-Bicocca, 20126 Milan, Italy"},{"name":"IRCCS Istituto Ortopedico Galeazzi, 20161 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Campagner","sequence":"additional","affiliation":[{"name":"IRCCS Istituto Ortopedico Galeazzi, 20161 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5171-5239","authenticated-orcid":false,"given":"Chiara","family":"Natali","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Systems and Communication, University of Milano-Bicocca, 20126 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0679-828X","authenticated-orcid":false,"given":"Enea","family":"Parimbelli","sequence":"additional","affiliation":[{"name":"Department of Electric, Computer and Biomedical Engineering, University of Pavia, 27100 Pavia, Italy"},{"name":"Telfer School of Management, University of Ottawa, Ottawa, ON K1N 6N5, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2182-4511","authenticated-orcid":false,"given":"Luca","family":"Ronzio","sequence":"additional","affiliation":[{"name":"Department of Medicine and Surgery, University of Milano-Bicocca, 20126 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3872-8964","authenticated-orcid":false,"given":"Matteo","family":"Cameli","sequence":"additional","affiliation":[{"name":"Department of Medicine, Surgery and Neuroscience, University of Siena, 53100 Siena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,8]]},"reference":[{"key":"ref_1","first-page":"7","article-title":"On the integration of symbolic and sub-symbolic techniques for XAI: A survey","volume":"14","author":"Calegari","year":"2020","journal-title":"Intell. Artif."},{"key":"ref_2","unstructured":"Springer, A., Hollis, V., and Whittaker, S. (2017, January 27\u201329). Dice in the black box: User experiences with an inscrutable algorithm. Proceedings of the 2017 AAAI Spring Symposium Series, Stanford, CA, USA."},{"key":"ref_3","unstructured":"Cin\u00e0, G., R\u00f6ber, T., Goedhart, R., and Birbil, I. (2022). Why we do need Explainable AI for Healthcare. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Gerlings, J., Shollo, A., and Constantiou, I. (2020). Reviewing the need for explainable artificial intelligence (xAI). arXiv.","DOI":"10.24251\/HICSS.2021.156"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Goebel, R., Chander, A., Holzinger, K., Lecue, F., Akata, Z., Stumpf, S., Kieseberg, P., and Holzinger, A. (2018, January 27). Explainable AI: The new 42?. Proceedings of the International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Hamburg, Germany.","DOI":"10.1007\/978-3-319-99740-7_21"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"101666","DOI":"10.1016\/j.giq.2021.101666","article-title":"The perils and pitfalls of explainable AI: Strategies for explaining algorithmic decision-making","volume":"39","author":"Warnier","year":"2022","journal-title":"Gov. Inf. Q."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1177\/0894439320980118","article-title":"Will algorithms blind people? The effect of explainable AI and decision-makers\u2019 experience on AI-supported decision-making in government","volume":"40","author":"Janssen","year":"2022","journal-title":"Soc. Sci. Comput. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/3236386.3241340","article-title":"The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery","volume":"16","author":"Lipton","year":"2018","journal-title":"Queue"},{"key":"ref_9","unstructured":"Schemmer, M., K\u00fchl, N., Benz, C., and Satzger, G. (2022). On the Influence of Explainable AI on Automation Bias. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Poursabzi-Sangdeh, F., Goldstein, D.G., Hofman, J.M., Wortman Vaughan, J.W., and Wallach, H. (2021, January 8\u201313). Manipulating and measuring model interpretability. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445315"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Liao, Q.V., and Bellamy, R.K. (2020, January 27\u201330). Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, Barcelona, Spain.","DOI":"10.1145\/3351095.3372852"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M.T., and Weld, D. (2021, January 8\u201313). Does the whole exceed its parts? The effect of ai explanations on complementary team performance. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445717"},{"key":"ref_13","first-page":"1","article-title":"To trust or to think: Cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making","volume":"5","author":"Malaya","year":"2021","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Suresh, H., Lao, N., and Liccardi, I. (2020, January 6\u201310). Misplaced trust: Measuring the interference of machine learning in human decision-making. Proceedings of the 12th ACM Conference on Web Science, Southampton, UK.","DOI":"10.1145\/3394231.3397922"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Eiband, M., Buschek, D., Kremer, A., and Hussmann, H. (2019, January 4\u20139). The impact of placebic explanations on trust in intelligent systems. Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290607.3312787"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"e745","DOI":"10.1016\/S2589-7500(21)00208-9","article-title":"The false hope of current approaches to explainable artificial intelligence in health care","volume":"3","author":"Ghassemi","year":"2021","journal-title":"Lancet Digit. Health"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1007\/s13218-022-00781-7","article-title":"Generating Explanations for Conceptual Validation of Graph Neural Networks: An Investigation of Symbolic Predicates Learned on Relevance-Ranked Sub-Graphs","volume":"36","author":"Finzel","year":"2022","journal-title":"KI-K\u00fcnstl. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"118888","DOI":"10.1016\/j.eswa.2022.118888","article-title":"Quod erat demonstrandum?-Towards a typology of the concept of explanation for the design of explainable AI","volume":"213","author":"Cabitza","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Green, B., and Chen, Y. (2019, January 29\u201331). Disparate interactions: An algorithm-in-the-loop analysis of fairness in risk assessments. Proceedings of the Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA.","DOI":"10.1145\/3287560.3287563"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"102551","DOI":"10.1016\/j.ijhcs.2020.102551","article-title":"The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI","volume":"146","author":"Shin","year":"2021","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e1312","DOI":"10.1002\/widm.1312","article-title":"Causability and explainability of artificial intelligence in medicine","volume":"9","author":"Holzinger","year":"2019","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1037\/0022-3514.36.6.635","article-title":"The mindlessness of ostensibly thoughtful action: The role of \u201cplacebic\u201d information in interpersonal interaction","volume":"36","author":"Langer","year":"1978","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102696","DOI":"10.1016\/j.ijhcs.2021.102696","article-title":"The need to move away from agential-AI: Empirical investigations, useful concepts and open issues","volume":"155","author":"Cabitza","year":"2021","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Cabitza, F., Campagner, A., Famiglini, L., Gallazzi, E., and La Maida, G.A. (2022, January 23\u201326). Color Shadows (Part I): Exploratory Usability Evaluation of Activation Maps in Radiological Machine Learning. Proceedings of the International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Vienna, Austria.","DOI":"10.1007\/978-3-031-14463-9_3"},{"key":"ref_25","unstructured":"Parimbelli, E., Peek, N., Holzinger, A., Guidotti, R., Mittelstadt, B., Dagliati, A., and Nicora, G. (2022, January 27\u201330). Explainability, Causability, Causality, Reliability: The many facets of \u201cgood\u201d explanations in XAI for health. Proceedings of the Challenges of Trustable AI and Added-Value on Health, Nice, France."},{"key":"ref_26","first-page":"100033","article-title":"A review on deep learning methods for ECG arrhythmia classification","volume":"7","author":"Ebrahimi","year":"2020","journal-title":"Expert Syst. Appl. X"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Huang, J.S., Chen, B.Q., Zeng, N.Y., Cao, X.C., and Li, Y. (2020). Accurate classification of ECG arrhythmia using MOWPT enhanced fast compression deep learning networks. J. Ambient. Intell. Humaniz. Comput., 1\u201318.","DOI":"10.1007\/s12652-020-02110-y"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.ymeth.2021.04.021","article-title":"Automated ECG classification based on 1D deep learning network","volume":"202","author":"Chen","year":"2022","journal-title":"Methods"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jelectrocard.2021.07.003","article-title":"Machine learning with electrocardiograms: A call for guidelines and best practices for \u2018stress testing\u2019 algorithms","volume":"69","author":"Bond","year":"2021","journal-title":"J. Electrocardiol."},{"key":"ref_30","unstructured":"Rojat, T., Puget, R., Filliat, D., Del Ser, J., Gelin, R., and D\u00edaz-Rodr\u00edguez, N. (2021). Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Survey. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107763","DOI":"10.1016\/j.knosys.2021.107763","article-title":"Designing ECG monitoring healthcare system with federated transfer learning and explainable AI","volume":"236","author":"Raza","year":"2022","journal-title":"Knowl.-Based Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Panigutti, C., Perotti, A., and Pedreschi, D. (2020, January 27\u201330). Doctor XAI: An ontology-based approach to black-box sequential data classification explanations. Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (FAT* \u201920), Barcelona, Spain.","DOI":"10.1145\/3351095.3372855"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1038\/s41551-018-0304-0","article-title":"Explainable machine-learning predictions for the prevention of hypoxaemia during surgery","volume":"2","author":"Lundberg","year":"2018","journal-title":"Nat. Biomed. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"104393","DOI":"10.1016\/j.compbiomed.2021.104393","article-title":"Interpretable heartbeat classification using local model-agnostic explanations on ECGs","volume":"133","author":"Neves","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Dahlb\u00e4ck, N., J\u00f6nsson, A., and Ahrenberg, L. (1993, January 4\u20137). Wizard of oz studies\u2014Why and how. Proceedings of the 1993 International Workshop on Intelligent User Interfaces, Orlando, FL, USA.","DOI":"10.1016\/0950-7051(93)90017-N"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ronzio, L., Campagner, A., Cabitza, F., and Gensini, G.F. (2021). Unity Is Intelligence: A Collective Intelligence Experiment on ECG Reading to Improve Diagnostic Performance in Cardiology. J. Intell., 9.","DOI":"10.3390\/jintelligence9020017"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nourani, M., King, J., and Ragan, E. (2020, January 25\u201329). The role of domain expertise in user trust and the impact of first impressions with intelligent systems. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Hilversum, The Netherlands.","DOI":"10.1609\/hcomp.v8i1.7469"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kim, A., Yang, M., and Zhang, J. (2020). When Algorithms Err: Differential Impact of Early vs. Late Errors on Users\u2019 Reliance on Algorithms. ACM Trans. Comput.-Hum. Interact.","DOI":"10.2139\/ssrn.3691575"},{"key":"ref_39","first-page":"175","article-title":"The theory of technology dominance: Understanding the impact of intelligent decision aids on decision maker\u2019s judgments","volume":"1","author":"Arnold","year":"1998","journal-title":"Adv. Account. Behav. Res."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Sutton, S.G., Arnold, V., and Holt, M. (2022). An Extension of the Theory of Technology Dominance: Understanding the Underlying Nature, Causes and Effects. Causes Eff., Available online: https:\/\/www.nhh.no\/globalassets\/centres\/digaudit\/activities\/sutton-arnold-and-holt-2022-april-an-extension-of-the-theory-of-technology-dominance.pdf.","DOI":"10.2139\/ssrn.4101835"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"ooac031","DOI":"10.1093\/jamiaopen\/ooac031","article-title":"Impact of explainable artificial intelligence assistance on clinical decision-making of novice dental clinicians","volume":"5","author":"Glick","year":"2022","journal-title":"JAMIA Open"},{"key":"ref_42","first-page":"610","article-title":"The Utility of Explainable AI in Ad Hoc Human-Machine Teaming","volume":"34","author":"Paleja","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/S1467-0895(02)00034-9","article-title":"Do tax decision support systems affect the accuracy of tax compliance decisions?","volume":"3","author":"Noga","year":"2002","journal-title":"Int. J. Account. Inf. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1467-629x.2004.00099.x","article-title":"Impact of intelligent decision aids on expert and novice decision-makers\u2019 judgments","volume":"44","author":"Arnold","year":"2004","journal-title":"Account. Financ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"175","DOI":"10.2753\/MIS0742-1222270108","article-title":"Technology dominance in complex decision making: The case of aided credibility assessment","volume":"27","author":"Jensen","year":"2010","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Cabitza, F. (2019, January 4\u20136). Biases affecting human decision making in AI-supported second opinion settings. Proceedings of the International Conference on Modeling Decisions for Artificial Intelligence, Milan, Italy.","DOI":"10.1007\/978-3-030-26773-5_25"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Cabitza, F., Campagner, A., Ronzio, L., Cameli, M., Mandoli, G.E., Pastore, M.C., Sconfienza, L., Folgado, D., Barandas, M., and Gamboa, H. (2022). Rams, Hounds and White Boxes: Investigating Human-AI Collaboration Protocols in Medical Diagnosis. Artif. Intell. Med., submitted.","DOI":"10.1016\/j.artmed.2023.102506"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Bansal, G., Nushi, B., Kamar, E., Horvitz, E., and Weld, D.S. (2021, January 2\u20139). Is the most accurate ai the best teammate? optimizing ai for teamwork. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.","DOI":"10.1609\/aaai.v35i13.17359"},{"key":"ref_49","unstructured":"Nunnally, J., and Bernstein, I. (1994). Psychometric Theory, McGraw-Hil. [3rd ed.]."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1177\/1094428114555994","article-title":"Cronbach\u2019s coefficient alpha: Well known but poorly understood","volume":"18","author":"Cho","year":"2015","journal-title":"Organ. Res. Methods"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1038\/s41746-021-00385-9","article-title":"Do as AI say: Susceptibility in deployment of clinical decision-aids","volume":"4","author":"Gaube","year":"2021","journal-title":"NPJ Digit. Med."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.1080\/0267257X.2019.1687571","article-title":"Siri, Alexa, and other digital assistants: A study of customer satisfaction with artificial intelligence applications","volume":"35","author":"Brill","year":"2019","journal-title":"J. Mark. Manag."},{"key":"ref_53","unstructured":"Yang, J., and Hurmelinna-Laukkanen, P. (2022). Innovation, Routledge."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1038\/s41398-021-01224-x","article-title":"How machine-learning recommendations influence clinician treatment selections: The example of antidepressant selection","volume":"11","author":"Jacobs","year":"2021","journal-title":"Transl. Psychiatry"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","article-title":"Explanation in artificial intelligence: Insights from the social sciences","volume":"267","author":"Miller","year":"2019","journal-title":"Artif. Intell."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Arrieta","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.inffus.2021.05.009","article-title":"Notions of explainability and evaluation approaches for explainable artificial intelligence","volume":"76","author":"Vilone","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1136\/bmj.320.7237.768","article-title":"Human error: Models and management","volume":"320","author":"Reason","year":"2000","journal-title":"BMJ"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"102471","DOI":"10.1016\/j.artmed.2022.102471","article-title":"Why did AI get this one wrong?\u2014Tree-based explanations of machine learning model predictions","volume":"135","author":"Parimbelli","year":"2023","journal-title":"Artif. Intell. Med."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Amann, J., Vetter, D., Blomberg, S.N., Christensen, H.C., Coffee, M., Gerke, S., Gilbert, T.K., Hagendorff, T., Holm, S., and Livne, M. (2022). To explain or not to explain?\u2014Artificial intelligence explainability in clinical decision support systems. PLoS Digit. Health, 1.","DOI":"10.1371\/journal.pdig.0000016"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/0010-4809(75)90009-9","article-title":"Computer-based consultations in clinical therapeutics: Explanation and rule acquisition capabilities of the MYCIN system","volume":"8","author":"Shortliffe","year":"1975","journal-title":"Comput. Biomed. Res. Int. J."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1001\/jamacardio.2020.7422","article-title":"Use of artificial intelligence and deep neural networks in evaluation of patients with electrocardiographically concealed long QT syndrome from the surface 12-lead electrocardiogram","volume":"6","author":"Bos","year":"2021","journal-title":"JAMA Cardiol."},{"key":"ref_63","unstructured":"Klein, G., Hoffman, R., and Mueller, S. (2019, January 17\u201321). Naturalistic Psychological Model of Explanatory Reasoning: How people explain things to others and to themselves. Proceedings of the International Conference on Naturalistic Decision Making, San Francisco, CA, USA."},{"key":"ref_64","first-page":"44","article-title":"DARPA\u2019s explainable artificial intelligence (XAI) program","volume":"40","author":"Gunning","year":"2019","journal-title":"AI Mag."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3359152","article-title":"The principles and limits of algorithm-in-the-loop decision making","volume":"3","author":"Green","year":"2019","journal-title":"Proc. Acm Hum.-Comput. Interact."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1145\/3358955.3363293","article-title":"The Effects of Mixing Machine Learning and Human Judgment: Collaboration between humans and machines does not necessarily lead to better outcomes","volume":"17","author":"Vaccaro","year":"2019","journal-title":"Queue"},{"key":"ref_67","unstructured":"Mueller, S.T., Veinott, E.S., Hoffman, R.R., Klein, G., Alam, L., Mamun, T., and Clancey, W.J. (2021). Principles of explanation in human-AI systems. arXiv."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1080\/10447318.2020.1741118","article-title":"Human-centered artificial intelligence: Reliable, safe & trustworthy","volume":"36","author":"Shneiderman","year":"2020","journal-title":"Int. J. Hum.\u2013Comput. Interact."},{"key":"ref_69","unstructured":"Dignum, V. (2022). Relational Artificial Intelligence. arXiv."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"14952","DOI":"10.1038\/s41598-022-18751-2","article-title":"Experimental evidence of effective human\u2013AI collaboration in medical decision-making","volume":"12","author":"Reverberi","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MC.2021.3092610","article-title":"Toward Human\u2013AI Interfaces to Support Explainability and Causability in Medical AI","volume":"54","author":"Holzinger","year":"2021","journal-title":"Computer"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., and Ebel, P. (2019, January 8\u201311). The future of human-ai collaboration: A taxonomy of design knowledge for hybrid intelligence systems. Proceedings of the Hawaii International Conference on System Sciences (HICSS), Maui, HI, USA.","DOI":"10.24251\/HICSS.2019.034"},{"key":"ref_73","first-page":"1","article-title":"The role of shared mental models in human-AI teams: A theoretical review","volume":"2","author":"Andrews","year":"2022","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Neerincx, M.A., Waa, J.v.d., Kaptein, F., and Diggelen, J.v. (2018, January 15). Using perceptual and cognitive explanations for enhanced human-agent team performance. Proceedings of the International Conference on Engineering Psychology and Cognitive Ergonomics, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-91122-9_18"},{"key":"ref_75","unstructured":"Cooke, N.J., and Lawless, W.F. (2021). Systems Engineering and Artificial Intelligence, Springer."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1093\/jcmc\/zmab013","article-title":"In AI we trust? Effects of agency locus and transparency on uncertainty reduction in human\u2013AI interaction","volume":"26","author":"Liu","year":"2021","journal-title":"J. Comput.-Mediat. Commun."},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Wang, D., Churchill, E., Maes, P., Fan, X., Shneiderman, B., Shi, Y., and Wang, Q. (2020, January 25\u201330). From human-human collaboration to Human-AI collaboration: Designing AI systems that can work together with people. Proceedings of the Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3334480.3381069"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.jarmac.2015.07.001","article-title":"A naturalistic decision making perspective on studying intuitive decision making","volume":"4","author":"Klein","year":"2015","journal-title":"J. Appl. Res. Mem. Cogn."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"e28236","DOI":"10.2196\/28236","article-title":"Research trends in artificial intelligence applications in human factors health care: Mapping review","volume":"8","author":"Asan","year":"2021","journal-title":"JMIR Hum. Factors"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1109\/3468.844354","article-title":"A model for types and levels of human interaction with automation","volume":"30","author":"Parasuraman","year":"2000","journal-title":"IEEE Trans. Syst. Man Cybern.-Part A Syst. Humans"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/5\/1\/17\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:50:46Z","timestamp":1760122246000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/5\/1\/17"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,8]]},"references-count":80,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["make5010017"],"URL":"https:\/\/doi.org\/10.3390\/make5010017","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,8]]}}}