{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T19:37:51Z","timestamp":1781725071820,"version":"3.54.5"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T00:00:00Z","timestamp":1763078400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T00:00:00Z","timestamp":1763078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/S02428X\/1"],"award-info":[{"award-number":["EP\/S02428X\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/X040186\/1"],"award-info":[{"award-number":["EP\/X040186\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100014013","name":"UK Research and Innovation","doi-asserted-by":"publisher","award":["EP\/V030302\/1"],"award-info":[{"award-number":["EP\/V030302\/1"]}],"id":[{"id":"10.13039\/100014013","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Explainable Artificial Intelligence (XAI) is proposed as essential for high-risk applications like healthcare, where it aims to enhance user trust. However, studies often rely on automated metrics rather than user evaluation. We adapt a prototype-based XAI model for image-based gestational age (GA) estimation and evaluate its impact on trust, reliance, and performance, including a novel measure of appropriate reliance. Ten sonographers completed a 3-stage reader study assessing the XAI model\u2019s impact on GA estimates. Model predictions reduced clinician mean absolute error (MAE) from 23.5 to 15.7 days, and explanations had a further non-significant reduction to 14.3 days. However, the impact of explanations varied across participants, with some performing worse with explanations than without. Additionally, although explanations increased participant confidence, they had no significant effect on trust or reliance on the model. These counterintuitive results highlight potential pitfalls in deploying XAI, emphasising the need for human studies to capture clinician variability.<\/jats:p>","DOI":"10.1038\/s41746-025-02023-0","type":"journal-article","created":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T15:38:52Z","timestamp":1763134732000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["The human factor in explainable artificial intelligence: clinician variability in trust, reliance, and performance"],"prefix":"10.1038","volume":"8","author":[{"given":"Angus","family":"Nicolson","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Bradburn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yarin","family":"Gal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aris T.","family":"Papageorghiou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J. Alison","family":"Noble","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,11,14]]},"reference":[{"key":"2023_CR1","doi-asserted-by":"publisher","first-page":"916","DOI":"10.1093\/jnci\/djy222","volume":"111","author":"A Rodriguez-Ruiz","year":"2019","unstructured":"Rodriguez-Ruiz, A. et al. Stand-alone artificial intelligence for breast cancer detection in mammography: comparison with 101 radiologists. J. Natl. Cancer Inst. 111, 916\u2013922 (2019).","journal-title":"J. Natl. Cancer Inst."},{"key":"2023_CR2","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/S1470-2045(20)30535-0","volume":"22","author":"R Yamashita","year":"2021","unstructured":"Yamashita, R. et al. Deep learning model for the prediction of microsatellite instability in colorectal cancer: a diagnostic study. Lancet Oncol. 22, 132\u2013141 (2021).","journal-title":"Lancet Oncol."},{"key":"2023_CR3","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1148\/radiol.212182","volume":"304","author":"RY Kim","year":"2022","unstructured":"Kim, R. Y. et al. Artificial intelligence tool for assessment of indeterminate pulmonary nodules detected with CT. Radiology 304, 683\u2013691 (2022).","journal-title":"Radiology"},{"key":"2023_CR4","doi-asserted-by":"publisher","first-page":"e44","DOI":"10.1016\/S2589-7500(23)00218-2","volume":"6","author":"YD Cid","year":"2024","unstructured":"Cid, Y. D. et al. Development and validation of open-source deep neural networks for comprehensive chest x-ray reading: a retrospective, multicentre study. Lancet Digit. Health 6, e44\u2013e57 (2024).","journal-title":"Lancet Digit. Health"},{"key":"2023_CR5","doi-asserted-by":"publisher","first-page":"e157","DOI":"10.1016\/S2589-7500(23)00242-X","volume":"6","author":"MHJ Maas","year":"2024","unstructured":"Maas, M. H. J. et al. A computer-aided polyp detection system in screening and surveillance colonoscopy: an international, multicentre, randomised, tandem trial. Lancet Digit. Health 6, e157\u2013e165 (2024).","journal-title":"Lancet Digit. Health"},{"key":"2023_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","volume":"267","author":"T Miller","year":"2019","unstructured":"Miller, T. Explanation in artificial intelligence: insights from the social sciences. Artif. Intell. 267, 1\u201338 (2019).","journal-title":"Artif. Intell."},{"key":"2023_CR7","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 1, 206\u2013215 (2019).","journal-title":"Nat. Mach. Intell."},{"key":"2023_CR8","doi-asserted-by":"publisher","unstructured":"Sokol, K. & Flach, P. Explainability fact sheets: a framework for systematic assessment of explainable approaches. In Proc. Conference on Fairness, Accountability, and Transparency. ACM; 56-57; https:\/\/doi.org\/10.1145\/3351095.3372870 (ACM, 2020).","DOI":"10.1145\/3351095.3372870"},{"key":"2023_CR9","doi-asserted-by":"publisher","first-page":"4394","DOI":"10.3390\/ijms22094394","volume":"22","author":"AJ Banegas-Luna","year":"2021","unstructured":"Banegas-Luna, A. J. et al. Towards the interpretability of machine learning predictions for medical applications targeting personalised therapies: a cancer case survey. Int. J. Mol. Sci. 22, 4394 (2021).","journal-title":"Int. J. Mol. Sci."},{"key":"2023_CR10","first-page":"359","volume":"106","author":"S Tonekaboni","year":"2019","unstructured":"Tonekaboni, S., Joshi, S., McCradden, M. D. & Goldenberg, A. What clinicians want: contextualizing explainable machine learning for clinical end use. Proc. 4th Mach. Learn. Healthc. Conf. 106, 359\u2013380 (2019).","journal-title":"Proc. 4th Mach. Learn. Healthc. Conf."},{"key":"2023_CR11","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1038\/s41746-020-0254-2","volume":"3","author":"CM Cutillo","year":"2020","unstructured":"Cutillo, C. M. et al. Machine intelligence in healthcare\u2014perspectives on trustworthiness, explainability, usability, and transparency. npj Digit. Med. 3, 47 (2020).","journal-title":"npj Digit. Med."},{"key":"2023_CR12","doi-asserted-by":"publisher","unstructured":"Reyes, M.et al. On the interpretability of artificial intelligence in radiology: challenges and opportunities. Radiol. Artif. Intell. 2, https:\/\/doi.org\/10.1148\/ryai.2020190043 (2020).","DOI":"10.1148\/ryai.2020190043"},{"key":"2023_CR13","first-page":"1","volume":"6","author":"Q Sun","year":"2025","unstructured":"Sun, Q., Akman, A. & Schuller, B. W. Explainable Artificial intelligence for medical applications: a review. ACM Trans. Comput. Healthc. 6, 1\u201331 (2025).","journal-title":"ACM Trans. Comput. Healthc."},{"key":"2023_CR14","unstructured":"Hou, J. et al. Self-eXplainable AI for medical image analysis: a survey and new outlooks. arXiv Preprint arXiv:2410.02331 (2024)."},{"key":"2023_CR15","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1145\/3561048","volume":"55","author":"R Dwivedi","year":"2023","unstructured":"Dwivedi, R. et al. Explainable AI (XAI): core ideas, techniques, and solutions. ACM Comput Surv. 55, 9 (2023).","journal-title":"ACM Comput Surv."},{"key":"2023_CR16","first-page":"99","volume":"15274","author":"A Nicolson","year":"2024","unstructured":"Nicolson, A., Gal, Y. & Noble, J. A. TextCAVs: debugging vision models using text. IMIMIC Workshop MICCAI, LNCS 15274, 99\u2013109 (2024).","journal-title":"IMIMIC Workshop MICCAI, LNCS"},{"key":"2023_CR17","unstructured":"Casper, S.et al. The SaTML\u201924 CNN Interpretability competition: new innovations for concept-level interpretability. arXiv Preprint arXiv:240402949. (2024)."},{"key":"2023_CR18","doi-asserted-by":"publisher","first-page":"1328","DOI":"10.1038\/s41591-021-01461-z","volume":"27","author":"S Kundu","year":"2021","unstructured":"Kundu, S. AI in medicine must be explainable. Nat. Med. 27, 1328 (2021).","journal-title":"Nat. Med."},{"key":"2023_CR19","doi-asserted-by":"publisher","unstructured":"Lu, S. C., Swisher, C. L., Chung, C., Jaffray, D. & Sidey-Gibbons, C. On the importance of interpretable machine learning predictions to inform clinical decision making in oncology. Front. Oncol. 13, https:\/\/doi.org\/10.3389\/fonc.2023.1129380 (2023).","DOI":"10.3389\/fonc.2023.1129380"},{"key":"2023_CR20","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1038\/s41591-018-0307-0","volume":"25","author":"J He","year":"2019","unstructured":"He, J. et al. The practical implementation of artificial intelligence technologies in medicine. Nat. Med. 25, 30\u201336 (2019).","journal-title":"Nat. Med."},{"key":"2023_CR21","first-page":"4","volume":"56","author":"C Patr\u0131\u0301cio","year":"2023","unstructured":"Patr\u0131\u0301cio, C., Neves, J. C. & Teixeira, L. F. Explainable Deep Learning Methods in Medical Image Classification: A Survey. ACM Comput. Surv. 56, 4 (2023).","journal-title":"ACM Comput. Surv."},{"key":"2023_CR22","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-020-01332-6","volume":"20","author":"J Amann","year":"2020","unstructured":"Amann, J. et al. Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med Inf. Decis. Mak. 20, 310 (2020).","journal-title":"BMC Med Inf. Decis. Mak."},{"key":"2023_CR23","doi-asserted-by":"publisher","first-page":"e745","DOI":"10.1016\/S2589-7500(21)00208-9","volume":"3","author":"M Ghassemi","year":"2021","unstructured":"Ghassemi, M., Oakden-Rayner, L. & Beam, A. L. The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit. Health 3, e745\u2013e750 (2021).","journal-title":"Lancet Digit. Health"},{"key":"2023_CR24","doi-asserted-by":"publisher","unstructured":"Adebayo, J., Muelly, M., Abelson, H. & Kim, B. Post hoc Explanations may be Ineffective for Detecting Unknown Spurious Correlation. In ICLR https:\/\/doi.org\/10.48550\/arXiv.2212.04629 (2022).","DOI":"10.48550\/arXiv.2212.04629"},{"key":"2023_CR25","doi-asserted-by":"publisher","unstructured":"Adebayo, J. et al. Sanity checks for saliency maps. In: NeurIPS 9525-9536 https:\/\/doi.org\/10.5555\/3327546.3327621 (2018).","DOI":"10.5555\/3327546.3327621"},{"key":"2023_CR26","doi-asserted-by":"publisher","unstructured":"Arun, N. et al. Assessing the Trustworthiness of Saliency Maps for Localizing Abnormalities in Medical Imaging. Radiology: Artificial Intelligence. 3, https:\/\/doi.org\/10.1148\/ryai.2021200267 (2021).","DOI":"10.1148\/ryai.2021200267"},{"key":"2023_CR27","doi-asserted-by":"crossref","unstructured":"Nauta, M. et al. From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI. ACM Computing Surveys. 55, (2023).","DOI":"10.1145\/3583558"},{"key":"2023_CR28","unstructured":"Doshi-Velez, F. & Kim, B. Towards A Rigorous Science of Interpretable Machine Learning. arXiv Preprint arXiv:170208608. (2017)."},{"key":"2023_CR29","doi-asserted-by":"publisher","first-page":"832","DOI":"10.3390\/electronics8080832","volume":"8","author":"DV Carvalho","year":"2019","unstructured":"Carvalho, D. V., Pereira, E. M. & Cardoso, J. S. Machine learning interpretability: a survey on methods and metrics. Electronics 8, 832 (2019).","journal-title":"Electronics"},{"key":"2023_CR30","doi-asserted-by":"publisher","first-page":"1719","DOI":"10.1007\/s10618-023-00933-9","volume":"37","author":"F Bodria","year":"2023","unstructured":"Bodria, F. et al. Benchmarking and survey of explanation methods for black box models. Data Min. Knowl. Discov. 37, 1719\u20131778 (2023).","journal-title":"Data Min. Knowl. Discov."},{"key":"2023_CR31","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1038\/s41746-022-00699-2","volume":"5","author":"H Chen","year":"2022","unstructured":"Chen, H., Gomez, C., Huang, C. M. & Unberath, M. Explainable medical imaging AI needs human-centered design: guidelines and evidence from a systematic review. npj Digit Med. 5, 156 (2022).","journal-title":"npj Digit Med."},{"key":"2023_CR32","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1038\/s41591-024-02850-w","volume":"30","author":"F Yu","year":"2024","unstructured":"Yu, F. et al. Heterogeneity and predictors of the effects of AI assistance on radiologists. Nat. Med. 30, 837\u2013849 (2024).","journal-title":"Nat. Med."},{"key":"2023_CR33","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-28633-w","volume":"13","author":"S Gaube","year":"2023","unstructured":"Gaube, S. et al. Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays. Sci. Rep. 13, 1383 (2023).","journal-title":"Sci. Rep."},{"key":"2023_CR34","doi-asserted-by":"publisher","DOI":"10.1038\/s41398-021-01224-x","volume":"11","author":"M Jacobs","year":"2021","unstructured":"Jacobs, M. et al. How machine-learning recommendations influence clinician treatment selections: the example of antidepressant selection. Transl. Psychiatry 11, 108 (2021).","journal-title":"Transl. Psychiatry"},{"key":"2023_CR35","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s41746-023-00955-z","volume":"6","author":"M Nagendran","year":"2023","unstructured":"Nagendran, M., Festor, P., Komorowski, M., Gordon, A. C. & Faisal, A. A. Quantifying the impact of AI recommendations with explanations on prescription decision making. npj Digit Med. 6, 206 (2023).","journal-title":"npj Digit Med."},{"key":"2023_CR36","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","volume":"46","author":"JD Lee","year":"2004","unstructured":"Lee, J. D. & See, K. A. Trust in automation: designing for appropriate reliance. Hum. Factors 46, 50\u201380 (2004).","journal-title":"Hum. Factors"},{"key":"2023_CR37","first-page":"153","volume":"5","author":"M Bilgic","year":"2005","unstructured":"Bilgic, M. & Mooney, R. J. Explaining recommendations: satisfaction vs. promotion. Beyond Pers. Workshop IUI 5, 153 (2005).","journal-title":"Beyond Pers. Workshop IUI"},{"key":"2023_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3519266","volume":"12","author":"X Wang","year":"2022","unstructured":"Wang, X. & Yin, M. Effects of explanations in AI-assisted decision making: principles and comparisons. ACM Trans. Interact. Intell. Syst. 12, 1\u201336 (2022).","journal-title":"ACM Trans. Interact. Intell. Syst."},{"key":"2023_CR39","doi-asserted-by":"publisher","unstructured":"L\u00f6fstr\u00f6m, H. On the definition of appropriate trust and the tools that come with it. CSCE 1555\u20131562 https:\/\/doi.org\/10.1109\/CSCE60160.2023.00256 (2023).","DOI":"10.1109\/CSCE60160.2023.00256"},{"key":"2023_CR40","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1038\/s41746-023-00774-2","volume":"6","author":"LH Lee","year":"2023","unstructured":"Lee, L. H. et al. Machine learning for accurate estimation of fetal gestational age based on ultrasound images. npj Digit. Med. 6, 36 (2023).","journal-title":"npj Digit. Med."},{"key":"2023_CR41","doi-asserted-by":"publisher","first-page":"102470","DOI":"10.1016\/j.media.2022.102470","volume":"79","author":"BHM van der Velden","year":"2022","unstructured":"van der Velden, B. H. M., Kuijf, H. J., Gilhuijs, K. G. A. & Viergever, M. A. Explainable artificial intelligence (XAI) in deep learning-based medical image analysis. Med. Image Anal. 79, 102470 (2022).","journal-title":"Med. Image Anal."},{"key":"2023_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejrad.2023.110787","volume":"162","author":"K Borys","year":"2023","unstructured":"Borys, K. et al. Explainable AI in medical imaging: an overview for clinical practitioners \u2013 Saliency-based XAI approaches. Eur. J. Radiol. 162, 110787 (2023).","journal-title":"Eur. J. Radiol."},{"key":"2023_CR43","unstructured":"Colin, J., Fel, T., Cadene, R. & Serre, T. What i cannot predict, i do not understand: a human-centered evaluation framework for explainability methods. NeurIPS (NIPS, 2022)."},{"key":"2023_CR44","unstructured":"Lage, I. et al. An evaluation of the human-interpretability of explanation. NIPS (NIPS, 2018)."},{"key":"2023_CR45","unstructured":"Chen C. et al. This looks like that: deep learning for interpretable image recognition. NeurIPS (NIPS, 2019)."},{"key":"2023_CR46","unstructured":"Schut, L. et al. Generating interpretable counterfactual explanations by implicit minimisation of epistemic and aleatoric uncertainties. AISTATS (AISTATS, 2021)."},{"key":"2023_CR47","unstructured":"Kim, B. et al. Interpretability beyond feature attribution: quantitative testing with concept activation vectors (TCAV) ICML 2668-2677 (ICML, 2018)."},{"key":"2023_CR48","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.1038\/s42256-021-00423-x","volume":"3","author":"AJ Barnett","year":"2021","unstructured":"Barnett, A. J. et al. A case-based interpretable deep learning model for classification of mass lesions in digital mammography. Nat. Mach. Intell. 3, 1061\u20131070 (2021).","journal-title":"Nat. Mach. Intell."},{"key":"2023_CR49","unstructured":"Nicolson, A., Schut, L., Noble, A. & Gal, Y. Explaining explainability: recommendations for effective use of concept activation vectors. TMLR, (TMLR, 2025)."},{"key":"2023_CR50","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2022.825565","volume":"5","author":"S Mertes","year":"2022","unstructured":"Mertes, S., Huber, T., Weitz, K., Heimerl, A. & Andr\u00e9, E. GANterfactual\u2014counterfactual explanations for medical non-experts using generative adversarial learning. Front. Artif. Intell. 5, 825565. https:\/\/doi.org\/10.3389\/frai.2022.825565 (2022).","journal-title":"Front. Artif. Intell."},{"key":"2023_CR51","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2023.119898","volume":"655","author":"J Del Ser","year":"2024","unstructured":"Del Ser, J. et al. On generating trustworthy counterfactual explanations. Inf. Sci. 655, 119898 (2024).","journal-title":"Inf. Sci."},{"key":"2023_CR52","doi-asserted-by":"publisher","first-page":"102412","DOI":"10.1016\/j.inffus.2024.102412","volume":"108","author":"E Nasarian","year":"2024","unstructured":"Nasarian, E., Alizadehsani, R., Acharya, U. R. & Tsui, K.-L. Designing interpretable ML system to enhance trust in healthcare: a systematic review to proposed responsible clinician-ai-collaboration framework. Inf. Fusion 108, 102412 (2024).","journal-title":"Inf. Fusion"},{"key":"2023_CR53","doi-asserted-by":"publisher","first-page":"2149","DOI":"10.3390\/biomedinformatics4040115","volume":"4","author":"LA De Santi","year":"2024","unstructured":"De Santi, L. A. et al. Part-prototype models in medical imaging: applications and current challenges. BioMedInformatics 4, 2149\u20132172 (2024).","journal-title":"BioMedInformatics"},{"key":"2023_CR54","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1038\/s41746-024-01200-x","volume":"7","author":"M Nagendran","year":"2024","unstructured":"Nagendran, M., Festor, P., Komorowski, M., Gordon, A. C. & Faisal, A. A. Eye tracking insights into physician behaviour with safe and unsafe explainable AI recommendations. npj Digit Med. 7, 202 (2024).","journal-title":"npj Digit Med."},{"key":"2023_CR55","doi-asserted-by":"publisher","unstructured":"Yin, M., Wortman Vaughan, J. & Wallach, H. Understanding the effect of accuracy on trust in machine learning models. CHI Conference on Human Factors in Computing Systems https:\/\/doi.org\/10.1145\/3290605.3300509 (ACM, 2019).","DOI":"10.1145\/3290605.3300509"},{"key":"2023_CR56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3449287","volume":"5","author":"Z Bu\u00e7inca","year":"2021","unstructured":"Bu\u00e7inca, Z., Malaya, M. B. & Gajos, K. Z. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proc. ACM Hum. Comp. Interact. 5, 1\u201321 (2021).","journal-title":"Proc. ACM Hum. Comp. Interact."},{"key":"2023_CR57","doi-asserted-by":"publisher","unstructured":"Calisto, F. M. et al. Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis. CHI Conference on Human Factors in Computing Systems https:\/\/doi.org\/10.1145\/3544548.3580682 (ACM, 2023).","DOI":"10.1145\/3544548.3580682"},{"key":"2023_CR58","doi-asserted-by":"publisher","first-page":"103444","DOI":"10.1016\/j.ijhcs.2025.103444","volume":"197","author":"FM Calisto","year":"2025","unstructured":"Calisto, F. M., Abrantes, J. M., Santiago, C., Nunes, N. J. & Nascimento, J. C. Personalized explanations for clinician-AI interaction in breast imaging diagnosis by adapting communication to expertise levels. Int. J. Hum.-Comp. Stud. 197, 103444 (2025).","journal-title":"Int. J. Hum.-Comp. Stud."},{"key":"2023_CR59","doi-asserted-by":"publisher","unstructured":"Poursabzi-Sangdeh, F., Goldstein, D. G., Hofman, J. M., Wortman Vaughan, J. W. & Wallach, H. Manipulating and Measuring Model Interpretability. CHI Conference on Human Factors in Computing Systems. https:\/\/doi.org\/10.1145\/3411764.3445315 (ACM, 2021).","DOI":"10.1145\/3411764.3445315"},{"key":"2023_CR60","doi-asserted-by":"publisher","first-page":"1331","DOI":"10.1038\/s41591-022-01833-z","volume":"28","author":"DE Ehrmann","year":"2022","unstructured":"Ehrmann, D. E. et al. Evaluating and reducing cognitive load should be a priority for machine learning in healthcare. Nat. Med. 28, 1331\u20131333 (2022).","journal-title":"Nat. Med."},{"key":"2023_CR61","doi-asserted-by":"publisher","DOI":"10.2196\/55499","volume":"12","author":"E Asgari","year":"2024","unstructured":"Asgari, E. et al. Impact of electronic health record use on cognitive load and burnout among clinicians: narrative review. JMIR Med. Inf. 12, e55499 (2024).","journal-title":"JMIR Med. Inf."},{"key":"2023_CR62","first-page":"336","volume":"295","author":"S Gerke","year":"2020","unstructured":"Gerke, S., Minssen, T. & Cohen, G. Ethical and legal challenges of artificial intelligence-driven healthcare. Artif. Intell. Healthc. 295, 336 (2020).","journal-title":"Artif. Intell. Healthc."},{"key":"2023_CR63","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1038\/s41746-020-0262-2","volume":"3","author":"S Gerke","year":"2020","unstructured":"Gerke, S. et al. The need for a system view to regulate artificial intelligence\/machine learning-based software as medical device. npj Digit. Med. 3, 53 (2020).","journal-title":"npj Digit. Med."},{"key":"2023_CR64","unstructured":"EU. Artificial Intelligence Act (2024\/1689). https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX:32024R1689. (EU, 2024)."},{"key":"2023_CR65","doi-asserted-by":"publisher","unstructured":"Wang, D. et al. \u201cBrilliant AI Doctor\u201d in Rural Clinics: challenges in AI-Powered Clinical Decision Support System Deployment. CHI Conference on Human Factors in Computing Systems. https:\/\/doi.org\/10.1145\/3411764.3445432 (ACM, 2021).","DOI":"10.1145\/3411764.3445432"},{"key":"2023_CR66","doi-asserted-by":"crossref","unstructured":"Kennedy, S. H. et al. Deep clinical and biological phenotyping of the preterm birth and small for gestational age syndromes: the INTERBIO-21st Newborn Case-Control Study protocol. Gates Open Res. 2, 49 (2018).","DOI":"10.12688\/gatesopenres.12869.1"},{"key":"2023_CR67","doi-asserted-by":"publisher","unstructured":"Dutta, A. & Zisserman, A. The VIA Annotation Software for Images, Audio and Video. In: Proc. 27th ACM Int. Conf. on Multimedia https:\/\/doi.org\/10.1145\/3343031.3350535 (ACM, 2019).","DOI":"10.1145\/3343031.3350535"},{"key":"2023_CR68","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1016\/S0140-6736(14)61490-2","volume":"384","author":"AT Papageorghiou","year":"2014","unstructured":"Papageorghiou, A. T. et al. International standards for fetal growth based on serial ultrasound measurements: the Fetal Growth Longitudinal Study of the INTERGROWTH-21st Project. Lancet 384, 869\u2013879 (2014).","journal-title":"Lancet"},{"key":"2023_CR69","doi-asserted-by":"publisher","first-page":"S630","DOI":"10.1016\/j.ajog.2018.01.011","volume":"218","author":"AT Papageorghiou","year":"2018","unstructured":"Papageorghiou, A. T. et al. The INTERGROWTH-21st fetal growth standards: toward the global integration of pregnancy and pediatric care. Am. J. Obstet. Gynecol. 218, S630\u2013S640 (2018).","journal-title":"Am. J. Obstet. Gynecol."},{"key":"2023_CR70","unstructured":"Hoffman, R. R., Mueller, S. T., Klein, G. & Litman, J. Metrics for Explainable AI: Challenges and Prospects. arXiv Preprint arXiv:181204608. (2019)."},{"key":"2023_CR71","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1006\/obhd.1997.2697","volume":"70","author":"N Harvey","year":"1997","unstructured":"Harvey, N. & Fischer, I. Taking advice: accepting help, improving judgment, and sharing responsibility. Organ. Behav. Hum. Decis. Process. 70, 117\u2013133 (1997).","journal-title":"Organ. Behav. Hum. Decis. Process."},{"key":"2023_CR72","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1002\/bdm.539","volume":"20","author":"F Gino","year":"2007","unstructured":"Gino, F. & Moore, D. A. Effects of task difficulty on use of advice. J. Behav. Decis. Mak. 20, 21\u201335 (2007).","journal-title":"J. Behav. Decis. Mak."},{"key":"2023_CR73","doi-asserted-by":"publisher","first-page":"10323","DOI":"10.3390\/app122010323","volume":"12","author":"Y Du","year":"2022","unstructured":"Du, Y., Antoniadi, A. M., McNestry, C., McAuliffe, F. M. & Mooney, C. The role of XAI in advice-taking from a clinical decision support system: a comparative user study of feature contribution-based and example-based explanations. Appl. Sci. 12, 10323 (2022).","journal-title":"Appl. Sci."},{"key":"2023_CR74","doi-asserted-by":"publisher","unstructured":"Panigutti, C., Beretta, A., Giannotti, F., Pedreschi, D. Understanding the Impact of Explanations on Advice-Taking: A User Study for AI-based Clinical Decision Support Systems. CHI Conference on Human Factors in Computing Systems. https:\/\/doi.org\/10.1145\/3491102.3502104 (ACM, 2022).","DOI":"10.1145\/3491102.3502104"},{"key":"2023_CR75","doi-asserted-by":"publisher","unstructured":"Ahn, D., Almaatouq, A., Gulabani, M., Hosanagar, K. Impact of Model Interpretability and Outcome Feedback on Trust in AI. CHI Conference on Human Factors in Computing Systems. https:\/\/doi.org\/10.1145\/3613904.364278 (ACM, 2024).","DOI":"10.1145\/3613904.364278"},{"key":"2023_CR76","doi-asserted-by":"publisher","first-page":"533","DOI":"10.3758\/BF03197054","volume":"16","author":"W Hell","year":"1988","unstructured":"Hell, W., Gigerenzer, G., Gauggel, S., Mall, M. & M\u00fcller, M. Hindsight bias: an interaction of automatic and motivational factors? Mem. Cogn. 16, 533\u2013538 (1988).","journal-title":"Mem. Cogn."},{"key":"2023_CR77","doi-asserted-by":"publisher","unstructured":"Yang, F., Huang, Z., Scholtz, J. & Arendt, D. L. How do visual explanations foster end users\u2019 appropriate trust in machine learning? IUI. 189\u2013201, https:\/\/doi.org\/10.1145\/3377325.3377480 (IUI, 2020).","DOI":"10.1145\/3377325.3377480"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02023-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02023-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02023-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,17]],"date-time":"2025-11-17T19:03:37Z","timestamp":1763406217000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02023-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,14]]},"references-count":77,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["2023"],"URL":"https:\/\/doi.org\/10.1038\/s41746-025-02023-0","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,14]]},"assertion":[{"value":"6 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 November 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"At the time of doing the academic research, JAN and ATP were senior consultants to Intelligent Ultrasound Ltd with the consultancy managed by Oxford University Innovations Ltd. The work conducted related to this paper relates solely to university academic research. AN, EB and YG declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"658"}}