{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T06:48:22Z","timestamp":1785739702010,"version":"3.56.0"},"reference-count":71,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T00:00:00Z","timestamp":1779840000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T00:00:00Z","timestamp":1779840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000781","name":"EC | European Research Council","doi-asserted-by":"publisher","award":["TAIPO, 101088594"],"award-info":[{"award-number":["TAIPO, 101088594"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mol Syst Biol"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In controlled proof-of-concept studies, healthcare artificial intelligence (AI) systems now routinely match or exceed specialist-level performance. Despite these impressive technical achievements, most systems remain confined to research settings, highlighting an opportunity to better prepare academic AI research for subsequent clinical translation. Successful translation requires attention to technical, regulatory, organizational, and infrastructural factors, ideally from the earliest stages of research. This Perspective focuses on trustworthiness as a key factor that academic researchers can address proactively. First, we outline how trustworthiness requirements differ across three stakeholder groups\u2014patients, clinicians, and regulatory bodies\u2014and how academic research can better align with these expectations. We then discuss key dimensions of trustworthy AI\u2014explainability, uncertainty quantification, and evaluation\u2014and how researchers can address them during study design. We also consider foundation models, which require adapted validation approaches. Based on this analysis, we propose a stakeholder-centered framework that emphasizes proactive integration of trust requirements during early development phases rather than post hoc considerations.<\/jats:p>","DOI":"10.1038\/s44320-026-00219-4","type":"journal-article","created":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T17:50:13Z","timestamp":1779904213000},"page":"1201-1213","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Toward trustworthy healthcare AI: designing academic research for translation readiness"],"prefix":"10.1038","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-4567-0907","authenticated-orcid":false,"given":"Achim","family":"Hekler","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5587-6761","authenticated-orcid":false,"given":"Florian","family":"Buettner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,5,27]]},"reference":[{"key":"219_CR1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-018-0040-6","volume":"1","author":"MD Abr\u00e0moff","year":"2018","unstructured":"Abr\u00e0moff MD, Lavin PT, Birch M, Shah N, Folk JC (2018) Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices. NPJ Digit Med 1:39","journal-title":"NPJ Digit Med"},{"key":"219_CR2","doi-asserted-by":"crossref","unstructured":"Agarwal V, Jin Y, Chandra M, De Choudhury M, Kumar S, Sastry N (2025) MedHalu: hallucinations in responses to healthcare queries by large language models. arXiv preprint arXiv:2409.19492","DOI":"10.1609\/icwsm.v20i1.42623"},{"key":"219_CR3","unstructured":"Agency for Healthcare Research and Quality (2023) Interplay between cognitive load and diagnostic accuracy. U.S. Department of Health; Human Services"},{"key":"219_CR4","unstructured":"American Medical Association (2024) 2 in 3 physicians are using health AI\u2014up 78% from 2023. AMA Digital Health News"},{"key":"219_CR5","first-page":"6679","volume":"35","author":"SO Arik","year":"2021","unstructured":"Arik SO, Pfister T (2021) Tabnet: attentive interpretable tabular learning. Proc AAAI Conf Artif Intell 35:6679\u20136687","journal-title":"Proc AAAI Conf Artif Intell"},{"issue":"4","key":"219_CR6","doi-asserted-by":"publisher","first-page":"746","DOI":"10.1016\/j.surg.2021.01.008","volume":"169","author":"J Balch","year":"2021","unstructured":"Balch J, Upchurch JrGR, Bihorac A, Loftus TJ (2021) Bridging the artificial intelligence valley of death in surgical decision-making. Surgery 169(4):746\u2013748","journal-title":"Surgery"},{"issue":"1","key":"219_CR7","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01420-1","volume":"8","author":"A Balendran","year":"2025","unstructured":"Balendran A, Beji C, Bouvier F, Khalifa O, Evgeniou T, Ravaud P, Porcher R (2025) A scoping review of robustness concepts for machine learning in healthcare. NPJ Digit Med 8(1):38","journal-title":"NPJ Digit Med"},{"key":"219_CR8","doi-asserted-by":"crossref","unstructured":"Beede E, Baylor E, Hersch F, Iurchenko A, Wilcox L, Ruamviboonsuk P, Vardoulakis LM (2020) A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In: Proceedings of the 2020 CHI Conference on human factors in computing systems. Association for Computing Machinery, New York, NY, USA, pp 1\u201312","DOI":"10.1145\/3313831.3376718"},{"issue":"1","key":"219_CR9","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1038\/s42256-018-0004-1","volume":"1","author":"E Begoli","year":"2019","unstructured":"Begoli E, Bhattacharya T, Kusnezov D (2019) The need for uncertainty quantification in machine-assisted medical decision making. Nat Mach Intell 1(1):20\u201323","journal-title":"Nat Mach Intell"},{"key":"219_CR10","doi-asserted-by":"publisher","first-page":"e58462","DOI":"10.2196\/58462","volume":"11","author":"N Benda","year":"2024","unstructured":"Benda N, Desai P, Reza Z, Zheng A, Kumar S, Harkins S, Hermann A, Zhang Y, Joly R, Kim J, Pathak J, Reading Turchioe M (2024) Patient perspectives on AI for mental health care: cross-sectional survey study. JMIR Ment Health 11:e58462","journal-title":"JMIR Ment Health"},{"issue":"11","key":"219_CR11","doi-asserted-by":"publisher","first-page":"8263","DOI":"10.1007\/s00330-023-09747-1","volume":"33","author":"MH Bernstein","year":"2023","unstructured":"Bernstein MH, Atalay MK, Dibble EH, Maxwell AWP, Karam AR, Agarwal S, Ward RC, Healey TT, Baird GL (2023) Can incorrect artificial intelligence (AI) results impact radiologists, and if so, what can we do about it? A multi-reader pilot study of lung cancer detection with chest radiography. Eur Radiol 33(11):8263\u20138269","journal-title":"Eur Radiol"},{"key":"219_CR12","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00837-4","volume":"6","author":"N Bienefeld","year":"2023","unstructured":"Bienefeld N, Boss JM, L\u00fcthy R, Brodbeck D, Azzati J, Blaser M, Willms J, Keller E (2023) Solving the explainable AI conundrum by bridging clinicians\u2019 needs and developers\u2019 goals. NPJ Digit Med 6:94","journal-title":"NPJ Digit Med"},{"key":"219_CR13","unstructured":"Blundell C, Cornebise J, Kavukcuoglu K, Wierstra D (2015) Weight uncertainty in neural networks. In: Proc 32nd Int. Conf Mach. Learn. PMLR: pp 1613\u20131622"},{"issue":"1","key":"219_CR14","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-01764-2","volume":"8","author":"A Brankovic","year":"2025","unstructured":"Brankovic A, Cook D, Rahman J, Delaforce A, Li J, Magrabi F, Cabitza F, Coiera E, Bradford D (2025) Clinician-informed XAI evaluation checklist with metrics (CLIX-M) for AI-powered clinical decision support systems. NPJ Digit Med 8(1):364","journal-title":"NPJ Digit Med"},{"issue":"10","key":"219_CR15","doi-asserted-by":"publisher","first-page":"2718","DOI":"10.1038\/s41591-024-03203-3","volume":"30","author":"S Chouffani El Fassi","year":"2024","unstructured":"Chouffani El Fassi S, Abdullah A, Fang Y, Natarajan S, Masroor AB, Kayali N, Prakash S, Henderson GE (2024) Not all AI health tools with regulatory authorization are clinically validated. Nat Med 30(10):2718\u20132720","journal-title":"Nat Med"},{"issue":"Special Issue","key":"219_CR16","doi-asserted-by":"publisher","first-page":"e171","DOI":"10.12927\/hcq.2009.20945","volume":"12","author":"P Croskerry","year":"2009","unstructured":"Croskerry P (2009) Context is everything or how could I have been that stupid? Healthc Q 12(Special Issue):e171\u2013e177","journal-title":"Healthc Q"},{"issue":"1","key":"219_CR17","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1037\/xge0000033","volume":"144","author":"BJ Dietvorst","year":"2015","unstructured":"Dietvorst BJ, Simmons JP, Massey C (2015) Algorithm aversion: people erroneously avoid algorithms after seeing them err. J Exp Psychol: Gen 144(1):114","journal-title":"J Exp Psychol: Gen"},{"key":"219_CR18","unstructured":"Ehrenfeld JM (2024) What\u2019s needed to build physician trust in health care AI. American Medical Association"},{"issue":"1","key":"219_CR19","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-020-01191-1","volume":"20","author":"P Esmaeilzadeh","year":"2020","unstructured":"Esmaeilzadeh P (2020) Use of AI-based tools for healthcare purposes: a survey study from consumers\u2019 perspectives. BMC Med Inform Decis Mak 20(1):170","journal-title":"BMC Med Inform Decis Mak"},{"issue":"7639","key":"219_CR20","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer using deep neural networks. Nature 542(7639):115\u2013118","journal-title":"Nature"},{"key":"219_CR21","unstructured":"European Parliament and Council (2024) Regulation (EU) 2024\/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artifi cial intelligence (Artifi cial Intelligence Act) and amending Regulations (EC) No 300\/2008, (EU) No 167\/2013, (EU) No 168\/2013, (EU) 2018\/858, (EU) 2018\/1139 and (EU) 2019\/2144 and Directives 2014\/90\/EU, (EU) 2016\/797 and (EU) 2020\/1828. OJ L, 2024\/1689, 12.7.2024."},{"key":"219_CR22","unstructured":"Gal Y, Ghahramani Z (2016) Dropout as a Bayesian approximation: representing model uncertainty in deep learning. In Proc. 33rd Int. Conf. Mach. Learn. PMLR 48:1050\u20131059"},{"key":"219_CR23","doi-asserted-by":"crossref","unstructured":"Ganguli D, Hernandez D, Lovitt L, DasSarma N, Henighan T, Jones A, Joseph N, Kernion J, Mann B, Askell A, Bai Y, Chen A, Conerly T, Drain D, Elhage N, El Showk S, Fort S, Hatfield-Dodds Z, Johnston S, Kravec S, Nanda N, Ndousse K, Olsson C, Amodei D, Brown T, Kaplan J, McCandlish S, Olah C, Amodei D, Clark J (2022) Predictability and surprise in large generative models. In: 2022 ACM Conference on fairness, accountability, and transparency (Seoul, Republic of Korea), FAccT \u201922. ACM, pp 1747\u20131764","DOI":"10.1145\/3531146.3533229"},{"key":"219_CR24","unstructured":"Ganguli D, Lovitt L, Kernion J, Askell A, Bai Y, Kadavath S, Mann B, Perez E, Schiefer N, Ndousse K, Jones A, Bowman S, Chen A, Conerly T, DasSarma N, Drain D, Elhage N, El-Showk S, Fort S, Hatfield-Dodds Z, Henighan T, Hernandez D, Hume T, Jacobson J, Johnston S, Kravec S, Olsson C, Ringer S, Tran-Johnson E, Amodei D, Brown T, Joseph N, McCandlish S, Olah C, Kaplan J, Clark J (2022) Red teaming language models to reduce harms: methods, scaling behaviors, and lessons learned. arXiv:2209.07858."},{"issue":"1","key":"219_CR25","doi-asserted-by":"publisher","first-page":"e50803","DOI":"10.2196\/50803","volume":"5","author":"M Giavina-Bianchi","year":"2024","unstructured":"Giavina-Bianchi M, Amaro JrE, Machado BS (2024) Medical expectations of physicians on AI solutions in daily practice: cross-sectional survey study. JMIRx Med 5(1):e50803","journal-title":"JMIRx Med"},{"issue":"3","key":"219_CR26","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1111\/cgf.14333","volume":"40","author":"C Gillmann","year":"2021","unstructured":"Gillmann C, Saur D, Wischgoll T, Scheuermann G (2021) Uncertainty-aware visualization in medical imaging\u2014a survey. Comput Graph Forum 40(3):665\u2013692","journal-title":"Comput Graph Forum"},{"issue":"22","key":"219_CR27","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan V, Peng L, Coram M, Stumpe MC, Wu D, Narayanaswamy A, Venugopalan S, Widner K, Madams T, Cuadros J, Kim R, Raman R, Nelson PC, Mega JL, Webster DR (2016) Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316(22):2402\u20132410","journal-title":"JAMA"},{"key":"219_CR28","unstructured":"Guo C, Pleiss G, Sun Y, Weinberger KQ (2017) On calibration of modern neural networks. In Proc. 34th Int. Conf. Mach. Learn. PMLR 70:1321\u20131330"},{"issue":"2","key":"219_CR29","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1016\/j.jaad.2024.04.033","volume":"91","author":"S Haggenm\u00fcller","year":"2024","unstructured":"Haggenm\u00fcller S, Maron RC, Hekler A, Krieghoff-Henning E, Utikal JS, Gaiser M, M\u00fcller V, Fabian S, Meier F, Hobelsberger S, Gellrich FF, Sergon M, Hauschild A, Weichenthal M, French LE, Heinzerling L, Schlager JG, Ghoreschi K, Schlaak M, Hilke FJ, Poch G, Korsing S, Berking C, Heppt MV, Erdmann M, Haferkamp S, Drexler K, Schadendorf D, Sondermann W, Goebeler M, Schilling B, Kather JN, Fr\u00f6hling S, Kaminski K, Doppler A, Bucher T, Brinker TJ (2024) Patients\u2019 and dermatologists\u2019 preferences in artificial intelligence-driven skin cancer diagnostics: a prospective multicentric survey study. J Am Acad Dermatol 91(2):366\u2013370","journal-title":"J Am Acad Dermatol"},{"issue":"5","key":"219_CR30","doi-asserted-by":"publisher","first-page":"e367","DOI":"10.1016\/S2589-7500(24)00047-5","volume":"6","author":"R Han","year":"2024","unstructured":"Han R, Acosta JN, Shakeri Z, Ioannidis JPA, Topol EJ, Rajpurkar P (2024) Randomised controlled trials evaluating artificial intelligence in clinical practice: a scoping review. Lancet Digit Health 6(5):e367\u2013e373","journal-title":"Lancet Digit Health"},{"key":"219_CR31","unstructured":"Hendrycks D, Dietterich T (2019) Benchmarking neural network robustness to common corruptions and perturbations. In 7th Int. Conf. Learn. Represent. New Orleans, LA, USA, ICLR pp 6\u20139"},{"issue":"4","key":"219_CR32","doi-asserted-by":"publisher","DOI":"10.1016\/j.medj.2025.100666","volume":"6","author":"X Huang","year":"2025","unstructured":"Huang X, Gu L, Sun J, Eils R (2025) Bridging the gaps: overcoming challenges of implementing AI in healthcare. Med 6(4):100666","journal-title":"Med"},{"issue":"3","key":"219_CR33","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s10994-021-05946-3","volume":"110","author":"E H\u00fcllermeier","year":"2021","unstructured":"H\u00fcllermeier E, Waegeman W (2021) Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Mach Learn 110(3):457\u2013506","journal-title":"Mach Learn"},{"issue":"23","key":"219_CR34","doi-asserted-by":"publisher","first-page":"2275","DOI":"10.1001\/jama.2023.22295","volume":"330","author":"S Jabbour","year":"2023","unstructured":"Jabbour S, Fouhey D, Shepard S, Valley TS, Kazerooni EA, Banovic N, Wiens J, Sjoding MW (2023) Measuring the impact of AI in the diagnosis of hospitalized patients: a randomized clinical vignette survey study. JAMA 330(23):2275\u20132284","journal-title":"JAMA"},{"issue":"3","key":"219_CR35","doi-asserted-by":"publisher","first-page":"498","DOI":"10.3390\/electronics13030498","volume":"13","author":"G Joshi","year":"2024","unstructured":"Joshi G, Jain A, Araveeti SR, Adhikari S, Garg H, Bhandari M (2024) FDA-approved artificial intelligence and machine learning (AI\/ML)-enabled medical devices: an updated landscape. Electronics 13(3):498","journal-title":"Electronics"},{"issue":"7873","key":"219_CR36","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","volume":"596","author":"J Jumper","year":"2021","unstructured":"Jumper J, Evans R, Pritzel A, Green T, Figurnov M, Ronneberger O, Tunyasuvunakool K, Bates R, \u017d\u00eddek A, Potapenko A, Bridgland A, Meyer C, Kohl SAA, Ballard AJ, Cowie A, Romera-Paredes B, Nikolov S, Jain R, Adler J, Back T, Petersen S, Reiman D, Clancy E, Zielinski M, Steinegger M, Pacholska M, Berghammer T, Bodenstein S, Silver D, Vinyals O, Senior AW, Kavukcuoglu K, Kohli P, Hassabis D (2021) Highly accurate protein structure prediction with AlphaFold. Nature 596(7873):583\u2013589","journal-title":"Nature"},{"key":"219_CR37","unstructured":"Kendall A, Gal Y (2017) What uncertainties do we need in Bayesian deep learning for computer vision? In: Advances in neural information processing systems. 30 (NIPS 2017) Curran Associates, Inc., Red Hook, NY pp 5574\u20135584."},{"key":"219_CR38","unstructured":"Lakshminarayanan B, Pritzel A, Blundell C (2017) Simple and scalable predictive uncertainty estimation using deep ensembles. In: Guyon I, von Luxburg U, Bengio S, Wallach H, Fergus R, Vishwanathan SVN, Garnett R (eds) Advances in neural information processing systems 30 (NIPS 2017). Curran Associates, Inc., Red Hook, NY, pp 6402\u20136413"},{"key":"219_CR39","unstructured":"Liu Y, Gadepalli K, Norouzi M, Dahl GE, Kohlberger T, Boyko A, Venugopalan S, Timofeev A, Nelson PQ, Corrado GS, Hipp JD, Peng L, Stumpe MC (2017) Detecting cancer metastases on gigapixel pathology images. Preprint at https:\/\/arxiv.org\/abs\/1703.02442"},{"issue":"6","key":"219_CR40","doi-asserted-by":"publisher","first-page":"900","DOI":"10.1038\/s41591-020-0842-3","volume":"26","author":"Y Liu","year":"2020","unstructured":"Liu Y, Jain A, Eng C, Way DH, Lee K, Bui P, Kanada K, de Oliveira Marinho G, Gallegos J, Gabriele S, Gupta V, Singh N, Natarajan V, Hofmann-Wellenhof R, Corrado GS, Peng LH, Webster DR, Ai D, Huang SJ, Liu Y, Dunn RC, Coz D (2020) A deep learning system for differential diagnosis of skin diseases. Nat Med 26(6):900\u2013908","journal-title":"Nat Med"},{"key":"219_CR41","unstructured":"Lundberg SM, Lee SI (2017) A unified approach to interpreting model predictions. Guyon I, von Luxburg U, Bengio S, Wallach H, Fergus R, Vishwanathan SVN, Garnett R (eds) In: Advances in neural information processing systems 30. Red Hook, NY, Curran Associates, Inc. NIPS pp 4765\u20134774"},{"issue":"2","key":"219_CR42","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1038\/s41592-023-02151-z","volume":"21","author":"L Maier-Hein","year":"2024","unstructured":"Maier-Hein L, Reinke A, Godau P, Tizabi MD, Buettner F, Christodoulou E, Glocker B, Isensee F, Kleesiek J, Kozubek M, Reyes M, Riegler MA, Wiesenfarth M, Kavur AE, Sudre CH, Baumgartner M, Eisenmann M, Heckmann-N\u00f6tzel D, R\u00e4dsch T, Acion L, Antonelli M, Arbel T, Bakas S, Benis A, Blaschko MB, Cardoso MJ, Cheplygina V, Cimini BA, Collins GS, Farahani K, Ferrer L, Galdran A, van Ginneken B, Haase R, Hashimoto DA, Hoffman MM, Huisman M, Jannin P, Kahn CE, Kainmueller D, Kainz B, Karargyris A, Karthikesalingam A, Kofler F, Kopp-Schneider A, Kreshuk A, Kurc T, Landman BA, Litjens G, Madani A, Maier-Hein K, Martel AL, Mattson P, Meijering E, Menze B, Moons KGM, M\u00fcller H, Nichyporuk B, Nickel F, Petersen J, Rajpoot N, Rieke N, Saez-Rodriguez J, S\u00e1nchez CI, Shetty S, van Smeden M, Summers RM, Taha AA, Tiulpin A, Tsaftaris SA, Van Calster B, Varoquaux G, J\u00e4ger PF (2024) Metrics reloaded: recommendations for image analysis validation. Nat Methods 21(2):195\u2013212","journal-title":"Nat Methods"},{"key":"219_CR43","doi-asserted-by":"crossref","unstructured":"Mitchell M, Wu S, Zaldivar A, Barnes P, Vasserman L, Hutchinson B, Spitzer E, Raji ID, Gebru T (2019) Model cards for model reporting. In: Proceedings of the conference on fairness, accountability, and transparency (FAT* '19). New York, NY, USA Association for Computing Machinery, pp 220\u2013229","DOI":"10.1145\/3287560.3287596"},{"issue":"7956","key":"219_CR44","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1038\/s41586-023-05881-4","volume":"616","author":"M Moor","year":"2023","unstructured":"Moor M, Banerjee O, Shakeri Hossein Abad Z, Krumholz HM, Leskovec J, Topol EJ, Rajpurkar P (2023) Foundation models for generalist medical artificial intelligence. Nature 616(7956):259\u2013265","journal-title":"Nature"},{"issue":"11","key":"219_CR45","first-page":"2","volume":"2","author":"RM Neal","year":"2011","unstructured":"Neal RM (2011) MCMC using Hamiltonian dynamics. Handb Markov Chain Monte Carlo 2(11):2","journal-title":"Handb Markov Chain Monte Carlo"},{"key":"219_CR46","unstructured":"Neal RM (2012) Bayesian learning for neural networks, Vol. 118. Springer Science & Business Media"},{"key":"219_CR47","unstructured":"Nori H, King N, McKinney SM, Carignan D, Horvitz E (2023) Capabilities of GPT-4 on medical challenge problems. arXiv:2303.13375"},{"issue":"1","key":"219_CR48","first-page":"1","volume":"3","author":"LM Padilla","year":"2018","unstructured":"Padilla LM, Creem-Regehr SH, Hegarty M, Stefanucci JK (2018) Decision making with visualizations: a cognitive framework across disciplines. Cogn Res: Princ Implic 3(1):1\u201325","journal-title":"Cogn Res: Princ Implic"},{"key":"219_CR49","doi-asserted-by":"crossref","unstructured":"Pal A, Umapathi LK, Sankarasubbu M (2023) Med-HALT: medical domain hallucination test for large language models. In: Proc. 27th Conf. Comput. Nat. Lang. Learn (CoNLL). (Association for Computational Linguistics, Singapore) pp 314\u2013334.","DOI":"10.18653\/v1\/2023.conll-1.21"},{"key":"219_CR50","first-page":"61","volume":"10","author":"J Platt","year":"1999","unstructured":"Platt J (1999) Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv Large Margin Classifiers 10:61\u201374","journal-title":"Adv Large Margin Classifiers"},{"issue":"10","key":"219_CR51","doi-asserted-by":"publisher","first-page":"1178","DOI":"10.5858\/arpa.2022-0066-OA","volume":"147","author":"P Raciti","year":"2023","unstructured":"Raciti P, Sue J, Retamero JA, Ceballos R, Godrich R, Kunz JD, Casson A, Thiagarajan D, Ebrahimzadeh Z, Viret J, Lee D, Sch\u00fcffler PJ, DeMuth G, Gulturk E, Kanan C, Rothrock B, Reis-Filho J, Klimstra DS, Reuter V, Fuchs TJ (2023) Clinical Validation of artificial intelligence\u2013augmented pathology diagnosis demonstrates significant gains in diagnostic accuracy in prostate cancer detection. Arch Pathol Lab Med 147(10):1178\u20131185","journal-title":"Arch Pathol Lab Med"},{"issue":"2","key":"219_CR52","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1038\/s41592-023-02150-0","volume":"21","author":"A Reinke","year":"2024","unstructured":"Reinke A, Tizabi MD, Baumgartner M, Eisenmann M, Heckmann-N\u00f6tzel D, Kavur AE, R\u00e4dsch T, Sudre CH, Acion L, Antonelli M, Arbel T, Bakas S, Benis A, Blaschko M, Buettner F, Cardoso MJ, Cheplygina V, Chen J, Christodoulou E, Cimini BA, Collins GS, Farahani K, Ferrer L, Galdran A, van Ginneken B, Glocker B, Godau P, Haase R, Hashimoto DA, Hoffman MM, Huisman M, Isensee F, Jannin P, Kahn CE, Kainmueller D, Kainz B, Karargyris A, Karthikesalingam A, Kenngott H, Kleesiek J, Kofler F, Kooi T, Kopp-Schneider A, Kozubek M, Kreshuk A, Kurc T, Landman BA, Litjens G, Madani A, Maier-Hein K, Martel AL, Mattson P, Meijering E, Menze B, Moons KGM, M\u00fcller H, Nichyporuk B, Nickel F, Petersen J, Rafelski SM, Rajpoot N, Reyes M, Riegler MA, Rieke N, Saez-Rodriguez J, S\u00e1nchez CI, Shetty S, Summers RM, Taha AA, Tiulpin A, Tsaftaris SA, Van Calster B, Varoquaux G, Yaniv ZR, J\u00e4ger PF, Maier-Hein L (2024) Understanding metric-related pitfalls in image analysis validation. Nat Methods 21(2):182\u2013194","journal-title":"Nat Methods"},{"key":"219_CR53","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) Why should I trust you? Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International conference on knowledge discovery and data mining. ACM, 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"key":"219_CR54","doi-asserted-by":"publisher","first-page":"1422177","DOI":"10.3389\/fpsyg.2024.1422177","volume":"15","author":"R Riedl","year":"2024","unstructured":"Riedl R, Hogeterp SA, Reuter M (2024) Do patients prefer a human doctor, artificial intelligence, or a blend, and is this preference dependent on medical discipline? Empirical evidence and implications for medical practice. Front Psychol 15:1422177","journal-title":"Front Psychol"},{"key":"219_CR55","doi-asserted-by":"publisher","first-page":"e46487","DOI":"10.2196\/46487","volume":"2","author":"R Robinson","year":"2023","unstructured":"Robinson R, Liday C, Lee S, Williams IC, Wright M, An S, Nguyen E (2023) Artificial intelligence in health care\u2014understanding patient information needs and designing comprehensible transparency: qualitative study. JMIR AI 2:e46487","journal-title":"JMIR AI"},{"issue":"October","key":"219_CR56","doi-asserted-by":"publisher","first-page":"e53207","DOI":"10.2196\/53207","volume":"3","author":"R Rosenbacke","year":"2024","unstructured":"Rosenbacke R, Melhus \u00c5, McKee M, Stuckler D (2024) How explainable artificial intelligence can increase or decrease clinicians\u2019 trust in AI applications in health care: systematic review. JMIR AI 3(October):e53207","journal-title":"JMIR AI"},{"key":"219_CR57","unstructured":"Ross C, Swetlitz I (2017) IBM pitched its Watson supercomputer as a revolution in cancer care. It\u2019s nowhere close. Stat 5 https:\/\/www.statnews.com\/2017\/09\/05\/watson-ibm-cancer\/"},{"key":"219_CR58","doi-asserted-by":"publisher","first-page":"55565","DOI":"10.52202\/075280-2425","volume":"36","author":"R Schaeffer","year":"2023","unstructured":"Schaeffer R, Miranda B, Koyejo S (2023) Are emergent abilities of large language models a mirage? Adv Neural Inf Process Syst 36:55565\u201355581","journal-title":"Adv Neural Inf Process Syst"},{"key":"219_CR59","doi-asserted-by":"crossref","unstructured":"Schemmer M, Kuehl N, Benz C, Bartos A, Satzger G (2023) Appropriate reliance on AI Advice: conceptualization and the effect of explanations. In: Proceedings of the 28th international conference on intelligent user interfaces (IUI' 23). New York, NY, USA (Association for Computing Machinery) pp 410\u2013422","DOI":"10.1145\/3581641.3584066"},{"key":"219_CR60","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision. IEEE, pp 618\u2013626","DOI":"10.1109\/ICCV.2017.74"},{"key":"219_CR61","first-page":"371","volume":"9","author":"G Shafer","year":"2008","unstructured":"Shafer G, Vovk V (2008) A tutorial on conformal prediction. J Mach Learn Res 9:371\u2013421","journal-title":"J Mach Learn Res"},{"key":"219_CR62","unstructured":"Spitzer P, K\u00fchl N, Goutier M (2022) Training novices: the role of human-AI collaboration and knowledge transfer. In Workshop on Human-Machine Collaboration and Teaming, Baltimore (HM-CaT)"},{"key":"219_CR63","unstructured":"Tonekaboni S, Joshi S, McCradden MD, Goldenberg A (2019) What clinicians want: contextualizing explainable machine learning for clinical end use. In: Proceedings of the 4th machine learning for healthcare conference, Vol. 106. Cambridge, MA, pp 359\u2013380"},{"key":"219_CR64","unstructured":"Tyson A, Pasquini G, Spencer A, Funk C (2023) 60% of Americans would be uncomfortable with provider relying on AI in their own health care. Pew ResearchCenter, Washington, https:\/\/www.pewresearch.org\/science\/2023\/02\/22\/60-of-americans-would-be-uncomfortable-with-provider-relying-on-ai-in-their-own-health-care\/"},{"key":"219_CR65","unstructured":"U.S. Food and Drug Administration (2025) Artificial intelligence-enabled device software functions: lifecycle management and marketing submission recommendations \u2013 draft guidance for industry and FDA staff. Draft Guidance Document"},{"issue":"10","key":"219_CR66","doi-asserted-by":"publisher","first-page":"2128","DOI":"10.1093\/jamia\/ocab127","volume":"28","author":"SN van der Veer","year":"2021","unstructured":"van der Veer SN, Riste L, Cheraghi-Sohi S, Phipps DL, Tully MP, Bozentko K, Atwood S, Hubbard A, Wiper C, Oswald M, Peek N (2021) Trading off accuracy and explainability in AI decision-making: findings from 2 citizens\u2019 juries. J Am Med Inform Assoc 28(10):2128\u20132138","journal-title":"J Am Med Inform Assoc"},{"key":"219_CR67","unstructured":"Wei J, Tay Y, Bommasani R, Raffel C, Zoph B, Borgeaud S, Yogatama D, Bosma M, Zhou D, Metzler D, Chi EH, Hashimoto T, Vinyals O, Liang P, Dean J, Fedus W (2022) Emergent abilities of large language models. Transactions on Machine Learning Research"},{"issue":"2","key":"219_CR68","first-page":"83","volume":"33","author":"DB White","year":"2007","unstructured":"White DB, Braddock 3rdCH, Bereknyei S, Curtis JR (2007) Uncertainty and clinical practice: physician and patient perspectives. J Med Ethics 33(2):83\u201389","journal-title":"J Med Ethics"},{"issue":"8","key":"219_CR69","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1001\/jamainternmed.2021.2626","volume":"181","author":"A Wong","year":"2021","unstructured":"Wong A, Otles E, Donnelly JP, Krumm A, McCullough J, DeTroyer-Cooley O, Pestrue J, Phillips M, Konye J, Penoza C, Ghous M, Singh K (2021) External validation of a widely implemented proprietary sepsis prediction system in hospitalized patients. JAMA Intern Med 181(8):1065\u20131070","journal-title":"JAMA Intern Med"},{"key":"219_CR70","first-page":"1434","volume":"30","author":"F Yu","year":"2024","unstructured":"Yu F, Moehring A, Restrepo MI, Gallas BD, Rajpurkar P (2024) Individual differences among physicians in how they use artificial intelligence for pulmonary radiographic diagnosis. Nat Med 30:1434\u20131441","journal-title":"Nat Med"},{"issue":"10477","key":"219_CR71","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1016\/S0140-6736(25)00202-8","volume":"405","author":"J Zou","year":"2025","unstructured":"Zou J, Topol EJ (2025) The rise of agentic AI teammates in medicine. Lancet 405(10477):457","journal-title":"Lancet"}],"container-title":["Molecular Systems Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1038\/s44320-026-00219-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1038\/s44320-026-00219-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1038\/s44320-026-00219-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T06:32:58Z","timestamp":1785738778000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1038\/s44320-026-00219-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,27]]},"references-count":71,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2026,8,3]]}},"alternative-id":["219"],"URL":"https:\/\/doi.org\/10.1038\/s44320-026-00219-4","relation":{},"ISSN":["1744-4292"],"issn-type":[{"value":"1744-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,27]]},"assertion":[{"value":"10 September 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2026","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2026","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 May 2026","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"FB has received funding from Merck KGaA, Siemens AG and Bayer AG.\u00a0AH\u00a0declares no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosure and competing interests statement"}}]}}