{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T14:40:07Z","timestamp":1781534407202,"version":"3.54.5"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,8,11]],"date-time":"2025-08-11T00:00:00Z","timestamp":1754870400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,8,11]],"date-time":"2025-08-11T00:00:00Z","timestamp":1754870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000886","name":"Duke Endowment","doi-asserted-by":"publisher","award":["AWD00002292"],"award-info":[{"award-number":["AWD00002292"]}],"id":[{"id":"10.13039\/100000886","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Health systems face the challenge of balancing innovation and safety to responsibly implement artificial intelligence (AI) solutions. The rapid proliferation, growing complexity, ethical considerations, and rising demand for these tools require timely and efficient processes for rigorous evaluation and ongoing monitoring. Current AI evaluation frameworks often lack the practical guidance for health systems to address these challenges. To fill this gap, we developed a prescriptive evaluation framework informed by a literature review, in-depth interviews with key stakeholders, including patients, and a multidisciplinary design workshop. The resulting framework provides health systems an outline of the resources, structures, criteria, and template documents to enable pre-implementation evaluation and post-implementation monitoring of AI solutions. Health systems will need to treat this or any alternative framework as a living document to maintain relevance and effectiveness as the AI landscape and regulations continue to evolve.<\/jats:p>","DOI":"10.1038\/s41746-025-01900-y","type":"journal-article","created":{"date-parts":[[2025,8,11]],"date-time":"2025-08-11T13:14:59Z","timestamp":1754918099000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":43,"title":["A practical framework for appropriate implementation and review of artificial intelligence (FAIR-AI) in healthcare"],"prefix":"10.1038","volume":"8","author":[{"given":"Brian J.","family":"Wells","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hieu M.","family":"Nguyen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"McWilliams","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matt","family":"Pallini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy","family":"Bovi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Kuzma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justin","family":"Kramer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shih-Hsiung","family":"Chou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timothy","family":"Hetherington","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patricia","family":"Corn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yhenneko J.","family":"Taylor","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Audrey","family":"Cuison","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary","family":"Gagen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"McKenzie","family":"Isreal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"FAIR-AI Consortium","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oguz","family":"Akbilgic","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katie","family":"Barr","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alicia","family":"Bowers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rikki","family":"Caffrey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael S.","family":"Carroll","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"CiRullo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen M.","family":"Downs","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natalie","family":"Hardy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Heuay","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristina","family":"Katzovitz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric","family":"Kirkendall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elsie","family":"Lindgren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lindsey","family":"Lonergan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elissa","family":"McKinley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas M.","family":"Pajewski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Sak-Castellano","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erika","family":"Setliff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabe","family":"Wright","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,8,11]]},"reference":[{"key":"1900_CR1","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","volume":"28","author":"P Rajpurkar","year":"2022","unstructured":"Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. AI in health and medicine. Nat. Med. 28, 31\u201338 (2022).","journal-title":"Nat. Med."},{"key":"1900_CR2","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.techfore.2016.04.005","volume":"108","author":"O Dedehayir","year":"2016","unstructured":"Dedehayir, O. & Steinert, M. The hype cycle model: A review and future directions. Technol. Forecast. Soc. Change 108, 28\u201341 (2016).","journal-title":"Technol. Forecast. Soc. Change"},{"key":"1900_CR3","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1016\/0025-5564(75)90047-4","volume":"23","author":"EH Shortliffe","year":"1975","unstructured":"Shortliffe, E. H. & Buchanan, B. G. A model of inexact reasoning in medicine. Math. Biosci. 23, 351\u2013379 (1975).","journal-title":"Math. Biosci."},{"key":"1900_CR4","doi-asserted-by":"publisher","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","volume":"29","author":"AJ Thirunavukarasu","year":"2023","unstructured":"Thirunavukarasu, A. J. et al. Large language models in medicine. Nat. Med. 29, 1930\u20131940 (2023).","journal-title":"Nat. Med."},{"key":"1900_CR5","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1108\/INTR-01-2022-0042","volume":"33","author":"T Birkstedt","year":"2023","unstructured":"Birkstedt, T., Minkkinen, M., Tandon, A. & M\u00e4ntym\u00e4ki, M. AI governance: themes, knowledge gaps and future agendas. Internet Res. 33, 133\u2013167 (2023).","journal-title":"Internet Res."},{"key":"1900_CR6","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1080\/14494035.2021.1928377","volume":"40","author":"A Taeihagh","year":"2021","unstructured":"Taeihagh, A. Governance of artificial intelligence. Policy Soc. 40, 137\u2013157 (2021).","journal-title":"Policy Soc."},{"key":"1900_CR7","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1007\/s43681-022-00143-x","volume":"2","author":"M M\u00e4ntym\u00e4ki","year":"2022","unstructured":"M\u00e4ntym\u00e4ki, M., Minkkinen, M., Birkstedt, T. & Viljanen, M. Defining organizational AI governance. AI Ethics 2, 603\u2013609 (2022).","journal-title":"AI Ethics"},{"key":"1900_CR8","doi-asserted-by":"publisher","first-page":"1631","DOI":"10.1093\/jamia\/ocac078","volume":"29","author":"AD Bedoya","year":"2022","unstructured":"Bedoya, A. D. et al. A framework for the oversight and local deployment of safe and high-quality prediction models. J. Am. Med. Inform. Assoc. JAMIA 29, 1631\u20131636 (2022).","journal-title":"J. Am. Med. Inform. Assoc. JAMIA"},{"key":"1900_CR9","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2021-100444","volume":"28","author":"S Reddy","year":"2021","unstructured":"Reddy, S. et al. Evaluation framework to guide implementation of AI systems into healthcare settings. BMJ Health Care Inform. 28, e100444 (2021).","journal-title":"BMJ Health Care Inform."},{"key":"1900_CR10","doi-asserted-by":"publisher","first-page":"l6927","DOI":"10.1136\/bmj.l6927","volume":"368","author":"S Vollmer","year":"2020","unstructured":"Vollmer, S. et al. Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness. BMJ 368, l6927 (2020).","journal-title":"BMJ"},{"key":"1900_CR11","doi-asserted-by":"publisher","first-page":"1503","DOI":"10.1093\/jamia\/ocad088","volume":"30","author":"AH van der Vegt","year":"2023","unstructured":"van der Vegt, A. H. et al. Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework. J. Am. Med. Inform. Assoc. JAMIA 30, 1503\u20131515 (2023).","journal-title":"J. Am. Med. Inform. Assoc. JAMIA"},{"key":"1900_CR12","doi-asserted-by":"publisher","first-page":"e078378","DOI":"10.1136\/bmj-2023-078378","volume":"385","author":"GS Collins","year":"2024","unstructured":"Collins, G. S. et al. TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ 385, e078378 (2024).","journal-title":"BMJ"},{"key":"1900_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12916-014-0241-z","volume":"13","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement. BMC Med. 13, 1\u201310 (2015).","journal-title":"BMC Med."},{"key":"1900_CR14","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","volume":"21","author":"EW Steyerberg","year":"2010","unstructured":"Steyerberg, E. W., et al. Assessing the performance of prediction models: A framework for some traditional and novel measures. Epidemiol. Camb. Mass 21, 128 (2010).","journal-title":"Epidemiol. Camb. Mass"},{"key":"1900_CR15","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1177\/0272989X06295361","volume":"26","author":"AJ Vickers","year":"2006","unstructured":"Vickers, A. J. & Elkin, E. B. Decision curve analysis: A novel method for evaluating prediction models. Med. Decis. Mak. Int. J. Soc. Med. Decis. Mak. 26, 565\u2013574 (2006).","journal-title":"Med. Decis. Mak. Int. J. Soc. Med. Decis. Mak."},{"key":"1900_CR16","first-page":"045","volume":"14","author":"A Botchkarev","year":"2019","unstructured":"Botchkarev, A. A new typology design of performance metrics to measure errors in machine learning regression algorithms. Interdiscip. J. Inf. Knowl. Manag. 14, 045\u2013076 (2019).","journal-title":"Interdiscip. J. Inf. Knowl. Manag."},{"key":"1900_CR17","doi-asserted-by":"publisher","first-page":"b606","DOI":"10.1136\/bmj.b606","volume":"338","author":"KGM Moons","year":"2009","unstructured":"Moons, K. G. M., Altman, D. G., Vergouwe, Y. & Royston, P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 338, b606 (2009).","journal-title":"BMJ"},{"key":"1900_CR18","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1136\/heartjnl-2011-301247","volume":"98","author":"KGM Moons","year":"2012","unstructured":"Moons, K. G. M. et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart 98, 691\u2013698 (2012).","journal-title":"Heart"},{"key":"1900_CR19","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-024-02459-6","volume":"24","author":"Y-J Park","year":"2024","unstructured":"Park, Y.-J. et al. Assessing the research landscape and clinical utility of large language models: a scoping review. BMC Med. Inform. Decis. Mak. 24, 72 (2024).","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"1900_CR20","doi-asserted-by":"publisher","first-page":"260","DOI":"10.3390\/fi15080260","volume":"15","author":"A Bandi","year":"2023","unstructured":"Bandi, A., Adapa, P. V. S. R. & Kuchi, Y. E. V. P. K. The power of generative AI: A review of requirements, models, input\u2013output formats, evaluation metrics, and challenges. Future Internet 15, 260 (2023).","journal-title":"Future Internet"},{"key":"1900_CR21","doi-asserted-by":"publisher","first-page":"1337","DOI":"10.1038\/s41591-019-0548-6","volume":"25","author":"J Wiens","year":"2019","unstructured":"Wiens, J. et al. Do no harm: A roadmap for responsible machine learning for health care. Nat. Med. 25, 1337\u20131340 (2019).","journal-title":"Nat. Med."},{"key":"1900_CR22","doi-asserted-by":"publisher","DOI":"10.1136\/bmjhci-2020-100251","volume":"28","author":"I Scott","year":"2021","unstructured":"Scott, I., Carter, S. & Coiera, E. Clinician checklist for assessing suitability of machine learning applications in healthcare. BMJ Health Care Inform. 28, e100251 (2021).","journal-title":"BMJ Health Care Inform."},{"key":"1900_CR23","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/s41512-018-0033-6","volume":"2","author":"TH Kappen","year":"2018","unstructured":"Kappen, T. H. et al. Evaluating the impact of prediction models: Lessons learned, challenges, and recommendations. Diagn. Progn. Res. 2, 11 (2018).","journal-title":"Diagn. Progn. Res."},{"key":"1900_CR24","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1197\/jamia.M2334","volume":"14","author":"JA Osheroff","year":"2007","unstructured":"Osheroff, J. A. et al. A roadmap for national action on clinical decision support. J. Am. Med. Inform. Assoc. JAMIA 14, 141 (2007).","journal-title":"J. Am. Med. Inform. Assoc. JAMIA"},{"key":"1900_CR25","unstructured":"Blackman, R. Ethical Machines: Your Concise Guide to Totally Unbiased, Transparent, and Respectful AI. (Harvard Business Review Press, 2022)."},{"key":"1900_CR26","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1353\/hpu.2021.0065","volume":"32","author":"I Dankwa-Mullan","year":"2021","unstructured":"Dankwa-Mullan, I. et al. A Proposed Framework on Integrating Health Equity and Racial Justice into the Artificial Intelligence Development Lifecycle. J. Health Care Poor Underserved 32, 300\u2013317 (2021).","journal-title":"J. Health Care Poor Underserved"},{"key":"1900_CR27","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCOUTCOMES.117.003823","volume":"10","author":"JK Paulus","year":"2017","unstructured":"Paulus, J. K. & Kent, D. M. Race and ethnicity: A part of the equation for personalized clinical decision making?. Circ. Cardiovasc. Qual. Outcomes 10, e003823 (2017).","journal-title":"Circ. Cardiovasc. Qual. Outcomes"},{"key":"1900_CR28","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1038\/s41746-020-0304-9","volume":"3","author":"JK Paulus","year":"2020","unstructured":"Paulus, J. K. & Kent, D. M. Predictably unequal: Understanding and addressing concerns that algorithmic clinical prediction may increase health disparities. NPJ Digit. Med. 3, 99 (2020).","journal-title":"NPJ Digit. Med."},{"key":"1900_CR29","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jclinepi.2013.08.005","volume":"67","author":"J O\u2019Neill","year":"2014","unstructured":"O\u2019Neill, J. et al. Applying an equity lens to interventions: Using PROGRESS ensures consideration of socially stratifying factors to illuminate inequities in health. J. Clin. Epidemiol. 67, 56\u201364 (2014).","journal-title":"J. Clin. Epidemiol."},{"key":"1900_CR30","doi-asserted-by":"publisher","first-page":"e384","DOI":"10.1016\/S2589-7500(22)00003-6","volume":"4","author":"X Liu","year":"2022","unstructured":"Liu, X. et al. The medical algorithmic audit. Lancet Digit. Health 4, e384\u2013e397 (2022).","journal-title":"Lancet Digit. Health"},{"key":"1900_CR31","doi-asserted-by":"publisher","first-page":"e070904","DOI":"10.1136\/bmj-2022-070904","volume":"377","author":"B Vasey","year":"2022","unstructured":"Vasey, B. et al. Reporting guideline for the early stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI. BMJ 377, e070904 (2022).","journal-title":"BMJ"},{"key":"1900_CR32","doi-asserted-by":"crossref","unstructured":"Zerilli, J., Bhatt, U. & Weller, A. How transparency modulates trust in artificial intelligence. Patterns 3, 100455 (2022).","DOI":"10.1016\/j.patter.2022.100455"},{"key":"1900_CR33","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1080\/15265161.2024.2399828","volume":"25","author":"ME Hurley","year":"2025","unstructured":"Hurley, M. E., Lang, B. H., Kostick-Quenet, K. M., Smith, J. N. & Blumenthal-Barby, J. Patient consent and the right to notice and explanation of AI systems used in health care. Am. J. Bioeth. AJOB 25, 102\u2013114 (2025).","journal-title":"Am. J. Bioeth. AJOB"},{"key":"1900_CR34","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1080\/15265161.2025.2457700","volume":"25","author":"M Pflanzer","year":"2025","unstructured":"Pflanzer, M. Balancing transparency and trust: Reevaluating AI disclosure in healthcare. Am. J. Bioeth. AJOB 25, 153\u2013156 (2025).","journal-title":"Am. J. Bioeth. AJOB"},{"key":"1900_CR35","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1038\/s41746-021-00549-7","volume":"5","author":"AAH de Hond","year":"2022","unstructured":"de Hond, A. A. H. et al. Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review. NPJ Digit. Med. 5, 2 (2022).","journal-title":"NPJ Digit. Med."},{"key":"1900_CR36","doi-asserted-by":"publisher","first-page":"e36823","DOI":"10.2196\/36823","volume":"24","author":"NL Crossnohere","year":"2022","unstructured":"Crossnohere, N. L., Elsaid, M., Paskett, J., Bose-Brill, S. & Bridges, J. F. P. Guidelines for artificial intelligence in medicine: Literature review and content analysis of frameworks. J. Med. Internet Res. 24, e36823 (2022).","journal-title":"J. Med. Internet Res."},{"key":"1900_CR37","unstructured":"Kramer, J. et al. Developing a Framework for the Review and Oversight of Artificial Intelligence at a Large Healthcare Enterprise: Assessing the Needs and Priorities of Senior Health System Leadership, Providers, and Community Stakeholders. in (AcademyHealth, 2024)."},{"key":"1900_CR38","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1001\/jama.2019.21579","volume":"323","author":"ME Matheny","year":"2020","unstructured":"Matheny, M. E., Whicher, D. & Thadaney Israni, S. Artificial Intelligence in Health Care: A Report From the National Academy of Medicine. JAMA 323, 509\u2013510 (2020).","journal-title":"JAMA"},{"key":"1900_CR39","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1007\/BF00146924","volume":"17","author":"B Fischhoff","year":"1984","unstructured":"Fischhoff, B., Watson, S. R. & Hope, C. Defining risk. Policy Sci. 17, 123\u2013139 (1984).","journal-title":"Policy Sci."},{"key":"1900_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-022-00611-y","volume":"5","author":"J Feng","year":"2022","unstructured":"Feng, J. et al. Clinical artificial intelligence quality improvement: towards continual monitoring and updating of AI algorithms in healthcare. Npj Digit. Med. 5, 1\u20139 (2022).","journal-title":"Npj Digit. Med."},{"key":"1900_CR41","doi-asserted-by":"publisher","unstructured":"Lu, J. et al. Learning under concept drift: A review. IEEE Trans. Knowl. Data Eng. pp. 1\u20131 https:\/\/doi.org\/10.1109\/TKDE.2018.2876857(2018).","DOI":"10.1109\/TKDE.2018.2876857"},{"key":"1900_CR42","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1038\/s41591-024-03425-5","volume":"31","author":"J Gallifant","year":"2025","unstructured":"Gallifant, J. et al. The TRIPOD-LLM reporting guideline for studies using large language models. Nat. Med. 31, 60\u201369 (2025).","journal-title":"Nat. Med."},{"key":"1900_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-024-01258-7","volume":"7","author":"TYC Tam","year":"2024","unstructured":"Tam, T. Y. C. et al. A framework for human evaluation of large language models in healthcare derived from literature review. Npj Digit. Med. 7, 1\u201320 (2024).","journal-title":"Npj Digit. Med."},{"key":"1900_CR44","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1177\/1744987120927206","volume":"25","author":"S Campbell","year":"2020","unstructured":"Campbell, S. et al. Purposive sampling: Complex or simple? Research case examples. J. Res. Nurs. JRN 25, 652 (2020).","journal-title":"J. Res. Nurs. JRN"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01900-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01900-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01900-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,8]],"date-time":"2025-09-08T23:43:48Z","timestamp":1757375028000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-01900-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,11]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["1900"],"URL":"https:\/\/doi.org\/10.1038\/s41746-025-01900-y","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-5975624\/v1","asserted-by":"object"}]},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,11]]},"assertion":[{"value":"6 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 August 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"The study was approved by the Advocate Health\u2014Wake Forest University School of Medicine IRB (#00109544) with a verbal consent procedure, as permitted under federal regulation 45 CFR 46.117(c). Avoiding written consent eliminated the need to collect any personally identifying information, thereby reducing the risk of a confidentiality breach.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics"}}],"article-number":"514"}}