{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T09:50:00Z","timestamp":1791539400796,"version":"4.3.4"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T00:00:00Z","timestamp":1791504000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T00:00:00Z","timestamp":1791504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Med"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Clinical prediction models are increasingly deployed to support diagnostic and prognostic decisions, making reproducibility essential for assessing their reliability and generalizability. Analytical code supports independent assessment of these processes, yet its availability in the literature remains limited. This scoping review quantifies current practices in sharing analytical code to inform the development of TRIPOD-Code, a reporting guideline for code availability and reproducibility. Here a large-language-model-assisted pipeline was developed to screen articles citing TRIPOD or TRIPOD+AI, extract repository links and assess retrieved repositories against 14 predefined reproducibility-related features. Among 3,967 articles, 482 (12.2%) included code-sharing statements. Sharing prevalence varied widely by journal and country. Repository assessment showed substantial heterogeneity in reproducibility features. These findings underscore the need for clearer expectations beyond code availability, including documentation, dependency specification and executable structure. Strengthening these practices may improve the usability of clinical prediction model studies and support their deployment in real-world clinical settings.<\/jats:p>","DOI":"10.1038\/s41591-026-04691-1","type":"journal-article","created":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T09:02:25Z","timestamp":1791536545000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["AI-assisted scoping review of code sharing in clinical prediction model research"],"prefix":"10.1038","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-5548-2695","authenticated-orcid":false,"given":"Thomas","family":"Sounack","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raffaele","family":"Giancotti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5576-3943","authenticated-orcid":false,"given":"Catherine A.","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8020-0210","authenticated-orcid":false,"given":"Lasai","family":"Barre\u00f1ada","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9426-823X","authenticated-orcid":false,"given":"Hyeonhoon","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0048-7958","authenticated-orcid":false,"given":"Hyung-Chul","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6712-6626","authenticated-orcid":false,"given":"Leo Anthony","family":"Celi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2118-004X","authenticated-orcid":false,"given":"Karel G. M.","family":"Moons","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2772-2316","authenticated-orcid":false,"given":"Gary S.","family":"Collins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charlotta","family":"Lindvall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5676-7898","authenticated-orcid":false,"given":"Tom","family":"Pollard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,10,9]]},"reference":[{"key":"4691_CR1","doi-asserted-by":"publisher","unstructured":"Collins, G. S. et al. Open science practices need substantial improvement in prognostic model studies in oncology using machine learning. J. Clin. Epidemiol. 165, 111199 https:\/\/doi.org\/10.1016\/j.jclinepi.2023.10.015 (2024).","DOI":"10.1016\/j.jclinepi.2023.10.015"},{"key":"4691_CR2","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.18","volume":"3","author":"MD Wilkinson","year":"2016","unstructured":"Wilkinson, M. D. et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci. Data 3, 160018 https:\/\/doi.org\/10.1038\/sdata.2016.18 (2016).","journal-title":"Sci. Data"},{"key":"4691_CR3","doi-asserted-by":"publisher","DOI":"10.1186\/1741-7015-8-24","volume":"8","author":"I Simera","year":"2010","unstructured":"Simera, I. et al. Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Med. 8, 24 https:\/\/doi.org\/10.1186\/1741-7015-8-24 (2010).","journal-title":"BMC Med."},{"key":"4691_CR4","doi-asserted-by":"publisher","unstructured":"Does your code stand up to scrutiny? Nature 555, 142 https:\/\/doi.org\/10.1038\/d41586-018-02741-4 (2018).","DOI":"10.1038\/d41586-018-02741-4"},{"key":"4691_CR5","doi-asserted-by":"publisher","first-page":"e1001607","DOI":"10.1371\/journal.pmed.1001607","volume":"11","author":"T Bloom","year":"2014","unstructured":"Bloom, T., Ganley, E. & Winker, M. Data access for the open access literature: PLOS\u2019s data policy. PLoS Med. 11, e1001607 https:\/\/doi.org\/10.1371\/journal.pmed.1001607 (2014).","journal-title":"PLoS Med."},{"key":"4691_CR6","doi-asserted-by":"publisher","first-page":"e0230416","DOI":"10.1371\/journal.pone.0230416","volume":"15","author":"G Colavizza","year":"2020","unstructured":"Colavizza, G., Hrynaszkiewicz, I., Staden, I., Whitaker, K. & McGillivray, B. The citation advantage of linking publications to research data. PLoS ONE 15, e0230416 https:\/\/doi.org\/10.1371\/journal.pone.0230416 (2020).","journal-title":"PLoS ONE"},{"key":"4691_CR7","doi-asserted-by":"publisher","first-page":"55","DOI":"10.7326\/M14-0697","volume":"162","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. M. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): the TRIPOD statement. Ann. Intern. Med. 162, 55\u201363 https:\/\/doi.org\/10.7326\/M14-0697 (2015).","journal-title":"Ann. Intern. Med."},{"key":"4691_CR8","doi-asserted-by":"publisher","first-page":"W1","DOI":"10.7326\/M14-0698","volume":"162","author":"KGM Moons","year":"2015","unstructured":"Moons, K. G. M. et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): explanation and elaboration. Ann. Intern. Med. 162, W1\u2013W73 https:\/\/doi.org\/10.7326\/M14-0698 (2015).","journal-title":"Ann. Intern. Med."},{"key":"4691_CR9","doi-asserted-by":"publisher","first-page":"e078378","DOI":"10.1136\/bmj-2023-078378","volume":"385","author":"GS Collins","year":"2024","unstructured":"Collins, G. S. et al. TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. Brit. Med. J. 385, e078378 https:\/\/doi.org\/10.1136\/bmj-2023-078378 (2024).","journal-title":"Brit. Med. J."},{"key":"4691_CR10","doi-asserted-by":"publisher","first-page":"e041537","DOI":"10.1136\/bmjopen-2020-041537","volume":"10","author":"AH Zamanipoor Najafabadi","year":"2020","unstructured":"Zamanipoor Najafabadi, A. H. et al. TRIPOD statement: a preliminary pre-post analysis of reporting and methods of prediction models. BMJ Open 10, e041537 https:\/\/doi.org\/10.1136\/bmjopen-2020-041537 (2020).","journal-title":"BMJ Open"},{"key":"4691_CR11","doi-asserted-by":"publisher","first-page":"e104691","DOI":"10.1136\/bmjopen-2025-104691","volume":"15","author":"AM Streiber","year":"2025","unstructured":"Streiber, A. M. et al. Improving reproducibility of data analysis and code in medical research: 5 recommendations to get started. BMJ Open 15, e104691 https:\/\/doi.org\/10.1136\/bmjopen-2025-104691 (2025).","journal-title":"BMJ Open"},{"key":"4691_CR12","doi-asserted-by":"publisher","first-page":"e075767","DOI":"10.1136\/bmj-2023-075767","volume":"382","author":"DG Hamilton","year":"2023","unstructured":"Hamilton, D. G. et al. Prevalence and predictors of data and code sharing in the medical and health sciences: systematic review with meta-analysis of individual participant data. Brit. Med. J. 382, e075767 https:\/\/doi.org\/10.1136\/bmj-2023-075767 (2023).","journal-title":"Brit. Med. J."},{"key":"4691_CR13","doi-asserted-by":"publisher","first-page":"e2066","DOI":"10.7717\/peerj-cs.2066","volume":"10","author":"NK Sharma","year":"2024","unstructured":"Sharma, N. K. et al. Analytical code sharing practices in biomedical research. PeerJ Comput. Sci. 10, e2066 https:\/\/doi.org\/10.7717\/peerj-cs.2066 (2024).","journal-title":"PeerJ Comput. Sci."},{"key":"4691_CR14","doi-asserted-by":"publisher","first-page":"giad113","DOI":"10.1093\/gigascience\/giad113","volume":"13","author":"S Samuel","year":"2024","unstructured":"Samuel, S. & Mietchen, D. Computational reproducibility of Jupyter notebooks from biomedical publications. GigaScience 13, giad113 https:\/\/doi.org\/10.1093\/gigascience\/giad113 (2024).","journal-title":"GigaScience"},{"key":"4691_CR15","unstructured":"Simk\u00f3, A., Garpebring, A., Jonsson, J., Nyholm, T. & L\u00f6fstedt, T. Reproducibility of the methods in medical imaging with deep learning. In Proc. Machine Learning Research Vol. 227, 95\u2013106 (PMLR, 2024)."},{"key":"4691_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.modpat.2023.100350","volume":"37","author":"SJ Wagner","year":"2024","unstructured":"Wagner, S. J. et al. Built to last? Reproducibility and reusability of deep learning algorithms in computational pathology. Mod. Pathol. 37, 100350 https:\/\/doi.org\/10.1016\/j.modpat.2023.100350 (2024).","journal-title":"Mod. Pathol."},{"key":"4691_CR17","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.1038\/s41591-026-04229-5","volume":"32","author":"SF Chen","year":"2026","unstructured":"Chen, S. F. et al. LLM-assisted systematic review of large language models in clinical medicine. Nat. Med. 32, 1152\u20131159 https:\/\/doi.org\/10.1038\/s41591-026-04229-5 (2026).","journal-title":"Nat. Med."},{"key":"4691_CR18","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2411962122","volume":"122","author":"FM Delgado-Chaves","year":"2025","unstructured":"Delgado-Chaves, F. M. et al. Transforming literature screening: the emerging role of large language models in systematic reviews. Proc. Natl Acad. Sci. USA 122, e2411962122 https:\/\/doi.org\/10.1073\/pnas.2411962122 (2025).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"4691_CR19","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s41512-025-00217-4","volume":"10","author":"T Pollard","year":"2026","unstructured":"Pollard, T. et al. Protocol for development of a reporting guideline (TRIPOD-Code) for code repositories associated with diagnostic and prognostic prediction model studies. Diagn. Progn. Res. 10, 4 https:\/\/doi.org\/10.1186\/s41512-025-00217-4 (2026).","journal-title":"Diagn. Progn. Res."},{"key":"4691_CR20","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.ijsu.2016.04.032","volume":"30","author":"RA Agha","year":"2016","unstructured":"Agha, R. A. et al. Impact of the mandatory implementation of reporting guidelines on reporting quality in a surgical journal: a before and after study. Int. J. Surg. 30, 169\u2013172 https:\/\/doi.org\/10.1016\/j.ijsu.2016.04.032 (2016).","journal-title":"Int. J. Surg."},{"key":"4691_CR21","doi-asserted-by":"publisher","first-page":"e83138","DOI":"10.1371\/journal.pone.0083138","volume":"8","author":"N Panic","year":"2013","unstructured":"Panic, N., Leoncini, E., De Belvis, G., Ricciardi, W. & Boccia, S. Evaluation of the Endorsement of the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) Statement on the quality of published systematic review and meta-analyses. PLoS ONE 8, e83138 https:\/\/doi.org\/10.1371\/journal.pone.0083138 (2013).","journal-title":"PLoS ONE"},{"key":"4691_CR22","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/j.jclinepi.2019.06.014","volume":"115","author":"V Leclercq","year":"2019","unstructured":"Leclercq, V. et al. Meta-analyses indexed in PsycINFO had a better completeness of reporting when they mention PRISMA. J. Clin. Epidemiol. 115, 46\u201354 https:\/\/doi.org\/10.1016\/j.jclinepi.2019.06.014 (2019).","journal-title":"J. Clin. Epidemiol."},{"key":"4691_CR23","doi-asserted-by":"publisher","first-page":"e1002598","DOI":"10.1371\/journal.pcbi.1002598","volume":"8","author":"A Morin","year":"2012","unstructured":"Morin, A., Urban, J. & Sliz, P. A quick guide to software licensing for the scientist-programmer. PLoS Comput. Biol. 8, e1002598 https:\/\/doi.org\/10.1371\/journal.pcbi.1002598 (2012).","journal-title":"PLoS Comput. Biol."},{"key":"4691_CR24","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcpdig.2025.100228","volume":"3","author":"A Saelmans","year":"2025","unstructured":"Saelmans, A. et al. Implementation and updating of clinical prediction models: a systematic review. Mayo Clinic Proc. Digit. Health 3, 100228 https:\/\/doi.org\/10.1016\/j.mcpdig.2025.100228 (2025).","journal-title":"Mayo Clinic Proc. Digit. Health"},{"key":"4691_CR25","doi-asserted-by":"publisher","first-page":"1065","DOI":"10.1001\/jamainternmed.2021.2626","volume":"181","author":"A Wong","year":"2021","unstructured":"Wong, A. et al. External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients. JAMA Intern. Med. 181, 1065\u20131070 https:\/\/doi.org\/10.1001\/jamainternmed.2021.2626 (2021).","journal-title":"JAMA Intern. Med."},{"key":"4691_CR26","doi-asserted-by":"publisher","first-page":"e2242343","DOI":"10.1001\/jamanetworkopen.2022.42343","volume":"5","author":"W Hsu","year":"2022","unstructured":"Hsu, W. et al. External validation of an ensemble model for automated mammography interpretation by artificial intelligence. JAMA Netw. Open 5, e2242343 https:\/\/doi.org\/10.1001\/jamanetworkopen.2022.42343 (2022).","journal-title":"JAMA Netw. Open"},{"key":"4691_CR27","doi-asserted-by":"publisher","first-page":"2176","DOI":"10.1038\/s41591-021-01595-0","volume":"27","author":"L Seyyed-Kalantari","year":"2021","unstructured":"Seyyed-Kalantari, L., Zhang, H., McDermott, M. B. A., Chen, I. Y. & Ghassemi, M. Underdiagnosis bias of artificial intelligence algorithms applied to chest radiographs in under-served patient populations. Nat. Med. 27, 2176\u20132182 https:\/\/doi.org\/10.1038\/s41591-021-01595-0 (2021).","journal-title":"Nat. Med."},{"key":"4691_CR28","doi-asserted-by":"publisher","first-page":"1132","DOI":"10.1038\/s41592-021-01256-7","volume":"18","author":"BJ Heil","year":"2021","unstructured":"Heil, B. J. et al. Reproducibility standards for machine learning in the life sciences. Nat. Methods 18, 1132\u20131135 https:\/\/doi.org\/10.1038\/s41592-021-01256-7 (2021).","journal-title":"Nat. Methods"},{"key":"4691_CR29","unstructured":"Bosma JS, et al. Reproducibility of training deep learning models for medical image analysis. In Proc. Machine Learning Research Vol. 227, 1269\u20131287 (PMLR, 2024)."},{"key":"4691_CR30","doi-asserted-by":"publisher","unstructured":"Bossuyt, P. M. et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. BMJ 351, h5527 https:\/\/doi.org\/10.1136\/bmj.h5527 (2015).","DOI":"10.1136\/bmj.h5527"},{"key":"4691_CR31","doi-asserted-by":"publisher","DOI":"10.1148\/ryai.240300","volume":"6","author":"AS Tejani","year":"2024","unstructured":"Tejani, A. S. et al. Checklist for Artificial Intelligence in Medical Imaging (CLAIM): 2024 update. Radiol. Artif. Intell. 6, e240300 https:\/\/doi.org\/10.1148\/ryai.240300 (2024).","journal-title":"Radiol. Artif. Intell."},{"key":"4691_CR32","doi-asserted-by":"publisher","first-page":"467","DOI":"10.7326\/M18-0850","volume":"169","author":"AC Tricco","year":"2018","unstructured":"Tricco, A. C. et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann. Intern. Med. 169, 467\u2013473 https:\/\/doi.org\/10.7326\/M18-0850 (2018).","journal-title":"Ann. Intern. Med."},{"key":"4691_CR33","unstructured":"Sounack, T. et al. Code sharing in prediction model research: a protocol for a scoping review. INPLASY https:\/\/inplasy.com\/wp-content\/uploads\/2026\/02\/INPLASY-Protocol-8832.pdf (2026)."},{"key":"4691_CR34","doi-asserted-by":"publisher","unstructured":"Sounack, T., Giancotti, R., Barre\u00f1ada, L. & Pollard, T. TRIPOD-Code. Zenodo https:\/\/doi.org\/10.5281\/zenodo.22102059 (2026).","DOI":"10.5281\/zenodo.22102059"}],"container-title":["Nature Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41591-026-04691-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41591-026-04691-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41591-026-04691-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T09:02:29Z","timestamp":1791536549000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41591-026-04691-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,9]]},"references-count":34,"alternative-id":["4691"],"URL":"https:\/\/doi.org\/10.1038\/s41591-026-04691-1","relation":{},"ISSN":["1078-8956","1546-170X"],"issn-type":[{"value":"1078-8956","type":"print"},{"value":"1546-170X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,9]]},"assertion":[{"value":"28 March 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 September 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 October 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"T.P. serves or has recently served on the editorial board of\n                      npj Scientific Data\n                      ,\n                      PLOS Digital Health\n                      and\n                      Artificial Intelligence in Medicine\n                      . L.A.C. is editor in chief of\n                      PLOS Digital Health\n                      . G.S.C. and K.G.M.M. are editors in chief of\n                      Diagnostic and Prognostic Research\n                      . G.S.C. is a statistical editor for the\n                      BMJ\n                      . G.S.C. and K.G.M.M. are the lead authors of the TRIPOD and the TRIPOD+AI reporting guidelines. H.L. is an associate editor of\n                      npj Digital Medicine\n                      . H.-C.L. is guest editor of\n                      Artificial Intelligence in Medicine\n                      . C.A.G. serves on the editorial board of\n                      CHEST\n                      . The other authors declare no competing interests.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Ethics"}}]}}