{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T00:48:01Z","timestamp":1784249281740,"version":"3.55.0"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T00:00:00Z","timestamp":1765929600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T00:00:00Z","timestamp":1768867200000},"content-version":"vor","delay-in-days":34,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100005405","name":"American Surgical Association Foundation","doi-asserted-by":"publisher","award":["NA"],"award-info":[{"award-number":["NA"]}],"id":[{"id":"10.13039\/100005405","id-type":"DOI","asserted-by":"publisher"}]},{"name":"University of Pennsylvania Linda Pechenik Montague Award","award":["NA"],"award-info":[{"award-number":["NA"]}]},{"DOI":"10.13039\/100008658","name":"Deutsches Krebsforschungszentrum","doi-asserted-by":"publisher","award":["CoBot 2.0"],"award-info":[{"award-number":["CoBot 2.0"]}],"id":[{"id":"10.13039\/100008658","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008662","name":"Joachim Herz Stiftung","doi-asserted-by":"publisher","award":["Add-On Fellowship for Interdisciplinary Life Science"],"award-info":[{"award-number":["Add-On Fellowship for Interdisciplinary Life Science"]}],"id":[{"id":"10.13039\/100008662","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Central Indiana Corporate Partnership","award":["AnalytiXIN Initiative"],"award-info":[{"award-number":["AnalytiXIN Initiative"]}]},{"name":"Evan and Sue Ann Werling Pancreatic Cancer Research Fund","award":["NA"],"award-info":[{"award-number":["NA"]}]},{"DOI":"10.13039\/100006975","name":"Indiana Clinical and Translational Sciences Institute","doi-asserted-by":"publisher","award":["EPAR4157"],"award-info":[{"award-number":["EPAR4157"]}],"id":[{"id":"10.13039\/100006975","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Surgical scene understanding (SSU) uses artificial intelligence (AI) to interpret visual data from surgeries, such as laparoscopic videos. Despite promising foundational research on instrument and anatomy recognition, clinical adoption remains minimal. This systematic review and meta-analysis (PROSPERO: CRD420251005301) evaluates current SSU research in minimally invasive abdominal surgery, focusing on data curation, model design, validation, reporting standards, and clinical relevance. A total of 188 studies were reviewed. Most relied on small, single-center datasets (70.7%), primarily laparoscopic cholecystectomies (59.0%), reflecting an overall narrow topical breadth. Validation practices were often weak, rarely involving external datasets (10.1%) or clinical experts. Few studies addressed clinical translation (5.9%), model performance variability estimation (38.3%), or made code available (29.8%). Overall, limited progress toward clinical integration has been made over the past decade. Our findings highlight the need for diverse, multi-institutional datasets, robust validation practices, and clinically driven development to unlock the full potential of SSU in surgical practice.<\/jats:p>","DOI":"10.1038\/s41746-025-02227-4","type":"journal-article","created":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T13:26:26Z","timestamp":1765977986000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Artificial intelligence for surgical scene understanding: a systematic review and reporting quality meta-analysis"],"prefix":"10.1038","volume":"9","author":[{"given":"Matthias","family":"Carstens","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shubha","family":"Vasisht","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheyuan","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Iulia","family":"Barbur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Annika","family":"Reinke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lena","family":"Maier-Hein","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel A.","family":"Hashimoto","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fiona R.","family":"Kolbinger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,12,17]]},"reference":[{"key":"2227_CR1","doi-asserted-by":"publisher","first-page":"951","DOI":"10.3390\/jpm13060951","volume":"13","author":"A Al Kuwaiti","year":"2023","unstructured":"Al Kuwaiti, A. et al. A review of the role of artificial intelligence in healthcare. JPM. 13, 951 (2023).","journal-title":"JPM."},{"key":"2227_CR2","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1038\/s41568-021-00399-1","volume":"21","author":"O Elemento","year":"2021","unstructured":"Elemento, O., Leslie, C., Lundin, J. & Tourassi, G. Artificial intelligence in cancer research, diagnosis and therapy. Nat. Rev. Cancer 21, 747\u2013752 (2021).","journal-title":"Nat. Rev. Cancer"},{"key":"2227_CR3","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","volume":"28","author":"P Rajpurkar","year":"2022","unstructured":"Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. AI in health and medicine. Nat. Med. 28, 31\u201338 (2022).","journal-title":"Nat. Med."},{"key":"2227_CR4","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102306","volume":"76","author":"L Maier-Hein","year":"2022","unstructured":"Maier-Hein, L. et al. Surgical data science \u2013 from concepts toward clinical translation. Med. Image Anal. 76, 102306 (2022).","journal-title":"Med. Image Anal."},{"key":"2227_CR5","doi-asserted-by":"crossref","unstructured":"Valderrama, N. et al. Towards Holistic Surgical Scene Understanding. in Medical Image Computing and Computer Assisted Intervention \u2013 MICCAI 2022 (eds Wang, L., Dou, Q., Fletcher, P. T., Speidel, S. & Li, S.) vol. 13437 442\u2013452 (Springer Nature Switzerland, Cham, 2022).","DOI":"10.1007\/978-3-031-16449-1_42"},{"key":"2227_CR6","doi-asserted-by":"publisher","first-page":"103387","DOI":"10.1016\/j.media.2024.103387","volume":"99","author":"Q Wang","year":"2025","unstructured":"Wang, Q., Zhao, S., Xu, Z. & Zhou, S. K. LACOSTE: Exploiting stereo and temporal contexts for surgical instrument segmentation. Med. Image Anal. 99, 103387 (2025).","journal-title":"Med. Image Anal."},{"key":"2227_CR7","doi-asserted-by":"publisher","first-page":"1388","DOI":"10.1007\/s00464-024-11489-0","volume":"39","author":"S Ryu","year":"2025","unstructured":"Ryu, S. et al. Artificial intelligence-enhanced navigation for nerve recognition and surgical education in laparoscopic colorectal surgery. Surg. Endosc. 39, 1388\u20131396 (2025).","journal-title":"Surg. Endosc."},{"key":"2227_CR8","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-00557-3","volume":"11","author":"Y Kumazu","year":"2021","unstructured":"Kumazu, Y. et al. Automated segmentation by deep learning of loose connective tissue fibers to define safe dissection planes in robot-assisted gastrectomy. Sci. Rep. 11, 21198 (2021).","journal-title":"Sci. Rep."},{"key":"2227_CR9","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1097\/SLA.0000000000004594","volume":"276","author":"A Madani","year":"2022","unstructured":"Madani, A. et al. Artificial Intelligence for Intraoperative Guidance: Using Semantic Segmentation to Identify Surgical Anatomy During Laparoscopic Cholecystectomy. Ann. Surg. 276, 363\u2013369 (2022).","journal-title":"Ann. Surg."},{"key":"2227_CR10","doi-asserted-by":"publisher","first-page":"263","DOI":"10.3109\/10929080009148894","volume":"5","author":"A Schweikard","year":"2000","unstructured":"Schweikard, A., Glosser, G., Bodduluri, M., Murphy, M. J. & Adler, J. R. Robotic motion compensation for respiratory movement during radiosurgery. Comput. Aided Surg. 5, 263\u2013277 (2000).","journal-title":"Comput. Aided Surg."},{"key":"2227_CR11","first-page":"233","volume":"2","author":"M Siddaiah-Subramanya","year":"2017","unstructured":"Siddaiah-Subramanya, M., Nyandowe, M. & Tiang, K. W. Technical problems during laparoscopy: a systematic method of troubleshooting for surgeons. Innov. Surg. Sci. 2, 233\u2013237 (2017).","journal-title":"Innov. Surg. Sci."},{"key":"2227_CR12","doi-asserted-by":"publisher","DOI":"10.1186\/s12938-018-0590-5","volume":"17","author":"C Wang","year":"2018","unstructured":"Wang, C., Alaya Cheikh, F., Kaaniche, M., Beghdadi, A. & Elle, O. J. Variational based smoke removal in laparoscopic images. BioMed. Eng. OnLine 17, 139 (2018).","journal-title":"BioMed. Eng. OnLine"},{"key":"2227_CR13","unstructured":"Clarivate. Journal Citation Reports. https:\/\/clarivate.com\/academia-government\/scientific-and-academic-research\/research-funding-analytics\/journal-citation-reports\/ (2025)."},{"key":"2227_CR14","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/TMI.2016.2593957","volume":"36","author":"AP Twinanda","year":"2017","unstructured":"Twinanda, A. P. et al. EndoNet: A deep architecture for recognition tasks on laparoscopic videos. IEEE Trans. Med. Imaging 36, 86\u201397 (2017).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"2227_CR15","doi-asserted-by":"crossref","unstructured":"Nwoye, C. I. et al. Recognition of Instrument-Tissue Interactions in Endoscopic Videos via Action Triplets. in Medical Image Computing and Computer Assisted Intervention \u2013 MICCAI 2020 (eds Martel, A. L. et al.) vol. 12263 364\u2013374 (Springer International Publishing, Cham, 2020).","DOI":"10.1007\/978-3-030-59716-0_35"},{"key":"2227_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2022.102433","volume":"78","author":"CI Nwoye","year":"2022","unstructured":"Nwoye, C. I. et al. Rendezvous: Attention mechanisms for the recognition of surgical action triplets in endoscopic videos. Med. Image Anal. 78, 102433 (2022).","journal-title":"Med. Image Anal."},{"key":"2227_CR17","doi-asserted-by":"publisher","unstructured":"Hong, W.-Y. et al. CholecSeg8k: A semantic segmentation dataset for laparoscopic cholecystectomy based on Cholec80. Preprint at https:\/\/doi.org\/10.48550\/ARXIV.2012.12453 (2020).","DOI":"10.48550\/ARXIV.2012.12453"},{"key":"2227_CR18","doi-asserted-by":"publisher","unstructured":"Stauder, R. et al. The TUM LapChole dataset for the M2CAI 2016 workflow challenge. Preprint at https:\/\/doi.org\/10.48550\/arXiv.1610.09278 (2017).","DOI":"10.48550\/arXiv.1610.09278"},{"key":"2227_CR19","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1038\/s41597-025-04642-4","volume":"12","author":"P Mascagni","year":"2025","unstructured":"Mascagni, P. et al. Endoscapes, a critical view of safety and surgical scene segmentation dataset for laparoscopic cholecystectomy. Sci Data 12, 331 (2025).","journal-title":"Sci Data"},{"key":"2227_CR20","doi-asserted-by":"publisher","first-page":"101920","DOI":"10.1016\/j.media.2020.101920","volume":"70","author":"T Ro\u00df","year":"2021","unstructured":"Ro\u00df, T. et al. Comparative validation of multi-instance instrument segmentation in endoscopy: Results of the ROBUST-MIS 2019 challenge. Med. Image Anal. 70, 101920 (2021).","journal-title":"Med. Image Anal."},{"key":"2227_CR21","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-021-00882-2","volume":"8","author":"L Maier-Hein","year":"2021","unstructured":"Maier-Hein, L. et al. Heidelberg colorectal data set for surgical data science in the sensor operating room. Sci. Data 8, 101 (2021).","journal-title":"Sci. Data"},{"key":"2227_CR22","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-022-01719-2","volume":"10","author":"M Carstens","year":"2023","unstructured":"Carstens, M. et al. The dresden surgical anatomy dataset for abdominal organ segmentation in surgical data science. Sci. Data 10, 3 (2023).","journal-title":"Sci. Data"},{"key":"2227_CR23","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1167\/tvst.9.8.22","volume":"9","author":"M Zarbin","year":"2020","unstructured":"Zarbin, M. What Constitutes Translational Research? Implications for the Scope of Translational Vision Science and Technology. Trans. Vis. Sci. Tech. 9, 22 (2020).","journal-title":"Trans. Vis. Sci. Tech."},{"key":"2227_CR24","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1038\/s43856-024-00492-0","volume":"4","author":"FR Kolbinger","year":"2024","unstructured":"Kolbinger, F. R., Veldhuizen, G. P., Zhu, J., Truhn, D. & Kather, J. N. Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis. Commun. Med. 4, 71 (2024).","journal-title":"Commun. Med."},{"key":"2227_CR25","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159 (1977).","journal-title":"Biometrics"},{"key":"2227_CR26","unstructured":"McDermott, K. & Liang, L. Overview of Operating Room Procedures During Inpatient Stays in U.S. Hospitals, 2018 #281. https:\/\/hcup-us.ahrq.gov\/reports\/statbriefs\/sb281-Operating-Room-Procedures-During-Hospitalization-2018.jsp."},{"key":"2227_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2024.103201","volume":"95","author":"H Wang","year":"2024","unstructured":"Wang, H. et al. A comprehensive survey on deep active learning in medical image analysis. Med. Image Anal. 95, 103201 (2024).","journal-title":"Med. Image Anal."},{"key":"2227_CR28","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1080\/24699322.2021.1937320","volume":"26","author":"TM Ward","year":"2021","unstructured":"Ward, T. M. et al. Challenges in surgical video annotation. Comput. Assist. Surg. 26, 58\u201368 (2021).","journal-title":"Comput. Assist. Surg."},{"key":"2227_CR29","doi-asserted-by":"publisher","first-page":"1710","DOI":"10.1097\/CCM.0000000000006359","volume":"52","author":"P Rockenschaub","year":"2024","unstructured":"Rockenschaub, P. et al. The impact of multi-institution datasets on the generalizability of machine learning prediction models in the ICU. Crit. Care Med. 52, 1710\u20131721 (2024).","journal-title":"Crit. Care Med."},{"key":"2227_CR30","doi-asserted-by":"publisher","first-page":"1052","DOI":"10.1093\/jamia\/ocx030","volume":"24","author":"SE Davis","year":"2017","unstructured":"Davis, S. E., Lasko, T. A., Chen, G., Siew, E. D. & Matheny, M. E. Calibration drift in regression and machine learning models for acute kidney injury. J. Am. Med. Inform. Assoc. 24, 1052\u20131061 (2017).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2227_CR31","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.ijmedinf.2017.03.006","volume":"102","author":"JH Chen","year":"2017","unstructured":"Chen, J. H., Alagappan, M., Goldstein, M. K., Asch, S. M. & Altman, R. B. Decaying relevance of clinical data towards future decisions in data-driven inpatient clinical order sets. Int. J. Med. Inform. 102, 71\u201379 (2017).","journal-title":"Int. J. Med. Inform."},{"key":"2227_CR32","unstructured":"Nestor, B. et al. Feature robustness in non-stationary health records: Caveats to deployable model performance in common clinical machine learning tasks. in Proceedings of the 4th Machine Learning for Healthcare Conference (eds Doshi-Velez, F. et al) vol. 106 381\u2013405 (PMLR, 2019)."},{"key":"2227_CR33","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1038\/s41746-022-00611-y","volume":"5","author":"J Feng","year":"2022","unstructured":"Feng, J. et al. Clinical artificial intelligence quality improvement: towards continual monitoring and updating of AI algorithms in healthcare. npj Digit. Med. 5, 66 (2022).","journal-title":"npj Digit. Med."},{"key":"2227_CR34","doi-asserted-by":"publisher","first-page":"e26162","DOI":"10.2196\/26162","volume":"23","author":"R Aggarwal","year":"2021","unstructured":"Aggarwal, R., Farag, S., Martin, G., Ashrafian, H. & Darzi, A. Patient perceptions on data sharing and applying artificial intelligence to health care data: Cross-sectional survey. J. Med Internet Res 23, e26162 (2021).","journal-title":"J. Med Internet Res"},{"key":"2227_CR35","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1038\/s41586-021-03583-3","volume":"594","author":"S Warnat-Herresthal","year":"2021","unstructured":"Warnat-Herresthal, S. et al. Swarm Learning for decentralized and confidential clinical machine learning. Nature 594, 265\u2013270 (2021).","journal-title":"Nature"},{"key":"2227_CR36","doi-asserted-by":"publisher","DOI":"10.1016\/j.xcrm.2024.101419","volume":"5","author":"ZL Teo","year":"2024","unstructured":"Teo, Z. L. et al. Federated machine learning in healthcare: A systematic review on clinical applications and technical architecture. Cell Rep. Med. 5, 101419 (2024).","journal-title":"Cell Rep. Med."},{"key":"2227_CR37","doi-asserted-by":"publisher","unstructured":"Kolbinger, F. R. et al. Appendix300: A multi-institutional laparoscopic appendectomy video dataset for computational modeling tasks. Preprint at https:\/\/doi.org\/10.1101\/2025.09.05.25335174 (2025).","DOI":"10.1101\/2025.09.05.25335174"},{"key":"2227_CR38","doi-asserted-by":"publisher","unstructured":"Saldanha, O. L. et al. Decentralized, privacy-preserving surgical video analysis with Swarm Learning. Preprint at https:\/\/doi.org\/10.1101\/2025.10.02.25337106 (2025).","DOI":"10.1101\/2025.10.02.25337106"},{"key":"2227_CR39","doi-asserted-by":"publisher","unstructured":"Christodoulou, E. et al. False Promises in Medical Imaging AI? Assessing Validity of Outperformance Claims. Preprint at https:\/\/doi.org\/10.48550\/ARXIV.2505.04720 (2025).","DOI":"10.48550\/ARXIV.2505.04720"},{"key":"2227_CR40","doi-asserted-by":"publisher","unstructured":"Alapatt, D. et al. The SAGES critical view of safety challenge: A global benchmark for AI-assisted surgical quality assessment. Preprint at https:\/\/doi.org\/10.48550\/ARXIV.2509.17100 (2025).","DOI":"10.48550\/ARXIV.2509.17100"},{"key":"2227_CR41","doi-asserted-by":"publisher","first-page":"e589","DOI":"10.1016\/S2589-7500(24)00095-5","volume":"6","author":"L Tikhomirov","year":"2024","unstructured":"Tikhomirov, L. et al. Medical artificial intelligence for clinicians: The lost cognitive perspective. Lancet Digital Health 6, e589\u2013e594 (2024).","journal-title":"Lancet Digital Health"},{"key":"2227_CR42","doi-asserted-by":"publisher","first-page":"1279629","DOI":"10.3389\/fdgth.2024.1279629","volume":"6","author":"VK B\u00fcrger","year":"2024","unstructured":"B\u00fcrger, V. K., Amann, J., Bui, C. K. T., Fehr, J. & Madai, V. I. The unmet promise of trustworthy AI in healthcare: why we fail at clinical translation. Front. Digit. Health 6, 1279629 (2024).","journal-title":"Front. Digit. Health"},{"key":"2227_CR43","doi-asserted-by":"publisher","unstructured":"Madai, V. I. & Higgins, D. C. Artificial Intelligence in Healthcare: Lost In Translation? Preprint at https:\/\/doi.org\/10.48550\/ARXIV.2107.13454 (2021).","DOI":"10.48550\/ARXIV.2107.13454"},{"key":"2227_CR44","doi-asserted-by":"publisher","unstructured":"Reinke A. et al. Current validation practice undermines surgical AI development. arXiV, https:\/\/doi.org\/10.48550\/arXiv.2511.03769 (2025)","DOI":"10.48550\/arXiv.2511.03769"},{"key":"2227_CR45","doi-asserted-by":"publisher","first-page":"e49023","DOI":"10.2196\/49023","volume":"2","author":"D Wilimitis","year":"2023","unstructured":"Wilimitis, D. & Walsh, C. G. Practical considerations and applied examples of cross-validation for model development and evaluation in health care: Tutorial. JMIR AI. 2, e49023 (2023).","journal-title":"JMIR AI."},{"key":"2227_CR46","first-page":"e220232","volume":"5","author":"TJ Bradshaw","year":"2023","unstructured":"Bradshaw, T. J., Huemann, Z., Hu, J. & Rahmim, A. A guide to cross-validation for artificial intelligence in medical imaging. Radiology: Artif. Intell. 5, e220232 (2023).","journal-title":"Radiology: Artif. Intell."},{"key":"2227_CR47","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-025-85420-5","volume":"15","author":"S Lee","year":"2025","unstructured":"Lee, S. et al. External validation of an artificial intelligence model using clinical variables, including ICD-10 codes, for predicting in-hospital mortality among trauma patients: a multicenter retrospective cohort study. Sci. Rep. 15, 1100 (2025).","journal-title":"Sci. Rep."},{"key":"2227_CR48","doi-asserted-by":"publisher","first-page":"18910","DOI":"10.1007\/s10489-023-04475-x","volume":"53","author":"U Dahmen","year":"2023","unstructured":"Dahmen, U., Osterloh, T. & Ro\u00dfmann, J. Structured validation of AI-based systems by virtual testing in simulated test scenarios. Appl Intell. 53, 18910\u201318924 (2023).","journal-title":"Appl Intell."},{"key":"2227_CR49","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1038\/s41592-023-02151-z","volume":"21","author":"L Maier-Hein","year":"2024","unstructured":"Maier-Hein, L. et al. Metrics reloaded: recommendations for image analysis validation. Nat. Methods 21, 195\u2013212 (2024).","journal-title":"Nat. Methods"},{"key":"2227_CR50","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-07619-7","volume":"9","author":"L Maier-Hein","year":"2018","unstructured":"Maier-Hein, L. et al. Why rankings of biomedical image analysis competitions should be interpreted with care. Nat. Commun. 9, 5217 (2018).","journal-title":"Nat. Commun."},{"key":"2227_CR51","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"EJ Topol","year":"2019","unstructured":"Topol, E. J. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 25, 44\u201356 (2019).","journal-title":"Nat. Med."},{"key":"2227_CR52","doi-asserted-by":"crossref","unstructured":"Christodoulou, E. et al. Confidence Intervals Uncovered: Are We Ready for Real-World Medical Imaging AI? in Medical Image Computing and Computer Assisted Intervention \u2013 MICCAI 2024 (eds Linguraru, M. G. et al.) vol. 15010 124\u2013132 (Springer Nature Switzerland, Cham, 2024).","DOI":"10.1007\/978-3-031-72117-5_12"},{"key":"2227_CR53","doi-asserted-by":"crossref","unstructured":"Lambert, B. Forbes, F., Doyle, S., Dehaene, H. & Dojat M. Trustworthy clinical AI solutions: A unified review of uncertainty quantification in Deep Learning models for medical image analysis. Artif. Intell. Med. 150, 102830 (2024).","DOI":"10.1016\/j.artmed.2024.102830"},{"key":"2227_CR54","doi-asserted-by":"crossref","unstructured":"Kolbinger. F. R. & Kather, J. N. Adaptive Validation Strategies for Real-World Clinical Artificial Intelligence. Nat. Comput. Sci. 5, 980\u2013986, (2025).","DOI":"10.1038\/s43588-025-00901-x"},{"key":"2227_CR55","doi-asserted-by":"publisher","first-page":"102545","DOI":"10.1016\/j.eclinm.2024.102545","volume":"70","author":"A Yiu","year":"2024","unstructured":"Yiu, A., Lam, K., Simister, C., Clarke, J. & Kinross, J. Adoption of routine surgical video recording: A nationwide freedom of information act request across England and Wales. eClinicalMedicine 70, 102545 (2024).","journal-title":"eClinicalMedicine"},{"key":"2227_CR56","doi-asserted-by":"publisher","unstructured":"Page, M. J. et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ n71 https:\/\/doi.org\/10.1136\/bmj.n71 (2021).","DOI":"10.1136\/bmj.n71"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02227-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02227-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02227-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T21:02:17Z","timestamp":1768942937000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-025-02227-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,17]]},"references-count":56,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["2227"],"URL":"https:\/\/doi.org\/10.1038\/s41746-025-02227-4","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,17]]},"assertion":[{"value":"16 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 November 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 December 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"D.A.H. is an independent consultant for Medtronic. F.R.K. declares advisory roles for Radical Healthcare, USA and the Surgical Data Science Collective, USA. The other authors declare no conflicts of interest.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"59"}}