{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T02:30:40Z","timestamp":1783650640305,"version":"3.55.0"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:00:00Z","timestamp":1760054400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:00:00Z","timestamp":1760054400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["KICH1.ST03.21.019"],"award-info":[{"award-number":["KICH1.ST03.21.019"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["OCENW.M.21.377"],"award-info":[{"award-number":["OCENW.M.21.377"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100023452","name":"Hanarth Fonds","doi-asserted-by":"publisher","award":["2022-13"],"award-info":[{"award-number":["2022-13"]}],"id":[{"id":"10.13039\/501100023452","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Surg Endosc"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Deep learning-based anatomy segmentation holds promise for improving real-time guidance in complex surgeries such as robot-assisted minimally invasive esophagectomy (RAMIE). However, the clinical relevance of commonly used metrics for evaluating segmentation quality remains unclear, as previous assessments have lacked direct input from surgeons. This study aims to assess how well quantitative segmentation metrics reflect surgeons\u2019 assessments of anatomical overlay accuracy and clinical usefulness during RAMIE.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conducted a survey involving 26 upper gastrointestinal surgeons, including both trainee and attending surgeons, who assessed video clips of RAMIE procedures featuring deep learning-generated anatomical overlays. We correlated the surgeons\u2019 qualitative evaluations of annotation accuracy and clinical usefulness with a comprehensive set of quantitative metrics, including overlap, distance, temporal, and error-specific measures. The analysis encompassed over 8000 manually annotated frames from 12 video clips, with overlays generated by two state-of-the-art deep learning models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Overlap and temporal consistency metrics show the strongest correlation with surgeon assessments. Distance-based and error-specific metrics correlate moderately. Novices show weaker correlations and tend to rate overlays more leniently. Qualitative feedback reveals issues like hallucinations and instability, often missed by current metrics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Standard quantitative metrics partially reflect surgeon perceptions but should be complemented by surgeon-informed evaluations and task-specific metrics to better capture clinically relevant errors. Aligning metric design with surgical expertise is essential for the safe and effective integration of AI-guided anatomical segmentation in the operating room.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Graphical abstract<\/jats:title>\n                  <\/jats:sec>","DOI":"10.1007\/s00464-025-12266-3","type":"journal-article","created":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:33:09Z","timestamp":1760113989000},"page":"277-290","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Do segmentation metrics reflect clinical reality? A surgeon-centered evaluation in robot-assisted minimally invasive esophagectomy"],"prefix":"10.1007","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-7806-4340","authenticated-orcid":false,"given":"Ronald","family":"de Jong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiping","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Romy","family":"van Jaarsveld","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gino","family":"Kuiper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"van Hillegersberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jelle","family":"Ruurda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Josien","family":"Pluim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcel","family":"Breeuwer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yasmina","family":"Al Khalil","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,10,10]]},"reference":[{"issue":"12","key":"12266_CR1","doi-asserted-by":"publisher","first-page":"8737","DOI":"10.1007\/s00464-022-09421-5","volume":"36","author":"R Den Boer","year":"2022","unstructured":"Den Boer R, Jongh C, Huijbers W, Jaspers T, Pluim J, Hillegersberg R, Van Eijnatten M, Ruurda J (2022) Computer-aided anatomy recognition in intrathoracic and-abdominal surgery: a systematic review. Surg Endosc 36(12):8737\u20138752. https:\/\/doi.org\/10.1007\/s00464-022-09421-5","journal-title":"Surg Endosc"},{"key":"12266_CR2","doi-asserted-by":"crossref","unstructured":"Jaspers TJM, Jong RLPD, Li Y, Kusters CHJ, Bakker FHA, Jaarsveld RC, Kuiper GM, Hillegersberg R, Ruurda JP, Brinkman WM, Pluim JPW, With PHN, Breeuwer M, Khalil YA, Sommen F (2025) Scaling up self-supervised learning for improved surgical foundation models. arXiv:2501.09436","DOI":"10.1016\/j.media.2025.103873"},{"issue":"3","key":"12266_CR3","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1002\/jso.23922","volume":"112","author":"J Ruurda","year":"2015","unstructured":"Ruurda J, Van Der Sluis P, Van Der Horst S, Van Hilllegersberg R (2015) Robot-assisted minimally invasive esophagectomy for esophageal cancer: a systematic review. J Surg Oncol 112(3):257\u2013265. https:\/\/doi.org\/10.1002\/jso.23922","journal-title":"J Surg Oncol"},{"issue":"6","key":"12266_CR4","doi-asserted-by":"publisher","first-page":"089","DOI":"10.1093\/dote\/doac089","volume":"36","author":"OJ Pickering","year":"2023","unstructured":"Pickering OJ, Van Boxel GI, Carter NC, Mercer SJ, Knight BC, Pucher PH (2023) Learning curve for adoption of robot-assisted minimally invasive esophagectomy: a systematic review of oncological, clinical, and efficiency outcomes. Dis Esophagus 36(6):089. https:\/\/doi.org\/10.1093\/dote\/doac089","journal-title":"Dis Esophagus"},{"issue":"4","key":"12266_CR5","doi-asserted-by":"publisher","first-page":"1024","DOI":"10.1016\/j.athoracsur.2017.11.058","volume":"105","author":"H Zhang","year":"2018","unstructured":"Zhang H, Chen L, Wang Z, Zheng Y, Geng Y, Wang F, Liu D, He A, Ma L, Yuan Y, Wang Y (2018) The learning curve for robotic McKeown esophagectomy in patients with esophageal cancer. Ann Thorac Surg 105(4):1024\u20131030. https:\/\/doi.org\/10.1016\/j.athoracsur.2017.11.058","journal-title":"Ann Thorac Surg"},{"issue":"1","key":"12266_CR6","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1016\/j.athoracsur.2018.01.038","volume":"106","author":"PC Sluis","year":"2018","unstructured":"Sluis PC, Ruurda JP, Horst S, Goense L, Hillegersberg R (2018) Learning curve for robot-assisted minimally invasive thoracoscopic esophagectomy: results from 312 cases. Ann Thorac Surg 106(1):264\u2013271. https:\/\/doi.org\/10.1016\/j.athoracsur.2018.01.038","journal-title":"Ann Thorac Surg"},{"key":"12266_CR7","doi-asserted-by":"publisher","first-page":"20200016","DOI":"10.1515\/cdbme-2020-0016","volume":"6","author":"PM Scheikl","year":"2020","unstructured":"Scheikl PM, Laschewski S, Kisilenko A, Davitashvili T, M\u00fcller B, Capek M, M\u00fcller-Stich BP, Wagner M, Mathis-Ullrich F (2020) Deep learning for semantic segmentation of organs and tissues in laparoscopic surgery. Curr Dir Biomed Eng 6:20200016. https:\/\/doi.org\/10.1515\/cdbme-2020-0016","journal-title":"Curr Dir Biomed Eng"},{"key":"12266_CR8","doi-asserted-by":"publisher","unstructured":"Mayank K, Kumar A, Jain P, Pal V (2024) Yogita: modified u-net based framework for laparoscopic procedures. In: 2024 Global conference on communications and information technologies (GCCIT), pp 1\u20137. https:\/\/doi.org\/10.1109\/GCCIT63234.2024.10862595","DOI":"10.1109\/GCCIT63234.2024.10862595"},{"issue":"1","key":"12266_CR9","doi-asserted-by":"publisher","first-page":"2329675","DOI":"10.1080\/24699322.2024.2329675","volume":"29","author":"S Ouyang","year":"2024","unstructured":"Ouyang S, He B, Luo H, Jia F (2024) Swind-net: a lightweight segmentation network for laparoscopic liver segmentation. Comput Assist Surg 29(1):2329675. https:\/\/doi.org\/10.1080\/24699322.2024.2329675","journal-title":"Comput Assist Surg"},{"key":"12266_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01332-6","volume":"20","author":"J Amann","year":"2020","unstructured":"Amann J, Blasimme A, Vayena E, Frey D, Madai VI (2020) Explainability for artificial intelligence in healthcare: a multidisciplinary perspective. BMC Med Inform Decis Mak 20:1\u20139. https:\/\/doi.org\/10.1186\/s12911-020-01332-6","journal-title":"BMC Med Inform Decis Mak"},{"issue":"1","key":"12266_CR11","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"EJ Topol","year":"2019","unstructured":"Topol EJ (2019) High-performance medicine: the convergence of human and artificial intelligence. Nat Med 25(1):44\u201356. https:\/\/doi.org\/10.1038\/s41591-018-0300-7","journal-title":"Nat Med"},{"key":"12266_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12916-019-1426-2","volume":"17","author":"CJ Kelly","year":"2019","unstructured":"Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D (2019) Key challenges for delivering clinical impact with artificial intelligence. BMC Med 17:1\u20139. https:\/\/doi.org\/10.1186\/s12916-019-1426-2","journal-title":"BMC Med"},{"key":"12266_CR13","doi-asserted-by":"publisher","unstructured":"Jong RLPD, Khalil Y, Jaspers TJM, Jaarsveld RC, Kuiper GM, Li Y, Hillegersberg R, Ruurda JP, Breeuwer M, Sommen F (2025) Benchmarking pretrained attention-based models for real-time recognition in robot-assisted esophagectomy. In: Medical imaging 2025: image-guided procedures, robotic interventions, and modeling, vol 13408. SPIE, San Diego, CA, USA, p 1340810. International Society for Optics and Photonics. https:\/\/doi.org\/10.1117\/12.3045187","DOI":"10.1117\/12.3045187"},{"key":"12266_CR14","doi-asserted-by":"publisher","unstructured":"Sofiiuk K, Petrov IA, Konushin A (2022) Reviving iterative training with mask guidance for interactive segmentation. In: 2022 IEEE international conference on image processing (ICIP). IEEE, pp 3141\u20133145. https:\/\/doi.org\/10.1109\/ICIP46576.2022.9897365","DOI":"10.1109\/ICIP46576.2022.9897365"},{"key":"12266_CR15","doi-asserted-by":"crossref","unstructured":"Cheng HK, Oh SW, Price B, Lee J-Y, Schwing A (2024) Putting the object back into video object segmentation. arXiv:2310.12982","DOI":"10.1109\/CVPR52733.2024.00304"},{"key":"12266_CR16","doi-asserted-by":"publisher","unstructured":"Farneb\u00e4ck G (2003) Two-frame motion estimation based on polynomial expansion. In: Image analysis: 13th Scandinavian conference, SCIA 2003 Halmstad, Sweden, 29 June\u20132 July 2003 proceedings 13. Springer, pp 363\u2013370. https:\/\/doi.org\/10.1007\/3-540-45103-X50","DOI":"10.1007\/3-540-45103-X50"}],"container-title":["Surgical Endoscopy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-025-12266-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00464-025-12266-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00464-025-12266-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T19:33:25Z","timestamp":1769024005000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00464-025-12266-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,10]]},"references-count":16,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["12266"],"URL":"https:\/\/doi.org\/10.1007\/s00464-025-12266-3","relation":{},"ISSN":["0930-2794","1432-2218"],"issn-type":[{"value":"0930-2794","type":"print"},{"value":"1432-2218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,10]]},"assertion":[{"value":"31 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Ronald de Jong, Gino Kuiper, and Josien Pluim received funding from the Dutch Research Council (NWO), study number KICH1.ST03.21.019, including in-kind contributions from Asensus and Rods & Cones. Yiping Li and Yasmina Al Khalil received funding from Stichting Hanarth Fonds, study number 2022-13. Romy van Jaarsveld received funding from the Dutch Research Council (NWO), study number OCENW.M.21.377. Jelle Ruurda received funding from Stichting Hanarth Fonds, study number 2022-13, and the Dutch Research Council (NWO), study number KICH1.ST03.21.019, including in-kind contributions from Asensus and Rods & Cones. Jelle Ruurda also has a consulting or advisory role for Intuitive Inc. and Medtronic. Richard van Hillegersberg has a consulting or advisory role for Intuitive Inc., Medtronic, and Olympus. Marcel Breeuwer has no conflicts of interest or financial ties to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosures"}}]}}