{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T04:45:43Z","timestamp":1791780343969,"version":"4.3.4"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T00:00:00Z","timestamp":1791763200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T00:00:00Z","timestamp":1791763200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"NIH","award":["R01 CA280135"],"award-info":[{"award-number":["R01 CA280135"]}]},{"name":"NIH","award":["R01 CA258987"],"award-info":[{"award-number":["R01 CA258987"]}]},{"name":"NIH","award":["R01 EB034691"],"award-info":[{"award-number":["R01 EB034691"]}]},{"name":"NIH","award":["R01 CA240808"],"award-info":[{"award-number":["R01 CA240808"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis. Comput. Ind. Biomed. Art"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Accurate segmentation of lesions is fundamental for medical image analysis. However, most existing approaches are designed for specific anatomical sites and imaging modalities, limiting their applicability in heterogeneous clinical environments. Recent vision-language foundation models have enabled concept-driven segmentation of natural images, offering a promising path toward more flexible and generalizable medical image segmentation. However, to the best of the authors\u2019 knowledge, concept-prompt-based lesion segmentation in medical images, particularly using the latest Segment Anything Model 3 (SAM3), has not been thoroughly examined. In this paper, the authors present a systematic investigation of the SAM3 framework for lesion segmentation. An extensive evaluation of SAM3 was first conducted using geometric bounding boxes and concept-based text and image exemplars as prompts for lesion segmentation across multiple cancer types and imaging modalities, including magnetic resonance imaging, computed tomography, ultrasound, dermoscopy, and endoscopic imaging, with particular emphasis on volumetric medical imaging datasets. To improve robustness and segmentation accuracy, additional knowledge into the input representation was further integrated, including predictions from adjacent slices, multiparametric imaging information, and prior annotations. In addition, the study compared different SAM3 fine-tuning strategies on the BraTS2023-MET dataset, including partial module fine-tuning, adapter-based optimization, and full-model fine-tuning, under different training objectives. Extensive experiments conducted on 13 datasets covering 11 lesion types demonstrate that SAM3 achieves strong cross-modality generalization and accurate instance-specific lesion delineation. These results highlight the potential of concept-driven foundation models for scalable and practical medical-image segmentation in real-world clinical settings. The source code and dataset splits are publicly available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/apple1986\/lesion-sam3\" ext-link-type=\"uri\">https:\/\/github.com\/apple1986\/lesion-sam3<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1186\/s42492-026-00234-0","type":"journal-article","created":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T04:01:07Z","timestamp":1791777667000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Adapting Segment Anything Model 3 for concept-driven lesion segmentation in medical images: an experimental study"],"prefix":"10.1186","volume":"9","author":[{"given":"Guoping","family":"Xu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jayaram K","family":"Udupa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yubing","family":"Tong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Long","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Deng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiguo","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"You","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,10,12]]},"reference":[{"key":"234_CR1","unstructured":"Xu GP, Udupa JK, Luo J, Zhao SL, Yu YJ, Raymond SB et al (2025) Is the medical image segmentation problem solved? A survey of current developments and future directions. arXiv preprint arXiv: 2508.20139"},{"issue":"8","key":"234_CR2","doi-asserted-by":"publisher","first-page":"3467","DOI":"10.1002\/mp.14240","volume":"47","author":"GP Xu","year":"2020","unstructured":"Xu GP, Udupa JK, Tong YB, Odhner D, Cao HQ, Torigian DA (2020) AAR-LN-DQ: automatic anatomy recognition based disease quantification in thoracic lymph node zones via FDG PET\/CT images without nodal delineation. Med Phys 47(8):3467\u20133484. https:\/\/doi.org\/10.1002\/mp.14240","journal-title":"Med Phys"},{"key":"234_CR3","doi-asserted-by":"publisher","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Navab N, Hornegger J, Wells WM, Frangi AF (eds) Medical image computing and computer-assisted intervention-MICCAI 2015. 18th international conference, Munich, October 2015. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 9351. Springer, Cham, pp 234\u2013241. https:\/\/doi.org\/10.1007\/978-3-319-24574-4_28","DOI":"10.1007\/978-3-319-24574-4_28"},{"issue":"6","key":"234_CR4","doi-asserted-by":"publisher","first-page":"1856","DOI":"10.1109\/TMI.2019.2959609","volume":"39","author":"ZW Zhou","year":"2019","unstructured":"Zhou ZW, Siddiquee MR, Tajbakhsh N, Liang JM (2019) UNet++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans Med Imaging 39(6):1856\u20131867. https:\/\/doi.org\/10.1109\/TMI.2019.2959609","journal-title":"IEEE Trans Med Imaging"},{"issue":"4","key":"234_CR5","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","volume":"40","author":"LC Chen","year":"2018","unstructured":"Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2018) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834\u2013848. https:\/\/doi.org\/10.1109\/TPAMI.2017.2699184","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"234_CR6","doi-asserted-by":"publisher","unstructured":"Chen LC, Zhu YK, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision \u2013 ECCV 2018. 15th European conference, Munich, September 2018. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 11211. Springer, Cham, pp 833\u2013851. https:\/\/doi.org\/10.1007\/978-3-030-01234-2_49","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"234_CR7","doi-asserted-by":"publisher","unstructured":"Guo MH, Lu CZ, Hou QB, Liu ZN, Cheng MM, Hu SM (2022) SegNeXt: rethinking convolutional attention design for semantic segmentation. In: Proceedings of the 36th international conference on neural information processing systems, Curran Associates Inc., New Orleans, 28 November 2022. https:\/\/doi.org\/10.52202\/068431-0084","DOI":"10.52202\/068431-0084"},{"key":"234_CR8","doi-asserted-by":"publisher","unstructured":"Zhao HS, Shi JP, Qi XJ, Wang XG, Jia JY (2017) Pyramid scene parsing network. In: Proceedings of 2017 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Honolulu, 21\u201326 July 2017. https:\/\/doi.org\/10.1109\/CVPR.2017.660","DOI":"10.1109\/CVPR.2017.660"},{"key":"234_CR9","doi-asserted-by":"publisher","unstructured":"Xiao TT, Liu YC, Zhou BL, Jiang YN, Sun J (2018) Unified perceptual parsing for scene understanding. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer vision \u2013 ECCV 2018. 15th European conference, Munich, September 2018. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 11209. Springer, Cham, pp 432\u2013448. https:\/\/doi.org\/10.1007\/978-3-030-01228-1_26","DOI":"10.1007\/978-3-030-01228-1_26"},{"key":"234_CR10","doi-asserted-by":"publisher","first-page":"103280","DOI":"10.1016\/j.media.2024.103280","volume":"97","author":"JN Chen","year":"2024","unstructured":"Chen JN, Mei JR, Li XH, Lu YY, Yu QH, Wei QY et al (2024) TransUNet: rethinking the U-Net architecture design for medical image segmentation through the lens of transformers. Med Image Anal 97:103280. https:\/\/doi.org\/10.1016\/j.media.2024.103280","journal-title":"Med Image Anal"},{"key":"234_CR11","doi-asserted-by":"publisher","unstructured":"Xu GP, Zhang X, He XW, Wu XL (2023) LeViT-UNet: make faster encoders with transformer for medical image segmentation. In: Liu QS, Wang HZ, Ma ZY, Zheng WS, Zha HB, Chen XL et al (eds) Pattern recognition and computer vision. 6th Chinese conference, PRCV 2023, Xiamen, October 2023. Lecture notes in computer science, vol 14432. Springer, Singapore, pp 42\u201353. https:\/\/doi.org\/10.1007\/978-981-99-8543-2_4","DOI":"10.1007\/978-981-99-8543-2_4"},{"key":"234_CR12","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/978-3-031-25066-8_9","volume-title":"Computer vision \u2013 ECCV 2022 workshops. Tel Aviv, October 2022","author":"H Cao","year":"2022","unstructured":"Cao H, Wang YY, Chen J, Jiang DS, Zhang XP, Tian Q et al (2022) Swin-unet: unet-like pure transformer for medical image segmentation. In: Karlinsky L, Michaeli T, Nishino K (eds) Computer vision \u2013 ECCV 2022 workshops. Tel Aviv, October 2022. Lecture notes in computer science, vol 13803. Springer, Cham, pp 205\u2013218. https:\/\/doi.org\/10.1007\/978-3-031-25066-8_9"},{"key":"234_CR13","doi-asserted-by":"publisher","first-page":"7222","DOI":"10.1109\/TIP.2025.3623259","volume":"34","author":"ZQ Zhu","year":"2025","unstructured":"Zhu ZQ, Zhang ZM, Qi GQ, Li YY, Yang P, Liu Y (2025) Probability map-guided network for 3D volumetric medical image segmentation. IEEE Trans Image Process 34:7222\u20137234. https:\/\/doi.org\/10.1109\/TIP.2025.3623259","journal-title":"IEEE Trans Image Process"},{"key":"234_CR14","doi-asserted-by":"publisher","unstructured":"Hatamizadeh A, Tang YC, Nath V, Yang D, Myronenko A, Landman B et al (2022) UNETR: transformers for 3D medical image segmentation. In: Proceedings of 2022 IEEE\/CVF Winter Conference on Applications of Computer Vision, IEEE, Waikoloa, 3\u20138 January 2022. https:\/\/doi.org\/10.1109\/WACV51458.2022.00181","DOI":"10.1109\/WACV51458.2022.00181"},{"issue":"9","key":"234_CR15","doi-asserted-by":"publisher","first-page":"3377","DOI":"10.1109\/TMI.2024.3398728","volume":"43","author":"A Shaker","year":"2024","unstructured":"Shaker A, Maaz M, Rasheed H, Khan S, Yang MH, Khan FS (2024) UNETR++: delving into efficient and accurate 3D medical image segmentation. IEEE Trans Med Imaging 43(9):3377\u20133390. https:\/\/doi.org\/10.1109\/TMI.2024.3398728","journal-title":"IEEE Trans Med Imaging"},{"issue":"5","key":"234_CR16","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1111\/1754-9485.13261","volume":"65","author":"P Chlap","year":"2021","unstructured":"Chlap P, Min H, Vandenberg N, Dowling J, Holloway L, Haworth A (2021) A review of medical image data augmentation techniques for deep learning applications. J Med Imaging Radiat Oncol 65(5):545\u2013563. https:\/\/doi.org\/10.1111\/1754-9485.13261","journal-title":"J Med Imaging Radiat Oncol"},{"key":"234_CR17","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.media.2017.05.001","volume":"41","author":"Q Dou","year":"2017","unstructured":"Dou Q, Yu LQ, Chen H, Jin YM, Yang X, Qin J et al (2017) 3D deeply supervised network for automated segmentation of volumetric medical images. Med Image Anal 41:40\u201354. https:\/\/doi.org\/10.1016\/j.media.2017.05.001","journal-title":"Med Image Anal"},{"key":"234_CR18","doi-asserted-by":"publisher","first-page":"102826","DOI":"10.1016\/j.media.2023.102826","volume":"87","author":"B Murugesan","year":"2023","unstructured":"Murugesan B, Liu BY, Galdran A, Ayed IB, Dolz J (2023) Calibrating segmentation networks with margin-based label smoothing. Med Image Anal 87:102826. https:\/\/doi.org\/10.1016\/j.media.2023.102826","journal-title":"Med Image Anal"},{"issue":"3","key":"234_CR19","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s11263-026-02776-5","volume":"134","author":"Y Ding","year":"2026","unstructured":"Ding Y, Li S, Li HF, Qi GQ, Cong BS, Gong YP et al (2026) Physical regularization loss: integrating physical knowledge to image segmentation. Int J Comput Vis 134(3):137. https:\/\/doi.org\/10.1007\/s11263-026-02776-5","journal-title":"Int J Comput Vis"},{"issue":"12","key":"234_CR20","doi-asserted-by":"publisher","first-page":"3868","DOI":"10.1109\/TMI.2020.3006437","volume":"39","author":"A Mehrtash","year":"2020","unstructured":"Mehrtash A, Wells WM, Tempany CM, Abolmaesumi P, Kapur T (2020) Confidence calibration and predictive uncertainty estimation for deep medical image segmentation. IEEE Trans Med Imaging 39(12):3868\u20133878. https:\/\/doi.org\/10.1109\/TMI.2020.3006437","journal-title":"IEEE Trans Med Imaging"},{"issue":"12","key":"234_CR21","doi-asserted-by":"publisher","first-page":"8929","DOI":"10.1002\/mp.17399","volume":"51","author":"XS Leng","year":"2024","unstructured":"Leng XS, Wang XX, Yue WB, Jin JX, Xu GP (2024) Structural tensor and frequency guided semi-supervised segmentation for medical images. Med Phys 51(12):8929\u20138942. https:\/\/doi.org\/10.1002\/mp.17399","journal-title":"Med Phys"},{"key":"234_CR22","doi-asserted-by":"publisher","first-page":"2518511","DOI":"10.1109\/TIM.2025.3551581","volume":"74","author":"ZQ Zhu","year":"2025","unstructured":"Zhu ZQ, Wang ZD, Qi GQ, Zhao YX, Liu Y (2025) Visually Stabilized Mamba U-shaped network with strong inductive bias for 3-D brain tumor segmentation. IEEE Trans Instrum Meas 74:2518511. https:\/\/doi.org\/10.1109\/TIM.2025.3551581","journal-title":"IEEE Trans Instrum Meas"},{"key":"234_CR23","doi-asserted-by":"publisher","first-page":"112676","DOI":"10.1016\/j.engappai.2025.112676","volume":"162","author":"YY Li","year":"2025","unstructured":"Li YY, Duan YF, Qi GQ, Cong BS, Zhang L, Zhu ZQ (2025) A lightweight vision mamba coding UNet for medical image segmentation. Eng Appl Artif Intell 162:112676. https:\/\/doi.org\/10.1016\/j.engappai.2025.112676","journal-title":"Eng Appl Artif Intell"},{"issue":"1","key":"234_CR24","doi-asserted-by":"publisher","first-page":"566","DOI":"10.1038\/s41746-025-01964-w","volume":"8","author":"ZH Zhao","year":"2025","unstructured":"Zhao ZH, Zhang Y, Wu CY, Zhang XM, Zhou X, Zhang Y et al (2025) Large-vocabulary segmentation for medical images with text prompts. npj Digit Med 8(1):566. https:\/\/doi.org\/10.1038\/s41746-025-01964-w","journal-title":"npj Digit Med"},{"key":"234_CR25","unstructured":"BigScience Workshop (2022) BLOOM: a 176B-parameter open-access multilingual language model. arXiv preprint arXiv: 2211.05100"},{"key":"234_CR26","unstructured":"DeepSeek-AI (2024) DeepSeek-v3 technical report. arXiv preprint arXiv: 2412.19437"},{"key":"234_CR27","unstructured":"Sim\u00e9oni O, Vo HV, Seitzer M, Baldassarre F, Oquab M, Jose C et al (2025) DINOv3. arXiv preprint arXiv: 2508.10104"},{"key":"234_CR28","doi-asserted-by":"publisher","unstructured":"He KM, Chen XL, Xie SN, Li YH, Doll\u00e1r P, Girshick R (2022) Masked autoencoders are scalable vision learners. In: Proceedings of 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE, New Orleans, 18\u201324 June 2022. https:\/\/doi.org\/10.1109\/CVPR52688.2022.01553","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"234_CR29","doi-asserted-by":"publisher","unstructured":"Kirillov A, Mintun E, Ravi N, Mao HZ, Rolland C, Gustafson L et al (2023) Segment anything. In: Proceedings of 2023 IEEE\/CVF International Conference on Computer Vision, IEEE, Paris, 1\u20136 October 2023. https:\/\/doi.org\/10.1109\/ICCV51070.2023.00371","DOI":"10.1109\/ICCV51070.2023.00371"},{"issue":"1","key":"234_CR30","doi-asserted-by":"publisher","first-page":"654","DOI":"10.1038\/s41467-024-44824-z","volume":"15","author":"J Ma","year":"2024","unstructured":"Ma J, He YT, Li FF, Han L, You CY, Wang B (2024) Segment anything in medical images. Nat Commun 15(1):654. https:\/\/doi.org\/10.1038\/s41467-024-44824-z","journal-title":"Nat Commun"},{"key":"234_CR31","first-page":"51","volume-title":"Computer vision \u2013 ECCV 2024 workshops. Milan, 29 September\u20134 October 2024","author":"HY Wang","year":"2025","unstructured":"Wang HY, Guo SZ, Ye J, Deng ZY, Cheng JL, Li TB et al (2025) SAM-Med3D: towards general-purpose segmentation models for volumetric medical images. In: Foo N, Goebel R (eds) Computer vision \u2013 ECCV 2024 workshops. Milan, 29 September\u20134 October 2024. Lecture notes in computer science, vol 15638. Springer, Cham, pp 51\u201367"},{"key":"234_CR32","unstructured":"Ravi N, Gabeur V, Hu YT, Hu RH, Ryali C, Ma TY et al (2025) SAM 2: segment anything in images and videos. In: Proceedings of the 13th International Conference on Learning Representations, ICLR, OpenReview.net, Singapore, 24\u201328 April 2025"},{"issue":"4","key":"234_CR33","doi-asserted-by":"publisher","first-page":"045026","DOI":"10.1088\/2632-2153\/ae13d1","volume":"6","author":"GP Xu","year":"2025","unstructured":"Xu GP, Kabat C, Zhang Y (2025) Depthwise-dilated convolutional adapters for medical object tracking and segmentation using the segment anything model 2. Mach Learn Sci Technol 6(4):045026. https:\/\/doi.org\/10.1088\/2632-2153\/ae13d1","journal-title":"Mach Learn Sci Technol"},{"issue":"1","key":"234_CR34","doi-asserted-by":"publisher","first-page":"015003","DOI":"10.1088\/3049-477X\/ae291a","volume":"2","author":"GP Xu","year":"2026","unstructured":"Xu GP, Shao HC, Zhang Y (2026) TSMS-SAM2: multi-scale temporal sampling augmentation and memory-splitting pruning for promptable video object segmentation and tracking in surgical scenarios. Mach Learn Health 2(1):015003. https:\/\/doi.org\/10.1088\/3049-477X\/ae291a","journal-title":"Mach Learn Health"},{"key":"234_CR35","unstructured":"Carion N, Gustafson L, Hu YT, Debnath S, Hu RH, Suris D et al (2025) SAM 3: segment anything with concepts. arXiv preprint arXiv: 2511.16719"},{"key":"234_CR36","unstructured":"Sapkota R, Roumeliotis KI, Karkee M (2025) The SAM2-to-SAM3 gap in the segment anything model family: why prompt-based expertise fails in concept-driven image segmentation. arXiv preprint arXiv: 2512.06032"},{"key":"234_CR37","unstructured":"Chakrabarty S, Soni R (2026) Comparing SAM 2 and SAM 3 for zero-shot segmentation of 3D medical data. In: Proceedings of the 9th International Conference on Medical Imaging with Deep Learning, PMLR, Taipei, China, 8\u201310 July 2026"},{"key":"234_CR38","unstructured":"Chen TR, Cao RL, Yu XD, Zhu LY, Ding CT, Ji DY et al (2025) SAM3-adapter: efficient adaptation of segment anything 3 for camouflage object segmentation, shadow detection, and medical image segmentation. arXiv preprint arXiv: 2511.19425"},{"key":"234_CR39","unstructured":"Liu AL, Xue RD, Cao XR, Shen YF, Lu Y, Li X et al (2025) MedSAM3: delving into segment anything with medical concepts. arXiv preprint arXiv: 2511.19046"},{"key":"234_CR40","doi-asserted-by":"publisher","first-page":"101851","DOI":"10.1016\/j.compmedimag.2020.101851","volume":"88","author":"GP Xu","year":"2021","unstructured":"Xu GP, Cao HQ, Udupa JK, Tong YB, Torigian DA (2021) DiSegNet: a deep dilated convolutional encoder-decoder architecture for lymph node segmentation on PET\/CT images. Comput Med Imaging Graph 88:101851. https:\/\/doi.org\/10.1016\/j.compmedimag.2020.101851","journal-title":"Comput Med Imaging Graph"},{"key":"234_CR41","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.media.2018.11.002","volume":"51","author":"YB Tong","year":"2019","unstructured":"Tong YB, Udupa JK, Odhner D, Wu CY, Schuster SJ, Torigian DA (2019) Disease quantification on PET\/CT images without explicit object delineation. Med Image Anal 51:169\u2013183. https:\/\/doi.org\/10.1016\/j.media.2018.11.002","journal-title":"Med Image Anal"},{"key":"234_CR42","unstructured":"LaBella D, Baid U, Khanna O, McBurney-Lin S, McLean R, Nedelec P et al (2024) Analysis of the BraTS 2023 intracranial meningioma segmentation challenge. arXiv preprint arXiv: 2405.09787"},{"key":"234_CR43","doi-asserted-by":"publisher","first-page":"101821","DOI":"10.1016\/j.media.2020.101821","volume":"67","author":"N Heller","year":"2021","unstructured":"Heller N, Isensee F, Maier-Hein KH, Hou XS, Xie CM, Li FY et al (2021) The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: results of the KiTS19 challenge. Med Image Anal 67:101821. https:\/\/doi.org\/10.1016\/j.media.2020.101821","journal-title":"Med Image Anal"},{"key":"234_CR44","doi-asserted-by":"publisher","first-page":"102680","DOI":"10.1016\/j.media.2022.102680","volume":"84","author":"P Bilic","year":"2023","unstructured":"Bilic P, Christ P, Li HB, Vorontsov E, Ben-Cohen A, Kaissis G et al (2023) The liver tumor segmentation benchmark (LiTs). Med Image Anal 84:102680. https:\/\/doi.org\/10.1016\/j.media.2022.102680","journal-title":"Med Image Anal"},{"key":"234_CR45","doi-asserted-by":"publisher","first-page":"104863","DOI":"10.1016\/j.dib.2019.104863","volume":"28","author":"W Al-Dhabyani","year":"2020","unstructured":"Al-Dhabyani W, Gomaa M, Khaled H, Fahmy A (2020) Dataset of breast ultrasound images. Data Brief 28:104863. https:\/\/doi.org\/10.1016\/j.dib.2019.104863","journal-title":"Data Brief"},{"key":"234_CR46","unstructured":"Codella N, Rotemberg V, Tschandl P, Celebi ME, Dusza S, Gutman D et al (2019) Skin lesion analysis toward melanoma detection 2018: a challenge hosted by the international skin imaging collaboration (ISIC). arXiv preprint arXiv: 1902.03368"},{"key":"234_CR47","doi-asserted-by":"publisher","unstructured":"Jha D, Smedsrud PH, Riegler MA, Johansen D, De Lange T, Halvorsen P et al (2019) ResUNet++: an advanced architecture for medical image segmentation. In: Proceedings of 2019 IEEE International Symposium on Multimedia, IEEE, San Diego, 9\u201311 December 2019. https:\/\/doi.org\/10.1109\/ISM46123.2019.00049","DOI":"10.1109\/ISM46123.2019.00049"},{"issue":"2","key":"234_CR48","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","volume":"18","author":"F Isensee","year":"2021","unstructured":"Isensee F, Jaeger PF, Kohl SAA, Petersen J, Maier-Hein KH (2021) nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation. Nat Methods 18(2):203\u2013211. https:\/\/doi.org\/10.1038\/s41592-020-01008-z","journal-title":"Nat Methods"},{"key":"234_CR49","doi-asserted-by":"publisher","unstructured":"Cheng BW, Misra I, Schwing AG, Kirillov A, Girdhar R (2022) Masked-attention mask transformer for universal image segmentation. In: Proceedings of 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE, New Orleans, 18\u201324 June 2022. https:\/\/doi.org\/10.1109\/CVPR52688.2022.00135","DOI":"10.1109\/CVPR52688.2022.00135"},{"key":"234_CR50","doi-asserted-by":"publisher","unstructured":"Sheng JC, Liao YS, Huang CR (2023) Apply masked-attention mask transformer to instance segmentation in pathology images. In: Proceedings of the 2023 Sixth International Symposium on Computer, Consumer and Control, IEEE, Taichung, China, 30 June\u20133 July 2023. https:\/\/doi.org\/10.1109\/IS3C57901.2023.00098","DOI":"10.1109\/IS3C57901.2023.00098"},{"issue":"10","key":"234_CR51","doi-asserted-by":"publisher","first-page":"6031","DOI":"10.1109\/JBHI.2024.3406871","volume":"28","author":"YB Gu","year":"2024","unstructured":"Gu YB, Wu QY, Tang H, Mai XL, Shu HZ, Li BS et al (2024) LeSAM: adapt segment anything model for medical lesion segmentation. IEEE J Biomed Health Inform 28(10):6031\u20136041. https:\/\/doi.org\/10.1109\/JBHI.2024.3406871","journal-title":"IEEE J Biomed Health Inform"},{"key":"234_CR52","unstructured":"Zhu JY, Hamdi A, Qi Y, Jin YM, Wu JD (2024) Medical SAM 2: segment medical images as video via segment anything model 2. arXiv preprint arXiv: 2408.00874"},{"key":"234_CR53","unstructured":"Radford A, Kim JW, Hallacy C, Ramesh A, Goh G, Agarwal S et al (2021) Learning transferable visual models from natural language supervision. In: Proceedings of the 38th International Conference on Machine Learning, PMLR, Virtually, 18\u201324 July 2021"},{"key":"234_CR54","doi-asserted-by":"publisher","unstructured":"Liu SL, Zeng ZY, Ren TH, Li F, Zhang H, Yang J et al (2024) Grounding DINO: Marrying DINO with grounded pre-training for open-set object detection. In: Leonardis A, Ricci E, Roth S, Russakovsky O, Sattler T, Varol G (eds) Computer vision \u2013 ECCV 2024. 18th European conference, Milan, September 2024. Lecture notes in computer science, vol 15105. Springer, Cham, pp 38\u201355. https:\/\/doi.org\/10.1007\/978-3-031-72970-6_3","DOI":"10.1007\/978-3-031-72970-6_3"},{"key":"234_CR55","unstructured":"Ren TH, Chen YH, Jiang Q, Zeng ZY, Xiong YD, Liu WL et al (2024) DINO-X: a unified vision model for open-world object detection and understanding. arXiv preprint arXiv: 2411.14347"},{"key":"234_CR56","doi-asserted-by":"publisher","unstructured":"Bolya D, Huang PY, Sun PZ, Cho JH, Madotto A, Wei C et al (2025) Perception encoder: the best visual embeddings are not at the output of the network. In: Proceedings of Advances in Neural Information Processing Systems, NeurIPS, San Diego, 2\u20137 December 2025. https:\/\/doi.org\/10.52202\/085713-2036","DOI":"10.52202\/085713-2036"},{"issue":"1","key":"234_CR57","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1038\/s42256-024-00961-0","volume":"7","author":"HL Zheng","year":"2025","unstructured":"Zheng HL, Shen L, Tang AK, Luo Y, Hu H, Du B et al (2025) Learning from models beyond fine-tuning. Nat Mach Intell 7(1):6\u201317. https:\/\/doi.org\/10.1038\/s42256-024-00961-0","journal-title":"Nat Mach Intell"},{"key":"234_CR58","unstructured":"Sung YL, Nair V, Raffel C (2021) Training neural networks with fixed sparse masks. In: Proceedings of 34th International Conference on Neural Information Processing Systems, Curran Associates Inc., Virtually, 6\u201312 December 2021"},{"key":"234_CR59","doi-asserted-by":"publisher","unstructured":"Zaken EB, Goldberg Y, Ravfogel S (2022) BitFit: simple parameter-efficient fine-tuning for transformer-based masked language-models. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Dublin, 22\u201327 May 2022. https:\/\/doi.org\/10.18653\/v1\/2022.acl-short.1","DOI":"10.18653\/v1\/2022.acl-short.1"},{"key":"234_CR60","unstructured":"Houlsby N, Giurgiu A, Jastrzebski S, Morrone B, De Laroussilhe Q, Gesmundo A et al (2019) Parameter-efficient transfer learning for NLP. In: Proceedings of the 36th International Conference on Machine Learning, PMLR, Long Beach, 9\u201315 June 2019"},{"key":"234_CR61","unstructured":"Hu EJ, Shen YL, Wallis P, Allen-Zhu Z, Li YZ, Wang SA et al (2022) LoRA: low-rank adaptation of large language models. In: Proceedings of the 10th International Conference on Learning Representations, ICLR, OpenReview.net, 25\u201329 April 2022"},{"key":"234_CR62","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-4876632\/v1","author":"TR Chen","year":"2024","unstructured":"Chen TR, Lu AK, Zhu LY, Ding CT, Yu CN, Ji DY et al (2024) SAM2-adapter: evaluating & adapting segment anything 2 in downstream tasks: camouflage, shadow, medical image segmentation, and more. arXiv preprint arXiv: 2408.04579. https:\/\/doi.org\/10.21203\/rs.3.rs-4876632\/v1","journal-title":"arXiv preprint arXiv"},{"key":"234_CR63","doi-asserted-by":"publisher","first-page":"103324","DOI":"10.1016\/j.media.2024.103324","volume":"98","author":"SZ Gong","year":"2024","unstructured":"Gong SZ, Zhong Y, Ma WA, Li JP, Wang Z, Zhang JY et al (2024) 3DSAM-adapter: holistic adaptation of SAM from 2D to 3D for promptable tumor segmentation. Med Image Anal 98:103324. https:\/\/doi.org\/10.1016\/j.media.2024.103324","journal-title":"Med Image Anal"},{"key":"234_CR64","doi-asserted-by":"publisher","unstructured":"Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A, Zagoruyko S (2020) End-to-end object detection with transformers. In: Vedaldi A, Bischof H, Brox T, Frahm JM (eds) Computer vision \u2013 ECCV 2020. 16th European conference, Glasgow, August 2020. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 12346. Springer, Cham, pp 213\u2013229. https:\/\/doi.org\/10.1007\/978-3-030-58452-8_13","DOI":"10.1007\/978-3-030-58452-8_13"},{"issue":"2","key":"234_CR65","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/j.ijrobp.2017.10.020","volume":"100","author":"AU Pathmanathan","year":"2018","unstructured":"Pathmanathan AU, van As NJ, Kerkmeijer LGW, Christodouleas J, Lawton CAF, Vesprini D et al (2018) Magnetic resonance imaging-guided adaptive radiation therapy: a \u201cgame changer\u201d for prostate treatment? Int J Radiat Oncol Biol Phys 100(2):361\u2013373. https:\/\/doi.org\/10.1016\/j.ijrobp.2017.10.020","journal-title":"Int J Radiat Oncol Biol Phys"},{"key":"234_CR66","unstructured":"Moawad AW, Janas A, Baid U, Ramakrishnan D, Saluja R, Ashraf N et al (2023) The brain tumor segmentation (braTS-METS) challenge 2023: brain metastasis segmentation on pre-treatment MRI. arXiv preprint arXiv: 2306.00838"},{"issue":"1","key":"234_CR67","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1038\/s41597-022-01875-5","volume":"9","author":"MR Hernandez Petzsche","year":"2022","unstructured":"Hernandez Petzsche MR, de la Rosa E, Hanning U, Wiest R, Valenzuela W, Reyes M et al (2022) ISLES 2022: a multi-center magnetic resonance imaging stroke lesion segmentation dataset. Sci Data 9(1):762. https:\/\/doi.org\/10.1038\/s41597-022-01875-5","journal-title":"Sci Data"},{"issue":"1","key":"234_CR68","doi-asserted-by":"publisher","first-page":"4128","DOI":"10.1038\/s41467-022-30695-9","volume":"13","author":"M Antonelli","year":"2022","unstructured":"Antonelli M, Reinke A, Bakas S, Farahani K, Kopp-Schneider A, Landman BA et al (2022) The medical segmentation decathlon. Nat Commun 13(1):4128. https:\/\/doi.org\/10.1038\/s41467-022-30695-9","journal-title":"Nat Commun"},{"key":"234_CR69","unstructured":"Xu GP, Dai Y, Zhao HR, Zhang Y, Deng J, Lu WG et al (2025) SAM2-Aug: prior knowledge-based augmentation for target volume auto-segmentation in adaptive radiation therapy using segment anything model 2. arXiv preprint arXiv: 2507.19282"},{"issue":"12","key":"234_CR70","doi-asserted-by":"publisher","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","volume":"39","author":"V Badrinarayanan","year":"2017","unstructured":"Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481\u20132495. https:\/\/doi.org\/10.1109\/TPAMI.2016.2644615","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"234_CR71","unstructured":"Oktay O, Schlemper J, Le Folgoc L, Lee M, Heinrich M, Misawa K et al (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint arXiv:1804.03999"},{"key":"234_CR72","doi-asserted-by":"publisher","unstructured":"Myronenko A (2019) 3D MRI brain tumor segmentation using autoencoder regularization. In: Crimi A, Bakas S, Kuijf H, Keyvan F, Reyes M, van Walsum T (eds) Brainlesion: glioma, multiple sclerosis, stroke and traumatic brain injuries. 4th international workshop, BrainLes 2018, held in conjunction with MICCAI 2018, Granada, September 2018. Lecture notes in computer science (Image processing, computer vision, pattern recognition, and graphics), vol 11384. Springer, Cham, pp 311\u2013320. https:\/\/doi.org\/10.1007\/978-3-030-11726-9_28","DOI":"10.1007\/978-3-030-11726-9_28"},{"key":"234_CR73","unstructured":"Xie EZ, Wang WH, Yu ZD, Anandkumar A, Alvarez JM, Luo P (2021) SegFormer: simple and efficient design for semantic segmentation with transformers. In: Proceedings of Advances in Neural Information Processing Systems 34, Curran Associates Inc., Virtual, 6\u201314 December 2021"},{"key":"234_CR74","unstructured":"Dai HX, Ma C, Yan ZL, Liu ZL, Shi EZ, Li YW et al (2023) SAMaug: point prompt augmentation for segment anything model. arXiv preprint arXiv: 2307.01187"},{"key":"234_CR75","unstructured":"Shaharabany T, Dahan A, Giryes R, Wolf L (2023) AutoSAM: adapting SAM to medical images by overloading the prompt encoder. arXiv preprint arXiv: 2306.06370"},{"key":"234_CR76","doi-asserted-by":"publisher","unstructured":"Wahd AS, K\u00fcpper J, Jaremko JL, Hareendranathan AR (2024) Semantic AutoSAM: self-prompting segment anything model for semantic segmentation of medical images. In: Proceedings of the 2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, IEEE, Orlando, 15\u201319 July 2024. https:\/\/doi.org\/10.1109\/EMBC53108.2024.10782494","DOI":"10.1109\/EMBC53108.2024.10782494"},{"issue":"1","key":"234_CR77","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1007\/s44267-025-00106-w","volume":"4","author":"XY Xiong","year":"2026","unstructured":"Xiong XY, Wu ZH, Tan SY, Li WX, Tang FL, Chen Y et al (2026) SAM2-UNet: segment anything 2 makes strong encoder for natural and medical image segmentation. Vis Intell 4(1):2. https:\/\/doi.org\/10.1007\/s44267-025-00106-w","journal-title":"Vis Intell"},{"issue":"2","key":"234_CR78","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1002\/mp.17481","volume":"52","author":"YX Li","year":"2025","unstructured":"Li YX, Jing BW, Li ZH, Wang J, Zhang Y (2025) Plug-and-play segment anything model improves nnUNet performance. Med Phys 52(2):899\u2013912. https:\/\/doi.org\/10.1002\/mp.17481","journal-title":"Med Phys"},{"key":"234_CR79","doi-asserted-by":"publisher","unstructured":"Lin X, Xiang YY, Yu L, Yan ZQ (2024) Beyond adapting SAM: towards end-to-end ultrasound image segmentation via Auto Prompting. In: Linguraru MG, Dou Q, Feragen A, Giannarou S, Glocker B, Lekadir K et al (eds) Medical image computing and computer assisted intervention \u2013 MICCAI 2024. 27th international conference, Marrakesh, October 2024. Lecture notes in computer science, vol 15008. Springer, Cham, pp 24\u201334. https:\/\/doi.org\/10.1007\/978-3-031-72111-3_3","DOI":"10.1007\/978-3-031-72111-3_3"},{"key":"234_CR80","doi-asserted-by":"publisher","unstructured":"Mansoori M, Shahabodini S, Abouei J, Plataniotis KN, Mohammadi A (2025) Self-prompting polyp segmentation in colonoscopy using hybrid YOLO-SAM2 model. In: Proceedings of the 2025 IEEE International Conference on Acoustics, Speech and Signal Processing, IEEE, Hyderabad, 6\u201311 April 2025. https:\/\/doi.org\/10.1109\/ICASSP49660.2025.10887638","DOI":"10.1109\/ICASSP49660.2025.10887638"},{"key":"234_CR81","doi-asserted-by":"publisher","first-page":"105782","DOI":"10.1016\/j.imavis.2025.105782","volume":"164","author":"XZ Wang","year":"2025","unstructured":"Wang XZ, Wu SY, Wu JB, Li JH (2025) APSAM: adaptive progressive learning for segment anything model in anomaly detection. Image Vision Comput 164:105782. https:\/\/doi.org\/10.1016\/j.imavis.2025.105782","journal-title":"Image Vision Comput"},{"key":"234_CR82","doi-asserted-by":"publisher","unstructured":"Li JY, Udupa JK, Tong YB, Torigian DA (2025) Prediction of disease quantification via PET\/CT images and auto-segmentation of target objects. In: Proceedings of SPIE 13410, Medical Imaging 2025: Clinical and Biomedical Imaging, SPIE, San Diego, 16\u201321 February 2025. https:\/\/doi.org\/10.1117\/12.3047268","DOI":"10.1117\/12.3047268"},{"key":"234_CR83","doi-asserted-by":"publisher","unstructured":"Hall D, Udupa JK, Nln Y, Tong YB, Wu CY, Torigian DA (2026) Hybrid-intelligence framework for pathological liver segmentation and disease localization in CT imaging. In: Proceedings of SPIE 13926, Medical Imaging 2026: Computer-Aided Diagnosis, SPIE, Vancouver, 15\u201320 February 2026. https:\/\/doi.org\/10.1117\/12.3087377","DOI":"10.1117\/12.3087377"}],"container-title":["Visual Computing for Industry, Biomedicine, and Art"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42492-026-00234-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s42492-026-00234-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s42492-026-00234-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T04:01:17Z","timestamp":1791777677000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s42492-026-00234-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,12]]},"references-count":83,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["234"],"URL":"https:\/\/doi.org\/10.1186\/s42492-026-00234-0","relation":{},"ISSN":["2524-4442"],"issn-type":[{"value":"2524-4442","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,12]]},"assertion":[{"value":"21 March 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 October 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}],"article-number":"23"}}