{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T08:36:35Z","timestamp":1773995795274,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T00:00:00Z","timestamp":1773792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Deep learning has achieved remarkable advancements in medical image segmentation, yet its generalization capability across unseen tasks remains a significant challenge. The variety of task objectives, disease-dependent labeling variations, and multi-center data contribute to the high uncertainty of task-specific models on unseen distributions. In this study, we propose PromptSeg, an innovative Transformer-based unified framework for universal 2D medical image segmentation. From an information-theoretic perspective, PromptSeg formulates the segmentation process as a conditional entropy minimization problem, utilizing visual prompts as side information to reduce the uncertainty of the target task. Guided by the information bottleneck principle, PromptSeg aims to utilize the provided visual prompts to filter out redundant noise and learn contextual representations, thereby breaking the restrictions of the task-specific paradigm. When faced with unseen datasets or segmentation targets, our method only requires a few annotated visual prompt pairs to extract task-specific semantics and segment the query images without retraining. Extensive experiments on CT and MRI datasets demonstrate that PromptSeg not only outperforms state-of-the-art methods but also exhibits strong multi-modality generalization capabilities.<\/jats:p>","DOI":"10.3390\/e28030342","type":"journal-article","created":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T17:12:26Z","timestamp":1773853946000},"page":"342","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["PromptSeg: An End-to-End Universal Medical Image Segmentation Method via Visual Prompts"],"prefix":"10.3390","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-4524-4830","authenticated-orcid":false,"given":"Minfan","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bingxun","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hong","family":"An","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Kamnitsas, K., Ferrante, E., Parisot, S., Ledig, C., Nori, A.V., Criminisi, A., Rueckert, D., and Glocker, B. (2016). DeepMedic for Brain Tumor Segmentation. Proceedings of the Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: Second International Workshop, BrainLes 2016, with the Challenges on BRATS, ISLES and mTOP 2016, Held in Conjunction with MICCAI 2016, Athens, Greece, 17 October 2016, Springer. Revised Selected Papers 2.","DOI":"10.1007\/978-3-319-55524-9_14"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","article-title":"nnU-Net: A Self-configuring Method for Deep Learning-based Biomedical Image Segmentation","volume":"18","author":"Isensee","year":"2021","journal-title":"Nat. Methods"},{"key":"ref_3","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015: 18th International Conference, Munich, Germany, 5\u20139 October 2015, Springer. Proceedings, Part III 18."},{"key":"ref_4","unstructured":"Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers Make Strong Encoders for Medical Image Segmentation. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Shi, J., Kan, H., Ruan, S., Zhu, Z., Zhao, M., Qiao, L., Wang, Z., An, H., and Xue, X. (2023). H-DenseFormer: An Efficient Hybrid Densely Connected Transformer for Multimodal Tumor Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-031-43901-8_66"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3","DOI":"10.4103\/0971-6203.58777","article-title":"Automated Medical Image Segmentation Techniques","volume":"35","author":"Sharma","year":"2010","journal-title":"J. Med. Phys."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sun, B., Feng, J., and Saenko, K. (2016, January 12\u201317). Return of Frustratingly Easy Domain Adaptation. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10306"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101840","DOI":"10.1016\/j.media.2020.101840","article-title":"Models Genesis","volume":"67","author":"Zhou","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Alzubaidi, L., Al-Amidie, M., Al-Asadi, A., Humaidi, A.J., Al-Shamma, O., Fadhel, M.A., Zhang, J., Santamar\u00eda, J., and Duan, Y. (2021). Novel Transfer Learning Approach for Medical Imaging with Limited Labeled Data. Cancers, 13.","DOI":"10.3390\/cancers13071590"},{"key":"ref_11","unstructured":"Ghafoorian, M., Mehrtash, A., Kapur, T., Karssemeijer, N., Marchiori, E., Pesteie, M., Guttmann, C.R., de Leeuw, F.E., Tempany, C.M., and Van Ginneken, B. (2017). Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation. Proceedings of the Medical Image Computing and Computer Assisted Intervention- MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, 11\u201313 September 2017, Springer. Proceedings, Part III 20."},{"key":"ref_12","unstructured":"Raghu, M., Zhang, C., Kleinberg, J., and Bengio, S. (2019). Transfusion: Understanding Transfer Learning for Medical Imaging. Adv. Neural Inf. Process. Syst., 32."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Shie, C.K., Chuang, C.H., Chou, C.N., Wu, M.H., and Chang, E.Y. (2015). Transfer Representation Learning for Medical Image Analysis. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE.","DOI":"10.1109\/EMBC.2015.7318461"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009). Imagenet: A Large-scale Hierarchical Image Database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_15","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft Coco: Common Objects in Context. Proceedings of the Computer Vision\u2013ECCV 2014: 13th European Conference, Zurich, Switzerland, 6\u201312 September 2014, Springer. Proceedings, Part V 13."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ouyang, C., Biffi, C., Chen, C., Kart, T., Qiu, H., and Rueckert, D. (2020). Self-supervision with Superpixels: Training Few-shot Medical Image Segmentation Without Annotation. Proceedings of the Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK, 23\u201328 August 2020, Springer. Proceedings, Part XXIX 16.","DOI":"10.1007\/978-3-030-58526-6_45"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lin, Y., Chen, Y., Cheng, K.T., and Chen, H. (2023). Few Shot Medical Image Segmentation with Cross Attention Transformer. arXiv.","DOI":"10.1007\/978-3-031-43895-0_22"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Wang, S., Xin, T., and Zhang, H. (2023). Few-Shot Medical Image Segmentation via a Region-Enhanced Prototypical Transformer. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-031-43901-8_26"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Butoi, V.I., Ortiz, J.J.G., Ma, T., Sabuncu, M.R., Guttag, J., and Dalca, A.V. (2023, January 2\u20133). Universeg: Universal Medical Image Segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Paris, France.","DOI":"10.1109\/ICCV51070.2023.01960"},{"key":"ref_20","first-page":"1877","article-title":"Language Models are Few-shot Learners","volume":"33","author":"Brown","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_21","first-page":"9","article-title":"Language Models are Unsupervised Multitask Learners","volume":"1","author":"Radford","year":"2019","journal-title":"OpenAI Blog"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"25005","DOI":"10.52202\/068431-1813","article-title":"Visual Prompting via Image Inpainting","volume":"35","author":"Bar","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bai, Y., Geng, X., Mangalam, K., Bar, A., Yuille, A., Darrell, T., Malik, J., and Efros, A.A. (2023). Sequential Modeling Enables Scalable Learning for Large Vision Models. arXiv.","DOI":"10.1109\/CVPR52733.2024.02157"},{"key":"ref_24","unstructured":"Dong, Q., Li, L., Dai, D., Zheng, C., Wu, Z., Chang, B., Sun, X., Xu, J., and Sui, Z. (2022). A Survey on In-context Learning. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"23716","DOI":"10.52202\/068431-1723","article-title":"Flamingo: A Visual Language Model for Few-shot Learning","volume":"35","author":"Alayrac","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.Y. (2023). Segment Anything. arXiv.","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, X., Wang, W., Cao, Y., Shen, C., and Huang, T. (2023, January 17\u201324). Images Speak in Images: A Generalist Painter for In-context Visual Learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPR52729.2023.00660"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, X., Zhang, X., Cao, Y., Wang, W., Shen, C., and Huang, T. (2023). Seggpt: Segmenting Everything in Context. arXiv.","DOI":"10.1109\/ICCV51070.2023.00110"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Esser, P., Rombach, R., and Ommer, B. (2021, January 20\u201325). Taming Transformers for High-resolution Image Synthesis. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01268"},{"key":"ref_30","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lambert, Z., Petitjean, C., Dubray, B., and Kuan, S. (2020). Segthor: Segmentation of Thoracic Organs at Risk in CT Images. Proceedings of the 2020 Tenth International Conference on Image Processing Theory, Tools and Applications (IPTA), IEEE.","DOI":"10.1109\/IPTA50016.2020.9286453"},{"key":"ref_32","unstructured":"Landman, B., Xu, Z., Igelsias, J., Styner, M., Langerak, T., and Klein, A. (2015, January 5\u20139). Miccai Multi-atlas Labeling Beyond the Cranial Vault\u2013Workshop and Challenge. Proceedings of the MICCAI Multi-Atlas Labeling Beyond Cranial Vault\u2014Workshop Challenge, Munich, Germany."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"101950","DOI":"10.1016\/j.media.2020.101950","article-title":"CHAOS Challenge-Combined (CT-MR) Healthy Abdominal Organ Segmentation","volume":"69","author":"Kavur","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"e230024","DOI":"10.1148\/ryai.230024","article-title":"TotalSegmentator: Robust Segmentation of 104 Anatomic Structures in CT Images","volume":"5","author":"Wasserthal","year":"2023","journal-title":"Radiol. Artif. Intell."},{"key":"ref_35","unstructured":"D\u2019Antonoli, T.A., Berger, L.K., Indrakanti, A.K., Vishwanathan, N., Wei\u00df, J., Jung, M., Berkarda, Z., Rau, A., Reisert, M., and K\u00fcstner, T. (2024). TotalSegmentator MRI: Robust Sequence-independent Segmentation of Multiple Anatomic Structures in MRI. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4128","DOI":"10.1038\/s41467-022-30695-9","article-title":"The Medical Segmentation Decathlon","volume":"13","author":"Antonelli","year":"2022","journal-title":"Nat. Commun."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"102166","DOI":"10.1016\/j.media.2021.102166","article-title":"VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Images","volume":"73","author":"Sekuboyina","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_38","first-page":"36722","article-title":"Amos: A Large-scale Abdominal Multi-organ Benchmark for Versatile Medical Image Segmentation","volume":"35","author":"Ji","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1118\/1.3528204","article-title":"The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): A Completed Reference Database of Lung Nodules on CT Scans","volume":"38","author":"Armato","year":"2011","journal-title":"Med. Phys."},{"key":"ref_40","unstructured":"Shi, J. (2023, December 24). StructSeg2019 GTV Segmentation. Available online: https:\/\/ieee-dataport.org\/documents\/structseg2019-gtv-segmentation."},{"key":"ref_41","unstructured":"An, P., Xu, S., Harmon, S.A., Turkbey, E.B., Sanford, T.H., Amalou, A., Kassin, M., Varble, N., Blain, M., and Anderson, V. (2023, December 24). CT Images in COVID-19. Available online: https:\/\/www.cancerimagingarchive.net\/collection\/ct-images-in-covid-19\/."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhao, M., Zhu, Z., Shi, J., Wang, Z., Chen, J., An, H., and Yan, B. (2025, January 6\u201311). PromptSeg: Learning to Segment Medical Image via Visual Prompts. Proceedings of the ICASSP 2025\u20142025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Hyderabad, India.","DOI":"10.1109\/ICASSP49660.2025.10889700"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/3\/342\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T05:23:11Z","timestamp":1773984191000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/3\/342"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,18]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["e28030342"],"URL":"https:\/\/doi.org\/10.3390\/e28030342","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,18]]}}}