{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T00:44:21Z","timestamp":1792802661862,"version":"4.5.0"},"reference-count":54,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T00:00:00Z","timestamp":1762819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Precise breast ultrasound (BUS) segmentation supports reliable measurement, quantitative analysis, and downstream classification yet remains difficult for small or low-contrast lesions with fuzzy margins and speckle noise. Text prompts can add clinical context, but directly applying weakly localized text\u2013image cues (e.g., CAM\/CLIP-derived signals) tends to produce coarse, blob-like responses that smear boundaries unless additional mechanisms recover fine edges. Methods: We propose XBusNet, a novel dual-prompt, dual-branch multimodal model that combines image features with clinically grounded text. A global pathway based on a CLIP Vision Transformer encodes whole-image semantics conditioned on lesion size and location, while a local U-Net pathway emphasizes precise boundaries and is modulated by prompts that describe shape, margin, and Breast Imaging Reporting and Data System (BI-RADS) terms. Prompts are assembled automatically from structured metadata, requiring no manual clicks. We evaluate the model on the Breast Lesions USG (BLU) dataset using five-fold cross-validation. The primary metrics are Dice and Intersection over Union (IoU); we also conduct size-stratified analyses and ablations to assess the roles of the global and local paths and the text-driven modulation. Results: XBusNet achieves state-of-the-art performance on BLU, with a mean Dice of 0.8766 and IoU of 0.8150, outperforming six strong baselines. Small lesions show the largest gains, with fewer missed regions and fewer spurious activations. Ablation studies show complementary contributions of global context, local boundary modeling, and prompt-based modulation. Conclusions: A dual-prompt, dual-branch multimodal design that merges global semantics with local precision yields accurate BUS segmentation masks and improves robustness for small, low-contrast lesions.<\/jats:p>","DOI":"10.3390\/diagnostics15222849","type":"journal-article","created":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T10:56:27Z","timestamp":1762858587000},"page":"2849","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["XBusNet: Text-Guided Breast Ultrasound Segmentation via Multimodal Vision\u2013Language Learning"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-6750-5604","authenticated-orcid":false,"given":"Raja","family":"Mallina","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Nevada, Las Vegas, NV 89154, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2124-1032","authenticated-orcid":false,"given":"Bryar","family":"Shareef","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Nevada, Las Vegas, NV 89154, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,11]]},"reference":[{"key":"ref_1","unstructured":"American Cancer Society (2025, May 05). Key Statistics for Breast Cancer. Available online: https:\/\/www.cancer.org\/cancer\/types\/breast-cancer\/about\/how-common-is-breast-cancer.html."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1918","DOI":"10.1001\/jama.2024.5534","article-title":"Screening for Breast Cancer: US Preventive Services Task Force Recommendation Statement","volume":"331","author":"Nicholson","year":"2024","journal-title":"JAMA"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1016\/j.ejca.2010.02.015","article-title":"Magnetic resonance imaging of the breast: Recommendations from the EUSOMA working group","volume":"46","author":"Sardanelli","year":"2010","journal-title":"Eur. J. Cancer"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"168","DOI":"10.7326\/0003-4819-138-3-200302040-00008","article-title":"Individual and Combined Effects of Age, Breast Density, and Hormone Replacement Therapy Use on the Accuracy of Screening Mammography","volume":"138","author":"Carney","year":"2003","journal-title":"Ann. Intern. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6348","DOI":"10.1007\/s00330-024-10740-5","article-title":"ESR Essentials: Screening for breast cancer\u2014General recommendations by EUSOBI","volume":"34","author":"Marcon","year":"2024","journal-title":"Eur. Radiol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1007\/s13244-018-0636-z","article-title":"Breast ultrasound: Recommendations for information to women and referring physicians by the European Society of Breast Imaging","volume":"9","author":"Evans","year":"2018","journal-title":"Insights Imaging"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Xian, M., Cheng, H.D., Shareef, B., Ding, J., Xu, F., Huang, K., Zhang, B., Ning, C., and Wang, Y. (2022). BUSIS: A Benchmark for Breast Ultrasound Image Segmentation. Healthcare, 10.","DOI":"10.3390\/healthcare10040729"},{"key":"ref_8","unstructured":"Shareef, B.M., Xian, M., Sun, S., Vakanski, A., Ding, J., Ning, C., and Cheng, H.D. (2025, May 20). A Benchmark for Breast Ultrasound Image Classification. SSRN Working Paper. Available online: https:\/\/ssrn.com\/abstract=4339660."},{"key":"ref_9","unstructured":"D\u2019Orsi, C.J., Sickles, E.A., Mendelson, E.B., and Morris, E.A. (2013). ACR BI-RADS Atlas: Breast Imaging Reporting and Data System, American College of Radiology. [5th ed.]."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gu, J., and Jiang, T. (2022). Ultrasound radiomics in personalized breast management: Current status and future prospects. Front. Oncol., 12.","DOI":"10.3389\/fonc.2022.963612"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1109\/TMI.2006.877092","article-title":"Ultrasound image segmentation: A survey","volume":"25","author":"Noble","year":"2006","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_12","first-page":"234","article-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","volume":"Volume 9351","author":"Ronneberger","year":"2015","journal-title":"Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Proceedings of the 18th International Conference, Munich, Germany, 5\u20139 October 2015"},{"key":"ref_13","first-page":"3","article-title":"UNet++: A Nested U-Net Architecture for Medical Image Segmentation","volume":"Volume 11045","author":"Zhou","year":"2018","journal-title":"Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Proceedings of the DLMIA\/ML-CDS@MICCAI, Granada, Spain, 20 September 2018"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_16","unstructured":"Oktay, O., Schlemper, J., Folgoc, L.L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N.Y., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv."},{"key":"ref_17","unstructured":"Xie, Y., Yang, B., Guan, Q., Zhang, J., Wu, Q., and Xia, Y. (2023). Attention Mechanisms in Medical Image Segmentation: A Survey. arXiv."},{"key":"ref_18","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_19","unstructured":"Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Rodriguez, J., Huang, K., and Xu, M. (2024, January 15\u201317). Multi-Task Breast Ultrasound Image Classification and Segmentation Using Swin Transformer and VMamba Models. Proceedings of the 2024 7th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), Hangzhou, China.","DOI":"10.1109\/PRAI62207.2024.10827729"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Shareef, B., Xian, M., Vakanski, A., and Wang, H. (2023). Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network. Medical Image Computing and Computer Assisted Intervention\u2013MICCAI 2023, Proceedings of the 26th International Conference, Vancouver, BC, Canada, 8\u201312 October 2023, Springer Nature.","DOI":"10.1007\/978-3-031-43901-8_33"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1109\/TBME.2021.3117407","article-title":"Domain Adaptation for Medical Image Analysis: A Survey","volume":"69","author":"Guan","year":"2022","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Shareef, B., Xian, M., and Vakanski, A. (2020, January 3\u20137). STAN: Small Tumor-Aware Network for Breast Ultrasound Image Segmentation. Proceedings of the 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI), Iowa City, IA, USA.","DOI":"10.1109\/ISBI45749.2020.9098691"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Shareef, B., Vakanski, A., Freer, P.E., and Xian, M. (2022). ESTAN: Enhanced Small Tumor-Aware Network for Breast Ultrasound Image Segmentation. Healthcare, 10.","DOI":"10.3390\/healthcare10112262"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hsieh, Y.-H., Hsu, F.-R., Dai, S.-T., Huang, H.-Y., Chen, D.-R., and Shia, W.-C. (2022). Incorporating the Breast Imaging Reporting and Data System Lexicon with a Fully Convolutional Network for Malignancy Detection on Breast Ultrasound. Diagnostics, 12.","DOI":"10.3390\/diagnostics12010066"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1109\/TMI.2017.2743464","article-title":"Anatomically Constrained Neural Networks (ACNN): Application to Cardiac Image Enhancement and Segmentation","volume":"37","author":"Oktay","year":"2017","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"101851","DOI":"10.1016\/j.media.2020.101851","article-title":"Boundary loss for highly unbalanced segmentation","volume":"67","author":"Kervadec","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Karimi, D., and Salcudean, S.E. (2019). Reducing the Hausdorff Distance in Medical Image Segmentation with Convolutional Neural Networks. arXiv.","DOI":"10.1109\/TMI.2019.2930068"},{"key":"ref_29","unstructured":"Hu, X., Li, F., Samaras, D., and Chen, C. (2019, January 8\u201314). Topology-Preserving Deep Image Segmentation. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"103248","DOI":"10.1016\/j.cviu.2021.103248","article-title":"High-level prior-based loss functions for medical image segmentation: A survey","volume":"210","author":"Petitjean","year":"2021","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1260","DOI":"10.1109\/TIP.2002.804276","article-title":"Speckle reducing anisotropic diffusion","volume":"11","author":"Yu","year":"2002","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1016\/j.ultrasmedbio.2010.04.001","article-title":"A Critical Review and Uniformized Representation of Statistical Distributions Modeling the Envelope of Ultrasonic Echoes","volume":"36","author":"Destrempes","year":"2010","journal-title":"Ultrasound Med. Biol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"S22410","DOI":"10.1117\/1.JMI.10.S2.S22410","article-title":"Texture quantified from ultrasound Nakagami parametric images is diagnostically relevant for breast tumor characterization","volume":"10","author":"Muhtadi","year":"2023","journal-title":"J. Med. Imaging"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"872","DOI":"10.1109\/TUFFC.2024.3402560","article-title":"A systematized review of quantitative ultrasound based on first-order speckle statistics","volume":"71","author":"Christensen","year":"2024","journal-title":"IEEE Trans. Ultrason. Ferroelectr. Freq. Control"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.Y. (2023). Segment Anything. arXiv.","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"L\u00fcddecke, T., and Ecker, A.S. (2021). Image Segmentation Using Text and Image Prompts. arXiv.","DOI":"10.1109\/CVPR52688.2022.00695"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, S., Zeng, Z., Ren, T., Li, F., Zhang, H., Yang, J., Jiang, Q., Li, C., Yang, J., and Su, H. (2023). Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection. arXiv.","DOI":"10.1007\/978-3-031-72970-6_3"},{"key":"ref_38","unstructured":"Ren, T., Liu, S., Zeng, A., Lin, J., Li, K., Cao, H., Chen, J., Huang, X., Chen, Y., and Yan, F. (2024). Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks. arXiv."},{"key":"ref_39","unstructured":"Li, J., Li, D., Hoi, S.C.H., and Xiong, C. (2022, January 17\u201323). BLIP: Bootstrapping Language\u2013Image Pre-training for Unified Vision\u2013Language Understanding and Generation. Proceedings of the 39th International Conference on Machine Learning, Baltimore, MD, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft COCO: Common Objects in Context. Computer Vision\u2013ECCV 2014, Proceedings of the 13th European Conference, Zurich, Switzerland, 6\u201312 September 2014, Springer.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yu, L., Poirson, P., Yang, S., Berg, A.C., and Berg, T.L. (2016). Modeling Context in Referring Expressions. Computer Vision\u2013ECCV 2016, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11\u201314 October 2016, Springer.","DOI":"10.1007\/978-3-319-46475-6_5"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, Y., Yang, X., Liu, L., Zhou, H., Chang, A., Zhou, X., Chen, R., Yu, J., Chen, J., and Chen, C. (2024). Segment Anything Model for Medical Images?. arXiv.","DOI":"10.1016\/j.media.2023.103061"},{"key":"ref_43","unstructured":"Tu, Z., Gu, L., Wang, X., and Jiang, B. (2024). Ultrasound SAM Adapter: Adapting SAM for Breast Lesion Segmentation in Ultrasound Images. arXiv."},{"key":"ref_44","first-page":"1022","article-title":"Segment anything in medical images","volume":"15","author":"Ma","year":"2024","journal-title":"Nat. Commun."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zhang, K., and Liu, D. (2023). Customized Segment Anything Model for Medical Image Segmentation. arXiv.","DOI":"10.2139\/ssrn.4495221"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Sun, X., Wei, B., Jiang, Y., Mao, L., and Zhao, Q. (2024). CLIP-TNseg: A Multi-Modal Hybrid Framework for Thyroid Nodule Segmentation in Ultrasound Images. arXiv.","DOI":"10.1109\/LSP.2025.3556789"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wei, M., Zheng, Z., Hu, J., Shi, Y., Xiong, S., Zhu, X.X., and Mou, L. (2025). CausalCLIPSeg: Unlocking CLIP\u2019s Potential in Referring Medical Image Segmentation with Causal Intervention. arXiv.","DOI":"10.1007\/978-3-031-72384-1_8"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_49","unstructured":"Jain, S., and Wallace, B.C. (2019, January 2\u20137). Attention is not Explanation. Proceedings of the NAACL-HLT, Minneapolis, MN, USA."},{"key":"ref_50","unstructured":"Adebayo, J., Gilmer, J., Muelly, M., Goodfellow, I., Hardt, M., and Kim, B. (2018, January 3\u20138). Sanity Checks for Saliency Maps. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montreal, QC, Canada."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1038\/s41597-024-02984-z","article-title":"Curated benchmark dataset for ultrasound based breast lesion analysis","volume":"11","author":"Domalik","year":"2024","journal-title":"Sci. Data"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"104863","DOI":"10.1016\/j.dib.2019.104863","article-title":"Dataset of breast ultrasound images","volume":"28","author":"Gomaa","year":"2020","journal-title":"Data Brief"},{"key":"ref_53","unstructured":"Li, C., Liu, X., Li, W., Wang, C., Liu, H., Liu, Y., Chen, Z., and Yuan, Y. (March, January 25). U-KAN makes strong backbone for medical image segmentation and generation. Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence and Thirty-Seventh Conference on Innovative Applications of Artificial Intelligence and Fifteenth Symposium on Educational Advances in Artificial Intelligence, Philadelphia, PA, USA. AAAI\u201925\/IAAI\u201925\/EAAI\u201925."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Xu, M., Wang, Y., and Huang, K. (2025, January 14\u201317). Anatosegnet: Anatomy Based CNN-Transformer Network for Enhanced Breast Ultrasound Image Segmentation. Proceedings of the 2025 IEEE 22nd International Symposium on Biomedical Imaging (ISBI), Houston, TX, USA.","DOI":"10.1109\/ISBI60581.2025.10980919"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/22\/2849\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T05:25:12Z","timestamp":1763011512000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/15\/22\/2849"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,11]]},"references-count":54,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["diagnostics15222849"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics15222849","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,11]]}}}