{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T16:17:31Z","timestamp":1791303451946,"version":"4.1.0"},"reference-count":63,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T00:00:00Z","timestamp":1727395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Physiol."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Ultrasound imaging has become a crucial tool in medical diagnostics, offering real-time visualization of internal organs and tissues. However, challenges such as low contrast, high noise levels, and variability in image quality hinder accurate interpretation. To enhance the diagnostic accuracy and support treatment decisions, precise segmentation of organs and lesions in ultrasound image is essential. Recently, several deep learning methods, including convolutional neural networks (CNNs) and Transformers, have reached significant milestones in medical image segmentation. Nonetheless, there remains a pressing need for methods capable of seamlessly integrating global context with local fine-grained information, particularly in addressing the unique challenges posed by ultrasound images.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>In this paper, to address these issues, we propose DDTransUNet, a hybrid network combining Transformer and CNN, with a dual-branch encoder and dual attention mechanism for ultrasound image segmentation. DDTransUNet adopts a Swin Transformer branch and a CNN branch to extract global context and local fine-grained information. The dual attention comprising Global Spatial Attention (GSA) and Global Channel Attention (GCA) modules to capture long-range visual dependencies. A novel Cross Attention Fusion (CAF) module effectively fuses feature maps from both branches using cross-attention.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Experiments on three ultrasound image datasets demonstrate that DDTransUNet outperforms previous methods. In the TN3K dataset, DDTransUNet achieves IoU, Dice, HD95 and ACC metrics of 73.82%, 82.31%, 16.98\u00a0mm, and 96.94%, respectively. In the BUS-BRA dataset, DDTransUNet achieves 80.75%, 88.23%, 8.12\u00a0mm, and 98.00%. In the CAMUS dataset, DDTransUNet achieves 82.51%, 90.33%, 2.82\u00a0mm, and 96.87%.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>These results indicate that our method can provide valuable diagnostic assistance to clinical practitioners.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fphys.2024.1432987","type":"journal-article","created":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T04:54:46Z","timestamp":1727412886000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["A dual-branch and dual attention transformer and CNN hybrid network for ultrasound image segmentation"],"prefix":"10.3389","volume":"15","author":[{"given":"Chong","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lingtong","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guohui","family":"Wei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiyong","family":"Kong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min","family":"Qiu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,9,27]]},"reference":[{"key":"B1","article-title":"Deep learning using rectified linear units (ReLU)","author":"Agarap","year":"2018"},{"key":"B2","article-title":"Layer normalization","author":"Ba","year":"2016"},{"key":"B3","doi-asserted-by":"publisher","first-page":"107614","DOI":"10.1016\/j.cmpb.2023.107614","article-title":"BPAT-UNet: boundary preserving assembled transformer UNet for ultrasound thyroid nodule segmentation","volume":"238","author":"Bi","year":"2023","journal-title":"Comput. Methods Programs Biomed."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.inffus.2016.10.003","article-title":"MRI segmentation fusion for brain tumor detection","volume":"36","author":"Cabria","year":"2017","journal-title":"Inf. Fusion"},{"key":"B5","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/978-3-031-25066-8_9","article-title":"Swin-unet: unet-like pure transformer for medical image segmentation","volume-title":"Computer vision \u2013 ECCV 2022 workshops","author":"Cao","year":"2023"},{"key":"B6","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/978-3-030-58452-8_13","article-title":"End-to-End object detection with transformers","volume-title":"Computer vision \u2013 eccv 2020","author":"Carion","year":"2020"},{"key":"B7","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.neucom.2020.02.002","article-title":"MMFNet: a multi-modality MRI fusion network for segmentation of nasopharyngeal carcinoma","volume":"394","author":"Chen","year":"2020","journal-title":"Neurocomputing"},{"key":"B8","article-title":"TransUNet: transformers make strong encoders for medical image segmentation","author":"Chen","year":"2021"},{"key":"B9","doi-asserted-by":"publisher","first-page":"105329","DOI":"10.1016\/j.cmpb.2020.105329","article-title":"A review of thyroid gland segmentation and thyroid nodule segmentation methods for medical ultrasound images","volume":"185","author":"Chen","year":"2020","journal-title":"Comput. Methods Programs Biomed."},{"key":"B10","article-title":"Sam-med2d","author":"Cheng","year":"2023"},{"key":"B11","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1007\/978-3-319-46723-8_49","article-title":"3D U-net: learning dense volumetric segmentation from sparse annotation","volume-title":"Medical image computing and computer-assisted intervention \u2013 miccai 2016","author":"\u00c7i\u00e7ek","year":"2016"},{"key":"B12","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding","volume-title":"North American Chapter of the Association for computational linguistics","author":"Devlin","year":"2019"},{"key":"B13","first-page":"74","article-title":"DaViT: dual attention vision transformers","volume-title":"Computer vision \u2013 eccv","author":"Ding","year":"2022"},{"key":"B14","doi-asserted-by":"publisher","first-page":"4093","DOI":"10.1007\/s10462-019-09788-3","article-title":"Using deep learning techniques in medical imaging: a systematic review of applications on CT and PET","volume":"53","author":"Domingues","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"B15","article-title":"An image is worth 16x16 words: transformers for image recognition at scale","author":"Dosovitskiy","year":"2020"},{"key":"B16","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1002\/uog.22122","article-title":"Introduction to artificial intelligence in ultrasound imaging in obstetrics and gynecology","volume":"56","author":"Drukker","year":"2020","journal-title":"Ultrasound Obstetr. Gynecol."},{"key":"B17","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/978-3-030-87199-4_6","article-title":"UTNet: a hybrid transformer architecture for medical image segmentation","volume-title":"Medical image computing and computer assisted intervention \u2013 miccai 2021","author":"Gao","year":"2021"},{"key":"B18","doi-asserted-by":"publisher","first-page":"3110","DOI":"10.1002\/mp.16812","article-title":"BUS-BRA: a breast ultrasound dataset for assessing computer-aided diagnosis systems","volume":"51","author":"G\u00f3mez-Flores","year":"2024","journal-title":"Med. Phys."},{"key":"B19","first-page":"257","article-title":"Multi-task learning for thyroid nodule segmentation with thyroid region prior","author":"Gong","year":"2021"},{"key":"B20","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1007\/978-981-16-6775-6_38","article-title":"UNet-2022: exploring dynamics in non-isomorphic architecture","volume-title":"Medical imaging and computer-aided diagnosis","author":"Guo","year":"2023"},{"key":"B21","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1007\/978-3-031-08999-2_22","article-title":"Swin UNETR: Swin transformers for semantic segmentation of brain tumors in MRI images","volume-title":"Brainlesion: glioma, multiple sclerosis, stroke and traumatic brain injuries","author":"Hatamizadeh","year":"2022"},{"key":"B22","first-page":"1748","article-title":"UNETR: transformers for 3D medical image segmentation","author":"Hatamizadeh","year":"2021"},{"key":"B23","doi-asserted-by":"publisher","first-page":"5137904","DOI":"10.1155\/2018\/5137904","article-title":"Machine learning in ultrasound computer-aided diagnostic systems: a survey","volume":"2018","author":"Huang","year":"2018","journal-title":"BioMed Res. Int."},{"key":"B24","doi-asserted-by":"publisher","first-page":"1484","DOI":"10.1109\/TMI.2022.3230943","article-title":"MISSFormer: an effective transformer for 2D medical image segmentation","volume":"42","author":"Huang","year":"2023","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B25","article-title":"Batch normalization: accelerating deep network training by reducing internal covariate shift","volume-title":"Proceedings of the 32nd international conference on machine learning","author":"Ioffe","year":"2015"},{"key":"B26","first-page":"225","article-title":"ResUNet++: an advanced architecture for medical image segmentation","author":"Jha","year":"2019"},{"key":"B27","doi-asserted-by":"publisher","first-page":"102878","DOI":"10.1016\/j.media.2023.102878","article-title":"Robotic ultrasound imaging: state-of-the-art and future perspectives","volume":"89","author":"Jiang","year":"2023","journal-title":"Med. Image Anal."},{"key":"B28","doi-asserted-by":"crossref","first-page":"3992","DOI":"10.1109\/ICCV51070.2023.00371","article-title":"Segment anything","volume-title":"2023 IEEE\/CVF international conference on computer vision (ICCV)","author":"Kirillov","year":"2023"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1007","DOI":"10.1038\/s43588-023-00555-7","article-title":"Predicting emerging drug interactions using GNNs","volume":"3","author":"Le","year":"2023","journal-title":"Nat. Comput. Sci."},{"key":"B30","doi-asserted-by":"publisher","first-page":"2198","DOI":"10.1109\/TMI.2019.2900516","article-title":"Deep learning for segmentation using an open large-scale dataset in 2D echocardiography","volume":"38","author":"Leclerc","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B31","doi-asserted-by":"publisher","first-page":"102762","DOI":"10.1016\/j.media.2023.102762","article-title":"Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives","volume":"85","author":"Li","year":"2023","journal-title":"Med. Image Anal."},{"key":"B32","doi-asserted-by":"publisher","first-page":"106365","DOI":"10.1016\/j.compbiomed.2022.106365","article-title":"ATTransUNet: an enhanced hybrid transformer architecture for ultrasound and histopathology image segmentation","volume":"152","author":"Li","year":"2023","journal-title":"Comput. Biol. Med."},{"key":"B33","first-page":"14420","article-title":"EfficientViT: memory efficient vision transformer with cascaded group attention","author":"Liu","year":"2023"},{"key":"B34","first-page":"9992","article-title":"Swin transformer: hierarchical vision transformer using shifted windows","author":"Liu","year":"2021"},{"key":"B35","doi-asserted-by":"publisher","first-page":"654","DOI":"10.1038\/s41467-024-44824-z","article-title":"Segment anything in medical images","volume":"15","author":"Ma","year":"2024","journal-title":"Nat. Commun."},{"key":"B36","first-page":"565","article-title":"V-net: fully convolutional neural networks for volumetric medical image segmentation","author":"Milletari","year":"2016"},{"key":"B37","article-title":"Intriguing properties of vision transformers","volume-title":"Neural information processing systems","author":"Naseer","year":"2021"},{"key":"B38","article-title":"Unsupervised universal image segmentation","author":"Niu","year":"2023"},{"key":"B39","article-title":"Attention U-net: learning where to look for the pancreas","author":"Oktay","year":"2018"},{"key":"B40","article-title":"U-net v2: rethinking the skip connections of U-net for medical image segmentation","author":"Peng","year":"2023"},{"key":"B41","doi-asserted-by":"publisher","first-page":"106397","DOI":"10.1016\/j.bspc.2024.106397","article-title":"AD-DUNet: a dual-branch encoder approach by combining axial Transformer with cascaded dilated convolutions for liver and hepatic tumor segmentation","volume":"95","author":"Qi","year":"2024","journal-title":"Biomed. Signal Process. Control"},{"key":"B42","first-page":"234","article-title":"U-net: convolutional networks for biomedical image segmentation","volume-title":"Medical image computing and computer-assisted intervention \u2013 miccai 2015","author":"Ronneberger","year":"2015"},{"key":"B43","article-title":"UNETR++: delving into efficient and accurate 3D medical image segmentation","author":"Shaker","year":"2022"},{"key":"B44","doi-asserted-by":"publisher","first-page":"102802","DOI":"10.1016\/j.media.2023.102802","article-title":"Transformers in medical imaging: a survey","volume":"88","author":"Shamshad","year":"2023","journal-title":"Med. Image Anal."},{"key":"B45","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1109\/JPROC.2019.2932116","article-title":"Deep learning in ultrasound imaging","volume":"108","author":"Sloun","year":"2020","journal-title":"Proc. IEEE"},{"key":"B46","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1007\/978-3-319-60801-3_27","article-title":"Multilayer Perceptron (MLP)","volume-title":"Geomatic approaches for modeling land change scenarios","author":"Taud","year":"2018"},{"key":"B47","article-title":"Training data-efficient image transformers and distillation through attention","volume-title":"Proceedings of the 38th international conference on machine learning","author":"Touvron","year":"2021"},{"key":"B48","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1093\/bfgp\/elad031","article-title":"Omics-based deep learning approaches for lung cancer decision-making and therapeutics development","volume":"23","author":"Tran","year":"2023","journal-title":"Briefings Funct. Genomics"},{"key":"B49","first-page":"07197","article-title":"Are convolutional neural networks or transformers more like human vision?","author":"Tuli","year":"2021"},{"key":"B50","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/978-3-031-16443-9_3","article-title":"UNeXt: MLP-based rapid medical image segmentation network","volume-title":"Medical image computing and computer assisted intervention \u2013 miccai 2022","author":"Valanarasu","year":"2022"},{"key":"B51","article-title":"Attention is all you need","volume-title":"Neural information processing systems","author":"Vaswani","year":"2017"},{"key":"B52","first-page":"2390","article-title":"Mixed transformer U-net for medical image segmentation","author":"Wang","year":"2022"},{"key":"B53","first-page":"548","article-title":"Pyramid vision transformer: a versatile backbone for dense prediction without convolutions","author":"Wang","year":"2021"},{"key":"B54","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1016\/j.patcog.2018.02.012","article-title":"Automatic breast ultrasound image segmentation: a survey","volume":"79","author":"Xian","year":"2018","journal-title":"Pattern Recognit."},{"key":"B55","first-page":"327","article-title":"Weighted res-UNet for high-quality retina vessel segmentation","author":"Xiao","year":"2018"},{"key":"B56","first-page":"42","volume-title":"LeViT-UNet: make faster encoders with transformer for medical image segmentation","author":"Xu","year":"2024"},{"key":"B57","first-page":"508","volume-title":"UniSeg: a prompt-driven universal segmentation model as well as A strong representation learner","author":"Ye","year":"2023"},{"key":"B58","first-page":"538","article-title":"Tokens-to-Token ViT: training vision transformers from scratch on ImageNet","author":"Yuan","year":"2021"},{"key":"B59","doi-asserted-by":"publisher","first-page":"105427","DOI":"10.1016\/j.bspc.2023.105427","article-title":"HAU-Net: hybrid CNN-transformer for breast ultrasound image segmentation","volume":"87","author":"Zhang","year":"2024","journal-title":"Biomed. Signal Process. Control"},{"key":"B60","doi-asserted-by":"publisher","first-page":"4036","DOI":"10.1109\/TIP.2023.3293771","article-title":"nnFormer: volumetric medical image segmentation via a 3D transformer","volume":"32","author":"Zhou","year":"2023","journal-title":"IEEE Trans. Image Process."},{"key":"B61","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-030-00889-5_1","article-title":"UNet++: a nested U-net architecture for medical image segmentation","volume-title":"Deep learning in medical image analysis and multimodal learning for clinical decision support","author":"Zhou","year":"2018"},{"key":"B62","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1016\/j.inffus.2022.10.022","article-title":"Brain tumor segmentation based on the fusion of deep semantics and edge information in multimodal MRI","volume":"91","author":"Zhu","year":"2023","journal-title":"Inf. Fusion"},{"key":"B63","doi-asserted-by":"publisher","first-page":"110553","DOI":"10.1016\/j.patcog.2024.110553","article-title":"Brain tumor segmentation in MRI with multi-modality spatial information enhancement and boundary shape correction","volume":"153","author":"Zhu","year":"2024","journal-title":"Pattern Recognit."}],"container-title":["Frontiers in Physiology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2024.1432987\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T04:54:54Z","timestamp":1727412894000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fphys.2024.1432987\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,27]]},"references-count":63,"alternative-id":["10.3389\/fphys.2024.1432987"],"URL":"https:\/\/doi.org\/10.3389\/fphys.2024.1432987","relation":{},"ISSN":["1664-042X"],"issn-type":[{"value":"1664-042X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,27]]},"article-number":"1432987"}}