{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T03:27:42Z","timestamp":1788924462975,"version":"build-2803163510"},"reference-count":48,"publisher":"IOP Publishing","issue":"19","license":[{"start":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T00:00:00Z","timestamp":1695686400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/iop-standard\/v1"},{"start":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T00:00:00Z","timestamp":1695686400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Health Care Project of China","award":["23BJZ39"],"award-info":[{"award-number":["23BJZ39"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Phys. Med. Biol."],"published-print":{"date-parts":[[2023,10,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    <jats:italic>Objective<\/jats:italic>\n                    . In brain tumor segmentation tasks, the convolutional neural network (CNN) or transformer is usually acted as the encoder since the encoder is necessary to be used. On one hand, the convolution operation of CNN has advantages of extracting local information although its performance of obtaining global expressions is bad. On the other hand, the attention mechanism of the transformer is good at establishing remote dependencies while it is lacking in the ability to extract high-precision local information. Either high precision local information or global contextual information is crucial in brain tumor segmentation tasks. The aim of this paper is to propose a brain tumor segmentation model that can simultaneously extract and fuse high-precision local and global contextual information.\n                    <jats:italic>Approach<\/jats:italic>\n                    . We propose a network model DE-Uformer with dual encoders to obtain local features and global representations using both CNN encoder and Transformer encoder. On the basis of this, we further propose the nested encoder-aware feature fusion (NEaFF) module for effective deep fusion of the information under each dimension. It may establishe remote dependencies of features under a single encoder via the spatial attention Transformer. Meanwhile ,it also investigates how features extracted from two encoders are related with the cross-encoder attention transformer.\n                    <jats:italic>Main results<\/jats:italic>\n                    . The proposed algorithm segmentation have been performed on BraTS2020 dataset and private meningioma dataset. Results show that it is significantly better than current state-of-the-art brain tumor segmentation methods.\n                    <jats:italic>Significance<\/jats:italic>\n                    . The method proposed in this paper greatly improves the accuracy of brain tumor segmentation. This advancement helps healthcare professionals perform a more comprehensive analysis and assessment of brain tumors, thereby improving diagnostic accuracy and reliability. This fully automated brain model segmentation model with high accuracy is of great significance for critical decisions made by physicians in selecting treatment strategies and preoperative planning.\n                  <\/jats:p>","DOI":"10.1088\/1361-6560\/acf911","type":"journal-article","created":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T18:39:16Z","timestamp":1694543956000},"page":"195019","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["DE-UFormer: U-shaped dual encoder architectures for brain tumor segmentation"],"prefix":"10.1088","volume":"68","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-0036-9806","authenticated-orcid":true,"given":"Yan","family":"Dong","sequence":"first","affiliation":[{"name":"Nanjing Tech University NanJing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ting","family":"Wang","sequence":"additional","affiliation":[{"name":"Nanjing Tech University NanJing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chiyuan","family":"Ma","sequence":"additional","affiliation":[{"name":"Nanjing University NanJing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenxing","family":"Li","sequence":"additional","affiliation":[{"name":"Nanjing University NanJing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryad","family":"Chellali","sequence":"additional","affiliation":[{"name":"Nanjing Tech University NanJing"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2023,9,26]]},"reference":[{"key":"pmbacf911bib1","doi-asserted-by":"publisher","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","type":"journal-article","article-title":"Segnet: a deep convolutional encoder\u2013decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"pmbacf911bib2","doi-asserted-by":"publisher","first-page":"R97","DOI":"10.1088\/0031-9155\/58\/13\/R97","type":"journal-article","article-title":"A survey of MRI-based medical image analysis for brain tumor studies","volume":"58","author":"Bauer","year":"2013","journal-title":"Phys. Med. Biol."},{"key":"pmbacf911bib3","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/978-3-031-25066-8_9","type":"conference-proceedings","article-title":"Swin-unet: Unet-like pure transformer for medical image segmentation","author":"Cao","year":"2023"},{"key":"pmbacf911bib4","doi-asserted-by":"publisher","first-page":"A057","DOI":"10.1007\/s00701-012-1273-9","type":"journal-article","article-title":"Computer-aided volumetric analysis as a sensitive tool for the management of incidental meningiomas","volume":"73","author":"Chang","year":"2012","journal-title":"J. Neurol. Surg."},{"key":"pmbacf911bib5","doi-asserted-by":"publisher","first-page":"786","DOI":"10.3390\/jpm11080786","type":"journal-article","article-title":"Automatic meningioma segmentation and grading prediction: a hybrid deep-learning method","volume":"11","author":"Chen","year":"2021a","journal-title":"J. Personalized Med."},{"key":"pmbacf911bib6","article-title":"Transunet: transformers make strong encoders for medical image segmentation","author":"Chen","year":"2021b","type":"preprint"},{"key":"pmbacf911bib7","doi-asserted-by":"publisher","first-page":"424","DOI":"10.1007\/978-3-319-46723-8_49","type":"conference-proceedings","article-title":"3D U-net: learning dense volumetric segmentation from sparse annotation","author":"Cicek","year":"2016"},{"key":"pmbacf911bib8","article-title":"An image is worth 16 x 16 words: transformers for image recognition at scale","author":"Dosovitskiy","year":"2020","type":"preprint"},{"key":"pmbacf911bib9","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","type":"journal-article","article-title":"Dermatologist-level classification of skin cancer with deep neural networks","volume":"542","author":"Esteva","year":"2017","journal-title":"Nature"},{"key":"pmbacf911bib10","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1016\/j.jceh.2015.08.001","type":"journal-article","article-title":"Magnetic resonance imaging: principles and techniques: lessons for clinicians","volume":"5","author":"Grover","year":"2015","journal-title":"J. Clin. Exp. Hepatol."},{"key":"pmbacf911bib11","doi-asserted-by":"publisher","first-page":"2281","DOI":"10.1109\/TMI.2019.2903562","type":"journal-article","article-title":"Ce-net: Context encoder network for 2D medical image segmentation","volume":"38","author":"Gu","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"pmbacf911bib12","doi-asserted-by":"publisher","first-page":"568","DOI":"10.1109\/JBHI.2019.2912935","type":"journal-article","article-title":"Fully dense unet for 2D sparse photoacoustic tomography artifact removal","volume":"24","author":"Guan","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"pmbacf911bib13","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1007\/978-3-031-08999-2_22","type":"conference-proceedings","article-title":"Swin unetr: swin transformers for semantic segmentation of brain tumors in mri images","author":"Hatamizadeh","year":"2022b"},{"key":"pmbacf911bib14","first-page":"1748","type":"conference-proceedings","article-title":"Unetr: transformers for 3D medical image segmentation","author":"Hatamizadeh","year":"2022a"},{"key":"pmbacf911bib15","article-title":"Axial attention in multidimensional transformers","author":"Ho","year":"2019","type":"preprint"},{"key":"pmbacf911bib16","doi-asserted-by":"publisher","first-page":"142","DOI":"10.4103\/2152-7806.85983","type":"journal-article","article-title":"Use of preoperative magnetic resonance imaging t1 and t2 sequences to determine intraoperative meningioma consistency","volume":"2","author":"Hoover","year":"2011","journal-title":"Surgical neurology international"},{"key":"pmbacf911bib17","first-page":"3464","type":"conference-proceedings","article-title":"Local relation networks for image recognition","author":"Hu","year":"2019"},{"key":"pmbacf911bib18","first-page":"1055","type":"conference-proceedings","article-title":"Unet 3+: a full-scale connected unet for medical image segmentation","author":"Huang","year":"2020"},{"key":"pmbacf911bib19","doi-asserted-by":"crossref","DOI":"10.24963\/ijcai.2022\/135","type":"preprint","article-title":"Scaleformer: revisiting the transformer-based backbones from a scale-wise perspective for medical image segmentation","author":"Huang","year":"2022"},{"key":"pmbacf911bib20","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1038\/s41592-020-01008-z","type":"journal-article","article-title":"nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation","volume":"18","author":"Isensee","year":"2021","journal-title":"Nat. Methods"},{"key":"pmbacf911bib21","doi-asserted-by":"publisher","first-page":"797","DOI":"10.3390\/brainsci12060797","type":"journal-article","article-title":"SwinBTS: a method for 3D multimodal brain tumor segmentation using swin transformer","volume":"12","author":"Jiang","year":"2022","journal-title":"Brain Sci."},{"key":"pmbacf911bib22","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1007\/s00330-018-5595-8","type":"journal-article","article-title":"Fully automated detection and segmentation of meningiomas using deep learning on routine multiparametric mri","volume":"29","author":"Laukamp","year":"2019","journal-title":"Eur. Radiol."},{"key":"pmbacf911bib23","doi-asserted-by":"crossref","first-page":"2663","DOI":"10.1109\/TMI.2018.2845918","type":"journal-article","article-title":"H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes","volume":"37","author":"Li","year":"2018","journal-title":"IEEE Trans. Med. Imaging"},{"key":"pmbacf911bib24","doi-asserted-by":"crossref","first-page":"3484","DOI":"10.1109\/TNNLS.2019.2892409","type":"journal-article","article-title":"Evaluate the malignancy of pulmonary nodules using the 3D deep leaky noisy-or network","volume":"30","author":"Liao","year":"2019","journal-title":"IEEE Trans Neural Netw. Learn. Syst."},{"key":"pmbacf911bib25","first-page":"10012","type":"conference-proceedings","article-title":"Swin transformer: hierarchical vision transformer using shifted windows","author":"Liu","year":"2021"},{"key":"pmbacf911bib26","first-page":"3431","type":"conference-proceedings","article-title":"Fully convolutional networks for semantic segmentation","author":"Long","year":"2015"},{"key":"pmbacf911bib27","doi-asserted-by":"crossref","first-page":"1993","DOI":"10.1109\/TMI.2014.2377694","type":"journal-article","article-title":"The multimodal brain tumor image segmentation benchmark (brats)","volume":"34","author":"Menze","year":"2014","journal-title":"IEEE Trans. Med. Imaging"},{"key":"pmbacf911bib28","first-page":"565","type":"conference-proceedings","article-title":"V-net: fully convolutional neural networks for volumetric medical image segmentation","author":"Milletari","year":"2016"},{"key":"pmbacf911bib29","first-page":"311","type":"conference-proceedings","article-title":"3D MRI brain tumor segmentation using autoencoder regularization, Brainlesion: Glioma, Multiple Sclerosis","volume":"4","author":"Myronenko","year":"2019"},{"key":"pmbacf911bib30","doi-asserted-by":"publisher","first-page":"896","DOI":"10.1093\/neuonc\/nou087","type":"journal-article","article-title":"The epidemiology of glioma in adults: a state of the science review","volume":"16","author":"Ostrom","year":"2014","journal-title":"Neuro-oncology"},{"key":"pmbacf911bib31","doi-asserted-by":"publisher","first-page":"v1","DOI":"10.1093\/neuonc\/noz150","type":"journal-article","article-title":"Cbtrus statistical report: primary brain and other central nervous system tumors diagnosed in the united states in 2012\u20132016","volume":"21","author":"Ostrom","year":"2019","journal-title":"Neuro-oncology"},{"key":"pmbacf911bib32","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-16443-9_16","type":"other","article-title":"A robust volumetric transformer for accurate 3D tumor segmentation","volume":"13435","author":"Peiris","year":"2022"},{"key":"pmbacf911bib33","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1146\/annurev.bioeng.2.1.315","type":"journal-article","article-title":"Current methods in medical image segmentation","volume":"2","author":"Pham","year":"2000","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"pmbacf911bib34","first-page":"68","type":"journal-article","article-title":"Stand-alone self-attention in vision models","volume":"32","author":"Ramachandran","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"pmbacf911bib35","first-page":"234","type":"conference-proceedings","article-title":"U-net: convolutional networks for biomedical image segmentation","author":"Ronneberger","year":"2015"},{"key":"pmbacf911bib36","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1109\/TMI.2002.808355","type":"journal-article","article-title":"A shape-based approach to the segmentation of medical imagery using level sets","volume":"22","author":"Tsai","year":"2003","journal-title":"IEEE Trans. Med. Imaging"},{"key":"pmbacf911bib37","article-title":"Instance normalization: the missing ingredient for fast stylization","author":"Ulyanov","year":"2016","type":"preprint"},{"key":"pmbacf911bib38","first-page":"36","type":"conference-proceedings","article-title":"Medical transformer: gated axialattention for medical image segmentation","author":"Valanarasu","year":"2021"},{"key":"pmbacf911bib39","first-page":"6000","type":"journal-article","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"pmbacf911bib40","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/j.mri.2019.05.043","type":"journal-article","article-title":"A review on brain tumor segmentation of mri images","volume":"61","author":"Wadhwa","year":"2019","journal-title":"Magn. Reson. Imaging"},{"key":"pmbacf911bib41","doi-asserted-by":"publisher","first-page":"2795","DOI":"10.1109\/TMI.2020.3047807","type":"journal-article","article-title":"Annotation-efficient deep learning for automatic medical image segmentation","volume":"40","author":"Wang","year":"2021b","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"pmbacf911bib42","first-page":"109","type":"conference-proceedings","article-title":"Transbts: multimodal brain tumor segmentation using transformer","author":"Wang","year":"2021a"},{"key":"pmbacf911bib43","first-page":"327","type":"conference-proceedings","article-title":"Weighted res-unet for high-quality retina vessel segmentation","author":"Xiao","year":"2018"},{"key":"pmbacf911bib44","first-page":"171","type":"conference-proceedings","article-title":"Cotr: Efficiently bridging cnn and transformer for 3d medical image segmentation","author":"Xie","year":"2021"},{"key":"pmbacf911bib45","doi-asserted-by":"crossref","first-page":"169350","DOI":"10.1109\/ACCESS.2019.2955101","type":"journal-article","article-title":"DMFNet: deep multi-modal fusion network for RGB-D indoor scene segmentation","volume":"7","author":"Yuan","year":"2019","journal-title":"IEEE Access"},{"key":"pmbacf911bib46","first-page":"107","type":"conference-proceedings","article-title":"mmformer: multimodal medical transformer for incomplete multimodal learning of brain tumor segmentation","author":"Zhang","year":"2022"},{"key":"pmbacf911bib47","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1109\/42.906424","type":"journal-article","article-title":"Segmentation of brain MR images through a hidden markov random field model and the expectation-maximization algorithm","volume":"20","author":"Zhang","year":"2001","journal-title":"IEEE Trans. Med. Imaging"},{"key":"pmbacf911bib48","article-title":"nnformer: interleaved transformer for volumetric segmentation","author":"Zhou","year":"2021","type":"preprint"}],"container-title":["Physics in Medicine &amp; Biology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T17:05:44Z","timestamp":1778778344000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/acf911"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,26]]},"references-count":48,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,9,26]]},"published-print":{"date-parts":[[2023,10,7]]}},"URL":"https:\/\/doi.org\/10.1088\/1361-6560\/acf911","relation":{},"ISSN":["0031-9155","1361-6560"],"issn-type":[{"value":"0031-9155","type":"print"},{"value":"1361-6560","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,26]]},"assertion":[{"value":"DE-UFormer: U-shaped dual encoder architectures for brain tumor segmentation","name":"article_title","label":"Article Title"},{"value":"Physics in Medicine & Biology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2023 Institute of Physics and Engineering in Medicine. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2023-04-24","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-09-12","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-09-26","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}