{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T16:28:32Z","timestamp":1772555312739,"version":"3.50.1"},"reference-count":31,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2024,10,14]],"date-time":"2024-10-14T00:00:00Z","timestamp":1728864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62271003"],"award-info":[{"award-number":["62271003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62201008"],"award-info":[{"award-number":["62201008"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Sci-Tech Innovation 2030 Agenda","award":["2022ZD0205200"],"award-info":[{"award-number":["2022ZD0205200"]}]},{"name":"Sci-Tech Innovation 2030 Agenda","award":["2022ZD0205204"],"award-info":[{"award-number":["2022ZD0205204"]}]},{"name":"Natural Science Foundation of Education Department of Anhui Province","award":["KJ2021A0017"],"award-info":[{"award-number":["KJ2021A0017"]}]},{"name":"University Synergy Innovation Program of Anhui Province","award":["GXXT-2021-001"],"award-info":[{"award-number":["GXXT-2021-001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Recent brain mapping efforts are producing large-scale whole-brain images using different imaging modalities. Accurate alignment and delineation of anatomical structures in these images are essential for numerous studies. These requirements are typically modeled as two distinct tasks: registration and segmentation. However, prevailing methods, fail to fully explore and utilize the inherent correlation and complementarity between the two tasks. Furthermore, variations in brain anatomy, brightness, and texture pose another formidable challenge in designing multi-modal similarity metrics. A high-throughput approach capable of overcoming the bottleneck of multi-modal similarity metric design, while effective leveraging the highly correlated and complementary nature of two tasks is highly desirable.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We introduce a deep learning framework for joint registration and segmentation of multi-modal brain images. Under this framework, registration and segmentation tasks are deeply coupled and collaborated at two hierarchical layers. In the inner layer, we establish a strong feature-level coupling between the two tasks by learning a unified common latent feature representation. In the outer layer, we introduce a mutually supervised dual-branch network to decouple latent features and facilitate task-level collaboration between registration and segmentation. Since the latent features we designed are also modality-independent, the bottleneck of designing multi-modal similarity metric is essentially addressed. Another merit offered by this framework is the interpretability of latent features, which allows intuitive manipulation of feature learning, thereby further enhancing network training efficiency and the performance of both tasks. Extensive experiments conducted on both multi-modal and mono-modal datasets of mouse and human brains demonstrate the superiority of our method.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>The code is available at https:\/\/github.com\/tingtingup\/DCRS.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btae606","type":"journal-article","created":{"date-parts":[[2024,10,14]],"date-time":"2024-10-14T14:37:27Z","timestamp":1728916647000},"source":"Crossref","is-referenced-by-count":4,"title":["Deep coupled registration and segmentation of multimodal whole-brain images"],"prefix":"10.1093","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-8419-1247","authenticated-orcid":false,"given":"Tingting","family":"Han","sequence":"first","affiliation":[{"name":"Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, School of Electronics and Information Engineering, Anhui University , Hefei, Anhui, 230601,","place":["China"]}]},{"given":"Jun","family":"Wu","sequence":"additional","affiliation":[{"name":"Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, School of Electronics and Information Engineering, Anhui University , Hefei, Anhui, 230601,","place":["China"]}]},{"given":"Pengpeng","family":"Sheng","sequence":"additional","affiliation":[{"name":"Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, School of Electronics and Information Engineering, Anhui University , Hefei, Anhui, 230601,","place":["China"]}]},{"given":"Yuanyuan","family":"Li","sequence":"additional","affiliation":[{"name":"Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, School of Electronics and Information Engineering, Anhui University , Hefei, Anhui, 230601,","place":["China"]}]},{"given":"ZaiYang","family":"Tao","sequence":"additional","affiliation":[{"name":"Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, School of Electronics and Information Engineering, Anhui University , Hefei, Anhui, 230601,","place":["China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2129-5253","authenticated-orcid":false,"given":"Lei","family":"Qu","sequence":"additional","affiliation":[{"name":"Ministry of Education Key Laboratory of Intelligent Computation and Signal Processing, Information Materials and Intelligent Sensing Laboratory of Anhui Province, School of Electronics and Information Engineering, Anhui University , Hefei, Anhui, 230601,","place":["China"]},{"name":"SEU-ALLEN Joint Center, Institute for Brain and Intelligence, Southeast University , Nanjing, Jiangsu, 210096,","place":["China"]},{"name":"Institute of Artiffcial Intelligence, Hefei Comprehensive National Science Center , Hefei, 231299,","place":["China"]},{"name":"Hefei National Laboratory, University of Science and Technology of China , Hefei, 230094,","place":["China"]}]}],"member":"286","published-online":{"date-parts":[[2024,10,14]]},"reference":[{"key":"2024110805210680800_btae606-B1","first-page":"13410","author":"Arar","year":"2020"},{"key":"2024110805210680800_btae606-B2","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.media.2007.06.004","article-title":"Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain","volume":"12","author":"Avants","year":"2008","journal-title":"Med Image Anal"},{"key":"2024110805210680800_btae606-B3","doi-asserted-by":"crossref","first-page":"1788","DOI":"10.1109\/TMI.2019.2897538","article-title":"VoxelMorph: a learning framework for deformable medical image registration","volume":"38","author":"Balakrishnan","year":"2019","journal-title":"IEEE Trans Med Imag"},{"key":"2024110805210680800_btae606-B4","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1023\/A:1007515423169","article-title":"An empirical comparison of voting classification algorithms: bagging, boosting, and variants","volume":"36","author":"Bauer","year":"1999","journal-title":"Mach Learn"},{"key":"2024110805210680800_btae606-B5","doi-asserted-by":"crossref","first-page":"102615","DOI":"10.1016\/j.media.2022.102615","article-title":"TransMorph: transformer for unsupervised medical image registration","volume":"82","author":"Chen","year":"2022","journal-title":"Med Image Anal"},{"key":"2024110805210680800_btae606-B6","first-page":"424","author":"\u00c7i\u00e7ek","year":"2016"},{"key":"2024110805210680800_btae606-B7","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1109\/TIP.2023.3240024","article-title":"Interpretable multi-modal image registration network based on disentangled convolutional sparse coding","volume":"32","author":"Deng","year":"2023","journal-title":"IEEE Trans Image Process"},{"key":"2024110805210680800_btae606-B8","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","article-title":"Measures of the amount of ecologic association between species","volume":"26","author":"Dice","year":"1945","journal-title":"Ecology"},{"key":"2024110805210680800_btae606-B9","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1038\/nmeth1036","article-title":"Ultramicroscopy: three-dimensional visualization of neuronal networks in the whole mouse brain","volume":"4","author":"Dodt","year":"2007","journal-title":"Nat Methods"},{"key":"2024110805210680800_btae606-B10","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1016\/j.neuron.2017.10.007","article-title":"The brain initiative cell census consortium: lessons learned toward generating a comprehensive brain cell atlas","volume":"96","author":"Ecker","year":"2017","journal-title":"Neuron"},{"key":"2024110805210680800_btae606-B11","doi-asserted-by":"crossref","first-page":"e10566","DOI":"10.7554\/eLife.10566","article-title":"A platform for brain-wide imaging and reconstruction of individual neurons","volume":"5","author":"Economo","year":"2016","journal-title":"Elife"},{"key":"2024110805210680800_btae606-B12","first-page":"310","author":"Estienne","year":"2019"},{"key":"2024110805210680800_btae606-B13","doi-asserted-by":"crossref","first-page":"12142","DOI":"10.1038\/ncomms12142","article-title":"High-throughput dual-colour precision imaging for brain-wide connectome with cytoarchitectonic landmarks at the cellular level","volume":"7","author":"Gong","year":"2016","journal-title":"Nat Commun"},{"key":"2024110805210680800_btae606-B14","first-page":"770","author":"He","year":"2020"},{"key":"2024110805210680800_btae606-B15","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1109\/JBHI.2021.3095409","article-title":"Few-shot learning for deformable medical image registration with perception-correspondence decoupling and reverse teaching","volume":"26","author":"He","year":"2021","journal-title":"IEEE J Biomed Health Inform"},{"key":"2024110805210680800_btae606-B16","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1016\/j.media.2012.05.008","article-title":"Mind: modality independent neighbourhood descriptor for multi-modal deformable registration","volume":"16","author":"Heinrich","year":"2012","journal-title":"Med Image Anal"},{"key":"2024110805210680800_btae606-B17","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1038\/nn.4332","article-title":"The mouse cortico-striatal projectome","volume":"19","author":"Hintiryan","year":"2016","journal-title":"Nat Neurosci"},{"key":"2024110805210680800_btae606-B151","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1007\/978-1-4612-4380-9_35","article-title":"Robust estimation of a location parameter","author":"Huber","year":"1992","journal-title":"Breakthroughs in Statistics: Methodology and Distribution"},{"key":"2024110805210680800_btae606-B18","author":"Kingma","year":"2014"},{"key":"2024110805210680800_btae606-B19","doi-asserted-by":"crossref","first-page":"33392","DOI":"10.3389\/fnins.2012.00171","article-title":"101 labeled brain images and a consistent human cortical labeling protocol","volume":"6","author":"Klein","year":"2012","journal-title":"Front Neurosci"},{"key":"2024110805210680800_btae606-B20","first-page":"249","author":"Qin","year":"2019"},{"key":"2024110805210680800_btae606-B21","doi-asserted-by":"crossref","first-page":"2499","DOI":"10.1109\/TASE.2021.3087868","article-title":"RSegNet: a joint learning framework for deformable registration and segmentation","volume":"19","author":"Qiu","year":"2021","journal-title":"IEEE Trans Automat Sci Eng"},{"key":"2024110805210680800_btae606-B22","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1038\/s41592-021-01334-w","article-title":"Cross-modal coherent registration of whole mouse brains","volume":"19","author":"Qu","year":"2022","journal-title":"Nat Methods"},{"key":"2024110805210680800_btae606-B23","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1109\/42.796284","article-title":"Nonrigid registration using free-form deformations: application to breast MR images","volume":"18","author":"Rueckert","year":"1999","journal-title":"IEEE Trans Med Imaging"},{"key":"2024110805210680800_btae606-B24","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1016\/j.neuroimage.2007.09.031","article-title":"Construction of a 3D probabilistic atlas of human cortical structures","volume":"39","author":"Shattuck","year":"2008","journal-title":"Neuroimage"},{"key":"2024110805210680800_btae606-B25","doi-asserted-by":"crossref","first-page":"936","DOI":"10.1016\/j.cell.2020.04.007","article-title":"The Allen mouse brain common coordinate framework: a 3D reference atlas","volume":"181","author":"Wang","year":"2020","journal-title":"Cell"},{"key":"2024110805210680800_btae606-B26","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1049\/ipr2.12419","article-title":"Medical image segmentation using deep learning: a survey","volume":"16","author":"Wang","year":"2022","journal-title":"IET Image Processing"},{"key":"2024110805210680800_btae606-B27","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: from error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans Image Process"},{"key":"2024110805210680800_btae606-B28","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1109\/TIP.2014.2387019","article-title":"Multimodal registration via mutual information incorporating geometric and spatial context","volume":"24","author":"Woo","year":"2014","journal-title":"IEEE Trans on Image Process"},{"key":"2024110805210680800_btae606-B29","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1038\/s41587-021-00986-5","article-title":"High-throughput mapping of a whole rhesus monkey brain at micrometer resolution","volume":"39","author":"Xu","year":"2021","journal-title":"Nat Biotechnol"},{"key":"2024110805210680800_btae606-B30","first-page":"420","author":"Xu","year":"2019"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btae606\/59748030\/btae606.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/11\/btae606\/60530406\/btae606.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/11\/btae606\/60530406\/btae606.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,8]],"date-time":"2024-11-08T05:21:50Z","timestamp":1731043310000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/doi\/10.1093\/bioinformatics\/btae606\/7821184"}},"subtitle":[],"editor":[{"given":"Macha","family":"Nikolski","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,10,14]]},"references-count":31,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2024,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btae606","relation":{},"ISSN":["1367-4811"],"issn-type":[{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,11]]},"published":{"date-parts":[[2024,10,14]]},"article-number":"btae606"}}