{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T03:23:34Z","timestamp":1785900214287,"version":"3.56.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T00:00:00Z","timestamp":1626220800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T00:00:00Z","timestamp":1626220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFC0409105"],"award-info":[{"award-number":["2019YFC0409105"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61801190"],"award-info":[{"award-number":["61801190"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Nature Science Foundation of Jilin Province","award":["20180101055JC"],"award-info":[{"award-number":["20180101055JC"]}]},{"name":"Industrial Technology Research and Development Funds of Jilin Province","award":["2019C054-3"],"award-info":[{"award-number":["2019C054-3"]}]},{"name":"\u201cThirteenth Five-Year Plan\u201d Scientific Research Planning Project of Education Department of Jilin Province","award":["JKH20200678KJ"],"award-info":[{"award-number":["JKH20200678KJ"]}]},{"name":"\u201cThirteenth Five-Year Plan\u201d Scientific Research Planning Project of Education Department of Jilin Province","award":["JJKH20200997KJ"],"award-info":[{"award-number":["JJKH20200997KJ"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>In medical diagnosis of brain, the role of multi-modal medical image fusion is becoming more prominent. Among them, there is no lack of filtering layered fusion and newly emerging deep learning algorithms. The former has a fast fusion speed but the fusion image texture is blurred; the latter has a better fusion effect but requires higher machine computing capabilities. Therefore, how to find a balanced algorithm in terms of image quality, speed and computing power is still the focus of all scholars.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We built an end-to-end Hahn-PCNN-CNN. The network is composed of feature extraction module, feature fusion module and image reconstruction module. We selected 8000 multi-modal brain medical images downloaded from the Harvard Medical School website to train the feature extraction layer and image reconstruction layer to enhance the network\u2019s ability to reconstruct brain medical images. In the feature fusion module, we use the moments of the feature map combined with the pulse-coupled neural network to reduce the information loss caused by convolution in the previous fusion module and save time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We choose eight sets of registered multi-modal brain medical images in four diease to verify our model. The anatomical structure images are from MRI and the functional metabolism images are SPECT and 18F-FDG. At the same time, we also selected eight representative fusion models as comparative experiments. In terms of objective quality evaluation, we select six evaluation metrics in five categories to evaluate our model.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The fusion image obtained by our model can retain the effective information in source images to the greatest extent. In terms of image fusion evaluation metrics, our model is superior to other comparison algorithms. In terms of time computational efficiency, our model also performs well. In terms of robustness, our model is very stable and can be generalized to multi-modal image fusion of other organs.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12880-021-00642-z","type":"journal-article","created":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T06:02:37Z","timestamp":1626242557000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Hahn-PCNN-CNN: an end-to-end multi-modal brain medical image fusion framework useful for clinical diagnosis"],"prefix":"10.1186","volume":"21","author":[{"given":"Kai","family":"Guo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiongfei","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaohan","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jichen","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tiehu","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,7,14]]},"reference":[{"key":"642_CR1","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1016\/j.eswa.2018.06.041","volume":"112","author":"KY Lim","year":"2018","unstructured":"Lim KY, Mandava R. A multi-phase semi-automatic approach for multisequence brain tumor image segmentation. Expert Syst Appl. 2018;112:288\u2013300.","journal-title":"Expert Syst Appl"},{"key":"642_CR2","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1038\/nrneurol.2017.44","volume":"13","author":"KJ Langen","year":"2017","unstructured":"Langen KJ, Galldiks N, Hattingen E, Shah NJ. Advances in neuro-oncology imaging. Nat Rev Neurol. 2017;13:279\u201389. https:\/\/doi.org\/10.1038\/nrneurol.2017.44.","journal-title":"Nat Rev Neurol"},{"key":"642_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.clinimag.2020.11.025","volume":"73","author":"D Nesselroth","year":"2021","unstructured":"Nesselroth D, Klang E, Soffer S, Druskin E, Zimlichman E. Yield of head CT for acute findings in patients presenting to the emergency department. Clin Imaging. 2021;73:1\u20135.","journal-title":"Clin Imaging"},{"issue":"1","key":"642_CR4","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1186\/s12880-017-0198-4","volume":"17","author":"N Sauwen","year":"2017","unstructured":"Sauwen N, Acou M, Sima D, Veraart J, Maes F, Himmelreich U, et al. Semi-automated brain tumor segmentation on multi-parametric mri using regularized non-negative matrix factorization. BMC Med Imaging. 2017;17(1):29.","journal-title":"BMC Med Imaging"},{"issue":"1","key":"642_CR5","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1186\/s12880-019-0348-y","volume":"19","author":"R Sun","year":"2019","unstructured":"Sun R, Wang K, Guo L, Yang C, Chen J, Ti Y, et al. A potential field segmentation based method for tumor segmentation on multi-parametric mri of glioma cancer patients. BMC Med Imaging. 2019;19(1):48.","journal-title":"BMC Med Imaging"},{"issue":"1","key":"642_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12880-018-0301-5","volume":"19","author":"Y Wu","year":"2019","unstructured":"Wu Y, Zhao Z, Wu W, Lin Y, Wang M. Automatic glioma segmentation based on adaptive superpixel. BMC Med Imaging. 2019;19(1):1\u201314.","journal-title":"BMC Med Imaging"},{"issue":"12","key":"642_CR7","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1016\/j.cancergen.2012.10.009","volume":"205","author":"M Goodenberger","year":"2012","unstructured":"Goodenberger M, Jenkins R. Genetics of adult glioma. Cancer Genet. 2012;205(12):613\u201321.","journal-title":"Cancer Genet"},{"key":"642_CR8","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/j.bspc.2014.11.009","volume":"18","author":"S Singh","year":"2015","unstructured":"Singh S, Gupta D, Anand R, Kumar V. Nonsubsampled shearlet based CT and MR medical image fusion using biologically inspired spiking neural network. Biomed Signal Process Control. 2015;18:91\u2013101.","journal-title":"Biomed Signal Process Control"},{"key":"642_CR9","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.dsp.2018.04.002","volume":"79","author":"H Shahdoosti","year":"2018","unstructured":"Shahdoosti H, Mehrabi A. Multimodal image fusion using sparse representation classification in tetrolet domain. Digit Signal Process. 2018;79:9\u201322.","journal-title":"Digit Signal Process"},{"key":"642_CR10","doi-asserted-by":"publisher","first-page":"22649","DOI":"10.1007\/s11042-017-5067-1","volume":"77","author":"H Shahdoosti","year":"2018","unstructured":"Shahdoosti H, Mehrabi A. MRI and PET image fusion using structure tensor and dual ripplet-II transform. Multimed Tools Appl. 2018;77:22649\u201370.","journal-title":"Multimed Tools Appl"},{"key":"642_CR11","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.inffus.2016.05.004","volume":"33","author":"S Li","year":"2016","unstructured":"Li S, Kang X, Fang L, Hu J, Yin H. Pixel-level image fusion: a survey of the state of the art. Inf Fusion. 2016;33:100\u201312.","journal-title":"Inf Fusion"},{"key":"642_CR12","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.inffus.2015.01.001","volume":"26","author":"Q Wang","year":"2015","unstructured":"Wang Q, Li S, Qin H, Hao A. Robust multi-modal medical image fusion via anisotropic heat diffusion guided low-rank structural analysis. Inf Fusion. 2015;26:103\u201321.","journal-title":"Inf Fusion"},{"key":"642_CR13","first-page":"66","volume":"6","author":"H Tanaka","year":"2011","unstructured":"Tanaka H, Hayashi S, Ohtakara K, Hoshi H, Iida T. Usefulness of ct-mri fusion in radiotherapy planning for localized prostate cancer. J Radiat Res. 2011;6:66.","journal-title":"J Radiat Res"},{"key":"642_CR14","first-page":"66","volume":"1","author":"M Yoshino","year":"2016","unstructured":"Yoshino M, Nakatomi T, Kin T, Saito T, Shono N, Nomura S, et al. Usefulness of high-resolution 3d multifusion medical imaging for preoperative planning in patients with posterior fossa hemangioblastoma: technical note. J Neurosurg. 2016;1:66.","journal-title":"J Neurosurg"},{"key":"642_CR15","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.neucom.2015.01.025","volume":"157","author":"G Bhatnagar","year":"2015","unstructured":"Bhatnagar G, Wu QJ, Liu Z. A new contrast based multimodal medical image fusion framework. Neurocomputing. 2015;157:143\u201352.","journal-title":"Neurocomputing"},{"key":"642_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neucom.2015.10.084","volume":"182","author":"B Yu","year":"2016","unstructured":"Yu B, Jia B, Ding L, Cai Z, Wu Q. Hybrid dual-tree complex wavelet transform and support vector machine for digital multi-focus image fusion. Neurocomputing. 2016;182:1\u20139.","journal-title":"Neurocomputing"},{"issue":"7","key":"642_CR17","doi-asserted-by":"publisher","first-page":"1334","DOI":"10.1016\/j.sigpro.2009.01.012","volume":"89","author":"Q Zhang","year":"2009","unstructured":"Zhang Q, Guo B. Multifocus image fusion using the nonsubsampled contourlet transform. Signal Process. 2009;89(7):1334\u201346.","journal-title":"Signal Process"},{"key":"642_CR18","doi-asserted-by":"crossref","unstructured":"Liu Y, Chen X, Cheng J, Peng H. A medical image fusion method based on convolutional neural networks. In: 2017 20th international conference on information fusion (Fusion). IEEE; 2017. p. 1\u20137","DOI":"10.23919\/ICIF.2017.8009769"},{"key":"642_CR19","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","volume":"24","author":"Y Liu","year":"2015","unstructured":"Liu Y, Liu S, Wang Z. A general framework for image fusion based on multi-scale transform and sparse representation. Inf Fusion. 2015;24:147\u201364.","journal-title":"Inf Fusion"},{"key":"642_CR20","doi-asserted-by":"publisher","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","volume":"22","author":"S Li","year":"2013","unstructured":"Li S, Kang X, Hu J. Image fusion with guided filtering. IEEE Trans Image Process. 2013;22:2864\u201375.","journal-title":"IEEE Trans Image Process"},{"issue":"5","key":"642_CR21","doi-asserted-by":"publisher","first-page":"2382","DOI":"10.1016\/j.eswa.2014.10.050","volume":"42","author":"X Zhang","year":"2015","unstructured":"Zhang X, Li X, Feng Y, Zhao H, Liu Z. Image fusion with internal generative mechanism. Expert Syst Appl. 2015;42(5):2382\u201391.","journal-title":"Expert Syst Appl"},{"key":"642_CR22","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","volume":"82","author":"J Ma","year":"2017","unstructured":"Ma J, Zhou Z, Wang B, Zong H. Infrared and visible image fusion based on visual saliency map and weighted least square optimization. Infrar Phys Technol. 2017;82:8\u2013171.","journal-title":"Infrar Phys Technol"},{"issue":"9","key":"642_CR23","doi-asserted-by":"publisher","first-page":"6880","DOI":"10.1109\/TIM.2020.2975405","volume":"69","author":"X Li","year":"2020","unstructured":"Li X, Guo X, Han P, Wang X, Li H, Luo T. Laplacian redecomposition for multimodal medical image fusion. IEEE Trans Instrum Meas. 2020;69(9):6880\u201390.","journal-title":"IEEE Trans Instrum Meas"},{"key":"642_CR24","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/j.imavis.2009.06.007","volume":"28","author":"Z Wang","year":"2010","unstructured":"Wang Z, Ma Y, Cheng F, Yang L. Review of pulse-coupled neural network. Image Vision Comput. 2010;28:5\u201313.","journal-title":"Image Vision Comput"},{"key":"642_CR25","doi-asserted-by":"crossref","unstructured":"Liu M, Gu K, Zhai G, Callet, PL. Visual saliency detection via image complexity feature. In: 2016 IEEE international conference on image processing (ICIP). IEEE; 2016. p. 2777\u201381.","DOI":"10.1109\/ICIP.2016.7532865"},{"issue":"4","key":"642_CR26","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1109\/TIP.2003.819861","volume":"13","author":"J Ma","year":"2004","unstructured":"Ma J, Yu W, Chen C, Liang P, Jiang J. Image quality assessment: from error measurement to structural similarity. IEEE Trans Image Process. 2004;13(4):600\u201312.","journal-title":"IEEE Trans Image Process"},{"key":"642_CR27","doi-asserted-by":"crossref","unstructured":"Piella G, Heijmans H. A new quality metric for image fusion. In: 2003 international conference on image processing (ICIP). IEEE; 2003. p. 173\u20136.","DOI":"10.1109\/ICIP.2003.1247209"},{"issue":"2","key":"642_CR28","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.inffus.2011.08.002","volume":"14","author":"Y Han","year":"2013","unstructured":"Han Y, Cai Y, Cao Y, Xu X. A new image fusion performance metric based on visual information fidelity. Inf Fusion. 2013;14(2):127\u201335.","journal-title":"Inf Fusion"},{"key":"642_CR29","doi-asserted-by":"crossref","unstructured":"Haghighat M, Razian MA. Fast-FMI: non-reference image fusion metric. In: 2014 IEEE 8th international conference on application of information and communication technologies (AICT). IEEE; 2014. p. 1\u20133.","DOI":"10.1109\/ICAICT.2014.7036000"},{"key":"642_CR30","first-page":"1","volume":"7","author":"J Demsar","year":"2006","unstructured":"Demsar J. Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res. 2006;7:1\u201330.","journal-title":"J Mach Learn Res"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-021-00642-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-021-00642-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-021-00642-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T02:44:26Z","timestamp":1725417866000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedimaging.biomedcentral.com\/articles\/10.1186\/s12880-021-00642-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,14]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["642"],"URL":"https:\/\/doi.org\/10.1186\/s12880-021-00642-z","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,14]]},"assertion":[{"value":"1 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 May 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The experimental protocol was established according to the ethical guidelines of the Helsinki Declaration and was approved by the Human Ethics Committee of the First Hospital of Jilin University. Informed consent was obtained from all participants.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Consent for publication was obtained from every individual whose data are included in this manuscript.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}],"article-number":"111"}}