{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T23:39:03Z","timestamp":1782257943839,"version":"3.54.5"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T00:00:00Z","timestamp":1671408000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T00:00:00Z","timestamp":1671408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFC0409105"],"award-info":[{"award-number":["2019YFC0409105"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2019YFC0409105"],"award-info":[{"award-number":["2019YFC0409105"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61801190"],"award-info":[{"award-number":["61801190"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61801190"],"award-info":[{"award-number":["61801190"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61801190"],"award-info":[{"award-number":["61801190"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Nature Science Foundation of Jilin Province"},{"name":"Nature Science Foundation of Jilin Province"},{"name":"Industrial Technology Research and Development Funds of Jilin Province","award":["2019C054-3"],"award-info":[{"award-number":["2019C054-3"]}]},{"name":"Industrial Technology Research and Development Funds of Jilin Province","award":["2019C054-3"],"award-info":[{"award-number":["2019C054-3"]}]},{"name":"Industrial Technology Research and Development Funds of Jilin Province","award":["2019C054-3"],"award-info":[{"award-number":["2019C054-3"]}]},{"name":"Industrial Technology Research and Development Funds of Jilin Province","award":["2019C054-3"],"award-info":[{"award-number":["2019C054-3"]}]},{"name":"\u201cThirteenth Five-Year Plan\u201d Scientific Research Planning Project of Education Department of Jilin Province","award":["JKH20200678KJ,JJKH20200997KJ"],"award-info":[{"award-number":["JKH20200678KJ,JJKH20200997KJ"]}]},{"name":"\u201cThirteenth Five-Year Plan\u201d Scientific Research Planning Project of Education Department of Jilin Province","award":["JKH20200678KJ,JJKH20200997KJ"],"award-info":[{"award-number":["JKH20200678KJ,JJKH20200997KJ"]}]},{"name":"\u201cThirteenth Five-Year Plan\u201d Scientific Research Planning Project of Education Department of Jilin Province","award":["JKH20200678KJ,JJKH20200997KJ"],"award-info":[{"award-number":["JKH20200678KJ,JJKH20200997KJ"]}]},{"name":"\u201cThirteenth Five-Year Plan\u201d Scientific Research Planning Project of Education Department of Jilin Province","award":["JKH20200678KJ,JJKH20200997KJ"],"award-info":[{"award-number":["JKH20200678KJ,JJKH20200997KJ"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>\n                           <jats:bold>Background<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>Today\u2019s biomedical imaging technology has been able to present the morphological structure or functional metabolic information of organisms at different scale levels, such as organ, tissue, cell, molecule and gene. However, different imaging modes have different application scope, advantages and disadvantages. In order to improve the role of medical image in disease diagnosis, the fusion of biomedical image information at different imaging modes and scales has become an important research direction in medical image. Traditional medical image fusion methods are all designed to measure the activity level and fusion rules. They are lack of mining the context features of different modes of image, which leads to the obstruction of improving the quality of fused images.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>\n                           <jats:bold>Method<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>In this paper, an attention-multiscale network medical image fusion model based on contextual features is proposed. The model selects five backbone modules in the VGG-16 network to build encoders to obtain the contextual features of medical images. It builds the attention mechanism branch to complete the fusion of global contextual features and designs the residual multiscale detail processing branch to complete the fusion of local contextual features. Finally, it completes the cascade reconstruction of features by the decoder to obtain the fused image.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>\n                           <jats:bold>Results<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>Ten sets of images related to five diseases are selected from the AANLIB database to validate the VANet model. Structural images are derived from MR images with high resolution and functional images are derived from SPECT and PET images that are good at describing organ blood flow levels and tissue metabolism. Fusion experiments are performed on twelve fusion algorithms including the VANet model. The model selects eight metrics from different aspects to build a fusion quality evaluation system to complete the performance evaluation of the fused images. Friedman\u2019s test and the post-hoc Nemenyi test are introduced to conduct professional statistical tests to demonstrate the superiority of VANet model.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>\n                           <jats:bold>Conclusions<\/jats:bold>\n                        <\/jats:title>\n                <jats:p>The VANet model completely captures and fuses the texture details and color information of the source images. From the fusion results, the metabolism and structural information of the model are well expressed and there is no interference of color information on the structure and texture; in terms of the objective evaluation system, the metric value of the VANet model is generally higher than that of other methods.; in terms of efficiency, the time consumption of the model is acceptable; in terms of scalability, the model is not affected by the input order of source images and can be extended to tri-modal fusion.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-022-05072-4","type":"journal-article","created":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T08:03:08Z","timestamp":1671436988000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["VANet: a medical image fusion model based on attention mechanism to assist disease diagnosis"],"prefix":"10.1186","volume":"23","author":[{"given":"Kai","family":"Guo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiongfei","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tiehu","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaohan","family":"Hu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,12,19]]},"reference":[{"key":"5072_CR1","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1016\/j.ins.2021.06.083","volume":"576","author":"J Fu","year":"2021","unstructured":"Fu J, Li W, Du J, Xu L. Dsagan: a generative adversarial network based on dual-stream attention mechanism for anatomical and functional image fusion. Inf Sci. 2021;576:484\u2013506.","journal-title":"Inf Sci"},{"issue":"3","key":"5072_CR2","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1002\/ima.22393","volume":"30","author":"P Ganasala","year":"2020","unstructured":"Ganasala P, Prasad AD. Medical image fusion based on laws of texture energy measures in stationary wavelet transform domain. Int J Imaging Syst Technol. 2020;30(3):544\u201357.","journal-title":"Int J Imaging Syst Technol"},{"key":"5072_CR3","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/j.bspc.2014.11.009","volume":"18","author":"S Singh","year":"2015","unstructured":"Singh S, Gupta D, Anand R, Kumar V. Nonsubsampled shearlet based ct and mr medical image fusion using biologically inspired spiking neural network. Biomed Signal Process Control. 2015;18:91\u2013101.","journal-title":"Biomed Signal Process Control"},{"key":"5072_CR4","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.dsp.2018.04.002","volume":"79","author":"HR Shahdoosti","year":"2018","unstructured":"Shahdoosti HR, Mehrabi A. Multimodal image fusion using sparse representation classification in tetrolet domain. Digit Signal Process. 2018;79:9\u201322.","journal-title":"Digit Signal Process"},{"issue":"17","key":"5072_CR5","doi-asserted-by":"publisher","first-page":"22649","DOI":"10.1007\/s11042-017-5067-1","volume":"77","author":"HR Shahdoosti","year":"2018","unstructured":"Shahdoosti HR, Mehrabi A. Mri and pet image fusion using structure tensor and dual ripplet-ii transform. Multimed Tools Appl. 2018;77(17):22649\u201370.","journal-title":"Multimed Tools Appl"},{"key":"5072_CR6","doi-asserted-by":"crossref","unstructured":"Li S, Kang X, Fang L, Hu J, Yin H. Pixel-level image fusion: a survey of the state of the art. Inf Fusion. 2017;33:100\u2013112.","DOI":"10.1016\/j.inffus.2016.05.004"},{"key":"5072_CR7","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.inffus.2015.01.001","volume":"26","author":"Q Wang","year":"2015","unstructured":"Wang Q, Li S, Qin H, Hao A. Robust multi-modal medical image fusion via anisotropic heat diffusion guided low-rank structural analysis. Inf Fusion. 2015;26:103\u201321.","journal-title":"Inf Fusion"},{"issue":"4","key":"5072_CR8","doi-asserted-by":"publisher","first-page":"1132","DOI":"10.1109\/TBME.2014.2372011","volume":"62","author":"S Liu","year":"2014","unstructured":"Liu S, Liu S, Cai W, Che H, Pujol S, Kikinis R, Feng D, Fulham MJ, et al. Multimodal neuroimaging feature learning for multiclass diagnosis of alzheimer\u2019s disease. IEEE Trans Biomed Eng. 2014;62(4):1132\u201340.","journal-title":"IEEE Trans Biomed Eng"},{"key":"5072_CR9","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1016\/j.patcog.2016.09.032","volume":"63","author":"B Shi","year":"2017","unstructured":"Shi B, Chen Y, Zhang P, Smith CD, Liu J, Initiative ADN, et al. Nonlinear feature transformation and deep fusion for Alzheimer\u2019s disease staging analysis. Pattern Recognit. 2017;63:487\u201398.","journal-title":"Pattern Recognit"},{"key":"5072_CR10","unstructured":"Singh V, Verma NK, Ul\u00a0Islam Z, Cui Y. Feature learning using stacked autoencoder for shared and multimodal fusion of medical images. In: Verma, G.A.K. Nishchal\u00a0K. (ed.) Computational Intelligence: Theories, Applications and Future Directions-Volume I."},{"key":"5072_CR11","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y. Generative adversarial nets. Adv Neural Inf Process Syst. 2014."},{"key":"5072_CR12","doi-asserted-by":"publisher","first-page":"584","DOI":"10.1109\/TCI.2021.3083965","volume":"7","author":"W Tang","year":"2021","unstructured":"Tang W, Liu Y, Cheng J, Li C, Chen X. Green fluorescent protein and phase contrast image fusion via detail preserving cross network. IEEE Trans Comput Imaging. 2021;7:584\u201397.","journal-title":"IEEE Trans Comput Imaging"},{"key":"5072_CR13","doi-asserted-by":"crossref","unstructured":"Liu Y, Chen X, Cheng J, Peng H. A medical image fusion method based on convolutional neural networks. In: 2017 20th International Conference on Information Fusion (Fusion). 2017:1\u20137.","DOI":"10.23919\/ICIF.2017.8009769"},{"issue":"7","key":"5072_CR14","doi-asserted-by":"publisher","first-page":"2029","DOI":"10.1007\/s00521-018-3441-1","volume":"30","author":"H Hermessi","year":"2018","unstructured":"Hermessi H, Mourali O, Zagrouba E. Convolutional neural network-based multimodal image fusion via similarity learning in the shearlet domain. Neural Comput Appl. 2018;30(7):2029\u201345.","journal-title":"Neural Comput Appl"},{"key":"5072_CR15","doi-asserted-by":"crossref","unstructured":"Xia K-j, Yin H-s, Wang J-q. A novel improved deep convolutional neural network model for medical image fusion. Cluster Comput. 2019;22(1);1515\u20131527.","DOI":"10.1007\/s10586-018-2026-1"},{"key":"5072_CR16","doi-asserted-by":"crossref","unstructured":"Song X, Wu X-J, Li H. Msdnet for medical image fusion. In: International Conference on Image and Graphics. 2019:278\u2013288.","DOI":"10.1007\/978-3-030-34110-7_24"},{"key":"5072_CR17","doi-asserted-by":"publisher","first-page":"6368","DOI":"10.1109\/ACCESS.2019.2963741","volume":"8","author":"J Kang","year":"2020","unstructured":"Kang J, Lu W, Zhang W. Fusion of brain pet and mri images using tissue-aware conditional generative adversarial network with joint loss. IEEE Access. 2020;8:6368\u201378.","journal-title":"IEEE Access"},{"key":"5072_CR18","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/j.inffus.2019.07.011","volume":"54","author":"Y Zhang","year":"2020","unstructured":"Zhang Y, Liu Y, Sun P, Yan H, Zhao X, Zhang L. Ifcnn: a general image fusion framework based on convolutional neural network. Inf Fusion. 2020;54:99\u2013118.","journal-title":"Inf Fusion"},{"issue":"7","key":"5072_CR19","doi-asserted-by":"publisher","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","volume":"22","author":"S Li","year":"2013","unstructured":"Li S, Kang X, Hu J. Image fusion with guided filtering. IEEE Trans Image Process. 2013;22(7):2864\u201375.","journal-title":"IEEE Trans Image Process"},{"issue":"2","key":"5072_CR20","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.inffus.2010.03.007","volume":"12","author":"T Li","year":"2011","unstructured":"Li T, Wang Y. Biological image fusion using a nsct based variable-weight method. Inf Fusion. 2011;12(2):85\u201392.","journal-title":"Inf Fusion"},{"issue":"5","key":"5072_CR21","doi-asserted-by":"publisher","first-page":"2382","DOI":"10.1016\/j.eswa.2014.10.050","volume":"42","author":"X Zhang","year":"2015","unstructured":"Zhang X, Li X, Feng Y, Zhao H, Liu Z. Image fusion with internal generative mechanism. Expert Syst Appl. 2015;42(5):2382\u201391.","journal-title":"Expert Syst Appl"},{"key":"5072_CR22","doi-asserted-by":"publisher","first-page":"103823","DOI":"10.1016\/j.compbiomed.2020.103823","volume":"123","author":"Z Wang","year":"2020","unstructured":"Wang Z, Cui Z, Zhu Y. Multi-modal medical image fusion by laplacian pyramid and adaptive sparse representation. Comput Biol Med. 2020;123:103823.","journal-title":"Comput Biol Med"},{"key":"5072_CR23","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","volume":"82","author":"J Ma","year":"2017","unstructured":"Ma J, Zhou Z, Wang B, Zong H. Infrared and visible image fusion based on visual saliency map and weighted least square optimization. Infrared Phys Technol. 2017;82:8\u201317.","journal-title":"Infrared Phys Technol"},{"issue":"12","key":"5072_CR24","doi-asserted-by":"publisher","first-page":"1882","DOI":"10.1109\/LSP.2016.2618776","volume":"23","author":"Y Liu","year":"2016","unstructured":"Liu Y, Chen X, Ward RK, Wang ZJ. Image fusion with convolutional sparse representation. IEEE Signal Process Lett. 2016;23(12):1882\u20136.","journal-title":"IEEE Signal Process Lett"},{"issue":"9","key":"5072_CR25","doi-asserted-by":"publisher","first-page":"6880","DOI":"10.1109\/TIM.2020.2975405","volume":"69","author":"X Li","year":"2020","unstructured":"Li X, Guo X, Han P, Wang X, Li H, Luo T. Laplacian redecomposition for multimodal medical image fusion. IEEE Trans Instrum Meas. 2020;69(9):6880\u201390.","journal-title":"IEEE Trans Instrum Meas"},{"key":"5072_CR26","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.ins.2020.03.051","volume":"525","author":"J Du","year":"2020","unstructured":"Du J, Li W, Tan H. Three-layer medical image fusion with tensor-based features. Inf Sci. 2020;525:93\u2013108.","journal-title":"Inf Sci"},{"issue":"3","key":"5072_CR27","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1109\/LSP.2019.2895749","volume":"26","author":"Y Liu","year":"2019","unstructured":"Liu Y, Chen X, Ward RK, Wang ZJ. Medical image fusion via convolutional sparsity based morphological component analysis. IEEE Signal Process Lett. 2019;26(3):485\u20139.","journal-title":"IEEE Signal Process Lett"},{"key":"5072_CR28","unstructured":"Li H, Wu X-J. Infrared and visible image fusion using latent low-rank representation. arXiv preprint arXiv:1804.08992. 2018."},{"key":"5072_CR29","doi-asserted-by":"publisher","first-page":"107793","DOI":"10.1016\/j.sigpro.2020.107793","volume":"178","author":"B Li","year":"2021","unstructured":"Li B, Peng H, Wang J. A novel fusion method based on dynamic threshold neural p systems and nonsubsampled contourlet transform for multi-modality medical images. Signal Process. 2021;178:107793.","journal-title":"Signal Process"},{"key":"5072_CR30","unstructured":"Piella G, Heijmans H. A new quality metric for image fusion. In: Proceedings 2003 International Conference on Image Processing (Cat. No. 03CH37429), 2003;3:173."},{"key":"5072_CR31","unstructured":"Zhou W. Image quality assessment: from error measurement to structural similarity. IEEE Trans Image Process. 2004."},{"issue":"2","key":"5072_CR32","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.inffus.2011.08.002","volume":"14","author":"Y Han","year":"2013","unstructured":"Han Y, Cai Y, Cao Y, Xu X. A new image fusion performance metric based on visual information fidelity. Inf Fusion. 2013;14(2):127\u201335.","journal-title":"Inf Fusion"},{"key":"5072_CR33","doi-asserted-by":"crossref","unstructured":"Haghighat M, Razian MA. Fast-fmi: non-reference image fusion metric. In: 2014 IEEE 8th International Conference on Application of Information and Communication Technologies (AICT). 2014:1\u20133.","DOI":"10.1109\/ICAICT.2014.7036000"},{"key":"5072_CR34","doi-asserted-by":"crossref","unstructured":"Petrovic V, Xydeas C. Objective image fusion performance characterisation. In: Tenth IEEE International Conference on Computer Vision (ICCV\u201905). 2005;Volume 1, vol. 2:1866\u20131871.","DOI":"10.1109\/ICCV.2005.175"},{"issue":"6","key":"5072_CR35","doi-asserted-by":"publisher","first-page":"1125","DOI":"10.1007\/s11760-012-0361-x","volume":"7","author":"B Shreyamsha Kumar","year":"2013","unstructured":"Shreyamsha Kumar B. Multifocus and multispectral image fusion based on pixel significance using discrete cosine harmonic wavelet transform. Signal Image Video Process. 2013;7(6):1125\u201343.","journal-title":"Signal Image Video Process"},{"key":"5072_CR36","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1016\/B978-0-12-372529-5.00017-2","volume":"19","author":"Q Wang","year":"2008","unstructured":"Wang Q, Shen Y, Jin J. Performance evaluation of image fusion techniques. Image Fusion Algorithms Appl. 2008;19:469\u201392.","journal-title":"Image Fusion Algorithms Appl"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-022-05072-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-022-05072-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-022-05072-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T08:03:33Z","timestamp":1671437013000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-022-05072-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,19]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["5072"],"URL":"https:\/\/doi.org\/10.1186\/s12859-022-05072-4","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,19]]},"assertion":[{"value":"6 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 December 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The experimental protocol was established according to the ethical guidelines of the Helsinki Declaration and was approved by the Human Ethics Committee of the First Hospital of Jilin University. Informed consent was obtained from all participants.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Consent for publication was obtained from every individual whose data are included in this manuscript.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"548"}}