{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,25]],"date-time":"2025-11-25T06:50:46Z","timestamp":1764053446970,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2016,9,15]],"date-time":"2016-09-15T00:00:00Z","timestamp":1473897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2015TS094"],"award-info":[{"award-number":["2015TS094"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Science and Technology Program of Wuhan","award":["2015060101010027"],"award-info":[{"award-number":["2015060101010027"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Multimodal medical image fusion (MIF) plays an important role in clinical diagnosis and therapy. Existing MIF methods tend to introduce artifacts, lead to loss of image details or produce low-contrast fused images. To address these problems, a novel spiking cortical model (SCM) based MIF method has been proposed in this paper. The proposed method can generate high-quality fused images using the weighting fusion strategy based on the firing times of the SCM. In the weighting fusion scheme, the weight is determined by combining the entropy information of pulse outputs of the SCM with the Weber local descriptor operating on the firing mapping images produced from the pulse outputs. The extensive experiments on multimodal medical images show that compared with the numerous state-of-the-art MIF methods, the proposed method can preserve image details very well and avoid the introduction of artifacts effectively, and thus it significantly improves the quality of fused images in terms of human vision and objective evaluation criteria such as mutual information, edge preservation index, structural similarity based metric, fusion quality index, fusion similarity metric and standard deviation.<\/jats:p>","DOI":"10.3390\/s16091503","type":"journal-article","created":{"date-parts":[[2016,9,15]],"date-time":"2016-09-15T10:22:51Z","timestamp":1473934971000},"page":"1503","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Spiking Cortical Model Based Multimodal Medical Image Fusion by Combining Entropy Information with Weber Local Descriptor"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4332-071X","authenticated-orcid":false,"given":"Xuming","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No. 1037, Luoyu Road, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinxia","family":"Ren","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No. 1037, Luoyu Road, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiwen","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No. 1037, Luoyu Road, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fei","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, School of Life Science and Technology, Huazhong University of Science and Technology, No. 1037, Luoyu Road, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,9,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/S0730-725X(02)00490-3","article-title":"Real time MRI-ultrasound image guided stereotactic prostate biopsy","volume":"20","author":"Kaplan","year":"2002","journal-title":"Magn. Reson. Imaging"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1007\/s00259-011-1803-3","article-title":"PET\/CT for staging lung cancer: Costly or cost-saving?","volume":"38","author":"Buck","year":"2011","journal-title":"Eur. J. Nucl. Med. Mol. Imaging"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1006\/nimg.2000.0707","article-title":"A general framework for the fusion of anatomical and functional medical images","volume":"13","author":"Barra","year":"2001","journal-title":"NeuroImage"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1756","DOI":"10.2967\/jnumed.107.043372","article-title":"The additional value of SPECT\/CT in lymphatic mapping in breast cancer and melanoma","volume":"48","author":"Nieweg","year":"2007","journal-title":"J. Nucl. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.inffus.2008.08.006","article-title":"Multifocus image fusion using the log-Gabor transform and a multisize windows technique","volume":"10","author":"Redondo","year":"2009","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S1566-2535(01)00036-7","article-title":"A new look at IHS-like image fusion methods","volume":"2","author":"Tu","year":"2001","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.inffus.2009.05.003","article-title":"MRI and PET image fusion by combining IHS and retina-inspired models","volume":"11","author":"Daneshvar","year":"2010","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, H.Q., and Xing, H. (2009, January 18\u201320). Multi-mode medical image fusion algorithm based on principal component analysis. Proceedings of the International Symposium on Computer Network and Multimedia Technology, Wuhan, China.","DOI":"10.1109\/CNMT.2009.5374652"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1117\/12.7977034","article-title":"Merging thermal and visual images by a contrast pyramid","volume":"28","author":"Toet","year":"1989","journal-title":"Opt. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TIP.2004.823821","article-title":"Gradient-based multiresolution image fusion","volume":"13","author":"Petrovic","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"10923","DOI":"10.3390\/s150510923","article-title":"Multi-scale pixel-based image fusion using multivariate empirical mode decomposition","volume":"15","author":"Ehsan","year":"2015","journal-title":"Sensors"},{"key":"ref_12","first-page":"184","article-title":"Medical image fusion by wavelet transform modulus maxima","volume":"92","author":"Qu","year":"2001","journal-title":"Opt. Express"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"579341","DOI":"10.1155\/2010\/579341","article-title":"Medical image fusion via an effective wavelet-based approach","volume":"2010","author":"Yang","year":"2010","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.inffus.2012.09.005","article-title":"Fusion of multimodal medical images using Daubechies complex wavelet transform\u2014A multiresolution approach","volume":"19","author":"Singh","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"215","DOI":"10.2528\/PIERC08041305","article-title":"Curvelet fusion of MR and CT images","volume":"3","author":"Ali","year":"2008","journal-title":"Prog. Electromagn. Res. C"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"355","DOI":"10.2528\/PIERB11040601","article-title":"Medical image fusion based on ripplet transform type-I","volume":"30","author":"Das","year":"2011","journal-title":"Prog. Electromagn. Res. B"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.neucom.2008.02.025","article-title":"Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform","volume":"72","author":"Yang","year":"2008","journal-title":"Neurocomputing"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.inffus.2010.03.007","article-title":"Biological image fusion using a NSCT based variable-weight method","volume":"12","author":"Li","year":"2011","journal-title":"Inf. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2215","DOI":"10.1587\/transinf.E96.D.2215","article-title":"Multi-modality image fusion using the nonsubsampled contourlet transform","volume":"96","author":"Liu","year":"2013","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/TMM.2013.2244870","article-title":"Directive contrast based multimodal medical image fusion in NSCT domain","volume":"15","author":"Bhatnagar","year":"2013","journal-title":"IEEE Trans. Multimed."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A general framework for image fusion based on multi-scale transform and sparse representation","volume":"24","author":"Liu","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"5872","DOI":"10.3390\/s120505872","article-title":"Improved image fusion method based on NSCT and accelerated NMF","volume":"12","author":"Wang","year":"2012","journal-title":"Sensors"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.inffus.2012.03.002","article-title":"Multi-modal medical image fusion using the inter-scale and intra-scale dependencies between image shift-invariant shearlet coefficients","volume":"19","author":"Wang","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.inffus.2013.04.005","article-title":"EGGDD: An explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain","volume":"19","author":"Wang","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"8515","DOI":"10.1016\/j.eswa.2011.01.052","article-title":"Fuzzy image fusion based on modified self-generating neural network","volume":"38","author":"Jiang","year":"2011","journal-title":"Expert Syst. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1162\/neco.1990.2.3.293","article-title":"Feature linking via synchronization among distributed assemblies: Simulation of results from cat cortex","volume":"2","author":"Eckhorn","year":"1990","journal-title":"Neural Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1097\/00001756-199303000-00004","article-title":"High frequency (60\u201390 Hz) oscillations in primary visual cortex of awake monkey","volume":"4","author":"Eckhorn","year":"1993","journal-title":"Neuroreport"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1948","DOI":"10.1016\/j.patrec.2006.05.004","article-title":"A region-based multi-sensor image fusion scheme using pulse coupled neural network","volume":"27","author":"Li","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.inffus.2007.04.003","article-title":"Medical image fusion using m-PCNN","volume":"9","author":"Wang","year":"2008","journal-title":"Inf. Fusion"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"221","DOI":"10.3233\/BME-130802","article-title":"Multimodal medical image fusion using improved multi-channel PCNN","volume":"24","author":"Zhao","year":"2014","journal-title":"Bio-Med. Mater. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3591","DOI":"10.1016\/j.optcom.2010.04.100","article-title":"Image fusion scheme using a novel dual-channel PCNN in lifting stationary wavelet domain","volume":"283","author":"Chai","year":"2010","journal-title":"Opt. Commun."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.3724\/SP.J.1004.2008.01508","article-title":"Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain","volume":"34","author":"Qu","year":"2008","journal-title":"Acta Autom. Sin."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1049\/iet-ipr.2009.0425","article-title":"Image fusion technique based on non-subsampled contourlet transform and adaptive unit-fast-linking pulse-coupled neural network","volume":"5","author":"Kong","year":"2011","journal-title":"IET Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1049\/iet-ipr.2013.0045","article-title":"Image fusion scheme based on modified dual pulse coupled neural network","volume":"7","author":"Helmy","year":"2013","journal-title":"IET Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1007\/s11517-012-0943-3","article-title":"NSCT-based multimodal medical image fusion using pulse-coupled neural network and modified spatial frequency","volume":"50","author":"Das","year":"2012","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3347","DOI":"10.1109\/TBME.2013.2282461","article-title":"A neuro-fuzzy approach for medical image fusion","volume":"60","author":"Das","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s10278-015-9806-4","article-title":"Feature-motivated simplified adaptive PCNN-based medical image fusion algorithm in NSST domain","volume":"29","author":"Ganasala","year":"2016","journal-title":"J. Digit. Imaging"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"067005","DOI":"10.1117\/1.OE.51.6.067005","article-title":"Image fusion by pulse couple neural network with shearlet","volume":"51","author":"Geng","year":"2012","journal-title":"Opt. Eng."},{"key":"ref_39","first-page":"84","article-title":"A novel method of medical image fusion based on bidimensional empirical mode decomposition","volume":"6","author":"Feng","year":"2011","journal-title":"J. Converg. Inf. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1980","DOI":"10.1109\/TNN.2009.2030585","article-title":"New spiking cortical model for invariant texture retrieval and image processing","volume":"20","author":"Zhan","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wang, R., Wu, Y., Ding, M., and Zhang, X. (2013, January 9\u201314). Medical image fusion based on spiking cortical model. Proceedings of the SPIE 8676, Medical Imaging 2013: Digital Pathology, Lake Buena Vista, FL, USA.","DOI":"10.1117\/12.2006659"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1109\/TPAMI.2009.155","article-title":"WLD: A robust local image descriptor","volume":"32","author":"Chen","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","unstructured":"The Whole Brain Atlas. Available online: http:\/\/www.med.harvard.edu\/aanlib\/home.html."},{"key":"ref_44","unstructured":"Image Fusion Toolbox. Available online: http:\/\/www.metapix.de\/toolbox.html."},{"key":"ref_45","unstructured":"NSCT-SF-PCNN-ImageFusion-Toolbox. Available online: http:\/\/dspace.xmu.edu.cn\/dspace\/handle\/2288\/8332."},{"key":"ref_46","unstructured":"MST_SR_Fusion_Toolbox. Available online: http:\/\/home.ustc.edu.cn\/~liuyu1\/publications\/MST_SR_fusion_toolbox."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1049\/el:20020212","article-title":"Information measurement for performance of image fusion","volume":"38","author":"Qu","year":"2002","journal-title":"Electron. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1049\/el:20000267","article-title":"Objective image fusion performance measure","volume":"36","author":"Xydeas","year":"2000","journal-title":"Electron. Lett."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.inffus.2006.09.001","article-title":"A novel similarity based quality metric for image fusion","volume":"9","author":"Yang","year":"2008","journal-title":"Infusion Fusion"},{"key":"ref_51","unstructured":"Piella, G., and Heijmans, H. (2003, January 14\u201318). A new quality metric for image fusion. Proceedings of the IEEE International Conference on Image Processing (ICIP), Barcelona, Spain."},{"key":"ref_52","first-page":"178","article-title":"A similarity metric for assessment of image fusion algorithms","volume":"2","author":"Cvejic","year":"2005","journal-title":"Int. J. Signal Process."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/9\/1503\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:31:00Z","timestamp":1760211060000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/9\/1503"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,9,15]]},"references-count":53,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2016,9]]}},"alternative-id":["s16091503"],"URL":"https:\/\/doi.org\/10.3390\/s16091503","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,9,15]]}}}