{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T02:19:10Z","timestamp":1784081950702,"version":"3.55.0"},"reference-count":48,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,5,11]],"date-time":"2021-05-11T00:00:00Z","timestamp":1620691200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Shanghai Aerospace Science and Technology Innovation Fund","award":["SAST2019-048."],"award-info":[{"award-number":["SAST2019-048."]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Multimodal medical image fusion aims to fuse images with complementary multisource information. In this paper, we propose a novel multimodal medical image fusion method using pulse coupled neural network (PCNN) and a weighted sum of eight-neighborhood-based modified Laplacian (WSEML) integrating guided image filtering (GIF) in non-subsampled contourlet transform (NSCT) domain. Firstly, the source images are decomposed by NSCT, several low- and high-frequency sub-bands are generated. Secondly, the PCNN-based fusion rule is used to process the low-frequency components, and the GIF-WSEML fusion model is used to process the high-frequency components. Finally, the fused image is obtained by integrating the fused low- and high-frequency sub-bands. The experimental results demonstrate that the proposed method can achieve better performance in terms of multimodal medical image fusion. The proposed algorithm also has obvious advantages in objective evaluation indexes VIFF, QW, API, SD, EN and time consumption.<\/jats:p>","DOI":"10.3390\/e23050591","type":"journal-article","created":{"date-parts":[[2021,5,11]],"date-time":"2021-05-11T04:05:32Z","timestamp":1620705932000},"page":"591","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain"],"prefix":"10.3390","volume":"23","author":[{"given":"Liangliang","family":"Li","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1785-4024","authenticated-orcid":false,"given":"Hongbing","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1109\/TIM.2019.2902808","article-title":"Multimodal medical image sensor fusion model using sparse K-SVD dictionary learning in nonsubsampled shearlet domain","volume":"69","author":"Singh","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1109\/TIM.2018.2865046","article-title":"Multimodal sensor medical image fusion based on local difference in non-subsampled domain","volume":"68","author":"Kong","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"103823","DOI":"10.1016\/j.compbiomed.2020.103823","article-title":"Multi-modal medical image fusion by Laplacian pyramid and adaptive sparse representation","volume":"123","author":"Wang","year":"2020","journal-title":"Comput. Biol. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"11820","DOI":"10.1109\/JSEN.2019.2948783","article-title":"Multi-modality image fusion in adaptive-parameters SPCNN based on inherent characteristics of image","volume":"20","author":"Zhang","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"101996","DOI":"10.1016\/j.bspc.2020.101996","article-title":"Robust spiking cortical model and total-variational decomposition for multimodal medical image fusion","volume":"61","author":"Liu","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.inffus.2019.07.011","article-title":"IFCNN: A general image fusion framework based on convolutional neural network","volume":"54","author":"Zhang","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2020","DOI":"10.1016\/j.inffus.2019.07.005","article-title":"Infrared and visible image fusion via detail preserving adversarial learning","volume":"54","author":"Ma","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.inffus.2020.06.013","article-title":"Multi-focus image fusion: A survey of the state of the art","volume":"64","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.inffus.2017.10.007","article-title":"Deep learning for pixel-level image fusion: Recent advances and future prospects","volume":"42","author":"Liu","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"21129","DOI":"10.1007\/s11042-019-08471-7","article-title":"Satellite image fusion based on modified central force optimization","volume":"79","author":"Talal","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1374","DOI":"10.1109\/TCSVT.2019.2901809","article-title":"A new multi-focus image fusion algorithm and its efficient implementation","volume":"30","author":"Liu","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1166\/jmihi.2012.1080","article-title":"Multimodal medical image fusion in dual tree complex wavelet transform domain using maximum and average fusion rules","volume":"2","author":"Singh","year":"2012","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A general framework for image fusion based on multi-scale transform and sparse representation","volume":"24","author":"Liu","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2091","DOI":"10.1109\/TIP.2005.859376","article-title":"The contourlet transform: An efficient directional multiresolution image representation","volume":"14","author":"Do","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"105794","DOI":"10.1016\/j.knosys.2020.105794","article-title":"Multi-focus image fusion based on dynamic threshold neural P systems and surfacelet transform","volume":"196","author":"Li","year":"2020","journal-title":"Knowl. Based Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.3724\/SP.J.1004.2008.01508","article-title":"Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain","volume":"34","author":"Qu","year":"2008","journal-title":"Acta Autom. Sin."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1137\/060649781","article-title":"Optimally sparse multidimensional representation using shearlets","volume":"39","author":"Guo","year":"2007","journal-title":"Siam J. Math. Anal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1815","DOI":"10.1166\/jmihi.2019.2827","article-title":"A novel medical image fusion approach based on nonsubsampled shearlet transform","volume":"9","author":"Li","year":"2019","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3367","DOI":"10.1109\/TIM.2018.2877285","article-title":"Image fusion using adjustable non-subsampled shearlet transform","volume":"68","author":"Vishwakarma","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"12817","DOI":"10.1007\/s11042-020-08661-8","article-title":"A multifocus image fusion using highlevel DWT components and guided filter","volume":"79","author":"Iqbal","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"34483","DOI":"10.1007\/s11042-019-08070-6","article-title":"Multifocus image fusion using convolutional neural networks in the discrete wavelet transform domain","volume":"78","author":"Wang","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.infrared.2018.08.013","article-title":"Visible and Infrared image fusion using DTCWT and adaptive combined clustered dictionary","volume":"93","author":"Aishwarya","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"25293","DOI":"10.1364\/OE.396604","article-title":"Image fusion based on multiscale transform and sparse representation to enhance terahertz images","volume":"28","author":"Mao","year":"2020","journal-title":"Opt. Express"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1007\/s12145-020-00472-7","article-title":"A pixel-level fusion method for multi-source optical remote sensing image combining the principal component analysis and curvelet transform","volume":"13","author":"Chen","year":"2020","journal-title":"Earth Sci. Inform."},{"key":"ref_25","first-page":"204","article-title":"Improving medical image fusion method using fuzzy entropy and nonsubsampling contourlet transform","volume":"30","author":"Li","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wu, C., and Chen, L. (2020). Infrared and visible image fusion method of dual NSCT and PCNN. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0239535"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"24303","DOI":"10.1007\/s11042-020-09154-4","article-title":"A novel approach for multi-focus image fusion based on SF-PAPCNN and ISML in NSST domain","volume":"79","author":"Li","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1016\/j.neucom.2020.04.002","article-title":"Using taylor expansion and convolutional sparse representation for image fusion","volume":"402","author":"Xing","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1049\/iet-ipr.2014.0311","article-title":"Simultaneous image fusion and denoising with adaptive sparse representation","volume":"9","author":"Liu","year":"2015","journal-title":"IET Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.inffus.2016.12.001","article-title":"Multi-focus image fusion with a deep convolutional neural network","volume":"36","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","article-title":"Image fusion with guided filtering","volume":"22","author":"Li","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3089","DOI":"10.1109\/TIP.2006.877507","article-title":"The nonsubsampled contourlet transform: Theory, design, and applications","volume":"15","author":"Da","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided image filtering","volume":"35","author":"He","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/TIM.2018.2838778","article-title":"Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain","volume":"68","author":"Yin","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1109\/LSP.2019.2895749","article-title":"Medical image fusion via convolutional sparsity based morphological component analysis","volume":"26","author":"Liu","year":"2019","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"106182","DOI":"10.1016\/j.knosys.2020.106182","article-title":"Fast infrared and visible image fusion with structural decomposition","volume":"204","author":"Li","year":"2020","journal-title":"Knowl. Based Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.inffus.2011.08.002","article-title":"A new image fusion performance metric based on visual information fidelity","volume":"14","author":"Han","year":"2013","journal-title":"Inf. Fusion"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"12389","DOI":"10.1007\/s11042-020-10462-y","article-title":"A novel multiscale transform decomposition based multi-focus image fusion framework","volume":"80","author":"Li","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"18077","DOI":"10.1007\/s11042-019-7203-6","article-title":"Enhancement of hyperspectral remote sensing images based on improved fuzzy contrast in nonsubsampled shearlet transform domain","volume":"78","author":"Li","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.inffus.2020.08.022","article-title":"MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion","volume":"66","author":"Zhang","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1785","DOI":"10.1166\/jmihi.2020.3111","article-title":"Brain image enhancement approach based on singular value decomposition in nonsubsampled shearlet transform domain","volume":"10","author":"Li","year":"2020","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TPAMI.2011.109","article-title":"Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: A comparative study","volume":"34","author":"Liu","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.inffus.2013.04.005","article-title":"EGGDD: An explicit dependency model for multi-modal medical image fusion in shift-invariant shearlet transform domain","volume":"19","author":"Wang","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1007\/s11760-013-0556-9","article-title":"Image fusion based on pixel significance using cross bilateral filter","volume":"9","author":"Kumar","year":"2015","journal-title":"Signal Image Video Process."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1002\/ima.22367","article-title":"Two-scale image decomposition based image fusion using structure tensor","volume":"30","author":"Du","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"103016","DOI":"10.1016\/j.cviu.2020.103016","article-title":"Infrared and visible image fusion via gradientlet filter","volume":"197","author":"Ma","year":"2020","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"7203","DOI":"10.1109\/TIP.2020.2999855","article-title":"MEF-GAN: Multi-exposure image fusion via generative adversarial networks","volume":"29","author":"Xu","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.ins.2019.08.066","article-title":"Infrared and visible image fusion based on target-enhanced multiscale transform decomposition","volume":"508","author":"Chen","year":"2020","journal-title":"Inf. Sci."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/5\/591\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:59:00Z","timestamp":1760162340000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/5\/591"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,11]]},"references-count":48,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["e23050591"],"URL":"https:\/\/doi.org\/10.3390\/e23050591","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,11]]}}}