{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T20:27:48Z","timestamp":1778704068613,"version":"3.51.4"},"reference-count":50,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,3,4]],"date-time":"2021-03-04T00:00:00Z","timestamp":1614816000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Shanghai Aerospace Science and Technology Innovation Fund","award":["SAST2019-048"],"award-info":[{"award-number":["SAST2019-048"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The rapid development of remote sensing and space technology provides multisource remote sensing image data for earth observation in the same area. Information provided by these images, however, is often complementary and cooperative, and multisource image fusion is still challenging. This paper proposes a novel multisource remote sensing image fusion algorithm. It integrates the contrast saliency map (CSM) and the sum-modified-Laplacian (SML) in the nonsubsampled shearlet transform (NSST) domain. The NSST is utilized to decompose the source images into low-frequency sub-bands and high-frequency sub-bands. Low-frequency sub-bands reflect the contrast and brightness of the source images, while high-frequency sub-bands reflect the texture and details of the source images. Using this information, the contrast saliency map and SML fusion rules are introduced into the corresponding sub-bands. Finally, the inverse NSST reconstructs the fusion image. Experimental results demonstrate that the proposed multisource remote image fusion technique performs well in terms of contrast enhancement and detail preservation.<\/jats:p>","DOI":"10.3390\/s21051756","type":"journal-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T00:39:07Z","timestamp":1614904747000},"page":"1756","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Saliency-Guided Nonsubsampled Shearlet Transform for Multisource Remote Sensing Image Fusion"],"prefix":"10.3390","volume":"21","author":[{"given":"Liangliang","family":"Li","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1785-4024","authenticated-orcid":false,"given":"Hongbing","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2596","DOI":"10.1016\/j.sigpro.2009.04.027","article-title":"Fusion of multiparametric SAR images based on SW-nonsubsampled contourlet and PCNN","volume":"89","author":"Yang","year":"2009","journal-title":"Signal Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"9507","DOI":"10.1080\/01431161.2020.1800126","article-title":"Image fusion in remote sensing by multi-objective deep learning","volume":"41","author":"Azarang","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"095068","DOI":"10.1117\/1.JRS.9.095068","article-title":"Multispectral image fusion based on joint sparse subspace recovery","volume":"9","author":"Liao","year":"2015","journal-title":"J. Appl. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.inffus.2020.06.013","article-title":"Multi-focus image fusion: A survey of the state of the art","volume":"64","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A general framework for image fusion based on multi-scale transform and sparse representation","volume":"24","author":"Liu","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2298","DOI":"10.1109\/TSP.2007.916129","article-title":"On the dual-tree complex wavelet packet and m-band transforms","volume":"56","author":"Bayram","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1109\/TIP.2017.2747093","article-title":"Random walks for synthetic aperture radar image fusion in framelet domain","volume":"27","author":"Yang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2091","DOI":"10.1109\/TIP.2005.859376","article-title":"The contourlet transform: An efficient directional multiresolution image representation","volume":"14","author":"Do","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3089","DOI":"10.1109\/TIP.2006.877507","article-title":"The nonsubsampled contourlet transform: Theory, design, and applications","volume":"15","author":"Da","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1137\/060649781","article-title":"Optimally sparse multidimensional representation using shearlets","volume":"39","author":"Guo","year":"2007","journal-title":"SIAM J. Math. Anal."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.acha.2007.09.003","article-title":"Sparse directional image representations using the discrete shearlet transform","volume":"25","author":"Easley","year":"2008","journal-title":"Appl. Comput. Harmon. Anal."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"12817","DOI":"10.1007\/s11042-020-08661-8","article-title":"A multifocus image fusion using highlevel DWT components and guided filter","volume":"79","author":"Iqbal","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.infrared.2018.08.013","article-title":"Visible and infrared image fusion using DTCWT and adaptive combined clustered dictionary","volume":"93","author":"Aishwarya","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5121","DOI":"10.1109\/TGRS.2019.2897010","article-title":"Random walks for pansharpening in complex tight framelet domain","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.asoc.2011.08.050","article-title":"Contourlet hidden markov tree and clarity-saliency driven PCNN based remote sensing images fusion","volume":"12","author":"Yang","year":"2012","journal-title":"Appl. Soft Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"107793","DOI":"10.1016\/j.sigpro.2020.107793","article-title":"A novel fusion method based on dynamic threshold neural P systems and nonsubsampled contourlet transform for multi-modality medical images","volume":"178","author":"Li","year":"2021","journal-title":"Signal Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/TIM.2018.2838778","article-title":"Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain","volume":"68","author":"Yin","year":"2019","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4803","DOI":"10.1109\/TGRS.2020.2967549","article-title":"A hyperspectral image NSST-HMF model and its application in HS-pansharpening","volume":"58","author":"Wang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","article-title":"Image fusion with guided filtering","volume":"22","author":"Li","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1007\/s11760-013-0556-9","article-title":"Image fusion based on pixel significance using cross bilateral filter","volume":"9","year":"2015","journal-title":"Signal Image Video Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1016\/j.future.2018.01.039","article-title":"Multi-scale image fusion through rolling guidance filter","volume":"83","author":"Jian","year":"2018","journal-title":"Future Gener. Comput. Syst. Int. J. Esci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103016","DOI":"10.1016\/j.cviu.2020.103016","article-title":"Infrared and visible image fusion via gradientlet filter","volume":"197","author":"Ma","year":"2020","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"24303","DOI":"10.1007\/s11042-020-09154-4","article-title":"A novel approach for multi-focus image fusion based on SF-PAPCNN and ISML in NSST domain","volume":"79","author":"Li","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2011.07.001","article-title":"Image matting for fusion of multi-focus images in dynamic scenes","volume":"14","author":"Li","year":"2013","journal-title":"Inf. Fusion"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"033014","DOI":"10.1117\/1.JEI.24.3.033014","article-title":"Multifocus image fusion using phase congruency","volume":"24","author":"Zhan","year":"2015","journal-title":"J. Electron. Imaging"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijleo.2018.06.123","article-title":"Structure-aware image fusion","volume":"172","author":"Li","year":"2018","journal-title":"Optik"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Du, Q., Xu, H., and Ma, Y. (2018). Fusing infrared and visible images of different resolutions via total variation model. Sensors, 18.","DOI":"10.3390\/s18113827"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"023027","DOI":"10.1117\/1.JEI.28.2.023027","article-title":"Multimodal image seamless fusion","volume":"28","author":"Zhan","year":"2019","journal-title":"J. Electron. Imaging"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.inffus.2011.08.002","article-title":"A new image fusion performance metric based on visual information fidelity","volume":"14","author":"Han","year":"2013","journal-title":"Inf. Fusion"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11042-020-10462-y","article-title":"A novel multiscale transform decomposition based multi-focus image fusion framework","volume":"80","author":"Li","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"9645","DOI":"10.1109\/TIM.2020.3005230","article-title":"NestFuse: An infrared and visible image fusion architecture based on nest connection and spatial\/channel attention models","volume":"69","author":"Li","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, K., Zheng, M., and Wei, H. (2020). Multi-modality medical image fusion using convolutional neural network and contrast pyramid. Sensors, 20.","DOI":"10.3390\/s20082169"},{"key":"ref_33","first-page":"1","article-title":"Multimodal medical image fusion via PCNN and WSEML in nonsubsampled contourlet transform domain","volume":"11","author":"Li","year":"2021","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TPAMI.2011.109","article-title":"Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: A comparative study","volume":"34","author":"Liu","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","first-page":"5001715","article-title":"Infrared and visible image fusion using visual saliency sparse representation and detail injection model","volume":"70","author":"Yang","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1785","DOI":"10.1166\/jmihi.2020.3111","article-title":"Brain image enhancement approach based on singular value decomposition in nonsubsampled shearlet transform domain","volume":"10","author":"Li","year":"2020","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.patrec.2020.11.014","article-title":"Multi-focus image fusion algorithm based on supervised learning for fully convolutional neural network","volume":"141","author":"Li","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1815","DOI":"10.1166\/jmihi.2019.2827","article-title":"A novel medical image fusion approach based on nonsubsampled shearlet transform","volume":"9","author":"Li","year":"2019","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Raudonis, V., Paulauskaite-Taraseviciene, A., and Sutiene, K. (2021). Fast multi-focus fusion based on deep learning for early-stage embryo image enhancement. Sensors, 21.","DOI":"10.3390\/s21030863"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1002\/ima.22436","article-title":"A novel approach in multimodality medical image fusion using optimal shearlet and deep learning","volume":"30","author":"Pothiraj","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1002\/ima.22367","article-title":"Two-scale image decomposition based image fusion using structure tensor","volume":"30","author":"Du","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1002\/ima.22393","article-title":"Medical image fusion based on laws of texture energy measures in stationary wavelet transform domain","volume":"30","author":"Ganasala","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Li, X., Yan, H., and Xie, W. (2020). An improved pulse-coupled neural network model for Pansharpening. Sensors, 20.","DOI":"10.3390\/s20102764"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.isprsjprs.2020.12.014","article-title":"GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening","volume":"172","author":"Zhang","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lee, C., and Oh, J. (2020). Rigorous co-registration of KOMPSAT-3 multispectral and panchromatic images for pan-sharpening image fusion. Sensors, 20.","DOI":"10.3390\/s20072100"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2898","DOI":"10.1080\/01431161.2020.1864056","article-title":"A pansharpening scheme using spectral graph wavelet transforms and convolutional neural networks","volume":"42","author":"Saxena","year":"2021","journal-title":"Int. J. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.comcom.2020.04.010","article-title":"Smart city oriented remote sensing image fusion methods based on convolution sampling and spatial transformation","volume":"157","author":"Wu","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.inffus.2020.04.006","article-title":"Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion","volume":"62","author":"Ma","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.inffus.2020.08.013","article-title":"Integrated fusion framework based on semicoupled sparse tensor factorization for spatio-temporal-spectra fusion of remote sensing images","volume":"65","author":"Peng","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1109\/TGRS.2020.2994968","article-title":"Hyperspectral and multispectral image fusion via nonlocal low-rank tensor approximation and sparse representation","volume":"59","author":"Li","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1756\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:32:27Z","timestamp":1760160747000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1756"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,4]]},"references-count":50,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["s21051756"],"URL":"https:\/\/doi.org\/10.3390\/s21051756","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,4]]}}}