{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T18:11:41Z","timestamp":1783793501042,"version":"3.55.0"},"reference-count":59,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T00:00:00Z","timestamp":1683590400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Beijing National Research Center for Information Science and Technology (BNRist)","award":["BNR2019TD01022"],"award-info":[{"award-number":["BNR2019TD01022"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>To solve problems of brightness and detail information loss in infrared and visible image fusion, an effective infrared and visible image fusion method using rolling guidance filtering and gradient saliency map is proposed in this paper. The rolling guidance filtering is used to decompose the input images into approximate layers and residual layers; the energy attribute fusion model is used to fuse the approximate layers; the gradient saliency map is introduced and the corresponding weight matrices are constructed to perform on residual layers. The fusion image is generated by reconstructing the fused approximate layer sub-image and residual layer sub-images. Experimental results demonstrate the superiority of the proposed infrared and visible image fusion method.<\/jats:p>","DOI":"10.3390\/rs15102486","type":"journal-article","created":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T01:57:51Z","timestamp":1683683871000},"page":"2486","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["An Effective Infrared and Visible Image Fusion Approach via Rolling Guidance Filtering and Gradient Saliency Map"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7354-7494","authenticated-orcid":false,"given":"Liangliang","family":"Li","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"},{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Lv","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhenhong","family":"Jia","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingxin","family":"Jin","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Guangxi University, Nanning 530004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minqin","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Software, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liangfu","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100101, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1785-4024","authenticated-orcid":false,"given":"Hongbing","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Xu, X., Shen, Y., and Han, S. (2023). Dense-FG: A fusion GAN model by using densely connected blocks to fuse infrared and visible images. Appl. Sci., 13.","DOI":"10.3390\/app13084684"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.inffus.2020.06.013","article-title":"Multi-focus image fusion: A Survey of the state of the art","volume":"64","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.inffus.2017.10.007","article-title":"Deep learning for pixel-level image fusion: Recent advances and future prospects","volume":"42","author":"Liu","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.inffus.2022.09.019","article-title":"Current advances and future perspectives of image fusion: A comprehensive review","volume":"90","author":"Karim","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.05.004","article-title":"Pixel-level image fusion: A survey of the state of the art","volume":"33","author":"Li","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1815","DOI":"10.1166\/jmihi.2019.2827","article-title":"A novel medical image fusion approach based on nonsubsampled shearlet transform","volume":"9","author":"Li","year":"2019","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mohan, C., Chouhan, K., and Rout, R. (2022). Improved procedure for multi-focus images using image fusion with qshiftN DTCWT and MPCA in Laplacian pyramid domain. Appl. Sci., 12.","DOI":"10.3390\/app12199495"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6152","DOI":"10.1109\/TGRS.2020.2974806","article-title":"Pansharpening: Context-based generalized Laplacian pyramids by robust regression","volume":"58","author":"Vivone","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1016\/S0167-8655(01)00047-2","article-title":"Image fusion by using steerable pyramid","volume":"22","author":"Liu","year":"2001","journal-title":"Pattern Recognit. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1374","DOI":"10.1109\/TCSVT.2019.2901809","article-title":"A new multi-focus image fusion algorithm and its efficient implementation","volume":"30","author":"Liu","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1080\/01431161.2020.1811913","article-title":"IHS-based pan-sharpening technique for visual quality improvement using KPCA and enhanced SML in the NSCT domain","volume":"42","author":"Sulaiman","year":"2021","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"115850","DOI":"10.1016\/j.image.2020.115850","article-title":"Pan-sharpening via multi-scale and multiple deep neural networks","volume":"85","author":"Huang","year":"2020","journal-title":"Signal Process. Image Commun."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Qi, B., Jin, L., and Li, G. (2022). Infrared and visible image fusion based on co-occurrence analysis shearlet transform. Remote Sens., 14.","DOI":"10.3390\/rs14020283"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"215","DOI":"10.3116\/16091833\/23\/4\/215\/2022","article-title":"Infrared and visible image fusion using intensity transfer and phase congruency in nonsubsampled shearlet transform domain","volume":"23","author":"Feng","year":"2022","journal-title":"Ukr. J. Phys. Opt."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, L., Lv, M., Jia, Z., and Ma, H. (2023). Sparse representation-based multi-focus image fusion method via local energy in shearlet domain. Sensors, 23.","DOI":"10.3390\/s23062888"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/MIM.2021.9400960","article-title":"Recent advances in sparse representation based medical image fusion","volume":"24","author":"Liu","year":"2021","journal-title":"IEEE Instrum. Meas. Mag."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.inffus.2014.10.004","article-title":"Multi-focus image fusion using dictionary-based sparse representation","volume":"25","author":"Nejati","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"104030","DOI":"10.1016\/j.bspc.2022.104030","article-title":"Joint sparse model with coupled dictionary for medical image fusion","volume":"79","author":"Zhang","year":"2023","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s00138-022-01322-w","article-title":"Joint patch clustering-based adaptive dictionary and sparse representation for multi-modality image fusion","volume":"33","author":"Wang","year":"2022","journal-title":"Mach. Vis. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"4070","DOI":"10.1109\/TIP.2021.3069339","article-title":"Different input resolutions and arbitrary output resolution: A meta learning-based deep framework for infrared and visible image fusion","volume":"30","author":"Li","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.inffus.2022.11.010","article-title":"MUFusion: A general unsupervised image fusion network based on memory unit","volume":"92","author":"Cheng","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"104629","DOI":"10.1016\/j.infrared.2023.104629","article-title":"Infrared and visible image fusion with entropy-based adaptive fusion module and mask-guided convolutional neural network","volume":"131","author":"Zhang","year":"2023","journal-title":"Infrared Phys. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"108996","DOI":"10.1016\/j.sigpro.2023.108996","article-title":"MCnet: Multiscale visible image and infrared image fusion network","volume":"208","author":"Sun","year":"2023","journal-title":"Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xiong, Z., and Zhang, X. (2023). IFormerFusion: Cross-domain frequency information learning for infrared and visible image fusion based on the inception transformer. Remote Sens., 15.","DOI":"10.3390\/rs15051352"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, L., and Ma, H. (2021). Saliency-guided nonsubsampled shearlet transform for multisource remote sensing image fusion. Sensors, 21.","DOI":"10.3390\/s21051756"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"24303","DOI":"10.1007\/s11042-020-09154-4","article-title":"A novel approach for multi-focus image fusion based on SF-PAPCNN and ISML in NSST domain","volume":"79","author":"Li","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/TCI.2022.3151472","article-title":"Injected infrared and visible image fusion via L-1 decomposition model and guided filtering","volume":"8","author":"Yan","year":"2022","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","article-title":"Image fusion with guided filtering","volume":"22","author":"Li","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.2174\/1573405616999200817103920","article-title":"Multimodal medical image fusion using rolling guidance filter with CNN and nuclear norm minimization","volume":"16","author":"Liu","year":"2020","journal-title":"Curr. Med. Imaging"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107268","DOI":"10.1016\/j.optlaseng.2022.107268","article-title":"Infrared and low-light visible image fusion based on hybrid multiscale decomposition and adaptive light adjustment","volume":"160","author":"Zou","year":"2023","journal-title":"Opt. Lasers Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1007\/978-3-319-10578-9_53","article-title":"Rolling guidance filter","volume":"8691","author":"Zhang","year":"2014","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"118283","DOI":"10.1016\/j.eswa.2022.118283","article-title":"Multi-modality image fusion for medical assistive technology management based on hybrid domain filtering","volume":"209","author":"Goyal","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1007\/s10044-022-01073-4","article-title":"Infrared and visible image fusion via multi-scale multi-layer rolling guidance filter","volume":"25","author":"Prema","year":"2022","journal-title":"Pattern Anal. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"100172","DOI":"10.1016\/j.iot.2020.100172","article-title":"A novel medical image fusion method based on rolling guidance filtering","volume":"14","author":"Chen","year":"2021","journal-title":"Internet Things"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"169218","DOI":"10.1016\/j.ijleo.2022.169218","article-title":"Adaptive infrared and visible image fusion method by using rolling guidance filter and saliency detection","volume":"262","author":"Lin","year":"2022","journal-title":"Optik"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"102280","DOI":"10.1016\/j.bspc.2020.102280","article-title":"Multi-modal brain image fusion based on multi-level edge-preserving filtering","volume":"64","author":"Tan","year":"2021","journal-title":"BioMed. Signal Process. Control"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"103016","DOI":"10.1016\/j.cviu.2020.103016","article-title":"Infrared and visible image fusion via gradientlet filter","volume":"197","author":"Ma","year":"2020","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.inffus.2016.09.006","article-title":"Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure","volume":"35","author":"Zhang","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A general framework for image fusion based on multi-scale transform and sparse representation","volume":"24","author":"Liu","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1109\/LSP.2016.2618776","article-title":"Image fusion with convolutional sparse representation","volume":"23","author":"Liu","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","article-title":"Infrared and visible image fusion based on visual saliency map and weighted least square optimization","volume":"82","author":"Ma","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1850018","DOI":"10.1142\/S0219691318500182","article-title":"Infrared and visible image fusion with convolutional neural networks","volume":"16","author":"Liu","year":"2018","journal-title":"Int. J. Wavelets Multiresolution Inf. Process."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1109\/LSP.2019.2895749","article-title":"Medical image fusion via convolutional sparsity based morphological component analysis","volume":"26","author":"Liu","year":"2019","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.ins.2019.08.066","article-title":"Infrared and visible image fusion based on target-enhanced multiscale transform decomposition","volume":"508","author":"Chen","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.3724\/SP.J.1004.2008.01508","article-title":"Image fusion algorithm based on spatial frequency-motivated pulse coupled neural networks in nonsubsampled contourlet transform domain","volume":"34","author":"Qu","year":"2008","journal-title":"Acta Autom. Sin."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"12389","DOI":"10.1007\/s11042-020-10462-y","article-title":"A novel multiscale transform decomposition based multi-focus image fusion framework","volume":"80","author":"Li","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"4357","DOI":"10.1109\/TCSVT.2020.3047935","article-title":"Visible-infrared image fusion based on early visual information processing mechanisms","volume":"31","author":"Tan","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1421","DOI":"10.1016\/j.imavis.2007.12.002","article-title":"A new automated quality assessment algorithm for image fusion","volume":"27","author":"Chen","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.physd.2004.11.001","article-title":"A nonlinear correlation measure for multivariable data set","volume":"200","author":"Wang","year":"2005","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.aeue.2015.09.004","article-title":"A new image quality metric for image fusion: The sum of the correlations of differences","volume":"69","author":"Aslantas","year":"2015","journal-title":"AEU Int. J. Electron. Commun."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Li, L., and Ma, H. (2021). Pulse coupled neural network-based multimodal medical image fusion via guided filtering and WSEML in NSCT domain. Entropy, 23.","DOI":"10.3390\/e23050591"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1007\/s11760-013-0556-9","article-title":"Image fusion based on pixel significance using cross bilateral filter","volume":"9","author":"Shreyamsha","year":"2015","journal-title":"Signal Image Video Process."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"4771","DOI":"10.1109\/TCSVT.2021.3054584","article-title":"Infrared and visible image fusion via texture conditional generative adversarial network","volume":"31","author":"Yang","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_55","first-page":"1063","article-title":"Visible and NIR image fusion using weight-map-guided Laplacian-Gaussian pyramid for improving scene visibility","volume":"42","author":"Vanmali","year":"2017","journal-title":"Sadhana-Acad. Proc. Eng. Sci."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1109\/TMM.2021.3134565","article-title":"Depth-distilled multi-focus image fusion","volume":"25","author":"Zhao","year":"2023","journal-title":"IEEE Trans. Multimed."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"4293","DOI":"10.1109\/TCSVT.2021.3053405","article-title":"Detail-preserving multi-exposure fusion with edge-preserving structural patch decomposition","volume":"31","author":"Li","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Li, J., Han, D., Wang, X., Yi, P., Yan, L., and Li, X. (2023). Multi-sensor medical-image fusion technique based on embedding bilateral filter in least squares and salient detection. Sensors, 23.","DOI":"10.3390\/s23073490"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"3562","DOI":"10.1049\/iet-ipr.2020.0360","article-title":"Infrared and visible image fusion using a shallow CNN and structural similarity constraint","volume":"14","author":"Li","year":"2020","journal-title":"IET Image Process."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/10\/2486\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:32:11Z","timestamp":1760124731000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/10\/2486"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,9]]},"references-count":59,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["rs15102486"],"URL":"https:\/\/doi.org\/10.3390\/rs15102486","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,9]]}}}