{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T10:09:37Z","timestamp":1781086177656,"version":"3.54.1"},"reference-count":26,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T00:00:00Z","timestamp":1661385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The purpose of infrared and visible image fusion is to generate images with prominent targets and rich information which provides the basis for target detection and recognition. Among the existing image fusion methods, the traditional method is easy to produce artifacts, and the information of the visible target and texture details are not fully preserved, especially for the image fusion under dark scenes and smoke conditions. Therefore, an infrared and visible image fusion method is proposed based on visual saliency image and image contrast enhancement processing. Aiming at the problem that low image contrast brings difficulty to fusion, an improved gamma correction and local mean method is used to enhance the input image contrast. To suppress artifacts that are prone to occur in the process of image fusion, a differential rolling guidance filter (DRGF) method is adopted to decompose the input image into the basic layer and the detail layer. Compared with the traditional multi-scale decomposition method, this method can retain specific edge information and reduce the occurrence of artifacts. In order to solve the problem that the salient object of the fused image is not prominent and the texture detail information is not fully preserved, the salient map extraction method is used to extract the infrared image salient map to guide the fusion image target weight, and on the other hand, it is used to control the fusion weight of the basic layer to improve the shortcomings of the traditional \u2018average\u2019 fusion method to weaken the contrast information. In addition, a method based on pixel intensity and gradient is proposed to fuse the detail layer and retain the edge and detail information to the greatest extent. Experimental results show that the proposed method is superior to other fusion algorithms in both subjective and objective aspects.<\/jats:p>","DOI":"10.3390\/s22176390","type":"journal-article","created":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T01:50:26Z","timestamp":1661392226000},"page":"6390","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Infrared and Visible Image Fusion Based on Visual Saliency Map and Image Contrast Enhancement"],"prefix":"10.3390","volume":"22","author":[{"given":"Yuanyuan","family":"Liu","sequence":"first","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130000, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiyong","family":"Wu","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xizhen","family":"Han","sequence":"additional","affiliation":[{"name":"Computer Science and Technology College, Changchun University of Science and Technology, Changchun 130000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiang","family":"Sun","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jian","family":"Zhao","sequence":"additional","affiliation":[{"name":"Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianzhuo","family":"Liu","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,25]]},"reference":[{"key":"ref_1","unstructured":"Heo, J., Kong, S.G., Abidi, B.R., and Abidi, M.A. (July, January 27). Fusion of visual and thermal signatures with eyeglass removal for robust face recognition. Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop, Washington, DC, USA."},{"key":"ref_2","unstructured":"Kumar, K.S., Kavitha, G., Subramanian, R., and Ramesh, G. (2011). Visual and thermal image fusion for UAV based target tracking. MATLAB-A Ubiquitous Tool for the Practical Engineer, InTech."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1007\/s10044-017-0621-z","article-title":"Fusion of thermal infrared and visible spectra for robust moving object detection","volume":"20","author":"Fendri","year":"2017","journal-title":"Pattern Anal. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1808","DOI":"10.1109\/JSTARS.2015.2489838","article-title":"Developing a spectral-based strategy for urban object detection from airborne hyperspectral TIR and visible data","volume":"9","author":"Eslami","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/LGRS.2010.2041323","article-title":"Multicontourlet-based adaptive fusion of infrared and visible remote sensing images","volume":"7","author":"Chang","year":"2010","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Burt, P.J., and Adelson, E.H. (1987). The Laplacian pyramid as a compact image code. Readings in Computer Vision, Elsevier.","DOI":"10.1016\/B978-0-08-051581-6.50065-9"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1137\/0515056","article-title":"Decomposition of Hardy functions into square integrable wavelets of constant shape","volume":"15","author":"Grossmann","year":"1984","journal-title":"SIAM J. Math. Anal."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.acha.2007.09.003","article-title":"Sparse directional image representations using the discrete shearlet transform","volume":"25","author":"Easley","year":"2008","journal-title":"Appl. Comput. Harmon. Anal."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3089","DOI":"10.1109\/TIP.2006.877507","article-title":"The nonsubsampled contourlet transform: Theory, design, and applications","volume":"15","author":"Zhou","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Huang, Y., Bi, D., and Wu, D. (2018). Infrared and visible image fusion based on different constraints in the non-subsampled shearlet transform domain. Sensors, 18.","DOI":"10.3390\/s18041169"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.inffus.2021.02.008","article-title":"An infrared and visible image fusion method based on multi-scale transformation and norm optimization","volume":"71","author":"Li","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.ins.2019.08.066","article-title":"Infrared and visible image fusion based on target-enhanced multiscale transform decomposition","volume":"508","author":"Chen","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, H., and Wu, X.J. (2018). Infrared and visible image fusion using latent low-rank representation. arXiv.","DOI":"10.1109\/ICPR.2018.8546006"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1016\/j.infrared.2018.06.029","article-title":"Infrared and visible image fusion method based on sparse features","volume":"92","author":"Ding","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.inffus.2015.11.003","article-title":"Perceptual fusion of infrared and visible images through a hybrid multi-scale decomposition with Gaussian and bilateral filters","volume":"30","author":"Zhou","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","article-title":"Infrared and visible image fusion based on visual saliency map and weighted least square optimization","volume":"82","author":"Ma","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zuo, Y., Liu, J., Bai, G., Wang, X., and Sun, M. (2017). Airborne infrared and visible image fusion combined with region segmentation. Sensors, 17.","DOI":"10.3390\/s17051127"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"6480","DOI":"10.1364\/AO.55.006480","article-title":"Fusion of infrared and visible images for night-vision context enhancement","volume":"55","author":"Zhou","year":"2016","journal-title":"Appl. Opt."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shi, Y., Yang, J., and Wu, R. (October, January 16). Reducing illumination based on nonlinear gamma correction. Proceedings of the 2007 IEEE International Conference on Image Processing, San Antonio, TX, USA.","DOI":"10.1109\/ICIP.2007.4379008"},{"key":"ref_21","first-page":"1","article-title":"Robust principal component analysis?","volume":"58","author":"Li","year":"2011","journal-title":"J. ACM (JACM)"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhai, Y., and Shah, M. (2006, January 23\u201327). Visual attention detection in video sequences using spatiotemporal cues. Proceedings of the 14th ACM International Conference on Multimedia, Santa Barbara, CA, USA.","DOI":"10.1145\/1180639.1180824"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Shen, X., Xu, L., and Jia, J. (2014, January 6\u201312). Rolling guidance filter. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10578-9_53"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1109\/TIP.2002.1014998","article-title":"The curvelet transform for image denoising","volume":"11","author":"Starck","year":"2002","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TPAMI.2011.109","article-title":"Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: A comparative study","volume":"34","author":"Liu","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, X., Ye, P., and Xiao, G. (2020, January 14\u201319). VIFB: A visible and infrared image fusion benchmark. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00060"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6390\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:14:55Z","timestamp":1760141695000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6390"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,25]]},"references-count":26,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22176390"],"URL":"https:\/\/doi.org\/10.3390\/s22176390","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,25]]}}}