{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T15:21:28Z","timestamp":1793114488329,"version":"4.5.0"},"reference-count":40,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2019,10,20]],"date-time":"2019-10-20T00:00:00Z","timestamp":1571529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In many actual applications, fused image is essential to contain high-quality details for achieving a comprehensive representation of the real scene. However, existing image fusion methods suffer from loss of details because of the error accumulations of sequential tasks. This paper proposes a novel fusion method to preserve details of infrared and visible images by combining new decomposition, feature extraction, and fusion scheme. For decomposition, different from the most decomposition methods by guided filter, the guidance image contains only the strong edge of the source image but no other interference information so that rich tiny details can be decomposed into the detailed part. Then, according to the different characteristics of infrared and visible detail parts, a rough convolutional neural network (CNN) and a sophisticated CNN are designed so that various features can be fully extracted. To integrate the extracted features, we also present a multi-layer features fusion strategy through discrete cosine transform (DCT), which not only highlights significant features but also enhances details. Moreover, the base parts are fused by weighting method. Finally, the fused image is obtained by adding the fused detail and base part. Different from the general image fusion methods, our method not only retains the target region of source image but also enhances background in the fused image. In addition, compared with state-of-the-art fusion methods, our proposed fusion method has many advantages, including (i) better visual quality of fused-image subjective evaluation, and (ii) better objective assessment for those images.<\/jats:p>","DOI":"10.3390\/s19204556","type":"journal-article","created":{"date-parts":[[2019,10,21]],"date-time":"2019-10-21T03:40:29Z","timestamp":1571629229000},"page":"4556","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Infrared and Visible Image Fusion through Details Preservation"],"prefix":"10.3390","volume":"19","author":[{"given":"Yaochen","family":"Liu","sequence":"first","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lili","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuanyuan","family":"Ji","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenhai","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.05.004","article-title":"Pixel-level image fusion: A survey of the state of the art","volume":"33","author":"Li","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7771","DOI":"10.3390\/s91007771","article-title":"Advances in Multi-Sensor Data Fusion: Algorithms and Applications","volume":"9","author":"Dong","year":"2009","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/JPROC.2018.2853589","article-title":"On the Applications of Robust PCA in Image and Video Processing","volume":"106","author":"Bouwans","year":"2018","journal-title":"Proc. IEEE"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1109\/JSEN.2007.894926","article-title":"Region-based multimodal image fusion using ICA bases","volume":"7","author":"Cvejic","year":"2007","journal-title":"IEEE Sens. J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1109\/5.775414","article-title":"A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application","volume":"87","author":"Zhang","year":"1999","journal-title":"Proc. IEEE"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6724","DOI":"10.1109\/ACCESS.2017.2685178","article-title":"Image fusion using quaternion wavelet transform and multiple features","volume":"5","author":"Chai","year":"2017","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.inffus.2017.05.006","article-title":"Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: A review","volume":"40","author":"Zhang","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TIM.2009.2026612","article-title":"Multifocus image fusion and restoration with sparse representation","volume":"59","author":"Yang","year":"2010","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.inffus.2018.07.010","article-title":"A survey on region based image fusion methods","volume":"48","author":"Meher","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"79039","DOI":"10.1109\/ACCESS.2018.2870393","article-title":"Target-aware fusion of infrared and visible images","volume":"6","author":"Zhou","year":"2018","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.inffus.2017.10.007","article-title":"Deep learning for pixel-level image fusion: Recent advances and future prospects","volume":"42","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.inffus.2018.09.004","article-title":"FusionGAN: A generative adversarial network for infrared and visible image fusion","volume":"48","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1850018","DOI":"10.1142\/S0219691318500182","article-title":"Infrared and visible image fusion with convolutional neural networks","volume":"16","author":"Liu","year":"2018","journal-title":"Int. J. Wavelets Multiresolut. Inf. Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2614","DOI":"10.1109\/TIP.2018.2887342","article-title":"DenseFuse: A fusion approach to infrared and visible images","volume":"25","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3064","DOI":"10.1364\/AO.58.003064","article-title":"Infrared and visible image perceptive fusion through multi-level gaussian curvature filtering image decomposition","volume":"58","author":"Tan","year":"2019","journal-title":"Appl. Opt."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"24646","DOI":"10.1109\/ACCESS.2017.2764101","article-title":"Multi-Scale Fusion Algorithm Based on Structure Similarity Index Constraint for Infrared Polarization and Intensity Images","volume":"5","author":"Zhang","year":"2017","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1016\/j.ins.2017.09.010","article-title":"A novel multi-modality image fusion method based on image decomposition and sparse representation","volume":"432","author":"Zhu","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.inffus.2011.01.002","article-title":"The multiscale directional bilateral filter and its and its application to multisensory image fusion","volume":"13","author":"Hu","year":"2012","journal-title":"Inf. Fusion"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided image filter","volume":"35","author":"He","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A computational approach to edge detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.inffus.2016.12.001","article-title":"Multi-focus image fusion with a deep convolutional neural network","volume":"36","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1109\/LSP.2016.2618776","article-title":"Image fusion with convolutional sparse representation","volume":"23","author":"Liu","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.1109\/JSTARS.2018.2805923","article-title":"Remote sensing image fusion with deep convolutional neural network","volume":"11","author":"Shao","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_26","unstructured":"Zeiler, M., and Fergus, R. (2013). Visualizing and understanding convolutional network. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/34.730558","article-title":"A model of saliency-based visual attention for rapid scene analysis","volume":"20","author":"Itti","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.inffus.2009.05.001","article-title":"Image fusion based on a new contourlet packet","volume":"1","author":"Yang","year":"2010","journal-title":"Inf. Fusion"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.infrared.2017.11.006","article-title":"Infrared visible image fusion using discrete cosine transform and swarm intelligence for surveillance applicatons","volume":"88","author":"Paramanandham","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_30","first-page":"20811","article-title":"A phase congruency and local Laplacian energy based multi-modality medical image fusion method in NSCT domain","volume":"20","author":"Zhu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","article-title":"Infrared and visible image fusion based on visual saliency map and weighted least square optimization","volume":"82","author":"Ma","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"72492","DOI":"10.1109\/ACCESS.2019.2920403","article-title":"Single Image Defogging Based on Multi-Channel Convolutional MSRCR","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","article-title":"Image fusion with guided filtering","volume":"22","author":"Li","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.infrared.2017.05.007","article-title":"Infrared and visible image fusion through infrared feature extraction and visual information preservation","volume":"83","author":"Zhang","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"023522","DOI":"10.1117\/1.2945910","article-title":"Assessment of image fusion procedures using entropy, image quality, and multispectral classification","volume":"2","author":"Roberts","year":"2008","journal-title":"J. Appl. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1016\/j.imavis.2011.09.003","article-title":"Edge preserved image fusion based on multiscale toggle contrast operator","volume":"29","author":"Bai","year":"2011","journal-title":"Image Vis. Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1049\/el:20020212","article-title":"Information measure for performance of image fusion","volume":"38","author":"Qu","year":"2002","journal-title":"Electron. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2959","DOI":"10.1109\/26.477498","article-title":"Image quality measures and their performance","volume":"43","author":"Eskicioglu","year":"1995","journal-title":"IEEE Trans. Commun."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s11760-014-0740-6","article-title":"A novel image fusion framework for night-vision navigation and surveillance","volume":"9","author":"Bhatnagar","year":"2015","journal-title":"Signal Image Video Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.inffus.2011.08.002","article-title":"A new image fusion performance metric based on visual information fidelity","volume":"14","author":"Han","year":"2013","journal-title":"Inf. Fusion"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/20\/4556\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:27:55Z","timestamp":1760189275000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/20\/4556"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,20]]},"references-count":40,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["s19204556"],"URL":"https:\/\/doi.org\/10.3390\/s19204556","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,20]]}}}