{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:34:59Z","timestamp":1760243699394,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,9,24]],"date-time":"2022-09-24T00:00:00Z","timestamp":1663977600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62171467","F2021506004"],"award-info":[{"award-number":["62171467","F2021506004"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003787","name":"Natural Science Foundation of Hebei Province","doi-asserted-by":"publisher","award":["62171467","F2021506004"],"award-info":[{"award-number":["62171467","F2021506004"]}],"id":[{"id":"10.13039\/501100003787","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Image fusion technology can process multiple single image data into more reliable and comprehensive data, which play a key role in accurate target recognition and subsequent image processing. In view of the incomplete image decomposition, redundant extraction of infrared image energy information and incomplete feature extraction of visible images by existing algorithms, a fusion algorithm for infrared and visible image based on three-scale decomposition and ResNet feature transfer is proposed. Compared with the existing image decomposition methods, the three-scale decomposition method is used to finely layer the source image through two decompositions. Then, an optimized WLS method is designed to fuse the energy layer, which fully considers the infrared energy information and visible detail information. In addition, a ResNet-feature transfer method is designed for detail layer fusion, which can extract detailed information such as deeper contour structures. Finally, the structural layers are fused by weighted average strategy. Experimental results show that the proposed algorithm performs well in both visual effects and quantitative evaluation results compared with the five methods.<\/jats:p>","DOI":"10.3390\/e24101356","type":"journal-article","created":{"date-parts":[[2022,9,25]],"date-time":"2022-09-25T23:13:27Z","timestamp":1664147607000},"page":"1356","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Fusion of Infrared and Visible Images Based on Three-Scale Decomposition and ResNet Feature Transfer"],"prefix":"10.3390","volume":"24","author":[{"given":"Jingyu","family":"Ji","sequence":"first","affiliation":[{"name":"Department of UAV, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuhua","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of UAV, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongjiang","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of UAV, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongke","family":"Li","sequence":"additional","affiliation":[{"name":"Department of UAV, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changlong","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of UAV, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhilong","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of UAV, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fuyu","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Electronic and Optical Engineering, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiangyi","family":"Yao","sequence":"additional","affiliation":[{"name":"Equipment Simulation Training Center, Army Engineering University, Shijiazhuang 050003, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Yang, Z., and Zeng, S. (2022). TPFusion: Texture preserving fusion of infrared and visible images via dense networks. Entropy, 24.","DOI":"10.3390\/e24020294"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhao, Y., Cheng, J., Zhou, W., Zhang, C., and Pan, X. (2019, January 18\u201321). Infrared pedestrian detection with converted temperature map. Proceedings of the 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Piscataway, NJ, USA.","DOI":"10.1109\/APSIPAASC47483.2019.9023228"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1007\/s10921-021-00805-6","article-title":"Infrared Image Correlation for Non-destructive Testing and Evaluation of Materials","volume":"40","author":"Arora","year":"2021","journal-title":"J. Nondestruct. Eval."},{"key":"ref_4","unstructured":"Fischler, M.A., and Firschein, O. (1987). The Laplacian pyramid as a compact image code. Readings in Computer Vision, Morgan Kaufmann."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/0167-8655(89)90003-2","article-title":"Image fusion by a ratio of low-pass pyramid","volume":"9","author":"Toet","year":"1989","journal-title":"Pattern Recognit. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/0167-8655(89)90004-4","article-title":"A morphological pyramidal image decomposition","volume":"9","author":"Toet","year":"1989","journal-title":"Pattern Recognit. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"108108","DOI":"10.1016\/j.sigpro.2021.108108","article-title":"Infrared and visible image fusion based on edge-preserving guided filter and infrared feature decomposition","volume":"186","author":"Ren","year":"2021","journal-title":"Signal Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1007\/s12524-016-0605-2","article-title":"ALOS PALSAR and hyperion data fusion for land use land cover feature extraction","volume":"45","author":"Kumar","year":"2017","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","article-title":"Infrared and visible image fusion based on visual saliency map and weighted least square optimization","volume":"82","author":"Ma","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4733","DOI":"10.1109\/TIP.2020.2975984","article-title":"MDLatLRR: A novel decomposition method for infrared and visible image fusion","volume":"29","author":"Li","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4881","DOI":"10.1016\/j.ijleo.2014.04.036","article-title":"Visual attention guided image fusion with sparse representation","volume":"125","author":"Yang","year":"2014","journal-title":"Opt.-Int. J. Light Electron Opt."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A general framework for image fusion based on multi-scale transform and sparse representation","volume":"24","author":"Liu","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"10564","DOI":"10.1364\/OE.27.010564","article-title":"Weighted sparse representation multi-scale transform fusion algorithm for high dynamic range imaging with a low-light dual-channel camera","volume":"27","author":"Chen","year":"2019","journal-title":"Opt. Express"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, H., Wu, X.J., and Kittler, J. (2018, January 20\u201324). Infrared and visible image fusion using a deep learning framework. Proceedings of the 24th International Conference on Pattern Recognition (ICPR), Beijing, China.","DOI":"10.1109\/ICPR.2018.8546006"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"165120","DOI":"10.1016\/j.ijleo.2020.165120","article-title":"Infrared and visible image fusion with supervised convolutional neural network","volume":"219","author":"An","year":"2020","journal-title":"Opt.-Int. J. Light Electron Opt."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.inffus.2018.09.004","article-title":"FusionGAN: A generative adversarial network for infrared and visible image fusion","volume":"48","author":"Ma","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2050063","DOI":"10.1142\/S0219691320500630","article-title":"Structural similarity preserving GAN for infrared and visible image fusion","volume":"19","author":"Zhang","year":"2021","journal-title":"Int. J. Wavelets Multiresolut. Inf. Processing"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Shen, X., Xu, L., and Jia, J. (2014, January 6\u201312). Rolling guidance filter. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10578-9_53"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided image filtering","volume":"35","author":"He","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, H., and Dana, K. (2018, January 8\u201314). Multi-style generative network for real-time transfer. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11018-5_32"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1587\/transinf.2020EDL8116","article-title":"Identification of multiple image steganographic methods using hierarchical ResNets","volume":"104","author":"Kang","year":"2021","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103039","DOI":"10.1016\/j.infrared.2019.103039","article-title":"Infrared and visible image fusion with ResNet and zero-phase component analysis","volume":"102","author":"Li","year":"2019","journal-title":"Infrared Phys. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"Imagenet large scale visual recognition challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yang, F., Li, J., Xu, S., and Pan, G. (2010, January 12). The research of a video segmentation algorithm based on image fusion in the wavelet domain. Proceedings of the 5th International Symposium on Advanced Optical Manufacturing and Testing Technologies: Smart Structures and Materials in Manufacturing and Testing, Dalian, China.","DOI":"10.1117\/12.864536"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1850018","DOI":"10.1142\/S0219691318500182","article-title":"Infrared and visible image fusion with convolutional neural networks","volume":"16","author":"Liu","year":"2018","journal-title":"Int. J. Wavelets Multiresolut. Inf. Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.02.001","article-title":"Infrared and visible image fusion via gradient transfer and total variation minimization","volume":"31","author":"Ma","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.infrared.2017.05.007","article-title":"Infrared and visual image fusion through infrared feature extraction and visual information preservation","volume":"83","author":"Zhang","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.infrared.2016.01.009","article-title":"Two-scale image fusion of visible and infrared images using saliency detection","volume":"76","author":"Bavirisetti","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_29","first-page":"5005014","article-title":"GANMcC: A generative adversarial network with multiclassification constraints for infrared and visible image fusion","volume":"70","author":"Ma","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1109\/TPAMI.2020.3012548","article-title":"U2Fusion: A unified unsupervised image fusion network","volume":"44","author":"Xu","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1016\/j.isprsjprs.2006.05.001","article-title":"Additive integration of SAR features into multispectral SPOT images by means of the \u00e0 trous wavelet decomposition","volume":"60","author":"Chibani","year":"2006","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_32","first-page":"181","article-title":"Objective image fusion performance measure","volume":"56","author":"Xydeas","year":"2000","journal-title":"Mil. Tech. Cour."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1421","DOI":"10.1016\/j.imavis.2007.12.002","article-title":"A new automated quality assessment algorithm for image fusion","volume":"27","author":"Yin","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1049\/el:20020212","article-title":"Information measure for performance of image fusion","volume":"38","author":"Qu","year":"2002","journal-title":"Electron. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Zhou","year":"2004","journal-title":"IEEE Trans. Image Process."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/10\/1356\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:38:46Z","timestamp":1760143126000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/10\/1356"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,24]]},"references-count":35,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["e24101356"],"URL":"https:\/\/doi.org\/10.3390\/e24101356","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,9,24]]}}}