{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T16:28:38Z","timestamp":1775665718454,"version":"3.50.1"},"reference-count":37,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,5,22]],"date-time":"2021-05-22T00:00:00Z","timestamp":1621641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2019M663929XB"],"award-info":[{"award-number":["2019M663929XB"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61872280"],"award-info":[{"award-number":["61872280"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the International S&amp;T Cooperation Program of China","award":["2014DFG12780"],"award-info":[{"award-number":["2014DFG12780"]}]},{"name":"the Fundamental Research Funds for the Central Universities","award":["XJS200214"],"award-info":[{"award-number":["XJS200214"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We formulate multi-spectral fusion and denoising for the luminance channel as a maximum a posteriori estimation problem in the wavelet domain. To deal with the discrepancy between RGB and near infrared (NIR) data in fusion, we build a discrepancy model and introduce the wavelet scale map. The scale map adjusts the wavelet coefficients of NIR data to have the same distribution as the RGB data. We use the priors of the wavelet scale map and its gradient as the contrast preservation term and gradient denoising term, respectively. Specifically, we utilize the local contrast and visibility measurements in the contrast preservation term to transfer the selected NIR data to the fusion result. We also use the gradient of NIR wavelet coefficients as the weight for the gradient denoising term in the wavelet scale map. Based on the wavelet scale map, we perform fusion of the RGB and NIR wavelet coefficients in the base and detail layers. To remove noise, we model the prior of the fused wavelet coefficients using NIR-guided Laplacian distributions. In the chrominance channels, we remove noise guided by the fused luminance channel. Based on the luminance variation after fusion, we further enhance the color of the fused image. Our experimental results demonstrated that the proposed method successfully performed the fusion of RGB and NIR images with noise reduction, detail preservation, and color enhancement.<\/jats:p>","DOI":"10.3390\/s21113610","type":"journal-article","created":{"date-parts":[[2021,5,24]],"date-time":"2021-05-24T00:01:20Z","timestamp":1621814480000},"page":"3610","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Multi-Spectral Fusion and Denoising of Color and Near-Infrared Images Using Multi-Scale Wavelet Analysis"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5481-1082","authenticated-orcid":false,"given":"Haonan","family":"Su","sequence":"first","affiliation":[{"name":"School of Electronic and Engineering, Xidian University, No. 2 South Taibai Road, Xi\u2019an, Shaanxi 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheolkon","family":"Jung","sequence":"additional","affiliation":[{"name":"School of Electronic and Engineering, Xidian University, No. 2 South Taibai Road, Xi\u2019an, Shaanxi 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Long","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Electronic and Engineering, Xidian University, No. 2 South Taibai Road, Xi\u2019an, Shaanxi 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1109\/TIP.2016.2633941","article-title":"Guided Wavelet Shrinkage for Edge-Aware Smoothing","volume":"26","author":"Deng","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1109\/LSP.2017.2688707","article-title":"Wavelet-Based Total Variation and Nonlocal Similarity Model for Image Denoising","volume":"24","author":"Shen","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1109\/LSP.2015.2406314","article-title":"Artifact-free wavelet denoising: Non-convex sparse regularization, convex optimization","volume":"22","author":"Ding","year":"2015","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yamashita, H., Sugimura, D., and Hamamoto, T. (2015, January 13\u201316). Enhancing low-light color images using an RGB-NIR single sensor. Proceedings of the IEEE International Conference on Visual Communications and Image Processing (VCIP), Singapore.","DOI":"10.1109\/VCIP.2015.7457844"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yamashita, H., Sugimura, D., and Hamamoto, T. (2017, January 5\u20139). RGB-NIR imaging with exposure bracketing for joint denoising and deblurring of low-light color images. Proceedings of the IEEE International Conference onAcoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7953319"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3111","DOI":"10.1109\/TCSVT.2017.2748150","article-title":"Near-Infrared Fusion via Color Regularization for Haze and Color Distortion Removals","volume":"28","author":"Son","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5381","DOI":"10.1109\/TIP.2017.2724241","article-title":"Near-Infrared Coloring via a Contrast-Preserving Mapping Model","volume":"26","author":"Son","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2518","DOI":"10.1109\/TPAMI.2015.2417569","article-title":"Multispectral joint image restoration via optimizing a scale map","volume":"37","author":"Shen","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"96:1","DOI":"10.1145\/1531326.1531402","article-title":"Dark Flash Photography","volume":"28","author":"Krishnan","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_10","unstructured":"Fredembach, C., and S\u00fcsstrunk, S. (2008, January 10\u201314). Colouring the near-infrared. Proceedings of the Color and Imaging Conference. Society for Imaging Science and Technology, Portland, OR, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhuo, S., Zhang, X., Miao, X., and Sim, T. (2010, January 26\u201329). Enhancing low light images using near infrared flash images. Proceedings of the IEEE International Conference on Image Processing (ICIP), Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5652900"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1394","DOI":"10.1016\/j.jvcir.2013.09.008","article-title":"Robust blind motion deblurring using near-infrared flash image","volume":"24","author":"Li","year":"2013","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yan, Q., Shen, X., Xu, L., Zhuo, S., Zhang, X., Shen, L., and Jia, J. (2013, January 1\u20138). Cross-field joint image restoration via scale map. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.194"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3586","DOI":"10.1109\/TIP.2015.2448356","article-title":"Enhancing color images of extremely low light scenes based on RGB\/NIR images acquisition with different exposure times","volume":"24","author":"Sugimura","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2866","DOI":"10.1109\/TIP.2016.2556618","article-title":"Layer-based approach for image pair fusion","volume":"25","author":"Son","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"013016","DOI":"10.1117\/1.JEI.25.1.013016","article-title":"Versatile visible and near-infrared image fusion based on high visibility area selection","volume":"25","author":"Shibata","year":"2016","journal-title":"J. Electron. Imaging"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2614","DOI":"10.1109\/TIP.2018.2887342","article-title":"DenseFuse: A Fusion Approach to Infrared and Visible Images","volume":"28","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"11820","DOI":"10.1109\/JSEN.2019.2948783","article-title":"Multi-Modality Image Fusion in Adaptive-Parameters SPCNN Based on Inherent Characteristics of Image","volume":"20","author":"Zhang","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8062","DOI":"10.1109\/JSEN.2020.2981719","article-title":"Image Dehazing by an Artificial Image Fusion Method Based on Adaptive Structure Decomposition","volume":"20","author":"Zheng","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3845","DOI":"10.1109\/TIP.2020.2966075","article-title":"Unsupervised Deep Image Fusion With Structure Tensor Representations","volume":"29","author":"Jung","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Su, H., and Jung, C. (2018, January 20\u201324). Multi-spectral Fusion and Denoising of RGB and NIR Images Using Multi-scale Wavelet Analysis. Proceedings of the 2018 24th IAPR International Conference on Pattern Reconition (ICPR), Beijing, China.","DOI":"10.1109\/ICPR.2018.8545108"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1109\/TIP.2005.863972","article-title":"Bayesian wavelet-based image deconvolution: A GEM algorithm exploiting a class of heavy-tailed priors","volume":"15","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/TMM.2013.2244870","article-title":"Directive contrast based multimodal medical image fusion in NSCT domain","volume":"15","author":"Bhatnagar","year":"2013","journal-title":"IEEE Trans. Multimed."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1076","DOI":"10.1109\/TIP.2016.2633863","article-title":"Perceptual Image Fusion Using Wavelets","volume":"26","author":"Hill","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, L., Yan, Q., Xia, Y., and Jia, J. (2012). Structure Extraction from Texture via Natural Variation Measure. ACM Trans. Graph. (Siggraph Asia), 31.","DOI":"10.1145\/2366145.2366158"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1145\/1360612.1360666","article-title":"Edge-preserving decompositions for multi-scale tone and detail manipulation","volume":"27","author":"Farbman","year":"2008","journal-title":"ACM Trans. Graph. (Tog)."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1109\/LSP.2007.911148","article-title":"Variational Models for Fusion and Denoising of Multifocus Images","volume":"15","author":"Wang","year":"2008","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided image filtering","volume":"35","author":"He","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1109\/LSP.2016.2580711","article-title":"Color image denoising via cross-channel texture transferring","volume":"23","author":"Dinh","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1111\/j.1467-8659.2009.01358.x","article-title":"Color Correction for Tone Mapping","volume":"28","author":"Mantiuk","year":"2009","journal-title":"Comput. Graph. Forum (Proc. Eurographics 2009)"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2080","DOI":"10.1109\/TIP.2007.901238","article-title":"Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering","volume":"16","author":"Dabov","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1145\/584091.584093","article-title":"A mathematical theory of communication","volume":"5","author":"Shannon","year":"2001","journal-title":"ACM SIGMOBILE Mob. Comput. Commun. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2579","DOI":"10.1109\/TIP.2015.2426416","article-title":"A feature-enriched completely blind image quality evaluator","volume":"24","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/TCE.2013.6626251","article-title":"No reference color image contrast and quality measures","volume":"59","author":"Panetta","year":"2013","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1763","DOI":"10.1109\/TIP.2006.873460","article-title":"JPEG2000 encoding with perceptual distortion control","volume":"15","author":"Liu","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.02.001","article-title":"Infrared and visible image fusion via gradient transfer and total variation minimization","volume":"31","author":"Ma","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1109\/TPAMI.2017.2669034","article-title":"Robust Guided Image Filtering Using Nonconvex Potentials","volume":"40","author":"Ham","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3610\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:05:59Z","timestamp":1760162759000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3610"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,22]]},"references-count":37,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21113610"],"URL":"https:\/\/doi.org\/10.3390\/s21113610","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,22]]}}}