{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,21]],"date-time":"2025-11-21T11:28:59Z","timestamp":1763724539514,"version":"build-2065373602"},"reference-count":58,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T00:00:00Z","timestamp":1634083200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Multi-modality image fusion applied to improve image quality has drawn great attention from researchers in recent years. However, noise is actually generated in images captured by different types of imaging sensors, which can seriously affect the performance of multi-modality image fusion. As the fundamental method of noisy image fusion, source images are denoised first, and then the denoised images are fused. However, image denoising can decrease the sharpness of source images to affect the fusion performance. Additionally, denoising and fusion are processed in separate processing modes, which causes an increase in computation cost. To fuse noisy multi-modality image pairs accurately and efficiently, a multi-modality image simultaneous fusion and denoising method is proposed. In the proposed method, noisy source images are decomposed into cartoon and texture components. Cartoon-texture decomposition not only decomposes source images into detail and structure components for different image fusion schemes, but also isolates image noise from texture components. A Gaussian scale mixture (GSM) based sparse representation model is presented for the denoising and fusion of texture components. A spatial domain fusion rule is applied to cartoon components. The comparative experimental results confirm the proposed simultaneous image denoising and fusion method is superior to the state-of-the-art methods in terms of visual and quantitative evaluations.<\/jats:p>","DOI":"10.3390\/computers10100129","type":"journal-article","created":{"date-parts":[[2021,10,13]],"date-time":"2021-10-13T21:36:15Z","timestamp":1634160975000},"page":"129","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A Novel Multi-Modality Image Simultaneous Denoising and Fusion Method Based on Sparse Representation"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9562-3865","authenticated-orcid":false,"given":"Guanqiu","family":"Qi","sequence":"first","affiliation":[{"name":"Computer Information Systems Department, State University of New York at Buffalo State, Buffalo, NY 14222, USA"}]},{"given":"Gang","family":"Hu","sequence":"additional","affiliation":[{"name":"Computer Information Systems Department, State University of New York at Buffalo State, Buffalo, NY 14222, USA"}]},{"given":"Neal","family":"Mazur","sequence":"additional","affiliation":[{"name":"Computer Information Systems Department, State University of New York at Buffalo State, Buffalo, NY 14222, USA"}]},{"given":"Huahua","family":"Liang","sequence":"additional","affiliation":[{"name":"College of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"given":"Matthew","family":"Haner","sequence":"additional","affiliation":[{"name":"Department of Mathematics & Computer and Information Science, Mansfield University of Pennsylvania, Mansfield, PA 16933, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1109\/TIP.2017.2651365","article-title":"Improved Denoising via Poisson Mixture Modeling of Image Sensor Noise","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_2","first-page":"1","article-title":"A Novel Fast Single Image Dehazing Algorithm Based on Artificial Multiexposure Image Fusion","volume":"70","author":"Zhu","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"8062","DOI":"10.1109\/JSEN.2020.2981719","article-title":"Image Dehazing by an Artificial Image Fusion Method Based on Adaptive Structure Decomposition","volume":"20","author":"Zheng","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.ins.2016.02.030","article-title":"Multifocus image fusion by combining with mixed-order structure tensors and multiscale neighborhood","volume":"349","author":"Li","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, K., Zheng, M., Wei, H., Qi, G., and Li, Y. (2020). Multi-Modality Medical Image Fusion Using Convolutional Neural Network and Contrast Pyramid. Sensors, 20.","DOI":"10.3390\/s20082169"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, Y., Sun, Y., Huang, X., Qi, G., Zheng, M., and Zhu, Z. (2018). An Image Fusion Method Based on Sparse Representation and Sum Modified-Laplacian in NSCT Domain. Entropy, 20.","DOI":"10.3390\/e20070522"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.05.004","article-title":"Pixel-level image fusion: A survey of the state of the art","volume":"33","author":"Li","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.infrared.2016.02.005","article-title":"Infrared and visible image fusion scheme based on NSCT and low-level visual features","volume":"76","author":"Li","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"20811","DOI":"10.1109\/ACCESS.2019.2898111","article-title":"A Phase Congruency and Local Laplacian Energy Based Multi-Modality Medical Image Fusion Method in NSCT Domain","volume":"7","author":"Zhu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3450","DOI":"10.1109\/TBME.2012.2217493","article-title":"Group-Sparse Representation With Dictionary Learning for Medical Image Denoising and Fusion","volume":"59","author":"Li","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Luo, Y., Qi, G., Meng, J., Li, Y., and Mazur, N. (2021). Remote Sensing Image Defogging Networks Based on Dual Self-Attention Boost Residual Octave Convolution. Remote Sens., 13.","DOI":"10.3390\/rs13163104"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Luo, Y., Wei, H., Li, Y., Qi, G., Mazur, N., Li, Y., and Li, P. (2021). Atmospheric Light Estimation Based Remote Sensing Image Dehazing. Remote Sens., 13.","DOI":"10.3390\/rs13132432"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.ins.2014.09.060","article-title":"LAPB: Locally adaptive patch-based wavelet domain edge-preserving image denoising","volume":"294","author":"Jain","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.sigpro.2017.03.008","article-title":"Multifocus image fusion via fixed window technique of multiscale images and non-local means filtering","volume":"138","author":"Li","year":"2017","journal-title":"Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/j.sigpro.2016.05.015","article-title":"Performance improvement scheme of multifocus image fusion derived by difference images","volume":"128","author":"Li","year":"2016","journal-title":"Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2231","DOI":"10.1109\/TIT.2004.834793","article-title":"Greed is Good: Algorithmic Results for Sparse Approximation","volume":"50","author":"Tropp","year":"2004","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2197","DOI":"10.1073\/pnas.0437847100","article-title":"Optimally sparse representation in general nonorthogonal dictionaries via l \u2212 1 minimization","volume":"100","author":"Donoho","year":"2003","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1816","DOI":"10.1109\/TNNLS.2014.2357036","article-title":"Robust Exemplar Extraction Using Structured Sparse Coding","volume":"26","author":"Liu","year":"2015","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1109\/TGRS.2014.2321557","article-title":"Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint","volume":"53","author":"Zhao","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1109\/TPAMI.2013.109","article-title":"Joint Sparse Representation for Robust Multimodal Biometrics Recognition","volume":"36","author":"Shekhar","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.ins.2016.02.055","article-title":"Sparse representation matching for person re-identification","volume":"355\u2013356","author":"An","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1109\/TIM.2016.2514779","article-title":"Object Recognition Using Tactile Measurements: Kernel Sparse Coding Methods","volume":"65","author":"Liu","year":"2016","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4311","DOI":"10.1109\/TSP.2006.881199","article-title":"K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation","volume":"54","author":"Aharon","year":"2006","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1109\/JSTSP.2011.2155032","article-title":"Multi-Scale Dictionary Learning Using Wavelets","volume":"5","author":"Ophir","year":"2011","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mairal, J., Bach, F., Ponce, J., and Sapiro, G. (2009, January 14\u201318). Online dictionary learning for sparse coding. Proceedings of the International Conference on Machine Learning, ICML 2009, Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553463"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zoran, D., and Weiss, Y. (2011, January 6\u201313). From learning models of natural image patches to whole image restoration. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126278"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2346","DOI":"10.1109\/TSP.2007.914345","article-title":"Bayesian Compressive Sensing","volume":"56","author":"Ji","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1109\/TIP.2012.2221729","article-title":"Nonlocal image restoration with bilateral variance estimation: A low-rank approach","volume":"22","author":"Dong","year":"2013","journal-title":"IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A general framework for image fusion based on multi-scale transform and sparse representation","volume":"24","author":"Liu","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TIM.2009.2026612","article-title":"Multifocus Image Fusion and Restoration With Sparse Representation","volume":"59","author":"Yang","year":"2010","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.neucom.2016.11.051","article-title":"A novel infrared and visible image fusion algorithm based on shift-invariant dual-tree complex shearlet transform and sparse representation","volume":"226","author":"Yin","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.neucom.2016.07.039","article-title":"A novel sparse-representation-based multi-focus image fusion approach","volume":"216","author":"Yin","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1016\/j.ins.2017.09.010","article-title":"A novel multi-modality image fusion method based on image decomposition and sparse representation","volume":"432","author":"Zhu","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.inffus.2015.03.003","article-title":"Joint patch clustering-based dictionary learning for multimodal image fusion","volume":"27","author":"Kim","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Qi, G., Chai, Y., and Li, P. (2017). A Geometric Dictionary Learning Based Approach for Fluorescence Spectroscopy Image Fusion. Appl. Sci., 7.","DOI":"10.3390\/app7020161"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, K., Qi, G., Zhu, Z., and Chai, Y. (2017). A Novel Geometric Dictionary Construction Approach for Sparse Representation Based Image Fusion. Entropy, 19.","DOI":"10.3390\/e19070306"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.inffus.2016.09.007","article-title":"A novel multi-focus image fusion approach based on image decomposition","volume":"35","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1049\/iet-ipr.2014.0311","article-title":"Simultaneous image fusion and denoising with adaptive sparse representation","volume":"9","author":"Liu","year":"2015","journal-title":"Iet Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.patcog.2018.02.005","article-title":"Joint medical image fusion, denoising and enhancement via discriminative low-rank sparse dictionaries learning","volume":"79","author":"Li","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"107087","DOI":"10.1016\/j.knosys.2021.107087","article-title":"Joint image fusion and denoising via three-layer decomposition and sparse representation","volume":"224","author":"Li","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.cam.2018.11.012","article-title":"Simultaneous image fusion and denoising by using fractional-order gradient information","volume":"351","author":"Mei","year":"2019","journal-title":"J. Comput. Appl. Math."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Su, H., Jung, C., and Yu, L. (2021). Multi-Spectral Fusion and Denoising of Color and Near-Infrared Images Using Multi-Scale Wavelet Analysis. Sensors, 21.","DOI":"10.3390\/s21113610"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"18751","DOI":"10.1364\/OE.28.018751","article-title":"Variational model for simultaneously image denoising and contrast enhancement","volume":"28","author":"Wang","year":"2020","journal-title":"Opt. Express"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Yang, F., Xu, S., and Li, C. (2020). Boosting of Denoising Effect with Fusion Strategy. Appl. Sci., 10.","DOI":"10.3390\/app10113857"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/B:JMIV.0000011316.54027.6a","article-title":"Image Denoising and Decomposition with Total Variation Minimization and Oscillatory Functions","volume":"20","author":"Vese","year":"2004","journal-title":"J. Math. Imaging Vis."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s11263-015-0808-y","article-title":"Image Restoration via Simultaneous Sparse Coding: Where Structured Sparsity Meets Gaussian Scale Mixture","volume":"114","author":"Dong","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1049\/el:20060693","article-title":"Image fusion metric based on mutual information and Tsallis entropy","volume":"42","author":"Cvejic","year":"2006","journal-title":"Electron. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TPAMI.2011.109","article-title":"Objective Assessment of Multiresolution Image Fusion Algorithms for Context Enhancement in Night Vision: A Comparative Study","volume":"34","author":"Liu","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Wang, Q., Shen, Y., and Jin, J. (2008). 19\u2014Performance evaluation of image fusion techniques. Image Fusion, 469\u2013492.","DOI":"10.1016\/B978-0-12-372529-5.00017-2"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.inffus.2005.05.001","article-title":"Subjective tests for image fusion evaluation and objective metric validation","volume":"8","author":"Petrovic","year":"2007","journal-title":"Inf. Fusion"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.cviu.2007.04.003","article-title":"A feature-based metric for the quantitative evaluation of pixel-level image fusion","volume":"109","author":"Liu","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1441","DOI":"10.1109\/TIM.2004.834094","article-title":"Fast quantitative correlation analysis and information deviation analysis for evaluating the performances of image fusion techniques","volume":"53","author":"Wang","year":"2004","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Qi, G., Chang, L., Luo, Y., Chen, Y., Zhu, Z., and Wang, S. (2020). A Precise Multi-Exposure Image Fusion Method Based on Low-level Features. Sensors, 20.","DOI":"10.3390\/s20061597"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.inffus.2006.09.001","article-title":"A novel similarity based quality metric for image fusion","volume":"9","author":"Yang","year":"2008","journal-title":"Inf. Fusion"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1421","DOI":"10.1016\/j.imavis.2007.12.002","article-title":"A new automated quality assessment algorithm for image fusion","volume":"27","author":"Chen","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1109\/TIP.2005.859378","article-title":"Image information and visual quality","volume":"15","author":"Sheikh","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Huang, X., Qi, G., Wei, H., Chai, Y., and Sim, J. (2019). A Novel Infrared and Visible Image Information Fusion Method Based on Phase Congruency and Image Entropy. Entropy, 21.","DOI":"10.3390\/e21121135"},{"key":"ref_58","first-page":"2459","article-title":"Gradient Histogram Estimation and Preservation for Texture Enhanced Image Denoising","volume":"23","author":"Zuo","year":"2014","journal-title":"IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/10\/10\/129\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:12:41Z","timestamp":1760166761000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/10\/10\/129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,13]]},"references-count":58,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["computers10100129"],"URL":"https:\/\/doi.org\/10.3390\/computers10100129","relation":{},"ISSN":["2073-431X"],"issn-type":[{"type":"electronic","value":"2073-431X"}],"subject":[],"published":{"date-parts":[[2021,10,13]]}}}