{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T02:59:35Z","timestamp":1768013975009,"version":"3.49.0"},"reference-count":38,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T00:00:00Z","timestamp":1624838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61772389, 61472303"],"award-info":[{"award-number":["61772389, 61472303"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Multi-focus-image-fusion is a crucial embranchment of image processing. Many methods have been developed from different perspectives to solve this problem. Among them, the sparse representation (SR)-based and convolutional neural network (CNN)-based fusion methods have been widely used. Fusing the source image patches, the SR-based model is essentially a local method with a nonlinear fusion rule. On the other hand, the direct mapping between the source images follows the decision map which is learned via CNN. The fusion is a global one with a linear fusion rule. Combining the advantages of the above two methods, a novel fusion method that applies CNN to assist SR is proposed for the purpose of gaining a fused image with more precise and abundant information. In the proposed method, source image patches were fused based on SR and the new weight obtained by CNN. Experimental results demonstrate that the proposed method clearly outperforms existing state-of-the-art methods in addition to SR and CNN in terms of both visual perception and objective evaluation metrics, and the computational complexity is greatly reduced. Experimental results demonstrate that the proposed method not only clearly outperforms the SR and CNN methods in terms of visual perception and objective evaluation indicators, but is also significantly better than other state-of-the-art methods since our computational complexity is greatly reduced.<\/jats:p>","DOI":"10.3390\/e23070827","type":"journal-article","created":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T22:43:06Z","timestamp":1624920186000},"page":"827","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["The Multi-Focus-Image-Fusion Method Based on Convolutional Neural Network and Sparse Representation"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6327-9211","authenticated-orcid":false,"given":"Bingzhe","family":"Wei","sequence":"first","affiliation":[{"name":"School of Mathematics and Statistics, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiangchu","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kun","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bian","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Mathematics and Statistics, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.inffus.2018.07.010","article-title":"A survey on region based image fusion methods","volume":"48","author":"Meher","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1007\/s11036-020-01681-6","article-title":"An image super-resolution reconstruction method with single frame character based on wavelet neural network in internet of things","volume":"26","author":"Guo","year":"2021","journal-title":"Mob. Netw. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1007\/s00779-019-01292-3","article-title":"Soft trees with neural components as image-processing technique for archeological excavations","volume":"24","author":"Polap","year":"2020","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.inffus.2020.06.013","article-title":"Multi-focus image fusion: A survey of the state of the art","volume":"64","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.inffus.2018.01.009","article-title":"Multi-focus image fusion using content adaptive blurring","volume":"45","author":"Farid","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.optlaseng.2020.106141","article-title":"Fractal dimension based parameter adaptive dual channel PCNN for multi-focus image fusion","volume":"133","author":"Panigrahy","year":"2020","journal-title":"Opt. Lasers Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.inffus.2014.10.004","article-title":"Multi-focus image fusion using dictionary-based sparse representation","volume":"25","author":"Nejati","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, K.P., Qi, G.Q., Zhu, Z.Q., and Chai, Y. (2017). A novel geometric dictionary construction approach for sparse representation based image fusion. Entropy, 19.","DOI":"10.3390\/e19070306"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TIM.2009.2026612","article-title":"Multifocus image fusion and restoration with sparse representation","volume":"59","author":"Yang","year":"2009","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Li, Y.Y., Sun, Y.J., Huang, X.H., Qi, G.Q., Zheng, M.Y., and Zhu, Z.Q. (2018). An image fusion method based on sparse representation and sum modified-Laplacian in NSCT domain. Entropy, 20.","DOI":"10.3390\/e20070522"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3450","DOI":"10.1109\/TBME.2012.2217493","article-title":"Group-sparse representation with dictionary learning for medical image denoising and fusion","volume":"59","author":"Li","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1049\/iet-ipr.2014.0311","article-title":"Simultaneous image fusion and denoising with adaptive sparse representation","volume":"9","author":"Liu","year":"2014","journal-title":"IET Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1109\/LSP.2016.2618776","article-title":"Image Fusion with Convolutional Sparse Representation","volume":"23","author":"Liu","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/j.inffus.2016.12.001","article-title":"Multi-focus image fusion with a deep convolutional neural network","volume":"36","author":"Liu","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3658","DOI":"10.1109\/TGRS.2014.2381272","article-title":"Hyperspectral and multispectral image fusion based on a sparse representation","volume":"53","author":"Wei","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5182","DOI":"10.1364\/OE.21.005182","article-title":"Regional multifocus image fusion using sparse representation","volume":"21","author":"Chen","year":"2013","journal-title":"Opt. Express"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.ins.2017.12.043","article-title":"Pixel convolutional neural network for multi-focus image fusion","volume":"433","author":"Tang","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.inffus.2018.11.012","article-title":"Multispectral and hyperspectral image fusion with spatial-spectral sparse representation","volume":"49","author":"Dian","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.neucom.2016.07.039","article-title":"A novel sparse-representation-based multi-focus image fusion approach","volume":"216","author":"Yin","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/TRPMS.2020.2991887","article-title":"Limited angle X ray CT reconstruction using image gradient l0 norm with dictionary learning","volume":"5","author":"Xu","year":"2020","journal-title":"IEEE Trans. Radiat. Plasma Med. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.sigpro.2013.09.025","article-title":"Image compressive sensing recovery using adaptively learned sparsifying basis via l0 minimization","volume":"103","author":"Zhang","year":"2014","journal-title":"Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4680","DOI":"10.1109\/TIT.2011.2146090","article-title":"Orthogonal matching pursuit for sparse signal recovery with noise","volume":"57","author":"Cai","year":"2011","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"6202","DOI":"10.1109\/TSP.2012.2218810","article-title":"Generalized orthogonal matching pursuit","volume":"60","author":"Wang","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Jeon, M.J., and Jeong, Y.S. (2020). Compact and Accurate Scene Text Detector. Appl. Sci., 10.","DOI":"10.3390\/app10062096"},{"key":"ref_25","first-page":"1","article-title":"Deep neural network correlation learning mechanism for CT brain tumor detection","volume":"6","author":"Silka","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Vu, T., Nguyen, C.V., Pham, T.X., Luu, T.M., and Yoo, C.D. (2018, January 8\u201314). Fast and Efficient Image Quality Enhancement via Desubpixel Convolutional Neural Networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-11021-5_16"},{"key":"ref_27","unstructured":"(2020, December 07). Lytro Multi-Focus Dataset. Available online: https:\/\/mansournejati.ece.iut.ac.ir\/content\/lytro-multi-focus-dataset."},{"key":"ref_28","unstructured":"(2020, December 07). Multi-Focus-Image-Fusion-Dataset. Available online: https:\/\/github.com\/sametaymaz\/Multi-focus-Image-Fusion-Dataset."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"066201","DOI":"10.1117\/1.3153331","article-title":"Objective evaluation of color image fusion methods","volume":"46","author":"Tsagaris","year":"2009","journal-title":"Opt. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.inffus.2005.05.001","article-title":"Subjective tests for image fusion evaluation and objective metric validation","volume":"8","year":"2007","journal-title":"Inf. Fusion"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1016\/j.ins.2017.09.010","article-title":"A novel multi-modality image fusion method based on image decomposition and sparse representation","volume":"432","author":"Zhu","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1421","DOI":"10.1016\/j.imavis.2007.12.002","article-title":"A new automated quality assessment algorithm for image fusion","volume":"27","author":"Chen","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1049\/el:20000267","article-title":"Objective image fusion performance measure","volume":"36","author":"Xydeas","year":"2004","journal-title":"Electron. Lett."},{"key":"ref_34","first-page":"1433","article-title":"Performance assessment of combinative pixel-level image fusion based on an absolute feature measurement","volume":"3","author":"Zhao","year":"2007","journal-title":"Int. J. Innov. Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.inffus.2006.09.001","article-title":"A novel similarity based quality metric for image fusion","volume":"9","author":"Yang","year":"2008","journal-title":"Inf. Fusion"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TPAMI.2011.109","article-title":"Objective assessment of multiresolution image fusion algorithms for context enhancement in night vision: A comparative study","volume":"34","author":"Liu","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.bspc.2017.02.005","article-title":"Medical image fusion based on sparse representation of classified image patches","volume":"34","author":"Zong","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A general framework for image fusion based on multi-scale transform and sparse representation","volume":"24","author":"Liu","year":"2017","journal-title":"Inf. Fusion"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/7\/827\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:26:17Z","timestamp":1760163977000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/7\/827"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,28]]},"references-count":38,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["e23070827"],"URL":"https:\/\/doi.org\/10.3390\/e23070827","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,28]]}}}