{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T15:13:49Z","timestamp":1781018029347,"version":"3.54.1"},"reference-count":49,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,8]],"date-time":"2022-01-08T00:00:00Z","timestamp":1641600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61801455"],"award-info":[{"award-number":["61801455"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>This study based on co-occurrence analysis shearlet transform (CAST) effectively combines the latent low rank representation (LatLRR) and the regularization of zero-crossing counting in differences to fuse the heterogeneous images. First, the source images are decomposed by CAST method into base-layer and detail-layer sub-images. Secondly, for the base-layer components with larger-scale intensity variation, the LatLRR, is a valid method to extract the salient information from image sources, and can be applied to generate saliency map to implement the weighted fusion of base-layer images adaptively. Meanwhile, the regularization term of zero crossings in differences, which is a classic method of optimization, is designed as the regularization term to construct the fusion of detail-layer images. By this method, the gradient information concealed in the source images can be extracted as much as possible, then the fusion image owns more abundant edge information. Compared with other state-of-the-art algorithms on publicly available datasets, the quantitative and qualitative analysis of experimental results demonstrate that the proposed method outperformed in enhancing the contrast and achieving close fusion result.<\/jats:p>","DOI":"10.3390\/rs14020283","type":"journal-article","created":{"date-parts":[[2022,1,9]],"date-time":"2022-01-09T23:08:26Z","timestamp":1641769706000},"page":"283","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Infrared and Visible Image Fusion Based on Co-Occurrence Analysis Shearlet Transform"],"prefix":"10.3390","volume":"14","author":[{"given":"Biao","family":"Qi","sequence":"first","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Longxu","family":"Jin","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoning","family":"Li","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiang","family":"Li","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoling","family":"Bi","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenhua","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Instrument Science and Electrical Engineering, Jilin University, Changchun 130012, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Palsson, F., Sveinsson, J., and Ulfarsson, M. (2018). Sentinel-2 Image Fusion Using a Deep Residual Network. Remote Sens., 18.","DOI":"10.3390\/rs10081290"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Liu, Y., Dong, L., Chen, Y., and Xu, W. (2020). An Efficient Method for Infrared and Visual Images Fusion Based on Visual Attention Technique. Remote Sens., 12.","DOI":"10.3390\/rs12050781"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.sigpro.2020.107936","article-title":"A Saliency-based Multiscale Approach for Infrared and Visible Image Fusion","volume":"182","author":"Chen","year":"2021","journal-title":"Signal Process."},{"key":"ref_4","first-page":"516","article-title":"Construction of Fused Image with Improved Depth-of-field Based on Guided Co-occurrence Filtering","volume":"104","author":"Harbinder","year":"2020","journal-title":"Digit. Signal Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"4733","DOI":"10.1109\/TIP.2020.2975984","article-title":"MDLatLRR: A Novel Decomposition Method for Infrared and Visible Image Fusion","volume":"29","author":"Li","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.imavis.2020.104037","article-title":"Infrared and Visible Image Fusion via Global Variable Consensus","volume":"104","author":"Shen","year":"2020","journal-title":"Image Vis. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bavirisetti, D., Xiao, G., and Liu, G. (2017, January 10\u201313). Multi-sensor Image Fusion Based on Fourth Order Partial Differential Equations. Proceedings of the 2017 20th International Conference on Information Fusion (Fusion), Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009719"},{"key":"ref_8","first-page":"866","article-title":"Multisensor Image Fusion and Enhancement in Spectral Total Variation Domain","volume":"20","author":"Zhao","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1016\/j.bspc.2020.102280","article-title":"Multi-modal Brain Image Fusion Based on Multi-level Edge-preserving Filtering","volume":"64","author":"Tan","year":"2021","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/TCOM.1983.1095851","article-title":"The Laplacian Pyramid as a Compact Image Code","volume":"31","author":"Peter","year":"1983","journal-title":"IEEE Trans. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, J., Ding, J., Ge, X., and Wang, J. (2021). Evaluation of Total Nitrogen in Water via Airborne Hyperspectral Data: Potential of Fractional Order Discretization Algorithm and Discrete Wavelet Transform Analysis. Remote Sens., 13.","DOI":"10.3390\/rs13224643"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"163497","DOI":"10.1016\/j.ijleo.2019.163497","article-title":"Infrared and Visible Image Fusion via Hybrid Decomposition of NSCT and Morphological Sequential Toggle Operator","volume":"201","author":"Wang","year":"2020","journal-title":"Optik"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.infrared.2018.04.004","article-title":"A Novel Fusion Framework of Visible Light and Infrared Images Based on Singular Value Decomposition and Adaptive DUALPCNN in NSST Domain","volume":"91","author":"Cheng","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.sigpro.2018.10.005","article-title":"MRI Reconstruction with an Edge-preserving Filtering Prior","volume":"155","author":"Zhuang","year":"2019","journal-title":"Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.sigpro.2019.07.026","article-title":"Side Window Guided Filtering","volume":"165","author":"Yin","year":"2019","journal-title":"Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1786","DOI":"10.1109\/TIP.2017.2658954","article-title":"Curvature Filters Efficiently Reduce Certain Variational Energies","volume":"26","author":"Gong","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","unstructured":"Tomasi, C., and Manduchi, R. (1998, January 7). Bilateral Filtering for Gray and Color Images. Proceedings of the Sixth International Conference on Computer Vision (IEEE Cat. No. 98CH36271), Bombay, India."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TPAMI.2012.213","article-title":"Guided Image Filtering","volume":"35","author":"He","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Yuan, W., Yuan, X., Xu, S., Gong, J., and Shibasaki, R. (2019). Dense Image-Matching via Optical Flow Field Estimation and Fast-Guided Filter Refinement. Remote Sens., 11.","DOI":"10.3390\/rs11202410"},{"key":"ref_20","first-page":"156043","article-title":"Medical Image Fusion Based on Rolling Guidance Filter and Spiking Cortical Mode","volume":"2015","author":"Liu","year":"2015","journal-title":"Comput. Math. Methods Med."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jevnisek, R., and Shai, A. (2017, January 21\u201326). Co-occurrence Filter. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.406"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, G., and Yan, S. (2011, January 6\u201313). Latent Low-rank Representation for Subspace Segmentation and Feature Extraction. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126422"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nie, T., Huang, L., Liu, H., Li, X., Zhao, Y., Yuan, H., Song, X., and He, B. (2021). Multi-Exposure Fusion of Gray Images Under Low Illumination Based on Low-Rank Decomposition. Remote Sens., 13.","DOI":"10.3390\/rs13020204"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.infrared.2018.05.006","article-title":"General Fusion Method for Infrared and Visual Images via Latent Low-rank Representation and Local Non-subsampled Shearlet Transform","volume":"92","author":"Cheng","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.cag.2017.07.034","article-title":"How Many Zero Crossings? A Method for Structure-texture Image Decomposition","volume":"68","author":"Jiang","year":"2017","journal-title":"Comput. Graph."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.infrared.2018.11.023","article-title":"Infrared and Low-light-level Image Fusion Based on l2-energy Minimization and Mixed-L1-gradient Regularization","volume":"96","author":"Cheng","year":"2019","journal-title":"Infrared Phys. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.infrared.2018.08.004","article-title":"Infrared and Visible Image Fusion Using Co-occurrence Filter","volume":"93","author":"Zhang","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hu, Y., He, J., and Xu, L. (2021, January 20\u201322). Infrared and Visible Image Fusion Based on Multiscale Decomposition with Gaussian and Co-Occurrence Filters. Proceedings of the 4th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), Yibin, China.","DOI":"10.1109\/PRAI53619.2021.9551089"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.infrared.2019.02.013","article-title":"Multi-band Images Synchronous Fusion Based on NSST and Fuzzy Logical Inference","volume":"98","author":"Wang","year":"2019","journal-title":"Infrared Phys. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","article-title":"Infrared and Visible Image Fusion Based on Visual Saliency Map and Weighted Least Square Optimization","volume":"82","author":"Ma","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1364\/JOSA.69.000914","article-title":"Bandpass Channels, Zero-crossings, and Early Visual Information Processing","volume":"69","author":"Marr","year":"1979","journal-title":"J. Opt. Soc. Am."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bauschke, H., Burachik, R., Combettes, P., Elser, V., Luke, D., and Wolkowicz, H. (2011). Proximal splitting methods in signal processing. Fixed-Point Algorithms for Inverse Problems in Science and Engineering, Springer.","DOI":"10.1007\/978-1-4419-9569-8"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1109\/5.52199","article-title":"Reconstruction of Two-dimensional Signals from Level Crossings","volume":"78","author":"Zakhor","year":"1990","journal-title":"Proc. IEEE"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1109\/TVCG.2015.2396064","article-title":"Fast Edge-aware Processing via First Order Proximal Approximation","volume":"21","author":"Badri","year":"2015","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000016","article-title":"Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers","volume":"3","author":"Boyd","year":"2011","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3654","DOI":"10.1109\/TSP.2014.2329263","article-title":"Jump-sparse and Sparse Recovery Using Potts Functionals","volume":"62","author":"Storath","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1826","DOI":"10.1137\/130950367","article-title":"Fast Partitioning of Vector-valued Images","volume":"7","author":"Storath","year":"2014","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1109\/TIP.2017.2651392","article-title":"l0 Gradient Projection","volume":"26","author":"Ono","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.infrared.2021.103662","article-title":"Infrared and Visible Image Fusion Based on Weighted Variance Guided Filter and Image Contrast Enhancement","volume":"114","author":"Ren","year":"2021","journal-title":"Infrared Phys. Technol."},{"key":"ref_40","unstructured":"Toet, A. (2021, November 30). TNO Image Fusion Dataset. Available online: https:\/\/figshare.com\/articles\/TN_Image_Fusion_Dataset\/1008029."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Cai, W., Li, M., and Li, X. (2009, January 20\u201323). Infrared and Visible Image Fusion Scheme Based on Contourlet Transform. Proceedings of the Fifth International Conference on Image and Graphics (ICIG), Xi\u2019an, China.","DOI":"10.1109\/ICIG.2009.158"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.inffus.2005.09.006","article-title":"Pixel-and Region-based Image Fusion with Complex Wavelets","volume":"8","author":"John","year":"2007","journal-title":"Inf. Fusion"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/j.inffus.2014.09.004","article-title":"A General Framework for Image Fusion Based on Multi-scale Transform and Sparse Representation","volume":"24","author":"Liu","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.inffus.2016.02.001","article-title":"Infrared and Visible Image Fusion via Gradient Transfer and Total Variation Minimization","volume":"31","author":"Ma","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"479","DOI":"10.14429\/dsj.61.705","article-title":"Image Fusion Technique Using Multi-resolution Singular Value Decomposition","volume":"61","author":"Naidu","year":"2011","journal-title":"Def. Sci. J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.infrared.2015.01.022","article-title":"Fusion of visible and infrared images using multi objective evolutionary algorithm based on decomposition","volume":"71","author":"Jin","year":"2015","journal-title":"Infrared Phys. Technol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.inffus.2021.02.023","article-title":"RFN-Nest: An End-to-end Residual Fusion Network for Infrared and Visible Images","volume":"73","author":"Li","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2959","DOI":"10.1109\/26.477498","article-title":"Image quality measures and their performance","volume":"43","author":"Eskicioglu","year":"1995","journal-title":"IEEE Trans. Commun."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1049\/el:20020212","article-title":"Information measure for performance of image fusion","volume":"38","author":"Qu","year":"2002","journal-title":"Electron. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/2\/283\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:27:02Z","timestamp":1760362022000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/2\/283"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,8]]},"references-count":49,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["rs14020283"],"URL":"https:\/\/doi.org\/10.3390\/rs14020283","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,8]]}}}