{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T15:06:47Z","timestamp":1767971207508,"version":"3.49.0"},"reference-count":45,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2021,11,24]],"date-time":"2021-11-24T00:00:00Z","timestamp":1637712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The Natural Science Foundation of China","award":["NO: 61805021"],"award-info":[{"award-number":["NO: 61805021"]}]},{"name":"The funds of Science Technology Department of Jilin Province","award":["NO: 20200401146GX"],"award-info":[{"award-number":["NO: 20200401146GX"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To get more obvious target information and more texture features, a new fusion method for the infrared (IR) and visible (VIS) images combining regional energy (RE) and intuitionistic fuzzy sets (IFS) is proposed, and this method can be described by several steps as follows. Firstly, the IR and VIS images are decomposed into low- and high-frequency sub-bands by non-subsampled shearlet transform (NSST). Secondly, RE-based fusion rule is used to obtain the low-frequency pre-fusion image, which allows the important target information preserved in the resulting image. Based on the pre-fusion image, the IFS-based fusion rule is introduced to achieve the final low-frequency image, which enables more important texture information transferred to the resulting image. Thirdly, the \u2018max-absolute\u2019 fusion rule is adopted to fuse high-frequency sub-bands. Finally, the fused image is reconstructed by inverse NSST. The TNO and RoadScene datasets are used to evaluate the proposed method. The simulation results demonstrate that the fused images of the proposed method have more obvious targets, higher contrast, more plentiful detailed information, and local features. Qualitative and quantitative analysis results show that the presented method is superior to the other nine advanced fusion methods.<\/jats:p>","DOI":"10.3390\/s21237813","type":"journal-article","created":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T01:45:02Z","timestamp":1638323102000},"page":"7813","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Combining Regional Energy and Intuitionistic Fuzzy Sets for Infrared and Visible Image Fusion"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5448-0036","authenticated-orcid":false,"given":"Xiaoxue","family":"Xing","sequence":"first","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cong","family":"Luo","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8440-1079","authenticated-orcid":false,"given":"Jian","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Minghan","family":"Yan","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Electronic Information Engineering, Changchun University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tingfa","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.cviu.2019.04.003","article-title":"Discriminant Deep Feature Learning based on joint supervision Loss and Multi-layer Feature Fusion for heterogeneous face recognition","volume":"184","author":"Hu","year":"2019","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2971","DOI":"10.1109\/JSTARS.2021.3061496","article-title":"Fusion of Infrared and Visible Images for Remote Detection of Low-Altitude Slow-Speed Small Targets","volume":"14","author":"Sun","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Huang, H., Dong, L., Xue, Z., Liu, X., and Hua, C. (2021). Fusion algorithm of visible and infrared image based on anisotropic diffusion and image enhancement. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0245563"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"102480","DOI":"10.1016\/j.bspc.2021.102480","article-title":"An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multimodal medical image fusion","volume":"66","author":"Jose","year":"2021","journal-title":"Biomed. Signal Proces. Control"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"7066","DOI":"10.1109\/JSTARS.2021.3090958","article-title":"Semisupervised Remote Sensing Image Fusion Using Multiscale Conditional Generative Adversarial Network with Siamese Structure","volume":"14","author":"Jin","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Qi, G., Chang, L., Luo, Y., Chen, Y., Zhu, Z., and Wang, S. (2020). A Precise Multi-Exposure Image Fusion Method Based on Low-level Features. Sensors, 20.","DOI":"10.3390\/s20061597"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, Y., Dong, L., Ji, Y., and Xu, W. (2019). Infrared and Visible Image Fusion through Details Preservation. Sensors, 19.","DOI":"10.3390\/s19204556"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1049\/el.2020.0557","article-title":"Infrared and visible image fusion based on non-subsampled shearlet transform, regional energy, and co-occurrence filtering","volume":"56","author":"Zhang","year":"2020","journal-title":"Electron. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1049\/iet-cvi.2015.0251","article-title":"Local energy-based multimodal medical image fusion in curvelet domain","volume":"10","author":"Srivastava","year":"2016","journal-title":"IET Comput. Vis."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1016\/j.aeue.2013.12.003","article-title":"Image fusion based on shearlet transform and regional features","volume":"68","author":"Liu","year":"2014","journal-title":"AEU-Int. J. Electron. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Versaci, M., Calcagno, S., and Morabito, F.C. (2015, January 19\u201321). Fuzzy Geometrical Approach Based on Unit Hyper-Cubes for Image Contrast Enhancement. Proceedings of the 2015 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICSIPA.2015.7412240"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1631\/FITEE.1900737","article-title":"Multi-focus image fusion based on fractional-order derivative and intuitionistic fuzzy sets","volume":"21","author":"Zhang","year":"2020","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"173","DOI":"10.4218\/etrij.17.0116.0568","article-title":"Multimodal medical image fusion based on Sugeno\u2019s intuitionistic fuzzy sets","volume":"39","author":"Tirupal","year":"2017","journal-title":"ETRI J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4938","DOI":"10.1109\/TIP.2013.2279953","article-title":"Probabilistic Fuzzy Image Fusion Approach for Radar Through Wall Sensing","volume":"22","author":"Seng","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and visible image fusion methods and applications: A survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inform. Fusion"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2850","DOI":"10.4028\/www.scientific.net\/AMR.756-759.2850","article-title":"Infrared Image and Visible Image Fusion Based on Wavelet Transform","volume":"756\u2013759","author":"Zhou","year":"2013","journal-title":"Adv. Mater. Res."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kou, L., Zhang, L., Zhang, K., Sun, J., Han, Q., and Jin, Z. (2018). A multi-focus image fusion method via region mosaicking on Laplacian pyramids. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0191085"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"18846","DOI":"10.1364\/OE.20.018846","article-title":"Multifocus color image fusion based on quaternion curvelet transform","volume":"20","author":"Guo","year":"2012","journal-title":"Opt. Express"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4643","DOI":"10.1007\/s11277-017-4111-9","article-title":"Optimal Target-Oriented Fusion of Passive Millimeter Wave Images with Visible Images Based on Contourlet Transform","volume":"95","author":"Mosavi","year":"2017","journal-title":"Wireless Pers. Commun."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.infrared.2013.07.010","article-title":"Image fusion based on nonsubsampled contourlet transform for infrared and visible light image","volume":"61","author":"Adu","year":"2013","journal-title":"Infrared Phys. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"085706","DOI":"10.1088\/2040-8978\/18\/8\/085706","article-title":"Adaptive enhancement for infrared image using shearlet frame","volume":"18","author":"Fan","year":"2016","journal-title":"J. Opt."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1049\/iet-ipr.2012.0558","article-title":"Multi-focus image fusion based on non-subsampled shearlet transform","volume":"7","author":"Guorong","year":"2013","journal-title":"IET Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102975","DOI":"10.1016\/j.infrared.2019.102975","article-title":"Efficient multi-scale non-sub-sampled shearlet fusion system based on modified central force optimization and contrast enhancement","volume":"102","author":"Faragallah","year":"2019","journal-title":"Infrared Phys. Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.infrared.2015.02.008","article-title":"Technique for infrared and visible image fusion based on non-subsampled shearlet transform and spiking cortical model","volume":"71","author":"Kong","year":"2015","journal-title":"Infrared Phys. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1137\/060649781","article-title":"Optimally Sparse Multidimensional Representation Using Shearlets","volume":"39","author":"Guo","year":"2007","journal-title":"SIAM J. Math. Anal."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.acha.2007.09.003","article-title":"Sparse directional image representations using the discrete shearlet transform","volume":"25","author":"Easley","year":"2008","journal-title":"Appl. Comput. Harmon. Anal."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/S0165-0114(02)00127-6","article-title":"On the relationship between some extensions of fuzzy set theory","volume":"133","author":"Deschrijver","year":"2003","journal-title":"Fuzzy Sets Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"17149","DOI":"10.3390\/s150717149","article-title":"Infrared and Visual Image Fusion through Fuzzy Measure and Alternating Operators","volume":"15","author":"Bai","year":"2015","journal-title":"Sensors"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1016\/j.asoc.2011.11.020","article-title":"Infrared and visible image fusion using fuzzy logic and population-based optimization","volume":"12","author":"Saeedi","year":"2012","journal-title":"Appl. Soft Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1109\/TSMC.1981.4308726","article-title":"Image enhancement using smoothing with fuzzy sets","volume":"11","author":"Pal","year":"1981","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4210","DOI":"10.1049\/iet-ipr.2020.0781","article-title":"Infrared and visible image fusion using multi-scale NSCT and rolling-guidance filter","volume":"14","author":"Selvaraj","year":"2020","journal-title":"IET Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"110214","DOI":"10.1109\/ACCESS.2020.3001974","article-title":"Infrared and Visible Image Fusion Based on a Latent Low-Rank Representation Nested with Multiscale Geometric Transform","volume":"8","author":"Yu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"610002","DOI":"10.3788\/gzxb20184706.0610002","article-title":"Fusion of infrared and visible images based on non-subsampled contourlet transform and intuitionistic fuzzy set","volume":"47","author":"Cai","year":"2018","journal-title":"Acta Photon. Sin."},{"key":"ref_34","first-page":"738","article-title":"Research on fusion method of visible and infrared image based on PCNN and IFS","volume":"31","author":"Dai","year":"2020","journal-title":"J. Optoelectron. Laser"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bavirisetti, D.P., Xiao, G., and Liu, G. (2017, January 10\u201313). In Multi-Sensor Image Fusion Based on Fourth Order Partial Differential Equations. Proceedings of the 2017 20th International Conference on Information Fusion (Fusion), Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009719"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.infrared.2017.02.005","article-title":"Infrared and visible image fusion based on visual saliency map and weighted least square optimization","volume":"82","author":"Ma","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_37","first-page":"881","article-title":"Comparative Study of Intuitionistic Fuzzy Sets in Multi-band Image Fusion","volume":"40","author":"Jingchao","year":"2018","journal-title":"Infrared Technol."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Du, Q., Xu, H., Ma, Y., Huang, J., and Fan, F. (2018). Fusing infrared and visible images of different resolutions via total variation model. Sensors, 18.","DOI":"10.3390\/s18113827"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Li, H., and Wu, X.J. (2018). Infrared and visible image fusion using latent low-rank representation. arXiv.","DOI":"10.1109\/ICPR.2018.8546006"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/j.patrec.2020.01.020","article-title":"Image fusion via sparse regularization with non-convex penalties","volume":"131","author":"Anantrasirichai","year":"2020","journal-title":"Pattern Recogn. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4733","DOI":"10.1109\/TIP.2020.2975984","article-title":"MDLatLRR: A novel decomposition method for infrared and visible image fusion","volume":"29","author":"Li","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.inffus.2021.02.023","article-title":"RFN-Nest: An end-to-end residual fusion network for infrared and visible images","volume":"73","author":"Li","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1186\/s13638-020-01774-6","article-title":"Infrared and visible image fusion based on nonlinear enhancement and NSST decomposition","volume":"2020","author":"Xing","year":"2020","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"key":"ref_44","first-page":"1021","article-title":"Review of image fusion quality evaluation methods","volume":"12","author":"Yang","year":"2018","journal-title":"J. Front. Comput. Sci. Technol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1016\/j.ijleo.2010.06.008","article-title":"Performance analysis of multi-spectral and panchromatic image fusion techniques based on two wavelet discrete approaches","volume":"122","author":"Guo","year":"2011","journal-title":"Optik"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/7813\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:35:09Z","timestamp":1760168109000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/23\/7813"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,24]]},"references-count":45,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21237813"],"URL":"https:\/\/doi.org\/10.3390\/s21237813","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,24]]}}}