{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T20:50:54Z","timestamp":1780087854988,"version":"3.54.0"},"reference-count":31,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2017,5,15]],"date-time":"2017-05-15T00:00:00Z","timestamp":1494806400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes an infrared (IR) and visible image fusion method introducing region segmentation into the dual-tree complex wavelet transform (DTCWT) region. This method should effectively improve both the target indication and scene spectrum features of fusion images, and the target identification and tracking reliability of fusion system, on an airborne photoelectric platform. The method involves segmenting the region in an IR image by significance, and identifying the target region and the background region; then, fusing the low-frequency components in the DTCWT region according to the region segmentation result. For high-frequency components, the region weights need to be assigned by the information richness of region details to conduct fusion based on both weights and adaptive phases, and then introducing a shrinkage function to suppress noise; Finally, the fused low-frequency and high-frequency components are reconstructed to obtain the fusion image. The experimental results show that the proposed method can fully extract complementary information from the source images to obtain a fusion image with good target indication and rich information on scene details. They also give a fusion result superior to existing popular fusion methods, based on eithers subjective or objective evaluation. With good stability and high fusion accuracy, this method can meet the fusion requirements of IR-visible image fusion systems.<\/jats:p>","DOI":"10.3390\/s17051127","type":"journal-article","created":{"date-parts":[[2017,5,15]],"date-time":"2017-05-15T12:16:12Z","timestamp":1494850572000},"page":"1127","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Airborne Infrared and Visible Image Fusion Combined with Region Segmentation"],"prefix":"10.3390","volume":"17","author":[{"given":"Yujia","family":"Zuo","sequence":"first","affiliation":[{"name":"Changchun Institute of Optics Fine Mechanics and Physics, Chinese Academy of Science, #3888 Dongnanhu Road, Changchun 130033, China"},{"name":"University of Chinese Academy of Sciences, #19 Yuquan Road, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinghong","family":"Liu","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics Fine Mechanics and Physics, Chinese Academy of Science, #3888 Dongnanhu Road, Changchun 130033, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanbing","family":"Bai","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics Fine Mechanics and Physics, Chinese Academy of Science, #3888 Dongnanhu Road, Changchun 130033, China"},{"name":"University of Chinese Academy of Sciences, #19 Yuquan Road, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuan","family":"Wang","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics Fine Mechanics and Physics, Chinese Academy of Science, #3888 Dongnanhu Road, Changchun 130033, China"},{"name":"University of Chinese Academy of Sciences, #19 Yuquan Road, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mingchao","family":"Sun","sequence":"additional","affiliation":[{"name":"Changchun Institute of Optics Fine Mechanics and Physics, Chinese Academy of Science, #3888 Dongnanhu Road, Changchun 130033, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,5,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"10326","DOI":"10.3390\/s120810326","article-title":"Multi-sensor fusion of infrared and electro-optic signals for high resolution night images","volume":"12","author":"Huang","year":"2012","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ma, Y., Wu, X., Yu, G., Xu, Y., and Wang, Y. (2016). Pedestrian detection and tracking from low-resolution unmanned aerial vehicle thermal imagery. Sensors, 16.","DOI":"10.3390\/s16040446"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"080599","DOI":"10.1117\/1.JRS.8.080599","article-title":"Wavelet-domain satellite image fusion based on a generalized fusion equation","volume":"8","author":"Jin","year":"2014","journal-title":"J. Appl. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.inffus.2013.08.001","article-title":"Semi-hidden target recognition in gated viewer images fused with thermal IR images","volume":"18","author":"Smeelen","year":"2014","journal-title":"Inf. Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Zitova","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"053017","DOI":"10.1117\/1.JEI.24.5.053017","article-title":"Visible and infrared image registration based on visual salient features","volume":"24","author":"Wu","year":"2015","journal-title":"J. Electron. Imaging"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"045007","DOI":"10.1117\/1.JRS.10.045007","article-title":"Image matching using structural similarity and geometric constraint approaches on remote sensing images","volume":"10","author":"Guo","year":"2016","journal-title":"J. Appl. Remote Sens."},{"key":"ref_8","unstructured":"Chen, Y. (2016). Multimodal Image Fusion and Its Applications. [Ph.D. Thesis, The University of Michigan]."},{"key":"ref_9","unstructured":"Zhen, J. (2014). Image Registration and Image Completion: Similarity and Estimation Error Optimization. [Ph.D. Thesis, University of Cincinnati]."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.infrared.2016.07.016","article-title":"Infrared and multi-type images fusion algorithm based on contrast pyramid transform","volume":"17","author":"Xu","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_11","first-page":"122","article-title":"Image enhancement using fusion by wavelet transform and laplacian pyramid","volume":"10","author":"Mukane","year":"2013","journal-title":"Int. J. Comput. Sci. Issues"},{"key":"ref_12","first-page":"2850","article-title":"Infrared image and visible image fusion based on wavelet transform","volume":"756\u2013759","author":"Zehua","year":"2014","journal-title":"Adv. Mater. Res."},{"key":"ref_13","unstructured":"Kingsbury, N.Q. (1998, January 9\u201312). The Dual-tree Complex Wavelet Transform: A New Technique for Shift Invariance and Directional Filters. Proceedings of the 8th IEEE Digital Signal Processing Workshop, Bryce Canyon, UT, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1109\/MSP.2005.1550194","article-title":"The dual-tree complex wavelet transform","volume":"22","author":"Selesnick","year":"2005","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2091","DOI":"10.1109\/TIP.2005.859376","article-title":"The contourlet transform: An efficient directional multiresolution image representation","volume":"14","author":"Do","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.neucom.2008.02.025","article-title":"Multimodality medical image fusion based on multiscale geometric analysis of contourlet transform","volume":"72","author":"Yang","year":"2008","journal-title":"Neurocomputing"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1109\/TIP.2002.1014998","article-title":"The curvelet transform for image denoising","volume":"11","author":"Starck","year":"2002","journal-title":"IEEE Trans. Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1016\/j.compeleceng.2012.04.003","article-title":"Medical image denoising using adaptive fusion of curvelet transform and total variation","volume":"39","author":"Bhadauria","year":"2013","journal-title":"Comput. Electr. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3089","DOI":"10.1109\/TIP.2006.877507","article-title":"The nonsubsampled contourlet transform: Theory, design, and applications","volume":"15","author":"Cunha","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.infrared.2015.01.002","article-title":"A fusion algorithm for infrared and visible images based on adaptive dual-channel unit-linking PCNN in NSCT domain","volume":"69","author":"Xiang","year":"2015","journal-title":"Infrared Phys. Technol."},{"key":"ref_21","first-page":"2824","article-title":"Multifocus Image Fusion Based on NSCT and Focused Area Detection","volume":"15","author":"Yang","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.infrared.2015.11.002","article-title":"An improved fusion algorithm for infrared and visible images based on multi-scale transform","volume":"74","author":"Li","year":"2016","journal-title":"Infrared Phys. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"123104","DOI":"10.1117\/1.OE.55.12.123104","article-title":"Research on fusion technology based on low-light visible image and infrared image","volume":"55","author":"Shuo","year":"2016","journal-title":"Opt. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2864","DOI":"10.1109\/TIP.2013.2244222","article-title":"Image fusion with guided filtering","volume":"22","author":"Li","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/S0743-7315(03)00039-X","article-title":"The load unbalancing problem for region growing image segmentation algorithm","volume":"63","author":"Montoya","year":"2003","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s10044-011-0198-x","article-title":"Preserving objects in markov random fields region growing image segmentation","volume":"15","author":"Dawoud","year":"2012","journal-title":"Pattern Anal. Appl."},{"key":"ref_27","first-page":"5319","article-title":"Colour based image segmentation using K-means clustering","volume":"2","author":"Chitade","year":"2010","journal-title":"Int. J. Eng. Sci. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2661","DOI":"10.1109\/TCE.2010.5681154","article-title":"Adaptive fuzzy-K-means clustering algorithm for image segmentation","volume":"56","author":"Sulaiman","year":"2010","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chen, M.-M., Zhang, G., Mitra, N.J., Huang, X., and Hu, S.-M. (2011, January 20\u201325). Global Contrast based salient region detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995344"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/1015706.1015720","article-title":"\u201cGrabcut\u201d\u2014Interactive foreground extraction using iterated graph cuts","volume":"23","author":"Carten","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.cviu.2009.09.002","article-title":"Non-Gaussian model based fusion of noisy images in the wavelet domain","volume":"114","author":"Loza","year":"2010","journal-title":"Comput. Vis. Image Underst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/5\/1127\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:35:53Z","timestamp":1760207753000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/5\/1127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,15]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2017,5]]}},"alternative-id":["s17051127"],"URL":"https:\/\/doi.org\/10.3390\/s17051127","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,5,15]]}}}