{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T01:17:36Z","timestamp":1768526256845,"version":"3.49.0"},"reference-count":37,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2018,4,23]],"date-time":"2018-04-23T00:00:00Z","timestamp":1524441600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Infrared and visible image registration is a very challenging task due to the large geometric changes and the significant contrast differences caused by the inconsistent capture conditions. To address this problem, this paper proposes a novel affine and contrast invariant descriptor called maximally stable phase congruency (MSPC), which integrates the affine invariant region extraction with the structural features of images organically. First, to achieve the contrast invariance and ensure the significance of features, we detect feature points using moment ranking analysis and extract structural features via merging phase congruency images in multiple orientations. Then, coarse neighborhoods centered on the feature points are obtained based on Log-Gabor filter responses over scales and orientations. Subsequently, the affine invariant regions of feature points are determined by using maximally stable extremal regions. Finally, structural descriptors are constructed from those regions and the registration can be implemented according to the correspondence of the descriptors. The proposed method has been tested on various infrared and visible pairs acquired by different platforms. Experimental results demonstrate that our method outperforms several state-of-the-art methods in terms of robustness and precision with different image data and also show its effectiveness in the application of trajectory tracking.<\/jats:p>","DOI":"10.3390\/rs10040658","type":"journal-article","created":{"date-parts":[[2018,4,24]],"date-time":"2018-04-24T04:44:48Z","timestamp":1524545088000},"page":"658","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["A Novel Affine and Contrast Invariant Descriptor for Infrared and Visible Image Registration"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2751-6096","authenticated-orcid":false,"given":"Xiangzeng","family":"Liu","sequence":"first","affiliation":[{"name":"Xi\u2019an Microelectronics Technology Institute, Xi\u2019an 710068, China"}]},{"given":"Yunfeng","family":"Ai","sequence":"additional","affiliation":[{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Juli","family":"Zhang","sequence":"additional","affiliation":[{"name":"Xi\u2019an Microelectronics Technology Institute, Xi\u2019an 710068, China"}]},{"given":"Zhuping","family":"Wang","sequence":"additional","affiliation":[{"name":"Xi\u2019an Microelectronics Technology Institute, Xi\u2019an 710068, China"}]}],"member":"1968","published-online":{"date-parts":[[2018,4,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Zitova","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1993","DOI":"10.1109\/TITS.2016.2634580","article-title":"Video processing from Electro-Optical sensors for object detection and tracking in a maritime environment: A Survey","volume":"18","author":"Prasad","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, H., Ding, W., Cao, X., and Liu, C. (2017). Image registration and fusion of visible and infrared integrated camera for medium-altitude unmanned aerial vehicle. Remote Sens., 9.","DOI":"10.3390\/rs9050441"},{"key":"ref_4","first-page":"153","article-title":"Registration of infrared and visible images based on edge extraction and phase correlation approaches","volume":"Volume 184","author":"Klimaszewski","year":"2013","journal-title":"Image Processing and Communications and Challenges 4. Advances in Intelligent Systems and Computing"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3823","DOI":"10.1016\/j.ijleo.2015.08.175","article-title":"Weighted-Hausdorff distance using gradient orientation information for visible and infrared image registration","volume":"126","author":"Feng","year":"2015","journal-title":"Optik"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1007\/s11119-016-9437-x","article-title":"Registration of visible and near infrared unmanned aerial vehicle images based on Fourier-Mellin transform","volume":"17","author":"Rabatel","year":"2016","journal-title":"Precision Agric."},{"key":"ref_7","unstructured":"Sun, M., Zhang, B., Liu, J., Wang, Y., and Yang, Q. (2010, January 17\u201319). The registration of aerial infrared and visible Images. Proceedings of the International Conference on Educational Information Technology, Chongqing, China."},{"key":"ref_8","first-page":"125","article-title":"Problems of infrared and Visible-Light images automatic registration","volume":"Volume 233","year":"2014","journal-title":"Image Processing and Communications Challenges 5. Advances in Intelligent Systems and Computing"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1109\/LGRS.2011.2176102","article-title":"A coarse-to-fine matching algorithm for FLIR and optical satellite image registration","volume":"9","author":"Wang","year":"2012","journal-title":"IEEE Trans. Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2941","DOI":"10.1109\/TGRS.2017.2656380","article-title":"Robust registration of multimodal remote sensing images based on structural similarity","volume":"55","author":"Ye","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3701","DOI":"10.1080\/0143116031000117047","article-title":"Mutual information-based image registration for remote sensing data","volume":"24","author":"Chen","year":"2003","journal-title":"Int. J. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7599","DOI":"10.3390\/s130607599","article-title":"Two phase non-rigid multi-modal image registration using weber local descriptor-based similarity metrics and normalized mutual information","volume":"13","author":"Yang","year":"2013","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2526","DOI":"10.1109\/TIP.2007.904956","article-title":"Efficient least squares multimodal registration with a globally exhaustive alignment search","volume":"16","author":"Orchard","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13319-017-0130-2","article-title":"Registration of visible and infrared images based on gradient information","volume":"8","author":"Geng","year":"2017","journal-title":"3D Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1016\/j.optlaseng.2012.12.016","article-title":"Image thresholding based on template matching with arctangent Hausdorff distance measure","volume":"51","author":"Zou","year":"2013","journal-title":"Opt. Lasers Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhu, X., Hao, Y.G., and Wang, H.Y. (2017, January 24\u201326). Research on infrared and visible images registration algorithm based on graph. Proceedings of the International Conference on Information Science and Technology, Wuhan, China.","DOI":"10.1051\/itmconf\/20171102002"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yi, X., Wang, B., Fang, Y., and Liu, S. (2013, January 16\u201318). Registration of infrared and visible images based on the correlation of the edges. Proceedings of the International Congress on Image and Signal Processing, Hangzhou, China.","DOI":"10.1109\/CISP.2013.6745309"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1007\/978-3-642-32436-9_10","article-title":"Visible and infrared image registration employing line-based geometric Analysis","volume":"Volume 7252","author":"Han","year":"2011","journal-title":"Computational Intelligence for Multimedia Understanding"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TCYB.2016.2548484","article-title":"Multimodal image registration with line segments by selective search","volume":"47","author":"Li","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1016\/j.patcog.2008.08.035","article-title":"MSLD: A robust descriptor for line matching","volume":"42","author":"Wang","year":"2009","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.neucom.2015.11.025","article-title":"Multimodal image matching based on multimodality robust line segment descriptor","volume":"177","author":"Zhao","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lyu, C., and Jie Jian, J. (2017). Remote sensing image registration with line segments and their intersections. Remote Sens., 9.","DOI":"10.3390\/rs9050439"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, Y., Dai, J., Mao, X., Liu, Y., and Jiang, X. (2017, January 29\u201331). Image registration between visible and infrared images for electrical equipment inspection robots based on quadrilateral features. Proceedings of the International Conference on Robotics and Automation Engineering, Shanghai, China.","DOI":"10.1109\/ICRAE.2017.8291366"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Understand."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hossain, M., Teng, S.W., and Lu, G. (2012, January 3\u20135). Achieving high multi-modal registration performance using simplified Hough-transform with improved symmetric-SIFT. Proceedings of the International Conference on Digital Image Computing Techniques and Applications, Fremantle, WA, Australia.","DOI":"10.1109\/DICTA.2012.6411676"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.neucom.2013.10.037","article-title":"Rapid multimodality registration based on MM-SURF","volume":"131","author":"Zhao","year":"2014","journal-title":"Neurocomputing"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"053017","DOI":"10.1117\/1.JEI.24.5.053017","article-title":"Visible and infrared image registration based on visual salient features","volume":"24","author":"Wu","year":"2015","journal-title":"J. Electron. Imaging"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/s11265-008-0202-x","article-title":"Robust multimodal registration using local phase-coherence representations","volume":"54","author":"Wong","year":"2009","journal-title":"J. Signal Process. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Xia, R., Zhao, J., and Liu, Y. (2013, January 26\u201327). A robust feature-based registration method of multimodal image using phase congruency and coherent point drift. Proceedings of the International Symposium on Multispectral Image Processing and Pattern Recognition, Wuhan, China.","DOI":"10.1117\/12.2031615"},{"key":"ref_31","first-page":"1","article-title":"Multi-modal image matching based on local frequency information","volume":"3","author":"Liu","year":"2013","journal-title":"EURASIP J. Adv. Sig. Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chen, M., Habib, A., He, H., Zhu, Q., and Zhang, W. (2017). Robust feature matching method for SAR and optical images by using Gaussian-Gamma-Shaped Bi-Windows-based descriptor and geometric constraint. Remote Sens., 9.","DOI":"10.3390\/rs9090882"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/TMI.2015.2455416","article-title":"Image registration based on autocorrelation of local structure","volume":"35","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1038\/324250a0","article-title":"Mach bands are phase dependent","volume":"324","author":"Morrone","year":"1986","journal-title":"Nature"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1007\/s004260000024","article-title":"Phase congruency: A low-level image invariant","volume":"64","author":"Kovesi","year":"2000","journal-title":"Psych. Res."},{"key":"ref_36","unstructured":"Kovesi, P. (2003, January 10\u201312). Phase congruency detects corners and edges. Proceedings of the Conference on Digital Image Computing: Techniques and Applications."},{"key":"ref_37","unstructured":"Donoser, M., and Bischof, H. (2006, January 17\u201322). Efficient maximally stable extremal region (MSER) tracking. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/4\/658\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:01:49Z","timestamp":1760194909000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/4\/658"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,23]]},"references-count":37,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,4]]}},"alternative-id":["rs10040658"],"URL":"https:\/\/doi.org\/10.3390\/rs10040658","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,23]]}}}