{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T15:49:57Z","timestamp":1784130597211,"version":"3.55.0"},"reference-count":42,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T00:00:00Z","timestamp":1694476800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["U19B2030"],"award-info":[{"award-number":["U19B2030"]}]},{"name":"National Natural Science Foundation of China","award":["61976167"],"award-info":[{"award-number":["61976167"]}]},{"name":"National Natural Science Foundation of China","award":["62101416"],"award-info":[{"award-number":["62101416"]}]},{"name":"National Natural Science Foundation of China","award":["2022JQ-708"],"award-info":[{"award-number":["2022JQ-708"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["U19B2030"],"award-info":[{"award-number":["U19B2030"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["61976167"],"award-info":[{"award-number":["61976167"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["62101416"],"award-info":[{"award-number":["62101416"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["2022JQ-708"],"award-info":[{"award-number":["2022JQ-708"]}]},{"name":"Fundamental ResearchFunds for the Central Universities","award":["U19B2030"],"award-info":[{"award-number":["U19B2030"]}]},{"name":"Fundamental ResearchFunds for the Central Universities","award":["61976167"],"award-info":[{"award-number":["61976167"]}]},{"name":"Fundamental ResearchFunds for the Central Universities","award":["62101416"],"award-info":[{"award-number":["62101416"]}]},{"name":"Fundamental ResearchFunds for the Central Universities","award":["2022JQ-708"],"award-info":[{"award-number":["2022JQ-708"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Registration of optical and synthetic aperture radar (SAR) images is challenging because extracting located identically and unique features on both images are tricky. This paper proposes a novel optical and SAR image registration method based on relative total variation (RTV) and scale-invariant feature transform (SIFT), named RTV-SIFT, to extract feature points on the edges of structures and construct structural edge descriptors to improve the registration accuracy. First, a novel RTV-Harris feature point detection method by combining the RTV and the multiscale Harris algorithm is proposed to extract feature points on both images\u2019 significant structures. This ensures a high repetition rate of the feature points. Second, the feature point descriptors are constructed on enhanced phase congruency edge (EPCE), which combines the Sobel operator and maximum moment of phase congruency (PC) to extract edges from structured images that enhance robustness to nonlinear intensity differences and speckle noise. Finally, after coarse registration, the position and orientation Euclidean distance (POED) between feature points is utilized to achieve fine feature point matching to improve the registration accuracy. The experimental results demonstrate the superiority of the proposed RTV-SIFT method in different scenes and image capture conditions, indicating its robustness and effectiveness in optical and SAR image registration.<\/jats:p>","DOI":"10.3390\/rs15184476","type":"journal-article","created":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T03:54:06Z","timestamp":1694490846000},"page":"4476","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["RTV-SIFT: Harnessing Structure Information for Robust Optical and SAR Image Registration"],"prefix":"10.3390","volume":"15","author":[{"given":"Siqi","family":"Pang","sequence":"first","affiliation":[{"name":"Key Laboratory of Collaborative Intelligence Systems, Ministry of Education of China, School of Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junyao","family":"Ge","sequence":"additional","affiliation":[{"name":"Key Laboratory of Collaborative Intelligence Systems, Ministry of Education of China, School of Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Hu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Collaborative Intelligence Systems, Ministry of Education of China, School of Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaitai","family":"Guo","sequence":"additional","affiliation":[{"name":"Key Laboratory of Collaborative Intelligence Systems, Ministry of Education of China, School of Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0515-7280","authenticated-orcid":false,"given":"Yang","family":"Zheng","sequence":"additional","affiliation":[{"name":"Key Laboratory of Collaborative Intelligence Systems, Ministry of Education of China, School of Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Changli","family":"Zheng","sequence":"additional","affiliation":[{"name":"Science and Technology on Electronic Information Control Laboratory, Southwest China Research Institute of Electronic Equipment, Chengdu 610036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Science and Technology on Electronic Information Control Laboratory, Southwest China Research Institute of Electronic Equipment, Chengdu 610036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jimin","family":"Liang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Collaborative Intelligence Systems, Ministry of Education of China, School of Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"9941","DOI":"10.1109\/TGRS.2019.2930322","article-title":"An Object-Based Hierarchical Compound Classification Method for Change Detection in Heterogeneous Optical and SAR Images","volume":"57","author":"Wan","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Nie, M., Ling, L., and Wei, X. (2006, January 16\u201319). A Novel Fusion and Target Detection Method of Airborne SAR Images and Optical Images. Proceedings of the International Conference on Radar, Shanghai, China.","DOI":"10.1109\/ICR.2006.343512"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2900","DOI":"10.1109\/TGRS.2011.2113351","article-title":"High-resolution optical and SAR image fusion for building database updating","volume":"49","author":"Poulain","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.inffus.2021.02.012","article-title":"A review of multimodal image matching: Methods and applications","volume":"73","author":"Jiang","year":"2021","journal-title":"Inf. Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1109\/TGRS.2009.2034842","article-title":"Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas","volume":"48","author":"Suri","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1007\/s00034-009-9130-7","article-title":"Fast Normalized Cross-Correlation","volume":"28","author":"Lewis","year":"2009","journal-title":"Circuits Syst. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, Y., and Wang, Q. (2010, January 24\u201328). Multi-sensor image registration based on local feature and its attributes set. Proceedings of the IEEE 10th International Conference on Signal Processing Proceedings, Beijing, China.","DOI":"10.1109\/ICOSP.2010.5655899"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4834","DOI":"10.1109\/TGRS.2019.2893310","article-title":"A novel two-step registration method for remote sensing images based on deep and local features","volume":"57","author":"Ma","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Quan, D., Wang, S., Liang, X., Wang, R., Fang, S., Hou, B., and Jiao, L. (2018, January 22\u201327). Deep generative matching network for optical and SAR image registration. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518653"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1811","DOI":"10.1109\/JSTARS.2018.2803212","article-title":"Exploring the potential of conditional adversarial networks for optical and SAR image matching","volume":"11","author":"Merkle","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2020.09.012","article-title":"A deep learning framework for matching of SAR and optical imagery","volume":"169","author":"Hughes","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zampieri, A., Charpiat, G., Girard, N., and Tarabalka, Y. (2018, January 8\u201314). Multimodal image alignment through a multiscale chain of neural networks with application to remote sensing. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01270-0_40"},{"key":"ref_13","first-page":"1","article-title":"LNIFT: Locally normalized image for rotation invariant multimodal feature matching","volume":"60","author":"Li","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1016\/j.isprsjprs.2022.04.011","article-title":"A robust multimodal remote sensing image registration method and system using steerable filters with first-and second-order gradients","volume":"188","author":"Ye","year":"2022","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote Sensing Image Registration With Modified SIFT and Enhanced Feature Matching","volume":"14","author":"Ma","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"SAR-SIFT: A SIFT-like algorithm for SAR images","volume":"53","author":"Dellinger","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Low","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1023\/A:1008045108935","article-title":"Feature Detection with Automatic Scale Selection","volume":"30","author":"Lindeberg","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","first-page":"1","article-title":"Combination of SIFT and Canny Edge Detection for Registration Between SAR and Optical Images","volume":"19","author":"Zhang","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/LGRS.2012.2216500","article-title":"Registration of optical and SAR satellite images by exploring the spatial relationship of the improved SIFT","volume":"10","author":"Fan","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_21","first-page":"1","article-title":"Optical and SAR Image Registration Using Complexity Analysis and Binary Descriptor in Suburban Areas","volume":"19","author":"Xie","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3296","DOI":"10.1109\/TIP.2019.2959244","article-title":"RIFT: Multi-modal image matching based on radiation-variation insensitive feature transform","volume":"29","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Forero, M.G., Mambuscay, C.L., Monroy, M.F., Miranda, S.L., M\u00e9ndez, D., Valencia, M.O., and Gomez Selvaraj, M. (2021). Comparative analysis of detectors and feature descriptors for multispectral image matching in rice crops. Plants, 10.","DOI":"10.3390\/plants10091791"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Sharma, S.K., Jain, K., and Shukla, A.K. (2023). A Comparative Analysis of Feature Detectors and Descriptors for Image Stitching. Appl. Sci., 13.","DOI":"10.3390\/app13106015"},{"key":"ref_25","unstructured":"Mikolajczyk, K., and Schmid, C. (2001, January 7\u201314). Indexing based on scale invariant interest points. Proceedings of the Proceedings Eighth IEEE International Conference on Computer Vision, ICCV 2001, Vancouver, BC, Canada."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1109\/TPAMI.2005.188","article-title":"A performance evaluation of local descriptors","volume":"27","author":"Mikolajczyk","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1707","DOI":"10.1109\/TBME.2010.2042169","article-title":"A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration","volume":"57","author":"Chen","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5368","DOI":"10.1109\/TGRS.2018.2815523","article-title":"SAR and optical image registration using nonlinear diffusion and phase congruency structural descriptor","volume":"56","author":"Fan","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","unstructured":"Shuai, J., Jzang, U., Wang, B., Zhu, X., and Sun, X. (2018, January 22\u201327). Registration of SAR and Optical Images by Weighted Sift Based on Phase Congruency. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3958","DOI":"10.1109\/JSTARS.2022.3172449","article-title":"High-Precision Pixelwise SAR\u2014Optical Image Registration via Flow Fusion Estimation Based on an Attention Mechanism","volume":"15","author":"Yu","year":"2022","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_31","first-page":"1","article-title":"Image Features from Phase Congruency","volume":"1","author":"Kovesi","year":"1999","journal-title":"Videre J. Comput. Vis. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1007\/s004260000024","article-title":"Phase congruency: A low-level image invariant","volume":"64","author":"Kovesi","year":"2000","journal-title":"Psychol. Res."},{"key":"ref_33","unstructured":"Kovesi, P. (2003). The Australian Pattern Recognition Society Conference: DICTA, Csiro Publishing."},{"key":"ref_34","first-page":"1","article-title":"Structure extraction from texture via relative total variation","volume":"31","author":"Xu","year":"2012","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/LGRS.2014.2325970","article-title":"A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration","volume":"12","author":"Wu","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1023\/A:1008199403446","article-title":"Evaluation of interest point detectors","volume":"37","author":"Schmid","year":"2000","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/LGRS.2008.2012441","article-title":"Measures for an objective evaluation of the geometric correction process quality","volume":"6","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5847","DOI":"10.1109\/JSTARS.2020.3026162","article-title":"Automatic Registration of Optical and SAR Images Via Improved Phase Congruency Model","volume":"13","author":"Xiang","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3078","DOI":"10.1109\/TGRS.2018.2790483","article-title":"OS-SIFT: A robust SIFT-like algorithm for high-resolution optical-to-SAR image registration in suburban areas","volume":"56","author":"Xiang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2941","DOI":"10.1109\/TGRS.2017.2656380","article-title":"Robust registration of multimodal remote sensing images based on structural similarity","volume":"55","author":"Ye","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","unstructured":"Konnik, M., and Welsh, J. (2014). High-level numerical simulations of noise in CCD and CMOS photosensors: Review and tutorial. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1834","DOI":"10.1109\/TGRS.2003.813845","article-title":"Optical imaging through clouds and fog","volume":"41","author":"Jaruwatanadilok","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4476\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:49:12Z","timestamp":1760129352000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/18\/4476"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,12]]},"references-count":42,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["rs15184476"],"URL":"https:\/\/doi.org\/10.3390\/rs15184476","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,12]]}}}