{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:09:59Z","timestamp":1760234999970,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T00:00:00Z","timestamp":1625356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Traditional feature matching methods of optical and synthetic aperture radar (SAR) used gradient are sensitive to non-linear radiation distortions (NRD) and the rotation between two images. To address this problem, this study presents a novel approach to solving the rigid body rotation problem by a two-step process. The first step proposes a deep learning neural network named RotNET to predict the rotation relationship between two images. The second step uses a local feature descriptor based on the Gaussian pyramid named Gaussian pyramid features of oriented gradients (GPOG) to match two images. The RotNET uses a neural network to analyze the gradient histogram of the two images to derive the rotation relationship between optical and SAR images. Subsequently, GPOG is depicted a keypoint by using the histogram of Gaussian pyramid to make one-cell block structure which is simpler and more stable than HOG structure-based descriptors. Finally, this paper designs experiments to prove that the gradient histogram of the optical and SAR images can reflect the rotation relationship and the RotNET can correctly predict them. The similarity map test and the image registration results obtained on experiments show that GPOG descriptor is robust to SAR speckle noise and NRD.<\/jats:p>","DOI":"10.3390\/rs13132628","type":"journal-article","created":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T22:35:22Z","timestamp":1625438122000},"page":"2628","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["A Rotation-Invariant Optical and SAR Image Registration Algorithm Based on Deep and Gaussian Features"],"prefix":"10.3390","volume":"13","author":[{"given":"Zeyi","family":"Li","sequence":"first","affiliation":[{"name":"Department of Precision Instruments, Tsinghua University, Beijing 100083, China"},{"name":"Key Laboratory Photonic Control Technology, Ministry of Education, Tsinghua University, Beijing 100083, China"}]},{"given":"Haitao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Precision Instruments, Tsinghua University, Beijing 100083, China"},{"name":"Key Laboratory Photonic Control Technology, Ministry of Education, Tsinghua University, Beijing 100083, China"}]},{"given":"Yihang","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Precision Instruments, Tsinghua University, Beijing 100083, China"},{"name":"Key Laboratory Photonic Control Technology, Ministry of Education, Tsinghua University, Beijing 100083, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.inffus.2020.01.003","article-title":"Pixel Level Fusion Techniques for SAR and Optical Images: A Review","volume":"59","author":"Kulkarni","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s11263-020-01359-2","article-title":"Image Matching from Handcrafted to Deep Features: A Survey","volume":"129","author":"Ma","year":"2021","journal-title":"Int. J. Comput. Vis."},{"doi-asserted-by":"crossref","unstructured":"Tapete, D., and Cigna, F. (2019). Detection of Archaeological Looting from Space: Methods, Achievements and Challenges. Remote Sens., 11.","key":"ref_3","DOI":"10.3390\/rs11202389"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1080\/2150704X.2019.1594430","article-title":"A novel change detection method combined with registration for SAR images","volume":"10","author":"Song","year":"2019","journal-title":"Remote Sens. Lett."},{"unstructured":"Li, K., and Zhang, X. (2018, January 13\u201315). Review of Research on Registration of SAR and Optical Remote Sensing Image Based on Feature. Proceedings of the 2018 IEEE 3rd International Conference on Signal and Image Processing (ICSIP), Shenzhen, China.","key":"ref_5"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5368","DOI":"10.1109\/TGRS.2018.2815523","article-title":"SAR and Optical Image Registration Using Nonlinear Diffusion and Phase Congruency Structural Descriptor","volume":"56","author":"Fan","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/S0924-2716(01)00031-4","article-title":"An improved model for automatic feature-based registration of SAR and SPOT images","volume":"56","author":"Dare","year":"2001","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.isprsjprs.2019.03.002","article-title":"Robust registration for remote sensing images by combining and localizing feature- and area-based methods","volume":"151","author":"Feng","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Zitova","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1109\/TGRS.2009.2034842","article-title":"Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas","volume":"48","author":"Suri","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/TMI.2015.2455416","article-title":"Image Registration Based on Autocorrelation of Local Structure","volume":"35","author":"Li","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"doi-asserted-by":"crossref","unstructured":"He, C., Fang, P., Xiong, D., Wang, W., and Liao, M. (2018). A Point Pattern Chamfer Registration of Optical and SAR Images Based on Mesh Grids. Remote Sens., 10.","key":"ref_12","DOI":"10.3390\/rs10111837"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"2","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, November 06). ORB: An Efficient Alternative to SIFT or SURF. Available online: https:\/\/ieeexplore.ieee.org\/document\/6126544.","key":"ref_14","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote Sensing Image Registration with Modified SIFT and Enhanced Feature Matching","volume":"14","author":"Ma","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"unstructured":"Ke, Y., and Sukthankar, R. (July, January 27). PCA-SIFT: A more distinctive representation for local image descriptors. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.","key":"ref_17"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"ASIFT: A new framework for fully affine invariant image comparison","volume":"2","author":"Morel","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3997","DOI":"10.1080\/01431161.2015.1070321","article-title":"An automatic optical and SAR image registration method with iterative level set segmentation and SIFT","volume":"36","author":"Xu","year":"2015","journal-title":"Int. J. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5283","DOI":"10.1109\/TGRS.2015.2420659","article-title":"Remote Sensing Image Matching Based on Adaptive Binning SIFT Descriptor","volume":"53","author":"Sedaghat","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"SAR-SIFT: A SIFT-Like Algorithm for SAR Images","volume":"53","author":"Dellinger","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3078","DOI":"10.1109\/TGRS.2018.2790483","article-title":"OS-SIFT: A Robust SIFT-Like Algorithm for High-Resolution Optical-to-SAR Image Registration in Suburban Areas","volume":"56","author":"Xiang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1007\/s004260000024","article-title":"Phase congruency: A low-level image invariant","volume":"64","author":"Kovesi","year":"2000","journal-title":"Psychol. Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/0167-8655(87)90013-4","article-title":"Feature detection from local energy","volume":"6","author":"Morrone","year":"1987","journal-title":"Pattern Recognit. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2941","DOI":"10.1109\/TGRS.2017.2656380","article-title":"Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity","volume":"55","author":"Ye","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"unstructured":"Dalal, N., and Triggs, B. (2005, January 25). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA.","key":"ref_26"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.isprsjprs.2018.06.010","article-title":"A local phase based invariant feature for remote sensing image matching","volume":"142","author":"Ye","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"6451","DOI":"10.1109\/TGRS.2020.2976865","article-title":"OS-PC: Combining Feature Representation and 3-D Phase Correlation for Subpixel Optical and SAR Image Registration","volume":"58","author":"Xiang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3296","DOI":"10.1109\/TIP.2019.2959244","article-title":"RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform","volume":"29","author":"Li","year":"2020","journal-title":"IEEE Trans. Image Process."},{"doi-asserted-by":"crossref","unstructured":"Fu, Z., Qin, Q., Luo, B., Sun, H., and Wu, C. (2018). HOMPC: A Local Feature Descriptor Based on the Combination of Magnitude and Phase Congruency Information for Multi-Sensor Remote Sensing Images. Remote Sens., 10.","key":"ref_30","DOI":"10.3390\/rs10081234"},{"doi-asserted-by":"crossref","unstructured":"Wang, L., Sun, M., Liu, J., Cao, L., and Ma, G. (2020). A Robust Algorithm Based on Phase Congruency for Optical and SAR Image Registration in Suburban Areas. Remote Sens., 12.","key":"ref_31","DOI":"10.3390\/rs12203339"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3028","DOI":"10.1109\/JSTARS.2019.2916560","article-title":"Registration of Multimodal Remote Sensing Image Based on Deep Fully Convolutional Neural Network","volume":"12","author":"Zhang","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"He, H., Chen, M., Chen, T., and Li, D. (2018). Matching of Remote Sensing Images with Complex Background Variations via Siamese Convolutional Neural Network. Remote Sens., 10.","key":"ref_33","DOI":"10.3390\/rs10020355"},{"doi-asserted-by":"crossref","unstructured":"Dong, Y., Jiao, W., Long, T., Liu, L., He, G., Gong, C., and Guo, Y. (2019). Local Deep Descriptor for Remote Sensing Image Feature Matching. Remote Sens., 11.","key":"ref_34","DOI":"10.3390\/rs11040430"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1811","DOI":"10.1109\/JSTARS.2018.2803212","article-title":"Exploring the Potential of Conditional Adversarial Networks for Optical and SAR Image Matching","volume":"11","author":"Merkle","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Schmitt, M., Hughes, L.H., and Zhu, X.X. (2018). The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion. arXiv.","key":"ref_36","DOI":"10.5194\/isprs-annals-IV-1-141-2018"},{"key":"ref_37","first-page":"77","article-title":"Feature Detection with Automatic Scale Selection","volume":"30","author":"Lindeberg","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"9059","DOI":"10.1109\/TGRS.2019.2924684","article-title":"Fast and Robust Matching for Multimodal Remote Sensing Image Registration","volume":"57","author":"Ye","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2286","DOI":"10.1109\/TIP.2013.2249080","article-title":"Log-Gabor Filters for Image-Based Vehicle Verification","volume":"22","author":"Arrospide","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"4516","DOI":"10.1109\/TGRS.2011.2144607","article-title":"Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images","volume":"49","author":"Sedaghat","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/LGRS.2014.2325970","article-title":"A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration","volume":"12","author":"Wu","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2628\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:25:54Z","timestamp":1760163954000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2628"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,4]]},"references-count":41,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13132628"],"URL":"https:\/\/doi.org\/10.3390\/rs13132628","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,7,4]]}}}