{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T10:40:54Z","timestamp":1781952054670,"version":"3.54.5"},"reference-count":42,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2024,9,13]],"date-time":"2024-09-13T00:00:00Z","timestamp":1726185600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["61901042"],"award-info":[{"award-number":["61901042"]}]},{"name":"National Natural Science Foundation of China","award":["9012035202"],"award-info":[{"award-number":["9012035202"]}]},{"name":"National Natural Science Foundation of China","award":["U20A20167"],"award-info":[{"award-number":["U20A20167"]}]},{"name":"National Natural Science Foundation of China","award":["62071455"],"award-info":[{"award-number":["62071455"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Optical and synthetic aperture radar (SAR) images exhibit non-negligible intensity differences due to their unique imaging mechanisms, which makes it difficult for classical SIFT-based algorithms to obtain sufficiently correct correspondences when processing the registration of these two types of images. To tackle this problem, an accurate optical and SAR image registration algorithm based on the SIFT algorithm (OS-PSO) is proposed. First, a modified ratio of exponentially weighted averages (MROEWA) operator is introduced to resolve the sudden dark patches in SAR images, thus generating more consistent gradients between optical and SAR images. Next, we innovatively construct the Harris scale space to replace the traditional difference in the Gaussian (DoG) scale space, identify repeatable key-points by searching for local maxima, and perform localization refinement on the identified key-points to improve their accuracy. Immediately after that, the gradient location orientation histogram (GLOH) method is adopted to construct the feature descriptors. Finally, we propose an enhanced matching method. The transformed relation is obtained in the initial matching stage using the nearest neighbor distance ratio (NNDR) and fast sample consensus (FSC) methods. And the re-matching takes into account the location, scale, and main direction of key-points to increase the number of correctly corresponding points. The proposed OS-PSO algorithm has been implemented on the Gaofen and Sentinel series with excellent results. The superior performance of the designed registration system can also be applied in complex scenarios, including urban, suburban, river, farmland, and lake areas, with more efficiency and accuracy than the state-of-the-art methods based on the WHU-OPT-SAR dataset and the BISTU-OPT-SAR dataset.<\/jats:p>","DOI":"10.3390\/s24185959","type":"journal-article","created":{"date-parts":[[2024,9,13]],"date-time":"2024-09-13T11:29:59Z","timestamp":1726226999000},"page":"5959","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["OS-PSO: A Modified Ratio of Exponentially Weighted Averages-Based Optical and SAR Image Registration"],"prefix":"10.3390","volume":"24","author":[{"given":"Hui","family":"Zhang","sequence":"first","affiliation":[{"name":"Beijing Key Laboratory of Sensor, Beijing Information Science & Technology University, Beijing 100101, China"},{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University, Beijing 100192, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Song","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Sensor, Beijing Information Science & Technology University, Beijing 100101, China"},{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University, Beijing 100192, China"},{"name":"State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingfang","family":"Hu","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Sensor, Beijing Information Science & Technology University, Beijing 100101, China"},{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University, Beijing 100192, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yansheng","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Sensor, Beijing Information Science & Technology University, Beijing 100101, China"},{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University, Beijing 100192, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3895-9220","authenticated-orcid":false,"given":"Yang","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Transducer Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guowei","family":"Gao","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Sensor, Beijing Information Science & Technology University, Beijing 100101, China"},{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University, Beijing 100192, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wu, Y., Hei, G., Teng, D., Wan, Q., Zhao, Y., Chen, M., Xia, Y., Jiang, M., and Li, S. (2023, January 14\u201316). Optical image and SAR image registration based on position constraint. Proceedings of the Fourth International Conference on Geology, Mapping, and Remote Sensing (ICGMRS 2023), Wuhan, China.","DOI":"10.1117\/12.3020081"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1007\/s10762-014-0057-0","article-title":"Review of terahertz tomography techniques","volume":"35","author":"Guillet","year":"2014","journal-title":"J. Infrared Millim. Terahertz Waves"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"109156","DOI":"10.1016\/j.sigpro.2023.109156","article-title":"Synthetic aperture radar image and its despeckling using variational methods: A review of recent trends","volume":"212","author":"Baraha","year":"2023","journal-title":"Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5205315","DOI":"10.1109\/TGRS.2024.3366519","article-title":"Optical and SAR image fusion based on complementary feature decomposition and visual saliency features","volume":"62","author":"Ye","year":"2024","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.inffus.2022.09.019","article-title":"Current advances and future perspectives of image fusion: A comprehensive review","volume":"90","author":"Karim","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"102061","DOI":"10.1016\/j.inffus.2023.102061","article-title":"Hybrid unsupervised paradigm based deformable image fusion for 4D CT lung image modality","volume":"102","author":"Iqbal","year":"2024","journal-title":"Inf. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, J., Bi, G., Wang, X., Nie, T., and Huang, L. (2024). Radiation-Variation Insensitive Coarse-to-Fine Image Registration for Infrared and Visible Remote Sensing Based on Zero-Shot Learning. Remote Sens., 16.","DOI":"10.3390\/rs16020214"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hou, X., Gao, Q., Wang, R., and Luo, X. (2021). Satellite-borne optical remote sensing image registration based on point features. Sensors, 21.","DOI":"10.3390\/s21082695"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1080\/00207160500112944","article-title":"Intensity-based robust similarity for multimodal image registration","volume":"83","author":"Du","year":"2006","journal-title":"Int. J. Comput. Math."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.imavis.2006.08.002","article-title":"Monomodal image registration using mutual information based methods","volume":"26","author":"Gao","year":"2008","journal-title":"Image Vis. Comput."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sarvaiya, J.N., Patnaik, S., and Bombaywala, S. (2009, January 28\u201329). Image registration by template matching using normalized cross-correlation. Proceedings of the 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies, Bangalore, India.","DOI":"10.1109\/ACT.2009.207"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4477","DOI":"10.1080\/01431161.2022.2114112","article-title":"Feature based remote sensing image registration techniques: A comprehensive and comparative review","volume":"43","author":"Misra","year":"2022","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s11263-020-01359-2","article-title":"Image matching from handcrafted to deep features: A survey","volume":"129","author":"Ma","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"SAR-SIFT: A SIFT-like algorithm for SAR images","volume":"53","author":"Dellinger","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote sensing image registration with modified SIFT and enhanced feature matching","volume":"14","author":"Ma","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3078","DOI":"10.1109\/TGRS.2018.2790483","article-title":"OS-SIFT: A robust SIFT-like algorithm for high-resolution optical-to-SAR image registration in suburban areas","volume":"56","author":"Xiang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"12440","DOI":"10.1109\/JSTARS.2021.3131489","article-title":"Self-similarity features for multimodal remote sensing image matching","volume":"14","author":"Xiong","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5368","DOI":"10.1109\/TGRS.2018.2815523","article-title":"SAR and optical image registration using nonlinear diffusion and phase congruency structural descriptor","volume":"56","author":"Fan","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.isprsjprs.2021.09.010","article-title":"Robust registration of aerial images and LiDAR data using spatial constraints and Gabor structural features","volume":"181","author":"Zhu","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3296","DOI":"10.1109\/TIP.2019.2959244","article-title":"RIFT: Multi-modal image matching based on radiation-variation insensitive feature transform","volume":"29","author":"Li","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"5233117","DOI":"10.1109\/TGRS.2022.3197357","article-title":"Robust registration algorithm for optical and SAR images based on adjacent self-similarity feature","volume":"60","author":"Xiong","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhang, Z., Ma, G., and Wu, J. (2021, January 11\u201316). Multi-source remote sensing image registration based on local deep learning feature. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.","DOI":"10.1109\/IGARSS47720.2021.9553142"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4706718","DOI":"10.1109\/TGRS.2022.3173476","article-title":"Self-distillation feature learning network for optical and SAR image registration","volume":"60","author":"Quan","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","first-page":"4017905","article-title":"A Siamese template matching method for SAR and optical image","volume":"19","author":"Wu","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_26","first-page":"4017605","article-title":"Robust matching for SAR and optical images using multiscale convolutional gradient features","volume":"19","author":"Zhou","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5235913","DOI":"10.1109\/TGRS.2022.3211858","article-title":"Optical and SAR image registration based on feature decoupling network","volume":"60","author":"Xiang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Li, Z., Fu, Z., Nie, H., and Chen, S. (2022). PM-Net: A Multi-Level Keypoints Detector and Patch Feature Learning Network for Optical and SAR Image Matching. Appl. Sci., 12.","DOI":"10.3390\/app12125989"},{"key":"ref_29","first-page":"102638","article-title":"MCANet: A joint semantic segmentation framework of optical and SAR images for land use classification","volume":"106","author":"Li","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cheng-li, J., Xiao-guang, Z., Ling-jun, Z., and Gang-yao, K. (2006, January 16\u201319). A Modified ROEWA method for edge detection in SAR images. Proceedings of the 2006 CIE International Conference on Radar, Shanghai, China.","DOI":"10.1109\/ICR.2006.343176"},{"key":"ref_31","unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1109\/TPAMI.2005.188","article-title":"A performance evaluation of local descriptors","volume":"27","author":"Mikolajczyk","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hou, H., Lan, C., Xu, Q., Lv, L., Xiong, X., Yao, F., and Wang, L. (2022). Attention-Based Matching Approach for Heterogeneous Remote Sensing Images. Remote Sens., 15.","DOI":"10.3390\/rs15010163"},{"key":"ref_34","first-page":"4011605","article-title":"Robust optical and SAR image registration based on OS-SIFT and cascaded sample consensus","volume":"19","author":"Zhang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5150","DOI":"10.1109\/TGRS.2011.2155069","article-title":"SBAS-based satellite orbit correction for the generation of DInSAR time-series: Application to RADARSAT-1 data","volume":"49","author":"Pepe","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","first-page":"4009105","article-title":"Thermal noise removal from polarimetric Sentinel-1 data","volume":"19","author":"Mascolo","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","first-page":"202","article-title":"Improved sigma filter for speckle filtering of SAR imagery","volume":"47","author":"Lee","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3915","DOI":"10.1109\/TGRS.2009.2023909","article-title":"PALSAR radiometric and geometric calibration","volume":"47","author":"Shimada","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","unstructured":"Werner, C., Strozzi, T., Wegmuller, U., and Wiesmann, A. (2002, January 24\u201328). SAR geocoding and multi-sensor image registration. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Toronto, ON, Canada."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mikolajczyk, K., and Schmid, C. (2002, January 28\u201331). An affine invariant interest point detector. Proceedings of the Computer Vision\u2014ECCV 2002: 7th European Conference on Computer Vision, Copenhagen, Denmark. Proceedings, Part I 7.","DOI":"10.1007\/3-540-47969-4_9"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Han, Z., Dou, Z., Huang, C., Cong, L., Lv, N., and Chen, C. (2023). Edge Consistency Feature Extraction Method for Multi-Source Image Registration. Remote Sens., 15.","DOI":"10.20944\/preprints202307.2073.v1"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2941","DOI":"10.1109\/TGRS.2017.2656380","article-title":"Robust registration of multimodal remote sensing images based on structural similarity","volume":"55","author":"Ye","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/18\/5959\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:55:59Z","timestamp":1760111759000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/18\/5959"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,13]]},"references-count":42,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["s24185959"],"URL":"https:\/\/doi.org\/10.3390\/s24185959","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,13]]}}}