{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T05:52:26Z","timestamp":1780465946916,"version":"3.54.1"},"reference-count":51,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T00:00:00Z","timestamp":1599696000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The nonlinear radiation distortions (NRD) among multimodal remote sensing images bring enormous challenges to image registration. The traditional feature-based registration methods commonly use the image intensity or gradient information to detect and describe the features that are sensitive to NRD. However, the nonlinear mapping of the corresponding features of the multimodal images often results in failure of the feature matching, as well as the image registration. In this paper, a modality-free multimodal remote sensing image registration method (SRIFT) is proposed for the registration of multimodal remote sensing images, which is invariant to scale, radiation, and rotation. In SRIFT, the nonlinear diffusion scale (NDS) space is first established to construct a multi-scale space. A local orientation and scale phase congruency (LOSPC) algorithm are then used so that the features of the images with NRD are mapped to establish a one-to-one correspondence, to obtain sufficiently stable key points. In the feature description stage, a rotation-invariant coordinate (RIC) system is adopted to build a descriptor, without requiring estimation of the main direction. The experiments undertaken in this study included one set of simulated data experiments and nine groups of experiments with different types of real multimodal remote sensing images with rotation and scale differences (including synthetic aperture radar (SAR)\/optical, digital surface model (DSM)\/optical, light detection and ranging (LiDAR) intensity\/optical, near-infrared (NIR)\/optical, short-wave infrared (SWIR)\/optical, classification\/optical, and map\/optical image pairs), to test the proposed algorithm from both quantitative and qualitative aspects. The experimental results showed that the proposed method has strong robustness to NRD, being invariant to scale, radiation, and rotation, and the achieved registration precision was better than that of the state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/rs12182937","type":"journal-article","created":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T22:58:01Z","timestamp":1599778681000},"page":"2937","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Modality-Free Feature Detector and Descriptor for Multimodal Remote Sensing Image Registration"],"prefix":"10.3390","volume":"12","author":[{"given":"Song","family":"Cui","sequence":"first","affiliation":[{"name":"The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8434-8009","authenticated-orcid":false,"given":"Miaozhong","family":"Xu","sequence":"additional","affiliation":[{"name":"The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ailong","family":"Ma","sequence":"additional","affiliation":[{"name":"The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9446-5850","authenticated-orcid":false,"given":"Yanfei","family":"Zhong","sequence":"additional","affiliation":[{"name":"The State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Flusser","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"025006","DOI":"10.1117\/1.JRS.11.025006","article-title":"Fusion of synthetic aperture radar and visible images based on variational multiscale image decomposition","volume":"11","author":"Wu","year":"2017","journal-title":"J. Appl. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo processing by semiglobal matching and mutual information","volume":"30","author":"Hirschmuller","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"5993","DOI":"10.1109\/TGRS.2016.2578438","article-title":"Sar image change detection based on correlation kernel and multistage extreme learning machine","volume":"54","author":"Jia","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1109\/TAES.1974.307828","article-title":"Correlation techniques of image registration","volume":"10","author":"Pratt","year":"1974","journal-title":"IEEE Tans. Aerosp. Electron. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2099","DOI":"10.1109\/TIP.2011.2171696","article-title":"Correlation-coefficient-based fast template matching through partial elimination","volume":"21","author":"Mahmood","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s12524-016-0584-3","article-title":"Description of salient features combined with local self-similarity for sar image registration","volume":"45","author":"Yang","year":"2017","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by maximization of mutual information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1080\/10255842.2012.670855","article-title":"Medical image registration: A review","volume":"17","author":"Oliveira","year":"2014","journal-title":"Comput. Methods Biomech. Biomed. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1109\/LGRS.2017.2783879","article-title":"Psosac: Particle swarm optimization sample consensus algorithm for remote sensing image registration","volume":"15","author":"Wu","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1080\/2150704X.2018.1458343","article-title":"Mutual information based multi-modal remote sensing image registration using adaptive feature weight","volume":"9","author":"Zhang","year":"2018","journal-title":"Remote Sens. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"14643","DOI":"10.1007\/s11042-019-7211-6","article-title":"An artificial bee algorithm with a leading group and its application into image registration","volume":"79","author":"Hu","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.1080\/01431161.2018.1437295","article-title":"Medium-low resolution multisource remote sensing image registration based on sift and robust regional mutual information","volume":"39","author":"Chen","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_14","first-page":"700","article-title":"Registration of translated and rotated images using finite fourier transforms","volume":"9","author":"De","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4143","DOI":"10.1109\/TGRS.2015.2391999","article-title":"A novel subpixel phase correlation method using singular value decomposition and unified random sample consensus","volume":"53","author":"Tong","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/146370.146374","article-title":"A survey of image registration techniques","volume":"24","author":"Brown","year":"1992","journal-title":"ACM Comput. Surv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1007\/s11554-019-00858-x","article-title":"Real-time adaptive visible and infrared image registration based on morphological gradient and c_sift","volume":"17","author":"Zeng","year":"2019","journal-title":"J. Real Time Image Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4900","DOI":"10.1109\/TIP.2017.2722689","article-title":"Volumetric image registration from invariant keypoints","volume":"26","author":"Rister","year":"2017","journal-title":"IEEE Trans. Image Process"},{"key":"ref_19","first-page":"1","article-title":"Robust point correspondence with gabor scale-invariant feature transform for optical satellite image registration","volume":"46","author":"Hou","year":"2017","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yan, L., Wang, Z., Liu, Y., and Ye, Z. (2018). Generic and automatic markov random field-based registration for multimodal remote sensing image using grayscale and gradient information. Remote Sens., 10.","DOI":"10.3390\/rs10081228"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Wang, F., and You, H. (2018). An automatic and novel sar image registration algorithm: A case study of the chinese gf-3 satellite. Sensors, 18.","DOI":"10.3390\/s18020672"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Feng, W., Ling, W., and You, H. (2017). An advanced rotation invariant descriptor for sar image registration. Remote Sens., 9.","DOI":"10.3390\/rs9070686"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"Asift: A new framework for fully affine invariant image comparison","volume":"2","author":"Morel","year":"2009","journal-title":"Siam J. Imaging Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (surf)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Und."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1038\/s41586-019-0912-1","article-title":"Deep learning and process understanding for data-driven earth system science","volume":"566","author":"Reichstein","year":"2019","journal-title":"Nature"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Niethammer, M., Kwitt, R., and Vialard, F.-X. (2019, January 19\u201325). Metric learning for image registration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR.2019.00866"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Shen, Z., Han, X., Xu, Z., and Niethammer, M. (2019, January 29\u201331). Networks for joint affine and non-parametric image registration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00435"},{"key":"ref_30","first-page":"1","article-title":"Registration of multimodal remote sensing image based on deep fully convolutional neural network","volume":"18","author":"Zhang","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4834","DOI":"10.1109\/TGRS.2019.2893310","article-title":"A novel two-step registration method for remote sensing images based on deep and local features","volume":"57","author":"Ma","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Merkle, N., Luo, W., Auer, S., M\u00fcller, R., and Urtasun, R. (2017). Exploiting deep matching and sar data for the geo-localization accuracy improvement of optical satellite images. Remote Sens., 9.","DOI":"10.3390\/rs9060586"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1811","DOI":"10.1109\/JSTARS.2018.2803212","article-title":"Exploring the potential of conditional adversarial networks for optical and sar image matching","volume":"11","author":"Merkle","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2576","DOI":"10.1080\/01431161.2018.1528402","article-title":"High-resolution image registration based on improved surf detector and localized gtm","volume":"40","author":"Sedaghat","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.isprsjprs.2017.12.012","article-title":"A deep learning framework for remote sensing image registration","volume":"145","author":"Wang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"593","DOI":"10.5194\/isprs-archives-XLI-B7-593-2016","article-title":"An automatic optical and sar image registration method using iterative multi-level and refinement model","volume":"7","author":"Xu","year":"2016","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"12661","DOI":"10.3390\/s120912661","article-title":"Multispectral image feature points","volume":"12","author":"Aguilera","year":"2012","journal-title":"Sensors"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1707","DOI":"10.1109\/TBME.2010.2042169","article-title":"A partial intensity invariant feature descriptor for multimodal retinal image registration","volume":"57","author":"Chen","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Shechtman, E., and Irani, M. (2007, January 17\u201322). Matching local self-similarities across images and videos. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383198"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1109\/LGRS.2017.2660067","article-title":"Robust optical-to-sar image matching based on shape properties","volume":"14","author":"Ye","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"9","DOI":"10.5194\/isprs-annals-III-1-9-2016","article-title":"Hopc: A novel similarity metric based on geometric structural properties for multi-modal remote sensing image matching","volume":"3","author":"Ye","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3296","DOI":"10.1109\/TIP.2019.2959244","article-title":"Rift: Multi-modal image matching based on radiation-variation insensitive feature transform","volume":"29","author":"Li","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2018.2815523","article-title":"Sar and optical image registration using nonlinear diffusion and phase congruency structural descriptor","volume":"56","author":"Fan","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1109\/34.56205","article-title":"Scale-space and edge detection using anisotropic diffusion","volume":"12","author":"Perona","year":"1990","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1007\/s004260000024","article-title":"Phase congruency: A low-level image invariant","volume":"64","author":"Kovesi","year":"2000","journal-title":"Psychol. Res."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kovesi, P. (2007). Phase is an important low-level image invariant. Pacific Rim Conference on Advances in Image and Video Technology, Springer.","DOI":"10.1007\/978-3-540-77129-6_4"},{"key":"ref_47","first-page":"115","article-title":"Image features from phase congruency","volume":"1","author":"Kovesi","year":"1999","journal-title":"J. Comput. Vis. Res."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Fan, B., Wu, F., and Hu, Z. (2011, January 20\u201325). Aggregating gradient distributions into intensity orders: A novel local image descriptor. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2011.5995385"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"Sar-sift: A sift-like algorithm for sar images","volume":"53","author":"Dellinger","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote sensing image registration with modified sift and enhanced feature matching","volume":"14","author":"Ma","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_51","unstructured":"Li, J., Hu, Q., and Ai, M. (2018). Rift: Multi-modal image matching based on radiation-invariant feature transform. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/2937\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:08:54Z","timestamp":1760177334000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/18\/2937"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,10]]},"references-count":51,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["rs12182937"],"URL":"https:\/\/doi.org\/10.3390\/rs12182937","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,10]]}}}