{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T02:42:06Z","timestamp":1770691326165,"version":"3.49.0"},"reference-count":41,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2021,8,29]],"date-time":"2021-08-29T00:00:00Z","timestamp":1630195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Finance Science and Technology project of Hainan Province, China","award":["418MS113"],"award-info":[{"award-number":["418MS113"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41801259"],"award-info":[{"award-number":["41801259"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41972308"],"award-info":[{"award-number":["41972308"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Aerospace Information Research Institute, Chinese Academy of Sciences","award":["Y951150Z2F"],"award-info":[{"award-number":["Y951150Z2F"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Accurate registration for multisource high-resolution remote sensing images is an essential step for various remote sensing applications. Due to the complexity of the feature and texture information of high-resolution remote sensing images, especially for images covering earthquake disasters, feature-based image registration methods need a more helpful feature descriptor to improve the accuracy. However, traditional image registration methods that only use local features at low levels have difficulty representing the features of the matching points. To improve the accuracy of matching features for multisource high-resolution remote sensing images, an image registration method based on a deep residual network (ResNet) and scale-invariant feature transform (SIFT) was proposed. It used the fusion of SIFT features and ResNet features on the basis of the traditional algorithm to achieve image registration. The proposed method consists of two parts: model construction and training and image registration using a combination of SIFT and ResNet34 features. First, a registration sample set constructed from high-resolution satellite remote sensing images was used to fine-tune the network to obtain the ResNet model. Then, for the image to be registered, the Shi_Tomas algorithm and the combination of SIFT and ResNet features were used for feature extraction to complete the image registration. Considering the difference in image sizes and scenes, five pairs of images were used to conduct experiments to verify the effectiveness of the method in different practical applications. The experimental results showed that the proposed method can achieve higher accuracies and more tie points than traditional feature-based methods.<\/jats:p>","DOI":"10.3390\/rs13173425","type":"journal-article","created":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T21:59:45Z","timestamp":1630447185000},"page":"3425","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["An Image Registration Method Using Deep Residual Network Features for Multisource High-Resolution Remote Sensing Images"],"prefix":"10.3390","volume":"13","author":[{"given":"Xin","family":"Zhao","sequence":"first","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"College of Geodesy and Geomatics, Shandong University of Science and Technology, Qingdao 266590, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3565-1773","authenticated-orcid":false,"given":"Hui","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Hainan Key Laboratory of Earth Observation, Sanya 572029, China"}]},{"given":"Ping","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Geodesy and Geomatics, Shandong University of Science and Technology, Qingdao 266590, China"}]},{"given":"Linhai","family":"Jing","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Hainan Key Laboratory of Earth Observation, Sanya 572029, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Li, K., Zhang, Y., Zhang, Z., and Lai, G. (2019). A coarse-to-fine registration strategy for multi-sensor images with large resolution differences. Remote Sens., 11.","DOI":"10.3390\/rs11040470"},{"key":"ref_2","first-page":"34","article-title":"ICA-ASIFT-based multi-temporal matching of high-resolution remote sensing urban images","volume":"16","author":"Huang","year":"2016","journal-title":"Cybern. Inf. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1716","DOI":"10.1109\/LGRS.2016.2605304","article-title":"A robust point-matching algorithm based on integrated spatial structure constraint for remote sensing image registration","volume":"13","author":"Jiang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4834","DOI":"10.1109\/TGRS.2019.2893310","article-title":"A novel two-step registration method for remote sensing images based on deep and local features","volume":"57","author":"Ma","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","first-page":"2","article-title":"Advances and opportunities in remote sensing image geometric registration: A systematic review of state-of-the-art approaches and future research directions","volume":"3","author":"Feng","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4328","DOI":"10.1109\/TGRS.2013.2281391","article-title":"A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information","volume":"52","author":"Gong","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1007\/978-3-642-13681-8_13","article-title":"Remote sensing image registration techniques: A survey","volume":"Volume 6134","author":"Dawn","year":"2010","journal-title":"Proceedings of the International Conference on Image and Signal Processing"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"760","DOI":"10.3724\/SP.J.1004.2008.00760","article-title":"An improved optical flow method for image registration with large-scale movements","volume":"34","author":"Xiong","year":"2008","journal-title":"Acta Autom. Sin."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.image.2018.12.002","article-title":"A survey of variational and CNN-based optical flow techniques","volume":"72","author":"Tu","year":"2019","journal-title":"Signal Process. Image Commun."},{"key":"ref_10","unstructured":"Moravec, H.P. (1977, January 22\u201325). Towards automatic visual obstacle avoidance. Proceedings of the 5th International Joint Conference on Artificial Intelligence, Cambridge, MA, USA."},{"key":"ref_11","unstructured":"Harris, C.G., and Stephens, M.J. (September, January 31). A combined corner and edge detector. Proceedings of the 4th Alvey Vision Conference, Manchester, UK."},{"key":"ref_12","unstructured":"Shi, J., and Tomasi, C. (1994, January 21\u201323). Good features to track. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust feature (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/TPAMI.2008.275","article-title":"Faster and better: A machine learning approach to corner detection","volume":"32","author":"Rosten","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3244","DOI":"10.1109\/TGRS.2020.3008609","article-title":"Iterative scale-invariant feature transform for remote sensing image registration","volume":"59","author":"Chen","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1023\/B:VISI.0000027790.02288.f2","article-title":"Scale & affine invariant interest point detectors","volume":"60","author":"Mikolajczyk","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1109\/TPAMI.2012.167","article-title":"Jiont depth map and color consistency estimation for stereo images with different illuminations and cameras","volume":"35","author":"Heo","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","unstructured":"Huang, X., Sun, Y., Metaxas, D., Sauer, F., and Xu, C. (July, January 27). Hybrid image registration based on configural matching of scale-invariant salient region features. Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPR), Washington, DC, USA."},{"key":"ref_20","unstructured":"Hong, G., and Zhang, Y. (2007, January 23\u201328). Combination of feature-based and area-based image registration technique for high resolution remote sensing image. Proceedings of the 2007 IEEE International Geoscience and Remote Sensing Symposium (IGASS), Barcelona, Spain."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"053553","DOI":"10.1117\/1.3643693","article-title":"High-resolution multispectral satellite image matching using scale invariant feature transform and speeded up robust features","volume":"5","author":"Teke","year":"2011","journal-title":"J. Appl. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1109\/LGRS.2014.2343471","article-title":"An efficient SIFT-based mode-seeking algorithm for sub-pixel registration of remotely sensed images","volume":"12","author":"Kupfer","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","first-page":"101","article-title":"Fast image matching algorithm based on Harris corner point and SIFT","volume":"45","author":"Zhao","year":"2019","journal-title":"J. Lanzhou Univ. Technol."},{"key":"ref_24","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1016\/j.sigpro.2016.05.021","article-title":"A practical guide to CNNs and Fisher Vectors for image instance retrieval","volume":"128","author":"Chandrasekhar","year":"2016","journal-title":"Signal Process."},{"key":"ref_26","first-page":"406","article-title":"Retrieval of remote sensing images based on semisupervised deep learning","volume":"21","author":"Zhang","year":"2017","journal-title":"J. Remote Sens."},{"key":"ref_27","first-page":"248","article-title":"Convolutional neural network based multi-band ship target recognition with feature fusion","volume":"37","author":"Liu","year":"2017","journal-title":"Acta Opt. Sin."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lee, W., Sim, D., and Oh, S.J. (2021). A CNN-based high-accuracy registration for remote sensing images. Remote Sens., 13.","DOI":"10.3390\/rs13081482"},{"key":"ref_29","unstructured":"Han, X., Leung, T., Jia, Y., Sukthankar, R., and Berg, A.C. (2015, January 7\u201312). MatchNet: Unifying feature and metric learning for patch-based matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 7\u201312). Learning to compare image patches via Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yang, T.Y., Hsu, J.H., Lin, Y.Y., and Chuang, Y.Y. (2017, January 22\u201329). Deepcd: Learning deep complementary descriptors for patch representations. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.359"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4190","DOI":"10.1109\/TIP.2012.2199124","article-title":"Second-order optimization of mutual information for real-time image registration","volume":"21","author":"Dame","year":"2012","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus-a paradigm for model-fitting with applications to image-analysis and automated cartography","volume":"24","author":"Fischiled","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_34","first-page":"630","article-title":"Identity mappings in deep residual networks","volume":"Volume 9908","author":"He","year":"2016","journal-title":"Lecture Notes in Computer Science, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11\u201314 October 2016"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhao, X., Li, H., Wang, P., and Jing, L. (2020). An image registration method for multisource high-resolution remote sensing images for earthquake disaster assessment. Sensors, 20.","DOI":"10.3390\/s20082286"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.isprsjprs.2017.12.012","article-title":"A deep learning framework for remote sensing image registration","volume":"145","author":"Wang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_37","first-page":"3320","article-title":"How transferable are features in deep neural networks?","volume":"Volume 2","author":"Yosinski","year":"2014","journal-title":"Proceedings of the 27th International Conference on Neural Information Processing Systems"},{"key":"ref_38","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2014, January 8\u201313). ImageNet classification with deep convolutional neural networks. Proceedings of the 27th International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1300","DOI":"10.1109\/LGRS.2016.2582528","article-title":"Remote sensing optical image registration using modified uniform robust SIFT","volume":"13","author":"Paul","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/LGRS.2008.2012441","article-title":"Measures for an objective evaluation of the geometric correction process quality","volume":"6","author":"Goncalves","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/17\/3425\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:54:45Z","timestamp":1760165685000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/17\/3425"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,29]]},"references-count":41,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["rs13173425"],"URL":"https:\/\/doi.org\/10.3390\/rs13173425","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,29]]}}}