{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T22:05:38Z","timestamp":1768773938144,"version":"3.49.0"},"reference-count":51,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2022,10,26]],"date-time":"2022-10-26T00:00:00Z","timestamp":1666742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Environmental Research and Technology Development Fund of the Environmental Restoration and Conservation Agency of Japan","award":["JPMEERF20S11811"],"award-info":[{"award-number":["JPMEERF20S11811"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The vast digital archives collected by optical remote sensing observations over a long period of time can be used to determine changes in the land surface and this information can be very useful in a variety of applications. However, accurate change extraction requires highly accurate image-to-image registration, which is especially true when the target is urban areas in high-resolution remote sensing images. In this paper, we propose a new method for automatic registration between images that can be applied to noisy images such as old aerial photographs taken with analog film, in the case where changes in man-made objects such as buildings in urban areas are extracted from multitemporal high-resolution remote sensing images. The proposed method performs image-to-image registration by applying template matching to road masks extracted from images using a two-step deep learning model. We applied the proposed method to multitemporal images, including images taken more than 36 years before the reference image. As a result, the proposed method achieved registration accuracy at the subpixel level, which was more accurate than the conventional area-based and feature-based methods, even for image pairs with the most distant acquisition times. The proposed method is expected to provide more robust image-to-image registration for differences in sensor characteristics, acquisition time, resolution and color tone of two remote sensing images, as well as to temporal variations in vegetation and the effects of building shadows. These results were obtained with a road extraction model trained on images from a single area, single time period and single platform, demonstrating the high versatility of the model. Furthermore, the performance is expected to be improved and stabilized by using images from different areas, time periods and platforms for training.<\/jats:p>","DOI":"10.3390\/rs14215360","type":"journal-article","created":{"date-parts":[[2022,10,26]],"date-time":"2022-10-26T07:17:48Z","timestamp":1666768668000},"page":"5360","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Image-to-Image Subpixel Registration Based on Template Matching of Road Network Extracted by Deep Learning"],"prefix":"10.3390","volume":"14","author":[{"given":"Shuhei","family":"Hikosaka","sequence":"first","affiliation":[{"name":"Graduate School of Science and Engineering, Ibaraki University, Hitachi 3168511, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4866-5955","authenticated-orcid":false,"given":"Hideyuki","family":"Tonooka","sequence":"additional","affiliation":[{"name":"Graduate School of Science and Engineering, Ibaraki University, Hitachi 3168511, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.landurbplan.2005.10.002","article-title":"Monitoring and Predicting Land Use Change in Beijing Using Remote Sensing and GIS","volume":"78","author":"Wu","year":"2006","journal-title":"Landsc. Urban Plan."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1063","DOI":"10.1080\/0143116031000156792","article-title":"Monitoring of Urban Growth of a Desert City through Remote Sensing: Al-Ain, UAE, between 1976 and 2000","volume":"25","author":"Yagoub","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.ijsbe.2015.02.005","article-title":"Monitoring Urban Growth and Land Use Change Detection with GIS and Remote Sensing Techniques in Daqahlia Governorate Egypt","volume":"4","author":"Hegazy","year":"2015","journal-title":"Int. J. Sustain. Built Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2876","DOI":"10.1109\/JPROC.2012.2196404","article-title":"Remote Sensing and Earthquake Damage Assessment: Experiences, Limits, and Perspectives","volume":"100","author":"Gamba","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ceresola, S., Fusiello, A., Bicego, M., Belussi, A., and Murino, V. (2005, January 6\u20138). Automatic Updating of Urban Vector Maps. Proceedings of the Image Analysis and Processing\u2014ICIAP 2005, Cagliari, Italy.","DOI":"10.1007\/11553595_139"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.isprsjprs.2009.10.002","article-title":"Automatic Change Detection of Buildings in Urban Environment from Very High Spatial Resolution Images Using Existing Geodatabase and Prior Knowledge","volume":"65","author":"Bouziani","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.3390\/rs2051217","article-title":"Automatic Detection of Buildings and Changes in Buildings for Updating of Maps","volume":"2","author":"Matikainen","year":"2010","journal-title":"Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1242","DOI":"10.1016\/j.proeng.2015.08.476","article-title":"A Rapid Seismic Risk Assessment Method for Existing Building Stock in Urban Areas","volume":"118","author":"Albayrak","year":"2015","journal-title":"Procedia Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1177\/8755293019878137","article-title":"Classifying Earthquake Damage to Buildings Using Machine Learning","volume":"36","author":"Mangalathu","year":"2020","journal-title":"Earthq. Spectra"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/S0034-4257(02)00029-9","article-title":"Radiometric Normalization of Multitemporal High-Resolution Satellite Images with Quality Control for Land Cover Change Detection","volume":"82","author":"Du","year":"2002","journal-title":"Remote Sens. Environ."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2365","DOI":"10.1080\/0143116031000139863","article-title":"Change Detection Techniques","volume":"25","author":"Lu","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4434","DOI":"10.1080\/01431161.2011.648285","article-title":"Object-Based Change Detection","volume":"33","author":"Chen","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.isprsjprs.2013.03.006","article-title":"Change Detection from Remotely Sensed Images: From Pixel-Based to Object-Based Approaches","volume":"80","author":"Hussain","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1109\/LGRS.2012.2228626","article-title":"Fault-Tolerant Building Change Detection From Urban High-Resolution Remote Sensing Imagery","volume":"10","author":"Tang","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.14358\/PERS.71.9.1037","article-title":"Image Misregistration Error in Change Measurements","volume":"71","author":"Wang","year":"2005","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"6883","DOI":"10.1080\/01431161.2013.810353","article-title":"Analysis of Spatial Distribution Pattern of Change-Detection Error Caused by Misregistration","volume":"34","author":"Shi","year":"2013","journal-title":"Int. J. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.isprsjprs.2013.10.007","article-title":"Assessment of the Image Misregistration Effects on Object-Based Change Detection","volume":"87","author":"Chen","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/83.650848","article-title":"A Pyramid Approach to Subpixel Registration Based on Intensity","volume":"7","author":"Ruttimann","year":"1998","journal-title":"IEEE Trans. Image Process."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sarvaiya, J.N., Patnaik, S., and Bombaywala, S. (2009, January 28\u201329). Image Registration by Template Matching Using Normalized Cross-Correlation. Proceedings of the 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies, Trivandrum, India.","DOI":"10.1109\/ACT.2009.207"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1430","DOI":"10.1109\/TMI.2004.835313","article-title":"Intensity-Based Image Registration Using Robust Correlation Coefficients","volume":"23","author":"Kim","year":"2004","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1109\/TIP.2003.819237","article-title":"Multiresolution Registration of Remote Sensing Imagery by Optimization of Mutual Information Using a Stochastic Gradient","volume":"12","author":"Johnson","year":"2003","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","first-page":"1925","article-title":"High-Accuracy Subpixel Image Registration Based on Phase-Only Correlation","volume":"86","author":"Takita","year":"2003","journal-title":"IEICE TRANSACTIONS Fundam. Electron. Commun. Comput. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nagashima, S., Aoki, T., Higuchi, T., and Kobayashi, K. (2006, January 12\u201315). A Subpixel Image Matching Technique Using Phase-Only Correlation. Proceedings of the 2006 International Symposium on Intelligent Signal Processing and Communications, Yonago, Japan.","DOI":"10.1109\/ISPACS.2006.364751"},{"key":"ref_24","unstructured":"Miura, M., Sakai, S., Aoyama, S., Ishii, J., Ito, K., and Aoki, T. (2012, January 20\u201323). High-Accuracy Image Matching Using Phase-Only Correlation and Its Application. Proceedings of the 2012 Proceedings of SICE Annual Conference (SICE), Akita, Japan."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Takenaka, H., Sakashita, T., Higuchi, A., and Nakajima, T. (2020). Geolocation Correction for Geostationary Satellite Observations by a Phase-Only Correlation Method Using a Visible Channel. Remote Sens., 12.","DOI":"10.3390\/rs12152472"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rasmy, L., Sebari, I., and Ettarid, M. (2021). Automatic Sub-Pixel Co-Registration of Remote Sensing Images Using Phase Correlation and Harris Detector. Remote Sens., 13.","DOI":"10.3390\/rs13122314"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1016\/j.cageo.2007.10.005","article-title":"A Fast and Fully Automatic Registration Approach Based on Point Features for Multi-Source Remote-Sensing Images","volume":"34","author":"Yu","year":"2008","journal-title":"Comput. Geosci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/j.procs.2016.07.224","article-title":"Image Registration of Satellite Images with Varying Illumination Level Using HOG Descriptor Based SURF","volume":"93","author":"Patel","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9059","DOI":"10.1109\/TGRS.2019.2924684","article-title":"Fast and Robust Matching for Multimodal Remote Sensing Image Registration","volume":"57","author":"Ye","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object Recognition from Local Scale-Invariant Features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_31","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of Oriented Gradients for Human Detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Hasan, M., Jia, X., Robles-Kelly, A., Zhou, J., and Pickering, M.R. (2010, January 25\u201330). Multi-Spectral Remote Sensing Image Registration via Spatial Relationship Analysis on Sift Keypoints. Proceedings of the 2010 IEEE International Geoscience and Remote Sensing Symposium, Honolulu, HI, USA.","DOI":"10.1109\/IGARSS.2010.5653482"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"177","DOI":"10.14358\/PERS.86.4.177","article-title":"Reducing Shadow Effects on the Co-Registration of Aerial Image Pairs","volume":"86","author":"Plummer","year":"2020","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1688","DOI":"10.1109\/JSTARS.2013.2273871","article-title":"Automatic Line Segment Registration Using Gaussian Mixture Model and Expectation-Maximization Algorithm","volume":"7","author":"Long","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_35","unstructured":"Yu, Z., Prinet, V., Pan, C., and Chen, P. (2004, January 24\u201327). A Novel Two-Steps Strategy for Automatic GIS-Image Registration. Proceedings of the 2004 International Conference on Image Processing, ICIP \u201904, Singapore."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Qu, Z., Gao, Y., Wang, P., Wang, P., Chen, X., Luo, F., and Shen, Z. (2011, January 10\u201312). Straight-Line Based Image Registration in Hough Parameter Space. Proceedings of the 2011 International Workshop on Multi-Platform\/Multi-Sensor Remote Sensing and Mapping, Xiamen, China.","DOI":"10.1109\/M2RSM.2011.5697410"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_39","unstructured":"Nair, V., and Hinton, G.E. (2010, January 21\u201324). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the Proceedings of the 27th International Conference on International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_40","first-page":"1929","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_41","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_42","unstructured":"Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017, January 4\u20139). Attention Is All You Need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Popel, M., and Bojar, O. (2018). Training Tips for the Transformer Model. arXiv.","DOI":"10.2478\/pralin-2018-0002"},{"key":"ref_44","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Association for Computational Linguistics."},{"key":"ref_45","unstructured":"Liu, L., Jiang, H., He, P., Chen, W., Liu, X., Gao, J., and Han, J. (2019). On the Variance of the Adaptive Learning Rate and Beyond. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_47","unstructured":"Friemel, B.H., Bohs, L.N., and Trahey, G.E. (1995, January 7\u201310). Relative Performance of Two-Dimensional Speckle-Tracking Techniques: Normalized Correlation, Non-Normalized Correlation and Sum-Absolute-Difference. Proceedings of the 1995 IEEE Ultrasonics Symposium. Proceedings. An International Symposium, Seattle, WA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/scj.10506","article-title":"Significance and Attributes of Subpixel Estimation on Area-Based Matching","volume":"34","author":"Shimizu","year":"2003","journal-title":"Syst. Comput. Jpn."},{"key":"ref_49","unstructured":"(2022, October 01). Geofabrik GmbH and OpenStreetMap Contributors Osm. Available online: http:\/\/download.geofabrik.de\/asia\/japan\/kanto.html."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1109\/LGRS.2018.2802944","article-title":"Road Extraction by Deep Residual U-Net","volume":"15","author":"Zhang","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/21\/5360\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:03:05Z","timestamp":1760144585000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/21\/5360"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,26]]},"references-count":51,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["rs14215360"],"URL":"https:\/\/doi.org\/10.3390\/rs14215360","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,26]]}}}