{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T15:48:45Z","timestamp":1772552925088,"version":"3.50.1"},"reference-count":41,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,4,17]],"date-time":"2017-04-17T00:00:00Z","timestamp":1492387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Recent years have witnessed the fast development of UAVs (unmanned aerial vehicles). As an alternative to traditional image acquisition methods, UAVs bridge the gap between terrestrial and airborne photogrammetry and enable flexible acquisition of high resolution images. However, the georeferencing accuracy of UAVs is still limited by the low-performance on-board GNSS and INS. This paper investigates automatic geo-registration of an individual UAV image or UAV image blocks by matching the UAV image(s) with a previously taken georeferenced image, such as an individual aerial or satellite image with a height map attached or an aerial orthophoto with a DSM (digital surface model) attached. As the biggest challenge for matching UAV and aerial images is in the large differences in scale and rotation, we propose a novel feature matching method for nadir or slightly tilted images. The method is comprised of a dense feature detection scheme, a one-to-many matching strategy and a global geometric verification scheme. The proposed method is able to find thousands of valid matches in cases where SIFT and ASIFT fail. Those matches can be used to geo-register the whole UAV image block towards the reference image data. When the reference images offer high georeferencing accuracy, the UAV images can also be geolocalized in a global coordinate system. A series of experiments involving different scenarios was conducted to validate the proposed method. The results demonstrate that our approach achieves not only decimeter-level registration accuracy, but also comparable global accuracy as the reference images.<\/jats:p>","DOI":"10.3390\/rs9040376","type":"journal-article","created":{"date-parts":[[2017,4,18]],"date-time":"2017-04-18T11:22:04Z","timestamp":1492514524000},"page":"376","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":55,"title":["Automatic UAV Image Geo-Registration by Matching UAV Images to Georeferenced Image Data"],"prefix":"10.3390","volume":"9","author":[{"given":"Xiangyu","family":"Zhuo","sequence":"first","affiliation":[{"name":"Remote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2988-982X","authenticated-orcid":false,"given":"Tobias","family":"Koch","sequence":"additional","affiliation":[{"name":"Remote Sensing Technology, Technische Universit\u00e4t M\u00fcnchen, 80333 Munich, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1718-0004","authenticated-orcid":false,"given":"Franz","family":"Kurz","sequence":"additional","affiliation":[{"name":"Remote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5805-8892","authenticated-orcid":false,"given":"Friedrich","family":"Fraundorfer","sequence":"additional","affiliation":[{"name":"Remote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, Germany"},{"name":"Institute for Computer Graphics and Vision, Graz University of Technology, 8010 Graz, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8122-1475","authenticated-orcid":false,"given":"Peter","family":"Reinartz","sequence":"additional","affiliation":[{"name":"Remote Sensing Technology Institute, German Aerospace Center, 82234 Wessling, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2017,4,17]]},"reference":[{"key":"ref_1","unstructured":"Eisenbei\u00df, H. (2009). UAV Photogrammetry. [Ph.D. Thesis, Institute of Geodesy and Photogrammetry]."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12518-013-0120-x","article-title":"UAV for 3D mapping applications: A review","volume":"6","author":"Nex","year":"2014","journal-title":"Appl. Geomat."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.isprsjprs.2014.02.013","article-title":"Unmanned aerial systems for photogrammetry and remote sensing: A review","volume":"92","author":"Colomina","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chiabrando, F., Lingua, A., and Piras, M. (2013). Direct photogrammetry using UAV: Tests and first results. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci., 81\u201386.","DOI":"10.5194\/isprsarchives-XL-1-W2-81-2013"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1127\/1432-8364\/2010\/0042","article-title":"DGPF-Project: Evaluation of Digital Photogrammetric Camera Systems Geometric Performance","volume":"2010","author":"Jacobsen","year":"2010","journal-title":"Photogramm. Fernerkund. Geoinf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.isprsjprs.2014.06.001","article-title":"Direct georeferencing of oblique and vertical imagery in different coordinate systems","volume":"95","author":"Zhao","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"33","DOI":"10.5194\/isprsarchives-XXXIX-B8-33-2012","article-title":"Low-cost optical camera system for disaster monitoring","volume":"39","author":"Kurz","year":"2012","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_9","first-page":"189","article-title":"Performance of a real-time sensor and processing system on a helicopter","volume":"XL-1","author":"Kurz","year":"2014","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_10","unstructured":"(2017, February 10). Vexcel UltraCam. Available online: http:\/\/www.vexcel-imaging.com\/."},{"key":"ref_11","unstructured":"(2017, February 10). Vexcel UltraNav. Available online: http:\/\/www.vexcel-imaging.com\/wp-content\/uploads\/2016\/09\/BrochureUltraNav.pdf."},{"key":"ref_12","unstructured":"Verhoeven, G., Wieser, M., Briese, C., and Doneus, M. (2013, January 2\u20136). Positioning in time and space: Cost-effective exterior orientation for airborne archaeological photographs. Proceedings of the 24th International CIPA Symposium (ISPRS), Strasbourg, France."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gerke, M., and Przybilla, H.J. (2016). Accuracy analysis of photogrammetric UAV image blocks: Influence of onboard RTK-GNSS and cross flight patterns. Photogramm. Fernerkund. Geoinf.","DOI":"10.1127\/pfg\/2016\/0284"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"977","DOI":"10.1016\/S0262-8856(03)00137-9","article-title":"Image registration methods: A survey","volume":"21","author":"Flusser","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). Brief: Binary robust independent elementary features. Proceedings of the European Conference on Computer Vision, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1281","DOI":"10.1109\/TPAMI.2011.222","article-title":"BRIEF: Computing a local binary descriptor very fast","volume":"34","author":"Calonder","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/TPAMI.2008.275","article-title":"Faster and better: A machine learning approach to corner detection","volume":"32","author":"Rosten","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Heinly, J., Dunn, E., and Frahm, J.M. (2012). Comparative evaluation of binary features. Computer Vision\u2014ECCV 2012, Springer.","DOI":"10.1007\/978-3-642-33709-3_54"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bekele, D., Teutsch, M., and Schuchert, T. (2013, January 15\u201318). Evaluation of binary keypoint descriptors. Proceedings of the 2013 20th IEEE International Conference on Image Processing (ICIP), Melbourne, Australia.","DOI":"10.1109\/ICIP.2013.6738753"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Dwarakanath, D., Eichhorn, A., Halvorsen, P., and Griwodz, C. (2012, January 26\u201328). Evaluating performance of feature extraction methods for practical 3D imaging systems. Proceedings of the 27th Conference on Image and Vision Computing New Zealand, Dunedin, New Zealand.","DOI":"10.1145\/2425836.2425887"},{"key":"ref_23","first-page":"143","article-title":"A comparison of sift, pca-sift and surf","volume":"3","author":"Juan","year":"2009","journal-title":"Int. J. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Alcantarilla, P.F., Bartoli, A., and Davison, A.J. (2012, January 7\u201313). KAZE features. Proceedings of the European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33783-3_16"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"11","DOI":"10.5201\/ipol.2011.my-asift","article-title":"ASIFT: An algorithm for fully affine invariant comparison","volume":"1","author":"Yu","year":"2011","journal-title":"Image Process. On Line"},{"key":"ref_26","first-page":"47","article-title":"Evaluation of feature-based methods for automated network orientation","volume":"40","author":"Apollonio","year":"2014","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Conte, G., and Doherty, P. (2009). Vision-based unmanned aerial vehicle navigation using geo-referenced information. EURASIP J. Adv. Signal Process.","DOI":"10.1155\/2009\/387308"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Fan, B., Du, Y., Zhu, L., and Tang, Y. (2010, January 10\u201312). The registration of UAV down-looking aerial images to satellite images with image entropy and edges. Proceedings of the International Conference on Intelligent Robotics and Applications, Shanghai, China.","DOI":"10.1007\/978-3-642-16584-9_59"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Cui, Y., Belongie, S., and Hays, J. (2015, January 7\u201312). Learning deep representations for ground-to-aerial geolocalization. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299135"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1109\/3DV.2014.69","article-title":"Accurate geo-registration by ground-to-aerial image matching","volume":"Volume 1","author":"Shan","year":"2014","journal-title":"Proceedings of the 2014 2nd International Conference on 3D Vision"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1002\/rob.21585","article-title":"Air-ground matching: Appearance-based GPS-denied urban localization of micro aerial vehicles","volume":"32","author":"Majdik","year":"2015","journal-title":"J. Field Robot."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"779","DOI":"10.3390\/rs8090779","article-title":"An image-Based approach for the co-Registration of multi-Temporal UAV image datasets","volume":"8","author":"Aicardi","year":"2016","journal-title":"Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Xu, Y., Ou, J., He, H., Zhang, X., and Mills, J. (2016). Mosaicking of Unmanned Aerial Vehicle Imagery in the Absence of Camera Poses. Remote Sens., 8.","DOI":"10.3390\/rs8030204"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"83","DOI":"10.5194\/isprs-annals-III-3-83-2016","article-title":"A new paradigm for matching UAV-and aerial images","volume":"3","author":"Koch","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhuo, X., Cui, S., Kurz, F., and Reinartz, P. (20166, January 10\u201315). Fusion and classification of aerial images from MAVS and airplanes for local information enrichment. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729924"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC superpixels compared to state-of-the-art superpixel methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","unstructured":"D\u2019Angelo, P., and Reinartz, P. (2011, January 14\u201317). Semiglobal matching results on the ISPRS stereo matching benchmark. Proceedings of the ISPRS Hannover Workshop 2011: High-Resolution Earth Imaging for Geospatial Information, Hannover, Germany."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo processing by semiglobal matching and mutual information","volume":"30","author":"Hirschmuller","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Koch, T., d\u2019Angelo, P., Kurz, F., Fraundorfer, F., Reinartz, P., and Korner, M. (2016, January 27\u201330). The TUM-DLR multimodal earth observation evaluation benchmark. Proceedings of the The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW.2016.92"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0924-2716(02)00124-7","article-title":"The shuttle radar topography mission-a new class of digital elevation models acquired by spaceborne radar","volume":"57","author":"Rabus","year":"2003","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_41","unstructured":"Rothermel, M., Wenzel, K., Fritsch, D., and Haala, N. (2012, January 4\u20135). SURE: Photogrammetric surface reconstruction from imagery. Proceedings of the LC3D Workshop, Berlin, Germany."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/4\/376\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:32:51Z","timestamp":1760207571000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/9\/4\/376"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,4,17]]},"references-count":41,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,4]]}},"alternative-id":["rs9040376"],"URL":"https:\/\/doi.org\/10.3390\/rs9040376","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,4,17]]}}}