{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T15:07:51Z","timestamp":1778080071754,"version":"3.51.4"},"reference-count":37,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,11]],"date-time":"2023-03-11T00:00:00Z","timestamp":1678492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007928","name":"NINGBO MUNICIPAL BUREAU OF SCIENCE AND TECHNOLOGY","doi-asserted-by":"publisher","award":["2021Z037"],"award-info":[{"award-number":["2021Z037"]}],"id":[{"id":"10.13039\/501100007928","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>This study aimed to achieve the accurate and real-time geographic positioning of UAV aerial image targets. We verified a method of registering UAV camera images on a map (with the geographic location) through feature matching. The UAV is usually in rapid motion and involves changes in the camera head, and the map is high-resolution and has sparse features. These reasons make it difficult for the current feature-matching algorithm to accurately register the two (camera image and map) in real time, meaning that there will be a large number of mismatches. To solve this problem, we used the SuperGlue algorithm, which has a better performance, to match the features. The layer and block strategy, combined with the prior data of the UAV, was introduced to improve the accuracy and speed of feature matching, and the matching information obtained between frames was introduced to solve the problem of uneven registration. Here, we propose the concept of updating map features with UAV image features to enhance the robustness and applicability of UAV aerial image and map registration. After numerous experiments, it was proved that the proposed method is feasible and can adapt to the changes in the camera head, environment, etc. The UAV aerial image is stably and accurately registered on the map, and the frame rate reaches 12 frames per second, which provides a basis for the geo-positioning of UAV aerial image targets.<\/jats:p>","DOI":"10.3390\/jimaging9030067","type":"journal-article","created":{"date-parts":[[2023,3,13]],"date-time":"2023-03-13T06:09:56Z","timestamp":1678687796000},"page":"67","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A Real-Time Registration Algorithm of UAV Aerial Images Based on Feature Matching"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-1020-897X","authenticated-orcid":false,"given":"Zhiwen","family":"Liu","sequence":"first","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China"},{"name":"Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gen","family":"Xu","sequence":"additional","affiliation":[{"name":"Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiangjian","family":"Xiao","sequence":"additional","affiliation":[{"name":"Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingxiang","family":"Yang","sequence":"additional","affiliation":[{"name":"Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ziyang","family":"Wang","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China"},{"name":"Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siyuan","family":"Cheng","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, Ningbo University, Ningbo 315211, China"},{"name":"Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MCOM.2017.1600238CM","article-title":"UAV-enabled intelligent transportation systems for the smart city: Applications and challenges","volume":"55","author":"Menouar","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Tsouros, D.C., Bibi, S., and Sarigiannidis, P.G. (2019). A review on UAV-based applications for precision agriculture. Information, 10.","DOI":"10.3390\/info10110349"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.12989\/sss.2014.13.6.1065","article-title":"A review of rotorcraft unmanned aerial vehicle (UAV) developments and applications in civil engineering","volume":"13","author":"Liu","year":"2014","journal-title":"Smart Struct. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, S. (2017). A Review of Feature Detection and Match Algorithms for Localization and Mapping, IOP Publishing. IOP Conference Series: Materials Science and Engineering.","DOI":"10.1088\/1757-899X\/231\/1\/012003"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.isprsjprs.2017.03.017","article-title":"An accelerated image matching technique for UAV orthoimage registration","volume":"128","author":"Tsai","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1109\/LGRS.2008.2011751","article-title":"Robust scale-invariant feature matching for remote sensing image registration","volume":"6","author":"Li","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote sensing image registration with modified SIFT and enhanced feature matching","volume":"14","author":"Ma","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sarlin, P.-E., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020, January 13\u201319). Superglue: Learning feature matching with graph neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00499"},{"key":"ref_9","first-page":"1150","article-title":"Object recognition from local scale-invariant features","volume":"Volume 2","author":"Lowe","year":"2002","journal-title":"Proceedings of the Seventh IEEE International Conference on Computer Vision"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_12","unstructured":"Viswanathan, D.G. (2009, January 6\u20138). Features from accelerated segment test (fast). Proceedings of the 10th Workshop on Image Analysis for Multimedia Interactive Services, London, UK."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). Brief: Binary robust independent elementary features. Proceedings of the European Conference on Computer Vision, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"025002","DOI":"10.1117\/1.JRS.12.025002","article-title":"Unmanned aerial vehicle oblique image registration using an ASIFT-based matching method","volume":"12","author":"Wang","year":"2018","journal-title":"J. Appl. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"95411","DOI":"10.1109\/ACCESS.2022.3204657","article-title":"Farmland Aerial Images Fast-Stitching Method and Application Based on Improved SIFT Algorithm","volume":"10","author":"Liu","year":"2022","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wu, T., Hung, I., Xu, H., Yang, L., Wang, Y., Fang, L., and Lou, X. (2022). An Optimized SIFT-OCT Algorithm for Stitching Aerial Images of a Loblolly Pine Plantation. Forests, 13.","DOI":"10.3390\/f13091475"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Goh, J.N., Phang, S.K., and Chew, W.J. (2021). Real-Time and Automatic Map Stitching through Aerial Images from UAV, IOP Publishing. Journal of Physics: Conference Series.","DOI":"10.1088\/1742-6596\/2120\/1\/012025"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xiong, P., Liu, X., Gao, C., Zhou, Z., Gao, C., and Liu, Q. (2013, January 22\u201323). A real-time stitching algorithm for UAV aerial images. Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013), Hangzhou, China.","DOI":"10.2991\/iccsee.2013.405"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, G., Qin, D., Yang, J., Yan, M., Tang, H., Bie, H., and Ma, L. (2022). UAV Low-Altitude Aerial Image Stitching Based on Semantic Segmentation and ORB Algorithm for Urban Traffic. Remote Sens., 14.","DOI":"10.3390\/rs14236013"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3349","DOI":"10.1109\/TPAMI.2020.2983686","article-title":"Deep high-resolution representation learning for visual recognition","volume":"43","author":"Wang","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2375","DOI":"10.1007\/s11263-021-01465-9","article-title":"OCNet: Object context for semantic segmentation","volume":"129","author":"Yuan","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"16573","DOI":"10.1007\/s11042-019-7729-7","article-title":"Automated accurate registration method between UAV image and Google satellite map","volume":"79","author":"Yuan","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_25","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhuo, X., Koch, T., Kurz, F., and Fraundorfer, F. (2017). Automatic UAV image geo-registration by matching UAV images to georeferenced image data. Remote Sens., 9.","DOI":"10.3390\/rs9040376"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lin, Y., and Medioni, G. (2007, January 17\u201322). Map-enhanced UAV image sequence registration and synchronization of multiple image sequences. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383428"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Nassar, A., Amer, K., ElHakim, R., and ElHelw, M. (2018, January 18\u201322). A deep CNN-based framework for enhanced aerial imagery registration with applications to UAV geolocalization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00201"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, F., and Liu, F. (2014, January 23\u201328). Parallax-tolerant image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.423"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"7027","DOI":"10.1109\/TGRS.2020.3025528","article-title":"Drone Image Stitching Using Local Mesh-Based Bundle Adjustment and Shape-Preserving Transform","volume":"59","author":"Wan","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, J., Li, Z.-C., Peng, C., Wang, Y., and Gong, W. (2022). UAV Image Stitching Based on Optimal Seam and Half-Projective Warp. Remote Sens., 14.","DOI":"10.3390\/rs14051068"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18\u201322). Superpoint: Self-supervised interest point detection and description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/TNN.2008.2005605","article-title":"The graph neural network model","volume":"20","author":"Scarselli","year":"2008","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_34","unstructured":"Mnih, V., Heess, N., Graves, A., and Kavukcuoglu, K. (2014). Recurrent models of visual attention. arXiv."},{"key":"ref_35","unstructured":"Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., and Uszkoreit, J. (2021). Mlp-mixer: An all-mlp architecture for vision. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Jakubovi\u0107, A., and Velagi\u0107, J. (2018, January 16\u201319). Image feature matching and object detection using brute-force matchers. Proceedings of the International Symposium ELMAR, Zadar, Croatia.","DOI":"10.23919\/ELMAR.2018.8534641"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/3\/67\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:52:50Z","timestamp":1760122370000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/3\/67"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,11]]},"references-count":37,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["jimaging9030067"],"URL":"https:\/\/doi.org\/10.3390\/jimaging9030067","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,11]]}}}