{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T13:48:02Z","timestamp":1762868882550,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,12]],"date-time":"2022-08-12T00:00:00Z","timestamp":1660262400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41771479","50-H31D01-0508-13\/15"],"award-info":[{"award-number":["41771479","50-H31D01-0508-13\/15"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National High-Resolution Earth Observation System","award":["41771479","50-H31D01-0508-13\/15"],"award-info":[{"award-number":["41771479","50-H31D01-0508-13\/15"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Image tie point matching is an essential task in real aerial photogrammetry, especially for model tie points. In current photogrammetry production, SIFT is still the main matching algorithm because of the high robustness for most aerial image tie points matching. However, when there is a certain number of weak texture images in a surveying area (mountain, grassland, woodland, etc.), these models often lack tie points, resulting in the failure of building an airline network. Some studies have shown that the image matching method based on deep learning is better than the SIFT method and other traditional methods to some extent (even for weak texture images). Unfortunately, these methods are often only used in small images, and they cannot be directly applied to large image tie point matching in real photogrammetry. Considering the actual photogrammetry needs and motivated by the Block-SIFT and SuperGlue, this paper proposes a SuperGlue-based LR-Superglue matching method for large aerial image tie points matching, which makes learned image matching possible in photogrammetry application and promotes the photogrammetry towards artificial intelligence. Experiments on real and difficult aerial surveying areas show that LR-Superglue obtains more model tie points in forward direction (on average, there are 60 more model points in each model) and more image tie points between airline(on average, there are 36 more model points in each adjacent images). Most importantly, the LR-Superglue method requires a certain number of points between each adjacent model, while the Block-SIFT method made a few models have no tie points. At the same time, the relative orientation accuracy of the image tie points matched by the proposed method is significantly better than block-SIFT, which reduced from 3.64 \u03bcm to 2.85 \u03bcm on average in each model (the camera pixel is 4.6 \u03bcm).<\/jats:p>","DOI":"10.3390\/rs14163907","type":"journal-article","created":{"date-parts":[[2022,8,15]],"date-time":"2022-08-15T23:44:03Z","timestamp":1660607043000},"page":"3907","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Large Aerial Image Tie Point Matching in Real and Difficult Survey Areas via Deep Learning Method"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3487-282X","authenticated-orcid":false,"given":"Xiuliu","family":"Yuan","sequence":"first","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}]},{"given":"Xiuxiao","family":"Yuan","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7825-6194","authenticated-orcid":false,"given":"Jun","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}]},{"given":"Xunping","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,12]]},"reference":[{"unstructured":"Yao, W. (1997). Autocorrelation Techniques for Soft Photogrammetry. [Ph.D. Thesis, Iowa State University].","key":"ref_1"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1111\/j.1477-9730.1984.tb00505.x","article-title":"Digital image correlation: Performance and potential application in photogrammetry","volume":"11","author":"Ackermann","year":"1984","journal-title":"Photogramm. Rec."},{"unstructured":"Moravec, H.P. (1981, January 24\u201328). Rover Visual Obstacle Avoidance. Proceedings of the 7th International Joint Conference on Artificial Intelligence, IJCAI \u201981, Vancouver, BC, Canada.","key":"ref_3"},{"unstructured":"F\u00f6rstner, W., and G\u00fclch, E. (1987, January 2\u20134). A fast operator for detection and precise location of distinct points, corners and centres of circular features. Proceedings of the ISPRS Intercommission Conference on Fast Processing of Photogrammetric Data, Interlaken, Switzerland.","key":"ref_4"},{"unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK.","key":"ref_5"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 7\u201313). Machine learning for high-speed corner detection. Proceedings of the ECCV 2006, 9th European Conference on Computer Vision, Graz, Austria.","key":"ref_8","DOI":"10.1007\/11744023_34"},{"doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 IEEE International Conference on Computer Vision, Barcelona, Spain.","key":"ref_9","DOI":"10.1109\/ICCV.2011.6126544"},{"unstructured":"Calonder, M., Lepetit, V., Vincent, S., Strecha, C., and Fua, P. (September, January 5\u2013). Brief: Binary robust independent elementary features. Proceedings of the European Conference on Computer Vision, Berlin\/Heidelberg, Germany.","key":"ref_10"},{"doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 IEEE International Conference on Computer Vision, Barcelona, Spain.","key":"ref_11","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.isprsjprs.2019.04.018","article-title":"Illumination-Robust remote sensing image matching based on oriented self-similarity","volume":"153","author":"Sedaghat","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"unstructured":"Ke, Y., and Sukthankar, R. (July, January 27). PCA-SIFT: A more distinctive representation for local image descriptors. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR, Washington, DC, USA.","key":"ref_13"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"ASIFT: A new framework for fully affine invariant image comparison","volume":"2","author":"Morel","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5283","DOI":"10.1109\/TGRS.2015.2420659","article-title":"Remote sensing image matching based on adaptive binning SIFT descriptor","volume":"53","author":"Sedaghat","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2014.02.001","article-title":"L2-SIFT: SIFT feature extraction and matching for large images in large-scale aerial photogrammetry","volume":"91","author":"Sun","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4516","DOI":"10.1109\/TGRS.2011.2144607","article-title":"Uniform robust scale-invariant feature matching for optical remote sensing images","volume":"49","author":"Sedaghat","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"unstructured":"Li, J., Hu, Q., and Ai, M. (2018). RIFT: Multi-modal image matching based on radiation-invariant feature transform. arXiv.","key":"ref_18"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"9059","DOI":"10.1109\/TGRS.2019.2924684","article-title":"Fast and robust matching for multimodal remote sensing image registration","volume":"57","author":"Ye","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2022.3157870","article-title":"Robust Feature Matching for Remote Sensing Image Registration via Guided Hyperplane Fitting","volume":"60","author":"Xiao","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Huang, X., Wan, X., and Peng, D. (2020). Robust feature matching with spatial smoothness constraints. Remote Sens., 12.","key":"ref_21","DOI":"10.3390\/rs12193158"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s11263-020-01359-2","article-title":"Image matching from handcrafted to deep features: A survey","volume":"129","author":"Ma","year":"2021","journal-title":"Int. J. Comput. Vis."},{"doi-asserted-by":"crossref","unstructured":"Jiang, W., Trulls, E., Hosang, J., Tagliasacchi, A., and Yi, K.M. (2021). COTR: Correspondence Transformer for Matching Across Images. arXiv.","key":"ref_23","DOI":"10.1109\/ICCV48922.2021.00615"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1007\/s11263-020-01385-0","article-title":"Image matching across wide baselines: From paper to practice","volume":"129","author":"Jin","year":"2021","journal-title":"Int. J. Comput. Vis."},{"doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 7\u201312). Learning to compare image patches via convolutional neural networks. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","key":"ref_25","DOI":"10.1109\/CVPR.2015.7299064"},{"doi-asserted-by":"crossref","unstructured":"He, H., Chen, M., Chen, T., and Li, D. (2018). Matching of remote sensing images with complex background variations via Siamese convolutional neural network. Remote Sens., 10.","key":"ref_26","DOI":"10.3390\/rs10020355"},{"unstructured":"Han, X., Leung, T., Jia, Y., Sukthankar, R., and Berg, A.C. (2015, January 7\u201312). Matchnet: Unifying feature and metric learning for patch-based matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","key":"ref_27"},{"doi-asserted-by":"crossref","unstructured":"Yi, K.M., Trulls, E., Lepetit, V., and Fua, P. (2016, January 11\u201314). Lift: Learned invariant feature transform. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","key":"ref_28","DOI":"10.1007\/978-3-319-46466-4_28"},{"doi-asserted-by":"crossref","unstructured":"Sarlin, P.E., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020, January 13\u201319). Superglue: Learning feature matching with graph neural networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","key":"ref_29","DOI":"10.1109\/CVPR42600.2020.00499"},{"doi-asserted-by":"crossref","unstructured":"Sun, J., Shen, Z., Wang, Y., Bao, H., and Zhou, X. (2021, January 20\u201325). LoFTR: Detector-free local feature matching with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","key":"ref_30","DOI":"10.1109\/CVPR46437.2021.00881"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1023\/A:1008097225773","article-title":"Edge detection and ridge detection with automatic scale selection","volume":"30","author":"Lindeberg","year":"1998","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.isprsjprs.2017.11.019","article-title":"Uniform competency-based local feature extraction for remote sensing images","volume":"135","author":"Sedaghat","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.isprsjprs.2020.11.002","article-title":"Robust line segment matching across views via ranking the line-point graph","volume":"171","author":"Wei","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.isprsjprs.2017.08.009","article-title":"Robust feature matching via support-line voting and affine-invariant ratios","volume":"132","author":"Li","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Dong, Y., Jiao, W., Long, T., Liu, L., He, G., Gong, C., and Guo, Y. (2019). Local deep descriptor for remote sensing image feature matching. Remote Sens., 11.","key":"ref_35","DOI":"10.3390\/rs11040430"},{"doi-asserted-by":"crossref","unstructured":"Yang, T.Y., Hsu, J.H., Lin, Y.Y., and Chuang, Y.Y. (2017, January 22\u201329). DeepCD: Learning deep complementary descriptors for patch representations. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","key":"ref_36","DOI":"10.1109\/ICCV.2017.359"},{"doi-asserted-by":"crossref","unstructured":"Luo, Z., Shen, T., Zhou, L., Zhu, S., Zhang, R., Yao, Y., Fang, T., and Quan, L. (2018, January 8\u201314). Geodesc: Learning local descriptors by integrating geometry constraints. Proceedings of the Computer Vision\u2014ECCV 2018\u201415th European Conference, Munich, Germany.","key":"ref_37","DOI":"10.1007\/978-3-030-01240-3_11"},{"unstructured":"Zhang, Z., and Lee, W.S. (November, January 27). Deep graphical feature learning for the feature matching problem. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea.","key":"ref_38"},{"unstructured":"Balntas, V., Johns, E., Tang, L., and Mikolajczyk, K. (2016). PN-Net: Conjoined triple deep network for learning local image descriptors. arXiv.","key":"ref_39"},{"doi-asserted-by":"crossref","unstructured":"Tian, Y., Fan, B., and Wu, F. (2017, January 21\u201326). L2-Net: Deep learning of discriminative patch descriptor in euclidean space. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","key":"ref_40","DOI":"10.1109\/CVPR.2017.649"},{"doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18\u201322). Superpoint: Self-supervised interest point detection and description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","key":"ref_41","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"ref_42","first-page":"1","article-title":"A Hierarchical Consensus Attention Network for Feature Matching of Remote Sensing Images","volume":"60","author":"Chen","year":"2022","journal-title":"ISPRS J. IEEE Trans. Geosci. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2853","DOI":"10.1109\/TNNLS.2018.2888757","article-title":"A novel neural network for remote sensing image matching","volume":"30","author":"Zhu","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.isprsjprs.2017.12.012","article-title":"A deep learning framework for remote sensing image registration","volume":"145","author":"Wang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_45","first-page":"1","article-title":"A multiscale framework with unsupervised learning for remote sensing image registration","volume":"60","author":"Ye","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_46","first-page":"1","article-title":"Unsupervised SAR and Optical Image Matching Using Siamese Domain Adaptation","volume":"60","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","first-page":"1","article-title":"MAP-net: SAR and optical image matching via image-based convolutional network with attention mechanism and spatial pyramid aggregated pooling","volume":"60","author":"Cui","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Xu, C., Liu, C., Li, H., Ye, Z., Sui, H., and Yang, W. (2022). Multiview Image Matching of Optical Satellite and UAV Based on a Joint Description Neural Network. Remote Sens., 14.","key":"ref_48","DOI":"10.3390\/rs14040838"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1706","DOI":"10.1109\/TIP.2014.2307478","article-title":"Robust point matching via vector field consensus","volume":"23","author":"Ma","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.patrec.2017.08.010","article-title":"How to speed up outliers removal in image matching","volume":"114","author":"Ramos","year":"2018","journal-title":"Pattern Recognit. Lett."},{"unstructured":"Brachmann, E., and Rother, C. (November, January 27). Neural-guided RANSAC: Learning where to sample model hypotheses. Proceedings of the Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea.","key":"ref_52"},{"doi-asserted-by":"crossref","unstructured":"Cavalli, L., Larsson, V., Oswald, M.R., Sattler, T., and Pollefeys, M. (2020). Adalam: Revisiting handcrafted outlier detection. arXiv.","key":"ref_53","DOI":"10.1007\/978-3-030-58529-7_45"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/16\/3907\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:07:36Z","timestamp":1760141256000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/16\/3907"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,12]]},"references-count":53,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14163907"],"URL":"https:\/\/doi.org\/10.3390\/rs14163907","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,8,12]]}}}