{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T23:05:43Z","timestamp":1767913543829,"version":"3.49.0"},"reference-count":40,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2020,9,26]],"date-time":"2020-09-26T00:00:00Z","timestamp":1601078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41701540"],"award-info":[{"award-number":["41701540"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41801386"],"award-info":[{"award-number":["41801386"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Innovation Program of CSU, CAS","award":["Y8031831"],"award-info":[{"award-number":["Y8031831"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Feature matching is to detect and match corresponding feature points in stereo pairs, which is one of the key techniques in accurate camera orientations. However, several factors limit the feature matching accuracy, e.g., image textures, viewing angles of stereo cameras, and resolutions of stereo pairs. To improve the feature matching accuracy against these limiting factors, this paper imposes spatial smoothness constraints over the whole feature point sets with the underlying assumption that feature points should have similar matching results with their surrounding high-confidence points and proposes a robust feature matching method with the spatial smoothness constraints (RMSS). The core algorithm constructs a graph structure from the feature point sets and then formulates the feature matching problem as the optimization of a global energy function with first-order, spatial smoothness constraints based on the graph. For computational purposes, the global optimization of the energy function is then broken into sub-optimizations of each feature point, and an approximate solution of the energy function is iteratively derived as the matching results of the whole feature point sets. Experiments on close-range datasets with some above limiting factors show that the proposed method was capable of greatly improving the matching robustness and matching accuracy of some feature descriptors (e.g., scale-invariant feature transform (SIFT) and Speeded Up Robust Features (SURF)). After the optimization of the proposed method, the inlier number of SIFT and SURF was increased by average 131.9% and 113.5%, the inlier percentages between the inlier number and the total matches number of SIFT and SURF were increased by average 259.0% and 307.2%, and the absolute matching accuracy of SIFT and SURF was improved by average 80.6% and 70.2%.<\/jats:p>","DOI":"10.3390\/rs12193158","type":"journal-article","created":{"date-parts":[[2020,9,28]],"date-time":"2020-09-28T08:02:58Z","timestamp":1601280178000},"page":"3158","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Robust Feature Matching with Spatial Smoothness Constraints"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3797-6042","authenticated-orcid":false,"given":"Xu","family":"Huang","sequence":"first","affiliation":[{"name":"School of Geospatial Engineering and Science, Sun Yat-Sen University, Zhuhai 519082, China"},{"name":"Wuhan Engineering Science and Technology Institute, Wuhan 430019, China"}]},{"given":"Xue","family":"Wan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Space Utilization, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China"}]},{"given":"Daifeng","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Remote Sensing and Geomatics Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"The Department of Information Engineering and Computer Science, University of Trento, 38123 Trento, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer. [1st ed.].","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ling, X., Huang, X., Zhang, Y., and Zhou, G. (2020). Matching Confidence Constrained Bundle Adjustment for Multi-View High-Resolution Satellite Images. Remote Sens., 12.","DOI":"10.3390\/rs12010020"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4836","DOI":"10.1080\/2150704X.2020.1723168","article-title":"A window size selection network for stereo dense image matching","volume":"41","author":"Huang","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Huang, X., Hu, K., Ling, X., Zhang, Y., Lu, Z., and Zhou, G. (2017, January 18\u201322). Global Patch Matching. Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Wuhan, China.","DOI":"10.5194\/isprs-annals-IV-2-W4-227-2017"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liu, X., Zhang, Y., Ling, X., Wan, Y., Liu, L., and Li, Q. (2019). TopoLAP: Topology Recovery for Building Reconstruction by Deducing the Relationships between Linear and Planar Primitives. Remote Sens., 11.","DOI":"10.3390\/rs11111372"},{"key":"ref_6","unstructured":"Ren, Z., Meng, J., and Yuan, J. (2011, January 13\u201316). Depth camera based hand gesture recognition and its applications in Human-Computer-Interaction. Proceedings of the International Conference on Information and Communication Security, Singapore."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"181","DOI":"10.4218\/etrij.17.2816.0045","article-title":"Motion Capture of the Human Body Using Multiple Depth Sensors","volume":"39","author":"Kim","year":"2017","journal-title":"ETRI J."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kim, K., Lawrence, R.L., Kyllonen, N., Ludewig, P.M., Ellingson, A.M., and Keefe, D.F. (2017, January 18\u201319). Anatomical 2D\/3D shape-matching in virtual reality: A user interface for quantifying joint kinematics with radiographic imaging. Proceedings of the IEEE Symposium on 3d User Interfaces, Los Angeles, CA, USA.","DOI":"10.1109\/3DUI.2017.7893362"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.cageo.2011.09.018","article-title":"Implementation of Martian virtual reality environment using very high-resolution stereo topographic data","volume":"44","author":"Kim","year":"2012","journal-title":"Comput. Geosci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wu, Y., Di, L., Ming, Y., Lv, H., and Tan, H. (2019). High-Resolution Optical Remote Sensing Image Registration via Reweighted Random Walk based Hyper-Graph Matching. Remote Sens., 11.","DOI":"10.3390\/rs11232841"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yang, H., Li, X., Zhao, L., and Chen, S. (2019). A Novel Coarse-to-Fine Scheme for Remote Sensing Image Registration Based on SIFT and Phase Correlation. Remote Sens., 11.","DOI":"10.3390\/rs11151833"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, M., Zhang, H., Sun, W., Li, S., Wang, F., and Yang, G. (2020). A Coarse-to-Fine Deep Learning Based Land Use Change Detection Method for High-Resolution Remote Sensing Images. Remote Sens., 12.","DOI":"10.3390\/rs12121933"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Dong, H., Ma, W., Wu, Y., Zhang, J., and Jiao, L. (2020). Self-Supervised Representation Learning for Remote Sensing Image Change Detection Based on Temporal Prediction. Remote Sens., 12.","DOI":"10.3390\/rs12111868"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"He, F., Zhou, T., Xiong, W., Hasheminnasab, S.M., and Habib, A. (2018). Automated Aerial Triangulation for UAV-Based Mapping. Remote Sens., 10.","DOI":"10.3390\/rs10121952"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Iacobucci, G., Troiani, F., Milli, S., Mazzanti, P., Piacentini, D., Zocchi, M., and Nadali, D. (2020). Combining Satellite Multispectral Imagery and Topographic Data for the Detection and Mapping of Fluvial Avulsion Processes in Lowland Areas. Remote Sens., 12.","DOI":"10.3390\/rs12142243"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.isprsjprs.2019.04.020","article-title":"An a-contrario method of mismatch detection for two-view pushbroom satellite images","volume":"153","author":"Wan","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/j.isprsjprs.2017.06.009","article-title":"The P2L method of mismatch detection for push broom high-resolution satellite images","volume":"130","author":"Wan","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_18","unstructured":"Huang, X., and Qin, R. (2019, January 27\u201331). Multi-view large-scale bundle adjustment method for high-resolution satellite images. Proceedings of the ASPRS Conference, Denver, CO, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8879","DOI":"10.1080\/01431161.2019.1624862","article-title":"Stereo rectification of pushbroom satellite images by robustly estimating the fundamental matrix","volume":"40","author":"Tatar","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Qin, R. (2016, January 12\u201319). RPC Stereo Processor (RSP): A Software Package for Digital Surface Model and Orthophoto Generation from Satellite Stereo Imagery. Proceedings of the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Prague, Czechoslovakia.","DOI":"10.5194\/isprsannals-III-1-77-2016"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jiang, S., and Jiang, W. (2017). On-Board GNSS\/IMU Assisted Feature Extraction and Matching for Oblique UAV Images. Remote Sens., 9.","DOI":"10.3390\/rs9080813"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"49","DOI":"10.14358\/PERS.81.1.49","article-title":"Reliable Spatial Relationship Constrained Feature Point Matching of Oblique Aerial Images","volume":"81","author":"Hu","year":"2015","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1109\/TGRS.2014.2331234","article-title":"LiDAR Strip Adjustment Using Multifeatures Matched with Aerial Images","volume":"53","author":"Zhang","year":"2015","journal-title":"IEEE T. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ling, X., Zhang, Y., Xiong, J., Huang, X., and Chen, Z. (2016). An Image Matching Algorithm Integrating Global SRTM and Image Segmentation for Multi-Source Satellite Imagery. Remote Sens., 8.","DOI":"10.3390\/rs8080672"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1080\/17538947.2016.1151955","article-title":"A combined image matching method for Chinese optical satellite imagery","volume":"9","author":"Duan","year":"2016","journal-title":"Int. J. Digit. Earth"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 12\u201318). SURF: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R. (2011, January 6\u201313). BRISK: Binary Robust invariant scalable keypoints. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"ASIFT: A New Framework for Fully Affine Invariant Image Comparison","volume":"2","author":"Morel","year":"2009","journal-title":"SIAM J. Imag. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Fern, P., Alcantarilla, N., Bartoli, A., and Davison, A.J. (2012, January 7\u201313). KAZE features. Proceedings of the European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33783-3_16"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sons, M., Kinzig, C., Zanker, D., and Stiller, C. (2019, January 27\u201330). An Approach for CNN-Based Feature Matching Towards Real-Time SLAM. Proceedings of the International Conference on Intelligent Transportation Systems, Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917293"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 7\u201312). Learning to compare image patches via convolutional neural networks. Proceedings of the Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"813","DOI":"10.14358\/PERS.83.12.813","article-title":"4FP-Structure: A Robust Local Region Feature Descriptor","volume":"83","author":"Li","year":"2017","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"513","DOI":"10.14358\/PERS.84.8.513","article-title":"A Local Distinctive Features Matching Method for Remote Sensing Images with Repetitive Patterns","volume":"84","author":"Chen","year":"2018","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1706","DOI":"10.1109\/TIP.2014.2307478","article-title":"Robust point matching via vector field consensus","volume":"23","author":"Ma","year":"2014","journal-title":"IEEE Trans. Imag. Process."},{"key":"ref_36","unstructured":"Winter, M., Ober, S., Arth, C., and Bischof, H. (2007, January 6\u20138). Vocabulary Tree Hypotheses and Co-Occurrences. Proceedings of the 12th Computer Vision Winter Workshop (CVWW\u201907), St. Lambrecht, Austria."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Shewchuk, J.R. (1996, January 27\u201328). Triangle: Engineering a 2D quality mesh generator and Delaunay triangulator. Proceedings of the Workshop on Applied Computational Geometry, Philadelphia, PA, USA.","DOI":"10.1007\/BFb0014497"},{"key":"ref_38","first-page":"1","article-title":"Real-time Kd-tree Construction on Graphics Hardware","volume":"27","author":"Zhou","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_39","unstructured":"(2020, August 19). 3D Reconstruction Dataset. Available online: http:\/\/vision.ia.ac.cn\/data."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/19\/3158\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:13:53Z","timestamp":1760177633000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/19\/3158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,26]]},"references-count":40,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["rs12193158"],"URL":"https:\/\/doi.org\/10.3390\/rs12193158","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,26]]}}}