{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T02:33:02Z","timestamp":1773541982793,"version":"3.50.1"},"reference-count":54,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T00:00:00Z","timestamp":1626220800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012326","name":"International Science and Technology Cooperation Programme","doi-asserted-by":"publisher","award":["2015DFR10830"],"award-info":[{"award-number":["2015DFR10830"]}],"id":[{"id":"10.13039\/501100012326","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Using unmanned aerial vehicles (UAVs) for remote sensing has the advantages of high flexibility, convenient operation, low cost, and wide application range. It fills the need for rapid acquisition of high-resolution aerial images in modern photogrammetry applications. Due to the insufficient parallaxes and the computation-intensive process, dense real-time reconstruction for large terrain scenes is a considerable challenge. To address these problems, we proposed a novel SLAM-based MVS (Multi-View-Stereo) approach, which can incrementally generate a dense 3D (three-dimensional) model of the terrain by using the continuous image stream during the flight. The pipeline of the proposed methodology starts with pose estimation based on SLAM algorithm. The tracked frames were then selected by a novel scene-adaptive keyframe selection method to construct a sliding window frame-set. This was followed by depth estimation using a flexible search domain approach, which can improve accuracy without increasing the iterate time or memory consumption. The whole system proposed in this study was implemented on the embedded GPU based on an UAV platform. We proposed a highly parallel and memory-efficient CUDA-based depth computing architecture, enabling the system to achieve good real-time performance. The evaluation experiments were carried out in both simulation and real-world environments. A virtual large terrain scene was built using the Gazebo simulator. The simulated UAV equipped with an RGB-D camera was used to obtain synthetic evaluation datasets, which were divided by flight altitudes (800-, 1000-, 1200 m) and terrain height difference (100-, 200-, 300 m). In addition, the system has been extensively tested on various types of real scenes. Comparison with commercial 3D reconstruction software is carried out to evaluate the precision in real-world data. According to the results on the synthetic datasets, over 93.462% of the estimation with absolute error distance of less then 0.9%. In the real-world dataset captured at 800 m flight height, more than 81.27% of our estimated point cloud are less then 5 m difference with the results of Photoscan. All evaluation experiments show that the proposed approach outperforms the state-of-the-art ones in terms of accuracy and efficiency.<\/jats:p>","DOI":"10.3390\/rs13142778","type":"journal-article","created":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T21:56:51Z","timestamp":1626299811000},"page":"2778","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Onboard Real-Time Dense Reconstruction in Large Terrain Scene Using Embedded UAV Platform"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4888-4306","authenticated-orcid":false,"given":"Zhengchao","family":"Lai","sequence":"first","affiliation":[{"name":"Beijing Key Lab for Precision Optoelectronic Measurement Instrument and Technology, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fei","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing Key Lab for Precision Optoelectronic Measurement Instrument and Technology, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shangwei","family":"Guo","sequence":"additional","affiliation":[{"name":"Beijing Key Lab for Precision Optoelectronic Measurement Instrument and Technology, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiantong","family":"Meng","sequence":"additional","affiliation":[{"name":"Beijing Key Lab for Precision Optoelectronic Measurement Instrument and Technology, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaokun","family":"Han","sequence":"additional","affiliation":[{"name":"Beijing Key Lab for Precision Optoelectronic Measurement Instrument and Technology, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenhao","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing Key Lab for Precision Optoelectronic Measurement Instrument and Technology, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"359","DOI":"10.5194\/esurf-4-359-2016","article-title":"Image-based surface reconstruction in geomorphometry\u2014Merits, limits and developments","volume":"4","author":"Eltner","year":"2016","journal-title":"Earth Surf. Dyn."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Meinen, B.U., and Robinson, D.T. (2020). Mapping erosion and deposition in an agricultural landscape: Optimization of UAV image acquisition schemes for SfM-MVS. Remote Sens. Environ., 239.","DOI":"10.1016\/j.rse.2020.111666"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mohammed, F., Idries, A., Mohamed, N., Al-Jaroodi, J., and Jawhar, I. (2014, January 27\u201330). UAVs for smart cities: Opportunities and challenges. Proceedings of the 2014 International Conference on Unmanned Aircraft Systems (ICUAS), Orlando, FL, USA.","DOI":"10.1109\/ICUAS.2014.6842265"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bash, E.A., Moorman, B.J., and Gunther, A. (2018). Detecting Short-Term Surface Melt on an Arctic Glacier Using UAV Surveys. Remote Sens., 10.","DOI":"10.3390\/rs10101547"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jaud, M., Passot, S., Le Bivic, R., Delacourt, C., Grandjean, P., and Le Dantec, N. (2016). Assessing the Accuracy of High Resolution Digital Surface Models Computed by PhotoScan\u00ae and MicMac\u00ae in Sub-Optimal Survey Conditions. Remote Sens., 8.","DOI":"10.3390\/rs8060465"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/978-3-319-67361-5_25","article-title":"Mapping on the Fly: Real-Time 3D Dense Reconstruction, Digital Surface Map and Incremental Orthomosaic Generation for Unmanned Aerial Vehicles","volume":"Volume 5","author":"Hinzmann","year":"2018","journal-title":"Field and Service Robotics"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1007\/s12524-020-01249-7","article-title":"Design Criteria of a UAV for ISTAR and Remote Sensing Applications","volume":"49","author":"Panigrahi","year":"2021","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tran, D.Q., Park, M., Jung, D., and Park, S. (2020). Damage-Map Estimation Using UAV Images and Deep Learning Algorithms for Disaster Management System. Remote Sens., 12.","DOI":"10.3390\/rs12244169"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/01431161.2019.1597294","article-title":"Streambank topography: An accuracy assessment of UAV-based and traditional 3D reconstructions","volume":"41","author":"Meinen","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_10","unstructured":"(2021, July 01). Microsoft Azure-Kinect-DK. Available online: https:\/\/azure.microsoft.com\/en-us\/services\/kinect-dk\/."},{"key":"ref_11","unstructured":"(2021, July 01). Intel RealSense Sensor. Available online: https:\/\/www.intelrealsense.com\/."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.isprsjprs.2020.04.016","article-title":"Efficient structure from motion for large-scale UAV images: A review and a comparison of SfM tools","volume":"167","author":"Jiang","year":"2020","journal-title":"Isprs J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12524-017-0727-1","article-title":"Application of drone for landslide mapping, dimension estimation and its 3D reconstruction","volume":"46","author":"Gupta","year":"2018","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1145\/1141911.1141964","article-title":"Photo tourism: Exploring photo collections in 3D","volume":"25","author":"Snavely","year":"2006","journal-title":"Acm Trans. Graph. (TOG)"},{"key":"ref_15","first-page":"91","article-title":"Fast Radiometry Guided Fusion of Disparity Images","volume":"XLI-B3","author":"Schmid","year":"2016","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1177\/027836498600500404","article-title":"On the Representation and Estimation of Spatial Uncertainty","volume":"5","author":"Smith","year":"1986","journal-title":"Int. J. Robot. Res."},{"key":"ref_17","unstructured":"Montemerlo, M., Thrun, S., Koller, D., and Wegbreit, B. (2002). FastSLAM: A Factored Solution to the Simultaneous Localization and Mapping Problem, MIT Press."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TPAMI.2007.1049","article-title":"MonoSLAM: Real-time single camera SLAM","volume":"29","author":"Davison","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1016\/j.vrih.2019.07.002","article-title":"Survey and evaluation of monocular visual-inertial SLAM algorithms for augmented reality","volume":"1","author":"Jinyu","year":"2019","journal-title":"Virtual Real. Intell. Hardw."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Huang, B., Zhao, J., and Liu, J. (2020). A Survey of Simultaneous Localization and Mapping with an Envision in 6G Wireless Networks. arXiv.","DOI":"10.5081\/jgps.17.1.94"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel Tracking and Mapping for Small AR Workspaces. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-Scale Direct Monocular SLAM. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct Sparse Odometry","volume":"40","author":"Engel","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 31). SVO: Fast semi-direct monocular visual odometry. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906584"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Campos, C., Elvira, R., G\u00f3mez, J.J., Montiel, J.M.M., and Tard\u00f3s, J.D. (2020). ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM. arXiv.","DOI":"10.1109\/TRO.2021.3075644"},{"key":"ref_26","unstructured":"Seitz, S., Curless, B., Diebel, J., Scharstein, D., and Szeliski, R. (2006, January 17\u201322). A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Furukawa, Y., and Hern\u00e1ndez, C. (2015). Multi-View Stereo: A Tutorial, Now Publishers, Inc.","DOI":"10.1561\/9781601988379"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1007\/s00300-019-02480-w","article-title":"Underwater photogrammetry in Antarctica: Long-term observations in benthic ecosystems and legacy data rescue","volume":"42","author":"Piazza","year":"2019","journal-title":"Polar Biol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Xiao, X., Guo, B., Li, D., Li, L., Yang, N., Liu, J., Zhang, P., and Peng, Z. (2016). Multi-View Stereo Matching Based on Self-Adaptive Patch and Image Grouping for Multiple Unmanned Aerial Vehicle Imagery. Remote Sens., 8.","DOI":"10.3390\/rs8020089"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Mohamed, H., Nadaoka, K., and Nakamura, T. (2020). Towards Benthic Habitat 3D Mapping Using Machine Learning Algorithms and Structures from Motion Photogrammetry. Remote Sens., 12.","DOI":"10.3390\/rs12010127"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hornung, A., and Kobbelt, L. (2006, January 7\u201313). Robust and efficient photo-consistency estimation for volumetric 3D reconstruction. Proceedings of the European Conference on Computer Vision (ECCV), Graz, Austria.","DOI":"10.1007\/11744047_14"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Starck, J., Hilton, A., and Miller, G. (2006, January 4\u20137). Volumetric Stereo with Silhouette and Feature Constraints. Proceedings of the British Machine Vision Conference, Edinburgh, UK.","DOI":"10.5244\/C.20.121"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Tran, S., and Davis, L. (2006, January 7\u201313). 3D surface reconstruction using graph cuts with surface constraints. Proceedings of the European Conference on Computer Vision (ECCV), Graz, Austria.","DOI":"10.1007\/11744047_17"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1109\/TPAMI.2011.172","article-title":"High Accuracy and Visibility-Consistent Dense Multiview Stereo","volume":"34","author":"Vu","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","unstructured":"Hirschm\u00fcller, H. (2011, January 5\u201311). Semi-Global Matching-Motivation, Developments and Applications. Proceedings of the Invited Paper at the 54th Photogrammetric Week, Stuttgart, Germany."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Luo, Q., Li, Y., and Qi, Y. (2018, January 22\u201324). Distributed Refinement of Large-Scale 3D Mesh for Accurate Multi-View Reconstruction. Proceedings of the 2018 International Conference on Virtual Reality and Visualization (ICVRV), Qingdao, China.","DOI":"10.1109\/ICVRV.2018.00018"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Lovegrove, S.J., and Davison, A.J. (2011, January 6\u201313). DTAM: Dense tracking and mapping in real-time. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126513"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yang, Z., Gao, F., and Shen, S. (June, January 29). Real-time monocular dense mapping on aerial robots using visual-inertial fusion. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989529"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wang, K., Ding, W., and Shen, S. (2018, January 1\u20135). Quadtree-Accelerated Real-Time Monocular Dense Mapping. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594101"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zeng, A., Song, S., Nie\u00dfner, M., Fisher, M., Xiao, J., and Funkhouser, T. (2017, January 21\u201326). 3DMatch: Learning Local Geometric Descriptors from RGB-D Reconstructions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.29"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gallup, D., Frahm, J.M., Mordohai, P., and Pollefeys, M. (2008, January 23\u201328). Variable baseline\/resolution stereo. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587671"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Aguilar-Gonz\u00e1lez, A., and Arias-Estrada, M. (2016, January 4\u20137). Dense mapping for monocular-SLAM. Proceedings of the 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Alcala de Henares, Spain.","DOI":"10.1109\/IPIN.2016.7743671"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.powtec.2018.04.034","article-title":"A GPU-based DEM for modelling large scale powder compaction with wide size distributions","volume":"333","author":"He","year":"2018","journal-title":"Powder Technol."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Pizzoli, M., Forster, C., and Scaramuzza, D. (June, January 31). REMODE: Probabilistic, monocular dense reconstruction in real time. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907233"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Ling, Y., Wang, K., and Shen, S. (2018, January 1\u20135). Probabilistic Dense Reconstruction from a Moving Camera. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593618"},{"key":"ref_46","unstructured":"(2021, July 01). NVidia TX2. Available online: https:\/\/www.nvidia.cn\/autonomous-machines\/embedded-systems\/jetson-tx2\/."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7\u201312). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura\u2013Algarve, Portugal.","DOI":"10.1109\/IROS.2012.6385773"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Handa, A., Whelan, T., McDonald, J., and Davison, A.J. (June, January 31). A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907054"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The KITTI vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_50","unstructured":"(2021, July 01). Gazebo Simulator. Available online: http:\/\/www.gazebosim.org\/."},{"key":"ref_51","unstructured":"(2021, July 01). Terrain.Party. Available online: https:\/\/terrain.party\/."},{"key":"ref_52","unstructured":"(2021, July 01). OpenStreetMap. Available online: www.openstreetmap.org."},{"key":"ref_53","unstructured":"(2021, July 01). Cloud Compare. Available online: http:\/\/www.cloudcompare.org."},{"key":"ref_54","unstructured":"(2021, July 01). Agisoft PhotoScan Professional. Available online: http:\/\/www.agisoft.com\/."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2778\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:30:44Z","timestamp":1760164244000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/14\/2778"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,14]]},"references-count":54,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13142778"],"URL":"https:\/\/doi.org\/10.3390\/rs13142778","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,14]]}}}