{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T18:29:25Z","timestamp":1780511365980,"version":"3.54.1"},"reference-count":46,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,19]],"date-time":"2018-11-19T00:00:00Z","timestamp":1542585600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61672429,61502364, 61272288"],"award-info":[{"award-number":["61672429,61502364, 61272288"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"ShenZhen Science and Technology Foundation","award":["JCYJ20160229172932237"],"award-info":[{"award-number":["JCYJ20160229172932237"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>With the rapid development of Unmanned Aerial Vehicle (UAV) systems, the autonomous landing of a UAV on a moving Unmanned Ground Vehicle (UGV) has received extensive attention as a key technology. At present, this technology is confronted with such problems as operating in GPS-denied environments, a low accuracy of target location, the poor precision of the relative motion estimation, delayed control responses, slow processing speeds, and poor stability. To address these issues, we present a hybrid camera array-based autonomous landing UAV that can land on a moving UGV in a GPS-denied environment. We first built a UAV autonomous landing system with a hybrid camera array comprising a fisheye lens camera and a stereo camera. Then, we integrated a wide Field of View (FOV) and depth imaging for locating the UGV accurately. In addition, we employed a state estimation algorithm based on motion compensation for establishing the motion state of the ground moving UGV, including its actual motion direction and speed. Thereafter, according to the characteristics of the designed system, we derived a nonlinear controller based on the UGV motion state to ensure that the UGV and UAV maintain the same motion state, which allows autonomous landing. Finally, to evaluate the performance of the proposed system, we carried out a large number of simulations in AirSim and conducted real-world experiments. Through the qualitative and quantitative analyses of the experimental results, as well as the analysis of the time performance, we verified that the autonomous landing performance of the system in the GPS-denied environment is effective and robust.<\/jats:p>","DOI":"10.3390\/rs10111829","type":"journal-article","created":{"date-parts":[[2018,11,21]],"date-time":"2018-11-21T11:23:27Z","timestamp":1542799407000},"page":"1829","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":72,"title":["Hybrid Camera Array-Based UAV Auto-Landing on Moving UGV in GPS-Denied Environment"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5180-2316","authenticated-orcid":false,"given":"Tao","family":"Yang","sequence":"first","affiliation":[{"name":"SAIIP, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710071, China"},{"name":"Research &amp; Development Institute of Northwestern Polytechnical University in Shenzhen, Shenzhen 518057, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9178-5082","authenticated-orcid":false,"given":"Qiang","family":"Ren","sequence":"additional","affiliation":[{"name":"SAIIP, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fangbing","family":"Zhang","sequence":"additional","affiliation":[{"name":"SAIIP, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bolin","family":"Xie","sequence":"additional","affiliation":[{"name":"SAIIP, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hailei","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Li","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanning","family":"Zhang","sequence":"additional","affiliation":[{"name":"SAIIP, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi\u2019an 710071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ajmera, J., Siddharthan, P.R., Ramaravind, K.M., Vasan, G., Balaji, N., and Sankaranarayanan, V. (2015, January 21\u201324). Autonomous Visual Tracking and Landing of A Quadrotor on A Moving Platform. Proceedings of the International Conference on Image Information Processing, Waknaghat, India.","DOI":"10.1109\/ICIIP.2015.7414792"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"33666","DOI":"10.1109\/ACCESS.2018.2842679","article-title":"Visual Homing Navigation With Haar-Like Features in the Snapshot","volume":"6","author":"Lee","year":"2018","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3164","DOI":"10.1109\/TIP.2018.2818931","article-title":"Visual Navigation Using Projection of Spatial Right-Angle in Indoor Environment","volume":"27","author":"Wei","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yang, T., Li, P., Zhang, H., Li, J., and Li, Z. (2018). Monocular Vision SLAM-Based UAV Autonomous Landing in Emergencies and Unknown Environments. Electronics, 7.","DOI":"10.3390\/electronics7050073"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1524","DOI":"10.1109\/TRO.2016.2604495","article-title":"Landing of a Quadrotor on a Moving Target Using Dynamic Image-Based Visual Servo Control","volume":"32","author":"Serra","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1109\/TMECH.2016.2639531","article-title":"Image-Based Visual Servoing of a Quadrotor Using Virtual Camera Approach","volume":"22","author":"Zheng","year":"2017","journal-title":"IEEE Trans. Mechatron."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Falanga, D., Zanchettin, A., Simovic, A., Delmerico, J., and Scaramuzza, D. (2017, January 11\u201313). Vision-based Autonomous Quadrotor Landing on a Moving Platform. Proceedings of the International Symposium on Safety, Security and Rescue Robotics, Shanghai, China.","DOI":"10.1109\/SSRR.2017.8088164"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2735","DOI":"10.1007\/s11071-014-1843-x","article-title":"Nonlinear Robust Output Feedback Tracking Control of a Quadrotor UAV using Quaternion Representation","volume":"79","author":"Xian","year":"2015","journal-title":"Nonlinear Dyn."},{"key":"ref_9","unstructured":"Tang, D., Jiao, Y., and Chen, J. (2016, January 12\u201314). On Automatic Landing System for Carrier Plane Based on Integration of INS, GPS and Vision. Proceedings of the IEEE Chinese Guidance, Navigation and Control Conference (CGNCC), Nanjing, China."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tian, D., He, X., Zhang, L., Lian, J., and Hu, X. (2017, January 26\u201327). A Design of Odometer-Aided Visual Inertial Integrated Navigation Algorithm Based on Multiple View Geometry Constraints. Proceedings of the International Conference on Intelligent Human-Machine Systems and Cybernetics, Hangzhou, China.","DOI":"10.1109\/IHMSC.2017.43"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"23190","DOI":"10.1109\/ACCESS.2017.2759799","article-title":"A Novel Visual-Vocabulary-Translator-Based Cross-Domain Image Matching","volume":"5","author":"Jing","year":"2017","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"17681","DOI":"10.1109\/ACCESS.2018.2820680","article-title":"Cross-Domain Co-Occurring Feature for Visible-Infrared Image Matching","volume":"6","author":"Jing","year":"2018","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yang, T., Li, G., Li, J., Zhang, Y., Zhang, X., Zhang, Z., and Li, Z. (2016). A Ground-Based Near Infrared Camera Array System for UAV Auto-Landing in GPS-Denied Environment. Sensors, 16.","DOI":"10.3390\/s16091393"},{"key":"ref_14","unstructured":"Kong, W., Zhang, D., Wang, X., and Xian, Z. (2013, January 3\u20137). Autonomous Landing of a UAV with a Ground-based Actuated Infrared Stereo Vision System. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Tokyo, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Muskardin, T., Balmer, G., Wlach, S., Kondak, K., Laiacker, M., and Ollero, A. (2016, January 16\u201321). Landing of a Fixed-wing UAV on A Mobile Ground Vehicle. Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487254"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ghamry, K.A., Dong, Y., Kamel, M.A., and Zhang, Y. (2016, January 21\u201324). Real-time Autonomous Take-off, Tracking and Landing of UAV on A Moving UGV Platform. Proceedings of the 2016 24th Mediterranean Conference on Control and Automation (MED), Athens, Greece.","DOI":"10.1109\/MED.2016.7535886"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Singh, S., and Padhi, R. (2009, January 10\u201312). Automatic Path Planning and Control Design for Autonomous Landing of UAVs using Dynamic Inversion. Proceedings of the American Control Conference, St. Louis, MO, USA.","DOI":"10.1109\/ACC.2009.5160444"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1007\/s10514-015-9456-x","article-title":"Vision-based Landing Site Evaluation and Informed Optimal Trajectory Generation Toward Autonomous Rooftop Landing","volume":"39","author":"Vishnu","year":"2015","journal-title":"Auton. Robot."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). SSD: Single Shot MultiBox Detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_20","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas Valley, NV, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, Faster, Stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A Flexible New Technique for Camera Calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Scaramuzza, D., Martinelli, A., and Siegwart, R. (2006, January 4\u20137). A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion. Proceedings of the IEEE International Conference on Computer Vision Systems, New York, NY, USA.","DOI":"10.1109\/ICVS.2006.3"},{"key":"ref_24","unstructured":"Rehder, J., Nikolic, J., Schneider, T., and Siegwart, R. (June, January 29). A Direct Formulation for Camera Calibration. Proceedings of the IEEE International Conference on Robotics and Automation, Singapore."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"23969","DOI":"10.1109\/ACCESS.2017.2764419","article-title":"Vision-Based Real-Time Aerial Object Localization and Tracking for UAV Sensing System","volume":"5","author":"Wu","year":"2017","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, J., Zhang, F., Wei, L., Yang, T., and Lu, Z. (2017). Nighttime Foreground Pedestrian Detection based on Three-dimensional Voxel Surface Model. Sensors, 17.","DOI":"10.3390\/s17102354"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Nguyen, P.H., Arsalan, M., Koo, J.H., Naqvi, R.A., Truong, N.Q., and Park, K.R. (2018). LightDenseYOLO: A Fast and Accurate Marker Tracker for Autonomous UAV Landing by Visible Light Camera Sensor on Drone. Sensors, 18.","DOI":"10.3390\/s18061703"},{"key":"ref_28","unstructured":"Redmon, J., and Farhadi, A. (arXiv, 2018). YOLOv3: An Incremental Improvement, arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Rezatofighi, S.H., Milan, A., Zhang, Z., and Shi, Q. (2015, January 7\u201313). Joint Probabilistic Data Association Revisited. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.349"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple Online and Realtime Tracking. Proceedings of the IEEE International Conference on Image Processing, Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rezatofighi, S.H., Milani, A., Zhang, Z., Shi, Q., Dick, A., and Reid, I. (2016, January 27\u201330). Joint Probabilistic Matching Using m-Best Solutions. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.22"},{"key":"ref_32","unstructured":"Bochinski, E., Eiselein, V., and Sikora, T. (September, January 29). High-Speed Tracking-by-detection without using Image Information. Proceedings of the IEEE International Conference on Advanced Video and Signal Based Surveillance, Lecce, Italy."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chen, T., Pennisi, A., Li, Z., Zhang, Y., and Sahli, H. (2018). A Hierarchical Association Framework for Multi-Object Tracking in Airborne Videos. Remote Sens., 10.","DOI":"10.20944\/preprints201807.0238.v1"},{"key":"ref_34","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster R-CNN: Towards Real-time Object Detection with Region Proposal networks. Proceedings of the International Conference on Neural Information Processing Systems, Montreal, QC, Cananda."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hosang, J., Benenson, R., and Schiele, B. (2017, January 21\u201326). Learning Non-maximum Suppression. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.685"},{"key":"ref_36","unstructured":"Sorenson, H.W. (1985). Kalman Filtering: Theory and Application, The Institute of Electrical and Electronics Engineers, Inc."},{"key":"ref_37","unstructured":"Maughan, D.S., Erekson, I., and Sharma, R. (2016, January 9\u201312). Using Extended Kalman Filter for Robust Control of a Flying Inverted Pendulum. Proceedings of the Signal Processing and Signal Processing Education Workshop, Salt Lake City, UT, USA."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","unstructured":"Tao, T., Koo, J.C., and Choi, H.R. (2008, January 21\u201324). A fast Block Matching Algorthim for Stereo Correspondence. Proceedings of the IEEE Conference on Cybernetics and Intelligent Systems, Chengdu, China."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo Processing by Semiglobal Matching and Mutual Information","volume":"30","author":"Hirschmuller","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hernandez-Juarez, D., Chac\u00f3n, A., Espinosa, A., V\u00e1zquez, D., Moure, J.C., and L\u00f3pez, A.M. (2016, January 6\u20138). Embedded Real-time Stereo Estimation via Semi-Global Matching on the GPU. Proceedings of the International Conference on Computational Science, San Diego, CA, USA.","DOI":"10.1016\/j.procs.2016.05.305"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, L., Bi, S., and Yang, H. (2010, January 26\u201328). Fuzzy-PID Control Algorithm of The Helicopter Model Flight Attitude Control. Proceedings of the IEEE Conference on Control and Decision Conference, Xuzhou, China.","DOI":"10.1109\/CCDC.2010.5498216"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Zhang, D., Chen, Z., and Xi, L. (2016, January 7\u20138). Adaptive Dual Fuzzy PID Control Method for Longitudinal Attitude Control of Tail-sitter UAV. Proceedings of the International Conference on Automation and Computing, Colchester, UK.","DOI":"10.1109\/IConAC.2016.7604949"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Shah, S., Dey, D., Lovett, C., and Kapoor, A. (2018). Airsim: High-fidelity Visual and Physical Simulation for Autonomous Vehicles. Field and Service Robotics, Springer.","DOI":"10.1007\/978-3-319-67361-5_40"},{"key":"ref_45","unstructured":"Tzutalin (2017, December 01). LabelImg. Available online: https:\/\/github.com\/tzutalin\/labelImg."},{"key":"ref_46","unstructured":"Daniel, D., Tomasz, M., and Andrew, R. (2018, January 18\u201322). SuperPoint: Self-Supervised Interest Point Detection and Description. Proceedings of the CVPR Deep Learning for Visual SLAM Workshop, Salt Lake City, UT, USA."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1829\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:30:36Z","timestamp":1760196636000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1829"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,19]]},"references-count":46,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["rs10111829"],"URL":"https:\/\/doi.org\/10.3390\/rs10111829","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,11,19]]}}}