{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T17:28:30Z","timestamp":1782408510755,"version":"3.54.5"},"reference-count":37,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2022,11,1]],"date-time":"2022-11-01T00:00:00Z","timestamp":1667260800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006579","name":"Open FundProject of Key Laboratory of Space Photoelectric Detection and Perception (Ministry of Industry and Information Technology)","doi-asserted-by":"publisher","award":["NJ2020021-01"],"award-info":[{"award-number":["NJ2020021-01"]}],"id":[{"id":"10.13039\/501100006579","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006579","name":"Open FundProject of Key Laboratory of Space Photoelectric Detection and Perception (Ministry of Industry and Information Technology)","doi-asserted-by":"publisher","award":["SJCX21_0103"],"award-info":[{"award-number":["SJCX21_0103"]}],"id":[{"id":"10.13039\/501100006579","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["NJ2020021-01"],"award-info":[{"award-number":["NJ2020021-01"]}]},{"name":"Postgraduate Research &amp; Practice Innovation Program of Jiangsu Province","award":["SJCX21_0103"],"award-info":[{"award-number":["SJCX21_0103"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Improving the level of autonomy during the landing phase helps promote the full-envelope autonomous flight capability of unmanned aerial vehicles (UAVs). Aiming at the identification of potential landing sites, an end-to-end state estimation method for the autonomous landing of carrier-based UAVs based on monocular vision is proposed in this paper, which allows them to discover landing sites in flight by using equipped optical sensors and avoid a crash or damage during normal and emergency landings. This scheme aims to solve two problems: the requirement of accuracy for runway detection and the requirement of precision for UAV state estimation. First, we design a robust runway detection framework on the basis of YOLOv5 (you only look once, ver. 5) with four modules: a data augmentation layer, a feature extraction layer, a feature aggregation layer and a target prediction layer. Then, the corner prediction method based on geometric features is introduced into the prediction model of the detection framework, which enables the landing field prediction to more precisely fit the runway appearance. In simulation experiments, we developed datasets applied to carrier-based UAV landing simulations based on monocular vision. In addition, our method was implemented with help of the PyTorch deep learning tool, which supports the dynamic and efficient construction of a detection network. Results showed that the proposed method achieved a higher precision and better performance on state estimation during carrier-based UAV landings.<\/jats:p>","DOI":"10.3390\/s22218385","type":"journal-article","created":{"date-parts":[[2022,11,2]],"date-time":"2022-11-02T08:15:12Z","timestamp":1667376912000},"page":"8385","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Monocular-Vision-Based Precise Runway Detection Applied to State Estimation for Carrier-Based UAV Landing"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6558-7023","authenticated-orcid":false,"given":"Ning","family":"Ma","sequence":"first","affiliation":[{"name":"College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiangrui","family":"Weng","sequence":"additional","affiliation":[{"name":"College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunfeng","family":"Cao","sequence":"additional","affiliation":[{"name":"College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linbin","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Astronautics, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3039","DOI":"10.1016\/j.cja.2020.06.020","article-title":"A review on carrier aircraft dispatch path planning and control on deck","volume":"33","author":"Wang","year":"2020","journal-title":"Chin. J. Aeronaut."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Symeonidis, C., Kakaletsis, E., Mademlis, I., Nikolaidis, N., Tefas, A., and Pitas, I. (2021, January 1\u20133). Vision-Based UAV Safe Landing Exploiting Lightweight Deep Neural Networks. Proceedings of the 2021 4th International Conference on Image and Graphics Processing, Sanya, China.","DOI":"10.1145\/3447587.3447590"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1016\/j.cja.2020.11.011","article-title":"Deep learning enabled localization for UAV autolanding","volume":"34","author":"Li","year":"2021","journal-title":"Chin. J. Aeronaut."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"012142","DOI":"10.1088\/1757-899X\/1116\/1\/012142","article-title":"A Review on Design Methods of Vertical take-off and landing UAV aircraft","volume":"1116","author":"Kumar","year":"2021","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1016\/j.comcom.2019.12.039","article-title":"Unmanned Aerial vehicle\u2019s runway landing system with efficient target detection by using morphological fusion for military surveillance system","volume":"151","author":"Nagarani","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_6","unstructured":"Lee, B. (2021). On the Complete Automation of Vertical Flight Aircraft Ship Landing. [Ph.D. Thesis, Texas A&M University]."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yan, L., Duan, H., and Yu, X. (2022). Autolanding System of Shipborne UAV Based on Fusion of INS, CDGPS and Vision-Based Navigation. Advances in Guidance, Navigation and Control, Springer.","DOI":"10.1007\/978-981-15-8155-7"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/j.ast.2018.12.030","article-title":"A visual\/inertial integrated landing guidance method for UAV landing on the ship","volume":"85","author":"Meng","year":"2019","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_9","unstructured":"Coutard, L. (2012). Appontage Automatique D\u2019avions par Asservissement Visuel. [Ph.D. Thesis, Universit\u00e9 Rennes]."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"115091","DOI":"10.1016\/j.eswa.2021.115091","article-title":"A survey of safe landing zone detection techniques for autonomous unmanned aerial vehicles (UAVs)","volume":"179","author":"Alam","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_11","first-page":"214","article-title":"Airport Detection for Fixed-Wing Unmanned Aerial Vehicle Landing Using a Hierarchical Architecture","volume":"16","author":"Hu","year":"2019","journal-title":"J. Aerosp. Inf. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"104069","DOI":"10.1016\/j.robot.2022.104069","article-title":"A review of GNSS-independent UAV navigation techniques","volume":"152","author":"Gyagenda","year":"2022","journal-title":"Robot. Auton. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Xiang, T. (2020). Multi-scale feature fusion based on swarm intelligence collaborative learning for full-stage anti-interference object tracking. J. Ambient. Intell. Humaniz. Comput., 1\u201310.","DOI":"10.1007\/s12652-019-01671-x"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"012005","DOI":"10.1088\/1742-6596\/2166\/1\/012005","article-title":"Visual Navigation Method for Carrier-based Aircraft Landing","volume":"2166","author":"Han","year":"2022","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"289","DOI":"10.2514\/3.19978","article-title":"Development of the F\/A-18A automatic carrier landing system","volume":"8","author":"Urnes","year":"1985","journal-title":"J. Guid. Control. Dyn."},{"key":"ref_16","unstructured":"Yang, Z., and Li, C.J. (2017, January 14\u201316). Review on vision-based pose estimation of UAV based on landmark. Proceedings of the 2017 2nd International Conference on Frontiers of Sensors Technologies (ICFST), Shenzhen, China."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ning, M. (2019, January 5\u20137). A SoC-based acceleration method for UAV runway detection image pre-processing algorithm. Proceedings of the 2019 25th International Conference on Automation and Computing (ICAC), Lancaster, UK.","DOI":"10.23919\/IConAC.2019.8895054"},{"key":"ref_18","unstructured":"Guo, T.-Q. (2013). Research on the Key Tecknologies of Autonomous Deck-Landing of Unmanned Helicopter. [Master\u2019s Thesis, University of Electronic Science and Technology of China]."},{"key":"ref_19","unstructured":"Shi, Y. (2013). Research on Target Recognition for Autonomous Landing of Ship-Board Rotor Unmanned Aerial Vehicles. [Master\u2019s Thesis, Nanjing University of Aeronautics and Astronautics]."},{"key":"ref_20","unstructured":"Yang, G. (2013). Research on Key Techniques of Airborne Vision-Based Navigation for Autonomous Landing of a UAV on a Ship Deck. [Ph.D. Thesis, National University of Defense Technology]."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, C., Cheng, I., and Basu, A. (2018). Real-Time Runway Detection for Infrared Aerial Image Using Synthetic Vision and an ROI Based Level Set Method. Remote Sens., 10.","DOI":"10.3390\/rs10101544"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hiba, A., G\u00e1ti, A., and Manecy, A. (2021). Optical Navigation Sensor for Runway Relative Positioning of Aircraft during Final Approach. Sensors, 21.","DOI":"10.3390\/s21062203"},{"key":"ref_23","unstructured":"Chen, Y. (2015). Research on Guiding Unmanned Helicopter Autonomous Landing A Ship Based on Vision. [Master\u2019s Thesis, Nanchang Hangkong University]."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2894","DOI":"10.1177\/0954410018788003","article-title":"Vision-based guidance for fixed-wing unmanned aerial vehicle autonomous carrier landing","volume":"233","author":"Zhang","year":"2019","journal-title":"Proc. Inst. Mech. Eng. Part G J. Aerosp. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1109\/JSTARS.2020.3034609","article-title":"Validation of Global Airport Spatial Locations From Open Databases Using Deep Learning for Runway Detection","volume":"14","author":"Ji","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_26","unstructured":"Li, J. (2020). Research on Landing Guidance Technology of Rotor UAV Based on Airborne Vision. [Master\u2019s Thesis, Nanjing University of Aeronautics and Astronautics]."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"130981","DOI":"10.1109\/ACCESS.2021.3112185","article-title":"Vision-Assisted Landing Method for Unmanned Powered Parachute Vehicle Based on Lightweight Neural Network","volume":"9","author":"Zhang","year":"2021","journal-title":"IEEE Access"},{"key":"ref_28","first-page":"88","article-title":"Landing mark identification method based on improved SSD network","volume":"29","author":"Wu","year":"2022","journal-title":"Electron. Optics Control"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"542","DOI":"10.14429\/dsj.67.10439","article-title":"Real-time Accurate Runway Detection based on Airborne Multi-sensors Fusion","volume":"67","author":"Zhang","year":"2017","journal-title":"Def. Sci. J."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Fadhil, A.F., Kanneganti, R., Gupta, L., Eberle, H., and Vaidyanathan, R. (2019). Fusion of Enhanced and Synthetic Vision System Images for Runway and Horizon Detection. Sensors, 19.","DOI":"10.3390\/s19173802"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ajith, B., Adlinge, S.D., Dinesh, S., Rajeev, U.P., and Padmakumar, E.S. (2019, January 23\u201325). Robust Method to Detect and Track the Runway during Aircraft Landing Using Colour segmentation and Runway features. Proceedings of the 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India.","DOI":"10.1109\/ICOEI.2019.8862529"},{"key":"ref_32","first-page":"1","article-title":"Monocular Vision Based Relative Localization For Fixed-wing Unmanned Aerial Vehicle Landing","volume":"29","author":"Xu","year":"2022","journal-title":"J. Harbin Inst. Technol. (New Ser.)"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1929","DOI":"10.2514\/1.G002898","article-title":"Fusing Vision and Inertial Sensors for Robust Runway Detection and Tracking","volume":"41","author":"Sundaramorthi","year":"2018","journal-title":"J. Guid. Control. Dyn."},{"key":"ref_34","first-page":"40","article-title":"Semantic segmentation of landing environment for unmanned helicopter based on improved ERFNet","volume":"60","author":"Liu","year":"2020","journal-title":"Telecommun. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Quessy, A.D., Richardson, T.S., and Hansen, M. (2022, January 3\u20137). Vision based Semantic Runway Segmentation from Simulation with Deep Convolutional Neural Networks. Proceedings of the AIAA SCITECH 2022 Forum, San Diego, CA, USA.","DOI":"10.2514\/6.2022-0680"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lin, S., Jin, L., and Chen, Z. (2021). Real-Time Monocular Vision System for UAV Autonomous Landing in Outdoor Low-Illumination Environments. Sensors, 21.","DOI":"10.3390\/s21186226"},{"key":"ref_37","unstructured":"Ultralytics (2022, February 15). YOLOv5 in PyTorch. Available online: https:\/\/github.com\/ultralytics\/yolov5."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8385\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:07:20Z","timestamp":1760144840000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8385"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,1]]},"references-count":37,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22218385"],"URL":"https:\/\/doi.org\/10.3390\/s22218385","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,1]]}}}