{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T06:53:21Z","timestamp":1780642401807,"version":"3.54.1"},"reference-count":52,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,1,20]],"date-time":"2019-01-20T00:00:00Z","timestamp":1547942400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004750","name":"Aeronautical Science Foundation of China","doi-asserted-by":"publisher","award":["2017ZC31008"],"award-info":[{"award-number":["2017ZC31008"]}],"id":[{"id":"10.13039\/501100004750","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004750","name":"Aeronautical Science Foundation of China","doi-asserted-by":"publisher","award":["2014ZC31004"],"award-info":[{"award-number":["2014ZC31004"]}],"id":[{"id":"10.13039\/501100004750","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Technology Innovation Foundation of Aviation Industry Corporation of China","award":["2014D63130R"],"award-info":[{"award-number":["2014D63130R"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper proposes a novel infrared-inertial navigation method for the precise landing of commercial aircraft in low visibility and Global Position System (GPS)-denied environments. Within a Square-root Unscented Kalman Filter (SR_UKF), inertial measurement unit (IMU) data, forward-looking infrared (FLIR) images and airport geo-information are integrated to estimate the position, velocity and attitude of the aircraft during landing. Homography between the synthetic image and the real image which implicates the camera pose deviations is created as vision measurement. To accurately extract real runway features, the current results of runway detection are used as the prior knowledge for the next frame detection. To avoid possible homography decomposition solutions, it is directly converted to a vector and fed to the SR_UKF. Moreover, the proposed navigation system is proven to be observable by nonlinear observability analysis. Last but not least, a general aircraft was elaborately equipped with vision and inertial sensors to collect flight data for algorithm verification. The experimental results have demonstrated that the proposed method could be used for the precise landing of commercial aircraft in low visibility and GPS-denied environments.<\/jats:p>","DOI":"10.3390\/s19020408","type":"journal-article","created":{"date-parts":[[2019,1,22]],"date-time":"2019-01-22T03:08:22Z","timestamp":1548126502000},"page":"408","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Infrared-Inertial Navigation for Commercial Aircraft Precision Landing in Low Visibility and GPS-Denied Environments"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7453-1224","authenticated-orcid":false,"given":"Lei","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Northwestern Polytechnical University, Dongda Road, Changan District, Xi\u2019an 710072, China"},{"name":"Xi\u2019an Aeronautics Computing Technique Research Institute, Aviation Industry Corporation of China, Jinyeer Road, Yanta District, Xi\u2019an 710065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9931-8849","authenticated-orcid":false,"given":"Zhengjun","family":"Zhai","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Northwestern Polytechnical University, Dongda Road, Changan District, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2515-8579","authenticated-orcid":false,"given":"Lang","family":"He","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Northwestern Polytechnical University, Dongda Road, Changan District, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengcheng","family":"Wen","sequence":"additional","affiliation":[{"name":"Xi\u2019an Aeronautics Computing Technique Research Institute, Aviation Industry Corporation of China, Jinyeer Road, Yanta District, Xi\u2019an 710065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wensheng","family":"Niu","sequence":"additional","affiliation":[{"name":"Xi\u2019an Aeronautics Computing Technique Research Institute, Aviation Industry Corporation of China, Jinyeer Road, Yanta District, Xi\u2019an 710065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1109\/TAES.2017.2650038","article-title":"Optimized GNSS Station Selection to Support Long-Term Monitoring of Ionospheric Anomalies for Aircraft Landing Systems","volume":"53","author":"Jiyun","year":"2017","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_2","unstructured":"Alvika, G., Sujit, P.B., and Srikanth, S. (2014, January 27\u201330). A Survey of Autonomous Landing Techniques for UAVs. Proceedings of the International Conference on Unmanned Aircraft Systems (ICUAS), Orlando, FL, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Kong, W., Zhou, D., Zhang, D., and Zhang, J. (2014, January 28\u201329). Vision-based Autonomous Landing System for Unmanned Aerial Vehicle: A Survey. Proceedings of the International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI), Beijing, China.","DOI":"10.1109\/MFI.2014.6997750"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s10846-010-9505-9","article-title":"On-board and Ground Visual Pose Estimation Techniques for UAV Control","volume":"61","author":"Compoy","year":"2011","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_5","unstructured":"Kong, W., Zhang, D., Wang, X., Xian, Z., and Zhang, J. (2013, January 3\u20137). Autonomous Landing of an UAV with a Ground-Based Actuated Infrared Stereo Vision System. Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kong, W., Zhou, D., Zhang, Y., Zhang, D., and Zhang, J. (2014, January 14\u201318). A Ground-Based Optical System for Autonomous Landing of a Fixed Wing UAV. Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS), Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6943244"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.3390\/s17061437","article-title":"Localization Framework for Real-Time UAV Autonomous Landing: An On-Ground Deployed Visual Approach","volume":"17","author":"Kong","year":"2017","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"67","DOI":"10.5772\/62027","article-title":"Ground Stereo Vision-based Navigation for Autonomous Take-off and Landing of UAVs: A Chan-Vese Model Approach","volume":"13","author":"Tang","year":"2016","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"43","DOI":"10.5772\/62257","article-title":"Stereo Vision Guiding for the Autonomous Landing of Fixed-wing UAVs: A Saliency-inspired Approach","volume":"13","author":"Ma","year":"2016","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.3390\/s16091393","article-title":"A Ground-Based Near Infrared Camera Array System for UAV Auto-Landing in GPS-Denied Environment","volume":"16","author":"Yang","year":"2016","journal-title":"Sensors"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Coutard, L., Chaumette, F., and Pflimlin, J. (2011, January 25\u201330). Automatic landing on aircraft carrier by visual servoing. Proceedings of the IEEE Conference on Intelligent Robots and Systems (IROS), San Francisco, CA, USA.","DOI":"10.1109\/IROS.2011.6048527"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Coutard, L., and Chaumette, F. (2011, January 9\u201313). Visual detection and 3D model-based tracking for landing on an aircraft carrier. Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979771"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"60","DOI":"10.5772\/60142","article-title":"FLIR\/INS\/RA Integrated Landing Guidance for Landing on Aircraft Carrier","volume":"12","author":"Ding","year":"2015","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_14","first-page":"176","article-title":"An Independently Carrier Landing Method Using Point and Line Features for Fixed-Wing UAVs","volume":"634","author":"Jia","year":"2016","journal-title":"Commun. Comput. Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Muskardin, T., Balmer, G., Wlach, S., Kondak, K., Laiacker, M., and Ollero, A. (2016, January 16\u201321). Landing of a Fixed-wing UAV on a Mobile Ground Vehicle. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487254"},{"key":"ref_16","unstructured":"Hans-Ullrich, D., and Bernd, R. (2004, January 12\u201313). Autonomous infrared-based guidance system for approach and landing. Proceedings of the Enhanced and Synthetic Vision, Orlando, FL, USA."},{"key":"ref_17","first-page":"269","article-title":"Vision-Based Automatic Approach and Landing of Fixed-Wing Aircraft Using a Dense Visual Tracking","volume":"85","author":"Goncalves","year":"2011","journal-title":"Inform. Control Autom. Robot."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s10846-013-9819-5","article-title":"Airborne Vision-Based Navigation Method for UAV Accuracy Landing Using Infrared Lamps","volume":"72","author":"Gui","year":"2013","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Guo, P., Li, X., Gui, Y., Zhou, X., Zhang, H., and Zhang, X. (2014, January 19\u201323). Airborne Vision-Aided Landing Navigation System for Fixed-Wing UAV. Proceedings of the IEEE International Conference on Signal Processing (ICSP), Hangzhou, China.","DOI":"10.1109\/ICOSP.2014.7015193"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1109\/TAES.2013.110780","article-title":"Approach Maneuvers for Autonomous Landing Using Visual Servo Control","volume":"50","author":"Bras","year":"2014","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1007\/s11431-016-0618-3","article-title":"Vision algorithms for fixed-wing unmanned aerial vehicle landing system","volume":"60","author":"Fan","year":"2017","journal-title":"Sci. China Technol. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Burlion, L., and Plinval, H. (2017, January 13\u201316). Toward vision-based landing of a fixed-wing UAV on an unknown runway under some fov constrains. Proceedings of the International Conference on Unmanned Aircraft Systems (ICUAS), Miami, FL, USA.","DOI":"10.1109\/ICUAS.2017.7991333"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Gibert, V., Burlion, L., Chriette, A., Boada, J., and Plestan, F. (2015, January 15\u201317). Nonlinear observers in vision system: Application to civil aircraft landing. Proceedings of the European Control Conference (ECC), Linz, Austria.","DOI":"10.1109\/ECC.2015.7330802"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.ifacol.2015.12.040","article-title":"New pose estimation scheme in perspective vision system during civil aircraft landing","volume":"48","author":"Gibert","year":"2015","journal-title":"IFAC-PapersOnLine"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.conengprac.2018.03.004","article-title":"Visual estimation of deviations for the civil aircraft landing","volume":"75","author":"Gibert","year":"2018","journal-title":"Control Eng. Pract."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s10846-017-0657-8","article-title":"Automatic Landing Assist System Using IMU+PnP for Robust Positioning of Fixed-Wing UAVs","volume":"90","author":"Ruchanurucks","year":"2018","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1109\/TASE.2016.2582752","article-title":"Visual Inertial Navigation Systems for Aerial Robotics Sensor Fusion and Technology","volume":"14","author":"Santoso","year":"2017","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yang, Z., Gao, F., and Shen, S.J. (June, January 29). Real-time Monocular Dense Mapping on Aerial Robots Using Visual-Inertial Fusion. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Marina Bay Sands, Singapore.","DOI":"10.1109\/ICRA.2017.7989529"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/LRA.2017.2653359","article-title":"Visual-Inertial monocular SLAM with Map Reuse","volume":"2","author":"Tardos","year":"2017","journal-title":"IEEE Trans. Autom. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/LRA.2018.2793349","article-title":"Robust Stereo Visual Inertial Odometry for Fast Autonomous Flight","volume":"3","author":"Sun","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2205","DOI":"10.1109\/TITS.2016.2515625","article-title":"Practical Infrared Visual Odometry","volume":"17","author":"Borges","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_32","first-page":"1980","article-title":"Runway Extraction in Low Visibility Conditions Based on Sensor Fusion Method","volume":"14","author":"Liu","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"67","DOI":"10.14429\/dsj.64.2765","article-title":"Detection of Runway and Obstacles using Electro-optical and Infrared Sensors before Landing","volume":"64","author":"Kumar","year":"2014","journal-title":"Def. Sci. J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1109\/LGRS.2016.2565706","article-title":"Efficient Airport Detection Using Line Segment Detector and Fisher Vector Representation","volume":"13","author":"Wu","year":"2016","journal-title":"IEEE Geosci. Remote Sens."},{"key":"ref_35","first-page":"48","article-title":"Real-time Accurate Runway Detection based on Airborne Multi-sensors Fusion","volume":"67","author":"Lei","year":"2017","journal-title":"Def. Sci. J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1109\/TAC.1977.1101601","article-title":"Nonlinear controllability and observability","volume":"22","author":"Hermann","year":"1977","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_37","first-page":"56","article-title":"Visual-Inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-Calibration","volume":"5","author":"Kelly","year":"2010","journal-title":"Int. J. Robot. Res."},{"key":"ref_38","unstructured":"Weiss, S. (2012). Vision Based Navigation for Micro Helicopters. [Ph.D. Thesis, ETH Zurich]."},{"key":"ref_39","unstructured":"RTCA DO-315B (2013). Minimum Aviation System Performance Standard (MASPS) for Enhanced Vision Systems, Synthetic Vision Systems, Combine Vision Systems and Enhanced Flight Vision Systems, RTCA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ma, Y., Soatto, S., Kosecka, J., and Sastry, S. (2004). An Invitation to 3-D Vision: From Images to Geometric Models, Springer.","DOI":"10.1007\/978-0-387-21779-6"},{"key":"ref_41","unstructured":"Ezio, M., and Manuel, V. (2007). Deeper Understanding of the Homography Decomposition for Vision-Based Control, INRIA. RR-6303."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1016\/j.patrec.2011.06.001","article-title":"EDLines: A real-time line segment detector with a false detection control","volume":"32","author":"Akinlar","year":"2011","journal-title":"Pattern Recognit. Lett."},{"key":"ref_44","unstructured":"Rudolph, V.D., and Eric., A.W. (2001, January 7\u201311). The Square-root Unscented Kalman Filter for State and Parameter-estimation. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing 2001, Salt Lake City, UT, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1134\/S2075108717040083","article-title":"Novel adaptive UKF for tightly-coupled INS\/GPS integration with experimental validation on an UAV","volume":"8","author":"Khalaf","year":"2017","journal-title":"Gyrosc. Navig."},{"key":"ref_47","unstructured":"Gay, R., and Maybeck, P. (1995, January 22\u201326). An Integrated GPS\/INS\/BARO and Radar Altimeter System for Aircraft Precision Approach Landings. Proceedings of the IEEE National Aerospace and Electronics Conference, Dayton, OH, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.3390\/s18041169","article-title":"Infrared and Visible Image Fusion Based on Different Constraints in the Non-Subsampled Shearlet Transform Domain","volume":"18","author":"Huang","year":"2018","journal-title":"Sensors"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.inffus.2018.02.004","article-title":"Infrared and Visible Image Fusion methods and Applications: A Survey","volume":"45","author":"Ma","year":"2019","journal-title":"Inform. Fusion"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Dong, J., Fei, X., and Soatto, S. (2017, January 21\u201326). Visual-Inertial-Semantic Scene Representation for 3D Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.380"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TASE.2016.2550621","article-title":"Monocular Visual-Inertial State Estimation with Online Initialization and Camera-IMU Extrinsic Calibration","volume":"14","author":"Yang","year":"2017","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/LRA.2016.2521413","article-title":"Simultaneous State Initialization and Gyroscope Bias Calibration in Visual Inertial Aided Navigation","volume":"2","author":"Kaiser","year":"2017","journal-title":"IEEE Robot. Autom. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/408\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:27:28Z","timestamp":1760185648000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/408"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,20]]},"references-count":52,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["s19020408"],"URL":"https:\/\/doi.org\/10.3390\/s19020408","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,20]]}}}