{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:21:34Z","timestamp":1760710894628,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T00:00:00Z","timestamp":1647388800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Project of State Key Laboratory of Industrial Control Technology, Zhejiang University, China","award":["No.ICT2021A10"],"award-info":[{"award-number":["No.ICT2021A10"]}]},{"name":"the Fundamental Research Funds for the Central\u00a0Universities","award":["No.2021FZZX003-01-06"],"award-info":[{"award-number":["No.2021FZZX003-01-06"]}]},{"name":"National Key R&amp;D Program of China","award":["2016YFD0200701-3"],"award-info":[{"award-number":["2016YFD0200701-3"]}]},{"DOI":"10.13039\/501100012172","name":"Double First Class University Plan","doi-asserted-by":"publisher","award":["CN"],"award-info":[{"award-number":["CN"]}],"id":[{"id":"10.13039\/501100012172","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the\u00a0National\u00a0Natural\u00a0Science\u00a0Foundation\u00a0of\u00a0China","award":["No.62088101,\u00a061673341"],"award-info":[{"award-number":["No.62088101,\u00a061673341"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The accurate and reliable high-altitude orientation estimation is of great significance for unmanned aerial vehicles (UAVs) localization, and further assists them to conduct some fundamental functions, such as aerial mapping, environmental monitoring, and risk management. However, the traditional orientation estimation is susceptible to electromagnetic interference, high maneuverability, and substantial scale variations. Hence, this paper aims to present a new visual compass algorithm to estimate the orientation of a UAV employing the appearance and geometry structure of the point and line features in the remote sensing images. In this study, a coarse-to-fine feature tracking method is used to locate the matched keypoints precisely. An LK-ZNCC algorithm is proposed to match line segments in real-time. A hierarchical fusion method for point and line features is designed to expand the scope of the usage of this system. Many comparative experiments between this algorithm and others are conducted on a UAV. Experimental results show that the proposed visual compass algorithm is a reliable, precise, and versatile system applicable to other UAV navigation systems, especially when they do not work in particular situations.<\/jats:p>","DOI":"10.3390\/rs14061430","type":"journal-article","created":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T03:36:23Z","timestamp":1647401783000},"page":"1430","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A Visual Compass Based on Point and Line Features for UAV High-Altitude Orientation Estimation"],"prefix":"10.3390","volume":"14","author":[{"given":"Ying","family":"Liu","sequence":"first","affiliation":[{"name":"State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"given":"Junyi","family":"Tao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8788-1976","authenticated-orcid":false,"given":"Da","family":"Kong","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0043-4904","authenticated-orcid":false,"given":"Yu","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"given":"Ping","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Karantanellis, E., Marinos, V., Vassilakis, E., and Christaras, B. (2020). Object-based analysis using unmanned aerial vehicles (UAVs) for site-specific landslide assessment. Remote Sens., 12.","DOI":"10.3390\/rs12111711"},{"key":"ref_2","first-page":"17","article-title":"Review on gps attitude determination","volume":"36","author":"Xu","year":"2003","journal-title":"J. Nav. Univ. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, Y., Zahran, S., Zhuang, Y., Gao, Z., Luo, Y., He, Z., Pei, L., Chen, R., and El-Sheimy, N. (2019). IMU\/magnetometer\/barometer\/mass-flow sensor integrated indoor quadrotor UAV localization with robust velocity updates. Remote Sens., 11.","DOI":"10.3390\/rs11070838"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1016\/j.robot.2012.05.010","article-title":"An accurate and robust visual-compass algorithm for robot-mounted omnidirectional cameras","volume":"60","author":"Mariottini","year":"2012","journal-title":"Robot. Auton. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"199202","DOI":"10.1007\/s11432-018-9748-1","article-title":"Uncalibrated downward-looking UAV visual compass based on clustered point features","volume":"62","author":"Liu","year":"2019","journal-title":"Sci. China Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel tracking and mapping for small AR workspaces. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct sparse odometry","volume":"40","author":"Engel","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","unstructured":"Teed, Z., and Deng, J. (2021). Droid-slam: Deep visual slam for monocular, stereo, and rgb-d cameras. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1109\/LGRS.2020.2985358","article-title":"A New Orientation Estimation Method Based on Rotation Invariant Gradient for Feature Points","volume":"18","author":"Xu","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","unstructured":"Mariottini, G.L., Scheggi, S., Morbidi, F., and Prattichizzo, D. (2009). A robust uncalibrated visual compass algorithm from paracatadioptric line images. First Workshop on Omnidirectional Robot Vision, Lecture Notes in Computer Science, Springer."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1109\/LRA.2017.2650150","article-title":"Phase correlation for dense visual compass from omnidirectional camera-robot images","volume":"2","author":"Morbidi","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_13","unstructured":"Montiel, J.M., and Davison, A.J. (2006, January 15\u201319). A visual compass based on SLAM. Proceedings of the 2006 IEEE International Conference on Robotics and Automation, Orlando, FL, USA. ICRA 2006."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pajdla, T., and Hlav\u00e1\u010d, V. (1999, January 1\u20133). Zero phase representation of panoramic images for image based localization. Proceedings of the International Conference on Computer Analysis of Images and Patterns, Ljubljana, Slovenia.","DOI":"10.1007\/3-540-48375-6_66"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.robot.2004.03.014","article-title":"Image-based memory for robot navigation using properties of omnidirectional images","volume":"47","author":"Menegatti","year":"2004","journal-title":"Robot. Auton. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.robot.2005.12.001","article-title":"Efficient visual homing based on Fourier transformed panoramic images","volume":"54","author":"Mallot","year":"2006","journal-title":"Robot. Auton. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Differt, D. (2017, January 10\u201312). Real-time rotational image registration. Proceedings of the 2017 18th International Conference on Advanced Robotics (ICAR), Hong Kong, China.","DOI":"10.1109\/ICAR.2017.8023488"},{"key":"ref_18","unstructured":"Makadia, A., Geyer, C., Sastry, S., and Daniilidis, K. (2005, January 20\u201325). Radon-based structure from motion without correspondences. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.robot.2008.10.002","article-title":"An appearance-based visual compass for mobile robots","volume":"57","author":"Sturm","year":"2009","journal-title":"Robot. Auton. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"7810","DOI":"10.1109\/TIE.2018.2884231","article-title":"FVC: A novel nonmagnetic compass","volume":"66","author":"Lv","year":"2018","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2613","DOI":"10.1109\/LRA.2022.3141751","article-title":"Quasi-globally Optimal and Real-time Visual Compass in Manhattan Structured Environments","volume":"7","author":"Kim","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sabnis, A., and Vachhani, L. (2013, January 28\u201330). A multiple camera based visual compass for a mobile robot in dynamic environment. Proceedings of the 2013 IEEE International Conference on Control Applications (CCA), Hyderabad, India.","DOI":"10.1109\/CCA.2013.6662817"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sturzl, W. (2017, January 22\u201329). A lightweight single-camera polarization compass with covariance estimation. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.572"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/s00138-002-0070-5","article-title":"Fast template matching using bounded partial correlation","volume":"13","author":"Mattoccia","year":"2003","journal-title":"Mach. Vis. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Washington, DC, USA.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Akinlar, C., and Topal, C. (2011, January 11\u201314). Edlines: Real-time line segment detection by edge drawing (ed). Proceedings of the 2011 18th IEEE International Conference on Image Processing, Brussels, Belgium.","DOI":"10.1109\/ICIP.2011.6116138"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1016\/j.patrec.2011.06.001","article-title":"EDLines: A real-time line segment detector with a false detection control","volume":"32","author":"Akinlar","year":"2011","journal-title":"Pattern Recognit. Lett."},{"key":"ref_28","first-page":"226","article-title":"A density-based algorithm for discovering clusters in large spatial databases with noise","volume":"96","author":"Ester","year":"1996","journal-title":"KDD"},{"key":"ref_29","first-page":"147","article-title":"A combined corner and edge detector","volume":"2","author":"Harris","year":"1988","journal-title":"Alvey Vis. Conf."},{"key":"ref_30","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, IJCAI \u201981, Vancouver, BC, Canada."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, Y., Zhao, J., Guo, Y., He, W., and Yuan, K. (2018). Pl-vio: Tightly-coupled monocular visual\u2013inertial odometry using point and line features. Sensors, 18.","DOI":"10.3390\/s18041159"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A computational approach to edge detection","volume":"PAMI-8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","unstructured":"Hough, P.V. (1962). Method and Means for Recognizing Complex Patterns. (3,069,654), U.S. Patent."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1016\/0167-8655(90)90042-Z","article-title":"A new curve detection method: Randomized Hough transform (RHT)","volume":"11","author":"Xu","year":"1990","journal-title":"Pattern Recognit. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/0031-3203(91)90073-E","article-title":"A probabilistic Hough transform","volume":"24","author":"Kiryati","year":"1991","journal-title":"Pattern Recognit."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1049\/ip-vis:20010354","article-title":"Gradient based progressive probabilistic Hough transform","volume":"148","author":"Galambos","year":"2001","journal-title":"IEEE Proc.-Vis. Image Signal Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.patcog.2007.04.003","article-title":"Real-time line detection through an improved Hough transform voting scheme","volume":"41","author":"Fernandes","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5201\/ipol.2012.gjmr-lsd","article-title":"LSD: A line segment detector","volume":"2","author":"Jakubowicz","year":"2012","journal-title":"Image Process. Online"},{"key":"ref_39","first-page":"722","article-title":"LSD: A fast line segment detector with a false detection control","volume":"32","author":"Jakubowicz","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Fan, B., Wu, F., and Hu, Z. (2010, January 13\u201318). Line matching leveraged by point correspondences. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540186"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1016\/j.patcog.2008.08.035","article-title":"MSLD: A robust descriptor for line matching","volume":"42","author":"Wang","year":"2009","journal-title":"Pattern Recognit."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1016\/j.jvcir.2013.05.006","article-title":"An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency","volume":"24","author":"Zhang","year":"2013","journal-title":"J. Vis. Commun. Image Represent."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/6\/1430\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:37:11Z","timestamp":1760135831000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/6\/1430"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,16]]},"references-count":42,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["rs14061430"],"URL":"https:\/\/doi.org\/10.3390\/rs14061430","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,3,16]]}}}