{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:06:04Z","timestamp":1760238364979,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2020,8,6]],"date-time":"2020-08-06T00:00:00Z","timestamp":1596672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91420203; 90920304; 91120010"],"award-info":[{"award-number":["91420203; 90920304; 91120010"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Equipment Pre-development Project","award":["41417070401"],"award-info":[{"award-number":["41417070401"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual-inertial navigation systems are credited with superiority over both pure visual approaches and filtering ones. In spite of the high precision many state-of-the-art schemes have attained, yaw remains unobservable in those systems all the same. More accurate yaw estimation not only means more accurate attitude calculation but also leads to better position estimation. This paper presents a novel scheme that combines visual and inertial measurements as well as magnetic information for suppressing deviation in yaw. A novel method for initializing visual-inertial-magnetic odometers, which recovers the directions of magnetic north and gravity, the visual scalar factor, inertial measurement unit (IMU) biases etc., has been conceived, implemented, and validated. Based on non-linear optimization, a magnetometer cost function is incorporated into the overall optimization objective function as a yawing constraint among others. We have done extensive research and collected several datasets recorded in large-scale outdoor environments to certify the proposed system\u2019s viability, robustness, and performance. Cogent experiments and quantitative comparisons corroborate the merits of the proposed scheme and the desired effect of the involvement of magnetic information on the overall performance.<\/jats:p>","DOI":"10.3390\/s20164386","type":"journal-article","created":{"date-parts":[[2020,8,6]],"date-time":"2020-08-06T09:41:21Z","timestamp":1596706881000},"page":"4386","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["VIMO: A Visual-Inertial-Magnetic Navigation System Based on Non-Linear Optimization"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1902-9271","authenticated-orcid":false,"given":"Jingzhe","family":"Wang","sequence":"first","affiliation":[{"name":"School of Automation, Beijing Institute of Technology, Beijing 100081, China"}]},{"given":"Leilei","family":"Li","sequence":"additional","affiliation":[{"name":"School of Automation, Beijing Institute of Technology, Beijing 100081, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9434-3693","authenticated-orcid":false,"given":"Huan","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Automation, Beijing Institute of Technology, Beijing 100081, China"}]},{"given":"Xunya","family":"Gui","sequence":"additional","affiliation":[{"name":"School of Automation, Beijing Institute of Technology, Beijing 100081, China"}]},{"given":"Zucheng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Automation, Beijing Institute of Technology, Beijing 100081, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,6]]},"reference":[{"key":"ref_1","unstructured":"Goldenberg, F. (2006, January 25\u201327). Geomagnetic Navigation Beyond the Magnetic Compass. Proceedings of the 2006 IEEE\/ION Position, Location, and Navigation Symposium, Coronado, CA, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Caruso, D., Eudes, A., Sanfourche, M., Vissiere, D., and Le Besnerais, G. (2017, January 18\u201321). An inverse square root filter for robust indoor\/outdoor magneto-visual-inertial odometry. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115888"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TPAMI.2007.1049","article-title":"MonoSLAM: Real-time single camera SLAM","volume":"29","author":"Davison","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Strasdat, H., Montiel, J., and Davison, A. (2010, January 3\u20137). Real-time monocular SLAM: Why filter?. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509636"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"854","DOI":"10.1002\/rob.20412","article-title":"Monocular-SLAM-Based Navigation for Autonomous Micro Helicopters in GPS-Denied Environments","volume":"28","author":"Weiss","year":"2011","journal-title":"J. Field Robot."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Eade, E., and Drummond, T. (2007, January 14\u201321). Monocular SLAM as a Graph of Coalesced Observations. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409098"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mur-Artal, R., and Tardos, J. (2015, January 13\u201317). Probabilistic Semi-Dense Mapping from Highly Accurate Feature-Based Monocular SLAM. Proceedings of the Robotics: Science and Systems, Rome, Italy.","DOI":"10.15607\/RSS.2015.XI.041"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.robot.2017.09.010","article-title":"Keyframe-based monocular SLAM: Design, survey, and future directions","volume":"98","author":"Younes","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1646","DOI":"10.1016\/j.robot.2014.03.012","article-title":"Scale-aware navigation of a low-cost quadrocopter with a monocular camera","volume":"62","author":"Engel","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/LRA.2017.2653359","article-title":"Visual-Inertial Monocular SLAM with Map Reuse","volume":"2","author":"Tardos","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, P., Qin, T., Hu, B., Zhu, F., and Shen, S. (2017, January 9\u201313). Monocular Visual-Inertial State Estimation for Mobile Augmented Reality. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Nantes, France.","DOI":"10.1109\/ISMAR.2017.18"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Han, Y., Wei, C., Li, R., Wang, J., and Yu, H. (2020). A Novel Cooperative Localization Method Based on IMU and UWB. Sensors, 20.","DOI":"10.3390\/s20020467"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bai, X., Wen, W., and Hsu, L.T. (2020). Robust Visual-Inertial Integrated Navigation System Aided by Online Sensor Model Adaption for Autonomous Ground Vehicles in Urban Areas. Remote Sens., 12.","DOI":"10.20944\/preprints202003.0018.v1"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dinh, N., and Kim, G.W. (2020). Robust Stereo Visual Inertial Navigation System Based on Multi-Stage Outlier Removal in Dynamic Environments. Sensors, 20.","DOI":"10.3390\/s20102922"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, J., Ren, M., Wang, P., Meng, J., and Mu, Y. (2020). Indoor Localization Based on VIO System and Three-Dimensional Map Matching. Sensors, 20.","DOI":"10.3390\/s20102790"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lee, K., and Johnson, E. (2020). Latency Compensated Visual-Inertial Odometry for Agile Autonomous Flight. Sensors, 20.","DOI":"10.3390\/s20082209"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Weiss, S., and Siegwart, R. (2011, January 9\u201313). Real-time metric state estimation for modular vision-inertial systems. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979982"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mourikis, A., and Roumeliotis, S. (2007, January 10\u201314). A Multi-State Constraint Kalman Filter for Vision-Aided Inertial Navigation. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bloesch, M., Omari, S., Hutter, M., and Siegwart, R. (October, January 28). Robust visual inertial odometry using a direct EKF-based approach. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353389"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bryson, M., Johnson-Roberson, M., and Sukkarieh, S. (2009, January 12\u201317). Airborne smoothing and mapping using vision and inertial sensors. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152678"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1177\/0278364914554813","article-title":"Keyframe-Based Visual-Inertial Odometry Using Nonlinear Optimization","volume":"34","author":"Leutenegger","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TRO.2016.2597321","article-title":"On-Manifold Preintegration for Real-Time Visual-Inertial Odometry","volume":"33","author":"Forster","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kneip, L., Weiss, S., and Siegwart, R. (2011, January 25\u201330). Deterministic initialization of metric state estimation filters for loosely-coupled monocular vision-inertial systems. Proceedings of the 2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA, USA.","DOI":"10.1109\/IROS.2011.6094699"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Faessler, M., Fontana, F., Forster, C., and Scaramuzza, D. (2015, January 26\u201330). Automatic Re-Initialization and Failure Recovery for Aggressive Flight with a Monocular Vision-Based Quadrotor. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139420"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Weiss, S., Brockers, R., Albrektsen, S., and Matthies, L. (2015, January 5\u20139). Inertial Optical Flow for Throw-and-Go Micro Air Vehicles. Proceedings of the 2015 IEEE Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV.2015.42"},{"key":"ref_26","first-page":"1","article-title":"Monocular Visual-Inertial State Estimation with Online Initialization and Camera-IMU Extrinsic Calibration","volume":"14","author":"Yang","year":"2016","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1007\/s11263-013-0647-7","article-title":"Closed-Form Solution of Visual-Inertial Structure from Motion","volume":"106","author":"Martinelli","year":"2014","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1182","DOI":"10.1109\/TMECH.2019.2963439","article-title":"Active SLAM for Mobile Robots With Area Coverage and Obstacle Avoidance","volume":"25","author":"Chen","year":"2020","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Trivun, D., Salaka, E., Osmankovic, D., Velagic, J., and Osmic, N. (2015, January 17\u201319). Active SLAM-based algorithm for autonomous exploration with mobile robot. Proceedings of the 2015 IEEE International Conference on Industrial Technology (ICIT), Seville, Spain.","DOI":"10.1109\/ICIT.2015.7125079"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"81479","DOI":"10.1109\/ACCESS.2020.2991465","article-title":"Submap-based indoor navigation system for the Fetch robot","volume":"8","author":"Chen","year":"2020","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1017\/S0263574719000754","article-title":"Autonomous Area Exploration and Mapping in Underground Mine Environments by Unmanned Aerial Vehicles","volume":"38","author":"Li","year":"2020","journal-title":"Robotica"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TRO.2018.2872402","article-title":"Attention and Anticipation in Fast Visual-Inertial Navigation","volume":"35","author":"Carlone","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1109\/TSP.2008.2007095","article-title":"Sensor selection via convex optimization","volume":"57","author":"Joshi","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_34","unstructured":"Li, M., Yu, H., Zheng, X., and Mourikis, A. (June, January 31). High-fidelity sensor modeling and self-calibration in vision-aided inertial navigation. Proceedings of the IEEE International Conference on Robotics and Automation, Hong Kong, China."},{"key":"ref_35","unstructured":"Shi, J., and Tomasi, C. (1994, January 21\u201323). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_36","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_38","unstructured":"Eade, E. (2020, July 23). Lie Groups for 2d and 3d Transformations. Available online: http:\/\/ethaneade.com\/lie.pdf."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"S\u00fcnderhauf, N., and Protzel, P. (2012, January 14\u201318). Towards a robust back-end for pose graph SLAM. Proceedings of the IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224709"},{"key":"ref_40","first-page":"799","article-title":"Robust regression: Asymptotics, conjectures and Monte Carlo","volume":"5","author":"Huber","year":"1973","journal-title":"Ann. Stat."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4386\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:57:05Z","timestamp":1760176625000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4386"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,6]]},"references-count":40,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["s20164386"],"URL":"https:\/\/doi.org\/10.3390\/s20164386","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,8,6]]}}}