{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:17:05Z","timestamp":1760242625161,"version":"build-2065373602"},"reference-count":24,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2017,12,4]],"date-time":"2017-12-04T00:00:00Z","timestamp":1512345600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual-inertial Navigation Systems (VINS) are nowadays used for robotic or augmented reality applications. They aim to compute the motion of the robot or the pedestrian in an environment that is unknown and does not have specific localization infrastructure. Because of the low quality of inertial sensors that can be used reasonably for these two applications, state of the art VINS rely heavily on the visual information to correct at high frequency the drift of inertial sensors integration. These methods struggle when environment does not provide usable visual features, such than in low-light of texture-less areas. In the last few years, some work have been focused on using an array of magnetometers to exploit opportunistic stationary magnetic disturbances available indoor in order to deduce a velocity. This led to Magneto-inertial Dead-reckoning (MI-DR) systems that show interesting performance in their nominal conditions, even if they can be defeated when the local magnetic gradient is too low, for example outdoor. We propose in this work to fuse the information from a monocular camera with the MI-DR technique to increase the robustness of both traditional VINS and MI-DR itself. We use an inverse square root filter inspired by the MSCKF algorithm and describe its structure thoroughly in this paper. We show navigation results on a real dataset captured by a sensor fusing a commercial-grade camera with our custom MIMU (Magneto-inertial Measurment Unit) sensor. The fused estimate demonstrates higher robustness compared to pure VINS estimate, specially in areas where vision is non informative. These results could ultimately increase the working domain of mobile augmented reality systems.<\/jats:p>","DOI":"10.3390\/s17122795","type":"journal-article","created":{"date-parts":[[2017,12,4]],"date-time":"2017-12-04T11:16:38Z","timestamp":1512386198000},"page":"2795","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["A Robust Indoor\/Outdoor Navigation Filter Fusing Data from Vision and Magneto-Inertial Measurement Unit"],"prefix":"10.3390","volume":"17","author":[{"given":"David","family":"Caruso","sequence":"first","affiliation":[{"name":"Computer Vision R and D department, Sysnav, 57 rue de Montigny, 27200 Vernon, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandre","family":"Eudes","sequence":"additional","affiliation":[{"name":"Department of Information Processing and Systems, ONERA, the French Aerospace Lab, Chemin de la Huni\u00e8re, 91120 Palaiseau, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martial","family":"Sanfourche","sequence":"additional","affiliation":[{"name":"Department of Information Processing and Systems, ONERA, the French Aerospace Lab, Chemin de la Huni\u00e8re, 91120 Palaiseau, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Vissi\u00e8re","sequence":"additional","affiliation":[{"name":"Computer Vision R and D department, Sysnav, 57 rue de Montigny, 27200 Vernon, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guy","family":"Le Besnerais","sequence":"additional","affiliation":[{"name":"Department of Information Processing and Systems, ONERA, the French Aerospace Lab, Chemin de la Huni\u00e8re, 91120 Palaiseau, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,12,4]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Zhang, J., Kaess, M., and Singh, S. (2014, January 14\u201318). Real-Time Depth Enhanced Monocular Odometry. Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS 2014), Chicago, IL, USA.","key":"ref_1","DOI":"10.1109\/IROS.2014.6943269"},{"doi-asserted-by":"crossref","unstructured":"Guo, C., and Roumeliotis, S.I. (2013, January 3\u20137). IMU-RGBD Camera Navigation Using Point and Plane Features. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan.","key":"ref_2","DOI":"10.1109\/IROS.2013.6696806"},{"doi-asserted-by":"crossref","unstructured":"Konolige, K., Agrawal, M., and Sola, J. (2011). Large-Scale Visual Odometry for Rough Terrain. Robotics Research, Springer.","key":"ref_3","DOI":"10.1007\/978-3-642-14743-2_18"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1177\/0278364914554813","article-title":"Keyframe-Based Visual\u2014Inertial Odometry Using Nonlinear Optimization","volume":"34","author":"Leutenegger","year":"2015","journal-title":"Int. J. Robot. Res."},{"doi-asserted-by":"crossref","unstructured":"Usenko, V., Engel, J., St\u00fcckler, J., and Cremers, D. (2016, January 16\u201321). Direct Visual-Inertial Odometry with Stereo Cameras. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","key":"ref_5","DOI":"10.1109\/ICRA.2016.7487335"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1177\/0278364913481251","article-title":"High-Precision, Consistent EKF-Based Visual\u2014Inertial Odometry","volume":"32","author":"Li","year":"2013","journal-title":"Int. J. Robot. Res."},{"doi-asserted-by":"crossref","unstructured":"Hernandez, J., Tsotsos, K., and Soatto, S. (2015, January 26\u201330). Observability, Identifiability and Sensitivity of Vision-Aided Inertial Navigation. Proceedings of the Robotics and 2015 IEEE International Conference on Automation (ICRA), Seattle, WA, USA.","key":"ref_7","DOI":"10.1109\/ICRA.2015.7139507"},{"unstructured":"Dorveaux, E., Boudot, T., Hillion, M., and Petit, N. (July, January 29). Combining Inertial Measurements and Distributed Magnetometry for Motion Estimation. Proceedings of the American Control Conference (ACC), San Francisco, CA, USA.","key":"ref_8"},{"doi-asserted-by":"crossref","unstructured":"Chesneau, C.I., Hillion, M., and Prieur, C. (2016, January 4\u20137). Motion Estimation of a Rigid Body with an EKF Using Magneto-Inertial Measurements. Proceedings of the IEEE 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Alcala de Henares, Spain.","key":"ref_9","DOI":"10.1109\/IPIN.2016.7743702"},{"doi-asserted-by":"crossref","unstructured":"Chesneau, C.I., Hillion, M., Hullo, J.F., Thibault, G., and Prieur, C. (2017, January 18\u201321). Improving Magneto-Inertial Attitude and Position Estimation by Means of Magnetic Heading Observer. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","key":"ref_10","DOI":"10.1109\/IPIN.2017.8115862"},{"doi-asserted-by":"crossref","unstructured":"Caruso, D., Sanfourche, M., Le Besnerais, G., and Vissiere, D. (2016, January 4\u20137). Infrastructureless Indoor Navigation with an Hybrid Magneto-Inertial and Depth Sensor System. Proceedings of the 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Alcala de Henares, Spain.","key":"ref_11","DOI":"10.1109\/IPIN.2016.7743690"},{"doi-asserted-by":"crossref","unstructured":"Caruso, D., Eudes, A., Sanfourche, M., Vissiere, D., and Le Besnerais, G. (2017, January 24\u201328). Robust Indoor\/Outdoor Navigation through Magneto-Visual-Inertial Optimization-Based Estimation. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","key":"ref_12","DOI":"10.1109\/IROS.2017.8206304"},{"doi-asserted-by":"crossref","unstructured":"Caruso, D., Eudes, A., Sanfourche, M., Vissiere, D., and Le Besnerais, G. (2017, January 18\u201321). An Inverse Square-Root Filter for Robust Indoor\/Outdoor Magneto-Visual-Inertial Odometry. Proceedings of the 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","key":"ref_13","DOI":"10.1109\/IPIN.2017.8115888"},{"doi-asserted-by":"crossref","unstructured":"Wu, K., Ahmed, A., Georgiou, G.A., and Roumeliotis, S.I. (2015, January 13\u201317). A Square Root Inverse Filter for Efficient Vision-Aided Inertial Navigation on Mobile Devices. Proceedings of the 2015 Robotics: Science and Systems Conference, Rome, Italy.","key":"ref_14","DOI":"10.15607\/RSS.2015.XI.008"},{"unstructured":"Anderson, B., and Moore, J. (1979). Optimal Filtering, Prentice-Hall.","key":"ref_15"},{"unstructured":"Forster, C., Carlone, L., Dellaert, F., and Scaramuzza, D. (2015). On-Manifold Preintegration Theory for Fast and Accurate Visual-Inertial Navigation. arXiv.","key":"ref_16"},{"doi-asserted-by":"crossref","unstructured":"Dorveaux, E., Vissiere, D., Martin, A.P., and Petit, N. (2009, January 15\u201318). Iterative Calibration Method for Inertial and Magnetic Sensors. Proceedings of the 48th IEEE Conference on Decision and Control, 2009 Held Jointly with the 2009 28th Chinese Control Conference, CDC\/CCC 2009, Shanghai, China.","key":"ref_17","DOI":"10.1109\/CDC.2009.5399503"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1177\/0278364913509675","article-title":"Camera-IMU-Based Localization: Observability Analysis and Consistency Improvement","volume":"33","author":"Hesch","year":"2014","journal-title":"Int. J. Robot. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1303","DOI":"10.1049\/iet-cta.2009.0032","article-title":"Kalman Filtering with State Constraints: A Survey of Linear and Nonlinear Algorithms","volume":"4","author":"Simon","year":"2010","journal-title":"IET Control Theory Appl."},{"doi-asserted-by":"crossref","unstructured":"Mourikis, A.I., and Roumeliotis, S.I. (2007, January 10\u201314). A Multi-State Constraint Kalman Filter for Vision-Aided Inertial Navigation. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","key":"ref_20","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TASE.2016.2550621","article-title":"Monocular Visual-Inertial State EstimationWith Online Initialization and Camera-IMU Extrinsic Calibration","volume":"14","author":"Yang","year":"2017","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"doi-asserted-by":"crossref","unstructured":"Dong-Si, T.C., and Mourikis, A. (2012, January 7\u201312). Estimator Initialization in Vision-Aided Inertial Navigation with Unknown Camera-IMU Calibration. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal.","key":"ref_22","DOI":"10.1109\/IROS.2012.6386235"},{"doi-asserted-by":"crossref","unstructured":"Furgale, P., Rehder, J., and Siegwart, R. (2013, January 3\u20137). Unified Temporal and Spatial Calibration for Multi-Sensor Systems. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan.","key":"ref_23","DOI":"10.1109\/IROS.2013.6696514"},{"doi-asserted-by":"crossref","unstructured":"Paul, M.K., Wu, K., Hesch, J.A., Nerurkar, E.D., and Roumeliotis, S.I. (June, January 29). A Comparative Analysis of Tightly-Coupled Monocular, Binocular, and Stereo VINS. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","key":"ref_24","DOI":"10.1109\/ICRA.2017.7989022"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2795\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:52:31Z","timestamp":1760208751000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/12\/2795"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,4]]},"references-count":24,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["s17122795"],"URL":"https:\/\/doi.org\/10.3390\/s17122795","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,12,4]]}}}