{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T16:19:32Z","timestamp":1782404372893,"version":"3.54.5"},"reference-count":34,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T00:00:00Z","timestamp":1714348800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>High precision navigation and positioning technology, as a fundamental function, is gradually occupying an indispensable position in the various fields. However, a single sensor cannot meet the navigation requirements in different scenarios. This paper proposes a \u201cplug and play\u201d Vision\/IMU\/UWB multi-sensor tightly-coupled system based on factor graph. The difference from traditional UWB-based tightly-coupled models is that the Vision\/IMU\/UWB tightly-coupled model in this study uses UWB base station coordinates as parameters for real-time estimation without pre-calibrating UWB base stations. Aiming at the dynamic change of sensor availability in multi-sensor integrated navigation system and the serious problem of traditional factor graph in the weight distribution of observation information, this study proposes an adaptive robust factor graph model. Based on redundant measurement information, we propose a novel adaptive estimation model for UWB ranging covariance, which does not rely on prior information of the system and can adaptively estimate real-time covariance changes of UWB ranging. The algorithm proposed in this study was extensively tested in real-world scenarios, and the results show that the proposed system is superior to the most advanced combination method in all cases. Compared with the visual-inertial odometer based on the factor graph (FG-VIO), the RMSE is improved by 62.83 and 64.26% in scene 1 and 82.15, 70.32, and 75.29% in scene 2 (non-line-of-sight environment).<\/jats:p>","DOI":"10.3389\/fnbot.2024.1343644","type":"journal-article","created":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T04:35:34Z","timestamp":1714365334000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["RFG-TVIU: robust factor graph for tightly coupled vision\/IMU\/UWB integration"],"prefix":"10.3389","volume":"18","author":[{"given":"Gongjun","family":"Fan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qing","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gaochao","family":"Yang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengfei","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,4,29]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","DOI":"10.1109\/ITSC.2016.7795656","article-title":"A cooperative fusion architecture for robust localization: application to autonomous driving","author":"Bresson","year":"2016"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"4702","DOI":"10.3390\/s20174702","article-title":"GNSS\/IMU\/ODO\/LiDAR-SLAM integrated navigation system using IMU\/ODO pre-integration","volume":"20","author":"Chang","year":"2020","journal-title":"Sensors"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"45","DOI":"10.3390\/robotics7030045","article-title":"A review of visual-inertial simultaneous localization and mapping from filtering-based and optimization-based perspectives","volume":"7","author":"Chen","year":"2018","journal-title":"Robotics"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1007\/978-3-642-54740-9_64","article-title":"Tightly coupled SLAM\/GNSS for land vehicle navigation","volume":"305","author":"Cheng","year":"2014","journal-title":"Lect. Notes Electr. Eng."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"797","DOI":"10.3390\/aerospace9120797","article-title":"Approaching and landing of UAVs","volume":"9","author":"Dong","year":"2022","journal-title":"Aerospace"},{"key":"ref6","first-page":"267","article-title":"A non-smooth Levenberg-Marquardt method for generalized complementarity problem","volume":"7","author":"Du","year":"2012","journal-title":"J. Inform. Comput. Sci."},{"key":"ref7","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1007\/s10291-017-0687-5","article-title":"Combined GPS and BDS for single-frequency continuous RTK positioning through real-time estimation of differential inter-system biases","volume":"22","author":"Gao","year":"2017","journal-title":"GPS Solutions"},{"key":"ref8","article-title":"Robust and precise vehicle localization based on multi-sensor fusion in Diverse City scenarios","author":"Guowei","year":"2018"},{"key":"ref9","article-title":"Tightly coupled visual-inertial-UWB indoor localization system with multiple position-unknown anchors","author":"Hu","year":"2023","journal-title":"IEEE Robot. Automat. Lett."},{"key":"ref10","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1016\/j.robot.2013.05.001","article-title":"Information fusion in navigation systems via factor graph based incremental smoothing","volume":"61","author":"Indelman","year":"2013","journal-title":"Robotics Auton. Syst."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"61525","DOI":"10.1109\/ACCESS.2023.3279292","article-title":"VIUNet: deep visual\u2013inertial\u2013UWB fusion for indoor UAV localization. IEEE","volume":"11","author":"Kao","year":"2023","journal-title":"Access"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1007\/s11235-020-00709-2","article-title":"Research on a factor graph-based robust UWB positioning algorithm in NLOS environments","volume":"76","author":"Li","year":"2021","journal-title":"Telecommun. Syst."},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.3390\/rs11060610","article-title":"Tight fusion of a monocular camera, MEMS-IMU, and single-frequency multi-GNSS RTK for precise navigation in GNSS-challenged environments","volume":"11","author":"Li","year":"2019","journal-title":"Remote Sens."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"2116","DOI":"10.1109\/TITS.2023.3314836","article-title":"Tightly coupled integration of GNSS\/UWB\/VIO for reliable and seamless positioning","volume":"25","author":"Liu","year":"","journal-title":"IEEE Trans. Intell. Transport. Syst"},{"key":"ref15","first-page":"1421","article-title":"GOMSF: graph-optimization based multi-sensor fusion for robust UAV pose estimation","author":"Mascaro","year":"2018"},{"key":"ref16","first-page":"7","article-title":"Multi-sensor fusion for motion estimation in visually-degraded environments","author":"Mikhail","year":"2019"},{"key":"ref17","first-page":"3565","article-title":"A multi-state constraint Kalman filter for vision-aided inertial navigation","author":"Mourikis","year":"2007"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"1678","DOI":"10.1109\/LRA.2021.3057838","article-title":"Range-focused fusion of camera-IMU-UWB for accurate and drift-reduced localization","volume":"6","author":"Nguyen","year":"2021","journal-title":"IEEE Robot. Automat. Lett."},{"key":"ref19","doi-asserted-by":"publisher","first-page":"2347","DOI":"10.3390\/s22062347","article-title":"UWB and IMU-based UAV\u2019s assistance system for autonomous landing on a platform","volume":"22","author":"Ochoa-de-Eribe-Landaberea","year":"2022","journal-title":"Sensors"},{"key":"ref20","article-title":"Asynchronous multi-sensor fusion for 3DMapping and localization","author":"Patrick","year":"2018"},{"key":"ref21","doi-asserted-by":"crossref","first-page":"1244","DOI":"10.3390\/s18041244","article-title":"Tightly-coupled GNSS\/vision using a sky-pointing camera for vehicle navigation in urban areas","volume":"18","author":"Paul","year":"2018","journal-title":"Sensors"},{"key":"ref22","first-page":"1","article-title":"VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator","volume":"99","author":"Qin Tong","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref23","article-title":"Vehicle localization with tightly coupled GNSS and visual Odometry","author":"Schreiber","year":"2016","journal-title":"IEEE Intel. Vehicles Symp."},{"key":"ref24","first-page":"370","article-title":"Stereo visual inertial LiDAR simultaneous localization and mapping","author":"Shao","year":"2019"},{"key":"ref25","first-page":"6568","article-title":"UWB\/LiDAR fusion for cooperative range-only SLAM","author":"Song","year":"2019"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"1078","DOI":"10.1109\/TITS.2016.2595618","article-title":"Sensor fusion-based low-cost vehicle localization system for complex urban environments","volume":"18","author":"Suhr","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref27","first-page":"1885","article-title":"Direct visual-inertial odometry with stereo cameras","author":"Usenko","year":"2016"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"107565","DOI":"10.1016\/j.ymssp.2020.107565","article-title":"An improved integrated navigation method with enhanced robustness based on factor graph","volume":"155","author":"Wei","year":"2021","journal-title":"Mech. Syst. Signal Process."},{"key":"ref29","doi-asserted-by":"publisher","first-page":"312","DOI":"10.3390\/drones6110312","article-title":"C2VIR-SLAM: centralized collaborative visual-inertial-range simultaneous localization and mapping","volume":"6","author":"Xie","year":"2022","journal-title":"Drones"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"772","DOI":"10.3390\/rs13040772","article-title":"Robust visual-inertial navigation system for low precision sensors under indoor and outdoor environments","volume":"13","author":"Xu","year":"2021","journal-title":"Remote Sens."},{"key":"ref31","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1109\/TASE.2016.2550621","article-title":"Monocular visual\u2013inertial state estimation with online initialization and camera\u2013IMU extrinsic calibration","volume":"14","author":"Yang","year":"2017","journal-title":"IEEE Trans. Automat. Sci. Eng."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"27967","DOI":"10.1109\/JSEN.2021.3123973","article-title":"PLS-VINS: visual inertial state estimator with point-line features fusion and structural constraints","volume":"21","author":"Yang","year":"2021","journal-title":"IEEE Sensors J."},{"key":"ref33","article-title":"Monocular camera and IMU integration for indoor position estimation","author":"Zhang","year":"2014"},{"key":"ref34","article-title":"Graphical approach for MAV sensors fusion","author":"Zheng","year":"2016"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1343644\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,29]],"date-time":"2024-04-29T04:35:40Z","timestamp":1714365340000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1343644\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,29]]},"references-count":34,"alternative-id":["10.3389\/fnbot.2024.1343644"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1343644","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,29]]},"article-number":"1343644"}}