{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,21]],"date-time":"2025-12-21T06:09:56Z","timestamp":1766297396514,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2024,9,1]],"date-time":"2024-09-01T00:00:00Z","timestamp":1725148800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hong Polytechnic University","award":["P23-0089","ECF120\/2021"],"award-info":[{"award-number":["P23-0089","ECF120\/2021"]}]},{"name":"Environment and Conservation Fund","award":["P23-0089","ECF120\/2021"],"award-info":[{"award-number":["P23-0089","ECF120\/2021"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Precise positioning in an indoor environment is a challenging task because it is difficult to receive a strong and reliable global positioning system (GPS) signal. For existing wireless indoor positioning methods, ultra-wideband (UWB) has become more popular because of its low energy consumption and high interference immunity. Nevertheless, factors such as indoor non-line-of-sight (NLOS) obstructions can still lead to large errors or fluctuations in the measurement data. In this paper, we propose a fusion method based on ultra-wideband (UWB), inertial measurement unit (IMU), and visual simultaneous localization and mapping (V-SLAM) to achieve high accuracy and robustness in tracking a mobile robot in a complex indoor environment. Specifically, we first focus on the identification and correction between line-of-sight (LOS) and non-line-of-sight (NLOS) UWB signals. The distance evaluated from UWB is first processed by an adaptive Kalman filter with IMU signals for pose estimation, where a new noise covariance matrix using the received signal strength indicator (RSSI) and estimation of precision (EOP) is proposed to reduce the effect due to NLOS. After that, the corrected UWB estimation is tightly integrated with IMU and visual SLAM through factor graph optimization (FGO) to further refine the pose estimation. The experimental results show that, compared with single or dual positioning systems, the proposed fusion method provides significant improvements in positioning accuracy in a complex indoor environment.<\/jats:p>","DOI":"10.3390\/rs16173245","type":"journal-article","created":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T07:59:40Z","timestamp":1725263980000},"page":"3245","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["UVIO: Adaptive Kalman Filtering UWB-Aided Visual-Inertial SLAM System for Complex Indoor Environments"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7242-7695","authenticated-orcid":false,"given":"Junxi","family":"Li","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China"}]},{"given":"Shouwen","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China"}]},{"given":"Jiahui","family":"Hao","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China"}]},{"given":"Biao","family":"Ma","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7225-6927","authenticated-orcid":false,"given":"Henry K.","family":"Chu","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Geneva, P., Eckenhoff, K., Lee, W., Yang, Y., and Huang, G. (August, January 31). OpenVINS: A Research Platform for Visual-Inertial Estimation. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196524"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1109\/JSEN.2015.2477444","article-title":"Tightly-Coupled Integration of WiFi and MEMS Sensors on Handheld Devices for Indoor Pedestrian Navigation","volume":"16","author":"Zhuang","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_5","unstructured":"Qin, T., Cao, S., Pan, J., and Shen, S. (2019). A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1109\/TRO.2019.2899783","article-title":"PL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments","volume":"35","author":"Moreno","year":"2019","journal-title":"IEEE Trans. Robot."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3929","DOI":"10.1109\/JSYST.2019.2903278","article-title":"Passive Localization of Standard WiFi Devices","volume":"13","author":"Li","year":"2019","journal-title":"IEEE Syst. J."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hu, S., He, K., Yang, X., and Peng, S. (2022, January 11\u201312). Bluetooth Fingerprint based Indoor Localization using Bi-LSTM. Proceedings of the 2022 31st Wireless and Optical Communications Conference (WOCC), Shenzhen, China.","DOI":"10.1109\/WOCC55104.2022.9880608"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Watthanawisuth, N., Tuantranont, A., and Kerdcharoen, T. (2014, January 22\u201325). Design of mobile robot for real world application in path planning using ZigBee localization. Proceedings of the 2014 14th International Conference on Control, Automation and Systems (ICCAS 2014), Gyeonggi-do, Republic of Korea.","DOI":"10.1109\/ICCAS.2014.6987828"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"10896","DOI":"10.1109\/TVT.2018.2870160","article-title":"Augmentation of Fingerprints for Indoor WiFi Localization Based on Gaussian Process Regression","volume":"67","author":"Sun","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"13608","DOI":"10.1109\/JIOT.2021.3067515","article-title":"Indoor Localization Fusing WiFi With Smartphone Inertial Sensors Using LSTM Networks","volume":"8","author":"Zhang","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Silva, B., Pang, Z., \u00c5kerberg, J., Neander, J., and Hancke, G. (2014, January 1\u20133). Experimental study of UWB-based high precision localization for industrial applications. Proceedings of the 2014 IEEE International Conference on Ultra-WideBand (ICUWB), Paris, France.","DOI":"10.1109\/ICUWB.2014.6958993"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1905","DOI":"10.1109\/78.301830","article-title":"A simple and efficient estimator for hyperbolic location","volume":"42","author":"Chan","year":"1994","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, Y., Zhu, X., Bo, X., Yang, Z., and Zhao, Z. (2021, January 28\u201331). Ultra-wideband high precision positioning system based on SDS-TWR algorithm. Proceedings of the 2021 International Applied Computational Electromagnetics Society (ACES-China) Symposium, Chengdu, China.","DOI":"10.23919\/ACES-China52398.2021.9581365"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hol, J.D., Dijkstra, F., Luinge, H., and Schon, T.B. (2009, January 9\u201311). Tightly coupled UWB\/IMU pose estimation. Proceedings of the 2009 IEEE International Conference on Ultra-Wideband, Vancouver, BC, Canada.","DOI":"10.1109\/ICUWB.2009.5288724"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/LRA.2019.2943821","article-title":"Improving the Accuracy and Robustness of Ultra-Wideband Localization Through Sensor Fusion and Outlier Detection","volume":"5","author":"Dwek","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4340","DOI":"10.1109\/TVT.2020.2974667","article-title":"A New Quaternion Kalman Filter Based Foot-Mounted IMU and UWB Tightly-Coupled Method for Indoor Pedestrian Navigation","volume":"69","author":"Wen","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chen, Z., Xu, A., Sui, X., Wang, C., Wang, S., Gao, J., and Shi, Z. (2022). Improved-UWB\/LiDAR-SLAM Tightly Coupled Positioning System with NLOS Identification Using a LiDAR Point Cloud in GNSS-Denied Environments. Remote Sens., 14.","DOI":"10.3390\/rs14061380"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zeng, Q., Liu, D., and Lv, C. (2019). UWB\/Binocular VO Fusion Algorithm Based on Adaptive Kalman Filter. Sensors, 19.","DOI":"10.3390\/s19184044"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1678","DOI":"10.1109\/LRA.2021.3057838","article-title":"Range-Focused Fusion of Camera-IMU-UWB for Accurate and Drift-Reduced Localization","volume":"6","author":"Nguyen","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, B., Li, J., and Zhang, H. (June, January 30). UVIP: Robust UWB aided Visual-Inertial Positioning System for Complex Indoor Environments. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561208"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ding, L., Zhu, X., Zhou, T., Wang, Y., Jie, Y., and Su, Y. (2018, January 4\u20136). Research on UWB-Based Indoor Ranging Positioning Technolog and a Method to Improve Accuracy. Proceedings of the 2018 IEEE Region Ten Symposium (Tensymp), Sydney, NSW, Australia.","DOI":"10.1109\/TENCONSpring.2018.8692064"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mazraani, R., Saez, M., Govoni, L., and Knobloch, D. (2017, January 21\u201325). Experimental results of a combined TDOA\/TOF technique for UWB based localization systems. Proceedings of the 2017 IEEE International Conference on Communications Workshops (ICC Workshops), Paris, France.","DOI":"10.1109\/ICCW.2017.7962796"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gu, Y., and Yang, B. (2018, January 19\u201321). Clock Compensation Two-Way Ranging (CC-TWR) Based on Ultra-Wideband Communication. Proceedings of the 2018 Eighth International Conference on Instrumentation & Measurement, Computer, Communication and Control (IMCCC), Harbin, China.","DOI":"10.1109\/IMCCC.2018.00238"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1109\/TSP.2004.823465","article-title":"Least squares algorithms for time-of-arrival-based mobile location","volume":"52","author":"Cheung","year":"2004","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Malyavej, V., and Udomthanatheera, P. (2014, January 1\u20133). RSSI\/IMU sensor fusion-based localization using unscented Kalman filter. Proceedings of the The 20th Asia-Pacific Conference on Communication (APCC2014), Pattaya, Thailand.","DOI":"10.1109\/APCC.2014.7091638"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fakharian, A., Gustafsson, T., and Mehrfam, M. (2011, January 11\u201313). Adaptive Kalman filtering based navigation: An IMU\/GPS integration approach. Proceedings of the 2011 International Conference on Networking, Sensing and Control, Delft, The Netherlands.","DOI":"10.1109\/ICNSC.2011.5874871"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tardif, J.P., George, M., Laverne, M., Kelly, A., and Stentz, A. (2010, January 18\u201322). A new approach to vision-aided inertial navigation. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5651059"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lee, Y., and Lim, D. (2019, January 3\u20136). Vision\/UWB\/IMU sensor fusion based localization using an extended Kalman filter. Proceedings of the 2019 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE), Yunlin, Taiwan.","DOI":"10.1109\/ECICE47484.2019.8942733"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, R., Fu, D., Chen, G., Dong, L., Wang, X., and Tian, M. (2022, January 16\u201318). Research on UWB-Based Data Fusion Positioning Method. Proceedings of the 2022 28th International Conference on Mechatronics and Machine Vision in Practice (M2VIP), Nanjing, China.","DOI":"10.1109\/M2VIP55626.2022.10041062"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sabatelli, S., Galgani, M., Fanucci, L., and Rocchi, A. (2012, January 7\u20139). A double stage Kalman filter for sensor fusion and orientation tracking in 9D IMU. Proceedings of the 2012 IEEE Sensors Applications Symposium Proceedings, Brescia, Italy.","DOI":"10.1109\/SAS.2012.6166315"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1719","DOI":"10.1109\/TCOMM.2012.042712.110035","article-title":"A Machine Learning Approach to Ranging Error Mitigation for UWB Localization","volume":"60","author":"Wymeersch","year":"2012","journal-title":"IEEE Trans. Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1109\/JSAC.2010.100907","article-title":"NLOS identification and mitigation for localization based on UWB experimental data","volume":"28","author":"Gifford","year":"2010","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_34","unstructured":"Decawave (2016). Dw1000 Metrics for Estimation of Non Line of Sight Operating Conditions, Decawave. Technical Report aps013 Part 3 Application Note."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Qin, C., Ye, H., Pranata, C.E., Han, J., Zhang, S., and Liu, M. (August, January 31). LINS: A Lidar-Inertial State Estimator for Robust and Efficient Navigation. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9197567"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3245\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:46:50Z","timestamp":1760111210000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/17\/3245"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,1]]},"references-count":35,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["rs16173245"],"URL":"https:\/\/doi.org\/10.3390\/rs16173245","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2024,9,1]]}}}