{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,16]],"date-time":"2026-02-16T03:03:34Z","timestamp":1771211014203,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,23]],"date-time":"2023-01-23T00:00:00Z","timestamp":1674432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Nature Science Foundation of China","award":["42274045"],"award-info":[{"award-number":["42274045"]}]},{"name":"National Nature Science Foundation of China","award":["41774037"],"award-info":[{"award-number":["41774037"]}]},{"name":"National Nature Science Foundation of China","award":["2022M712442"],"award-info":[{"award-number":["2022M712442"]}]},{"name":"Postdoctoral Science Foundation of China","award":["42274045"],"award-info":[{"award-number":["42274045"]}]},{"name":"Postdoctoral Science Foundation of China","award":["41774037"],"award-info":[{"award-number":["41774037"]}]},{"name":"Postdoctoral Science Foundation of China","award":["2022M712442"],"award-info":[{"award-number":["2022M712442"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>For positioning tasks of mobile robots in indoor environments, the emerging positioning technique based on visual inertial odometry (VIO) is heavily influenced by light and suffers from cumulative errors, which cannot meet the requirements of long-term navigation and positioning. In contrast, positioning techniques that rely on indoor signal sources such as 5G and geomagnetism can provide drift-free global positioning results, but their overall positioning accuracy is low. In order to obtain higher precision and more reliable positioning, this paper proposes a fused 5G\/geomagnetism\/VIO indoor localization method. Firstly, the error back propagation neural network (BPNN) model is used to fuse 5G and geomagnetic signals to obtain more reliable global positioning results; secondly, the conversion relationship from VIO local positioning results to the global coordinate system is established through the least squares principle; and finally, a fused 5G\/geomagnetism\/VIO localization system based on the error state extended Kalman filter (ES-EKF) is constructed. The experimental results show that the 5G\/geomagnetism fusion localization method overcomes the problem of low accuracy of single sensor localization and can provide more accurate global localization results. Additionally, after fusing the local and global positioning results, the average positioning error of the mobile robot in the two scenarios is 0.61 m and 0.72 m. Compared with the VINS-mono algorithm, our approach improves the average positioning accuracy in indoor environments by 69.0% and 67.2%, respectively.<\/jats:p>","DOI":"10.3390\/s23031311","type":"journal-article","created":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T01:29:45Z","timestamp":1674523785000},"page":"1311","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A Novel Deep Learning Approach to 5G CSI\/Geomagnetism\/VIO Fused Indoor Localization"],"prefix":"10.3390","volume":"23","author":[{"given":"Chaoyong","family":"Yang","sequence":"first","affiliation":[{"name":"Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, China"}]},{"given":"Zhenhao","family":"Cheng","sequence":"additional","affiliation":[{"name":"Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, China"}]},{"given":"Xiaoxue","family":"Jia","sequence":"additional","affiliation":[{"name":"Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, China"}]},{"given":"Letian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1056-6406","authenticated-orcid":false,"given":"Linyang","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8615-2459","authenticated-orcid":false,"given":"Dongqing","family":"Zhao","sequence":"additional","affiliation":[{"name":"Institute of Geospatial Information, Information Engineering University, Zhengzhou 450001, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"11537","DOI":"10.1109\/LRA.2022.3202349","article-title":"Ctrl-VIO: Continuous-Time Visual-Inertial Odometry for Rolling Shutter Cameras","volume":"7","author":"Lang","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_2","unstructured":"Pieter, V., and Robert, M. (June, January 30). An Equivariant Filter for Visual Inertial Odometry. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Xi\u2019an, China."},{"key":"ref_3","first-page":"58","article-title":"VIO-SLAM Review","volume":"27","author":"Fang","year":"2021","journal-title":"Electron. Opt. Control"},{"key":"ref_4","unstructured":"Ian, S., and Kegen, Y. (2018). Wireless Positioning: Principles and Practice, Springer Nature Singapore."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"225123","DOI":"10.1109\/ACCESS.2020.3044812","article-title":"A TDOA and PDR Fusion Method for 5G Indoor Localization Based on Virtual Base Stations in Unknown Areas","volume":"8","author":"Deng","year":"2021","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Lee, N., and Han, D. (2017, January 18\u201321). Magnetic Indoor Positioning System Using Deep Neural Network. Proceedings of the 8th International Conference on Indoor Positioning and Indoor Navigation (IPIN), Sapporo, Japan.","DOI":"10.1109\/IPIN.2017.8115887"},{"key":"ref_7","first-page":"18","article-title":"High-precision indoor positioning based on robust LM visual inertial odometer and pseudosatellite","volume":"51","author":"Yang","year":"2022","journal-title":"Acta Geod. Et Cartogr. Sin."},{"key":"ref_8","unstructured":"Qin, T., Cao, S., Pan, J., and Shen, S. (2019). A General Optimization-based Framework for Global Pose Estimation with Multiple Sensors. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chen, J., Ou, G., Peng, A., Zheng, L., and Shi, J. (2019). A Hybrid Dead Reckon System Based on 3-Dimensional Dynamic Time Warping. Electronics, 8.","DOI":"10.3390\/electronics8020185"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Barneto, C.B., Riihonen, T., Turunen, M., Koivisto, M., Talvitie, J., and Valkama, M. (2020, January 2\u20134). Radio-based Sensing and Indoor Mapping with Millimeter-Wave 5G NR Signals. Proceedings of the 10th International Conference on Navigation, Localization and GNSS (ICL-GNSS), Tampere, Finland.","DOI":"10.1109\/ICL-GNSS49876.2020.9115568"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5502415","DOI":"10.1109\/TIM.2022.3196748","article-title":"Hi-Loc: Hybrid Indoor Localization via Enhanced 5G NR CSI","volume":"71","author":"Ruan","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kordi, K., Alhammadi, A., and Roslee, M. (2020, January 9\u201311). A Review on Wireless Emerging IoT Indoor Localization. Proceedings of the 5th IEEE International Symposium on Telecommunication Technologies (ISTT), Shah Alam, Malaysia.","DOI":"10.1109\/ISTT50966.2020.9279386"},{"key":"ref_13","unstructured":"He, J., Wang, Q., Zhang, Q., Liu, B., and Yu, Y. (2011, January 11\u201314). A practical indoor TOA ranging error model for localization algorithm. Proceedings of the 22nd IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Toronto, ON, Canada."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"9526532","DOI":"10.1155\/2022\/9526532","article-title":"Indoor Localization with a Single Access Point Based on TDoA and AoA","volume":"2022","author":"Deng","year":"2022","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hoflinger, F., Zhang, R., and Reindl, L.M. (2012, January 23\u201327). Indoor-localization system using a Micro Inertial Measurement Unit (IMU). Proceedings of the 26th European-Frequency-and-Time-Forum (EFTF) Meeting, Gothenburg, Sweden.","DOI":"10.1109\/EFTF.2012.6502421"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"An, J.H., and Choi, L. (2016, January 4\u20138). Inverse Fingerprinting: Server Side Indoor Localization with Bluetooth Low Energy. Proceedings of the 27th IEEE Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), Valencia, Spain.","DOI":"10.1109\/PIMRC.2016.7794891"},{"key":"ref_17","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014). Proceedings of the European Conference on Computer Vision, Springer."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"Orb-slam: Aversatile and accurate monocular slam system","volume":"31","author":"Montiel","year":"2015","journal-title":"In Proc. IEEE Trans. Robot."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 31). Svo: Fast semi-direct monocular visual odometry. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), IEEE, Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906584"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mourikis, A., and Roumeliotis, S. (2007, January 10\u201314). A multi-state constraint Kalman filter for vision-aided inertial navigation. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1177\/0278364914554813","article-title":"Keyframe-based visual\u2013inertial odometry using nonlinear optimization","volume":"34","author":"Leutenegger","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Qin, T., and Shen, S. (2017, January 24\u201328). Robust initialization of monocular visual-inertial estimation on aerial robots. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206284"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Li, P., Qin, T., Hu, B., Zhu, F., and Shen, S. (2017, January 9\u201313). Monocular visual-inertial state estimation for mobile augmented reality. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Nantes, France.","DOI":"10.1109\/ISMAR.2017.18"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Qin, T., Li, P., and Shen, S. (2018, January 21\u201325). Relocalization, global optimization and map merging for monocular visual-inertial slam. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460780"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"VINS-Mono: A robust and versatile monocular visual-inertial state estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, M., and Rajkumar, R.R. (2021\u20131, January 27). Extended VINS-Mono: A Systematic Approach for Absolute and Relative Vehicle Localization in Large-Scale Outdoor Environments. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636776"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kang, R., Xiong, L., Xu, M., Zhao, J., and Zhang, P. (2019, January 27\u201330). VINS-Vehicle: A Tightly-Coupled Vehicle Dynamics Extension to Visual-Inertial State Estimator. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), IEEE, Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8916940"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"11950","DOI":"10.1109\/LRA.2022.3208354","article-title":"UWB-VIO Fusion for Accurate and Robust Relative Localization of Round Robotic Teams","volume":"7","author":"Zheng","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1049\/cmu2.12359","article-title":"Low drift visual inertial odometry with UWB aided for indoor localization","volume":"16","author":"Gao","year":"2022","journal-title":"IET Commun"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1550147719884893","DOI":"10.1177\/1550147719884893","article-title":"A three-dimensional pattern recognition localization system based on a Bayesian graphical model","volume":"16","author":"Alhammadi","year":"2020","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Qiu, K., Huang, H., Li, W., and Luo, D. (2018, January 22\u201323). Indoor Geomagnetic Positioning based on a Joint Algorithm of Particle Filter and Dynamic Time Warp. Proceedings of the 5th IEEE Conference on Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS), IEEE, Wuhan, China.","DOI":"10.1109\/UPINLBS.2018.8559747"},{"key":"ref_33","first-page":"34","article-title":"Indoor fingerprint localization method based on DTW","volume":"37","author":"Xu","year":"2018","journal-title":"Transducer Microsyst. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, S., Li, M., Lin, R., and Ni, Z. (2020, January 12\u201314). Tightly Coupled Algorithm of Visual Inertial Odometry and Magnetometer Fusion. Proceedings of the 5th Information Technology and Mechatronics Engineering Conference (ITOEC), IEEE, Chongqing, China.","DOI":"10.1109\/ITOEC49072.2020.9141790"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"9717629","DOI":"10.1155\/2021\/9717629","article-title":"Application of a WiFi\/Geomagnetic Combined Positioning Method in a Single Access Point Environment","volume":"2021","author":"Pan","year":"2021","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"7472","DOI":"10.1109\/JSEN.2016.2600099","article-title":"Basmag: An Optimized HMM-Based Localization System Using Backward Sequences Matching Algorithm Exploiting Geomagnetic Information","volume":"16","author":"Ma","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2233","DOI":"10.1109\/JSAC.2022.3157397","article-title":"Towards 5G NR high-precision indoor positioning via channel frequency response: A new paradigm and dataset generation method. IEEE J","volume":"40","author":"Gao","year":"2022","journal-title":"Sel. Areas Commun."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Kia, G., Ruotsalainen, L., and Talvitie, J. (2022). A CNN Approach for 5G mmWave Positioning Using Beamformed CSI Measurements. arXiv.","DOI":"10.1109\/ICL-GNSS54081.2022.9797028"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mahbub, M., Saym, M., and Rouf, M. (2020, January 19\u201320). MmWave Propagation Characteristics Analysis for UMa and UMi Wireless Communications. Proceedings of the 2nd International Conference on Sustainable Technologies for Industry 4.0 (STI), Dhaka, Bangladesh.","DOI":"10.1109\/STI50764.2020.9350499"},{"key":"ref_40","first-page":"8","article-title":"Pedometer-free Geomagnetic Fingerprinting with Casual Walking Speed. ACM Trans","volume":"18","author":"Wu","year":"2021","journal-title":"Sen. Netw"},{"key":"ref_41","first-page":"67","article-title":"Multi-source information fusion indoor positioning method based on genetic algorithm to optimize neural network","volume":"28","author":"Liu","year":"2020","journal-title":"J. Chin. Inert. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, G., Geng, E., Ye, Z., Xu, Y., Lin, J., and Pang, Y. (2018). Indoor Positioning Algorithm Based on the Improved RSSI Distance Model. Sensors, 18.","DOI":"10.3390\/s18092820"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1311\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:14:24Z","timestamp":1760120064000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1311"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,23]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23031311"],"URL":"https:\/\/doi.org\/10.3390\/s23031311","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,23]]}}}