{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:27:12Z","timestamp":1760236032303,"version":"build-2065373602"},"reference-count":58,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T00:00:00Z","timestamp":1634169600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The National Key Research and Development Project of China","award":["2020YFB0505602-02"],"award-info":[{"award-number":["2020YFB0505602-02"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>The real-time kinematic positioning technique (RTK) and visual\u2013inertial odometry (VIO) are both promising positioning technologies. However, RTK degrades in GNSS-hostile areas, where global navigation satellite system (GNSS) signals are reflected and blocked, while VIO is affected by long-term drift. The integration of RTK and VIO can improve the accuracy and robustness of positioning. In recent years, smartphones equipped with multiple sensors have become commodities and can provide measurements for integrating RTK and VIO. This paper verifies the feasibility of integrating RTK and VIO using smartphones, and we propose an improved algorithm to integrate RTK and VIO with better performance. We began by developing an Android smartphone application for data collection and then wrote a Python program to convert the data to a robot operating system (ROS) bag. Next, we established two ROS nodes to calculate the RTK results and accomplish the integration. Finally, we conducted experiments in urban areas to assess the integration of RTK and VIO based on smartphones. The results demonstrate that the integration improves the accuracy and robustness of positioning and that our improved algorithm reduces altitude deviation. Our work can aid navigation and positioning research, which is the reason why we open source the majority of the codes at our GitHub.<\/jats:p>","DOI":"10.3390\/ijgi10100699","type":"journal-article","created":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T22:42:18Z","timestamp":1634251338000},"page":"699","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["The Integration of GPS\/BDS Real-Time Kinematic Positioning and Visual\u2013Inertial Odometry Based on Smartphones"],"prefix":"10.3390","volume":"10","author":[{"given":"Zun","family":"Niu","sequence":"first","affiliation":[{"name":"Department of Electronics, Peking University, Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fugui","family":"Guo","sequence":"additional","affiliation":[{"name":"Department of Electronics, Peking University, Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiangqiang","family":"Shuai","sequence":"additional","affiliation":[{"name":"Department of Electronics, Peking University, Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3084-6333","authenticated-orcid":false,"given":"Guangchen","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electronics, Peking University, Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bocheng","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Electronics, Peking University, Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,14]]},"reference":[{"key":"ref_1","unstructured":"(2021, June 07). GNSS & Surveying 2017: The Year in Review. Available online: https:\/\/www.gpsworld.com\/gnss-surveying-2017-the-year-in-review\/."},{"key":"ref_2","unstructured":"(2021, June 07). The Almanac. Available online: https:\/\/www.gpsworld.com\/the-almanac\/."},{"key":"ref_3","unstructured":"Rietdorf, A., Daub, C., and Loef, P. (2006, January 16). Precise positioning in real-time using navigation satellites and telecommunication. Proceedings of the 3rd Workshop on Positioning, Navigation and Communication (WPNC\u201906), Hannover, Germany."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1186\/BF03351948","article-title":"The performance of RTK-GPS for surveying under challenging environmental conditions","volume":"58","author":"Lee","year":"2006","journal-title":"Earth Planets Sp."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1007\/s10291-013-0339-3","article-title":"Performance assessment of single-and dual-frequency BeiDou\/GPS single-epoch kinematic positioning","volume":"18","author":"He","year":"2014","journal-title":"GPS Solut."},{"key":"ref_6","unstructured":"Carcanague, S., Julien, O., Vigneau, W., and Macabiau, C. (2013, January 23\u201325). Low-cost single-frequency GPS\/GLONASS RTK for road users. Proceedings of the ION 2013 Pacific PNT Meeting, Honolulu, HI, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s10291-012-0298-0","article-title":"Characterization of between-receiver GPS-Galileo inter-system biases and their effect on mixed ambiguity resolution","volume":"17","author":"Odijk","year":"2013","journal-title":"GPS Solut."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s10291-014-0376-6","article-title":"Combined BDS, Galileo, QZSS and GPS single-frequency RTK","volume":"19","author":"Odolinski","year":"2015","journal-title":"GPS Solut."},{"key":"ref_9","unstructured":"Takasu, T. (2021, June 07). RTKLIB ver 2.4.2 Manual. Available online: http:\/\/www.rtklib.com\/prog\/manual_2.4.2.pdf."},{"key":"ref_10","unstructured":"Pesyna, K., Heath, R., and Humphreys, T. (2014, January 8\u201312). Centimeter positioning with a smartphone-quality GNSS antenna. Proceedings of the 27th International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2014), Tampa, FL, USA."},{"key":"ref_11","first-page":"757","article-title":"Circularly polarized monopole mobile phone antenna for GNSS applications","volume":"3","author":"Meenakshi","year":"2016","journal-title":"Int. Res. J. Eng. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lachapelle, G., and Gratton, P. (2019, January 11\u201313). GNSS precise point positioning (PPP) with Android smartphones and comparison with high performance receiver. Proceedings of the 2019 IEEE International Conference on Signal, Information and Data Processing (ICSIDP), Chongqing, China.","DOI":"10.1109\/ICSIDP47821.2019.9173062"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Fortunato, M., Ravanelli, M., and Mazzoni, A. (2019). Real-time geophysical applications with Android GNSS raw mdeasurements. Remote Sens., 11.","DOI":"10.3390\/rs11182113"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Warnant, R., Mazzoni, A., Vyvere, L.V., and Warnant, Q. (2018, January 24\u201328). Positioning with single and dual frequency smartphones running Android 7 or later. Proceedings of the 31st International Technical Meeting of the Satellite Division of The Institute of Navigation (ION GNSS+ 2018), Miami, FL, USA.","DOI":"10.33012\/2018.15880"},{"key":"ref_15","unstructured":"Diggeln, F.D. (2021, June 07). GNSS Raw Measurements from Android Phones. Available online: https:\/\/www.gsa.europa.eu\/sites\/default\/files\/expo\/frank_van_diggelen_keynote_android_gnss_measurements_update.pdf."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Robustelli, U., Baiocchi, V., and Pugliano, G. (2019). Assessment of dual frequency GNSS observations from a Xiaomi Mi 8 Android smartphone and positioning performance analysis. Electronics, 8.","DOI":"10.3390\/electronics8010091"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Niu, Z., Nie, P., Tao, L., Sun, J., and Zhu, B. (2019). RTK with the assistance of an IMU-based pedestrian navigation algorithm for smartphones. Sensors, 19.","DOI":"10.3390\/s19143228"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wu, Q., Sun, M., Zhou, C., and Zhang, P. (2019). Precise point positioning using dual-Frequency GNSS observations on smartphone. Sensors, 19.","DOI":"10.3390\/s19092189"},{"key":"ref_19","first-page":"1964","article-title":"Vector frequency lock loop design for weak GPS signal","volume":"38","author":"Luo","year":"2017","journal-title":"J. Harbin Eng. Univ."},{"key":"ref_20","unstructured":"Kaplan, E., and Hegarty, C. (2005). Satellite signal acquisition, tracking, and data demodulation. Understanding GPS: Principles and Applications, Artech House. [2nd ed.]."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1002\/j.2161-4296.2003.tb00334.x","article-title":"RTK performance in highway and racetrack experiments","volume":"50","author":"Sinko","year":"2003","journal-title":"J. Inst. Navig."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10291-018-0766-2","article-title":"Correlational inference-based adaptive unscented Kalman filter with application in GNSS\/IMU-integrated navigation","volume":"22","author":"Yang","year":"2018","journal-title":"GPS Solut."},{"key":"ref_23","unstructured":"(2021, June 07). IMU Noise Model. Available online: https:\/\/github.com\/ethz-asl\/kalibr\/wiki\/IMU-Noise-Model."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/rob.20103","article-title":"Visual odometry for ground vehicle applications","volume":"23","author":"Naroditsky","year":"2006","journal-title":"J. Field Robot."},{"key":"ref_25","unstructured":"Gao, X., Zhang, T., Liu, Y., and Yan, Q.R. (2017). First glance of visual SLAM. 14 Lectures on Visual SLAM: From Theory to Practice, Publishing House of Electronics Industry. [2nd ed.]."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"97466","DOI":"10.1109\/ACCESS.2019.2929133","article-title":"A survey on odometry for autonomous navigation systems","volume":"7","author":"Mohamed","year":"2019","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"VINS-Mono: A robust and versatile monocular visual-inertial state estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Campos, C., Elvira, R., Rodr\u00edguez, J., Montiel, J., and Tard\u00f3s, J. (2021). ORB-SLAM3: An accurate open-source library for visual, visual-inertial and multi-map SLAM. arXiv.","DOI":"10.1109\/TRO.2021.3075644"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mourikis, A., and Roumeliotis, S. (2007, January 10\u201314). A multi-state constraint Kalman filter for vision-aided inertial navigation. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Rome, Italy.","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"ref_30","unstructured":"(2021, June 07). Robot Operating System: Bags. Available online: http:\/\/wiki.ros.org\/Bags."},{"key":"ref_31","first-page":"1","article-title":"Graph-Based Adaptive Fusion of GNSS and VIO Under Intermittent GNSS-Degraded Environment","volume":"70","author":"Gong","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_32","unstructured":"Qin, T., Cao, S.Z., Pan, J., and Shen, S.J. (2019). A general optimization-based framework for global pose estimation with multiple sensors. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Lynen, S., Achtelik, M.W., Weiss, S., Chli, M., and Siegwart, R. (2013, January 3\u20137). A robust and modular multi-sensor fusion approach applied to MAV navigation. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696917"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"10110","DOI":"10.1109\/JSEN.2020.2989332","article-title":"Robust IMU\/GPS\/VO Integration for Vehicle Navigation in GNSS Degraded Urban Areas","volume":"20","author":"Sun","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_35","unstructured":"Qin, T., Pan, J., Cao, S.Z., and Shen, S.J. (2019). A general optimization-based framework for local odometry estimation with multiple sensors. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Li, T., Zhang, H.P., Gao, Z.Z., Niu, X.J., and El-sheimy, N. (2019). Tight Fusion of a Monocular Camera, MEMS-IMU, and Single-Frequency Multi-GNSS RTK for Precise Navigation in GNSS-Challenged Environments. Remote Sens., 11.","DOI":"10.3390\/rs11060610"},{"key":"ref_37","unstructured":"Cao, S.Z., Lu, X., and Shen, S.J. (2021). GVINS: Tightly coupled GNSS-visual-inertial fusion for smooth and consistent state estimation. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Nikolic, J., Rehder, J., Burri, M., Gohl, P., Leutenegger, S., Furgale, P.T., and Siegwart, R. (June, January 31). A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time SLAM. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906892"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Meilland, M., Drummond, T., and Comport, A. (2013, January 1\u20138). A unified rolling shutter and motion blur model for 3D visual registration. Proceedings of the 2013 IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.252"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Wang, Y., Chen, L., Wei, P., and Lu, X. (2020). Visual-Inertial odometry of smartphone under Manhattan world. Remote Sens., 12.","DOI":"10.3390\/rs12223818"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"8956","DOI":"10.1109\/ACCESS.2017.2695525","article-title":"Robustness, security and privacy in location-based services for future IoT: A survey","volume":"5","author":"Chen","year":"2017","journal-title":"IEEE Access"},{"key":"ref_42","unstructured":"(2021, June 07). Geo++ RINEX Logger. Available online: https:\/\/play.google.com\/store\/apps\/details?id=de.geopp.rinexlogger."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Realini, E., Caldera, S., Pertusini, L., and Sampietro, D. (2017). Precise GNSS positioning using smart devices. Sensors, 17.","DOI":"10.3390\/s17102434"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"109162","DOI":"10.1016\/j.measurement.2021.109162","article-title":"An analysis of multi-GNSS observations tracked by recent Android smartphones and smartphone-only relative positioning results","volume":"175","author":"Paziewski","year":"2021","journal-title":"Measurement"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Huai, J.Z., Zhang, Y.J., and Yilmaz, A. (2019, January 27\u201330). The mobile AR sensor logger for Android and IOS devices. Proceedings of the 2019 IEEE SensorS, Montreal, QC, Canada.","DOI":"10.1109\/SENSORS43011.2019.8956816"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"185638","DOI":"10.1109\/ACCESS.2020.3028119","article-title":"A continuous positioning algorithm based on RTK and VI-SLAM with smartphones","volume":"8","author":"Niu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Fortunato, M., Critchley, M.J., Siutkowska, M., Ivanovici, M.L., Benedetti, E., and Roberts, W. (2019, January 9\u201312). Enabling high accuracy dynamic applications in urban environments using PPP and RTK on Android multi-frequency and multi-GNSS smartphones. Proceedings of the 2019 European Navigation Conference (ENC), Warsaw, Poland.","DOI":"10.1109\/EURONAV.2019.8714140"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Kuang, J., Niu, X.J., and Chen, X.G. (2018). Robust pedestrian dead reckoning based on MEMS-IMU for smartphones. Sensors, 18.","DOI":"10.3390\/s18051391"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Li, Y., Lan, H., Zhuang, Y., Zhang, P., Niu, X.J., and EI-Sheimy, N. (2015, January 13\u201316). Real-time attitude tracking of mobile devices. Proceedings of the 2015 International Conference on Indoor Positioning and Indoor Navigation (IPIN), Banff, AB, Canada.","DOI":"10.1109\/IPIN.2015.7346770"},{"key":"ref_50","unstructured":"Himanshu, S., and Mohamed, B. (2019, January 26). RTK with Smartphone and Need of Sensor Fusion. Proceedings of the Third Annual GNSS Raw Measurements Task Force Workshop, Prague, Czech Republic."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Li, P.L., Qin, T., Hu, B., Zhu, F., and Shen, S.J. (2017, January 9\u201313). Monocular Visual-Inertial State Estimation for Mobile Augmented Reality. Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Nantes, France.","DOI":"10.1109\/ISMAR.2017.18"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Yan, H., Shan, Q., and Furukawa, Y. (2017). RIDI: Robust IMU Double Integration. arXiv.","DOI":"10.1007\/978-3-030-01261-8_38"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Yan, H., Herath, S., and Furukawa, Y. (2019). RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methods. arXiv.","DOI":"10.1109\/ICRA40945.2020.9196860"},{"key":"ref_54","unstructured":"Takasu, T., and Yasuda, A. (2009, January 7). Development of the low-cost RTK-GPS receiver with an open source program package RTKLIB. Proceedings of the International Symposium on GPS\/GNSS, Jeju, Korea."},{"key":"ref_55","first-page":"166","article-title":"Precise positioning systems","volume":"Volume 7","author":"Xie","year":"2017","journal-title":"Principles of GPS and Receiver Design"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1007\/BF00863419","article-title":"The least-squares ambiguity decorrelation adjustment: A method for fast GPS integer ambiguity estimation","volume":"70","author":"Teunissen","year":"1995","journal-title":"J. Geod."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Netthonglang, C., Thongtan, T., and Satirapod, C. (2019, January 11\u201314). GNSS precise positioning determinations using smartphones. Proceedings of the 2019 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS), Bangkok, Thailand.","DOI":"10.1109\/APCCAS47518.2019.8953132"},{"key":"ref_58","unstructured":"(2021, June 07). Kalibr. Available online: https:\/\/github.com\/ethz-asl\/kalibr."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/10\/699\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:14:47Z","timestamp":1760166887000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/10\/699"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,14]]},"references-count":58,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["ijgi10100699"],"URL":"https:\/\/doi.org\/10.3390\/ijgi10100699","relation":{},"ISSN":["2220-9964"],"issn-type":[{"type":"electronic","value":"2220-9964"}],"subject":[],"published":{"date-parts":[[2021,10,14]]}}}