{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T16:26:29Z","timestamp":1781367989136,"version":"3.54.1"},"reference-count":30,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,7,21]],"date-time":"2020-07-21T00:00:00Z","timestamp":1595289600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100009899","name":"Bevica Fonden","doi-asserted-by":"publisher","award":["GazeIT"],"award-info":[{"award-number":["GazeIT"]}],"id":[{"id":"10.13039\/501100009899","id-type":"DOI","asserted-by":"publisher"}]},{"name":"InfinIT","award":["Vision-based behaviours for service robots"],"award-info":[{"award-number":["Vision-based behaviours for service robots"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Positioning is an essential aspect of robot navigation, and visual odometry an important technique for continuous updating the internal information about robot position, especially indoors without GPS (Global Positioning System). Visual odometry is using one or more cameras to find visual clues and estimate robot movements in 3D relatively. Recent progress has been made, especially with fully integrated systems such as the RealSense T265 from Intel, which is the focus of this article. We compare between each other three visual odometry systems (and one wheel odometry, as a known baseline), on a ground robot. We do so in eight scenarios, varying the speed, the number of visual features, and with or without humans walking in the field of view. We continuously measure the position error in translation and rotation thanks to a ground truth positioning system. Our result shows that all odometry systems are challenged, but in different ways. The RealSense T265 and the ZED Mini have comparable performance, better than our baseline ORB-SLAM2 (mono-lens without inertial measurement unit (IMU)) but not excellent. In conclusion, a single odometry system might still not be sufficient, so using multiple instances and sensor fusion approaches are necessary while waiting for additional research and further improved products.<\/jats:p>","DOI":"10.3390\/robotics9030056","type":"journal-article","created":{"date-parts":[[2020,7,21]],"date-time":"2020-07-21T06:38:55Z","timestamp":1595313535000},"page":"56","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Comparison of Three Off-the-Shelf Visual Odometry Systems"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4112-5155","authenticated-orcid":false,"given":"Alexandre","family":"Alapetite","sequence":"first","affiliation":[{"name":"Alexandra Institute, Njalsgade 76, 2300 Copenhagen S, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Alexandra Institute, Njalsgade 76, 2300 Copenhagen S, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John Paulin","family":"Hansen","sequence":"additional","affiliation":[{"name":"Department of Technology, Management and Economics, Technical University of Denmark, Diplomvej 371, 2800 Kongens Lyngby, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcin","family":"Zaj\u0105czkowski","sequence":"additional","affiliation":[{"name":"Department of Technology, Management and Economics, Technical University of Denmark, Diplomvej 371, 2800 Kongens Lyngby, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miko\u0142aj","family":"Patalan","sequence":"additional","affiliation":[{"name":"Department of Technology, Management and Economics, Technical University of Denmark, Diplomvej 371, 2800 Kongens Lyngby, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"97466","DOI":"10.1109\/ACCESS.2019.2929133","article-title":"A Survey on Odometry for Autonomous Navigation Systems","volume":"7","author":"Mohamed","year":"2019","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1897","DOI":"10.1186\/s40064-016-3573-7","article-title":"Review of visual odometry: Types, approaches, challenges, and applications","volume":"5","author":"Aqel","year":"2016","journal-title":"SpringerPlus"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/LRA.2017.2653359","article-title":"Visual-Inertial Monocular SLAM With Map Reuse","volume":"2","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Usenko, V., Engel, J., St\u00fcckler, J., and Cremers, D. (2016, January 16\u201321). Direct visual-inertial odometry with stereo cameras. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487335"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Whelan, T., Johannsson, H., Kaess, M., Leonard, J., and McDonald, J. (2013, January 6\u201310). Robust real-time visual odometry for dense RGB-D mapping. Proceedings of the IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631400"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Steinbr\u00fccker, F., Sturm, J., and Cremers, D. (2011, January 6\u201313). Real-time visual odometry from dense RGB-D images. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130321"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Graeter, J., Wilczynski, A., and Lauer, M. (2018, January 1\u20135). Limo: Lidar-monocular visual odometry. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594394"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shin, Y., Park, Y.S., and Kim, A. (2018, January 21\u201325). Direct Visual SLAM Using Sparse Depth for Camera-LiDAR System. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8461102"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/MRA.2006.1678144","article-title":"Simultaneous localization and mapping: Part I","volume":"13","author":"Bailey","year":"2006","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_11","unstructured":"Gutmann, J.S., and Konolige, K. (1999, January 8\u20139). Incremental mapping of large cyclic environments. Proceedings of the IEEE International Symposium on Computational Intelligence in Robotics and Automation."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Delmerico, J., and Scaramuzza, D. (2018, January 21\u201325). A benchmark comparison of monocular visual-inertial odometry algorithms for flying robots. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460664"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.1007\/s11554-017-0670-y","article-title":"An evaluation of real-time RGB-D visual odometry algorithms on mobile devices","volume":"16","author":"Angladon","year":"2019","journal-title":"J. Real-Time Image Proc."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Joshi, B., Rahman, S., Kalaitzakis, M., Cain, B., Johnson, J., Xanthidis, M., Karapetyan, N., Hernandez, A., Li, A.Q., and Vitzilaios, N. (2019, January 3\u20138). Experimental Comparison of Open Source Visual-Inertial-Based State Estimation Algorithms in the Underwater Domain. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8968049"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, C., Zhu, H., Li, M., and You, S. (2018). A Review of Visual-Inertial Simultaneous Localization and Mapping from Filtering-Based and Optimization-Based Perspectives. Robotics, 7.","DOI":"10.3390\/robotics7030045"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ouerghi, S., Ragot, N., Boutteau, R., and Savatier, X. (2020, January 27\u201329). Comparative Study of a commercial tracking camera and ORB-SLAM2 for person localization. Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Valletta, Malta.","DOI":"10.5220\/0008980703570364"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cort\u00e9s, S., Solin, A., Rahtu, E., and Kannala, J. (2018, January 8\u201314). ADVIO: An Authentic Dataset for Visual-Inertial Odometry. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01249-6_26"},{"key":"ref_19","unstructured":"(2020, July 15). OptiTrack for robotics. Available online: https:\/\/optitrack.com\/motion-capture-robotics\/."},{"key":"ref_20","unstructured":"(2020, July 15). OptiTrack Prime 13. Available online: https:\/\/optitrack.com\/products\/prime-13\/."},{"key":"ref_21","unstructured":"(2020, July 15). Arlo Complete Robot System. Available online: https:\/\/www.parallax.com\/product\/28966."},{"key":"ref_22","unstructured":"(2020, July 15). Arlo Robotic Platform System. Available online: https:\/\/www.parallax.com\/product\/arlo-robotic-platform-system."},{"key":"ref_23","unstructured":"(2020, July 15). ROS. Available online: https:\/\/www.ros.org."},{"key":"ref_24","unstructured":"(2020, July 15). Propeller Activity Board, WX. Available online: https:\/\/www.parallax.com\/product\/32912."},{"key":"ref_25","unstructured":"(2020, July 15). Introducing ZED Mini. Available online: https:\/\/www.stereolabs.com\/blog\/introducing-zed-mini\/."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1109\/TRO.2012.2197158","article-title":"Bags of binary words for fast place recognition in image sequences","volume":"28","author":"Tardos","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Feigl, T., Porada, A., Steiner, S., L\u00f6f-fler, C., Mutschler, C., and Philippsen, M. (2020, January 27\u201329). Localization Limitations of ARCore, ARKit, and Hololens in Dynamic Large-Scale Industry Environments. Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Valletta, Malta.","DOI":"10.5220\/0008989903070318"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, X., Yao, X., Zhu, Y., and Hu, F. (2019). An ARCore Based User Centric Assistive Navigation System for Visually Impaired People. Appl. Sci., 9.","DOI":"10.3390\/app9050989"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"K\u00e4stner, L., and Lambrecht, J. (2019, January 18\u201320). Augmented-Reality-Based Visualization of Navigation Data of Mobile Robots on the Microsoft Hololens-Possibilities and Limitations. Proceedings of the IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM), Bangkok, Thailand.","DOI":"10.1109\/CIS-RAM47153.2019.9095836"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/9\/3\/56\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:50:15Z","timestamp":1760176215000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/9\/3\/56"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,21]]},"references-count":30,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["robotics9030056"],"URL":"https:\/\/doi.org\/10.3390\/robotics9030056","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints202005.0221.v1","asserted-by":"object"}]},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,21]]}}}