{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T14:00:36Z","timestamp":1772114436783,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T00:00:00Z","timestamp":1660780800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Science and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-05097-2020"],"award-info":[{"award-number":["RGPIN-05097-2020"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>A slip-aware localization framework is proposed for mobile robots experiencing wheel slip in dynamic environments. The framework fuses infrastructure-aided visual tracking data (via fisheye lenses) and proprioceptive sensory data from a skid-steer mobile robot to enhance accuracy and reduce variance of the estimated states. The slip-aware localization framework includes: the visual thread to detect and track the robot in the stereo image through computationally efficient 3D point cloud generation using a region of interest; and the ego motion thread which uses a slip-aware odometry mechanism to estimate the robot pose utilizing a motion model considering wheel slip. Covariance intersection is used to fuse the pose prediction (using proprioceptive data) and the visual thread, such that the updated estimate remains consistent. As confirmed by experiments on a skid-steer mobile robot, the designed localization framework addresses state estimation challenges for indoor\/outdoor autonomous mobile robots which experience high-slip, uneven torque distribution at each wheel (by the motion planner), or occlusion when observed by an infrastructure-mounted camera. The proposed system is real-time capable and scalable to multiple robots and multiple environmental cameras.<\/jats:p>","DOI":"10.3390\/robotics11040082","type":"journal-article","created":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T23:28:41Z","timestamp":1660865321000},"page":"82","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Infrastructure-Aided Localization and State Estimation for Autonomous Mobile Robots"],"prefix":"10.3390","volume":"11","author":[{"given":"Daniel","family":"Fl\u00f6gel","sequence":"first","affiliation":[{"name":"Institute for Regulation and Control Systems, Karlsruhe Institute of Technology (KIT), 76131 Karlsruhe, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1807-9672","authenticated-orcid":false,"given":"Neel Pratik","family":"Bhatt","sequence":"additional","affiliation":[{"name":"Mechanical and Mechatronics Engineering Department, University of Waterloo, 200 University Ave W, Waterloo, ON N2L 3G1, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6236-7516","authenticated-orcid":false,"given":"Ehsan","family":"Hashemi","sequence":"additional","affiliation":[{"name":"Mechanical Engineering Department, University of Alberta, 9211-116 Street NW, Edmonton, AB T6G 1H9, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sun, D., Gei\u00dfer, F., and Nebel, B. (2016, January 9\u201314). Towards effective localization in dynamic environments. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759665"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"Orb-slam3: An accurate open-source library for visual, visual\u2013inertial, and multimap slam","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Hess, W., Kohler, D., Rapp, H., and Andor, D. (2016, January 16\u201321). Real-time loop closure in 2D LIDAR SLAM. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487258"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Shan, T., and Englot, B. (2018, January 1\u20135). Lego-loam: Lightweight and ground-optimized lidar odometry and mapping on variable terrain. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594299"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2480","DOI":"10.1109\/TAC.2008.2006925","article-title":"Multi-agent coordination by decentralized estimation and control","volume":"53","author":"Yang","year":"2008","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3198","DOI":"10.1016\/j.ifacol.2020.12.1082","article-title":"Event-Triggered Task-Switching Control Based on Distributed Estimation","volume":"53","author":"He","year":"2020","journal-title":"IFAC-PapersOnLine"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6436","DOI":"10.1109\/TIE.2015.2416692","article-title":"Indoor intelligent mobile robot localization using fuzzy compensation and Kalman filter to fuse the data of gyroscope and magnetometer","volume":"62","author":"Chung","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"Vins-mono: A robust and versatile monocular visual-inertial state estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1109\/TCST.2015.2470636","article-title":"Joint wheel-slip and vehicle-motion estimation based on inertial, GPS, and wheel-speed sensors","volume":"24","author":"Berntorp","year":"2016","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhou, S., Liu, Z., Suo, C., Wang, H., Zhao, H., and Liu, Y.H. (2019, January 20\u201324). Vision-based dynamic control of car-like mobile robots. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793980"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"9613","DOI":"10.1109\/TVT.2020.3004163","article-title":"Robust and Autonomous Stereo Visual-Inertial Navigation for Non-Holonomic Mobile Robots","volume":"69","author":"Chae","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1007\/s10846-013-9871-1","article-title":"Control of a mobile robot subject to wheel slip","volume":"74","author":"Tian","year":"2014","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1002\/rob.21535","article-title":"Robust data fusion of multimodal sensory information for mobile robots","volume":"32","author":"Kubelka","year":"2015","journal-title":"J. Field Robot."},{"key":"ref_14","unstructured":"Delibasis, K.K., Plagianakos, V.P., and Maglogiannis, I. Real time indoor robot localization using a stationary fisheye camera. Proceedings of the IFIP International Conference on Artificial Intelligence Applications and Innovations."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Jankovi\u0107, N.V., \u0106iri\u0107, S.V., and Jovi\u010di\u0107, N.S. (2015, January 24\u201326). System for indoor localization of mobile robots by using machine vision. Proceedings of the 2015 23rd Telecommunications Forum Telfor (TELFOR), Belgrade, Serbia.","DOI":"10.1109\/TELFOR.2015.7377543"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"15154","DOI":"10.1016\/j.ifacol.2020.12.2082","article-title":"Event-triggered Add-on Safety for Connected and Automated Vehicles Using Road-side Network Infrastructure","volume":"53","author":"Mamduhi","year":"2020","journal-title":"IFAC-PapersOnLine"},{"key":"ref_17","unstructured":"Zickler, S., Laue, T., Birbach, O., Wongphati, M., and Veloso, M. (2009). SSL-vision: The shared vision system for the RoboCup Small Size League. Robot Soccer World Cup, Springer."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Shim, J.H., and Cho, Y.I. (2016). A mobile robot localization via indoor fixed remote surveillance cameras. Sensors, 16.","DOI":"10.3390\/s16020195"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ramer, C., Sessner, J., Scholz, M., Zhang, X., and Franke, J. (2015, January 14\u201316). Fusing low-cost sensor data for localization and mapping of automated guided vehicle fleets in indoor applications. Proceedings of the 2015 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), San Diego, CA, USA.","DOI":"10.1109\/MFI.2015.7295747"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.robot.2017.05.014","article-title":"Learning of skid-steered kinematic and dynamic models for motion planning","volume":"95","author":"Ordonez","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"43482","DOI":"10.1109\/ACCESS.2020.2977889","article-title":"Slip-aware motion estimation for off-road mobile robots via multi-innovation unscented Kalman filter","volume":"8","author":"Liu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gosala, N., B\u00fchler, A., Prajapat, M., Ehmke, C., Gupta, M., Sivanesan, R., Gawel, A., Pfeiffer, M., B\u00fcrki, M., and Sa, I. (2019, January 20\u201324). Redundant perception and state estimation for reliable autonomous racing. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794155"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1109\/TRO.2008.921563","article-title":"Modeling and analysis of skidding and slipping in wheeled mobile robots: Control design perspective","volume":"24","author":"Wang","year":"2008","journal-title":"IEEE Trans. Robot."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rabiee, S., and Biswas, J. (2019, January 20\u201324). A friction-based kinematic model for skid-steer wheeled mobile robots. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794216"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1016\/j.automatica.2013.12.036","article-title":"Adaptive output feedback tracking control of a nonholonomic mobile robot","volume":"50","author":"Huang","year":"2014","journal-title":"Automatica"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mandow, A., Martinez, J.L., Morales, J., Blanco, J.L., Garcia-Cerezo, A., and Gonzalez, J. (November, January 29). Experimental kinematics for wheeled skid-steer mobile robots. Proceedings of the 2007 IEEE\/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA.","DOI":"10.1109\/IROS.2007.4399139"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"14133","DOI":"10.3390\/s131014133","article-title":"Multi sensor fusion framework for indoor-outdoor localization of limited resource mobile robots","volume":"13","author":"Soriano","year":"2013","journal-title":"Sensors"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer Science & Business Media.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1109\/TPAMI.2006.153","article-title":"A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses","volume":"28","author":"Kannala","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"34157","DOI":"10.1007\/s11042-019-08232-6","article-title":"Improved object recognition results using SIFT and ORB feature detector","volume":"78","author":"Gupta","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1109\/MRA.2015.2432331","article-title":"Registration with the point cloud library: A modular framework for aligning in 3-D","volume":"22","author":"Holz","year":"2015","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.robot.2015.12.008","article-title":"3D robot perception with point cloud library","volume":"78","author":"Munaro","year":"2016","journal-title":"Robot. Auton. Syst."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/4\/82\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:11:39Z","timestamp":1760141499000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/11\/4\/82"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,18]]},"references-count":34,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["robotics11040082"],"URL":"https:\/\/doi.org\/10.3390\/robotics11040082","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,18]]}}}