{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T07:32:37Z","timestamp":1768894357796,"version":"3.49.0"},"reference-count":54,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,1,15]],"date-time":"2024-01-15T00:00:00Z","timestamp":1705276800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Nanchang Automotive Institute of Intelligence and New Energy, Tongji University","award":["TPD-TC202211-07"],"award-info":[{"award-number":["TPD-TC202211-07"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Intelligent vehicles are constrained by road, resulting in a disparity between the assumed six degrees of freedom (DoF) motion within the Visual Simultaneous Localization and Mapping (SLAM) system and the approximate planar motion of vehicles in local areas, inevitably causing additional pose estimation errors. To address this problem, a stereo Visual SLAM system with road constraints based on graph optimization is proposed, called RC-SLAM. Addressing the challenge of representing roads parametrically, a novel method is proposed to approximate local roads as discrete planes and extract parameters of local road planes (LRPs) using homography. Unlike conventional methods, constraints between the vehicle and LRPs are established, effectively mitigating errors arising from assumed six DoF motion in the system. Furthermore, to avoid the impact of depth uncertainty in road features, epipolar constraints are employed to estimate rotation by minimizing the distance between road feature points and epipolar lines, robust rotation estimation is achieved despite depth uncertainties. Notably, a distinctive nonlinear optimization model based on graph optimization is presented, jointly optimizing the poses of vehicle trajectories, LPRs, and map points. The experiments on two datasets demonstrate that the proposed system achieved more accurate estimations of vehicle trajectories by introducing constraints between the vehicle and LRPs. The experiments on a real-world dataset further validate the effectiveness of the proposed system.<\/jats:p>","DOI":"10.3390\/s24020536","type":"journal-article","created":{"date-parts":[[2024,1,15]],"date-time":"2024-01-15T08:52:03Z","timestamp":1705308723000},"page":"536","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["RC-SLAM: Road Constrained Stereo Visual SLAM System Based on Graph Optimization"],"prefix":"10.3390","volume":"24","author":[{"given":"Yuan","family":"Zhu","sequence":"first","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201800, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5722-605X","authenticated-orcid":false,"given":"Hao","family":"An","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201800, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huaide","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201800, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2991-1874","authenticated-orcid":false,"given":"Ruidong","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201800, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingzhi","family":"Wu","sequence":"additional","affiliation":[{"name":"Nanchang Automotive Institute of Intelligence & New Energy, Tongji University, Nanchang 330038, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9166-4790","authenticated-orcid":false,"given":"Ke","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201800, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bala, J.A., Adeshina, S.A., and Aibinu, A.M. (2022). Advances in Visual Simultaneous Localisation and Mapping Techniques for Autonomous Vehicles: A Review. Sensors, 22.","DOI":"10.3390\/s22228943"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"104992","DOI":"10.1016\/j.engappai.2022.104992","article-title":"A Review of Visual SLAM Methods for Autonomous Driving Vehicles","volume":"114","author":"Cheng","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","article-title":"Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age","volume":"32","author":"Cadena","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4196","DOI":"10.1109\/LRA.2022.3147256","article-title":"Visual Localization and Mapping Leveraging the Constraints of Local Ground Manifolds","volume":"7","author":"Zhou","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Su, Y., Wang, T., Yao, C., Shao, S., and Wang, Z. (2020, January 25\u201329). GR-SLAM: Vision-Based Sensor Fusion SLAM for Ground Robots on Complex Terrain. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341387"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"9699","DOI":"10.1109\/JSEN.2018.2873055","article-title":"SE(2)-Constrained Visual Inertial Fusion for Ground Vehicles","volume":"18","author":"Zheng","year":"2018","journal-title":"IEEE Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3344","DOI":"10.1016\/j.cja.2020.03.008","article-title":"Lightweight Hybrid Visual-Inertial Odometry with Closed-Form Zero Velocity Update","volume":"33","author":"Qiu","year":"2020","journal-title":"Chin. J. Aeronaut."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1177\/0278364914554813","article-title":"Keyframe-Based Visual\u2013Inertial Odometry Using Nonlinear Optimization","volume":"34","author":"Leutenegger","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hernandez, J., Tsotsos, K., and Soatto, S. (2015, January 25\u201330). Observability, Identifiability and Sensitivity of Vision-Aided Inertial Navigation. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139507"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jia, G., Li, X., Zhang, D., Xu, W., Lv, H., Shi, Y., and Cai, M. (2022). Visual-SLAM Classical Framework and Key Techniques: A Review. Sensors, 22.","DOI":"10.3390\/s22124582"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Martinelli, A. (2013, January 3\u20137). Visual-Inertial Structure from Motion: Observability and Resolvability. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696963"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1109\/TRO.2008.2004490","article-title":"Appearance-Guided Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles","volume":"24","author":"Scaramuzza","year":"2008","journal-title":"IEEE Trans. Robot."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, M., Chen, Y., and Li, M. (2019, January 3\u20138). Vision-Aided Localization For Ground Robots. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8968521"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1109\/TRO.2020.3043970","article-title":"Pose Estimation for Ground Robots: On Manifold Representation, Integration, Reparameterization, and Optimization","volume":"37","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lategahn, H., Geiger, A., and Kitt, B. (2011, January 9\u201313). Visual SLAM for Autonomous Ground Vehicles. Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979711"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1007\/s10846-021-01315-3","article-title":"Monocular Visual SLAM with Points and Lines for Ground Robots in Particular Scenes: Parameterization for Lines on Ground","volume":"101","author":"Quan","year":"2021","journal-title":"J. Intell. Robot."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1109\/TITS.2019.2900330","article-title":"Ground-Plane-Based Absolute Scale Estimation for Monocular Visual Odometry","volume":"21","author":"Zhou","year":"2020","journal-title":"EEE Trans. Intell. Transp. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tian, R., Zhang, Y., Zhu, D., Liang, S., Coleman, S., and Kerr, D. (June, January 30). Accurate and Robust Scale Recovery for Monocular Visual Odometry Based on Plane Geometry. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561215"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lee, B., Daniilidis, K., and Lee, D.D. (2015, January 25\u201330). Online Self-Supervised Monocular Visual Odometry for Ground Vehicles. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139928"},{"key":"ref_21","first-page":"1","article-title":"SOFT2: Stereo Visual Odometry for Road Vehicles Based on a Point-to-Epipolar-Line Metric","volume":"39","year":"2022","journal-title":"IEEE Trans. Robot."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Koledi\u0107, K., Cvi\u0161i\u0107, I., Markovi\u0107, I., and Petrovi\u0107, I. (June, January 29). MOFT: Monocular Odometry Based on Deep Depth and Careful Feature Selection and Tracking. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.","DOI":"10.1109\/ICRA48891.2023.10160588"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1002\/rob.21762","article-title":"SOFT-SLAM: Computationally Efficient Stereo Visual Simultaneous Localization and Mapping for Autonomous Unmanned Aerial Vehicles","volume":"35","year":"2018","journal-title":"J. Field Robot."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1874","DOI":"10.1109\/TRO.2021.3075644","article-title":"ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual\u2013Inertial, and Multimap SLAM","volume":"37","author":"Campos","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1109\/LRA.2021.3058069","article-title":"OV2SLAM: A Fully Online and Versatile Visual SLAM for Real-Time Applications","volume":"6","author":"Ferrera","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1109\/TRO.2016.2623335","article-title":"SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems","volume":"33","author":"Forster","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-Scale Direct Monocular SLAM. Proceedings of the Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1363","DOI":"10.1109\/TRO.2020.2991614","article-title":"Direct Sparse Mapping","volume":"36","author":"Zubizarreta","year":"2020","journal-title":"IEEE Trans. Robot."},{"key":"ref_30","first-page":"99","article-title":"Simultaneous Localization and Mapping: Part I","volume":"13","author":"Bailey","year":"2016","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1109\/70.938381","article-title":"A Solution to the Simultaneous Localization and Map Building (SLAM) Problem","volume":"17","author":"Dissanayake","year":"2021","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zheng, S., Wang, J., Rizos, C., Ding, W., and El-Mowafy, A. (2023). Simultaneous Localization and Mapping (SLAM) for Autonomous Driving: Concept and Analysis. Remote Sens., 15.","DOI":"10.3390\/rs15041156"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ma, S., Bai, X., Wang, Y., and Fang, R. (2019). Robust Stereo Visual-Inertial Odometry Using Nonlinear Optimization. Sensors, 19.","DOI":"10.3390\/s19173747"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/LRA.2021.3056380","article-title":"Unified Multi-Modal Landmark Tracking for Tightly Coupled Lidar-Visual-Inertial Odometry","volume":"6","author":"Wisth","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wu, K.J., Guo, C.X., Georgiou, G., and Roumeliotis, S.I. (June, January 29). VINS on Wheels. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989603"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Peng, G., Zhou, Y., Hu, L., Xiao, L., Sun, Z., Wu, Z., and Zhu, X. (2023). VILO SLAM: Tightly Coupled Binocular Vision\u2013Inertia SLAM Combined with LiDAR. Sensors, 23.","DOI":"10.3390\/s23104588"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"7469","DOI":"10.1109\/LRA.2021.3095515","article-title":"R 2 LIVE: A Robust, Real-Time, LiDAR-Inertial-Visual Tightly-Coupled State Estimator and Mapping","volume":"6","author":"Lin","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wei, X., Lv, J., Sun, J., Dong, E., and Pu, S. (2022, January 23\u201327). GCLO: Ground Constrained LiDAR Odometry with Low-Drifts for GPS-Denied Indoor Environments. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9812336"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2652","DOI":"10.1109\/TCYB.2018.2831900","article-title":"Odometry-Vision-Based Ground Vehicle Motion Estimation with SE(2)-Constrained SE(3) Poses","volume":"49","author":"Zheng","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zheng, F., and Liu, Y.-H. (2019, January 20\u201324). Visual-Odometric Localization and Mapping for Ground Vehicles Using SE(2)-XYZ Constraints. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793928"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"navi.527","DOI":"10.33012\/navi.527","article-title":"AGPC-SLAM: Absolute Ground Plane Constrained 3D Lidar SLAM","volume":"69","author":"Wen","year":"2022","journal-title":"J. Inst. Navig."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, K., Wang, Y., and Kneip, L. (June, January 30). B-Splines for Purely Vision-Based Localization and Mapping on Non-Holonomic Ground Vehicles. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561131"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wirges, S., R\u00f6sch, K., Bieder, F., and Stiller, C. (2021, January 1\u20134). Fast and Robust Ground Surface Estimation from LiDAR Measurements Using Uniform B-Splines. Proceedings of the 2021 IEEE 24th International Conference on Information Fusion (FUSION), Sun City, South Africa.","DOI":"10.23919\/FUSION49465.2021.9626921"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Geneva, P., Eckenhoff, K., Yang, Y., and Huang, G. (2018, January 1\u20135). LIPS: LiDAR-Inertial 3D Plane SLAM. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594463"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"109341","DOI":"10.1016\/j.sigpro.2023.109341","article-title":"Centric Graph Regularized Log-Norm Sparse Non-Negative Matrix Factorization for Multi-View Clustering","volume":"217","author":"Dong","year":"2024","journal-title":"Signal Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"9394","DOI":"10.1109\/TKDE.2023.3238416","article-title":"Self-Supervised Graph Completion for Incomplete Multi-View Clustering","volume":"35","author":"Liu","year":"2023","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Chen, D., Wang, S., Xie, W., Zhai, S., Wang, N., Bao, H., and Zhang, G. (2022, January 23\u201327). VIP-SLAM: An Efficient Tightly-Coupled RGB-D Visual Inertial Planar SLAM. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9812354"},{"key":"ref_49","unstructured":"K\u00fcmmerle, R., Grisetti, G., Strasdat, H., Konolige, K., and Burgard, W. (2011, January 9\u201313). G2o: A General Framework for Graph Optimization. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1109\/TRO.2012.2197158","article-title":"Bags of Binary Words for Fast Place Recognition in Image Sequences","volume":"28","author":"Tardos","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"3292","DOI":"10.1109\/TPAMI.2022.3179507","article-title":"KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3D. IEEE Trans. Pattern Anal. Mach. Intell","volume":"45","author":"Liao","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7\u201312). A Benchmark for the Evaluation of RGB-D SLAM Systems. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385773"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision Meets Robotics: The KITTI Dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1109\/TPAMI.1987.4767965","article-title":"Least-Squares Fitting of Two 3-D Point Sets","volume":"PAMI-9","author":"Arun","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/536\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:47:17Z","timestamp":1760104037000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/536"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,15]]},"references-count":54,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24020536"],"URL":"https:\/\/doi.org\/10.3390\/s24020536","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,15]]}}}