{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T19:59:36Z","timestamp":1772481576141,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,8]],"date-time":"2021-02-08T00:00:00Z","timestamp":1612742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51466001"],"award-info":[{"award-number":["51466001"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004607","name":"Natural Science Foundation of Guangxi Province","doi-asserted-by":"publisher","award":["2017GXNSFAA198344"],"award-info":[{"award-number":["2017GXNSFAA198344"]}],"id":[{"id":"10.13039\/501100004607","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004607","name":"Natural Science Foundation of Guangxi Province","doi-asserted-by":"publisher","award":["2017GXNSFDA198042"],"award-info":[{"award-number":["2017GXNSFDA198042"]}],"id":[{"id":"10.13039\/501100004607","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The traditional simultaneous localization and mapping (SLAM) system uses static points of the environment as features for real-time localization and mapping. When there are few available point features, the system is difficult to implement. A feasible solution is to introduce line features. In complex scenarios containing rich line segments, the description of line segments is not strongly differentiated, which can lead to incorrect association of line segment data, thus introducing errors into the system and aggravating the cumulative error of the system. To address this problem, a point-line stereo visual SLAM system incorporating semantic invariants is proposed in this paper. This system improves the accuracy of line feature matching by fusing line features with image semantic invariant information. When defining the error function, the semantic invariant is fused with the reprojection error function, and the semantic constraint is applied to reduce the cumulative error of the poses in the long-term tracking process. Experiments on the Office sequence of the TartanAir dataset and the KITTI dataset show that this system improves the matching accuracy of line features and suppresses the cumulative error of the SLAM system to some extent, and the mean relative pose error (RPE) is 1.38 and 0.0593 m, respectively.<\/jats:p>","DOI":"10.3390\/s21041196","type":"journal-article","created":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T04:33:46Z","timestamp":1612931626000},"page":"1196","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["A Multi-Feature Fusion Slam System Attaching Semantic Invariant to Points and Lines"],"prefix":"10.3390","volume":"21","author":[{"given":"Gang","family":"Li","sequence":"first","affiliation":[{"name":"College of Electrical Engineering, Guangxi University, Nanning 530000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yawen","family":"Zeng","sequence":"additional","affiliation":[{"name":"College of Electrical Engineering, Guangxi University, Nanning 530000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2643-4611","authenticated-orcid":false,"given":"Huilan","family":"Huang","sequence":"additional","affiliation":[{"name":"College of Mechanical Engineering, Guangxi University, Nanning 530000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaojian","family":"Song","sequence":"additional","affiliation":[{"name":"College of Electrical Engineering, Guangxi University, Nanning 530000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7194-4496","authenticated-orcid":false,"given":"Bin","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Electrical Engineering, Guangxi University, Nanning 530000, China"},{"name":"College of Automation, Central South University, Changsha 410083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiang","family":"Liao","sequence":"additional","affiliation":[{"name":"College of Electrical Engineering, Guangxi University, Nanning 530000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1109\/MRA.2006.1678144","article-title":"Simultaneous localization and mapping: Part I","volume":"13","author":"Bailey","year":"2006","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_2","first-page":"855","article-title":"A survey of monocular simultaneous localization and mapping","volume":"28","author":"Liu","year":"2016","journal-title":"J. Computer-Aided Des. Comp. Graph."},{"key":"ref_3","first-page":"55","article-title":"Visual simultaneous localization and mapping: A survey","volume":"43","year":"2012","journal-title":"Artif. Intell. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","article-title":"Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age","volume":"32","author":"Cadena","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct sparse odometry","volume":"40","author":"Engel","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","unstructured":"Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 31). SVO: Fast semi-direct monocular visual odometry. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel tracking and mapping for small AR workspaces. Proceedings of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM system for Monocular, Stereo, and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/TRO.2013.2279412","article-title":"3-D Mapping With an RGB-D Camera","volume":"30","author":"Endres","year":"2014","journal-title":"IEEE Trans. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kerl, C., Sturm, J., and Cremers, D. (2013, January 3\u20137). Dense visual SLAM for RGB-D cameras. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696650"},{"key":"ref_12","first-page":"485","article-title":"A Visual SLAM Algorithm Based on Line Point Invariants","volume":"42","author":"Chen","year":"2020","journal-title":"Robot"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Smith, P., Reid, I., and Davison, A. (2006, January 4\u20137). Real-Time Monocular SLAM with Straight Lines. Proceedings of the British Machine Vision Conference, Edinburgh, UK.","DOI":"10.5244\/C.20.3"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1109\/TRO.2015.2489498","article-title":"Building a 3-d line-based map using stereo SLAM","volume":"31","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1109\/TVT.2015.2388780","article-title":"StructSLAM: Visual SLAM with building structure lines","volume":"64","author":"Zhou","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Vakhitov, A., Funke, J., and Moreno-Noguer, F. Accurate and Linear Time Pose Estimation from Points and Lines. European Conference on Computer Vision, Amsterdam, The Netherlands, 8\u201316 October 2016, Springer.","DOI":"10.1007\/978-3-319-46478-7_36"},{"key":"ref_17","unstructured":"Gomez-Ojeda, R., Moreno, F.A., Scaramuzza, D., and Gonzalez-Jimenez, J. (2017). PL-SLAM: A Stereo SLAM System through the Combination of Points and Line Segments. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zuo, X., Xie, X., Liu, Y., and Huang, G. (2017, January 24\u201328). Robust visual SLAM with point and line features. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8205991"},{"key":"ref_19","unstructured":"Pumarola, A., Vakhitov, A., Agudo, A., Sanfeliu, A., and Moreno-Noguer, F. (June, January 29). PL-SLAM: Real-time monocular visual SLAM with points and lines. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Singapore."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, R., Di, K., Wan, W., and Wang, Y. (2018). Improved Point-Line Feature Based Visual SLAM Method for Indoor Scenes. Sensors, 18.","DOI":"10.3390\/s18103559"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, N., and Zhao, Y. (2019). Fast and Robust Monocular Visua-Inertial Odometry Using Points and Lines. Sensors, 19.","DOI":"10.3390\/s19204545"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zou, Y., Eldemiry, A., Li, Y., and Chen, W. (2020). Robust RGB-D SLAM Using Point and Line Features for Low Textured Scene. Sensors, 20.","DOI":"10.3390\/s20174984"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Garcia-Garcia, A., Orts-Escolano, S., Oprea, S., Villena-Martinez, V., and Garcia-Rodriguez, J. (2017). A Review on Deep Learning Techniques Applied to Semantic Segmentation. arXiv.","DOI":"10.1016\/j.asoc.2018.05.018"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4158","DOI":"10.1177\/1729881420919185","article-title":"A Survey of Image Semantics-based Visual Simultaneous Localization and Mapping: Application-oriented Solutions to Autonomous Navigation of Mobile Robots","volume":"17","author":"Xia","year":"2020","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_25","unstructured":"Bowman, S.L., Atanasov, N., Daniilidis, K., and Pappas, G.J. (June, January 29). Probabilistic data association for semantic SLAM. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Singapore."},{"key":"ref_26","unstructured":"Konstantinos-Nektarios, L., Sch\u00f6nberger, J., Marc, P., and Torsten, S. (2018, January 8\u201314). VSO: Visual Semantic Odometry. Proceedings of the 15th European Conference, Munich, Germany."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hirose, K., and Saito, H. (2012, January 3\u20137). Fast line description for line-based SLAM. Proceedings of the British Machine Vision Conference, Guildford, UK.","DOI":"10.5244\/C.26.83"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2012","DOI":"10.4249\/scholarpedia.10491","article-title":"Scale invariant feature transform","volume":"7","author":"Lindeberg","year":"2012","journal-title":"Scholarpedia"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5201\/ipol.2012.gjmr-lsd","article-title":"LSD: A line segment detector","volume":"2","author":"Jakubowicz","year":"2012","journal-title":"Image Process. Line"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1016\/j.jvcir.2013.05.006","article-title":"An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency","volume":"24","author":"Zhang","year":"2013","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Suleymanov, T., Gadd, M., Kunze, L., and Newman, P. (2020, January 20\u201323). LiDAR Lateral Localisation Despite Challenging Occlusion from Traffic. Proceedings of the IEEE\/ION Position, Location and Navigation Symposium (PLANS), Portland, OR, USA.","DOI":"10.1109\/PLANS46316.2020.9109911"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1109\/TRO.2012.2197158","article-title":"Bags of binary words for fast place recognition in image sequences","volume":"28","author":"Tardos","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, W., Zhu, D., Wang, X., Hu, Y., Qiu, Y., Wang, C., Hu, F., Ashish, K., and Scherer, S. (2020). TartanAir: A Dataset to Push the Limits of Visual SLAM. arXiv.","DOI":"10.1109\/IROS45743.2020.9341801"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_38","unstructured":"Facebook AI Research (2020, December 23). Detectron2. Available online: https:\/\/github.com\/facebookresearch\/detectron2."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1109\/TPAMI.2018.2844175","article-title":"Mask R-CNN","volume":"42","author":"He","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","unstructured":"OpenCV Developers Team (2020, December 23). Open Source Computer Vision (OpenCV) Library. Available online: http:\/\/opencv.org."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1196\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:21:28Z","timestamp":1760160088000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1196"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,8]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041196"],"URL":"https:\/\/doi.org\/10.3390\/s21041196","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,8]]}}}