{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T09:27:03Z","timestamp":1782552423693,"version":"3.54.5"},"reference-count":51,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2020,9,2]],"date-time":"2020-09-02T00:00:00Z","timestamp":1599004800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010877","name":"Shenzhen Science and Technology Innovation Commission","doi-asserted-by":"publisher","award":["JCYJ20170818104822282"],"award-info":[{"award-number":["JCYJ20170818104822282"]}],"id":[{"id":"10.13039\/501100010877","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Hong Kong Research Grants Council (RGC) Competitive Earmarked Research Grant","award":["152223\/18E"],"award-info":[{"award-number":["152223\/18E"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Three-dimensional (3D) reconstruction using RGB-D camera with simultaneous color image and depth information is attractive as it can significantly reduce the cost of equipment and time for data collection. Point feature is commonly used for aligning two RGB-D frames. Due to lacking reliable point features, RGB-D simultaneous localization and mapping (SLAM) is easy to fail in low textured scenes. To overcome the problem, this paper proposes a robust RGB-D SLAM system fusing both points and lines, because lines can provide robust geometry constraints when points are insufficient. To comprehensively fuse line constraints, we combine 2D and 3D line reprojection error with point reprojection error in a novel cost function. To solve the cost function and filter out wrong feature matches, we build a robust pose solver using the Gauss\u2013Newton method and Chi-Square test. To correct the drift of camera poses, we maintain a sliding-window framework to update the keyframe poses and related features. We evaluate the proposed system on both public datasets and real-world experiments. It is demonstrated that it is comparable to or better than state-of-the-art methods in consideration with both accuracy and robustness.<\/jats:p>","DOI":"10.3390\/s20174984","type":"journal-article","created":{"date-parts":[[2020,9,2]],"date-time":"2020-09-02T11:07:14Z","timestamp":1599044834000},"page":"4984","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Robust RGB-D SLAM Using Point and Line Features for Low Textured Scene"],"prefix":"10.3390","volume":"20","author":[{"given":"Yajing","family":"Zou","sequence":"first","affiliation":[{"name":"Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen 518057, China"},{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong 999077, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8725-6727","authenticated-orcid":false,"given":"Amr","family":"Eldemiry","sequence":"additional","affiliation":[{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong 999077, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5610-3223","authenticated-orcid":false,"given":"Yaxin","family":"Li","sequence":"additional","affiliation":[{"name":"Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen 518057, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1787-5191","authenticated-orcid":false,"given":"Wu","family":"Chen","sequence":"additional","affiliation":[{"name":"Shenzhen Research Institute, The Hong Kong Polytechnic University, Shenzhen 518057, China"},{"name":"Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University, Hong Kong 999077, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1007\/s41095-015-0029-x","article-title":"3D Indoor scene modeling from RGB-D data: A survey","volume":"1","author":"Chen","year":"2015","journal-title":"Comput. Vis. Media"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel tracking and mapping for small AR workspaces. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1109\/TRO.2013.2279412","article-title":"3-D mapping with an RGB-D camera","volume":"30","author":"Endres","year":"2013","journal-title":"IEEE Trans. Robot."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1002\/rob.21831","article-title":"RTAB-map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation","volume":"36","author":"Michaud","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_9","unstructured":"Shi, J. (1994, January 21\u201323). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1109\/TRO.2019.2899783","article-title":"PL-SLAM: A stereo SLAM system through the combination of points and line segments","volume":"35","author":"Moreno","year":"2019","journal-title":"IEEE Trans. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jeong, W.Y., and Lee, K.M. (2006, January 9\u201315). Visual SLAM with line and corner features. Proceedings of the 2006 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Beijing, China.","DOI":"10.1109\/IROS.2006.281708"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lemaire, T., and Lacroix, S. (2007, January 10\u201314). Monocular-vision based SLAM using line segments. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.363894"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pumarola, A., Vakhitov, A., Agudo, A., Sanfeliu, A., and Moreno-Noguer, F. (June, January 29). PL-SLAM: Real-time monocular visual SLAM with points and lines. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989522"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"He, Y., Zhao, J., Guo, Y., He, W., and Yuan, K. (2018). Pl-vio: Tightly-coupled monocular visual\u2013inertial odometry using point and line features. Sensors, 18.","DOI":"10.3390\/s18041159"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, Y., Brasch, N., Wang, Y., Navab, N., and Tombari, F. (2020). Structure-SLAM: Low-drift monocular SLAM in indoor environments. arXiv.","DOI":"10.1109\/LRA.2020.3015456"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zuo, X., Xie, X., Liu, Y., and Huang, G. (2017, January 24\u201328). Robust visual SLAM with point and line features. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8205991"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"9908","DOI":"10.1109\/JSEN.2019.2927405","article-title":"A robust RGB-D SLAM system with points and lines for low texture indoor environments","volume":"19","author":"Fu","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lu, Y., and Song, D. (2015, January 7\u201313). Robust RGB-D odometry using point and line features. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.448"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1109\/TRO.2018.2875382","article-title":"Canny-vo: Visual odometry with rgb-d cameras based on geometric 3-d\u20142-d edge alignment","volume":"35","author":"Zhou","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kerl, C., Sturm, J., and Cremers, D. (2013, January 3\u20137). Dense visual SLAM for RGB-D cameras. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696650"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., and Fitzgibbon, A. (2011, January 26\u201329). KinectFusion: Real-time dense surface mapping and tracking. Proceedings of the 2011 10th IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland.","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Whelan, T., Leutenegger, S., Salas-Moreno, R., Glocker, B., and Davison, A. (2015, January 13\u201317). ElasticFusion: Dense SLAM without a pose graph. Proceedings of the Robotics: Science and Systems, Rome, Italy.","DOI":"10.15607\/RSS.2015.XI.001"},{"key":"ref_23","unstructured":"Whelan, T., Kaess, M., Fallon, M., Johannsson, H., Leonard, J., and McDonald, J. (2012, January 9\u201310). Kintinuous: Spatially Extended Kinectfusion. Proceedings of the RSS Workshop on RGB-D: Advanced Reasoning With Depth Cameras, Sydney, NSW, Australia."},{"key":"ref_24","first-page":"1","article-title":"Real-time 3D reconstruction at scale using voxel hashing","volume":"32","author":"Izadi","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Schops, T., Sattler, T., and Pollefeys, M. (2019, January 15\u201320). Bad slam: Bundle adjusted direct rgb-d slam. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00022"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.-M. (2016, January 27\u201330). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1177\/0278364911434148","article-title":"RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments","volume":"31","author":"Henry","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_28","unstructured":"Nister, D., and Stewenius, H. (2006, January 17\u201322). Scalable recognition with a vocabulary tree. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_29","unstructured":"Engelhard, N., Endres, F., Hess, J., Sturm, J., and Burgard, W. (2011, January 6\u20138). Real-time 3D visual SLAM with a hand-held RGB-D camera. Proceedings of the RGB-D Workshop on 3D Perception in Robotics at the European Robotics Forum, Vasteras, Sweden."},{"key":"ref_30","unstructured":"Sturm, J., Burgard, W., and Cremers, D. (2012, January 7\u201312). Evaluating egomotion and structure-from-motion approaches using the TUM RGB-D benchmark. Proceedings of the Workshop on Color-Depth Camera Fusion in Robotics at the IEEE\/RJS International Conference on Intelligent Robot Systems (IROS), Vilamoura, Algarve, Portugal."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s10514-012-9321-0","article-title":"OctoMap: An efficient probabilistic 3D mapping framework based on octrees","volume":"34","author":"Hornung","year":"2013","journal-title":"Auton. Robot."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tang, S., Chen, W., Wang, W., Li, X., Darwish, W., Li, W., Huang, Z., Hu, H., and Guo, R. (2018). Geometric integration of hybrid correspondences for RGB-D unidirectional tracking. Sensors, 18.","DOI":"10.3390\/s18051385"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3072959.3054739","article-title":"Bundlefusion: Real-time globally consistent 3d reconstruction using on-the-fly surface reintegration","volume":"36","author":"Dai","year":"2017","journal-title":"ACM Trans. Graph. (ToG)"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct sparse odometry","volume":"40","author":"Engel","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.cviu.2005.06.001","article-title":"Structure-from-motion using lines: Representation, triangulation, and bundle adjustment","volume":"100","author":"Bartoli","year":"2005","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_37","unstructured":"Chen, S., Wen, C.-Y., Zou, Y., and Chen, W. (2020). Stereo visual inertial pose estimation based on feedforward-feedback loops. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1177\/027836499501400606","article-title":"A Lie group formulation of robot dynamics","volume":"14","author":"Park","year":"1995","journal-title":"Int. J. Robot. Res."},{"key":"ref_39","unstructured":"Harris, C.G., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_40","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An Iterative Image Registration Technique with An Application to Stereo Vision. Proceedings of the Seventh International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5201\/ipol.2012.gjmr-lsd","article-title":"LSD: A line segment detector","volume":"2","author":"Jakubowicz","year":"2012","journal-title":"Image Process. Line"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1016\/j.jvcir.2013.05.006","article-title":"An efficient and robust line segment matching approach based on LBD descriptor and pairwise geometric consistency","volume":"24","author":"Zhang","year":"2013","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_43","first-page":"2","article-title":"Fast approximate nearest neighbors with automatic algorithm configuration","volume":"2","author":"Muja","year":"2009","journal-title":"VISAPP"},{"key":"ref_44","unstructured":"Grisetti, G., K\u00fcmmerle, R., Strasdat, H., and Konolige, K. (2011, January 9\u201313). g2o: A general framework for (hyper) graph optimization. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China."},{"key":"ref_45","unstructured":"Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer Vision with the OpenCV Library, O\u2019Reilly Media, Inc."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1109\/TRO.2015.2489498","article-title":"Building a 3-D line-based map using stereo SLAM","volume":"31","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1109\/TRO.2012.2197158","article-title":"Bags of binary words for fast place recognition in image sequences","volume":"28","author":"Tardos","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/TRO.2018.2853729","article-title":"Vins-mono: A robust and versatile monocular visual-inertial state estimator","volume":"34","author":"Qin","year":"2018","journal-title":"IEEE Trans. Robot."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1109\/34.88573","article-title":"Least-squares estimation of transformation parameters between two point patterns","volume":"13","author":"Umeyama","year":"1991","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","unstructured":"Qualisys, A.B. (2008). Qualisys Motion Capture Systems, Qualisys."},{"key":"ref_51","unstructured":"Girardeau-Montaut, D. (2016). CloudCompare, GPL Software."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4984\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:06:03Z","timestamp":1760177163000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/4984"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,2]]},"references-count":51,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20174984"],"URL":"https:\/\/doi.org\/10.3390\/s20174984","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,2]]}}}