{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T08:25:04Z","timestamp":1790843104788,"version":"4.1.0"},"reference-count":28,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T00:00:00Z","timestamp":1694736000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2021YFA0716600"],"award-info":[{"award-number":["2021YFA0716600"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["JCYJ20180307151430655"],"award-info":[{"award-number":["JCYJ20180307151430655"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["KQTD20190929172704911"],"award-info":[{"award-number":["KQTD20190929172704911"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100017607","name":"Shenzhen Fundamental Research Program","doi-asserted-by":"publisher","award":["2021YFA0716600"],"award-info":[{"award-number":["2021YFA0716600"]}],"id":[{"id":"10.13039\/501100017607","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100017607","name":"Shenzhen Fundamental Research Program","doi-asserted-by":"publisher","award":["JCYJ20180307151430655"],"award-info":[{"award-number":["JCYJ20180307151430655"]}],"id":[{"id":"10.13039\/501100017607","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100017607","name":"Shenzhen Fundamental Research Program","doi-asserted-by":"publisher","award":["KQTD20190929172704911"],"award-info":[{"award-number":["KQTD20190929172704911"]}],"id":[{"id":"10.13039\/501100017607","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shenzhen Science and Technology Program","award":["2021YFA0716600"],"award-info":[{"award-number":["2021YFA0716600"]}]},{"name":"Shenzhen Science and Technology Program","award":["JCYJ20180307151430655"],"award-info":[{"award-number":["JCYJ20180307151430655"]}]},{"name":"Shenzhen Science and Technology Program","award":["KQTD20190929172704911"],"award-info":[{"award-number":["KQTD20190929172704911"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the rapid development of autonomous driving and robotics applications in recent years, visual Simultaneous Localization and Mapping (SLAM) has become a hot research topic. The majority of visual SLAM systems relies on the assumption of scene rigidity, which may not always hold true in real applications. In dynamic environments, SLAM systems, without accounting for dynamic objects, will easily fail to estimate the camera pose. Some existing methods attempt to address this issue by simply excluding the dynamic features lying in moving objects. But this may lead to a shortage of features for tracking. To tackle this problem, we propose OTE-SLAM, an object tracking enhanced visual SLAM system, which not only tracks the camera motion, but also tracks the movement of dynamic objects. Furthermore, we perform joint optimization of both the camera pose and object 3D position, enabling a mutual benefit between visual SLAM and object tracking. The results of experiences demonstrate that the proposed approach improves the accuracy of the SLAM system in challenging dynamic environments. The improvements include a maximum reduction in both absolute trajectory error and relative trajectory error by 22% and 33%, respectively.<\/jats:p>","DOI":"10.3390\/s23187921","type":"journal-article","created":{"date-parts":[[2023,9,17]],"date-time":"2023-09-17T23:57:46Z","timestamp":1694995066000},"page":"7921","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["OTE-SLAM: An Object Tracking Enhanced Visual SLAM System for Dynamic Environments"],"prefix":"10.3390","volume":"23","author":[{"given":"Yimeng","family":"Chang","sequence":"first","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Hu","sequence":"additional","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shiyou","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen 518107, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An open-source slam system for monocular, stereo, and RDB-D cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct sparse odometry","volume":"40","author":"Engel","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 31). SVO: Fast semi-direct monocular visual odometry. Proceedings of the 2014 IEEE international conference on robotics and automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906584"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Pumarola, A., Vakhitov, A., Agudo, A., Sanfeliu, A., and Moreno-Noguer, F. (June, January 29). PL-SLAM: Real-time monocular visual SLAM with points and lines. Proceedings of the 2017 IEEE international conference on robotics and automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989522"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tateno, K., Tombari, F., Laina, I., and Navab, N. (2017, January 21\u201326). Cnn-slam: Real-time dense monocular slam with learned depth prediction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.695"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yu, C., Liu, Z., Liu, X.J., Xie, F., Yang, Y., Wei, Q., and Fei, Q. (2018, January 1\u20135). DS-SLAM: A semantic visual SLAM towards dynamic environments. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593691"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4076","DOI":"10.1109\/LRA.2018.2860039","article-title":"DynaSLAM: Tracking, mapping, and inpainting in dynamic scenes","volume":"3","author":"Bescos","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhong, F., Wang, S., Zhang, Z., and Wang, Y. (2018, January 12\u201315). Detect-SLAM: Making object detection and SLAM mutually beneficial. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00115"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.robot.2019.03.012","article-title":"Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment","volume":"117","author":"Xiao","year":"2019","journal-title":"Robot. Auton. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"108225","DOI":"10.1016\/j.patcog.2021.108225","article-title":"Blitz-SLAM: A semantic SLAM in dynamic environments","volume":"121","author":"Fan","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5191","DOI":"10.1109\/LRA.2021.3068640","article-title":"DynaSLAM II: Tightly-coupled multi-object tracking and SLAM","volume":"6","author":"Bescos","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_13","unstructured":"Zhang, J., Henein, M., Mahony, R., and Ila, V. (2020). VDO-SLAM: A visual dynamic object-aware SLAM system. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ballester, I., Font\u00e1n, A., Civera, J., Strobl, K.H., and Triebel, R. (June, January 30). DOT: Dynamic object tracking for visual SLAM. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561452"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Sun, P., Jiang, Y., Yu, D., Weng, F., Yuan, Z., Luo, P., Liu, W., and Wang, X. (2022, January 23\u201327). Bytetrack: Multi-object tracking by associating every detection box. Proceedings of the Computer Vision\u2013ECCV 2022: 17th European Conference, Tel Aviv, Israel. Proceedings, Part XXII.","DOI":"10.1007\/978-3-031-20047-2_1"},{"key":"ref_16","unstructured":"Wu, Q., Shi, S., Wan, Z., Fan, Q., Fan, P., and Zhang, C. (2022). Towards V2I age-aware fairness access: A dqn based intelligent vehicular node training and test method. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"SegNet: A deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1002\/rob.22145","article-title":"YOLOv4-tiny-based robust RGB-D SLAM approach with point and surface feature fusion in complex indoor environments","volume":"40","author":"Chang","year":"2022","journal-title":"J. Field Robot."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zang, Q., Zhang, K., Wang, L., and Wu, L. (2023). An Adaptive ORB-SLAM3 System for Outdoor Dynamic Environments. Sensors, 23.","DOI":"10.3390\/s23031359"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yuan, C., Xu, Y., and Zhou, Q. (2023). PLDS-SLAM: Point and Line Features SLAM in Dynamic Environment. Remote Sens., 15.","DOI":"10.3390\/rs15071893"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1109\/TRO.2019.2909168","article-title":"CubeSLAM: Monocular 3-D object SLAM","volume":"35","author":"Yang","year":"2019","journal-title":"IEEE Trans. Robot."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Qiu, Y., Wang, C., Wang, W., Henein, M., and Scherer, S. (2022, January 23\u201327). AirDOS: Dynamic SLAM benefits from articulated objects. Proceedings of the 2022 IEEE International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9811667"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1109\/LRA.2021.3056072","article-title":"A switching-coupled backend for simultaneous localization and dynamic object tracking","volume":"6","author":"Liu","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sun, Y., Hu, J., Yun, J., Liu, Y., Bai, D., Liu, X., Zhao, G., Jiang, G., Kong, J., and Chen, B. (2022). Multi-objective location and mapping based on deep learning and visual slam. Sensors, 22.","DOI":"10.3390\/s22197576"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Veeramani, B., Raymond, J.W., and Chanda, P. (2018). DeepSort: Deep convolutional networks for sorting haploid maize seeds. BMC Bioinform., 19.","DOI":"10.1186\/s12859-018-2267-2"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The kitti dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7921\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:51:58Z","timestamp":1760129518000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7921"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,15]]},"references-count":28,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23187921"],"URL":"https:\/\/doi.org\/10.3390\/s23187921","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,15]]}}}