{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T23:10:04Z","timestamp":1772838604651,"version":"3.50.1"},"reference-count":22,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T00:00:00Z","timestamp":1630454400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The National Science Foundation (NSF) for Young Scientists of China","award":["61803045"],"award-info":[{"award-number":["61803045"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>When a traditional visual SLAM system works in a dynamic environment, it will be disturbed by dynamic objects and perform poorly. In order to overcome the interference of dynamic objects, we propose a semantic SLAM system for catadioptric panoramic cameras in dynamic environments. A real-time instance segmentation network is used to detect potential moving targets in the panoramic image. In order to find the real dynamic targets, potential moving targets are verified according to the sphere\u2019s epipolar constraints. Then, when extracting feature points, the dynamic objects in the panoramic image are masked. Only static feature points are used to estimate the pose of the panoramic camera, so as to improve the accuracy of pose estimation. In order to verify the performance of our system, experiments were conducted on public data sets. The experiments showed that in a highly dynamic environment, the accuracy of our system is significantly better than traditional algorithms. By calculating the RMSE of the absolute trajectory error, we found that our system performed up to 96.3% better than traditional SLAM. Our catadioptric panoramic camera semantic SLAM system has higher accuracy and robustness in complex dynamic environments.<\/jats:p>","DOI":"10.3390\/s21175889","type":"journal-article","created":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T11:39:03Z","timestamp":1630496343000},"page":"5889","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Semantic SLAM System for Catadioptric Panoramic Cameras in Dynamic Environments"],"prefix":"10.3390","volume":"21","author":[{"given":"Yu","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiping","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ning","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaowen","family":"Lv","sequence":"additional","affiliation":[{"name":"School of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1109\/TIV.2017.2749181","article-title":"Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving","volume":"2","author":"Bresson","year":"2017","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-Scale Direct Monocular SLAM. Proceedings of the Computer Vision\u2014ECCV 2014, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct Sparse Odometry","volume":"40","author":"Engel","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Heng, L., and Choi, B. (2016, January 9\u201314). Semi-direct visual odometry for a fisheye-stereo camera. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759600"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Liu, P., Heng, L., Sattler, T., Geiger, A., and Pollefeys, M. (2017, January 24\u201328). Direct visual odometry for a fisheye-stereo camera. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8205988"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wang, S., Yue, J., Dong, Y., Shen, R., and Zhang, X. (2018, January 26\u201330). Real-time Omnidirectional Visual SLAM with Semi-Dense Mapping. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Real-time Omnidirectional Visual SLAM with Semi-Dense Mapping, Changshu, China.","DOI":"10.1109\/IVS.2018.8500460"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"32310","DOI":"10.1109\/ACCESS.2021.3059866","article-title":"Robust Stereo Visual SLAM for Dynamic Environments With Moving Object","volume":"9","author":"Li","year":"2021","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chum, O., Matas, J., and Kittler, J. (2003). Locally Optimized RANSAC, Springer.","DOI":"10.1007\/978-3-540-45243-0_31"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pire, T., Fischer, T., Civera, J., Crist\u00f3foris, P.D., and Berlles, J.J. (October, January 28). Stereo parallel tracking and mapping for robot localization. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353546"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.robot.2016.11.012","article-title":"Improving RGB-D SLAM in dynamic environments: A motion removal approach","volume":"89","author":"Sun","year":"2017","journal-title":"Robot. Auton. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2263","DOI":"10.1109\/LRA.2017.2724759","article-title":"RGB-D SLAM in Dynamic Environments Using Static Point Weighting","volume":"2","author":"Li","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1080\/01691864.2019.1610060","article-title":"Improving monocular visual SLAM in dynamic environments: An optical-flow-based approach","volume":"33","author":"Cheng","year":"2019","journal-title":"Adv. Robot."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.robot.2019.03.012","article-title":"Dynamic-SLAM: Semantic monocular visual localization and mapping based on deep learning in dynamic environment","volume":"117","author":"Xiao","year":"2019","journal-title":"Robot. Auton. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5191","DOI":"10.1109\/LRA.2021.3068640","article-title":"DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM","volume":"6","author":"Bescos","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yu, C., Liu, Z., Liu, X., Xie, F., Yang, Y., Wei, Q., and Fei, Q. (2018, January 1\u20135). DS-SLAM: A Semantic Visual SLAM towards Dynamic Environments. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593691"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bolya, D., Zhou, C., Xiao, F., and Lee, Y.J. (November, January 27). YOLACT: Real-time Instance Segmentation. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00925"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Scaramuzza, D., Martinelli, A., and Siegwart, R. (2006, January 4\u20137). A Flexible Technique for Accurate Omnidirectional Camera Calibration and Structure from Motion. Proceedings of the IEEE International Conference on Computer Vision Systems, New York, NY, USA.","DOI":"10.1109\/ICVS.2006.3"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nbein, M., and Geiger, A. (2014, January 14\u201318). Omnidirectional 3D Reconstruction in Augmented Manhattan Worlds. Proceedings of the 2014 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6942637"},{"key":"ref_21","first-page":"190","article-title":"Research on Visual Odometry Based on Catadioptric Panoramic Camera","volume":"50","author":"Zhang","year":"2021","journal-title":"Acta Photonica Sin."},{"key":"ref_22","unstructured":"Zhang, J., Henein, M., Mahony, R., and Ila, V. (2020). VDO-SLAM: A Visual Dynamic Object-aware SLAM System. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/17\/5889\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:54:15Z","timestamp":1760165655000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/17\/5889"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,1]]},"references-count":22,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["s21175889"],"URL":"https:\/\/doi.org\/10.3390\/s21175889","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,1]]}}}