{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T16:51:34Z","timestamp":1792687894411,"version":"4.5.0"},"reference-count":34,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,2,23]],"date-time":"2021-02-23T00:00:00Z","timestamp":1614038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Wearable auxiliary devices for visually impaired people are highly attractive research topics. Although many proposed wearable navigation devices can assist visually impaired people in obstacle avoidance and navigation, these devices cannot feedback detailed information about the obstacles or help the visually impaired understand the environment. In this paper, we proposed a wearable navigation device for the visually impaired by integrating the semantic visual SLAM (Simultaneous Localization And Mapping) and the newly launched powerful mobile computing platform. This system uses an Image-Depth (RGB-D) camera based on structured light as the sensor, as the control center. We also focused on the technology that combines SLAM technology with the extraction of semantic information from the environment. It ensures that the computing platform understands the surrounding environment in real-time and can feed it back to the visually impaired in the form of voice broadcast. Finally, we tested the performance of the proposed semantic visual SLAM system on this device. The results indicate that the system can run in real-time on a wearable navigation device with sufficient accuracy.<\/jats:p>","DOI":"10.3390\/s21041536","type":"journal-article","created":{"date-parts":[[2021,2,23]],"date-time":"2021-02-23T20:19:36Z","timestamp":1614111576000},"page":"1536","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":62,"title":["A Wearable Navigation Device for Visually Impaired People Based on the Real-Time Semantic Visual SLAM System"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1597-9058","authenticated-orcid":false,"given":"Zhuo","family":"Chen","sequence":"first","affiliation":[{"name":"Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, State Key Laboratory of Intelligent Control and Decision of Complex System, Beijing Advanced Innovation Center for Intelligent Robots and Systems, and School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0230-2742","authenticated-orcid":false,"given":"Xiaoming","family":"Liu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, State Key Laboratory of Intelligent Control and Decision of Complex System, Beijing Advanced Innovation Center for Intelligent Robots and Systems, and School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Masaru","family":"Kojima","sequence":"additional","affiliation":[{"name":"Department of Materials Engineering Science, Osaka University, Osaka 560-8531, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qiang","family":"Huang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, State Key Laboratory of Intelligent Control and Decision of Complex System, Beijing Advanced Innovation Center for Intelligent Robots and Systems, and School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tatsuo","family":"Arai","sequence":"additional","affiliation":[{"name":"Key Laboratory of Biomimetic Robots and Systems, Ministry of Education, State Key Laboratory of Intelligent Control and Decision of Complex System, Beijing Advanced Innovation Center for Intelligent Robots and Systems, and School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China"},{"name":"Global Alliance Laboratory, The University of Electro-Communications, Tokyo 182-8585, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dhivya, K., Premalatha, G., and Monica, S. (2019, January 15\u201317). Wearable Navigation Device for Virtual Blind Guidance. Proceedings of the 2019 International Conference on Intelligent Computing and Control Systems (ICCS), Madurai, India.","DOI":"10.1109\/ICCS45141.2019.9065816"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Vamsi Krishna, B., and Aparna, K. (2018). IoT-Based Indoor Navigation Wearable System for Blind People. 2017 Artificial Intelligence and Evolutionary Computations in Engineering Systems, Springer.","DOI":"10.1007\/978-981-10-7868-2_40"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wang, Y., Huang, J., Wang, Y., Tao, C., Yan, H., and Ma, L. (2014, January 3\u20135). Indoor localization system based on wearable posture sensors with incomplete observations. Proceedings of the 2014 International Conference on Modelling, Identification & Control, Melbourne, Australia.","DOI":"10.1109\/ICMIC.2014.7020780"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1109\/TMECH.2011.2169980","article-title":"Human-Walking-Intention-Based Motion Control of an Omnidirectional-Type Cane Robot","volume":"18","author":"Wakita","year":"2013","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"021001","DOI":"10.1088\/1741-2552\/aa9817","article-title":"A Review of Rapid Serial Visual Presentation-based Brain-Computer Interfaces","volume":"15","author":"Lees","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_6","unstructured":"Smith, R., Self, M., and Cheeseman, P. (1987). A stochastic map for uncertain spatial relationships. Proceedings 4th International Symposium on Robotic Research, MIT Press."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A Versatile and Accurate Monocular SLAM System","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-Scale Direct Monocular SLAM. Proceedings of the European Conference on Computer Vision, Cham, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1177\/0278364916669237","article-title":"ElasticFusion: Real-Time Dense SLAM and Light Source Estimation","volume":"35","author":"Whelan","year":"2016","journal-title":"Int. J. Robot. Res."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Forster, C., Pizzoli, M., and Scaramuzza, D. (June, January 31). SVO: Fast semi-direct monocular visual odometry. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6906584"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kaiser, E.B., Kaiser, E.B., and Lawo, M. (June, January 30). Wearable Navigation System for the Visually Impaired and Blind People. Proceedings of the 2012 IEEE\/ACIS 11th International Conference on Computer and Information Science, Shanghai, China.","DOI":"10.1109\/ICIS.2012.118"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.cviu.2016.03.019","article-title":"RGB-D camera based wearable navigation system for the visually impaired","volume":"149","author":"Lee","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, X., Li, B., Joseph, S.L., Xiao, J., Sun, Y., Tian, Y., Mu\u00f1oz, J.P., and Yi, C. (2015, January 9\u201312). A SLAM Based Semantic Indoor Navigation System for Visually Impaired Users. Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Hong Kong, China.","DOI":"10.1109\/SMC.2015.258"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Salas-Moreno, R.F., Newcombe, R.A., Strasdat, H., Kelly, P.H.J., and Davison, A.J. (2013, January 23\u201328). SLAM++: Simultaneous Localisation and Mapping at the Level of Objects. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.178"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TPAMI.2016.2572683","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Shelhamer","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs","volume":"40","author":"Chen","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016). Deep Residual Learning for Image Recognition, IEEE.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sturm, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7\u201312). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal.","DOI":"10.1109\/IROS.2012.6385773"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Agrawal, M., Konolige, K., and Blas, M.R. (2008, January 12\u201318). CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching. Proceedings of the European Conference on Computer Vision, Berlin\/Heidelberg, Germany.","DOI":"10.1007\/978-3-540-88693-8_8"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jianbo, S. (1994, January 21\u201323). Tomasi. Good features to track. In Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.1994.323794"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 13). SURF: Speeded Up Robust Features. Proceedings of the European Conference on Computer Vision, Berlin\\Heidelberg, Germany.","DOI":"10.1007\/11744023_32"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary Robust invariant scalable keypoints. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 13). Machine Learning for High-Speed Corner Detection. Proceedings of the European Conference on Computer Vision, Berlin, Heidelberg, Germany.","DOI":"10.1007\/11744023_34"},{"key":"ref_29","unstructured":"Paszke, A., Chaurasia, A., Kim, S., and Culurciello, E. (2016). ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation. arXiv."},{"key":"ref_30","unstructured":"Yu, F., and Koltun, V. (2016, January 2\u20134). Multi-Scale Context Aggregation by Dilated Convolutions. Proceedings of the International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bowman, S.L., Atanasov, N., Daniilidis, K., and Pappas, G.J. (June, January 29). Probabilistic data association for semantic SLAM. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989203"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhao, H., Qi, X., Shen, X., Shi, J., and Jia, J. (2018, January 8\u201314). ICNet for Real-Time Semantic Segmentation on High-Resolution Images. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_25"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"SegNet: A Deep Convolutional Encoder-Decoder Architecture for Scene Segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1536\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:26:52Z","timestamp":1760160412000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/4\/1536"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,23]]},"references-count":34,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["s21041536"],"URL":"https:\/\/doi.org\/10.3390\/s21041536","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,23]]}}}