{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T17:50:45Z","timestamp":1790877045886,"version":"4.1.0"},"reference-count":24,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2025,7,6]],"date-time":"2025-07-06T00:00:00Z","timestamp":1751760000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12204273"],"award-info":[{"award-number":["12204273"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["ZR2024MF107"],"award-info":[{"award-number":["ZR2024MF107"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["ts20230111"],"award-info":[{"award-number":["ts20230111"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2017YFA0701302"],"award-info":[{"award-number":["2017YFA0701302"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["12204273"],"award-info":[{"award-number":["12204273"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["ZR2024MF107"],"award-info":[{"award-number":["ZR2024MF107"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["ts20230111"],"award-info":[{"award-number":["ts20230111"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["2017YFA0701302"],"award-info":[{"award-number":["2017YFA0701302"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Instrument Improvement Funds of Shandong University Public Technology Platform","award":["12204273"],"award-info":[{"award-number":["12204273"]}]},{"name":"Instrument Improvement Funds of Shandong University Public Technology Platform","award":["ZR2024MF107"],"award-info":[{"award-number":["ZR2024MF107"]}]},{"name":"Instrument Improvement Funds of Shandong University Public Technology Platform","award":["ts20230111"],"award-info":[{"award-number":["ts20230111"]}]},{"name":"Instrument Improvement Funds of Shandong University Public Technology Platform","award":["2017YFA0701302"],"award-info":[{"award-number":["2017YFA0701302"]}]},{"name":"National Key Research and the Development Program of China","award":["12204273"],"award-info":[{"award-number":["12204273"]}]},{"name":"National Key Research and the Development Program of China","award":["ZR2024MF107"],"award-info":[{"award-number":["ZR2024MF107"]}]},{"name":"National Key Research and the Development Program of China","award":["ts20230111"],"award-info":[{"award-number":["ts20230111"]}]},{"name":"National Key Research and the Development Program of China","award":["2017YFA0701302"],"award-info":[{"award-number":["2017YFA0701302"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Visual impairment or even loss seriously affects quality of life. Benefited by the rapid development of sound\/laser detection, Global Positioning System (GPS)\/Beidou positioning, machine vision and other technologies, the quality of life of blind people is expected to be improved through visual substitution technology. The existing visual substitution devices still have limitations in terms of safety, robustness, and ease of operation. The remote companion system developed here fully utilizes multimodal navigation and remote communication technologies, and the positioning and interaction functions of commercial mobile phones. Together with the accumulated judgment of backend personnel, it can provide real-time, safe, and reliable navigation services for blind people, helping them complete daily activities such as independent travel, circulation, and shopping. The practical results show that the system not only has strong operability and is easy to use, but also can provide users with a strong sense of security and companionship, making it suitable for promotion. In the future, this system can also be promoted for other vulnerable groups such as the elderly.<\/jats:p>","DOI":"10.3390\/s25134223","type":"journal-article","created":{"date-parts":[[2025,7,7]],"date-time":"2025-07-07T04:43:37Z","timestamp":1751863417000},"page":"4223","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Multimodal Navigation and Virtual Companion System: A Wearable Device Assisting Blind People in Independent Travel"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0443-547X","authenticated-orcid":false,"given":"Jingjing","family":"Xu","sequence":"first","affiliation":[{"name":"School of Integrated Circuits, Shandong University, Jinan 250010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Caiyi","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Shandong University, Jinan 250010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yancheng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Electronics, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuantuo","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Electronics, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meina","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Tianjin University of Technology, Tianjin 300382, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhuoqun","family":"Shen","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Shandong University, Jinan 250010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiding","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Electronics, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxin","family":"Wan","sequence":"additional","affiliation":[{"name":"School of Electronics, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7610-922X","authenticated-orcid":false,"given":"Fengrong","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Integrated Circuits, Shandong University, Jinan 250010, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7844-6035","authenticated-orcid":false,"given":"Jianhua","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Tianjin University of Technology, Tianjin 300382, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9567-5980","authenticated-orcid":false,"given":"Shengyong","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Electronics, Peking University, Beijing 100871, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,7,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e130","DOI":"10.1016\/S2214-109X(20)30425-3","article-title":"Trends in prevalence of blindness and distance and near vision impairment over 30 years: An analysis for the Global Burden of Disease Study","volume":"9","author":"Bourne","year":"2021","journal-title":"Lancet Glob. Health"},{"key":"ref_2","first-page":"1316","article-title":"Artificial Vision-aid Systems: Current Status and Future Trend","volume":"48","author":"Song","year":"2021","journal-title":"Prog. Biochem. Biophys."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Borda, E., and Ghezzi, D. (2022). Advances in visual prostheses: Engineering and biological challenges. Prog. Biomed. Eng., 4.","DOI":"10.1088\/2516-1091\/ac812c"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zrenner, E., Bartz-Schmidt, K.U., Besch, D., Gekeler, F., Koitschev, A., Sachs, H.G., and Stingl, K. (2017). The subretinal implant ALPHA: Implantation and functional results. Artificial Vision: A Clinical Guide, Springer.","DOI":"10.1007\/978-3-319-41876-6_6"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1038\/s41565-023-01587-w","article-title":"Liquid-metal-based three-dimensional microelectrode arrays integrated with implantable ultrathin retinal prosthesis for vision restoration","volume":"19","author":"Chung","year":"2024","journal-title":"Nat. Nanotechnol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1016\/j.cell.2020.04.033","article-title":"Dynamic stimulation of visual cortex produces form vision in sighted and blind humans","volume":"181","author":"Beauchamp","year":"2020","journal-title":"Cell"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mai, C., Xie, D., Zeng, L., Li, Z., Li, Z., Qiao, Z., Qu, Y., Liu, G., and Li, L. (2023). Laser Sensing and Vision Sensing Smart Blind Cane: A Review. Sensors, 23.","DOI":"10.3390\/s23020869"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gill, E., Morton, J., Axelrad, P., Akos, D.M., Centrella, M., and Speretta, S. (2023). Overview of Space-Capable Global Navigation Satellite Systems Receivers: Heritage, Status and the Trend towards Miniaturization. Sensors, 23.","DOI":"10.3390\/s23177648"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"100132","DOI":"10.1016\/j.sintl.2021.100132","article-title":"Exploring impact and features of machine vision for progressive industry 4.0 culture","volume":"3","author":"Javaid","year":"2022","journal-title":"Sens. Int."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhang, K., Wang, Y., Shi, S., Wang, Q., Wang, C., and Liu, S. (2024). Improved yolov5 algorithm combined with depth camera and embedded system for blind indoor visual assistance. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-74416-2"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"eabg6594","DOI":"10.1126\/scirobotics.abg6594","article-title":"Multimodal sensing and intuitive steering assistance improve navigation and mobility for people with impaired vision","volume":"6","author":"Slade","year":"2021","journal-title":"Sci. Robot."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s10209-023-01086-8","article-title":"Recent advancements in indoor electronic travel aids for the blind or visually impaired: A comprehensive review of technologies and implementations","volume":"24","author":"Kim","year":"2024","journal-title":"Univers. Access Inf. Soc."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, X., Pan, Z., Song, Z., Zhang, Y., Li, W., and Ding, S. (2024). The Aerial Guide Dog: A Low-Cognitive-Load Indoor Electronic Travel Aid for Visually Impaired Individuals. Sensors, 24.","DOI":"10.3390\/s24010297"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, H., and Ye, C. (August, January 31). A visual positioning system for indoor blind navigation. Proceedings of the 2020 IEEE international conference on robotics and automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196782"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/TSMCC.2009.2021255","article-title":"Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey","volume":"40","author":"Dakopoulos","year":"2010","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_16","first-page":"1543","article-title":"A Virtual Vision Navigation System for the Blind Using Wearable Touch-vision Devices","volume":"49","author":"Ge","year":"2021","journal-title":"Prog. Biochem. Biophys"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez, I., Rubio, D., and Rubio, F. (2022). Complexity of adaptive testing in scenarios defined extensionally. Front. Comput. Sci., 17.","DOI":"10.1007\/s11704-022-1673-9"},{"key":"ref_18","unstructured":"Shashua, A., and Aviram, Z.Y. (2025, July 03). Empowering Accessibility with AI. Available online: https:\/\/www.orcam.com\/en-us\/home\/."},{"key":"ref_19","unstructured":"Wiberg, H.J. (2025, January 23). See the World Together. Available online: https:\/\/www.bemyeyes.com\/."},{"key":"ref_20","unstructured":"Kanuganti, S. (2025, January 23). We\u2019re Aira, a Visual Interpreting Service. Available online: https:\/\/aira.io\/."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1145\/3340319","article-title":"NavCog3 in the Wild: Large-scale Blind Indoor Navigation Assistant with Semantic Features","volume":"12","author":"Sato","year":"2019","journal-title":"ACM Trans. Access. Comput."},{"key":"ref_22","unstructured":"Pirttimaa, I. (2025, January 23). Pioneering Accessible Navigation\u2014Indoors and Outdoors. Available online: https:\/\/www.blindsquare.com\/."},{"key":"ref_23","unstructured":"Alexiou, G. (2025, January 23). Sunu Band\u2014The Smart Wearable Helping Blind People Maintain Social Distance. Available online: https:\/\/www.forbes.com\/sites\/gusalexiou\/2020\/08\/30\/sunu-band--the-smart-wearable-helping-blind-people-maintain-social-distance\/."},{"key":"ref_24","unstructured":"Kumar, V.S. (2025, January 23). SmartCane\u2014Blind Cane\/Blind Stick. Available online: https:\/\/www.phoenixmedicalsystems.com\/assistive-technology\/smartcane."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/13\/4223\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:05:31Z","timestamp":1760033131000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/25\/13\/4223"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,6]]},"references-count":24,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["s25134223"],"URL":"https:\/\/doi.org\/10.3390\/s25134223","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,6]]}}}