{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T13:39:46Z","timestamp":1776692386675,"version":"3.51.2"},"reference-count":28,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T00:00:00Z","timestamp":1621209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1852002"],"award-info":[{"award-number":["1852002"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1560302"],"award-info":[{"award-number":["1560302"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, significant work has been done in technological enhancements for mobility aids (smart walkers). However, most of this work does not cover the millions of people who have both mobility and visual impairments. In this paper, we design and study four different configurations of smart walkers that are specifically targeted to the needs of this population. We investigated different sensing technologies (ultrasound-based, infrared depth cameras and RGB cameras with advanced computer vision processing), software configurations, and user interface modalities (haptic and audio signal based). Our experiments show that there are several engineering choices that can be used in the design of such assistive devices. Furthermore, we found that a holistic evaluation of the end-to-end performance of the systems is necessary, as the quality of the user interface often has a larger impact on the overall performance than increases in the sensing accuracy beyond a certain point.<\/jats:p>","DOI":"10.3390\/s21103488","type":"journal-article","created":{"date-parts":[[2021,5,17]],"date-time":"2021-05-17T12:19:57Z","timestamp":1621253997000},"page":"3488","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["A Smart Walker for People with Both Visual and Mobility Impairment"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1456-3747","authenticated-orcid":false,"given":"Nafisa","family":"Mostofa","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA"}]},{"given":"Christopher","family":"Feltner","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA"}]},{"given":"Kelly","family":"Fullin","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Ashland University, Ashland, OH 44805, USA"}]},{"given":"Jonathan","family":"Guilbe","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2734-7990","authenticated-orcid":false,"given":"Sharare","family":"Zehtabian","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2525-5873","authenticated-orcid":false,"given":"Salih Safa","family":"Bacanl\u0131","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA"}]},{"given":"Ladislau","family":"B\u00f6l\u00f6ni","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8635-7198","authenticated-orcid":false,"given":"Damla","family":"Turgut","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Central Florida, Orlando, FL 32816, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,17]]},"reference":[{"key":"ref_1","unstructured":"(2019, October 12). Blindness and Vision Impairment. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/blindness-and-visual-impairment."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1111\/jgs.13393","article-title":"Mobility device use in older adults and incidence of falls and worry about falling: Findings from the 2011\u20132012 National Health and Aging Trends Study","volume":"63","author":"Gell","year":"2015","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_3","unstructured":"MacNamara, S., and Lacey, G. (2000, January 24\u201328). A smart walker for the frail visually impaired. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA-2000), San Francisco, CA, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1007\/s12369-019-00585-0","article-title":"Reinforcement Learning Aided Robot-Assisted Navigation: A Utility and RRT Two-Stage Approach","volume":"12","author":"Garrote","year":"2020","journal-title":"Int. J. Soc. Robot."},{"key":"ref_5","unstructured":"Dubowsky, S., Genot, F., Godding, S., Kozono, H., Skwersky, A., Yu, H., and Yu, L.S. (2000, January 24\u201328). PAMM\u2014A robotic aid to the elderly for mobility assistance and monitoring: A \u201chelping-hand\u201d for the elderly. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA-2000), San Francisco, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1109\/MRA.2008.929924","article-title":"The evolution of Guido","volume":"15","author":"Lacey","year":"2008","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_7","unstructured":"Zehtabian, S., Khodadadeh, S., Pearlman, R., Willenberg, B., Kim, B., Turgut, D., B\u00f6l\u00f6ni, L., and Ross, E.A. (2018, January 13\u201315). Supporting rehabilitation prescription compliance with an IoT-augmented four-legged walker. Proceedings of the 2nd Workshop on AI for Aging, Rehabilitation and Independent Assisted Living (ARIAL-18), Stockholm, Sweden."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Khodadadeh, S., Zehtabian, S., Guilbe, J., Pearlman, R., Willenberg, B., Kim, B., Ross, E.A., B\u00f6l\u00f6ni, L., and Turgut, D. (2019, January 20\u201324). Detecting unsafe use of a four-legged walker using IoT and deep learning. Proceedings of the IEEE International Conference on Communications (ICC-2019), Shanghai, China.","DOI":"10.1109\/ICC.2019.8761068"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1109\/THMS.2017.2759807","article-title":"ISR-AIWALKER: Robotic Walker for Intuitive and Safe Mobility Assistance and Gait Analysis","volume":"47","author":"Paulo","year":"2017","journal-title":"IEEE Trans. Hum. Mach. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kashyap, P., Saleh, M., Shakhbulatov, D., and Dong, Z. (2018, January 24\u201325). An Autonomous Simultaneous Localization and Mapping Walker for Indoor Navigation. Proceedings of the IEEE 39th Sarnoff Symposium, Newark, NJ, USA.","DOI":"10.1109\/SARNOF.2018.8720504"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bhatlawande, S.S., Mukhopadhyay, J., and Mahadevappa, M. (2012, January 3\u20135). Ultrasonic spectacles and waist-belt for visually impaired and blind person. Proceedings of the IEEE National Conference on Communications (NCC-2012), Kharagpur, India.","DOI":"10.1109\/NCC.2012.6176765"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Orita, K., Takizawa, H., Aoyagi, M., Ezaki, N., and Shinji, M. (2013, January 15\u201317). Obstacle detection by the Kinect cane system for the visually impaired. Proceedings of the IEEE\/SICE International Symposium on System Integration, Kobe, Japan.","DOI":"10.1109\/SII.2013.6776667"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3754918","DOI":"10.1155\/2016\/3754918","article-title":"Real-time obstacle detection system in indoor environment for the visually impaired using Microsoft Kinect sensor","volume":"2016","author":"Pham","year":"2016","journal-title":"J. Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Panteleris, P., and Argyros, A.A. (2014, January 6\u20137). Vision-based SLAM and moving objects tracking for the perceptual support of a smart walker platform. Proceedings of the Workshop on Assistive Computer Vision and Robotics (ACVR 2014) in Conjunction with ECCV 2014, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-16199-0_29"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rizzon, L., Moro, F., Passerone, R., Macii, D., Fontanelli, D., Nazemzadeh, P., Corr\u00e0, M., Palopoli, L., and Prattichizzo, D. (2016). c-Walker: A cyber-physical system for ambient assisted living. Applications in Electronics Pervading Industry, Environment and Society, Springer.","DOI":"10.1007\/978-3-319-20227-3_10"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Viegas, V., Dias Pereira, J., Postolache, O., and Gir\u00e3o, P.S. (2018). Monitoring walker assistive devices: A novel approach based on load cells and optical distance measurements. Sensors, 18.","DOI":"10.3390\/s18020540"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ramadhan, A.J. (2018). Wearable Smart System for Visually Impaired People. Sensors, 18.","DOI":"10.3390\/s18030843"},{"key":"ref_18","first-page":"99","article-title":"Usability and design guidelines of smart canes for users with visual impairments","volume":"7","author":"Kim","year":"2013","journal-title":"Int. J. Des."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Feltner, C., Guilbe, J., Zehtabian, S., Khodadadeh, S., B\u00f6l\u00f6ni, L., and Turgut, D. (2019, January 20\u201324). Smart Walker for the Visually Impaired. Proceedings of the IEEE ICC 2019, Shanghai, China.","DOI":"10.1109\/ICC.2019.8762081"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mostofa, N., Fullin, K., Zehtabian, S., Bacanli, S.S., B\u00f6l\u00f6ni, L., and Turgut, D. (2020, January 7\u201311). IoT-Enabled Smart Mobility Devices for Aging and Rehabilitation. Proceedings of the IEEE ICC 2020, Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9149442"},{"key":"ref_21","unstructured":"(2019, October 12). Ultrasonic Ranging Module HC\u2014SR04. Available online: https:\/\/www.mouser.com\/datasheet\/2\/813\/HCSR04-1022824.pdf."},{"key":"ref_22","unstructured":"Ren, S., He, K., Girshick, R.B., and Sun, J. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., and Vanhoucke, V. (2016). Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. arXiv.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1956","DOI":"10.1007\/s11263-020-01316-z","article-title":"The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale","volume":"128","author":"Kuznetsova","year":"2020","journal-title":"IJCV"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s10846-010-9498-4","article-title":"Obstacle-free pathway detection by means of depth maps","volume":"63","author":"Ortigosa","year":"2011","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3D is here: Point Cloud Library (PCL). Proceedings of the IEEE International Conference on Robotics and automation (ICRA-2011), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, B., Zhang, X., Mu\u00f1oz, J.P., Xiao, J., Rong, X., and Tian, Y. (2015, January 6\u20139). Assisting blind people to avoid obstacles: An wearable obstacle stereo feedback system based on 3D detection. Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO-2015), Zhuhai, China.","DOI":"10.1109\/ROBIO.2015.7419118"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Martinez, M., Constantinescu, A., Schauerte, B., Koester, D., and Stiefelhagen, R. (2014, January 9\u201311). Cognitive evaluation of haptic and audio feedback in short range navigation tasks. Proceedings of the International Conference on Computers for Handicapped Persons, Paris, France.","DOI":"10.1007\/978-3-319-08599-9_20"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3488\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:02:39Z","timestamp":1760162559000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3488"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,17]]},"references-count":28,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21103488"],"URL":"https:\/\/doi.org\/10.3390\/s21103488","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,17]]}}}