{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T19:03:11Z","timestamp":1769022191157,"version":"3.49.0"},"reference-count":53,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2016,11,21]],"date-time":"2016-11-21T00:00:00Z","timestamp":1479686400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The introduction of RGB-Depth (RGB-D) sensors into the visually impaired people (VIP)-assisting area has stirred great interest of many researchers. However, the detection range of RGB-D sensors is limited by narrow depth field angle and sparse depth map in the distance, which hampers broader and longer traversability awareness. This paper proposes an effective approach to expand the detection of traversable area based on a RGB-D sensor, the Intel RealSense R200, which is compatible with both indoor and outdoor environments. The depth image of RealSense is enhanced with IR image large-scale matching and RGB image-guided filtering. Traversable area is obtained with RANdom SAmple Consensus (RANSAC) segmentation and surface normal vector estimation, preliminarily. A seeded growing region algorithm, combining the depth image and RGB image, enlarges the preliminary traversable area greatly. This is critical not only for avoiding close obstacles, but also for allowing superior path planning on navigation. The proposed approach has been tested on a score of indoor and outdoor scenarios. Moreover, the approach has been integrated into an assistance system, which consists of a wearable prototype and an audio interface. Furthermore, the presented approach has been proved to be useful and reliable by a field test with eight visually impaired volunteers.<\/jats:p>","DOI":"10.3390\/s16111954","type":"journal-article","created":{"date-parts":[[2016,11,21]],"date-time":"2016-11-21T11:16:05Z","timestamp":1479726965000},"page":"1954","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":76,"title":["Expanding the Detection of Traversable Area with RealSense for the Visually Impaired"],"prefix":"10.3390","volume":"16","author":[{"given":"Kailun","family":"Yang","sequence":"first","affiliation":[{"name":"College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"given":"Kaiwei","family":"Wang","sequence":"additional","affiliation":[{"name":"College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"given":"Weijian","family":"Hu","sequence":"additional","affiliation":[{"name":"College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]},{"given":"Jian","family":"Bai","sequence":"additional","affiliation":[{"name":"College of Optical Science and Engineering, Zhejiang University, Hangzhou 310027, China"}]}],"member":"1968","published-online":{"date-parts":[[2016,11,21]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization. Available online: www.who.int\/mediacentre\/factsheets\/fs282\/en."},{"key":"ref_2","unstructured":"PrimeSense. Available online: www.en.wikipedia.org\/wiki\/PrimeSense."},{"key":"ref_3","unstructured":"Kinect. Available online: www.en.wikipedia.org\/wiki\/Kinect."},{"key":"ref_4","unstructured":"Xtion Pro. Available online: www.asus.com.cn\/3D-Sensor\/Xtion_PRO."},{"key":"ref_5","unstructured":"Mantis Vision. Available online: www.mv4d.com."},{"key":"ref_6","unstructured":"Structure Sensor. Available online: structure.io."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Z\u00f6llner, M., Huber, S., Jetter, H., and Reiterer, H. (2007). NAVI\u2014A Proof-of-Concept of a Mobile Navigational Aid for Visually Impaired Based on the Microsoft Kinect. Human-Computer Interaction\u2014INTERACT 2011, Springer.","DOI":"10.1007\/978-3-642-23768-3_88"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hicks, S.L., Wilson, I., Muhammed, L., Worsfold, J., Downes, S.M., and Kennard, C. (2013). A depth-based head-mounted visual display to aid navigation in partially sighted individuals. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0067695"},{"key":"ref_9","first-page":"1","article-title":"Navigational assistance for the visually impaired using rgb-d sensor with range expansion","volume":"99","author":"Aladren","year":"2014","journal-title":"IEEE Syst. J."},{"key":"ref_10","first-page":"740","article-title":"Kinect cane: An assistive system for the visually impaired based on three-dimensional object recognition","volume":"19","author":"Takizawa","year":"2012","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_11","unstructured":"Park, C.H., and Howard, A.M. (2013, January 14\u201318). Real-time haptic rendering and haptic telepresence robotic system for the visually impaired. Proceedings of the World Haptics Conference, Daejeon, Korea."},{"key":"ref_12","unstructured":"Khan, A., Moideen, F., Lopez, J., Khoo, W.L., and Zhu, Z. (2012). Computers Helping People with Special Needs, Springer."},{"key":"ref_13","first-page":"319","article-title":"Auditory augmented reality: Object sonification for the visually impaired","volume":"11","author":"Ribeiro","year":"2012","journal-title":"IEEE Int. Workshop Multimed. Signal Proc."},{"key":"ref_14","unstructured":"Yang, K., Wang, K., Cheng, R., and Zhu, X. (2015, January 19). A new approach of point cloud processing and scene segmentation for guiding the visually impaired. Proceedings of the IET International Conference on Biomedical Image and Signal Processing, Beijing, China."},{"key":"ref_15","unstructured":"Cheng, R., Wang, K., Yang, K., and Zhao, X. (2015, January 19). A ground and obstacle detection algorithm for the visually impaired. Proceedings of the IET International Conference on Biomedical Image and Signal Processing, Beijing, China."},{"key":"ref_16","unstructured":"PMD. Available online: www.pmdtec.com."},{"key":"ref_17","unstructured":"SoftKinetic. Available online: www.softkinetic.com."},{"key":"ref_18","unstructured":"HEPTAGON. Available online: hptg.com\/industrial."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zeng, L., Prescher, D., and Webber, G. (2012, January 22\u201324). Exploration and avoidance of surrounding obstacles for the visually impaired. Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, Boulder, CO, USA.","DOI":"10.1145\/2384916.2384936"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tamjidi, A., Ye, C., and Hong, S. (2013, January 21\u201323). 6-DOF pose estimation of a Portable Navigation Aid for the visually impaired. Proceedings of the IEEE International Symposium on Robotics and Sensors Environments, Washington, DC, USA.","DOI":"10.1109\/ROSE.2013.6698439"},{"key":"ref_21","unstructured":"Lee, C.H., Su, Y.C., and Chen, L.G. (2012, January 23\u201325). An intelligent depth-based obstacle detection for visually-impaired aid applications. Proceedings of the IEEE 2012 13th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS), Dublin, Ireland."},{"key":"ref_22","unstructured":"PointGrey Bumblebee. Available online: www.ptgrey.com\/bumblebee2-firewire-stereo-vision-camera-systems."},{"key":"ref_23","unstructured":"Stereolabs. Available online: www.stereolabs.com."},{"key":"ref_24","unstructured":"DUO. Available online: duo3d.com."},{"key":"ref_25","first-page":"17476","article-title":"Assisting the visually impaired: Obstacle detection and warning system by acoustic feedback","volume":"12","author":"Yebes","year":"2011","journal-title":"Sensors"},{"key":"ref_26","unstructured":"Lee, Y.H., and Medioni, G. (2011, January 27). RGB-D camera based navigation for the visually impaired. Proceedings of the RSS RGBD Advanced Reasoning with Depth Camera Workshop, Los Angeles, CA, USA."},{"key":"ref_27","unstructured":"Martinez, J.M.S., and Ruiz, F.E. (2008, January 18). Stereo-based aerial obstacle detection for the visually impaired. Proceedings of the Workshop on Computer Vision Applications for the Visually Impaired, Marseille, France."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lin, K.W., Lau, T.K., Cheuk, C.M., and Liu, Y. (2012, January 5\u20138). A wearable stereo vision system for visually impaired. Proceedings of the 2012 International Conference on Mechatronics and Automation (ICMA), Chengdu, China.","DOI":"10.1109\/ICMA.2012.6284345"},{"key":"ref_29","unstructured":"Intel RealSense R200. Available online: software.intel.com\/en-us\/realsense\/r200camera."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kyt\u00f6, M., Nuutinen, M., and Oittinen, P. (2011). Method for measuring stereo camera depth accuracy based on stereoscopic vision. Proc. SPIE Int. Soc. Opt. Eng.","DOI":"10.1117\/12.872015"},{"key":"ref_31","unstructured":"Getting Started with the Depth Data Provided by Intel RealSense Technology. Available online: software.intel.com\/en-us\/articles\/realsense-depth-data."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Comm. ACM"},{"key":"ref_33","unstructured":"InvenSense MPU-6050. Available online: www.invensense.com\/products\/motion-tracking\/6-axis\/mpu-6050."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1109\/34.295913","article-title":"Seeded Region Growing","volume":"16","author":"Adams","year":"1994","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, T., Bu, L., and Huang, Z. (2015). A new method for obstacle detection based on Kinect depth image. IEEE Chin. Autom. Congr.","DOI":"10.1109\/CAC.2015.7382559"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Perez-Yus, A., Gutierrez-Gomez, D., Lopez-Nicolas, G., and Guerrero, J.J. (2016). Stairs detection with odometry-aided traversal from a wearable RGB-D camera. Comput. Vis. Image Underst., in press.","DOI":"10.1016\/j.cviu.2016.04.007"},{"key":"ref_37","unstructured":"Wang, Z., Huang, S., and Dissanayake, G. (2008). Simultaneous Localization and Mapping, Springer."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.cviu.2016.03.019","article-title":"RGB-D camera based wearable navigation system for the visually impaired","volume":"149","author":"Lee","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_39","first-page":"197","article-title":"Localization and tracking in known large environments using portable real-time 3D sensors","volume":"139","author":"Taddei","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Koester, D., Schauerte, B., and Stiefelhagen, R. (2013, January 15\u201319). Accessible section detection for visual guidance. Proceedings of the IEEE International Conference on Multimedia and Expo Workshops, San Jose, CA, USA.","DOI":"10.1109\/ICMEW.2013.6618351"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Bellone, M., Messina, A., and Reina, G. (2013, January 9\u201312). A new approach for terrain analysis in mobile robot applications. Proceedings of the IEEE International Conference on Mechatronics, Wollongong, Australia.","DOI":"10.1109\/ICMECH.2013.6518540"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.cviu.2015.11.007","article-title":"An integrated artificial vision framework for assisting visually impaired users","volume":"149","author":"Chessa","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1002\/rob.20276","article-title":"Learning long-range vision for autonomous off-road driving","volume":"26","author":"Hadsell","year":"2009","journal-title":"J. Field Robot."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"12405","DOI":"10.3390\/s120912405","article-title":"Towards autonomous agriculture: Automatic ground detection using trinocular stereovision","volume":"12","author":"Reina","year":"2012","journal-title":"Sensors"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.robot.2012.10.001","article-title":"Visual ground segmentation by radar supervision","volume":"62","author":"Milella","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Reina, G., Milella, A., and Rouveure, R. (2015, January 17\u201319). Traversability analysis for off-road vehicles using stereo and radar data. Proceedings of the IEEE International Conference on Industrial Technology, Seville, Spain.","DOI":"10.1109\/ICIT.2015.7125155"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.cviu.2016.02.016","article-title":"You-Do, I-Learn: Egocentric unsupervised discovery of objects and their modes of interaction towards video-based guidance","volume":"149","author":"Damen","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_48","unstructured":"Geiger, A., Roser, M., and Urtasun, R. (2010). Efficient Large-Scale Stereo Matching. Asian Conference on Computer Vision, Springer."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Einecke, N., and Eggert, J. (July, January 28). A multi-block-matching approach for stereo. Proceedings of the 2015 IEEE Intelligent Vehicles Symposium (IV), Seoul, Korea.","DOI":"10.1109\/IVS.2015.7225748"},{"key":"ref_50","first-page":"1397","article-title":"Guided Image Filtering","volume":"35","author":"He","year":"2013","journal-title":"IEEE Trans. Softw. Eng."},{"key":"ref_51","unstructured":"Intel RealSense Depth Enabled Photography. Available online: software.intel.com\/en-us\/articles\/intel-realsense-depth-enabled-photography."},{"key":"ref_52","unstructured":"Kaiwei Wang Team. Available online: wangkaiwei.org."},{"key":"ref_53","unstructured":"AfterShokz BLUEZ 2S. Available online: www.aftershokz.com.cn\/bluez-2s."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1954\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:27:06Z","timestamp":1760210826000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1954"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,21]]},"references-count":53,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2016,11]]}},"alternative-id":["s16111954"],"URL":"https:\/\/doi.org\/10.3390\/s16111954","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,11,21]]}}}