{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T09:49:17Z","timestamp":1764841757203,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2014,6,13]],"date-time":"2014-06-13T00:00:00Z","timestamp":1402617600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper, we propose a new haptic-assisted virtual cane system operated by a simple finger pointing gesture. The system is developed by two stages: development of visual information delivery assistant (VIDA) with a stereo camera and adding a tactile feedback interface with dual actuators for guidance and distance feedbacks. In the first stage, user\u2019s pointing finger is automatically detected using color and disparity data from stereo images and then a 3D pointing direction of the finger is estimated with its geometric and textural features. Finally, any object within the estimated pointing trajectory in 3D space is detected and the distance is then estimated in real time. For the second stage, identifiable tactile signals are designed through a series of identification experiments, and an identifiable tactile feedback interface is developed and integrated into the VIDA system. Our approach differs in that navigation guidance is provided by a simple finger pointing gesture and tactile distance feedbacks are perfectly identifiable to the blind.<\/jats:p>","DOI":"10.3390\/s140610412","type":"journal-article","created":{"date-parts":[[2014,6,13]],"date-time":"2014-06-13T11:12:51Z","timestamp":1402657971000},"page":"10412-10431","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Stereo Camera Based Virtual Cane System with Identifiable Distance Tactile Feedback for the Blind"],"prefix":"10.3390","volume":"14","author":[{"given":"Donghun","family":"Kim","sequence":"first","affiliation":[{"name":"School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN 47906, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kwangtaek","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-ITTechnology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sangyoun","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Institute of BioMed-IT, Energy-IT and Smart-ITTechnology (Best), Yonsei University, Yonsei-ro, Seodaemun-gu, Seoul 120-749, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2014,6,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Vera, P., Zenteno, D., and Salas, J. (2013). A smartphone-based virtual white cane. Pattern Anal. Appl., 2013.","DOI":"10.1007\/s10044-013-0328-8"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/TSMCC.2009.2021255","article-title":"Wearable obstacle avoidance electronic travel aids for blind: A survey","volume":"40","author":"Dakopoulos","year":"2010","journal-title":"IEEE Trans. Syst. Man Cybern. Part C Appl. Rev."},{"key":"ref_3","unstructured":"Yuan, D., and Manduchi, R. (2, January 27). A tool for range sensing and environment discovery for the blind. Washington, DC, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1145\/2063176.2063200","article-title":"(Computer) vision without sight","volume":"55","author":"Manduchi","year":"2012","journal-title":"ACM Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1142\/S0219467810003871","article-title":"Artificial vision for the blind: A bio-inspired algorithm for objects and obstacles detection","volume":"10","author":"Dramas","year":"2010","journal-title":"Int. J. Image Graph."},{"key":"ref_6","first-page":"362","article-title":"The SmartVision local navigation aid for blind and visually impaired persons","volume":"5","author":"Farrajota","year":"2011","journal-title":"Int. J. Digit. Content Technol. Appl."},{"key":"ref_7","unstructured":"Fernandes, H., Costa, P., Filipe, V., Hadjileontiadis, L., and Barroso, J. (2010, January 19\u201323). Stereo vision in blind navigation assistance. Kobe, Japan."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Brilhault, A., Kammoun, S., Gutierrez, O., Truillet, P., and Jouffrais, C. (2011, January 7\u201310). Fusion of artificial vision and GPS to improve blind pedestrian positioning. Paris, France.","DOI":"10.1109\/NTMS.2011.5721061"},{"key":"ref_9","unstructured":"Denis, G., Jouffrais, C., Vergnieux, V., and Mac\u00e9, M. (2, January 27). Human faces detection and localization with simulated prosthetic vision. Paris, France."},{"key":"ref_10","unstructured":"Asano, H., Nagayasu, T., Orimo, T., Terabayashi, K., Ohta, M., and Umeda, K. (2013, January 14\u201317). Recognition of finger-pointing direction using color clustering and image segmentation. Nagoya, Japan."},{"key":"ref_11","unstructured":"Kim, D., and Hong, K. (2013, January 11\u201314). A robust human pointing location estimation using 3D hand and face poses with RGB-D sensor. Las Vegas, NV, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1145\/1897816.1897838","article-title":"Vision-based hand-gesture applications","volume":"54","author":"Wachs","year":"2011","journal-title":"Commun. ACM"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Matikainen, P., Pillai, P., Mummert, L., Sukthankar, R., and Hebert, M. (2011, January 21\u201325). Prop-free pointing detection in dynamic cluttered environments. Santa Barbara, CA, USA.","DOI":"10.1109\/FG.2011.5771428"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lee, M., Green, R., and Billinghurst, M. (2008, January 26\u201328). 3D natural hand interaction for AR applications. Christchurch, UK.","DOI":"10.1109\/IVCNZ.2008.4762125"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1016\/j.imavis.2005.12.020","article-title":"Visual recognition of pointing gestures for human-robot interaction","volume":"25","author":"Nickel","year":"2007","journal-title":"Image Vis. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1007\/s100550200017","article-title":"Glove based user interaction techniques for augmented reality in an outdoor environment","volume":"6","author":"Thomas","year":"2002","journal-title":"Virtual Real."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Segen, J., and Kumar, S. (1998, January 12\u201316). Gesture VR: Vision-based 3D hand interace for spatial interaction. Bristol, UK.","DOI":"10.1145\/290747.290822"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Rehg, J., and Kanade, T. (1994, January 2\u20136). Visual tracking of high DOF articulated structures: An application to human hand tracking. Stockholm, Sweden.","DOI":"10.1007\/BFb0028333"},{"key":"ref_19","unstructured":"Ong, E., and Bowden, R. (2004, January 17\u201319). A boosted classifier tree for hand shape detection. Seoul, Korea."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1109\/34.735811","article-title":"Real-time american sign language recognition using desk and wearable computer based video","volume":"20","author":"Starner","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","unstructured":"Kolsch, M., and Turk, M. (2004, January 17\u201319). Robust hand detection. Seoul, Korea."},{"key":"ref_22","unstructured":"Trucco, E., and Verri, A. (1998). Introductory Techniques for 3-D Computer Vision, Prentice Hall."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_24","first-page":"58","article-title":"An effective technique for calibrating a binocular stereo through projective reconstruction using both a calibration object and the environment","volume":"1","author":"Zhang","year":"1997","journal-title":"Videre"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1109\/JRA.1987.1087109","article-title":"A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses","volume":"3","author":"Tsai","year":"1987","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_26","first-page":"35","article-title":"Mowat sensor","volume":"11","author":"Pressey","year":"1977","journal-title":"Focus"},{"key":"ref_27","unstructured":"Ertan, S., Lee, C., Willets, A., Tan, H., and Pentland, A. (1998, January 19\u201320). A wearable haptic navigation guidance system. Pittsburgh, PA, USA."},{"key":"ref_28","unstructured":"Vel\u00e1zquez, R., Maingreaud, F., and Pissaloux, E. (2003, January 6\u20139). Intelligent glasses: A new man-machine interface concept integrating computer vision and human tactile perception. Dublin, Ireland."},{"key":"ref_29","unstructured":"Hirose, M., and Amemiya, T. (2003;, January 22\u201327). Wearable finger-braille interface for navigation of deaf-blind in ubiquitous barrier-free space. Crete, Greece."},{"key":"ref_30","unstructured":"Goldstein, E.B. (2013). Sensation and Perception, Cengage Learning."},{"key":"ref_31","first-page":"95","article-title":"Note on the bias of information estimates","volume":"2","author":"Miller","year":"1955","journal-title":"Inf. Theory Psychol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/6\/10412\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:12:26Z","timestamp":1760217146000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/6\/10412"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,6,13]]},"references-count":31,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2014,6]]}},"alternative-id":["s140610412"],"URL":"https:\/\/doi.org\/10.3390\/s140610412","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2014,6,13]]}}}