{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T16:13:36Z","timestamp":1779898416964,"version":"3.53.1"},"reference-count":34,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2016,10,28]],"date-time":"2016-10-28T00:00:00Z","timestamp":1477612800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Romanian National Authority for Scientific Research and Innovation, CNCS - UEFISCDI","award":["PN-II-RU-TE-2014-4-0202"],"award-info":[{"award-number":["PN-II-RU-TE-2014-4-0202"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the most recent report published by the World Health Organization concerning people with visual disabilities it is highlighted that by the year 2020, worldwide, the number of completely blind people will reach 75 million, while the number of visually impaired (VI) people will rise to 250 million. Within this context, the development of dedicated electronic travel aid (ETA) systems, able to increase the safe displacement of VI people in indoor\/outdoor spaces, while providing additional cognition of the environment becomes of outmost importance. This paper introduces a novel wearable assistive device designed to facilitate the autonomous navigation of blind and VI people in highly dynamic urban scenes. The system exploits two independent sources of information: ultrasonic sensors and the video camera embedded in a regular smartphone. The underlying methodology exploits computer vision and machine learning techniques and makes it possible to identify accurately both static and highly dynamic objects existent in a scene, regardless on their location, size or shape. In addition, the proposed system is able to acquire information about the environment, semantically interpret it and alert users about possible dangerous situations through acoustic feedback. To determine the performance of the proposed methodology we have performed an extensive objective and subjective experimental evaluation with the help of 21 VI subjects from two blind associations. The users pointed out that our prototype is highly helpful in increasing the mobility, while being friendly and easy to learn.<\/jats:p>","DOI":"10.3390\/s16111807","type":"journal-article","created":{"date-parts":[[2016,10,28]],"date-time":"2016-10-28T10:14:04Z","timestamp":1477649644000},"page":"1807","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":84,"title":["When Ultrasonic Sensors and Computer Vision Join Forces for Efficient Obstacle Detection and Recognition"],"prefix":"10.3390","volume":"16","author":[{"given":"Bogdan","family":"Mocanu","sequence":"first","affiliation":[{"name":"ARTEMIS Department, Institut Mines-T\u00e9l\u00e9com\/T\u00e9l\u00e9com SudParis, UMR CNRS MAP5 8145, 9 rue Charles Fourier, \u00c9vry 91000, France"},{"name":"Telecommunication Department, Faculty of ETTI, University Politehnica of Bucharest, Splaiul Independentei 313, Bucharest 060042, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruxandra","family":"Tapu","sequence":"additional","affiliation":[{"name":"ARTEMIS Department, Institut Mines-T\u00e9l\u00e9com\/T\u00e9l\u00e9com SudParis, UMR CNRS MAP5 8145, 9 rue Charles Fourier, \u00c9vry 91000, France"},{"name":"Telecommunication Department, Faculty of ETTI, University Politehnica of Bucharest, Splaiul Independentei 313, Bucharest 060042, Romania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Titus","family":"Zaharia","sequence":"additional","affiliation":[{"name":"ARTEMIS Department, Institut Mines-T\u00e9l\u00e9com\/T\u00e9l\u00e9com SudParis, UMR CNRS MAP5 8145, 9 rue Charles Fourier, \u00c9vry 91000, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2016,10,28]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (WHO)\u2014Visual Impairment and Blindness. Available online: http:\/\/www.who.int\/mediacentre\/factsheets\/fs282\/en\/."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"17476","DOI":"10.3390\/s121217476","article-title":"Assisting the visually impaired: Obstacle detection and warning system by acoustic feedback","volume":"12","author":"Yebes","year":"2012","journal-title":"Sensors"},{"key":"ref_3","first-page":"35","article-title":"Mowat sensor","volume":"11","author":"Pressey","year":"1977","journal-title":"Focus"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Busnel, R.-G., and Fish, J.F. (1980). Animal Sonar Systems, Plenium Press.","DOI":"10.1007\/978-1-4684-7254-7"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1109\/TBME.2002.803561","article-title":"Binaural sonar electronic travel aid proves vibrotactile cues for landmark reflector motion and surface texture classification","volume":"49","author":"Kuc","year":"2002","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/3468.911370","article-title":"The GuideCane-applying mobile robot technologies to assist the visually impaired","volume":"31","author":"Ulrich","year":"2001","journal-title":"IEEE Trans. Syst. Man Cybern. A Syst. Hum."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s00371-006-0032-4","article-title":"A wearable system for mobility improvement of visually-impaired people","volume":"23","author":"Cardin","year":"2007","journal-title":"Vis. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"901707","DOI":"10.1155\/2009\/901707","article-title":"CyARM: Haptic sensing device for spatial localization on basis of exploration by arms","volume":"2009","author":"Akita","year":"2009","journal-title":"Adv. Hum. Comput. Interact."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"32168","DOI":"10.3390\/s151229912","article-title":"Design, implementation and evaluation of an indoor navigation system for visually impaired people","volume":"15","author":"Losilla","year":"2015","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jeong, G.-Y., and Yu, K.-H. (2016). Multi-section sensing and vibrotactile perception for walking guide of visually impaired person. Sensors, 16.","DOI":"10.3390\/s16071070"},{"key":"ref_11","first-page":"362","article-title":"The smart vision local navigation aid for blind and visually impaired persons","volume":"5","author":"Farrajota","year":"2011","journal-title":"Int. J. Digit. Content Technol. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Manduchi, R. (2012, January 11\u201313). Vision as assistive technology for the blind: An experimental study. Proceedings of the 13th International Conference on Computers Helping People with Special Needs, Linz, Austria.","DOI":"10.1007\/978-3-642-31534-3_2"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tapu, R., Mocanu, B., Bursuc, A., and Zaharia, T. (2013, January 1\u20138). A smartphone-based obstacle detection and classification system for assisting visually impaired people. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.65"},{"key":"ref_14","unstructured":"Saez, J.M., Escolano, F., and Penalver, A. (2005, January 20\u201325). First Steps towards Stereo-based 6DOF SLAM for the Visually Impaired. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition\u2014Workshops, San Diego, CA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Pradeep, V., Medioni, G., and Weiland, J. (2010, January 13\u201318). Robot vision for the visually impaired. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition\u2014Workshops, San Francisco, CA, USA.","DOI":"10.1109\/CVPRW.2010.5543579"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/JBHI.2014.2322392","article-title":"Aerial obstacle detection with 3-D mobile devices","volume":"19","author":"Escolano","year":"2015","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_17","unstructured":"Khan, A., Moideen, F., Lopez, J., Khoo, W.L., and Zhu, Z. (2012). Computer Helping People with Special, Springer. LNCS7382."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Takizawa, H., Yamaguchi, S., Aoyagi, M., Ezaki, N., and Mizuno, S. (2012, January 16\u201318). Kinect cane: An assistive system for the visually impaired based on three-dimensional object recognition. Proceedings of IEEE International Symposium on System Integration, Fukuoka, Japan.","DOI":"10.1109\/SII.2012.6426936"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Brock, M., and Kristensson, P.O. (2013, January 8\u201312). Supporting blind navigation using depth sensing and sonification. Proceedings of the ACM Conference on Pervasive and Ubiquitous Computing, Zurich, Switzerland.","DOI":"10.1145\/2494091.2494173"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Panteleris, P., and Argyros, A.A. (2014, January 6\u201312). Vision-based SLAM and moving objects tracking for the perceptual support of a smart walker platform. Proceedings of the European Conference on Computer Vision ECCV 2014 Workshops, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-16199-0_29"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). Brief: Binary robust independent elementary features. Proceedings of the 11th European Conference on Computer Vision (ECCV), Heraklion, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Tuzel, O., Porikli, O., and Meer, F. (2006, January 7\u201313). Region covariance: A fast descriptor for detection and classification. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744047_45"},{"key":"ref_25","unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Fourth Alvey Vision Conference, Manchester, UK."},{"key":"ref_26","first-page":"63","article-title":"Scale and affine invariant interest point detectors","volume":"Volume 60","author":"Mikolajczyk","year":"2004","journal-title":"Ubiquitous Intelligence and Computing"},{"key":"ref_27","unstructured":"Lucas, B., and Kanade, T. (1981, January 24\u201328). An iterative technique of image registration and its application to stereo. Proceedings of the IJCAI\u201981 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, USA."},{"key":"ref_28","unstructured":"Lee, J.J., and Kim, G. (2007, January 26\u201329). Robust estimation of camera homography using fuzzy RANSAC. Proceedings of the International Conference on Computational Science and Its Applications, Kuala Lumpur, Malaysia."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","unstructured":"Dance, C.R., Csurka, G., An, L.J., and Willamowski Bray, C. (2004, January 11\u201314). Visual categorization with bags of keypoints. Proceedings of the Workshop on Statistical Learning in Computer Vision at European Conference on Computer Vision (ECCV), Prague, Czech."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Delhumeau, J., Gosselin, P.H., J\u00e9gou, H., and P\u00e9rez, P. (2013, January 21\u201325). Revisiting the VLAD image representation. Proceedings of the 21st ACM International Conference on Multimedia, Barcelona, Spain.","DOI":"10.1145\/2502081.2502171"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1198\/106186006X113430","article-title":"Sparse principal component analysis","volume":"15","author":"Zou","year":"2006","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_33","unstructured":"Tong, S., and Chang, E. (October, January 30). Support vector machine active learning for image retrieval. Proceedings of the International Conference on Multimedia, Ottawa, ON, Canada."},{"key":"ref_34","first-page":"37","article-title":"Evaluation: From precision, recall and f-measure to roc, informedness, markedness and correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1807\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:34:14Z","timestamp":1760211254000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/11\/1807"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,10,28]]},"references-count":34,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2016,11]]}},"alternative-id":["s16111807"],"URL":"https:\/\/doi.org\/10.3390\/s16111807","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,10,28]]}}}