{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T17:10:11Z","timestamp":1783789811442,"version":"3.55.0"},"reference-count":29,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T00:00:00Z","timestamp":1616630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>As difficult vision-based tasks like object detection and monocular depth estimation are making their way in real-time applications and as more light weighted solutions for autonomous vehicles navigation systems are emerging, obstacle detection and collision prediction are two very challenging tasks for small embedded devices like drones. We propose a novel light weighted and time-efficient vision-based solution to predict Time-to-Collision from a monocular video camera embedded in a smartglasses device as a module of a navigation system for visually impaired pedestrians. It consists of two modules: a static data extractor made of a convolutional neural network to predict the obstacle position and distance and a dynamic data extractor that stacks the obstacle data from multiple frames and predicts the Time-to-Collision with a simple fully connected neural network. This paper focuses on the Time-to-Collision network\u2019s ability to adapt to new sceneries with different types of obstacles with supervised learning.<\/jats:p>","DOI":"10.3390\/jimaging7040061","type":"journal-article","created":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T14:51:12Z","timestamp":1616683872000},"page":"61","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Time- and Resource-Efficient Time-to-Collision Forecasting for Indoor Pedestrian Obstacles Avoidance"],"prefix":"10.3390","volume":"7","author":[{"given":"David","family":"Urban","sequence":"first","affiliation":[{"name":"CNRS, GIPSA-Lab, Institute of Engineering, University of Grenoble Alpes, 38000 Grenoble, France"},{"name":"IKOS RA, 69001 Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5937-4627","authenticated-orcid":false,"given":"Alice","family":"Caplier","sequence":"additional","affiliation":[{"name":"CNRS, GIPSA-Lab, Institute of Engineering, University of Grenoble Alpes, 38000 Grenoble, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fernandes, H., Costa, P., Filipe, V., Paredes, H., and Barroso, J. (2019). A review of assistive spatial orientation and navigation technologies for the visually impaired. Univ. Access Inf. Soc., 18.","DOI":"10.1007\/s10209-017-0570-8"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wong, F., Nagarajan, R., and Yaacob, S. (2003, January 15\u201318). Application of stereovision in a navigation aid for blind people. Proceedings of the Fourth International Conference on Information, Communications and Signal Processing, Singapore.","DOI":"10.1109\/ICICS.2003.1292553"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/TSMCC.2009.2021255","article-title":"Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey","volume":"40","author":"Dakopoulos","year":"2010","journal-title":"IEEE Trans. Syst. ManCybern. Part C"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Garnett, N., Silberstein, S., Oron, S., Fetaya, E., Verner, U., Ayash, A., Goldner, V., Cohen, R., Horn, K., and Levi, D. (2017, January 22\u201329). Real-Time Category-Based and General Obstacle Detection for Autonomous Driving. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.32"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Al-Kaff, A., Garc\u00eda, F., Mart\u00edn, D., De La Escalera, A., and Armingol, J.M. (2017). Obstacle Detection and Avoidance System Based on Monocular Camera and Size Expansion Algorithm for UAVs. Sensors, 17.","DOI":"10.3390\/s17051061"},{"key":"ref_6","first-page":"1029","article-title":"Vision-based vehicle forward collision warning system using optical flow algorithm","volume":"6","author":"Pan","year":"2015","journal-title":"J. Inf. Hiding Multimed. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1831","DOI":"10.1109\/TPAMI.2009.109","article-title":"Robust Multiperson Tracking from a Mobile Platform","volume":"31","author":"Ess","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wofk, D., Ma, F., Yang, T.-J., Karaman, S., and Sze, V. (2019, January 20\u201324). FastDepth: Fast Monocular Depth Estimation on Embedded Systems. Proceedings of the International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794182"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Gan, Y., Xu, X., Sun, W., and Lin, L. (2018, January 8\u201314). Monocular Depth Estimation with Affinity, Vertical Pooling, and Label Enhancement. Proceedings of the 15th European Conference, Part III, Munich, Germany.","DOI":"10.1007\/978-3-030-01219-9_14"},{"key":"ref_10","unstructured":"Phillips, D., Aragon, J., Roychowdhury, A., Madigan, R., Chintakindi, S., and Kochenderfer, M. (2019). Real-Time Prediction of Automotive Collision Risk from Monocular Video, arXiv preprint."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017). YOLO9000: Better, Faster, Stronger. IEEE Conf. Comput. Vis. Pattern Recognit. CVPR, 6517\u20136525.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_13","unstructured":"Haseeb, M.A., Guan, J., Risti\u0107-Durrant, D., and Gr\u00e4ser, A. (October, January Spain). DisNet: A Novel Method for Distance Estimation from Monocular Camera. In proceeding of 10th Planning, Perception and Navigation for Intelligent Vehicles (PPNIV\u201918), IROS, Madrid."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_15","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (July, January 26). The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA."},{"key":"ref_16","unstructured":"Aleny\u00e0, G., N\u00e8gre, A., and Crowley, J. (2009, January 23\u201325). Time to Contact for Obstacle Avoidance. In Proceeding of the 4th European Conference on Mobile Robots, ECMR\u201909, Mlini\/Dubrovnik, Croatia."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.aap.2018.02.028","article-title":"Time-to-collision analysis of pedestrian and pedal-cycle accidents for the development of autonomous emergency braking systems","volume":"115","author":"Lenard","year":"2018","journal-title":"Accid. Anal. Prev."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Camus, T., Coombs, D., Herman, M., and Hong, T.-H. (1996, January 25\u201329). Real-time single-workstation obstacle avoidance using only wide-field flow divergence. Proceedings of the 13th International Conference on Pattern Recognition, Vienna, Austria.","DOI":"10.1109\/ICPR.1996.546964"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Coombs, D., Herman, M., Hong, T., and Nashman, M. (1995, January 20\u201323). Real-time obstacle avoidance using central flow divergence and peripheral flow. Proceedings of the IEEE Transactions on Robotics and Automation, Massachusetts Institute of Technology, Cambridge, MA, USA.","DOI":"10.6028\/NIST.IR.5605"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1109\/34.42840","article-title":"Obstacle avoidance using flow field divergence","volume":"11","author":"Nelson","year":"1989","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Pundlik, S., Tomasi, M., and Luo, G. (2013, January 23\u201328). Collision Detection for Visually Impaired from a Body-Mounted Camera. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Portland, OR, USA.","DOI":"10.1109\/CVPRW.2013.11"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Byrne, J., and Taylor, C.J. (2009, January 12\u201317). Expansion Segmentation for Visual Collision Detection and Estimation. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152487"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pundlik, S., Peli, E., and Luo, G. (2011, January 26\u201328). Time to Collision and Collision Risk Estimation from Local Scale and Motion. Proceedings of the Advances in Visual Computing-7th International Symposium, ISVC 2011, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-642-24028-7_67"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mori, T., and Scherer, S. (2013, January 6\u201310). First results in detecting and avoiding frontal obstacles from a monocular camera for micro unmanned aerial vehicles. Proceedings of the IEEE 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630807"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Manglik, A., Weng, X., Ohn-Bar, E., and Kitanil, K.M. (2019, January 4\u20138). Forecasting Time-to-Collision from Monocular Video: Feasibility, Dataset, and Challenges. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967730"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft COCO: Common Objects in Context. Proceedings of the 13th European Conference on Computer Vision, (ECCV 2014), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Song, S., Lichtenberg, S.P., and Xiao, J. (2015, January 7\u201312). SUN RGB-D: A RGB-D scene understanding benchmark suite. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298655"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Carreira, J., and Zisserman, A. (2017, January 21\u201326). Quo Vadis, Action Recognition?. A New Model and the Kinetics Dataset. In Proceeding of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.502"},{"key":"ref_29","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/4\/61\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:41:10Z","timestamp":1760161270000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/4\/61"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,25]]},"references-count":29,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["jimaging7040061"],"URL":"https:\/\/doi.org\/10.3390\/jimaging7040061","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,25]]}}}