{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T05:47:46Z","timestamp":1775281666846,"version":"3.50.1"},"reference-count":136,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,8]],"date-time":"2022-08-08T00:00:00Z","timestamp":1659916800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Mobile robots lack a driver or a pilot and, thus, should be able to detect obstacles autonomously. This paper reviews various image-based obstacle detection techniques employed by unmanned vehicles such as Unmanned Surface Vehicles (USVs), Unmanned Aerial Vehicles (UAVs), and Micro Aerial Vehicles (MAVs). More than 110 papers from 23 high-impact computer science journals, which were published over the past 20 years, were reviewed. The techniques were divided into monocular and stereo. The former uses a single camera, while the latter makes use of images taken by two synchronised cameras. Monocular obstacle detection methods are discussed in appearance-based, motion-based, depth-based, and expansion-based categories. Monocular obstacle detection approaches have simple, fast, and straightforward computations. Thus, they are more suited for robots like MAVs and compact UAVs, which usually are small and have limited processing power. On the other hand, stereo-based methods use pair(s) of synchronised cameras to generate a real-time 3D map from the surrounding objects to locate the obstacles. Stereo-based approaches have been classified into Inverse Perspective Mapping (IPM)-based and disparity histogram-based methods. Whether aerial or terrestrial, disparity histogram-based methods suffer from common problems: computational complexity, sensitivity to illumination changes, and the need for accurate camera calibration, especially when implemented on small robots. In addition, until recently, both monocular and stereo methods relied on conventional image processing techniques and, thus, did not meet the requirements of real-time applications. Therefore, deep learning networks have been the centre of focus in recent years to develop fast and reliable obstacle detection solutions. However, we observed that despite significant progress, deep learning techniques also face difficulties in complex and unknown environments where objects of varying types and shapes are present. The review suggests that detecting narrow and small, moving obstacles and fast obstacle detection are the most challenging problem to focus on in future studies.<\/jats:p>","DOI":"10.3390\/rs14153824","type":"journal-article","created":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T04:16:55Z","timestamp":1660018615000},"page":"3824","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":75,"title":["Image-Based Obstacle Detection Methods for the Safe Navigation of Unmanned Vehicles: A Review"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8210-7482","authenticated-orcid":false,"given":"Samira","family":"Badrloo","sequence":"first","affiliation":[{"name":"GeoAI, Smarter Map and LiDAR Lab, Department of Surveying and Geoinformatics, Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Xipu Campus, Chengdu 611756, China"},{"name":"Department of Photogrammetry, K.N. Toosi University of Technology, Tehran 19697, Iran"}]},{"given":"Masood","family":"Varshosaz","sequence":"additional","affiliation":[{"name":"Department of Photogrammetry, K.N. Toosi University of Technology, Tehran 19697, Iran"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3177-037X","authenticated-orcid":false,"given":"Saied","family":"Pirasteh","sequence":"additional","affiliation":[{"name":"GeoAI, Smarter Map and LiDAR Lab, Department of Surveying and Geoinformatics, Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Xipu Campus, Chengdu 611756, China"},{"name":"Department of Geotechnics and Geomatics, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai 602105, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7899-0049","authenticated-orcid":false,"given":"Jonathan","family":"Li","sequence":"additional","affiliation":[{"name":"Geospatial Sensing and Data Intelligence Lab, Department of Geography and Environmental Management, University of Waterloo, Waterloo, ON N2L 3G1, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.isprsjprs.2014.02.013","article-title":"Unmanned aerial systems for photogrammetry and remote sensing: A review","volume":"92","author":"Colomina","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/s40996-017-0076-x","article-title":"Cartography for Civil Engineering Projects: Photogrammetry Supported by Unmanned Aerial Vehicles","volume":"42","author":"Reinoso","year":"2018","journal-title":"Iran. J. Sci. Technol. Trans. Civ. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Janou\u0161ek, J., Jambor, V., Marco\u0148, P., Dohnal, P., Synkov\u00e1, H., and Fiala, P. (2021). Using UAV-Based Photogrammetry to Obtain Correlation between the Vegetation Indices and Chemical Analysis of Agricultural Crops. Remote Sens., 13.","DOI":"10.3390\/rs13101878"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1002\/rob.21741","article-title":"High-speed autonomous obstacle avoidance with pushbroom stereo","volume":"35","author":"Barry","year":"2018","journal-title":"J. Field Robot."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s10846-020-01284-z","article-title":"Deep Learning-based Monocular Obstacle Avoidance for Unmanned Aerial Vehicle Navigation in Tree Plantations","volume":"101","author":"Lee","year":"2021","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.isprsjprs.2015.10.004","article-title":"Remote sensing platforms and sensors: A survey","volume":"115","author":"Toth","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Goodin, C., Carrillo, J., Monroe, J.G., Carruth, D.W., and Hudson, C.R. (2021). An Analytic Model for Negative Obstacle Detection with Lidar and Numerical Validation Using Physics-Based Simulation. Sensors, 21.","DOI":"10.3390\/s21093211"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1631\/FITEE.1900518","article-title":"A survey on multi-sensor fusion based obstacle detection for intelligent ground vehicles in off-road environments","volume":"21","author":"Hu","year":"2020","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"John, V., and Mita, S. (2021). Deep Feature-Level Sensor Fusion Using Skip Connections for Real-Time Object Detection in Autonomous Driving. Electronics, 10.","DOI":"10.3390\/electronics10040424"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.isprsjprs.2013.07.001","article-title":"Urban accessibility diagnosis from mobile laser scanning data","volume":"84","author":"Serna","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","first-page":"275","article-title":"INDOOR NAVIGATION FROM POINT CLOUDS: 3D MODELLING AND OBSTACLE DETECTION","volume":"41","author":"Boguslawski","year":"2016","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"819","DOI":"10.5194\/isprs-archives-XLII-2-W13-819-2019","article-title":"Construction of Obstacle Element Map Based on Indoor Scene Recognition","volume":"XLII-2\/W13","author":"Li","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.jpdc.2020.08.013","article-title":"Mad-c: Multi-stage approximate distributed cluster-combining for obstacle detection and localization","volume":"147","author":"Keramatian","year":"2021","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_14","first-page":"127","article-title":"Obstacle Detection System Involving Fusion of Multiple Sensor Technologies","volume":"42","author":"Balsi","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xie, G., Zhang, J., Tang, J., Zhao, H., Sun, N., and Hu, M. (2021). Obstacle detection based on depth fusion of lidar and radar in challenging conditions. Industrial Robot: The International Journal of Robotics Research and Application, Emerald Group Publishing Limited.","DOI":"10.1108\/IR-12-2020-0271"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Qin, R., Zhao, X., Zhu, W., Yang, Q., He, B., Li, G., and Yan, T. (2021). Multiple Receptive Field Network (MRF-Net) for Autonomous Underwater Vehicle Fishing Net Detection Using Forward-Looking Sonar Images. Sensors, 21.","DOI":"10.3390\/s21061933"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.13189\/ujes.2019.070101","article-title":"Remote and Autonomous Controlled Robotic Car based on Arduino with Real Time Obstacle Detection and Avoidance","volume":"7","year":"2019","journal-title":"Univers. J. Eng. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"9475","DOI":"10.1109\/JSEN.2021.3055515","article-title":"A Framework for the Generation of Obstacle Data for the Study of Obstacle Detection by Ultrasonic Sensors","volume":"21","author":"Singh","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1007\/s10846-017-0477-x","article-title":"Design and implementation of a multi sensor based brain computer interface for a robotic wheelchair","volume":"87","author":"Kucukyildiz","year":"2017","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Quaglia, G., Visconte, C., Scimmi, L.S., Melchiorre, M., Cavallone, P., and Pastorelli, S. (2020). Design of a UGV powered by solar energy for precision agriculture. Robotics, 9.","DOI":"10.3390\/robotics9010013"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s12145-019-00437-5","article-title":"A new algorithm for landslide geometric and deformation analysis supported by digital elevation models","volume":"13","author":"Pirasteh","year":"2020","journal-title":"Earth Sci. Inform."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"639","DOI":"10.14358\/PERS.20-00099","article-title":"Double Adaptive Intensity-Threshold Method for Uneven Lidar Data to Extract Road Markings","volume":"87","author":"Ye","year":"2021","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Li, H., Ye, W., Liu, J., Tan, W., Pirasteh, S., Fatholahi, S.N., and Li, J. (2021). High-Resolution Terrain Modeling Using Airborne LiDAR Data with Transfer Learning. Remote Sens., 13.","DOI":"10.3390\/rs13173448"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1080\/19475705.2021.1884608","article-title":"Optimizing Sector Ring Histogram of Oriented Gradients for human injured detection from drone images","volume":"12","author":"Ghasemi","year":"2021","journal-title":"Geomat. Nat. Hazards Risk"},{"key":"ref_25","first-page":"28","article-title":"Using geometric constraints to improve performance of image classifiers for automatic segmentation of traffic signs","volume":"75","author":"Yazdan","year":"2021","journal-title":"Geomatica"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"427","DOI":"10.17509\/ijost.v6i2.36275","article-title":"Embedded design and implementation of mobile robot for surveillance applications","volume":"6","author":"Nasser","year":"2021","journal-title":"Indones. J. Sci. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"021008","DOI":"10.1115\/1.4047816","article-title":"Assessing impact of understory vegetation density on solid obstacle detection for off-road autonomous ground vehicles","volume":"1","author":"Foroutan","year":"2021","journal-title":"ASME Lett. Dyn. Syst. Control."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"04022008","DOI":"10.1061\/(ASCE)CO.1943-7862.0002256","article-title":"Fast-PGMED: Fast and Dense Elevation Determination for Earthwork Using Drone and Deep Learning","volume":"148","author":"Han","year":"2022","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Tondin Ferreira Dias, E., Vieira Neto, H., and Schneider, F.K. (2020). A Compressed Sensing Approach for Multiple Obstacle Localisation Using Sonar Sensors in Air. Sensors, 20.","DOI":"10.3390\/s20195511"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3427","DOI":"10.1109\/TAES.2015.140252","article-title":"Vision-based sense-and-avoid framework for unmanned aerial vehicles","volume":"51","author":"Huh","year":"2015","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1108\/IJIUS-11-2017-0013","article-title":"UAV and obstacle sensing techniques\u2013a perspective","volume":"6","author":"Aswini","year":"2018","journal-title":"Int. J. Intell. Unmanned Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lee, T.-J., Yi, D.-H., and Cho, D.-I. (2016). A monocular vision sensor-based obstacle detection algorithm for autonomous robots. Sensors, 16.","DOI":"10.3390\/s16030311"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3067","DOI":"10.1109\/JSEN.2018.2890094","article-title":"A new velocity meter based on Hall effect sensors for UAV indoor navigation","volume":"19","author":"Zahran","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Mashaly, A.S., Wang, Y., and Liu, Q. (2016, January 10\u201315). Efficient sky segmentation approach for small UAV autonomous obstacles avoidance in cluttered environment. Proceedings of the Geoscience and Remote Sensing Symposium (IGARSS), 2016 IEEE International, Beijing, China.","DOI":"10.1109\/IGARSS.2016.7730752"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Al-Kaff, A., Garc\u00eda, F., Mart\u00edn, D., De La Escalera, A., and Armingol, J.M. (2017). Obstacle detection and avoidance system based on monocular camera and size expansion algorithm for UAVs. Sensors, 17.","DOI":"10.3390\/s17051061"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.optlaseng.2007.08.002","article-title":"A stereo vision-based obstacle detection system in vehicles","volume":"46","author":"Huh","year":"2008","journal-title":"Opt. Lasers Eng."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MCE.2019.2892280","article-title":"Obstacle Avoidance for Unmanned Aerial Vehicles: Using Visual Features in Unknown Environments","volume":"8","author":"Padhy","year":"2019","journal-title":"IEEE Consum. Electron. Mag."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1109\/LRA.2017.2658940","article-title":"Efficient Optical Flow and Stereo Vision for Velocity Estimation and Obstacle Avoidance on an Autonomous Pocket Drone","volume":"2","author":"McGuire","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_39","first-page":"EL_29_2_41","article-title":"Obstacle Detection of Intelligent Vehicle Based on Fusion of Lidar and Machine Vision","volume":"29","author":"Sun","year":"2021","journal-title":"Eng. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Risti\u0107-Durrant, D., Franke, M., and Michels, K. (2021). A Review of Vision-Based On-Board Obstacle Detection and Distance Estimation in Railways. Sensors, 21.","DOI":"10.3390\/s21103452"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Nobile, L., Randazzo, M., Colledanchise, M., Monorchio, L., Villa, W., Puja, F., and Natale, L. (2021). Active Exploration for Obstacle Detection on a Mobile Humanoid Robot. Actuators, 10.","DOI":"10.3390\/act10090205"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yu, X., and Marinov, M. (2020). A study on recent developments and issues with obstacle detection systems for automated vehicles. Sustainability, 12.","DOI":"10.3390\/su12083281"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yeong, D.J., Velasco-Hernandez, G., Barry, J., and Walsh, J. (2021). Sensor and sensor fusion technology in autonomous vehicles: A review. Sensors, 21.","DOI":"10.20944\/preprints202102.0459.v1"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Nieuwenhuisen, M., Droeschel, D., Schneider, J., Holz, D., Labe, T., and Behnke, S. (2013, January 25). Multimodal obstacle detection and collision avoidance for micro aerial vehicles. Proceedings of the Mobile Robots (ECMR), 2013 European Conference on Mobile Robots, Resid\u00e8ncia d\u2019Investigadors, Barcelona, Spain.","DOI":"10.1109\/ECMR.2013.6698812"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1002\/rob.21603","article-title":"Multilayered mapping and navigation for autonomous micro aerial vehicles","volume":"33","author":"Droeschel","year":"2016","journal-title":"J. Field Robot."},{"key":"ref_46","first-page":"66","article-title":"Autonomous Walking with Guiding Stick for the Blind Using Echolocation and Image Processing","volume":"7","author":"Agrawal","year":"2019","journal-title":"Methodology"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1007\/s10846-017-0529-2","article-title":"Obstacle detection system for small UAVs using ADS-B and thermal imaging","volume":"88","author":"Carrio","year":"2017","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Beul, M., Krombach, N., Nieuwenhuisen, M., Droeschel, D., and Behnke, S. (2017). Autonomous navigation in a warehouse with a cognitive micro aerial vehicle. Robot Operating System (ROS), Springer.","DOI":"10.1007\/978-3-319-54927-9_15"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"John, V., Nithilan, M., Mita, S., Tehrani, H., Sudheesh, R., and Lalu, P. (2019, January 18\u201322). So-net: Joint semantic segmentation and obstacle detection using deep fusion of monocular camera and radar. Proceedings of the Pacific-Rim Symposium on Image and Video Technology, Sydney, NSW, Australia.","DOI":"10.1007\/978-3-030-39770-8_11"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1002\/rob.21866","article-title":"Multi-Modal Obstacle Detection in Unstructured Environments with Conditional Random Fields","volume":"37","author":"Kragh","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5815\/ijigsp.2017.05.05","article-title":"Obstacle Detection Techniques in Outdoor Environment: Process, Study and Analysis","volume":"9","author":"Singh","year":"2017","journal-title":"Int. J. Image Graph. Signal Processing"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Qiu, Z., Zhao, N., Zhou, L., Wang, M., Yang, L., Fang, H., He, Y., and Liu, Y. (2020). Vision-based moving obstacle detection and tracking in paddy field using improved yolov3 and deep SORT. Sensors, 20.","DOI":"10.3390\/s20154082"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.imavis.2017.06.002","article-title":"Context-aware obstacle detection for navigation by visually impaired","volume":"64","author":"Gharani","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Hatch, K., Mern, J.M., and Kochenderfer, M.J. (2021, January 11\u201322). Obstacle Avoidance Using a Monocular Camera. Proceedings of the AIAA Scitech 2021 Forum, Virtual Event.","DOI":"10.2514\/6.2021-0269"},{"key":"ref_55","first-page":"122","article-title":"Monocular vision based obstacle detection","volume":"1","author":"Badrloo","year":"2017","journal-title":"Earth Obs. Geomat. Eng."},{"key":"ref_56","unstructured":"Ulrich, I., and Nourbakhsh, I. (2000, January 30). Appearance-based obstacle detection with monocular color vision. Proceedings of the AAAI\/IAAI, Austin, TX, USA."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1372","DOI":"10.1007\/s11036-021-01752-2","article-title":"Real-Time Monocular Obstacle Detection Based on Horizon Line and Saliency Estimation for Unmanned Surface Vehicles","volume":"26","author":"Liu","year":"2021","journal-title":"Mob. Netw. Appl."},{"key":"ref_58","first-page":"1021","article-title":"Obstacle Avoidance of Mobile Robot Based on HyperOmni Vision","volume":"31","author":"Chou","year":"2019","journal-title":"Sens. Mater."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Wang, S.-H., and Li, X.-X. (2020, January 20\u201323). A Real-Time Monocular Vision-Based Obstacle Detection. Proceedings of the 2020 6th International Conference on Control, Automation and Robotics (ICCAR), Singapore.","DOI":"10.1109\/ICCAR49639.2020.9108018"},{"key":"ref_60","unstructured":"Talele, A., Patil, A., and Barse, B. (2019). Detection of real time objects using TensorFlow and OpenCV. Asian J. Converg. Technol. (AJCT), 5."},{"key":"ref_61","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). {TensorFlow}: A System for {Large-Scale} Machine Learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), Savannah, GA, USA."},{"key":"ref_62","first-page":"120","article-title":"The openCV library","volume":"Volume 25","author":"Bradski","year":"2000","journal-title":"Dr. Dobb\u2019s Journal: Software Tools for the Professional Programmer"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Rane, M., Patil, A., and Barse, B. (2020). Real object detection using TensorFlow. ICCCE 2019, Springer.","DOI":"10.1007\/978-981-13-8715-9_5"},{"key":"ref_64","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"109241","DOI":"10.1016\/j.measurement.2021.109241","article-title":"Obstacle detection of rail transit based on deep learning","volume":"176","author":"He","year":"2021","journal-title":"Measurement"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"2505","DOI":"10.1109\/TTE.2021.3080690","article-title":"A Feature Fusion Method to Improve the Driving Obstacle Detection under Foggy Weather","volume":"7","author":"He","year":"2021","journal-title":"IEEE Trans. Transp. Electrif."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1002\/rob.21983","article-title":"Efficient obstacle detection based on prior estimation network and spatially constrained mixture model for unmanned surface vehicles","volume":"38","author":"Liu","year":"2021","journal-title":"J. Field Robot."},{"key":"ref_68","unstructured":"de Croon, G., and De Wagter, C. (2018). Learning what is above and what is below: Horizon approach to monocular obstacle detection. arXiv."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Zhao, F., Wang, G., Zhang, L., and Xu, B. (2016, January 13\u201316). Brain-Inspired Obstacle Detection Based on the Biological Visual Pathway. Proceedings of the International Conference on Brain and Health Informatics, Omaha, NE, USA.","DOI":"10.1007\/978-3-319-47103-7_35"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/s00371-014-0918-5","article-title":"Real-time obstacle detection with motion features using monocular vision","volume":"31","author":"Jia","year":"2015","journal-title":"Vis. Comput."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/j.imavis.2012.11.004","article-title":"Appearance-based navigation and homing for autonomous mobile robot","volume":"31","author":"Ohnishi","year":"2013","journal-title":"Image Vis. Comput."},{"key":"ref_72","first-page":"21","article-title":"Vision-Based Obstacle Detection for Mobile Robot in Outdoor Environment","volume":"34","author":"Tsai","year":"2018","journal-title":"J. Inf. Sci. Eng."},{"key":"ref_73","first-page":"5","article-title":"Support vector machines for classification and regression","volume":"14","author":"Gunn","year":"1998","journal-title":"ISIS Tech. Rep."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1038\/s42256-020-00279-7","article-title":"Enhancing optical-flow-based control by learning visual appearance cues for flying robots","volume":"3","author":"Seidl","year":"2021","journal-title":"Nat. Mach. Intell."},{"key":"ref_76","doi-asserted-by":"crossref","unstructured":"Urban, D., and Caplier, A. (2021). Time- and Resource-Efficient Time-to-Collision Forecasting for Indoor Pedestrian Obstacles Avoidance. J. Imaging, 7.","DOI":"10.3390\/jimaging7040061"},{"key":"ref_77","unstructured":"Nalpantidis, L., and Gasteratos, A. (2012). Stereo vision depth estimation methods for robotic applications. Depth Map and 3D Imaging Applications: Algorithms and Technologies, IGI Global."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"27137","DOI":"10.1364\/OE.402317","article-title":"Deep neural network for multi-depth hologram generation and its training strategy","volume":"28","author":"Lee","year":"2020","journal-title":"Opt. Express"},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"Almalioglu, Y., Saputra, M.R.U., De Gusmao, P.P., Markham, A., and Trigoni, N. (2019, January 9\u201310). GANVO: Unsupervised deep monocular visual odometry and depth estimation with generative adversarial networks. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Colombo, Sri Lanka.","DOI":"10.1109\/ICRA.2019.8793512"},{"key":"ref_80","unstructured":"Kim, D., Ga, W., Ahn, P., Joo, D., Chun, S., and Kim, J. (2022). Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepth. arXiv."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1002\/rob.21946","article-title":"Autonomous aerial robot using dual-fisheye cameras","volume":"37","author":"Gao","year":"2020","journal-title":"J. Field Robot."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1007\/s10846-019-01033-x","article-title":"Monocular Trail Detection and Tracking Aided by Visual SLAM for Small Unmanned Aerial Vehicles","volume":"97","author":"Silva","year":"2020","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.imavis.2017.07.003","article-title":"3D visual perception for self-driving cars using a multi-camera system: Calibration, mapping, localization, and obstacle detection","volume":"68","author":"Heng","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1002\/rob.21732","article-title":"Autonomous aerial navigation using monocular visual-inertial fusion","volume":"35","author":"Lin","year":"2018","journal-title":"J. Field Robot."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"1612","DOI":"10.1007\/s11431-020-1582-8","article-title":"Monocular depth estimation based on deep learning: An overview","volume":"63","author":"Zhao","year":"2020","journal-title":"Sci. China Technol. Sci."},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Kumar, V.R., Milz, S., Simon, M., Witt, C., Amende, K., Petzold, J., and Yogamani, S. (2018). Monocular Fisheye Camera Depth Estimation Using Semi-supervised Sparse Velodyne Data. arXiv.","DOI":"10.1109\/ITSC.2018.8569665"},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"1490","DOI":"10.1109\/LRA.2018.2800083","article-title":"J-MOD 2: Joint Monocular Obstacle Detection and Depth Estimation","volume":"3","author":"Mancini","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_88","unstructured":"Haseeb, M.A., Guan, J., Ristic-Durrant, D., and Gr\u00e4ser, A. (2018, January 1). DisNet: A novel method for distance estimation from monocular camera. Proceedings of the 10th Planning, Perception and Navigation for Intelligent Vehicles (PPNIV18), IROS, Madrid, Spain."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"M\u00e1ttyus, G., Luo, W., and Urtasun, R. (2017, January 22\u201329). Deeproadmapper: Extracting road topology from aerial images. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.372"},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Homayounfar, N., Ma, W.-C., Liang, J., Wu, X., Fan, J., and Urtasun, R. (2019, January 16\u201317). Dagmapper: Learning to map by discovering lane topology. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Long Beach, CA, USA.","DOI":"10.1109\/ICCV.2019.00300"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Maturana, D., Chou, P.-W., Uenoyama, M., and Scherer, S. (2018, January 25). Real-time semantic mapping for autonomous off-road navigation. Proceedings of the Field and Service Robotics, Toronto, ON, Canada.","DOI":"10.1007\/978-3-319-67361-5_22"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Sengupta, S., Sturgess, P., Ladick\u00fd, L.u., and Torr, P.H. (2012, January 7\u201312). Automatic dense visual semantic mapping from street-level imagery. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Algarve, Portugal.","DOI":"10.1109\/IROS.2012.6385958"},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.isprsjprs.2013.10.011","article-title":"Fusion of airborne laserscanning point clouds and images for supervised and unsupervised scene classification","volume":"87","author":"Gerke","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/J.ENG.2016.02.010","article-title":"Autonomous driving in the iCity\u2014HD maps as a key challenge of the automotive industry","volume":"2","author":"Seif","year":"2016","journal-title":"Engineering"},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Jiao, J. (2018, January 23\u201327). Machine learning assisted high-definition map creation. Proceedings of the 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC), Tokyo, Japan.","DOI":"10.1109\/COMPSAC.2018.00058"},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1109\/TITS.2020.3028033","article-title":"Robust lane extraction from MLS point clouds towards HD maps especially in curve road","volume":"23","author":"Ye","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.neucom.2020.12.089","article-title":"Deep learning for monocular depth estimation: A review","volume":"438","author":"Ming","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_98","doi-asserted-by":"crossref","unstructured":"Mori, T., and Scherer, S. (2013, January 6\u201310). First results in detecting and avoiding frontal obstacles from a monocular camera for micro unmanned aerial vehicles. Proceedings of the Robotics and Automation (Icra), 2013 IEEE International Conference on, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6630807"},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Aguilar, W.G., Casaliglla, V.P., and P\u00f3lit, J.L. (2017). Obstacle avoidance based-visual navigation for micro aerial vehicles. Electronics, 6.","DOI":"10.3390\/electronics6010010"},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1002\/rob.21744","article-title":"R-ADVANCE: Rapid Adaptive Prediction for Vision-based Autonomous Navigation, Control, and Evasion","volume":"35","author":"Johnson","year":"2018","journal-title":"J. Field Robot."},{"key":"ref_102","first-page":"102739","article-title":"A novel region-based expansion rate obstacle detection method for MAVs using a fisheye camera","volume":"108","author":"Badrloo","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_103","first-page":"493","article-title":"Stereo vision-based forward obstacle detection","volume":"8","author":"Jung","year":"2007","journal-title":"Int. J. Automot. Technol."},{"key":"ref_104","doi-asserted-by":"crossref","first-page":"2305","DOI":"10.22214\/ijraset.2022.41786","article-title":"Self-Driving Car","volume":"10","author":"Parmar","year":"2022","journal-title":"Int. J. Res. Appl. Sci. Eng. Technol. (IJRASET)."},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"1938","DOI":"10.1016\/j.proeng.2012.01.240","article-title":"A novel traffic stream detection method based on inverse perspective mapping","volume":"29","author":"Wang","year":"2012","journal-title":"Procedia Eng."},{"key":"ref_106","doi-asserted-by":"crossref","unstructured":"Muad, A.M., Hussain, A., Samad, S.A., Mustaffa, M.M., and Majlis, B.Y. (2004, January 21\u201324). Implementation of inverse perspective mapping algorithm for the development of an automatic lane tracking system. Proceedings of the 2004 IEEE Region 10 Conference TENCON, Chiang Mai, Thailand.","DOI":"10.1109\/TENCON.2004.1414393"},{"key":"ref_107","first-page":"1","article-title":"Robust Image-Based Water-Level Estimation Using Single-Camera Monitoring","volume":"71","author":"Kuo","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"3119","DOI":"10.1177\/09544070211005579","article-title":"Detection of parking slots occupation by temporal difference of inverse perspective mapping from vehicle-borne monocular camera","volume":"235","author":"Hu","year":"2021","journal-title":"Proc. Inst. Mech. Eng. Part D J. Automob. Eng."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"296598","DOI":"10.1155\/2010\/296598","article-title":"Construction of fisheye lens inverse perspective mapping model and its applications of obstacle detection","volume":"2010","author":"Lin","year":"2010","journal-title":"EURASIP J. Adv. Signal Processing"},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/83.650851","article-title":"GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection","volume":"7","author":"Bertozzi","year":"1998","journal-title":"IEEE Trans. Image Processing"},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.ifacol.2018.11.533","article-title":"An application of stereo camera with two different FoVs for SLAM and obstacle detection","volume":"51","author":"Kim","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_112","unstructured":"Wang, H., Yuan, K., Zou, W., and Peng, Y. (2005, January 5\u20139). Real-time region-based obstacle detection with monocular vision. Proceedings of the 2005 IEEE International Conference on Robotics and Biomimetics-ROBIO, Hong Kong, China."},{"key":"ref_113","doi-asserted-by":"crossref","unstructured":"Fazl-Ersi, E., and Tsotsos, J.K. (2009, January 6\u20138). Region classification for robust floor detection in indoor environments. Proceedings of the International Conference Image Analysis and Recognition, Halifax, NS, Canada.","DOI":"10.1007\/978-3-642-02611-9_71"},{"key":"ref_114","doi-asserted-by":"crossref","unstructured":"Cucchiara, R., Perini, E., and Pistoni, G. (2007, January 10\u201314). Efficient Stereo Vision for Obstacle Detection and AGV Navigation. Proceedings of the ICIAP, Modena, Italy.","DOI":"10.1109\/ICIAP.2007.4362794"},{"key":"ref_115","doi-asserted-by":"crossref","unstructured":"Tanveer, M.H., and Sgorbissa, A. (2018, January 29\u201331). An Inverse Perspective Mapping Approach using Monocular Camera of Pepper Humanoid Robot to Determine the Position of Other Moving Robot in Plane. Proceedings of the ICINCO (2), Porto, Portugal.","DOI":"10.5220\/0006930002290235"},{"key":"ref_116","doi-asserted-by":"crossref","unstructured":"Song, W., Xiong, G., Cao, L., and Jiang, Y. (2011). Depth calculation and object detection using stereo vision with subpixel disparity and hog feature. Advances in Information Technology and Education, Springer.","DOI":"10.1007\/978-3-642-22418-8_69"},{"key":"ref_117","doi-asserted-by":"crossref","first-page":"6295","DOI":"10.1016\/j.eswa.2015.04.035","article-title":"Rear obstacle detection system with fisheye stereo camera using HCT","volume":"42","author":"Kim","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/MRA.2016.2616541","article-title":"Farm Workers of the Future: Vision-Based Robotics for Broad-Acre Agriculture","volume":"24","author":"Ball","year":"2017","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_119","first-page":"72","article-title":"Design on FPGA of an obstacle detection module over stereo image for robotic learning","volume":"19","author":"Salhi","year":"2022","journal-title":"Indian J. Eng."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"27116","DOI":"10.3390\/s151027116","article-title":"An indoor obstacle detection system using depth information and region growth","volume":"15","author":"Huang","year":"2015","journal-title":"Sensors"},{"key":"ref_121","first-page":"786","article-title":"Obstacle tracking for unmanned surface vessels using 3-D point cloud","volume":"45","author":"Bovcon","year":"2019","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_122","doi-asserted-by":"crossref","unstructured":"Murmu, N., and Nandi, D. (2021). Lane and Obstacle Detection System Based on Single Camera-Based Stereo Vision System. Applications of Advanced Computing in Systems, Springer.","DOI":"10.1007\/978-981-33-4862-2_28"},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"3616","DOI":"10.1109\/JSEN.2022.3142024","article-title":"Region of Interest Constrained Negative Obstacle Detection and Tracking With a Stereo Camera","volume":"22","author":"Sun","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.robot.2017.11.014","article-title":"Unsupervised obstacle detection in driving environments using deep-learning-based stereovision","volume":"100","author":"Dairi","year":"2018","journal-title":"Robot. Auton. Syst."},{"key":"ref_125","first-page":"606","article-title":"Deep learning based object distance measurement method for binocular stereo vision blind area","volume":"9","author":"Zhang","year":"2018","journal-title":"Methods"},{"key":"ref_126","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Song, J., Ding, Y., Yuan, Y., and Wei, H.-L. (2021). FSD-BRIEF: A Distorted BRIEF Descriptor for Fisheye Image Based on Spherical Perspective Model. Sensors, 21.","DOI":"10.3390\/s21051839"},{"key":"ref_127","doi-asserted-by":"crossref","unstructured":"Choe, J., Joo, K., Rameau, F., and Kweon, I.S. (June, January 30). Stereo object matching network. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xian, China.","DOI":"10.1109\/ICRA48506.2021.9562027"},{"key":"ref_128","doi-asserted-by":"crossref","unstructured":"Luo, W., Schwing, A.G., and Urtasun, R. Efficient deep learning for stereo matching. Proceedings of the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 30 June 2016.","DOI":"10.1109\/CVPR.2016.614"},{"key":"ref_129","doi-asserted-by":"crossref","first-page":"5151","DOI":"10.1109\/JSEN.2018.2832291","article-title":"Lane detection and classification for forward collision warning system based on stereo vision","volume":"18","author":"Song","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_130","doi-asserted-by":"crossref","unstructured":"Haris, M., and Hou, J. (2020). Obstacle Detection and Safely Navigate the Autonomous Vehicle from Unexpected Obstacles on the Driving Lane. Sensors, 20.","DOI":"10.3390\/s20174719"},{"key":"ref_131","doi-asserted-by":"crossref","unstructured":"Mukherjee, A., Adarsh, S., and Ramachandran, K. (2021). ROS-Based Pedestrian Detection and Distance Estimation Algorithm Using Stereo Vision, Leddar and CNN. Intelligent System Design, Springer.","DOI":"10.1007\/978-981-15-5400-1_13"},{"key":"ref_132","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1109\/TRO.2017.2683530","article-title":"Obstacle avoidance strategy using onboard stereo vision on a flapping wing mav","volume":"33","author":"Tijmons","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_133","doi-asserted-by":"crossref","unstructured":"Lin, J., Zhu, H., and Alonso-Mora, J. (August, January 31). Robust vision-based obstacle avoidance for micro aerial vehicles in dynamic environments. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9197481"},{"key":"ref_134","doi-asserted-by":"crossref","unstructured":"Grinberg, M., and Ruf, B. (2021). UAV Use Case: Real-Time Obstacle Avoidance System for Unmanned Aerial Vehicles Based on Stereo Vision. Towards Ubiquitous Low-Power Image Processing Platforms, Springer.","DOI":"10.1007\/978-3-030-53532-2_8"},{"key":"ref_135","first-page":"376","article-title":"Passive vision road obstacle detection: A literature mapping","volume":"44","author":"Rateke","year":"2020","journal-title":"Int. J. Comput. Appl."},{"key":"ref_136","first-page":"023032","article-title":"Obstacle detection method of unmanned electric locomotive in coal mine based on YOLOv3-4L","volume":"31","author":"Wang","year":"2022","journal-title":"J. Electron. Imaging"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3824\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:05:49Z","timestamp":1760141149000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3824"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,8]]},"references-count":136,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14153824"],"URL":"https:\/\/doi.org\/10.3390\/rs14153824","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,8]]}}}