{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T05:47:10Z","timestamp":1775281630542,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2016,3,1]],"date-time":"2016-03-01T00:00:00Z","timestamp":1456790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents a monocular vision sensor-based obstacle detection algorithm for autonomous robots. Each individual image pixel at the bottom region of interest is labeled as belonging either to an obstacle or the floor. While conventional methods depend on point tracking for geometric cues for obstacle detection, the proposed algorithm uses the inverse perspective mapping (IPM) method. This method is much more advantageous when the camera is not high off the floor, which makes point tracking near the floor difficult. Markov random field-based obstacle segmentation is then performed using the IPM results and a floor appearance model. Next, the shortest distance between the robot and the obstacle is calculated. The algorithm is tested by applying it to 70 datasets, 20 of which include nonobstacle images where considerable changes in floor appearance occur. The obstacle segmentation accuracies and the distance estimation error are quantitatively analyzed. For obstacle datasets, the segmentation precision and the average distance estimation error of the proposed method are 81.4% and 1.6 cm, respectively, whereas those for a conventional method are 57.5% and 9.9 cm, respectively. For nonobstacle datasets, the proposed method gives 0.0% false positive rates, while the conventional method gives 17.6%.<\/jats:p>","DOI":"10.3390\/s16030311","type":"journal-article","created":{"date-parts":[[2016,3,1]],"date-time":"2016-03-01T11:07:19Z","timestamp":1456830439000},"page":"311","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["A Monocular Vision Sensor-Based Obstacle Detection Algorithm for Autonomous Robots"],"prefix":"10.3390","volume":"16","author":[{"given":"Tae-Jae","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Automation and Systems Research Institute (ASRI), Seoul National University, Seoul 151-742, Korea"}]},{"given":"Dong-Hoon","family":"Yi","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Automation and Systems Research Institute (ASRI), Seoul National University, Seoul 151-742, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8040-5803","authenticated-orcid":false,"given":"Dong-Il","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Automation and Systems Research Institute (ASRI), Seoul National University, Seoul 151-742, Korea"},{"name":"Inter-University Semiconductor Research Center (ISRC), Seoul National University, Seoul 151-742, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2016,3,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"11551","DOI":"10.3390\/s150511551","article-title":"Towards the Automatic Scanning of Indoors with Robots","volume":"15","author":"Quintana","year":"2015","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"15830","DOI":"10.3390\/s150715830","article-title":"Graph Structure-Based Simultaneous Localization and Mapping Using a Hybrid Method of 2D Laser Scan and Monocular Camera Image in Environments with Laser Scan Ambiguity","volume":"15","author":"Oh","year":"2015","journal-title":"Sensors"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3491","DOI":"10.3390\/s150203491","article-title":"3D Modeling of Building Indoor Spaces and Closed Doors from Imagery and Point Clouds","volume":"15","author":"Lucia","year":"2015","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"14661","DOI":"10.3390\/s150614661","article-title":"Radar Sensing for Intelligent Vehicles in Urban Environments","volume":"15","author":"Reina","year":"2015","journal-title":"Sensors"},{"key":"ref_5","unstructured":"iRobot Roomba. Available online: http:\/\/www.irobot.com\/For-the-Home\/Vacuum-Cleaning\/Roomba.aspx\/."},{"key":"ref_6","unstructured":"Neato Botvac. Available online: https:\/\/www.neatorobotics.com\/."},{"key":"ref_7","unstructured":"Dyson 360 Eye. Available online: https:\/\/www.dyson360eye.com\/."},{"key":"ref_8","unstructured":"Samsung POWERbot. Available online: http:\/\/www.samsung.com\/us\/appliances\/vacuums\/all-products\/."},{"key":"ref_9","unstructured":"LG Roboking. Available online: http:\/\/www.lg.com\/au\/roboking\/introducing-roboking\/."},{"key":"ref_10","unstructured":"DR Robot Sentinel. Available online: http:\/\/www.drrobot.com\/products.asp\/."},{"key":"ref_11","unstructured":"Lorigo, L.M., Brooks, R., and Grimsou, W.E.L. (1997, January 7\u201311). Visually-Guided Obstacle Avoidance in Unstructured Environments. Proceedings of the the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Grenoble, France."},{"key":"ref_12","unstructured":"Ulrich, I., and Nourbakhsh, I. (August, January 30). Appearance-Based Obstacle Detection with Monocular Color Vision. Proceedings of the Seventeenth National Conference on Artificial Intelligence, Austin, TX, USA."},{"key":"ref_13","unstructured":"Li, Y., and Birchfield, S.T. (2010, January 18\u201322). Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan."},{"key":"ref_14","unstructured":"Shen, Y., Du, X., and Liu, J. (2007). Advances in Neural Networks\u2014ISNN 2007, Springer Berlin Heidelberg."},{"key":"ref_15","first-page":"13","article-title":"Optical Flow Based Robot Obstacle Avoidance","volume":"4","author":"Souhila","year":"2007","journal-title":"Int. J. Adv. Rob. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lalonde, J., Laganiere, R., and Martel, L. (2012, January 16\u201321). Single-Siew Obstacle Detection for Smart Back-up Camera Systems. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238887"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Naito, T., Ito, T., and Kaneda, Y. (2007, January 13\u201315). The Obstacle Detection Method Using Optical Flow Estimation at the Edge Image. Proceedings of the Intelligent Vehicles Symposium, Istanbul, Turkey.","DOI":"10.1109\/IVS.2007.4290217"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhou, J., and Li, B. (2006, January 8\u201311). Robust Ground Plane Detection with Normalized Homography in Monocular Sequences from a Robot Platform. Proceedings of the IEEE International Conference on Image Processing, Atlanta, GA, USA.","DOI":"10.1109\/ICIP.2006.312972"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Conrad, D., and DeSouza, G.N. (2010, January 3\u20137). Homography-Based Ground Plane Detection for Mobile Robot Navigation Using a Modified EM Algorithm. Proceedings on IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509457"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1007\/s12555-009-0511-2","article-title":"Floor Segmentation by Computing Plane Normals from Image Motion Fields for Visual Navigation","volume":"7","author":"Cui","year":"2009","journal-title":"Int. J. Control Autom. Syst."},{"key":"ref_21","unstructured":"Lin, C.H., Jiang, S.Y., Pu, Y.J., and Song, K.T. (2010, January 18\u201322). Robust Ground Plane Detection for Obstacle Avoidance of Mobile Robots Using a Monocular Camera. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kumar, S., Dewan, A., and Krishna, K.M. (2012, January 16\u201319). A Bayes Filter Based Adaptive Floor Segmentation with Homography and Appearance Cues. Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing, Mumbai, India.","DOI":"10.1145\/2425333.2425387"},{"key":"ref_23","unstructured":"Kumar, S., Karthik, M.S., and Krishna, K.M. (June, January 31). Markov Random Field Based Small Obstacle Discovery over Images. Proceedings of the IEEE International Conference on Robotics and Automation, Hong Kong, China."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1109\/TPAMI.2004.1262177","article-title":"What Energy Functions Can be Minimized via Graph Cuts?","volume":"26","author":"Kolmogorov","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","unstructured":"Bouguet, J.Y. Pyramidal Implementation of the Affine Lucas Kanade Feature Tracker Description of the Algorithm. Available online:http:\/\/robots.stanford.edu\/cs223b04\/algo_tracking.pdf."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1938","DOI":"10.1016\/j.proeng.2012.01.240","article-title":"A Novel Traffic Stream Detection Method Based on Inverse Perspective Mapping","volume":"29","author":"Wang","year":"2012","journal-title":"Procedia Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Muad, A.M., Hussain, A., Samad, S.A., Mustaffa, M.M., and Majlis, B.Y. (2004, January 21\u201324). Implementation of Inverse Perspective Mapping Algorithm for the Development of an Automatic Lane Tracking System. Proceedings of the IEEE Region 10 International Conference, Chiang Mai, Thailand.","DOI":"10.1109\/TENCON.2004.1414393"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Niemann, H., Kasprzak, W., and Weierich, P. (1996, January 3\u201312). Integrated Motion and Geometry-Based Obstacle Detection in Image Sequences of Traffic Scenes. Proceedings of the 10th Annual Symposium on Aerospace\/Defense Sensing and Controls, Orlando, FL, USA.","DOI":"10.1117\/12.241037"},{"key":"ref_29","unstructured":"Jiang, G.Y., Choi, T.Y., Hong, S.K., Bae, J.W., and Song, B.S. (2000, January 8\u201311). Lane and Obstacle Detection Based on Fast Inverse Perspective Mapping Algorithm. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Nashville, TN, USA."},{"key":"ref_30","unstructured":"Ma, G., Park, S.B., Muller-Schneiders, S., Ioffe, A., and Kummert, A. (October, January 30). Vision-Based Pedestrian Detection-Reliable Pedestrian Candidate Detection by Combining IPM and a 1D Profile. Proceedings of the IEEE International Conference on Intelligent Transportation Systems, Seattle, WA, USA."},{"key":"ref_31","unstructured":"Wang, H., Yuan, K., Zou, W., and Peng, Y. (July, January 29). Real-time Region-Based Obstacle Detection with Monocular Vision. Proceedings of the IEEE International Conference on Robotics and Biomimetics, Shatin, China."},{"key":"ref_32","unstructured":"Fazl-Ersi, E., and Tsotsos, J.K. (2009). Image Analysis and Recognition, Springer Berlin Heidelberg."},{"key":"ref_33","unstructured":"Stein, G.P., Mano, O., and Shashua, A. (2003, January 9\u201311). Vision-Based ACC with a Single Camera: Bounds on Range and Range Rate Accuracy. Proceedings of the IEEE Intelligent vehicles symposium, Istanbul, Turkey."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"445","DOI":"10.4208\/nmtma.2009.m9007s","article-title":"Fast Texture Segmentation Based on Semi-Local Region Descriptor and Active Contour","volume":"2","author":"Houhou","year":"2009","journal-title":"Numer. Math. Theory Methods Appl."},{"key":"ref_35","unstructured":"Raykar, V.C., and Duraiswami, R. (2007). Large Scale Kernel Machines, MIT Press."},{"key":"ref_36","unstructured":"Kullback, S., and Leibler, R.A. (1951). The Annals of Mathematical Statistics, The Institue of Mathematical Statistics."},{"key":"ref_37","unstructured":"Boykov, Y.Y., and Jolly, M.P. (2001, January 7\u201314). Interactive graph cuts for optimal boundary & region segmentation of objects in ND images. Proceedings of the IEEE International Conference on Computer Vision, Vancouver, BC, Canada."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","unstructured":"Farneb\u00e4ck, G. (2003). Image Analysis, Springer Berlin Heidelberg."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC Superpixels Compared to State-of-the-Art Superpixel Methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/311\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:19:57Z","timestamp":1760210397000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/311"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,1]]},"references-count":40,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,3]]}},"alternative-id":["s16030311"],"URL":"https:\/\/doi.org\/10.3390\/s16030311","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,3,1]]}}}