{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T16:27:09Z","timestamp":1775838429602,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T00:00:00Z","timestamp":1684454400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51905320"],"award-info":[{"award-number":["51905320"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52102465"],"award-info":[{"award-number":["52102465"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["ZR2022MF230"],"award-info":[{"award-number":["ZR2022MF230"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2022003"],"award-info":[{"award-number":["2022003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["51905320"],"award-info":[{"award-number":["51905320"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["52102465"],"award-info":[{"award-number":["52102465"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["ZR2022MF230"],"award-info":[{"award-number":["ZR2022MF230"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100007129","name":"Natural Science Foundation of Shandong Province","doi-asserted-by":"publisher","award":["2022003"],"award-info":[{"award-number":["2022003"]}],"id":[{"id":"10.13039\/501100007129","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Experiment Technology Upgrading Project","award":["51905320"],"award-info":[{"award-number":["51905320"]}]},{"name":"Experiment Technology Upgrading Project","award":["52102465"],"award-info":[{"award-number":["52102465"]}]},{"name":"Experiment Technology Upgrading Project","award":["ZR2022MF230"],"award-info":[{"award-number":["ZR2022MF230"]}]},{"name":"Experiment Technology Upgrading Project","award":["2022003"],"award-info":[{"award-number":["2022003"]}]},{"name":"Shandong Provincial Programme of Introducing and Cultivating Talents of Discipline to Universities: Research and Innovation Team of Intelligent Connected Vehicle Technology","award":["51905320"],"award-info":[{"award-number":["51905320"]}]},{"name":"Shandong Provincial Programme of Introducing and Cultivating Talents of Discipline to Universities: Research and Innovation Team of Intelligent Connected Vehicle Technology","award":["52102465"],"award-info":[{"award-number":["52102465"]}]},{"name":"Shandong Provincial Programme of Introducing and Cultivating Talents of Discipline to Universities: Research and Innovation Team of Intelligent Connected Vehicle Technology","award":["ZR2022MF230"],"award-info":[{"award-number":["ZR2022MF230"]}]},{"name":"Shandong Provincial Programme of Introducing and Cultivating Talents of Discipline to Universities: Research and Innovation Team of Intelligent Connected Vehicle Technology","award":["2022003"],"award-info":[{"award-number":["2022003"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Road obstacle detection is an important component of intelligent assisted driving technology. Existing obstacle detection methods ignore the important direction of generalized obstacle detection. This paper proposes an obstacle detection method based on the fusion of roadside units and vehicle mounted cameras and illustrates the feasibility of a combined monocular camera inertial measurement unit (IMU) and roadside unit (RSU) detection method. A generalized obstacle detection method based on vision IMU is combined with a roadside unit obstacle detection method based on a background difference method to achieve generalized obstacle classification while reducing the spatial complexity of the detection area. In the generalized obstacle recognition stage, a VIDAR (Vision-IMU based identification and ranging) -based generalized obstacle recognition method is proposed. The problem of the low accuracy of obstacle information acquisition in the driving environment where generalized obstacles exist is solved. For generalized obstacles that cannot be detected by the roadside unit, VIDAR obstacle detection is performed on the target generalized obstacles through the vehicle terminal camera, and the detection result information is transmitted to the roadside device terminal through the UDP (User Data Protocol) protocol to achieve obstacle recognition and pseudo-obstacle removal, thereby reducing the error recognition rate of generalized obstacles. In this paper, pseudo-obstacles, obstacles with a certain height less than the maximum passing height of the vehicle, and obstacles with a height greater than the maximum passing height of the vehicle are defined as generalized obstacles. Pseudo-obstacles refer to non-height objects that appear to be \u201cpatches\u201d on the imaging interface obtained by visual sensors and obstacles with a height less than the maximum passing height of the vehicle. VIDAR is a vision-IMU-based detection and ranging method. IMU is used to obtain the distance and pose of the camera movement, and through the inverse perspective transformation, it can calculate the height of the object in the image. The VIDAR-based obstacle detection method, the roadside unit-based obstacle detection method, YOLOv5 (You Only Look Once version 5), and the method proposed in this paper were applied to outdoor comparison experiments. The results show that the accuracy of the method is improved by 2.3%, 17.4%, and 1.8%, respectively, compared with the other four methods. Compared with the roadside unit obstacle detection method, the speed of obstacle detection is improved by 1.1%. The experimental results show that the method can expand the detection range of road vehicles based on the vehicle obstacle detection method and can quickly and effectively eliminate false obstacle information on the road.<\/jats:p>","DOI":"10.3390\/s23104920","type":"journal-article","created":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T10:08:55Z","timestamp":1684490935000},"page":"4920","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Obstacle Detection Method Based on RSU and Vehicle Camera Fusion"],"prefix":"10.3390","volume":"23","author":[{"given":"Shaohong","family":"Ding","sequence":"first","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Yi","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"},{"name":"Collaborative Innovation Center of New Energy Automotive, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Qian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Jinan Engineering Polytechnic, Jinan 250200, China"}]},{"given":"Jinxin","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Teng","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Juan","family":"Ni","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Shuyue","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Xiangcun","family":"Kong","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Ruoyu","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Liming","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"}]},{"given":"Pengwei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Transportation and Vehicle Engineering, Shandong University of Technology, Zibo 255000, China"},{"name":"Collaborative Innovation Center of New Energy Automotive, Shandong University of Technology, Zibo 255000, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,19]]},"reference":[{"key":"ref_1","first-page":"475","article-title":"Vision-IMU Based Obstacle Detection Method","volume":"Volume 503","author":"Xu","year":"2019","journal-title":"Green Intelligent Transportation Systems GITSS 2017"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sabir, Z., Dafrallah, S., and Amine, A. (2019, January 11\u201312). A Novel Solution to Prevent Accidents using V2I in Moroccan Smart Cities. Proceedings of the International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), Dubai, United Arab Emirates.","DOI":"10.1109\/ICCIKE47802.2019.9004397"},{"key":"ref_3","first-page":"73","article-title":"Road obstacles positional and dynamic features extraction combining object detection, stereo disparity maps and optical flow data","volume":"31","author":"Rateke","year":"2020","journal-title":"Int. J. Comput. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"16318","DOI":"10.1109\/TITS.2022.3149789","article-title":"End-to-End Real-Time Obstacle Detection Network for Safe Self-Driving via Multi-Task Learning","volume":"23","author":"Song","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"110718","DOI":"10.1016\/j.measurement.2022.110718","article-title":"Real-time obstacle detection by stereo vision and ultrasonic data fusion","volume":"190","author":"Gholami","year":"2022","journal-title":"Measurement"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"65599","DOI":"10.1109\/ACCESS.2020.2982681","article-title":"Object Recognition Based Interpolation With 3D LIDAR and Vision for Autonomous Driving of an Intelligent Vehicle","volume":"8","author":"Weon","year":"2020","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1007\/s42452-020-2815-z","article-title":"Obstacle avoidance using stereo vision and depth maps for visual aid devices","volume":"2","author":"Bansal","year":"2020","journal-title":"SN Appl. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xu, C., and Hu, X. (2020, January 20\u201322). Real time detection algorithm of parking slot based on deep learning and fisheye image. Proceedings of the Journal of Physics: Conference Series, Sanya, China.","DOI":"10.1088\/1742-6596\/1518\/1\/012037"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3425295","DOI":"10.1155\/2022\/3425295","article-title":"Proposing Lane and Obstacle Detection Algorithm Using YOLO to Control Self-Driving Cars on Advanced Networks","volume":"2022","author":"Huu","year":"2022","journal-title":"Adv. Multimedia"},{"key":"ref_10","first-page":"2403","article-title":"Design and implementation of a radar and camera-based obstacle classifification system using machinelearning techniques","volume":"18","author":"Dhouioui","year":"2021","journal-title":"JRTIP"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Xue, J., Cheng, F., Li, Y., Song, Y., and Mao, T. (2022). Detection of Farmland Obstacles Based on an Improved YOLOv5s Algorithm by Using CIoU and Anchor Box Scale Clustering. Sensors, 22.","DOI":"10.3390\/s22051790"},{"key":"ref_12","first-page":"1357","article-title":"Moving object detection based on frame difference and W4","volume":"11","author":"Sengar","year":"2017","journal-title":"IJIGSP"},{"key":"ref_13","first-page":"5264347","article-title":"An Obstacle Detection and Distance Measurement Method for Sloped Roads Based on VIDAR","volume":"2022","author":"Jiang","year":"2022","journal-title":"J. Robot."},{"key":"ref_14","first-page":"3641930","article-title":"An Improved VM Obstacle Identification Method for Reflection Road","volume":"2022","author":"Jiang","year":"2022","journal-title":"J. Robot."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Steinbaeck, J., Druml, N., Herndl, T., Loigge, S., Marko, N., Postl, M., Kail, G., Hladik, R., Hechenberger, G., and Fuereder, H. (2019, January 15\u201317). ACTIVE\u2014Autonomous Car to Infrastructure Communication Mastering Adverse Environments. Proceedings of the Sensor Data Fusion: Trends, Solutions, Applications (SDF) Conference, Bonn, Germany.","DOI":"10.1109\/SDF.2019.8916631"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mouawad, N., Mannoni, V., Denis, B., and da Silva, A.P. (2021, January 25\u201328). Impact of LTE-V2X Connectivity on Global Occupancy Maps in a Cooperative Collision Avoidance (CoCA) System. Proceedings of the IEEE 93rd Vehicular Technology Conference (VTC2021-Spring), Helsinki, Finland.","DOI":"10.1109\/VTC2021-Spring51267.2021.9449034"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ghovanlooy Ghajar, F., Salimi Sratakhti, J., and Sikora, A. (2021). SBTMS: Scalable Blockchain Trust Management System for VANET. Appl. Sci., 11.","DOI":"10.3390\/app112411947"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1886","DOI":"10.3906\/elk-1908-94","article-title":"ReMAC: A novel hybrid and reservation-based MAC protocol for VANETs","volume":"28","year":"2020","journal-title":"Turk. J. Electr. Eng. Comput. Sci."},{"key":"ref_19","unstructured":"Ke, Q., and Kanade, T. (2003, January 18\u201320). Transforming camera geometry to a virtual downward-looking camera: Robust ego-motion estimation and ground-layer detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Madison, WI, USA."},{"key":"ref_20","unstructured":"Boyoon, J., and Sukhatme, G.S. (2004, January 10\u201313). Detecting Moving Objects Using a Single Camera on a Mobile Robot in an Outdoor Environment. Proceedings of the 8th Conference on Intelligent Autonomous Systems, Amsterdam, The Netherlands."},{"key":"ref_21","unstructured":"Wybo, S., Bendahan, R., Bougnoux, S., Vestri, C., Abad, F., and Kakinami, T. (2006, January 13\u201315). Movement Detection for Safer Backward Maneuvers. Proceedings of the IEEE Intelligent Vehicles Symposium, Meguro-Ku, Japan."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"298","DOI":"10.2219\/rtriqr.58.4_298","article-title":"Frontal Obstacle Detection Using Background Subtraction and Frame Registration","volume":"58","author":"Nakasone","year":"2017","journal-title":"Q. Rep. RTRI"},{"key":"ref_23","first-page":"1879","article-title":"Research on Mobile Robot Target Recognition and Obstacle Avoidance Based on Vision","volume":"19","author":"Zhang","year":"2018","journal-title":"J. Int. Technol."},{"key":"ref_24","first-page":"80","article-title":"Convolutional neural network based detection and judgement of environmental obstacle in vehicle operation","volume":"4","author":"Qi","year":"2019","journal-title":"CAAI TIT"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2216","DOI":"10.1049\/iet-ipr.2018.6433","article-title":"Adaptive road detection method combining lane line and obstacle boundary","volume":"14","author":"Li","year":"2020","journal-title":"IET Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/s11265-015-1006-4","article-title":"Real-time automatic obstacle detection method for traffic surveillance in urban traffic","volume":"82","author":"Lan","year":"2016","journal-title":"J. Signal Process. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2515114","DOI":"10.1109\/TIM.2021.3116315","article-title":"Rail Transit Obstacle Detection Based on Improved CNN","volume":"70","author":"He","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yuxi, F., Guotian, H., and Qizhou, W. (2016, January 20\u201329). A New Motion Obstacle Detection Based Monocular-Vision Algorithm. Proceedings of the International Conference on Computational Intelligence and Applications (ICCIA), Chongqing, China.","DOI":"10.1109\/ICCIA.2016.19"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bertozzi, M., Broggi, A., Medici, P., Porta, P.P., and Vitulli, R. (2005, January 6\u20138). Obstacle detection for start-inhibit and low speed driving. Proceedings of the Intelligent Vehicles Symposium, Las Vegas, NV, USA.","DOI":"10.1109\/IVS.2005.1505164"},{"key":"ref_30","first-page":"5","article-title":"Introduction to the k-means clustering algorithm based on the elbow method","volume":"1","author":"Cui","year":"2020","journal-title":"Account. Audit. Financ."},{"key":"ref_31","first-page":"1","article-title":"Integration k-means clustering method and elbow method for identification of the best customer profile cluster","volume":"Volume 336","author":"Syakur","year":"2018","journal-title":"Proceedings of the IOP Conference Series: Materials Science and Engineering, 2nd International Conference on Vocational Education and Electrical Engineering (ICVEE), Surabaya, Indonesia, 9 November 2017"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1016\/j.ins.2019.06.064","article-title":"Three-way confusion matrix for classification: A measure driven view","volume":"507","author":"Xu","year":"2020","journal-title":"Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1007\/s12517-017-2909-0","article-title":"Development of machine vision-based ore classifification model using support vector machine (SVM) algorithm","volume":"10","author":"Patel","year":"2017","journal-title":"Arab. J. Geosci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1364\/OE.20.000228","article-title":"Hybrid feature selection and SVM-based classification for mouse skin precancerous stages diagnosis from bimodal spectroscopy","volume":"20","author":"Abdat","year":"2012","journal-title":"Opt. Express."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/10\/4920\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:38:48Z","timestamp":1760125128000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/10\/4920"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,19]]},"references-count":34,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["s23104920"],"URL":"https:\/\/doi.org\/10.3390\/s23104920","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,19]]}}}