{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T07:25:46Z","timestamp":1775460346063,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,4,26]],"date-time":"2020-04-26T00:00:00Z","timestamp":1587859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003052","name":"Ministry of Trade, Industry and Energy","doi-asserted-by":"publisher","award":["Fault Detection and Diagnosis for ADAS-Sensors and Hazardous Analysis and Development of Fault Management Strategy, 10076338"],"award-info":[{"award-number":["Fault Detection and Diagnosis for ADAS-Sensors and Hazardous Analysis and Development of Fault Management Strategy, 10076338"]}],"id":[{"id":"10.13039\/501100003052","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Lane detection and tracking in a complex road environment is one of the most important research areas in highly automated driving systems. Studies on lane detection cover a variety of difficulties, such as shadowy situations, dimmed lane painting, and obstacles that prohibit lane feature detection. There are several hard cases in which lane candidate features are not easily extracted from image frames captured by a driving vehicle. We have carefully selected typical scenarios in which the extraction of lane candidate features can be easily corrupted by road vehicles and road markers that lead to degradations in the understanding of road scenes, resulting in difficult decision making. We have introduced two main contributions to the interpretation of road scenes in dense traffic environments. First, to obtain robust road scene understanding, we have designed a novel framework combining a lane tracker method integrated with a camera and a radar forward vehicle tracker system, which is especially useful in dense traffic situations. We have introduced an image template occupancy matching method with the integrated vehicle tracker that makes it possible to avoid extracting irrelevant lane features caused by forward target vehicles and road markers. Second, we present a robust multi-lane detection by a tracking algorithm that incudes adjacent lanes as well as ego lanes. We verify a comprehensive experimental evaluation with a real dataset comprised of problematic road scenarios. Experimental result shows that the proposed method is very reliable for multi-lane detection at the presented difficult situations.<\/jats:p>","DOI":"10.3390\/s20092457","type":"journal-article","created":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T10:30:58Z","timestamp":1588069858000},"page":"2457","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Reliable Road Scene Interpretation Based on ITOM with the Integrated Fusion of Vehicle and Lane Tracker in Dense Traffic Situation"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3366-8915","authenticated-orcid":false,"given":"Jinhan","family":"Jeong","sequence":"first","affiliation":[{"name":"Department of Automotive Engineering, Hanyang University, Seoul 04763, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yook Hyun","family":"Yoon","sequence":"additional","affiliation":[{"name":"Department of Automotive Engineering, Hanyang University, Seoul 04763, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4308-2910","authenticated-orcid":false,"given":"Jahng Hyon","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Automotive Engineering, Hanyang University, Seoul 04763, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,26]]},"reference":[{"key":"ref_1","unstructured":"(2019, October 16). Euro NCAP. Available online: https:\/\/www.euroncap.com\/en\/for-engineers\/protocols\/safety-assist\/."},{"key":"ref_2","unstructured":"SAE International (2018). Taxonomy and Definitions for Terms Related to Driving Automation Systems for on-Road Motor Vehicles, SAE International."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Louw, T., Merat, N., and Jamson, H. (2015, January 22\u201325). Engaging with highly automated driving: To be or not to be in the loop?. Proceedings of the Eighth International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, Salt Lake City, UT, USA.","DOI":"10.17077\/drivingassessment.1570"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhou, H., Zhang, H.D., Hasith, K., and Wang, H. (2019, January 3\u20135). Real-time Robust Multi-lane Detection and Tracking in Challenging Urban Scenarios. Proceedings of the 2019 IEEE 4th International Conference on Advanced Robotics and Mechatronics (ICARM), Osaka, Japan.","DOI":"10.1109\/ICARM.2019.8834317"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hur, J., Kang, S.N., and Seo, S.W. (2013, January 23\u201326). Multi-Lane Detection in Urban Driving Environments Using Conditional Random Fields. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, Australia.","DOI":"10.1109\/IVS.2013.6629645"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5749","DOI":"10.1109\/ACCESS.2017.2731804","article-title":"Robust Lane-Mark Extraction for Autonomous Driving under Complex Real Conditions","volume":"6","author":"Xuan","year":"2017","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kang, S.N., Lee, S., Hur, J., and Seo, S.W. (2014, January 8\u201311). Multi-Lane Detection Based on Accurate Geometric Lane Estimation in Highway Scenarios. Proceedings of the IEEE Intelligent Vehicles Symposium Proceedings, Dearborn, MI, USA.","DOI":"10.1109\/IVS.2014.6856537"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Deusch, H., J\u00fcrgen, W., Stephan, R., Magdalena, S., Marcus, K., and Klaus, D. (2012, January 16\u201319). A Random Finite Set Approach to Multiple Lane Detection. Proceedings of the 2012 15th International IEEE Conference on Intelligent Transportation Systems, Anchorage, AK, USA.","DOI":"10.1109\/ITSC.2012.6338772"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhao, K., Mirko, M., Christian, N., Dennis, M., Stefan, M.S., and Josef, P. (2012, January 3\u20137). A Novel Multi-Lane Detection and Tracking System. Proceedings of the IEEE Intelligent Vehicles Symposium, Alcala de Henares, Spain.","DOI":"10.1109\/IVS.2012.6232168"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Nieto, M., Salgado, L., Jaureguizar, F., and Arr\u00f3spide, J. (2008, January 12\u201315). Robust multiple lane road modeling based on perspective analysis. Proceedings of the 15th IEEE International Conference on Image Processing, San Diego, CA, USA.","DOI":"10.1109\/ICIP.2008.4712275"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vacek, S., Bergmann, S., Mohr, U., and Dillmann, R. (2006, January 3\u20136). Rule-based tracking of multiple lanes using particle filters. Proceedings of the 2006 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, Heidelberg, Germany.","DOI":"10.1109\/MFI.2006.265649"},{"key":"ref_12","unstructured":"Meuter, M., Stefan, M.S., Adalbert, M., Stephanie, H., Christian, N., and Anton, K. (, January 3\u20137). A Novel Approach to Lane Detection and Tracking. Proceedings of the 12th International IEEE Conference on Intelligent Transportation Systems, St. Louis, MO, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.1177\/0954407014567719","article-title":"Probabilistic Lane Detection and Lane Tracking for Autonomous Vehicles Using a Cascade Particle Filter","volume":"229","author":"Minchae","year":"2015","journal-title":"Proc. Inst. Mech. Eng. Part D J. Automob. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sehestedt, S.A., Sarath, K., Alen, A., and Gamini, D. (2007, January 19\u201321). Efficient Lane Detection and Tracking in Urban Environments. Proceedings of the European Conference on Mobile Robots: ECMR, Freiburg, Germany.","DOI":"10.1109\/IROS.2007.4399388"},{"key":"ref_15","unstructured":"Haloi, M., and Dinesh, B.J. (July, January 28). A robust lane detection and departure warning system. Proceedings of the IEEE Intelligent Vehicles Symposium (IV), Seoul, Korea."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/TITS.2007.908582","article-title":"Robust lane detection and tracking in challenging scenarios","volume":"9","author":"Kim","year":"2008","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3270","DOI":"10.3390\/s130303270","article-title":"Robust lane sensing and departure warning under shadows and occlusions","volume":"13","year":"2013","journal-title":"Sensors"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1007\/s11760-018-1264-2","article-title":"Real-time road surface and semantic lane estimation using deep features. Signal","volume":"12","author":"John","year":"2018","journal-title":"Image Video Process."},{"key":"ref_19","unstructured":"Southall, B., and Camillo, J.T. (2001, January 7\u201314). Stochastic Road Shape Estimation. Proceedings of the Eighth IEEE International Conference on Computer Vision (ICCV 2001), Vancouver, BC, Canada."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1109\/TITS.2009.2018328","article-title":"Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision","volume":"10","author":"Danescu","year":"2009","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1259","DOI":"10.1177\/0954407018768659","article-title":"Lane marking detection and classification with combined deep neural network for driver assistance","volume":"233","author":"Zhang","year":"2019","journal-title":"Proc. Inst. Mech. Eng. Part D J. Automob. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bakr, M.A., and Lee, S. (2017). Distributed multisensor data fusion under unknown correlation and data inconsistency. Sensors, 17.","DOI":"10.3390\/s17112472"},{"key":"ref_23","first-page":"525","article-title":"Multiple sensor fusion and classification for moving object detection and tracking","volume":"17","author":"Aycard","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Matzka, S., and Richard, A. (2009). A comparison of track-to-track fusion algorithms for automotive sensor fusion. Multisensor Fusion and Integration for Intelligent Systems, Springer.","DOI":"10.1109\/MFI.2008.4648063"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.inffus.2011.03.005","article-title":"Information fusion for automotive applications\u2013An overview","volume":"12","author":"Stiller","year":"2011","journal-title":"Inf. Fusion"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yu, Z., Bai, J., Chen, S., Huang, L., and Bi, X. (2018). Camera-Radar Data Fusion for Target Detection via Kalman Filter and Bayesian Estimation (No. 2018-01-1608). SAE Technical Paper, Proceedings of the Intelligent and Connected Vehicles Symposium, Kunshan City, China, 14\u201315 August 2018, SAE International.","DOI":"10.4271\/2018-01-1608"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/34.121789","article-title":"Recursive 3-d road and relative ego-state recognition","volume":"2","author":"Dickmanns","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","first-page":"1","article-title":"Real-time illumination and shadow invariant lane detection on mobile platform","volume":"16","author":"Urhan","year":"2017","journal-title":"J. Real Time Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1006\/cviu.1999.0832","article-title":"MLESAC: A new robust estimator with application to estimating image geometry","volume":"78","author":"Torr","year":"2000","journal-title":"Comput. Vis. Image Underst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/9\/2457\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:09:24Z","timestamp":1760364564000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/9\/2457"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,26]]},"references-count":29,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["s20092457"],"URL":"https:\/\/doi.org\/10.3390\/s20092457","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,26]]}}}