{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:43:54Z","timestamp":1760233434390,"version":"build-2065373602"},"reference-count":56,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,11]],"date-time":"2021-01-11T00:00:00Z","timestamp":1610323200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Detection of multiple lane markings on road surfaces is an important aspect of autonomous vehicles. Although a number of approaches have been proposed to detect lanes, detecting multiple lane markings, particularly across a large number of frames and under varying lighting conditions, in a consistent manner is still a challenging problem. In this paper, we propose a novel approach for detecting multiple lanes across a large number of frames and under various lighting conditions. Instead of resorting to the conventional approach of processing each frame to detect lanes, we treat the overall problem as a multitarget tracking problem across space and time using the integrated probabilistic data association filter (IPDAF) as our basis filter. We use the intensity of the pixels as an augmented feature to correctly group multiple lane markings using the Hough transform. By representing these extracted lane markings as splines, we then identify a set of control points, which becomes a set of targets to be tracked over a period of time, and thus across a large number of frames. We evaluate our approach on two different fronts, covering both model- and machine-learning-based approaches, using two different datasets, namely the Caltech and TuSimple lane detection datasets, respectively. When tested against model-based approach, the proposed approach can offer as much as 5%, 12%, and 3% improvements on the true positive, false positive, and false positives per frame rates compared to the best alternative approach, respectively. When compared against a state-of-the-art machine learning technique, particularly against a supervised learning method, the proposed approach offers 57%, 31%, 4%, and 9\u00d7 improvements on the false positive, false negative, accuracy, and frame rates. Furthemore, the proposed approach retains the explainability, or in other words, the cause of actions of the proposed approach can easily be understood or explained.<\/jats:p>","DOI":"10.3390\/s21020461","type":"journal-article","created":{"date-parts":[[2021,1,11]],"date-time":"2021-01-11T11:36:11Z","timestamp":1610364971000},"page":"461","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Multilane Tracking Algorithm Using IPDA with Intensity Feature"],"prefix":"10.3390","volume":"21","author":[{"given":"Behzad","family":"Akbari","sequence":"first","affiliation":[{"name":"ECE Department, McMaster University, Hamilton, ON L8S 4L8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2167-1343","authenticated-orcid":false,"given":"Jeyan","family":"Thiyagalingam","sequence":"additional","affiliation":[{"name":"Rutherford Appleton Laboratory, Scientific Computing Department, Science and Technology Facilities Council, Didcot OX11 0FA, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard","family":"Lee","sequence":"additional","affiliation":[{"name":"General Dynamics Land Systems\u2014Canada, London, ON L8S 4L8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kirubarajan","family":"Thia","sequence":"additional","affiliation":[{"name":"ECE Department, McMaster University, Hamilton, ON L8S 4L8, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1109\/TITS.2016.2600300","article-title":"Vehicles of the Future: A Survey of Research on Safety Issues","volume":"18","author":"Bila","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1699","DOI":"10.1109\/TCAD.2019.2925353","article-title":"Deterministic stellar bist for automotive ics","volume":"39","author":"Liu","year":"2020","journal-title":"IEEE Trans. Comput. Aided Des. Integr. Circuits Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/MITS.2011.942201","article-title":"Task-Based Environment Interpretation and System Architecture for Next Generation ADAS","volume":"3","author":"Kastner","year":"2011","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1109\/TITS.2009.2032769","article-title":"Collision Sensing by Stereo Vision and Radar Sensor Fusion","volume":"10","author":"Wu","year":"2009","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_5","first-page":"910","article-title":"Lane Departure Identification for Advanced Driver Assistance","volume":"16","author":"Gaikwad","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5151","DOI":"10.1109\/JSEN.2018.2832291","article-title":"Lane Detection and Classification for Forward Collision Warning System Based on Stereo Vision","volume":"18","author":"Song","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2373","DOI":"10.1109\/TITS.2015.2389527","article-title":"Coordinated Adaptive Cruise Control System with Lane-Change Assistance","volume":"16","author":"Dang","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/TIV.2015.2503342","article-title":"Lane Change and Merge Maneuvers for Connected and Automated Vehicles: A Survey","volume":"1","author":"Bevly","year":"2016","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/MIS.2003.1200722","article-title":"Vision in and out of vehicles","volume":"18","author":"Fletcher","year":"2003","journal-title":"IEEE Intell. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1049\/iet-its.2012.0154","article-title":"ITS-based cooperative services development framework for improving safety of vulnerable road users","volume":"7","author":"Sanchez","year":"2013","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1109\/TITS.2011.2173196","article-title":"A Novel Lane Detection System With Efficient Ground Truth Generation","volume":"13","author":"Borkar","year":"2012","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_12","unstructured":"Dai, X., Kummert, A., Park, S.B., and Neisius, D. (2009, January 3\u20135). A warning algorithm for Lane Departure Warning system. Proceedings of the 2009 IEEE Intelligent Vehicles Symposium, Xi\u2019an, China."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1109\/TITS.2011.2182649","article-title":"Integrating Appearance and Edge Features for Sedan Vehicle Detection in the Blind-Spot Area","volume":"13","author":"Lin","year":"2012","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/TITS.2007.908582","article-title":"Robust Lane Detection and Tracking in Challenging Scenarios","volume":"9","author":"Kim","year":"2008","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1109\/TVT.2013.2281199","article-title":"A Sensor-Fusion Drivable-Region and Lane-Detection System for Autonomous Vehicle Navigation in Challenging Road Scenarios","volume":"63","author":"Li","year":"2014","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"49679","DOI":"10.1109\/ACCESS.2018.2868976","article-title":"Robust Lane Detection for Complicated Road Environment Based on Normal Map","volume":"6","author":"Yuan","year":"2018","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4043","DOI":"10.1109\/TITS.2018.2791572","article-title":"Robust Lane Detection and Tracking for Real-Time Applications","volume":"19","author":"Lee","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Aly, M. (2008, January 4\u20136). Real time detection of lane markers in urban streets. Proceedings of the 2008 IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands.","DOI":"10.1109\/IVS.2008.4621152"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1109\/TITS.2009.2018328","article-title":"Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereo-vision","volume":"10","author":"Danescu","year":"2009","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1109\/TITS.2012.2184756","article-title":"A Learning Approach Towards Detection and Tracking of Lane Markings","volume":"13","author":"Gopalan","year":"2012","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.patcog.2015.12.010","article-title":"Robust Lane Detection using Two-stage Feature Extraction with Curve Fitting","volume":"59","author":"Niu","year":"2016","journal-title":"Pattern Recognit."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/83.650851","article-title":"GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection","volume":"7","author":"Bertozzi","year":"1998","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kuk, J.G., An, J.H., Ki, H., and Cho, N.I. (2010, January 19\u201322). Fast lane detection tracking based on Hough transform with reduced memory requirement. Proceedings of the 13th International IEEE Conference on Intelligent Transportation Systems, Funchal, Portugal.","DOI":"10.1109\/ITSC.2010.5625121"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1109\/TSMC.2016.2616490","article-title":"Fast and Accurate Vanishing Point Detection and Its Application in Inverse Perspective Mapping of Structured Road","volume":"48","author":"Yang","year":"2018","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Reichenbach, M., Liebischer, L., Vaas, S., and Fey, D. (2018, January 10\u201312). Comparison of Lane Detection Algorithms for ADAS Using Embedded Hardware Architectures. Proceedings of the 2018 Conference on Design and Architectures for Signal and Image Processing (DASIP), Porto, Portugal.","DOI":"10.1109\/DASIP.2018.8596994"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lee, Y., and Kim, H. (2016, January 5\u20137). Real-time lane detection and departure warning system on embedded platform. Proceedings of the 2016 IEEE 6th International Conference on Consumer Electronics, Berlin, Germany.","DOI":"10.1109\/ICCE-Berlin.2016.7684702"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Nieto, M., Salgado, L., Jaureguizar, F., and Cabrera, J. (2007, January 13\u201315). Stabilization of Inverse Perspective Mapping Images based on Robust Vanishing Point Estimation. Proceedings of the IEEE Intelligent Vehicles Symposium, Istanbul, Turkey.","DOI":"10.1109\/IVS.2007.4290133"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Su, H. (2018, January 8\u20139). Vanishing points in road recognition: A review. Proceedings of the 2018 11th International Symposium on Computational Intelligence and Design (ISCID), Hangzhou, China.","DOI":"10.1109\/ISCID.2018.10131"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3254","DOI":"10.1109\/TITS.2017.2679222","article-title":"A Robust Lane Detection Method Based on Vanishing Point Estimation Using the Relevance of Line Segments","volume":"18","author":"Yoo","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2211","DOI":"10.1109\/TIP.2010.2045715","article-title":"General Road Detection From a Single Image","volume":"19","author":"Kong","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.imavis.2003.10.003","article-title":"Lane detection and tracking using B-Snake","volume":"22","author":"Wang","year":"2004","journal-title":"Image Vis. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1109\/TITS.2018.2856361","article-title":"A Novel Strategy for Road Lane Detection and Tracking Based on a Vehicle\u2019s Forward Monocular Camera","volume":"20","author":"Andrade","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst. (Early Access)"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"5180","DOI":"10.1109\/TSMC.2018.2867807","article-title":"Robust Tube-Based Model Predictive Control for Lane Change Maneuver of Tractor-Trailer Vehicles Based on a Polynomial Trajectory","volume":"50","author":"Yue","year":"2018","journal-title":"IEEE Trans. Syst. Man Cybern. Syst. (Early Access)"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"10293","DOI":"10.1109\/TVT.2018.2867541","article-title":"Personalized Lane-Change Assistance System With Driver Behavior Identification","volume":"67","author":"Zhu","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_35","unstructured":"Coulombeau, P., and Laurgeau, C. (2002, January 17\u201321). Vehicle yaw, pitch, roll and 3D lane shape recovery by vision. Proceedings of the IEEE Intelligent Vehicle Symposium, Versailles, France."},{"key":"ref_36","unstructured":"Feihu, Z., Hauke, S., Chao, C., Christian, B., and Alois, K. (2013, January 23\u201326). A lane marking extraction approach based on Random Finite Set Statistics. Proceedings of the Intelligent Vehicles Symposium (IV), Gold Coast, Australia."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ma, Y., Havyarimana, V., Bai, J., and Xiao, Z. (2018, January 26\u201328). Vision-Based Lane Detection and Lane-Marking Model Inference: A Three-Step Deep Learning Approach. Proceedings of the 2018 9th International Symposium on Parallel Architectures, Algorithms and Programming (PAAP), Taipei, Taiwan.","DOI":"10.1109\/PAAP.2018.00039"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Pan, X., Shi, J., Luo, P., Wang, X., and Tang, X. (2017). Spatial As Deep: Spatial CNN for Traffic Scene Understanding. arXiv.","DOI":"10.1609\/aaai.v32i1.12301"},{"key":"ref_39","unstructured":"Wang, Z., Ren, W., and Qiu, Q. (2018). LaneNet: Real-Time Lane Detection Networks for Autonomous Driving. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Feng, J., Wu, X., and Zhang, Y. (2018, January 8\u20139). Lane detection base on deep learning. Proceedings of the 2018 11th International Symposium on Computational Intelligence and Design (ISCID), Hangzhou, China.","DOI":"10.1109\/ISCID.2018.00078"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yang, Z. (2019, January 16\u201318). Research on lane recognition algorithm based on deep learning. Proceedings of the 2019 International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM), Dublin, Ireland.","DOI":"10.1109\/AIAM48774.2019.00082"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Brust, C., Sickert, S., Simon, M., Rodner, E., and Denzler, J. (2015, January 11\u201314). Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding. Proceedings of the 10th International Conference on Computer Vision Theory and Applications\u2014Volume 3: VISAPP, (VISIGRAPP 2015), Berlin, Germany.","DOI":"10.5220\/0005355105100517"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.neunet.2017.07.017","article-title":"A patch-based convolutional neural network for remote sensing image classification","volume":"95","author":"Sharma","year":"2017","journal-title":"Neural Netw."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/0031-3203(91)90073-E","article-title":"A probabilistic Hough transform","volume":"24","author":"Kiryati","year":"1991","journal-title":"Pattern Recognit."},{"key":"ref_46","unstructured":"Bar-Shalom, Y., Li, X.R., and Kirubarajan, T. (2001). Estimation, Tracking and Navigation: Theory, Algorithms and Software, John Wiley and Sons. [1st ed.]."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MCS.2009.934469","article-title":"The probabilistic data association filter","volume":"29","author":"Daum","year":"2009","journal-title":"IEEE Control Syst."},{"key":"ref_48","unstructured":"Gonzalez, R.C., and Woods, R.E. (2017). Digital Image Processing, Addison-Wesley Longman Publishing Co., Inc.. [4th ed.]."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1145\/361237.361242","article-title":"Use of the Hough Transformation to Detect Lines and Curves in Pictures","volume":"15","author":"Duda","year":"1972","journal-title":"Commun. ACM"},{"key":"ref_50","unstructured":"Galamhos, C., Matas, J., and Kittler, J. (1999, January 23\u201325). Progressive probabilistic Hough transform for line detection. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u201999, Fort Collins, CO, USA."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.1109\/9.293185","article-title":"Integrated probabilistic data association","volume":"39","author":"Musicki","year":"1994","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Huang, Y., Chong, S.Y., Song, T.L., and Lee, J.H. (2018, January 24\u201327). Multi-path data association for over-the-horizon radar using linear multitarget integrated probabilistic data association. Proceedings of the 2018 International Conference on Control, Automation and Information Sciences (ICCAIS), Hangzhou, China.","DOI":"10.1109\/ICCAIS.2018.8570333"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Lerro, D., and Bar-Shalom, Y. (1990, January 23\u201325). Automated Tracking with Target Amplitude Information. Proceedings of the 1990 American Control Conference, San Diego, CA, USA.","DOI":"10.23919\/ACC.1990.4791244"},{"key":"ref_54","first-page":"258","article-title":"Comparison of Single-point and Two-point Difference Track Initiation Algorithms Using Position Measurements","volume":"34","author":"Mallick","year":"2008","journal-title":"Acta Autom. Sin."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Hur, J., Kang, S.N., and Seo, S.W. (2013, January 23\u201326). Multi-lane detection in urban driving environments using conditional random fields. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, Australia.","DOI":"10.1109\/IVS.2013.6629645"},{"key":"ref_56","unstructured":"(2019, July 17). Tusimple Benchmark. Available online: http:\/\/benchmark.tusimple.ai."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/2\/461\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:09:40Z","timestamp":1760159380000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/2\/461"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,11]]},"references-count":56,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21020461"],"URL":"https:\/\/doi.org\/10.3390\/s21020461","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,1,11]]}}}