{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T03:46:25Z","timestamp":1772768785317,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,1,11]],"date-time":"2019-01-11T00:00:00Z","timestamp":1547164800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2015R1D1A1A01056761"],"award-info":[{"award-number":["NRF-2015R1D1A1A01056761"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Detection and classification of road markings are a prerequisite for operating autonomous vehicles. Although most studies have focused on the detection of road lane markings, the detection and classification of other road markings, such as arrows and bike markings, have not received much attention. Therefore, we propose a detection and classification method for various types of arrow markings and bike markings on the road in various complex environments using a one-stage deep convolutional neural network (CNN), called RetinaNet. We tested the proposed method in complex road scenarios with three open datasets captured by visible light camera sensors, namely the Malaga urban dataset, the Cambridge dataset, and the Daimler dataset on both a desktop computer and an NVIDIA Jetson TX2 embedded system. Experimental results obtained using the three open databases showed that the proposed RetinaNet-based method outperformed other methods for detection and classification of road markings in terms of both accuracy and processing time.<\/jats:p>","DOI":"10.3390\/s19020281","type":"journal-article","created":{"date-parts":[[2019,1,11]],"date-time":"2019-01-11T11:36:42Z","timestamp":1547206602000},"page":"281","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["Deep RetinaNet-Based Detection and Classification of Road Markings by Visible Light Camera Sensors"],"prefix":"10.3390","volume":"19","author":[{"given":"Toan","family":"Hoang","sequence":"first","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Phong","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Noi","family":"Truong","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Young","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]},{"given":"Kang","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Electronics and Electrical Engineering, Dongguk University, 30 Pildong-ro 1-gil, Jung-gu, Seoul 100-715, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,11]]},"reference":[{"key":"ref_1","unstructured":"(2018, September 28). Self-Driving Cars Will Change Your Life More Than You Can Ever Imagine. Available online: https:\/\/money.cnn.com\/technology\/our-driverless-future\/self-driving-cars-will-change-your-life\/."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Benligiray, B., Topal, C., and Akinlar, C. (2012, January 10\u201312). Video-Based Lane Detection Using a Fast Vanishing Point Estimation Method. Proceedings of the IEEE International Symposium on Multimedia, Irvine, CA, USA.","DOI":"10.1109\/ISM.2012.70"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Hoang, T.M., Baek, N.R., Cho, S.W., Kim, K.W., and Park, K.R. (2017). Road Lane Detection Robust to Shadows Based on a Fuzzy System Using a Visible Light Camera Sensor. Sensors, 17.","DOI":"10.3390\/s17112475"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Suchitra, S., Satzoda, R.K., and Srikanthan, T. (2012, January 3\u20137). Detection & Classification of Arrow Markings on Roads Using Signed Edge Signatures. Proceedings of the IEEE Intelligent Vehicles Symposium, Alcala de Henares, Spain.","DOI":"10.1109\/IVS.2012.6232302"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Foucher, P., Sebsadji, Y., Tarel, J.-P., Charbonnier, P., and Nicolle, P. (2011, January 5\u20137). Detection and Recognition of Urban Road Markings Using Images. Proceedings of the 14th IEEE International Conference on Intelligent Transportation Systems, Washington, DC, USA.","DOI":"10.1109\/ITSC.2011.6082840"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Li, Z., Cai, Z.-X., Xie, J., and Ren, X.-P. (2012, January 29\u201331). Road Markings Extraction Based on Threshold Segmentation. Proceedings of the 9th International Conference on Fuzzy Systems and Knowledge Discovery, Sichuan, China.","DOI":"10.1109\/FSKD.2012.6234167"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1109\/TITS.2013.2252427","article-title":"Gradient-Enhancing Conversion for Illumination-Robust Lane Detection","volume":"14","author":"Yoo","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_8","unstructured":"Sun, T.-Y., Tsai, S.-J., and Chan, V. (2006, January 17\u201320). HSI Color Model Based Lane-Marking Detection. Proceedings of the IEEE Intelligent Transportation Systems Conference, Toronto, ON, Canada."},{"key":"ref_9","unstructured":"Gurghian, A., Koduri, T., Bailur, S.V., Carey, K.J., and Murali, V.N. (July, January 26). DeepLanes: End-To-End Lane Position Estimation Using Deep Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1109\/TNNLS.2016.2522428","article-title":"Deep Neural Network for Structural Prediction and Lane Detection in Traffic Scene","volume":"28","author":"Li","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vokhidov, H., Hong, H.G., Kang, J.K., Hoang, T.M., and Park, K.R. (2016). Recognition of Damaged Arrow-Road Markings by Visible Light Camera Sensor Based on Convolutional Neural Network. Sensors, 16.","DOI":"10.3390\/s16122160"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lee, S., Kim, J., Yoon, J.S., Shin, S., Bailo, O., Kim, N., Lee, T.-H., Hong, H.S., Han, S.-H., and Kweon, I.S. (2017, January 22\u201329). VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.215"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal Loss for Dense Object Detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_14","unstructured":"(2018, October 01). The M\u00e1laga Stereo and Laser Urban Data Set\u2014MRPT. Available online: https:\/\/www.mrpt.org\/MalagaUrbanDataset."},{"key":"ref_15","unstructured":"(2018, October 01). Daimler Urban Segmentation Dataset. Available online: http:\/\/www.6d-vision.com\/scene-labeling."},{"key":"ref_16","unstructured":"(2018, October 01). Cambridge-Driving Labeled Video Database (CamVid). Available online: http:\/\/mi.eng.cam.ac.uk\/research\/projects\/VideoRec\/CamVid\/."},{"key":"ref_17","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_18","unstructured":"(2018, October 02). ImageNet Large Scale Visual Recognition Challenge (ILSVRC). Available online: http:\/\/www.image-net.org\/challenges\/LSVRC\/."},{"key":"ref_19","unstructured":"Chen, T., Chen, Z., Shi, Q., and Huang, X. (July, January 28). Road Marking Detection and Classification Using Machine Learning Algorithms. Proceedings of the IEEE Intelligent Vehicles Symposium, Seoul, Korea."},{"key":"ref_20","unstructured":"He, B., Ai, R., Yan, Y., and Lang, X. (2016, January 19\u201322). Accurate and Robust Lane Detection Based on Dual-View Convolutional Neutral Network. Proceedings of the IEEE Intelligent Vehicles Symposium, Gothenburg, Sweden."},{"key":"ref_21","unstructured":"Huval, B., Wang, T., Tandon, S., Kiske, J., Song, W., Pazhayampallil, J., Andriluka, M., Rajpurkar, P., Migimatsu, T., and Cheng-Yue, R. (ArXiv, 2015). An Empirical Evaluation of Deep Learning on Highway Driving, ArXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Al-Qizwini, M., Barjasteh, I., Al-Qassab, H., and Radha, H. (2017, January 11\u201314). Deep Learning Algorithm for Autonomous Driving Using GoogLeNet. Proceedings of the IEEE Intelligent Vehicles Symposium, Redondo Beach, CA, USA.","DOI":"10.1109\/IVS.2017.7995703"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bailo, O., Lee, S., Rameau, F., Yoon, J.S., and Kweon, I.S. (2017, January 24\u201331). Robust Road Marking Detection and Recognition Using Density-Based Grouping and Machine Learning Techniques. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.90"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_27","unstructured":"Redmon, J., and Farhadi, A. (ArXiv, 2018). YOLOv3: An Incremental Improvement, ArXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (ArXiv, 2016). SSD: Single Shot MultiBox Detector, ArXiv.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_29","unstructured":"Chira, I.M., Chibulcutean, A., and Danescu, R.G. (December, January 30). Real-Time Detection of Road Markings for Driving Assistance Applications. Proceedings of the International Conference on Computer Engineering & Systems, Cairo, Egypt."},{"key":"ref_30","unstructured":"(2018, October 01). Jetson TX2 Module. Available online: https:\/\/www.nvidia.com\/en-us\/autonomous-machines\/embedded-systems-dev-kits-modules\/."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Soviany, P., and Ionescu, R.T. (ArXiv, 2018). Optimizing the Trade-off Between Single-Stage and Two-Stage Object Detectors Using Image Difficulty Prediction, ArXiv.","DOI":"10.1109\/SYNASC.2018.00041"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_34","unstructured":"(2018, October 01). NVIDIA GeForce\u00ae GTX 1070. Available online: https:\/\/www.nvidia.com\/en-us\/geforce\/products\/10series\/geforce-gtx-1070\/."},{"key":"ref_35","unstructured":"(2018, October 01). Keras: The Python Deep Learning Library. Available online: https:\/\/keras.io\/."},{"key":"ref_36","unstructured":"(2018, October 01). F1 Score. Available online: https:\/\/en.wikipedia.org\/wiki\/F1_score."},{"key":"ref_37","unstructured":"Henon, Y. (2018, October 15). Keras-Faster R-CNN. Available online: https:\/\/github.com\/yhenon\/keras-frcnn."},{"key":"ref_38","unstructured":"(2018, October 15). Darknet: Open Source Neural Networks in C. Available online: https:\/\/pjreddie.com\/darknet\/."},{"key":"ref_39","unstructured":"(2018, October 24). Understanding Convolutional Layers in Convolutional Neural Networks (CNNs). Available online: http:\/\/machinelearninguru.com\/computer_vision\/basics\/convolution\/convolution_layer.html."},{"key":"ref_40","unstructured":"(2018, October 24). CS231n Convolutional Neural Networks for Visual Recognition. Available online: http:\/\/cs231n.github.io\/convolutional-networks\/#conv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Muad, A.M., Hussain, A., Samad, S.A., Mustaffa, M.M., and Majlis, B.Y. (2004, January 24). Implementation of Inverse Perspective Mapping Algorithm for the Development of an Automatic Lane Tracking System. Proceedings of the IEEE Region 10 Conference TENCON, Chiang Mai, Thailand.","DOI":"10.1109\/TENCON.2004.1414393"},{"key":"ref_42","unstructured":"(2018, October 24). Dongguk RetinaNet for Detecting Road Marking Objects with Algorithms and Annotated Files for Open Databases. Available online: http:\/\/dm.dgu.edu\/link.html."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_44","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_45","unstructured":"(2018, November 14). Smooth L1 Loss. Available online: https:\/\/stats.stackexchange.com\/questions\/351874\/how-to-interpret-smooth-l1-loss?rq=1."},{"key":"ref_46","unstructured":"(2018, November 16). Ubuntu 16.04. Available online: https:\/\/en.wikipedia.org\/wiki\/Ubuntu_version_history#Ubuntu_16.04_LTS_.28Xenial_Xerus.29."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet Large Scale Visual Recognition Challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.inffus.2014.09.003","article-title":"Multimodal Inverse Perspective Mapping","volume":"24","author":"Oliveira","year":"2015","journal-title":"Inf. Fusion"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Pendleton, S.D., Andersen, H., Du, X., Shen, X., Meghjani, M., Eng, Y.H., Rus, D., and Ang, M.H. (2017). Perception, Planning, Control, and Coordination for Autonomous Vehicles. Machines, 5.","DOI":"10.3390\/machines5010006"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Tayara, H., and Chong, K.T. (2018). Object Detection in Very High-Resolution Aerial Images Using One-Stage Densely Connected Feature Pyramid Network. Sensors, 18.","DOI":"10.3390\/s18103341"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/281\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:25:26Z","timestamp":1760185526000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/2\/281"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,11]]},"references-count":50,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["s19020281"],"URL":"https:\/\/doi.org\/10.3390\/s19020281","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,11]]}}}