{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:18:05Z","timestamp":1780355885104,"version":"3.54.1"},"reference-count":38,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2023,6,26]],"date-time":"2023-06-26T00:00:00Z","timestamp":1687737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Traffic Sign Recognition (TSR) is one of the many utilities made possible by embedded systems with internet connections. Through the usage of vehicular cameras, it\u2019s possible to capture and classify traffic signs in real time with Artificial Intelligence (AI), more specifically, Convolutional Neural Networks (CNNs) based techniques. This article discusses the implementation of such TSR systems, and the building process of datasets for AI training. Such datasets include a brand new class to be used in TSR, vegetation occlusion. The results show that this approach is useful in making traffic sign maintenance faster since this application turns vehicles into moving sensors in that context. Leaning on the proposed technique, identified irregularities in traffic signs can be reported to a responsible body so they will eventually be fixed, contributing to a safer traffic environment. This paper also discusses the usage and performance of different YOLO models according to our case studies.<\/jats:p>","DOI":"10.3390\/s23135919","type":"journal-article","created":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T02:11:22Z","timestamp":1687831882000},"page":"5919","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Traffic Sign Recognition with Deep Learning: Vegetation Occlusion Detection in Brazilian Environments"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-5312-2410","authenticated-orcid":false,"given":"Vanessa","family":"Dalborgo","sequence":"first","affiliation":[{"name":"Computational Modeling and Industrial Technology Program, SENAI CIMATEC, Salvador 41650-010, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5598-2679","authenticated-orcid":false,"given":"Thiago B.","family":"Murari","sequence":"additional","affiliation":[{"name":"Computational Modeling and Industrial Technology Program, SENAI CIMATEC, Salvador 41650-010, Brazil"},{"name":"Industrial Management and Technology Program, SENAI CIMATEC, Salvador 41650-010, Brazil"},{"name":"Institute of Science, Innovation and Technology of the State of Bahia (INCITE)\u2014Industry 4.0, SENAI CIMATEC, Salvador 41650-010, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0132-5643","authenticated-orcid":false,"given":"Vinicius S.","family":"Madureira","sequence":"additional","affiliation":[{"name":"Electrical Engineering Program, College of Ilh\u00e9us, Ilh\u00e9us 45655-120, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-5013-9674","authenticated-orcid":false,"given":"Jo\u00e3o Gabriel L.","family":"Moraes","sequence":"additional","affiliation":[{"name":"Computational Modeling and Industrial Technology Program, SENAI CIMATEC, Salvador 41650-010, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-9319-8959","authenticated-orcid":false,"given":"Vitor Magno O. S.","family":"Bezerra","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Federal University of Sergipe, S\u00e3o Cristov\u00e3o 49100-000, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3490-256X","authenticated-orcid":false,"given":"Filipe Q.","family":"Santos","sequence":"additional","affiliation":[{"name":"Department of Engineering and Computing, State University of Santa Cruz, Ilh\u00e9us 45662-900, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7436-8818","authenticated-orcid":false,"given":"Alexandre","family":"Silva","sequence":"additional","affiliation":[{"name":"Computational Modeling and Industrial Technology Program, SENAI CIMATEC, Salvador 41650-010, Brazil"},{"name":"Department of Engineering and Computing, State University of Santa Cruz, Ilh\u00e9us 45662-900, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3931-5953","authenticated-orcid":false,"given":"Roberto L. S.","family":"Monteiro","sequence":"additional","affiliation":[{"name":"Computational Modeling and Industrial Technology Program, SENAI CIMATEC, Salvador 41650-010, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/MIM.2019.8633345","article-title":"Classifications of Safety Systems","volume":"22","author":"Galvani","year":"2019","journal-title":"IEEE Instrum. Meas. Mag."},{"key":"ref_2","first-page":"24","article-title":"A Review and Comparative Analysis of Recent Advancements in Traffic Sign Detection and Recognition Techniques","volume":"2","author":"Chourasia","year":"2011","journal-title":"SAMRIDDHI J. Phys. Sci. Eng. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cao, J., Song, C., Peng, S., Xiao, F., and Song, S. (2019). Improved traffic sign detection and recognition algorithm for intelligent vehicles. Sensors, 19.","DOI":"10.3390\/s19184021"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Silva, R., Prado, B., Matos, L.N., Santo, F., Zanchettin, C., and Novais, P. (2021). Construction of Brazilian Regulatory Traffic Sign Recognition Dataset, Springer.","DOI":"10.1007\/978-3-030-93420-0_16"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gu, Y., and Si, B. (2022). A Novel Lightweight Real-Time Traffic Sign Detection Integration Framework Based on YOLOv4. Entropy, 24.","DOI":"10.3390\/e24040487"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"17779","DOI":"10.1007\/s11042-022-12163-0","article-title":"Traffic sign recognition based on deep learning","volume":"81","author":"Zhu","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Triki, N., Karray, M., and Ksantini, M. (2023). A Real-Time Traffic Sign Recognition Method Using a New Attention-Based Deep Convolutional Neural Network for Smart Vehicles. Appl. Sci., 13.","DOI":"10.3390\/app13084793"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_10","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2023, February 10). SSD: Single Shot Multibox Detector, Available online: http:\/\/xxx.lanl.gov\/abs\/1512.02325."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhou, K., Zhan, Y., and Fu, D. (2021). Learning region-based attention network for traffic sign recognition. Sensors, 21.","DOI":"10.3390\/s21030686"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.neunet.2012.02.016","article-title":"Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognition","volume":"32","author":"Stallkamp","year":"2012","journal-title":"Neural Netw."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., and Igel, C. (2013, January 4\u20139). Detection of traffic signs in real-world images: The German traffic sign detection benchmark. Proceedings of the 2013 International Joint Conference on Neural Networks (IJCNN), Dallas, TX, USA.","DOI":"10.1109\/IJCNN.2013.6706807"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1007\/s00138-011-0391-3","article-title":"Multi-view traffic sign detection, recognition, and 3D localisation","volume":"25","author":"Timofte","year":"2014","journal-title":"Mach. Vis. Appl."},{"key":"ref_15","unstructured":"Youssef, A., Albani, D., Nardi, D., and Bloisi, D.D. (2016). Advanced Concepts for Intelligent Vision Systems, Springer International Publishing. Lecture Notes in Computer Science."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/s13735-017-0129-8","article-title":"An overview of traffic sign detection and classification methods","volume":"6","author":"Saadna","year":"2017","journal-title":"Int. J. Multimed. Inf. Retr."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1588","DOI":"10.23940\/ijpe.20.10.p10.15881597","article-title":"A Survey of the Inadequacies in Traffic Sign Recognition Systems for Autonomous Vehicles","volume":"16","author":"Magnussen","year":"2020","journal-title":"Int. J. Perform. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wali, S.B., Abdullah, M.A., Hannan, M.A., Hussain, A., Samad, S.A., Ker, P.J., and Mansor, M.B. (2019). Vision-Based Traffic Sign Detection and Recognition Systems: Current Trends and Challenges. Sensors, 19.","DOI":"10.3390\/s19092093"},{"key":"ref_19","first-page":"1881","article-title":"Cognition based Recognition of Partially Occluded Traffic Signs","volume":"29","author":"Mannan","year":"2022","journal-title":"Sci. Iran."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1049\/iet-cvi.2016.0303","article-title":"D-patches: Effective traffic sign detection with occlusion handling","volume":"11","author":"Rehman","year":"2017","journal-title":"IET Comput. Vis."},{"key":"ref_21","unstructured":"Jocher, G. (2022, January 15). YOLOv5 by Ultralytics, Version 7.0; Zenodo. Available online: https:\/\/doi.org\/10.5281\/zenodo.3908559."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mathias, M., Timofte, R., Benenson, R., and Van Gool, L. (2013, January 4\u20139). Traffic sign recognition\u2014How far are we from the solution?. Proceedings of the The 2013 International Joint Conference on Neural Networks (IJCNN), Dallas, TX, USA.","DOI":"10.1109\/IJCNN.2013.6707049"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Balali, V., and Golparvar-Fard, M. (2014). Video-based detection and classification of US traffic signs and mile markers using color candidate extraction and feature-based recognition. Tech. Rep., 858\u2013866.","DOI":"10.1061\/9780784413616.107"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1016\/j.imavis.2008.07.006","article-title":"Using self-organising maps in the detection and recognition of road signs","volume":"27","author":"Prieto","year":"2009","journal-title":"Image Vis. Comput."},{"key":"ref_25","unstructured":"Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., and Hu, S. (July, January 26). Traffic-Sign Detection and Classification in the Wild. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Atif, M., Zoppi, T., Gharib, M., and Bondavalli, A. (2022). Towards Enhancing Traffic Sign Recognition through Sliding Windows. Sensors, 22.","DOI":"10.3390\/s22072683"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1109\/TITS.2019.2956813","article-title":"Overcoming Occlusion in the Automotive Environment\u2014A Review","volume":"22","author":"Gilroy","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kim, J.U., Kwon, J., Kim, H.G., Lee, H., and Ro, Y.M. (2018, January 7\u201310). Object Bounding Box-Critic Networks for Occlusion-Robust Object Detection in Road Scene. Proceedings of the Proceedings\u2014International Conference on Image Processing, ICIP, Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451034"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mostafa, T., Chowdhury, S.J., Rhaman, M.K., and Alam, M.G.R. (2022, January 12\u201315). Occluded Object Detection for Autonomous Vehicles Employing YOLOv5, YOLOX and Faster R-CNN. Proceedings of the 2022 IEEE 13th Annual Information Technology, Electronics and Mobile Communication Conference, IEMCON, Vancouver, BC, Canada.","DOI":"10.1109\/IEMCON56893.2022.9946565"},{"key":"ref_30","first-page":"103017","article-title":"Occlusion detection of traffic signs by voxel-based ray tracing using highly detailed models and MLS point clouds of vegetation","volume":"114","author":"Hirt","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_31","unstructured":"Zottis Junges, R., de Paula, M., and de Aguiar, M. (November, January 27). Brazilian Traffic Signs Detection and Recognition in Videos Using CLAHE, HOG Feature Extraction and SVM Cascade Classifier with Temporal Coherence. Proceedings of the Advances in Soft Computing, Xalapa, Mexico."},{"key":"ref_32","unstructured":"Conselho Nacional de Tr\u00e2nsito (CONTRAN) (2022, January 15). Manuais Brasileiros de Sinaliza\u00e7\u00e3o de Tr\u00e2nsito, Available online: https:\/\/www.gov.br\/transportes\/pt-br\/assuntos\/transito\/senatran\/manuais-brasileiros-de-sinalizacao-de-transito."},{"key":"ref_33","unstructured":"KartaView (2022, January 15). KartaView. Available online: https:\/\/kartaview.org\/."},{"key":"ref_34","unstructured":"Tkachenko, M., Malyuk, M., Holmanyuk, A., and Liubimov, N. (2022, January 15). Label Studio: Data labeling software. Available online: https:\/\/labelstud.io\/."},{"key":"ref_35","unstructured":"Wada, K. (2022, January 15). Labelme: Image Polygonal Annotation with Python. Available online: https:\/\/github.com\/zhong110020\/labelme."},{"key":"ref_36","unstructured":"CVAT.ai Corporation (Computer Vision Annotation Tool (CVAT), 2022). Computer Vision Annotation Tool (CVAT), Version 2.0.0."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Padilla, R., Netto, S.L., and da Silva, E.A.B. (2020, January 1\u20133). A Survey on Performance Metrics for Object-Detection Algorithms. Proceedings of the 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), Niteroi, Brazil.","DOI":"10.1109\/IWSSIP48289.2020.9145130"},{"key":"ref_38","unstructured":"Consortium, C. (2022, January 23). COCO Common Objects in Context. Available online: https:\/\/cocodataset.org\/#home."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/5919\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:01:04Z","timestamp":1760126464000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/5919"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,26]]},"references-count":38,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["s23135919"],"URL":"https:\/\/doi.org\/10.3390\/s23135919","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,26]]}}}