{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T14:40:40Z","timestamp":1777560040285,"version":"3.51.4"},"reference-count":34,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["AIC"],"published-print":{"date-parts":[[2024,4,17]]},"abstract":"<jats:p>Traffic systems play a key role in modern society. However, these systems are increasingly suffering from problems, such as congestions. A\u00a0well-known way to efficiently reduce this kind of problem is to perform traffic light control intelligently through reinforcement learning (RL) algorithms. In this context, extracting relevant features from the traffic environment to support decision-making becomes a central concern. Examples of such features include vehicle counting on each queue, identification of vehicles\u2019 origins and destinations, among others. Recently, the advent of deep learning has paved to way to efficient methods for extracting some of the aforementioned features. However, the problem of identifying vehicles and their origins and destinations within an intersection has not been fully addressed in the literature, even though such information has shown to play a role in RL-based traffic signal control. Building against this background, in this work we propose a deep learning pipeline for extracting relevant features from intersections based on traffic scenes. Our pipeline comprises three main steps: (i) a YOLO-based object detector fine-tuned using the UAVDT dataset, (ii) a tracking algorithm to keep track of vehicles along their trajectories, and (iii) an origin-destination identification algorithm. Using this pipeline, it is possible to identify vehicles as well as their origins and destinations within a given intersection. In order to assess our pipeline, we evaluated each of its modules separately as well as the pipeline as a whole. The object detector model obtained 98.2% recall and 79.5% precision, on average. The tracking algorithm obtained a MOTA of 72.6% and a MOTP of 74.4%. Finally, the complete pipeline obtained an average error rate of 3.065% in terms of origin and destination counts.<\/jats:p>","DOI":"10.3233\/aic-220317","type":"journal-article","created":{"date-parts":[[2023,7,14]],"date-time":"2023-07-14T11:37:56Z","timestamp":1689334676000},"page":"189-201","source":"Crossref","is-referenced-by-count":2,"title":["A machine learning pipeline for extracting decision-support features from traffic scenes1"],"prefix":"10.1177","volume":"37","author":[{"given":"Vitor A.","family":"Fraga","sequence":"first","affiliation":[{"name":"Graduate Program in Applied Computing, Universidade do Vale do Rio dos Sinos, S\u00e3o Leopoldo, RS, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lincoln V.","family":"Schreiber","sequence":"additional","affiliation":[{"name":"Graduate Program in Applied Computing, Universidade do Vale do Rio dos Sinos, S\u00e3o Leopoldo, RS, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marco Antonio C.","family":"da Silva","sequence":"additional","affiliation":[{"name":"Institute of Informatics, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rafael","family":"Kunst","sequence":"additional","affiliation":[{"name":"Graduate Program in Applied Computing, Universidade do Vale do Rio dos Sinos, S\u00e3o Leopoldo, RS, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jorge L.V.","family":"Barbosa","sequence":"additional","affiliation":[{"name":"Graduate Program in Applied Computing, Universidade do Vale do Rio dos Sinos, S\u00e3o Leopoldo, RS, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel de O.","family":"Ramos","sequence":"additional","affiliation":[{"name":"Graduate Program in Applied Computing, Universidade do Vale do Rio dos Sinos, S\u00e3o Leopoldo, RS, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/AIC-220317_ref1","doi-asserted-by":"publisher","first-page":"963","DOI":"10.1016\/j.procs.2013.06.134","article-title":"Autonomous road surveillance system: A proposed model for vehicle detection and traffic signal control","volume":"19","author":"Ali","year":"2013","journal-title":"Procedia Computer Science"},{"key":"10.3233\/AIC-220317_ref2","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.procs.2018.10.527","article-title":"Detection and classification of vehicles for traffic video analytics","volume":"144","author":"Arinaldi","year":"2018","journal-title":"Procedia Computer Science"},{"issue":"5","key":"10.3233\/AIC-220317_ref3","first-page":"446","article-title":"The economics of traffic congestion","volume":"82","author":"Arnott","year":"1994","journal-title":"American scientist"},{"issue":"3","key":"10.3233\/AIC-220317_ref4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-031-01565-6","article-title":"Introduction to intelligent systems in traffic and transportation","volume":"7","author":"Bazzan","year":"2013","journal-title":"Synthesis Lectures on Artificial Intelligence and Machine Learning"},{"key":"10.3233\/AIC-220317_ref5","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"10.3233\/AIC-220317_ref6","doi-asserted-by":"crossref","unstructured":"E. Bochinski, V. Eiselein and T. Sikora, High-speed tracking-by-detection without using image information, in: International Workshop on Traffic and Street Surveillance for Safety and Security at IEEE AVSS 2017, 2017.","DOI":"10.1109\/AVSS.2017.8078516"},{"issue":"04","key":"10.3233\/AIC-220317_ref7","doi-asserted-by":"publisher","first-page":"305","DOI":"10.4236\/jtts.2012.24033","article-title":"Video based vehicle detection and its application in intelligent transportation systems","volume":"02","author":"Chintalacheruvu","year":"2012","journal-title":"Journal of Transportation Technologies"},{"key":"10.3233\/AIC-220317_ref8","doi-asserted-by":"publisher","first-page":"64460","DOI":"10.1109\/ACCESS.2019.2914254","article-title":"Video-based vehicle counting framework","volume":"7","author":"Dai","year":"2019","journal-title":"IEEE Access"},{"key":"10.3233\/AIC-220317_ref11","unstructured":"V.A. Fraga, L. Schreiber, R. Kunst, J.L.C. Barbosa and G.de.O. Ramos, A machine learning pipeline for extracting decision-support features from traffic scenes, in: Proceedings of the 12th Workshop on Agents in Traffic and Transportation (ATT-2022), A.L.C. Bazzan, I. Dusparic, M. Lujak and G. Vizzari, eds, Vol. 3173, Vienna, 2022, pp. 194\u2013208."},{"key":"10.3233\/AIC-220317_ref12","doi-asserted-by":"crossref","unstructured":"R. Girshick, Fast r-cnn, in: Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 1440\u20131448.","DOI":"10.1109\/ICCV.2015.169"},{"key":"10.3233\/AIC-220317_ref13","doi-asserted-by":"crossref","unstructured":"R. Girshick, J. Donahue, T. Darrell and J. Malik, Rich feature hierarchies for accurate object detection and semantic segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 580\u2013587.","DOI":"10.1109\/CVPR.2014.81"},{"issue":"12","key":"10.3233\/AIC-220317_ref14","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.1109\/tnnls.2013.2270314","article-title":"Highly accurate moving object detection in variable bit rate video-based traffic monitoring systems","volume":"24","author":"Huang","year":"2013","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"6","key":"10.3233\/AIC-220317_ref15","doi-asserted-by":"publisher","first-page":"7756","DOI":"10.3390\/s130607756","article-title":"Robust vehicle detection under various environmental conditions using an infrared thermal camera and its application to road traffic flow monitoring","volume":"13","author":"Iwasaki","year":"2013","journal-title":"Sensors"},{"key":"10.3233\/AIC-220317_ref16","doi-asserted-by":"publisher","first-page":"543","DOI":"10.1016\/j.neucom.2015.11.049","article-title":"Analyzing crowd behavior in naturalistic conditions: Identifying sources and sinks and characterizing main flows","volume":"177","author":"Khan","year":"2016","journal-title":"Neurocomputing"},{"key":"10.3233\/AIC-220317_ref17","doi-asserted-by":"crossref","unstructured":"H. Law and J. Deng, Cornernet: Detecting objects as paired keypoints, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018, pp. 734\u2013750.","DOI":"10.1007\/978-3-030-01264-9_45"},{"key":"10.3233\/AIC-220317_ref19","doi-asserted-by":"crossref","unstructured":"T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Doll\u00e1r and C.L. Zitnick, Microsoft coco: Common objects in context, in: European Conference on Computer Vision, Springer, 2014, pp. 740\u2013755.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"10.3233\/AIC-220317_ref20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0186098"},{"key":"10.3233\/AIC-220317_ref21","doi-asserted-by":"crossref","unstructured":"W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu and A.C. Berg, Ssd: Single shot multibox detector, in: European Conference on Computer Vision, Springer, 2016, pp. 21\u201337.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"10.3233\/AIC-220317_ref22","doi-asserted-by":"crossref","unstructured":"Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin and B. Guo, Swin transformer: Hierarchical vision transformer using shifted windows, in: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), 2021, pp. 10012\u201310022.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"10.3233\/AIC-220317_ref23","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-25808-9_4"},{"key":"10.3233\/AIC-220317_ref25","doi-asserted-by":"publisher","DOI":"10.1109\/SPIN.2014.6776948"},{"key":"10.3233\/AIC-220317_ref26","first-page":"91","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"28","author":"Ren","year":"2015","journal-title":"Advances in neural information processing systems"},{"key":"10.3233\/AIC-220317_ref27","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN55064.2022.9892422"},{"issue":"1","key":"10.3233\/AIC-220317_ref28","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1109\/TITS.2018.2799228","article-title":"Boxcars: Improving fine-grained recognition of vehicles using 3-d bounding boxes in traffic surveillance","volume":"20","author":"Sochor","year":"2018","journal-title":"IEEE transactions on intelligent transportation systems"},{"key":"10.3233\/AIC-220317_ref29","doi-asserted-by":"publisher","DOI":"10.1109\/icip.2017.8296683"},{"issue":"1","key":"10.3233\/AIC-220317_ref30","doi-asserted-by":"publisher","first-page":"349","DOI":"10.2174\/1874444301406010349","article-title":"Robust vehicle detection based on cascade classifier in traffic surveillance system","volume":"6","author":"Tang","year":"2014","journal-title":"The Open Automation and Control Systems Journal"},{"key":"10.3233\/AIC-220317_ref31","doi-asserted-by":"crossref","unstructured":"C.-Y. Wang, A. Bochkovskiy and H.-Y.M. Liao, Scaled-YOLOv4: Scaling Cross Stage Partial Network, 2021.","DOI":"10.1109\/CVPR46437.2021.01283"},{"key":"10.3233\/AIC-220317_ref32","doi-asserted-by":"publisher","DOI":"10.3390\/rs11182155"},{"key":"10.3233\/AIC-220317_ref33","doi-asserted-by":"crossref","unstructured":"Q. Wang, Z. Wang, J. Xiao, J. Xiao and W. Li, Fine-grained vehicle recognition in traffic surveillance, in: Pacific Rim Conference on Multimedia, Springer, 2016, pp. 285\u2013295.","DOI":"10.1007\/978-3-319-48890-5_28"},{"key":"10.3233\/AIC-220317_ref35","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2017.8296962"},{"issue":"1","key":"10.3233\/AIC-220317_ref36","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1049\/iet-its.2017.0047","article-title":"Real-time vehicle detection and counting in complex traffic scenes using background subtraction model with low-rank decomposition","volume":"12","author":"Yang","year":"2017","journal-title":"IET Intelligent Transport Systems"},{"issue":"5","key":"10.3233\/AIC-220317_ref37","doi-asserted-by":"publisher","first-page":"1141","DOI":"10.1007\/s11263-019-01266-1","article-title":"The unmanned aerial vehicle benchmark: Object detection, tracking and baseline","volume":"128","author":"Yu","year":"2020","journal-title":"International Journal of Computer Vision"},{"key":"10.3233\/AIC-220317_ref38","doi-asserted-by":"publisher","DOI":"10.17485\/ijst\/2016\/v9i32\/100713"},{"issue":"4","key":"10.3233\/AIC-220317_ref39","doi-asserted-by":"publisher","first-page":"1624","DOI":"10.1109\/TITS.2011.2158001","article-title":"Data-driven intelligent transportation systems: A survey","volume":"12","author":"Zhang","year":"2011","journal-title":"IEEE Transactions on Intelligent Transportation Systems"}],"container-title":["AI Communications"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/AIC-220317","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T18:28:13Z","timestamp":1777400893000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/AIC-220317"}},"subtitle":[],"editor":[{"given":"Ana L.C.","family":"Bazzan","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Ivana","family":"Dusparic","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Marin","family":"Lujak","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]},{"given":"Giuseppe","family":"Vizzari","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,4,17]]},"references-count":34,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/aic-220317","relation":{},"ISSN":["1875-8452","0921-7126"],"issn-type":[{"value":"1875-8452","type":"electronic"},{"value":"0921-7126","type":"print"}],"subject":[],"published":{"date-parts":[[2024,4,17]]}}}