{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T03:17:37Z","timestamp":1777432657794,"version":"3.51.4"},"reference-count":68,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2021,12,27]],"date-time":"2021-12-27T00:00:00Z","timestamp":1640563200000},"content-version":"vor","delay-in-days":360,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["S2018\/NMT-4331"],"award-info":[{"award-number":["S2018\/NMT-4331"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computational Intelligence and Neuroscience"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>Real\u2010time vehicle monitoring in highways, roads, and streets may provide useful data both for infrastructure planning and for traffic management in general. Even though it is a classic research area in computer vision, advances in neural networks for object detection and classification, especially in the last years, made this area even more appealing due to the effectiveness of these methods. This study presents TrafficSensor, a system that employs deep learning techniques for automatic vehicle tracking and classification on highways using a calibrated and fixed camera. A new traffic image dataset was created to train the models, which includes real traffic images in poor lightning or weather conditions and low\u2010resolution images. The proposed system consists mainly of two modules, first one responsible of vehicle detection and classification and a second one for vehicle tracking. For the first module, several neural models were tested and objectively compared, and finally, the YOLOv3 and YOLOv4\u2010based network trained on the new traffic dataset were selected. The second module combines a simple spatial association algorithm with a more sophisticated KLT (Kanade\u2013Lucas\u2013Tomasi) tracker to follow the vehicles on the road. Several experiments have been conducted on challenging traffic videos in order to validate the system with real data. Experimental results show that the proposed system is able to successfully detect, track, and classify vehicles traveling on a highway on real time.<\/jats:p>","DOI":"10.1155\/2021\/4632353","type":"journal-article","created":{"date-parts":[[2021,12,28]],"date-time":"2021-12-28T03:20:07Z","timestamp":1640661607000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Robust Real\u2010Time Traffic Surveillance with Deep Learning"],"prefix":"10.1155","volume":"2021","author":[{"given":"Jessica","family":"Fern\u00e1ndez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4179-2211","authenticated-orcid":false,"given":"Jos\u00e9 M.","family":"Ca\u00f1as","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vanessa","family":"Fern\u00e1ndez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8233-333X","authenticated-orcid":false,"given":"Sergio","family":"Paniego","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2021,12,27]]},"reference":[{"key":"e_1_2_9_1_2","doi-asserted-by":"crossref","unstructured":"HodlmoserM. MicusikB. LiuM. PollefeysM. andKampelM. Classification and pose estimation of vehicles in videos by 3d modeling within discrete-continuous optimization Proceedings of the 3D Imaging Modeling Processing Visualization and Transmission (3DIMPVT) 2012 Second International Conference October 2012 Zurich Switzerland 198\u2013205 https:\/\/doi.org\/10.1109\/3dimpvt.2012.23 2-s2.0-84872045524.","DOI":"10.1109\/3DIMPVT.2012.23"},{"key":"e_1_2_9_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2012.2186128"},{"key":"e_1_2_9_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2013.2269137"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12209-011-1593-5"},{"key":"e_1_2_9_5_2","doi-asserted-by":"crossref","unstructured":"YulongW. GuoJ. andQianZ. Real-time vehicle classification based on eigenface Proceedings of the Consumer Electronics Communications and Networks (CECNet) April 2011 Xianning China 4292\u20134295.","DOI":"10.1109\/CECNET.2011.5768322"},{"key":"e_1_2_9_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2013.02.011"},{"key":"e_1_2_9_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2011.2119372"},{"key":"e_1_2_9_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2010.2045500"},{"key":"e_1_2_9_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45103-x_52"},{"key":"e_1_2_9_10_2","doi-asserted-by":"crossref","unstructured":"KollerD. WeberJ. andMalikJ. Robust multiple car tracking with occlusion reasoning Proceedings of the Computer Vision-ECCV\u201994 June 1994 Stockholm Sweden 189\u2013196 https:\/\/doi.org\/10.1007\/3-540-57956-7_22.","DOI":"10.1007\/3-540-57956-7_22"},{"key":"e_1_2_9_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2004.833769"},{"key":"e_1_2_9_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2007.902647"},{"key":"e_1_2_9_13_2","doi-asserted-by":"publisher","DOI":"10.1117\/1.JEI.25.3.033021"},{"key":"e_1_2_9_14_2","doi-asserted-by":"crossref","unstructured":"BenjaminY. WangY. andZhuS. Reconfigurable templates for robust vehicle detection and classification Proceedings of the Applications of Computer Vision (WACV) January 2012 Breckenridge CO USA 321\u2013328.","DOI":"10.1109\/WACV.2012.6163016"},{"key":"e_1_2_9_15_2","doi-asserted-by":"crossref","unstructured":"ChenZ.andEllisT. Multi-shape descriptor vehicle classification for urban traffic Proceedings of the International Conference on Digital Image Computing: Techniques and Applications December 2011 Noosa QLD Australia 465\u2013461 https:\/\/doi.org\/10.1109\/dicta.2011.83 2-s2.0-84863078818.","DOI":"10.1109\/DICTA.2011.83"},{"key":"e_1_2_9_16_2","doi-asserted-by":"crossref","unstructured":"ChenZ. EllisT. andVelastinS. Vehicle type categorization: a comparison of classification schemes Proceedings of the 14th International IEEE Conference on Intelligent Transportation Systems October 2011 Washington DC USA 74\u201379 https:\/\/doi.org\/10.1109\/itsc.2011.6083075 2-s2.0-83755173344.","DOI":"10.1109\/ITSC.2011.6083075"},{"key":"e_1_2_9_17_2","doi-asserted-by":"publisher","DOI":"10.5815\/ijigsp.2012.09.08"},{"key":"e_1_2_9_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2160954"},{"key":"e_1_2_9_19_2","doi-asserted-by":"crossref","unstructured":"BlossevilleJ. M. KrafftC. LeniorF. MotykaV. andBeucherS. New traffic measurement by image processing Proceedings of the IFAC Control Computers Communications in Transportation September 1989 Paris France 35\u201342.","DOI":"10.1016\/B978-0-08-037025-5.50011-6"},{"key":"e_1_2_9_20_2","doi-asserted-by":"crossref","unstructured":"LaiJ. HuangS. andTsengC. Image-based vehicle tracking and classification on the highway Proceedings of the Green Circuits and Systems (ICGCS) 2010 International Conference on June 2010 Shanghai China 666\u2013670.","DOI":"10.1109\/ICGCS.2010.5542980"},{"key":"e_1_2_9_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-009-0185-z"},{"key":"e_1_2_9_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2014.12.018"},{"key":"e_1_2_9_23_2","unstructured":"ChalidabhongseT. KimK. HarwoodD. andDavisL. A perturbation method for evaluating background subtraction algorithms Proceedings of the IEEE Joint International Workshop VS-PETS January 2003 Nice France 1\u20137."},{"key":"e_1_2_9_24_2","unstructured":"KimK. ChalidabhongseT. HarwoodD. andDavisL. Background modeling and subtraction by codebook construction Proceedings of the ICIP November 2004 3061\u20133064."},{"key":"e_1_2_9_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rti.2004.12.004"},{"key":"e_1_2_9_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2011.2174358"},{"key":"e_1_2_9_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2005.11.005"},{"key":"e_1_2_9_28_2","doi-asserted-by":"crossref","unstructured":"HuangL. Real-time multi-vehicle detection and sub-feature based tracking for traffic surveillance systems Proceedings of the 2010 2nd International Asia Conference on Informatics in Control March 2010 Wuhan China Automation and Robotics https:\/\/doi.org\/10.1109\/car.2010.5456534 2-s2.0-77953033799.","DOI":"10.1109\/CAR.2010.5456534"},{"key":"e_1_2_9_29_2","doi-asserted-by":"crossref","unstructured":"RobertK. Night-time traffic surveillance: a robust framework for multi-vehicle detection classification and tracking Proceedings of the Advanced Video and Signal Based Surveillance September 2009 Genova Italy 1\u20136 https:\/\/doi.org\/10.1109\/avss.2009.98 2-s2.0-72449201253.","DOI":"10.1109\/AVSS.2009.98"},{"key":"e_1_2_9_30_2","doi-asserted-by":"crossref","unstructured":"ZivkovicZ. Improved adaptive Gaussian mixture model for background subtraction Proceedings of the 2004 ICPR 2004 17th International Conference on Pattern Recognition August 2004 Cambridge UK 28\u201331.","DOI":"10.1109\/ICPR.2004.1333992"},{"key":"e_1_2_9_31_2","article-title":"Vehicle detection, tracking and speed measurement for traffic regulation","volume":"04","author":"Samhitha P. H.","year":"2017","journal-title":"International Research Journal of Engineering and Technology (IRJET)"},{"key":"e_1_2_9_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38622-0_32"},{"key":"e_1_2_9_33_2","doi-asserted-by":"crossref","unstructured":"HodlmoserM. MicusikB. PollefeysM. LiuM. andKampelM. Model-based vehicle pose estimation and tracking in videos using random forests Proceedings of the International Conference on 3D Vision June 2013 Seattle WA USA 430\u2013437 https:\/\/doi.org\/10.1109\/3dv.2013.63 2-s2.0-84885974988.","DOI":"10.1109\/3DV.2013.63"},{"key":"e_1_2_9_34_2","doi-asserted-by":"publisher","DOI":"10.1023\/b:visi.0000029664.99615.94"},{"key":"e_1_2_9_35_2","article-title":"Multiple vehicle detection and tracking in highway traffic surveillance video based on sift feature matching","volume":"12","author":"Mu K.","year":"2016","journal-title":"Journal of Information Processing Systems"},{"key":"e_1_2_9_36_2","doi-asserted-by":"publisher","DOI":"10.1186\/1687-6180-2011-95"},{"key":"e_1_2_9_37_2","doi-asserted-by":"crossref","unstructured":"ChenZ. EllisT. andVelastinS. A. Vehicle detection tracking and classification in urban traffic Proceedings of the 15th International IEEE Conference on Intelligent Transportation Systems September 2012 Anchorage AK USA.","DOI":"10.1109\/ITSC.2012.6338852"},{"key":"e_1_2_9_38_2","doi-asserted-by":"crossref","unstructured":"ZhuZ.andLuX. An accurate shadow removal method for vehicle tracking Proceedings of the Artificial Intelligence and Computational Intelligence (AICI) 2010 International Conference on October 2010 Sanya China 59\u201362.","DOI":"10.1109\/AICI.2010.135"},{"key":"e_1_2_9_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2016.05.008"},{"key":"e_1_2_9_40_2","doi-asserted-by":"crossref","unstructured":"HuangL.andBarthM. Real-time multi-vehicle tracking based on feature detection and color probability model Proceedings of the Intelligent Vehicles Symposium (IV) June 2010 La Jolla CA USA 981\u2013986 https:\/\/doi.org\/10.1109\/ivs.2010.5548060 2-s2.0-77956506032.","DOI":"10.1109\/IVS.2010.5548060"},{"key":"e_1_2_9_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2009.03.005"},{"key":"e_1_2_9_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2010.217"},{"key":"e_1_2_9_43_2","doi-asserted-by":"crossref","unstructured":"BakerK. D.andSullivanG. D. Performance assessment of model-based tracking Proceedings of the IEEE Workshop on Applications of Computer Vision November 1992 Palm Springs CA USA 28\u201335.","DOI":"10.1109\/ACV.1992.240330"},{"key":"e_1_2_9_44_2","unstructured":"WelchG.andBishopG. An introduction to the Kalman filter 2006 University of North Carolina at Chapel Hill Chapel Hill NC USA Technical Report TR 95-041."},{"key":"e_1_2_9_45_2","doi-asserted-by":"crossref","unstructured":"VedaldiA. GulshanV. VarmaM. andZissermanA. Multiple kernels for object detection Proceedings of the IEEE 12th International Conference on Computer Vision (ICCV) September 2009 Kyoto Japan https:\/\/doi.org\/10.1109\/iccv.2009.5459183 2-s2.0-77953196456.","DOI":"10.1109\/ICCV.2009.5459183"},{"key":"e_1_2_9_46_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/4175.001.0001"},{"key":"e_1_2_9_47_2","doi-asserted-by":"publisher","DOI":"10.1023\/a:1008162616689"},{"key":"e_1_2_9_48_2","unstructured":"PapageorgiouC. P. OrenM. andPoggioT. A general framework for object detection Proceedings of the Sixth International Conference on Computer Vision ICCV\u201998 January 1998 Bombay India."},{"key":"e_1_2_9_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/TENCONSpring.2016.7519418"},{"key":"e_1_2_9_50_2","doi-asserted-by":"crossref","unstructured":"JiaY. ShelhamerE. DonahueJ. KarayevS. LongJ. GirshickR. GuadarramaS. andDarrellT. Caffe: convolutional architecture for fast feature embedding 2014 URLhttp:\/\/caffe.berkeleyvision.org\/tutorial\/solver.html.","DOI":"10.1145\/2647868.2654889"},{"key":"e_1_2_9_51_2","doi-asserted-by":"crossref","unstructured":"SensaJ. K. SyahraG. S. DewaC. K. andAfiahayati Traffic congestion detection: learning from CCTV monitoring images using convolutional neural network Proceedings of the INNS Conference on Big Data and Deep Learning January 2018 Bali Indonesia 291\u2013297.","DOI":"10.1016\/j.procs.2018.10.530"},{"key":"e_1_2_9_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2020.106533"},{"key":"e_1_2_9_53_2","article-title":"Multi-scale traffic vehicle detection based on faster RE-CNN with NAS optimization and feature enrichment","volume":"17","author":"Luo J.","year":"2020","journal-title":"Defence Technology"},{"key":"e_1_2_9_54_2","doi-asserted-by":"crossref","unstructured":"RedmonJ. DivvalaS. GirshickR. andFarhadiA. You only look once: unified real-time object detection Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) June 2016 Las Vegas NV USA 779\u2013788 https:\/\/doi.org\/10.1109\/CVPR.2016.91 2-s2.0-84986308404.","DOI":"10.1109\/CVPR.2016.91"},{"key":"e_1_2_9_55_2","doi-asserted-by":"crossref","unstructured":"RajotteJ. F. SotirM. NoiseuxC. NoelL. P. andBertiereT. Object counting on low quality images: a case study of near real-time traffic monitoring Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications December 2018 Orlando FL USA.","DOI":"10.1109\/ICMLA.2018.00194"},{"key":"e_1_2_9_56_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9061014"},{"key":"e_1_2_9_57_2","article-title":"Refining yolov4 for vehicle detection","volume":"11","author":"Mahto P.","year":"2020","journal-title":"International Journal of Advanced Research in Engineering and Technology (IJARET)"},{"key":"e_1_2_9_58_2","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1757\/1\/012070"},{"key":"e_1_2_9_59_2","volume-title":"Advances in Neural Information Processing Systems","author":"Szegedy C.","year":"2013"},{"key":"e_1_2_9_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3065386"},{"key":"e_1_2_9_61_2","unstructured":"RedmonJ.andFarhadiA. Yolov3: an incremental improvement 2018 URLhttp:\/\/arxiv.org\/abs\/1804.02767."},{"key":"e_1_2_9_62_2","unstructured":"BochkovskiyA. WangC. Y. andLiaoH. Y. Yolov4: optimal speed and accuracy of object detection 2020 https:\/\/arxiv.org\/abs\/2004.10934."},{"key":"e_1_2_9_63_2","doi-asserted-by":"crossref","unstructured":"WangC. Y. LiaoH. Y. M. YehI. H. WuY. H. ChenP. Y. andHsiehJ. W. CSPNet: a new backbone that can enhance learning capability of CNN Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) June 2020 Seattle WA USA 1571\u20131580 https:\/\/doi.org\/10.1109\/cvprw50498.2020.00203.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"e_1_2_9_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/tpami.2015.2389824"},{"key":"e_1_2_9_65_2","doi-asserted-by":"crossref","unstructured":"LiuS. QiL. QinH. ShiJ. andJiaJ. Path aggregation network for instance segmentation Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition June 2018 Salt Lake City UT USA 8759\u20138768 https:\/\/doi.org\/10.1109\/cvpr.2018.00913 2-s2.0-85060854014.","DOI":"10.1109\/CVPR.2018.00913"},{"key":"e_1_2_9_66_2","volume-title":"Pyramidal Implementation of the Lucas Kanade Feature Tracker","author":"Bouguet J. Y.","year":"2000"},{"key":"e_1_2_9_67_2","doi-asserted-by":"crossref","unstructured":"WojkeN. BewleyA. andPaulusD. Simple online and realtime tracking with a deep association metric Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP) September 2017 Beijing China 3645\u20133649 https:\/\/doi.org\/10.1109\/icip.2017.8296962 2-s2.0-85045318361.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"e_1_2_9_68_2","doi-asserted-by":"crossref","unstructured":"BewleyA. GeZ. OttL. RamosF. andUpcroftB. Simple online and realtime tracking Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP) September 2016 Phoenix AZ USA https:\/\/doi.org\/10.1109\/icip.2016.7533003 2-s2.0-85006782971.","DOI":"10.1109\/ICIP.2016.7533003"}],"container-title":["Computational Intelligence and Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2021\/4632353.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2021\/4632353.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/4632353","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,15]],"date-time":"2024-09-15T07:28:15Z","timestamp":1726385295000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2021\/4632353"}},"subtitle":[],"editor":[{"given":"Miguel","family":"Cazorla","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":68,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1155\/2021\/4632353"],"URL":"https:\/\/doi.org\/10.1155\/2021\/4632353","archive":["Portico"],"relation":{},"ISSN":["1687-5265","1687-5273"],"issn-type":[{"value":"1687-5265","type":"print"},{"value":"1687-5273","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"2021-07-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"4632353"}}