{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T05:13:23Z","timestamp":1790572403721,"version":"4.1.0"},"reference-count":50,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Regional Development Fund","award":["ERDF-FEDER"],"award-info":[{"award-number":["ERDF-FEDER"]}]},{"name":"European Regional Development Fund","award":["04\/18\/VA\/0008"],"award-info":[{"award-number":["04\/18\/VA\/0008"]}]},{"name":"European Regional Development Fund","award":["04\/18\/VA\/0013"],"award-info":[{"award-number":["04\/18\/VA\/0013"]}]},{"name":"European Regional Development Fund","award":["04\/20\/VA\/0130"],"award-info":[{"award-number":["04\/20\/VA\/0130"]}]},{"name":"European Regional Development Fund","award":["101008297"],"award-info":[{"award-number":["101008297"]}]},{"name":"Instituto de Competitividad Empresarial","award":["ERDF-FEDER"],"award-info":[{"award-number":["ERDF-FEDER"]}]},{"name":"Instituto de Competitividad Empresarial","award":["04\/18\/VA\/0008"],"award-info":[{"award-number":["04\/18\/VA\/0008"]}]},{"name":"Instituto de Competitividad Empresarial","award":["04\/18\/VA\/0013"],"award-info":[{"award-number":["04\/18\/VA\/0013"]}]},{"name":"Instituto de Competitividad Empresarial","award":["04\/20\/VA\/0130"],"award-info":[{"award-number":["04\/20\/VA\/0130"]}]},{"name":"Instituto de Competitividad Empresarial","award":["101008297"],"award-info":[{"award-number":["101008297"]}]},{"name":"EU Horizon 2020 Research and Innovation Programme","award":["ERDF-FEDER"],"award-info":[{"award-number":["ERDF-FEDER"]}]},{"name":"EU Horizon 2020 Research and Innovation Programme","award":["04\/18\/VA\/0008"],"award-info":[{"award-number":["04\/18\/VA\/0008"]}]},{"name":"EU Horizon 2020 Research and Innovation Programme","award":["04\/18\/VA\/0013"],"award-info":[{"award-number":["04\/18\/VA\/0013"]}]},{"name":"EU Horizon 2020 Research and Innovation Programme","award":["04\/20\/VA\/0130"],"award-info":[{"award-number":["04\/20\/VA\/0130"]}]},{"name":"EU Horizon 2020 Research and Innovation Programme","award":["101008297"],"award-info":[{"award-number":["101008297"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We present an automatic road incident detector characterised by a low computational complexity for easy implementation in affordable devices, automatic adaptability to changes in scenery and road conditions, and automatic detection of the most common incidents (vehicles with abnormal speed, pedestrians or objects falling on the road, vehicles stopped on the shoulder, and detection of kamikaze vehicles). To achieve these goals, different tasks have been addressed: lane segmentation, identification of traffic directions, and elimination of unnecessary objects in the foreground. The proposed system has been tested on a collection of videos recorded in real scenarios with real traffic, including areas with different lighting. Self-adaptability (plug and play) to different scenarios has been tested using videos with significant scene changes. The achieved system can process a minimum of 80 video frames within the camera\u2019s field of view, covering a distance of 400 m, all within a span of 12 s. This capability ensures that vehicles travelling at speeds of 120 km\/h are seamlessly detected with more than enough margin. Additionally, our analysis has revealed a substantial improvement in incident detection with respect to previous approaches. Specifically, an increase in accuracy of 2\u20135% in automatic mode and 2\u20137% in semi-automatic mode. The proposed classifier module only needs 2.3 MBytes of GPU to carry out the inference, thus allowing implementation in low-cost devices.<\/jats:p>","DOI":"10.3390\/s24061822","type":"journal-article","created":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T12:14:40Z","timestamp":1710245680000},"page":"1822","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Self-Adaptive Automatic Incident Detection System for Road Surveillance Based on Deep Learning"],"prefix":"10.3390","volume":"24","author":[{"given":"C\u00e9sar","family":"Bartolom\u00e9-Hornillos","sequence":"first","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad de Valladolid, 47011 Valladolid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8760-9577","authenticated-orcid":false,"given":"Luis M.","family":"San-Jos\u00e9-Revuelta","sequence":"additional","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad de Valladolid, 47011 Valladolid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7054-0369","authenticated-orcid":false,"given":"Javier M.","family":"Aguiar-P\u00e9rez","sequence":"additional","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad de Valladolid, 47011 Valladolid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos","family":"Garc\u00eda-Serrada","sequence":"additional","affiliation":[{"name":"Construcciones y Obras Llorente, S.A., 47012 Valladolid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eduardo","family":"Vara-Pazos","sequence":"additional","affiliation":[{"name":"Construcciones y Obras Llorente, S.A., 47012 Valladolid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1565-0842","authenticated-orcid":false,"given":"Pablo","family":"Casaseca-de-la-Higuera","sequence":"additional","affiliation":[{"name":"ETSI Telecomunicaci\u00f3n, Universidad de Valladolid, 47011 Valladolid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,3,12]]},"reference":[{"key":"ref_1","unstructured":"C-ITS Organisation (2022). Ecosystem for Fully Operational C-ITS Service Delivery, European Commission, EU. Technical Report."},{"key":"ref_2","unstructured":"C-ITS Organisation (2021). C-Roads Annual Pilot Overview Report, European Commission, EU. Technical Report."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. (2000, January 23\u201328). Image inpainting. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2000), New Orleans, LA, USA.","DOI":"10.1145\/344779.344972"},{"key":"ref_4","first-page":"100986","article-title":"Smart roads: A state of the art of highways innovations in the Smart Age","volume":"25","author":"Pompigna","year":"2022","journal-title":"Eng. Sci. Technol. Int. J."},{"key":"ref_5","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2001), Kauai, HI, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Girshick, R.B. (2015). Fast R-CNN. arXiv.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","first-page":"379","article-title":"R-FCN: Object detection via region-based fully convolutional networks","volume":"29","author":"Dai","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_11","unstructured":"Etten, A.V. (2018). You Only Look Twice: Rapid Multi-Scale Object Detection In Satellite Imagery. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/34.1000236","article-title":"Mean shift: A robust approach toward feature space analysis","volume":"24","author":"Comaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An Iterative Image Registration Technique with an Application to Stereo Vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI-81), San Francisco, CA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/0262-8856(84)90001-5","article-title":"Computation of optic flow from the motion of edge features in image sequences","volume":"2","author":"Buxton","year":"1984","journal-title":"Image Vis. Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016, January 25\u201328). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017, January 14\u201320). Simple online and realtime tracking with a deep association metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/BF00133570","article-title":"Snakes: Active contour models","volume":"1","author":"Kass","year":"1988","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1006\/jcph.2000.6636","article-title":"Level Set Methods: An Overview and Some Recent Results","volume":"169","author":"Osher","year":"2001","journal-title":"J. Comput. Phys."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI)\u2014MICCAI 2015, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chen, Z., and Ellis, T. (2013, January 27\u201330). Automatic lane detection from vehicle motion trajectories. Proceedings of the 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance, Krakow, Poland.","DOI":"10.1109\/AVSS.2013.6636684"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Usmankhujaev, S., Baydadaev, S., and Woo, K.J. (2020). Real-Time, Deep learning based wrong direction detection. Appl. Sci., 10.","DOI":"10.3390\/app10072453"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Rahman, Z., Ami, A.M., and Ullah, M.A. (2020, January 5\u20137). A real-time wrong-way vehicle detection based on YOLO and centroid tracking. Proceedings of the 2020 IEEE Region 10 Symposium (TENSYMP), Dhaka, Bangladesh.","DOI":"10.1109\/TENSYMP50017.2020.9230463"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Monteiro, G., Ribeiro, M., Marcos, J., and Batista, J. (2007, January 16\u201319). Wrongway drivers detection based on optical flow. Proceedings of the 2007 IEEE International Conference on Image Processing (ICIP), San Antonio, TX, USA.","DOI":"10.1109\/ICIP.2007.4379785"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1109\/TCSVT.2008.2005599","article-title":"Trajectory-Based Anomalous Event Detection","volume":"18","author":"Piciarelli","year":"2008","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_26","first-page":"21","article-title":"Geometric information from single uncalibrated images of roads","volume":"34","author":"Grammatikopoulos","year":"2002","journal-title":"Int. Arch. Photogr. Remote Sens. Spat. Inform. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.isprsjprs.2007.02.002","article-title":"An automatic approach for camera calibration from vanishing points","volume":"62","author":"Grammatikopoulos","year":"2007","journal-title":"ISPRS Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4805","DOI":"10.3390\/s100504805","article-title":"Real time speed estimation of moving vehicles from side view images from an uncalibrated video camera","volume":"10","author":"Temiz","year":"2010","journal-title":"Sensors"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/TPAMI.2003.1217599","article-title":"Complete solution classification for the perspective-three-point problem","volume":"25","author":"Gao","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1109\/TSMC.2015.2497235","article-title":"Animal-Vehicle Collision Mitigation System for Automated Vehicles","volume":"46","author":"Mammeri","year":"2016","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.procs.2017.08.185","article-title":"Object Detection Method in Traffic by On-Board Computer Vision with Time Delay Neural Network","volume":"112","author":"Varagula","year":"2017","journal-title":"Procedia Comput. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Galvao, L.G., Abbod, M., Kalganova, T., Palade, V., and Huda, M.N. (2021). Pedestrian and Vehicle Detection in Autonomous Vehicle Perception Systems\u2014A Review. Sensors, 21.","DOI":"10.3390\/s21217267"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zivkovic, Z. (2004, January 23\u201326). Improved adaptive Gaussian mixture model for background subtraction. Proceedings of the 17th International Conference on Pattern Recognition (ICPR 2004), Cambridge, UK.","DOI":"10.1109\/ICPR.2004.1333992"},{"key":"ref_34","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Bodla, N., Singh, B., Chellappa, R., and Davis, L.S. (2017, January 22\u201329). Soft-NMS\u2013improving object detection with one line of code. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV 2017), Venice, Italy.","DOI":"10.1109\/ICCV.2017.593"},{"key":"ref_36","unstructured":"Jocher, G., Chaurasia, A., Stoken, A., Borovec, J., NanoCode012, Kwon, Y., Michael, K., Fang, J., and imyhxy (YOLOv5 by Ultralytics, 2020). YOLOv5 by Ultralytics, Version 7.0."},{"key":"ref_37","unstructured":"Jocher, G., Chaurasia, A., and Qiu, J. (2023). Ultralytics YOLOv8, Zenodo."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Doll\u00e1r, P. (2014, January 6\u201312). Microsoft COCO: Common Objects in Context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_39","unstructured":"Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrell, T. (2018). BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Chan, F.H., Chen, Y.T., Xiang, Y., and Sun, M. (2016, January 20\u201324). Anticipating Accidents in Dashcam Videos. Proceedings of the 13th Asian Conference on Computer Vision (ACCV 2016), Taipei, Taiwan.","DOI":"10.1007\/978-3-319-54190-7_9"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Shah, A.P., Lamare, J.B., Nguyen-Anh, T., and Hauptmann, A. (2018, January 27\u201330). CADP: A Novel Dataset for CCTV Traffic Camera based Accident Analysis. Proceedings of the 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Auckland, New Zealand.","DOI":"10.1109\/AVSS.2018.8639160"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Fang, J., Yan, D., Qiao, J., Xue, J., Wang, H., and Li, S. (2019, January 27\u201330). DADA-2000: Can Driving Accident be Predicted by Driver Attention? Analyzed by A Benchmark. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917218"},{"key":"ref_43","unstructured":"Snyder, C., and Do, M. (2019). Data for STREETS: A Novel Camera Network Dataset for Traffic Flow, University of Illinois at Urbana-Champaign."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Stepanyants, V., Andzhusheva, M., and Romanov, A. (2023, January 27\u201331). A Pipeline for Traffic Accident Dataset Development. Proceedings of the 2023 International Russian Smart Industry Conference (SmartIndustryCon), Sochi, Russia.","DOI":"10.1109\/SmartIndustryCon57312.2023.10110794"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/1015706.1015720","article-title":"\u201cGrabCut\u201d Interactive foreground extraction using iterated graph cuts","volume":"23","author":"Rother","year":"2004","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kumar, A., Khorramshahi, P., Lin, W.A., Dhar, P., Chen, J.C., and Chellappa, R. (2018, January 18\u201322). A semi-automatic 2D solution for vehicle speed estimation from monocular videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00026"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/10867651.2004.10487596","article-title":"An image inpainting technique based on the fast marching method","volume":"9","author":"Telea","year":"2004","journal-title":"J. Graph. Tools"},{"key":"ref_49","unstructured":"Milan, A., Leal-Taix\u00e9, L., Reid, I., Roth, S., and Schindler, K. (2016). MOT16: A Benchmark for Multi-Object Tracking. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The pascal visual object classes (voc) challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/6\/1822\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:12:29Z","timestamp":1760105549000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/6\/1822"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":50,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["s24061822"],"URL":"https:\/\/doi.org\/10.3390\/s24061822","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,12]]}}}