{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T22:37:07Z","timestamp":1773787027276,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T00:00:00Z","timestamp":1721174400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education (MOE)","award":["2023RIS-009"],"award-info":[{"award-number":["2023RIS-009"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Understanding road conditions is essential for implementing effective road safety measures and driving solutions. Road situations encompass the day-to-day conditions of roads, including the presence of vehicles and pedestrians. Surveillance cameras strategically placed along streets have been instrumental in monitoring road situations and providing valuable information on pedestrians, moving vehicles, and objects within road environments. However, these video data and information are stored in large volumes, making analysis tedious and time-consuming. Deep learning models are increasingly utilized to monitor vehicles and identify and evaluate road and driving comfort situations. However, the current neural network model requires the recognition of situations using time-series video data. In this paper, we introduced a multi-directional detection model for road situations to uphold high accuracy. Deep learning methods often integrate long short-term memory (LSTM) into long-term recurrent network architectures. This approach effectively combines recurrent neural networks to capture temporal dependencies and convolutional neural networks (CNNs) to extract features from extensive video data. In our proposed method, we form a multi-directional long-term recurrent convolutional network approach with two groups equipped with CNN and two layers of LSTM. Additionally, we compare road situation recognition using convolutional neural networks, long short-term networks, and long-term recurrent convolutional networks. The paper presents a method for detecting and recognizing multi-directional road contexts using a modified LRCN. After balancing the dataset through data augmentation, the number of video files increased, resulting in our model achieving 91% accuracy, a significant improvement from the original dataset.<\/jats:p>","DOI":"10.3390\/s24144618","type":"journal-article","created":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T15:15:19Z","timestamp":1721229319000},"page":"4618","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Multi-Directional Long-Term Recurrent Convolutional Network for Road Situation Recognition"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-3523-0770","authenticated-orcid":false,"suffix":"Jr.","given":"Cyreneo","family":"Dofitas","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, Jeju National University, Jeju 63243, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6774-8476","authenticated-orcid":false,"given":"Joon-Min","family":"Gil","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Jeju National University, Jeju 63243, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1107-9941","authenticated-orcid":false,"given":"Yung-Cheol","family":"Byun","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Major of Electronic Engineering, Institute of Information Science & Technology, Jeju National University, Jeju 63243, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Socha, R., and Kogut, B. (2020). Urban video surveillance as a tool to improve security in public spaces. Sustainability, 12.","DOI":"10.3390\/su12156210"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"100666","DOI":"10.1016\/j.uclim.2020.100666","article-title":"The making of a climate emergency response: Examining the attributes of climate emergency plans","volume":"33","author":"Davidson","year":"2020","journal-title":"Urban Clim."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.iatssr.2022.01.004","article-title":"A multi-country survey for collecting and analyzing facts related to road traffic safety: Legislation, enforcement, and education for safer drivers","volume":"46","author":"Toriumi","year":"2022","journal-title":"IATSS Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/PL00013275","article-title":"A model-driven approach for real-time road recognition","volume":"13","author":"Aufrere","year":"2001","journal-title":"Mach. Vis. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1109\/OJITS.2023.3237480","article-title":"Detection of road condition defects using multiple sensors and IoT technology: A review","volume":"4","author":"Alrajhi","year":"2023","journal-title":"IEEE Open J. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hasanujjaman, M., Chowdhury, M.Z., and Jang, Y.M. (2023). Sensor fusion in autonomous vehicle with traffic surveillance camera system: Detection, localization, and AI networking. Sensors, 23.","DOI":"10.3390\/s23063335"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Micko, K., Papcun, P., and Zolotova, I. (2023). Review of IoT sensor systems used for monitoring the road infrastructure. Sensors, 23.","DOI":"10.3390\/s23094469"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"105949","DOI":"10.1016\/j.ssci.2022.105949","article-title":"Data-driven approaches for road safety: A comprehensive systematic literature review","volume":"158","author":"Sohail","year":"2023","journal-title":"Saf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"103116","DOI":"10.1016\/j.jvcir.2021.103116","article-title":"A review of video surveillance systems","volume":"77","author":"Elharrouss","year":"2021","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_10","first-page":"1","article-title":"Decision Making for Advanced Driver Assistance Systems for Public Transport","volume":"Volume 5","author":"Wassouf","year":"2023","journal-title":"Proceedings of the 2023 5th International Youth Conference on Radio Electronics, Electrical and Power Engineering (REEPE)"},{"key":"ref_11","unstructured":"Estable, S., Schick, J., Stein, F., Janssen, R., Ott, R., Ritter, W., and Zheng, Y.J. (1994, January 24\u201326). A real-time traffic sign recognition system. Proceedings of the Intelligent Vehicles\u2019 94 Symposium, Paris, France."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"159406","DOI":"10.1016\/j.scitotenv.2022.159406","article-title":"Effects of noise on pedestrians in urban environments where road traffic is the main source of sound","volume":"857","author":"Morillas","year":"2023","journal-title":"Sci. Total. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104791","DOI":"10.1016\/j.micpro.2023.104791","article-title":"An efficient implementation of traffic signs recognition system using CNN","volume":"98","author":"Fredj","year":"2023","journal-title":"Microprocess. Microsyst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1007\/s11554-011-0232-7","article-title":"Real-time automatic license plate recognition for CCTV forensic applications","volume":"8","author":"Sarfraz","year":"2013","journal-title":"J. Real-Time Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1007\/s10844-020-00618-5","article-title":"System for monitoring road slippery based on CCTV cameras and convolutional neural networks","volume":"55","author":"Grabowski","year":"2020","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sirirattanapol, C., Nagai, M., Witayangkurn, A., Pravinvongvuth, S., and Ekpanyapong, M. (2019). Bangkok CCTV image through a road environment extraction system using multi-label convolutional neural network classification. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8030128"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4523","DOI":"10.1109\/JSYST.2019.2960193","article-title":"System integration of sensor-fusion localization tasks using vision-based driving lane detection and road-marker recognition","volume":"14","author":"Lin","year":"2020","journal-title":"IEEE Syst. J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MIS.2019.2942836","article-title":"Research on road traffic situation awareness system based on image big data","volume":"35","author":"Zhu","year":"2019","journal-title":"IEEE Intell. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/S0262-8856(99)00033-5","article-title":"Road recognition in urban environment","volume":"18","author":"Paetzold","year":"2000","journal-title":"Image Vis. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1109\/JRFID.2022.3211262","article-title":"Real-time traffic and road surveillance with parallel edge intelligence","volume":"6","author":"Ke","year":"2022","journal-title":"IEEE J. Radio Freq. Identif."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.cviu.2004.02.007","article-title":"An automatic road sign recognition system based on a computational model of human recognition processing","volume":"96","author":"Fang","year":"2004","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"114","DOI":"10.5391\/IJFIS.2020.20.2.114","article-title":"CNN-based recognition algorithm for four classes of roads","volume":"20","author":"Cho","year":"2020","journal-title":"Int. J. Fuzzy Log. Intell. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3043","DOI":"10.1007\/s13369-018-3390-0","article-title":"Data-driven short-term forecasting for urban road network traffic based on data processing and LSTM-RNN","volume":"44","author":"Xiangxue","year":"2019","journal-title":"Arab. J. Sci. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5517","DOI":"10.1007\/s11042-020-09971-7","article-title":"LRCN-RetailNet: A recurrent neural network architecture for accurate people counting","volume":"80","author":"Massa","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ma, Y., Wei, Y., Shi, Y., Li, X., Tian, Y., and Zhao, Z. (2022). Online learning engagement recognition using bidirectional Long-Term recurrent convolutional networks. Sustainability, 15.","DOI":"10.3390\/su15010198"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yang, W., Zhang, X., Lei, Q., Shen, D., Xiao, P., and Huang, Y. (2020). Lane position detection based on long short-term memory (LSTM). Sensors, 20.","DOI":"10.3390\/s20113115"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sinulingga, H.R., and Munir, R. (2020, January 8\u20139). Road recognition system with heuristic method and machine learning. Proceedings of the 2020 7th International Conference on Advance Informatics: Concepts, Theory and Applications (ICAICTA), Online.","DOI":"10.1109\/ICAICTA49861.2020.9429073"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"103935","DOI":"10.1016\/j.autcon.2021.103935","article-title":"Deep learning-based road damage detection and classification for multiple countries","volume":"132","author":"Arya","year":"2021","journal-title":"Autom. Constr."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3325282","DOI":"10.1155\/2022\/3325282","article-title":"An Automatic Architecture Designing Approach of Convolutional Neural Networks for Road Surface Conditions Image Recognition: Tradeoff between Accuracy and Efficiency","volume":"2022","author":"Wu","year":"2022","journal-title":"J. Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Luo, H., Li, C., Wu, M., and Cai, L. (2023). An Enhanced Lightweight Network for Road Damage Detection Based on Deep Learning. Electronics, 12.","DOI":"10.3390\/electronics12122583"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Park, J., Wen, M., Sung, Y., and Cho, K. (2019). Multiple event-based simulation scenario generation approach for autonomous vehicle smart sensors and devices. Sensors, 19.","DOI":"10.3390\/s19204456"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1584","DOI":"10.1109\/TITS.2019.2913166","article-title":"Naturalistic driver intention and path prediction using recurrent neural networks","volume":"21","author":"Zyner","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"115400","DOI":"10.1016\/j.eswa.2021.115400","article-title":"Car crash detection using ensemble deep learning and multimodal data from dashboard cameras","volume":"183","author":"Choi","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"108350","DOI":"10.1016\/j.engappai.2024.108350","article-title":"Enhancing smart road safety with federated learning for Near Crash Detection to advance the development of the Internet of Vehicles","volume":"133","author":"Djenouri","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"100258","DOI":"10.1016\/j.array.2022.100258","article-title":"Data augmentation: A comprehensive survey of modern approaches","volume":"16","author":"Mumuni","year":"2022","journal-title":"Array"},{"key":"ref_36","first-page":"979","article-title":"Differential data augmentation techniques for medical imaging classification tasks","volume":"Volume 2017","author":"Hussain","year":"2017","journal-title":"Proceedings of the AMIA Annual Symposium Proceedings"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4618\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:18:04Z","timestamp":1760109484000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/14\/4618"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,17]]},"references-count":36,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24144618"],"URL":"https:\/\/doi.org\/10.3390\/s24144618","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,17]]}}}