{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T19:27:10Z","timestamp":1778527630438,"version":"3.51.4"},"reference-count":40,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T00:00:00Z","timestamp":1673222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The major challenge faced by autonomous vehicles today is driving through busy roads without getting into an accident, especially with a pedestrian. To avoid collision with pedestrians, the vehicle requires the ability to communicate with a pedestrian to understand their actions. The most challenging task in research on computer vision is to detect pedestrian activities, especially at nighttime. The Advanced Driver-Assistance Systems (ADAS) has been developed for driving and parking support for vehicles to visualize sense, send and receive information from the environment but it lacks to detect nighttime pedestrian actions. This article proposes a framework based on Deep Reinforcement Learning (DRL) using Scale Invariant Faster Region-based Convolutional Neural Networks (SIFRCNN) technologies to efficiently detect pedestrian operations through which the vehicle, as agents train themselves from the environment and are forced to maximize the reward. The SIFRCNN has reduced the running time of detecting pedestrian operations from road images by incorporating Region Proposal Network (RPN) computation. Furthermore, we have used Reinforcement Learning (RL) for optimizing the Q-values and training itself to maximize the reward after getting the state from the SIFRCNN. In addition, the latest incarnation of SIFRCNN achieves near-real-time object detection from road images. The proposed SIFRCNN has been tested on KAIST, City Person, and Caltech datasets. The experimental results show an average improvement of 2.3% miss rate of pedestrian detection at nighttime compared to the other CNN-based pedestrian detectors.<\/jats:p>","DOI":"10.3390\/e25010135","type":"journal-article","created":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T01:30:47Z","timestamp":1673314247000},"page":"135","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["A Conceptual Multi-Layer Framework for the Detection of Nighttime Pedestrian in Autonomous Vehicles Using Deep Reinforcement Learning"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4095-8868","authenticated-orcid":false,"given":"Muhammad Shoaib","family":"Farooq","sequence":"first","affiliation":[{"name":"Department of Computer Science, School of Systems and Technology, University of Management and Technology, Lahore 54000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haris","family":"Khalid","sequence":"additional","affiliation":[{"name":"Department of Computer Science, School of Systems and Technology, University of Management and Technology, Lahore 54000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7116-4545","authenticated-orcid":false,"given":"Ansif","family":"Arooj","sequence":"additional","affiliation":[{"name":"Department of Information Sciences, Division of Science and Technology, University of Education, Lahore 54000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3333-8142","authenticated-orcid":false,"given":"Tariq","family":"Umer","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Lahore Campus, COMSATS University Islamabad, Lahore 54000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9708-257X","authenticated-orcid":false,"given":"Aamer Bilal","family":"Asghar","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, COMSATS University Islamabad, Lahore 54000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3761-1641","authenticated-orcid":false,"given":"Jawad","family":"Rasheed","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Nisantasi University, Istanbul 34398, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2586-9963","authenticated-orcid":false,"given":"Raed M.","family":"Shubair","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, New York University (NYU), Abu Dhabi 129188, United Arab Emirates"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0603-6592","authenticated-orcid":false,"given":"Amani","family":"Yahyaoui","sequence":"additional","affiliation":[{"name":"Department of Software Engineering, Istanbul Sabahattin Zaim University, Istanbul 34303, Turkey"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MCE.2018.2828440","article-title":"Advanced Driver-Assistance Systems: A Path Toward Autonomous Vehicles","volume":"7","author":"Kukkala","year":"2018","journal-title":"IEEE Consum. Electron. Mag."},{"key":"ref_2","first-page":"100138","article-title":"Detecting, analyzing, and modeling failed lane-changing attempts in traditional and connected environments","volume":"28","author":"Ali","year":"2020","journal-title":"Anal. Methods Accid. Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Aranjuelo, N., Unzueta, L., Arganda-Carreras, I., and Otaegui, O. (2018, January 12\u201313). Multimodal deep learning for advanced driving systems. Proceedings of the 10th International Conference on Articulated Motion and Deformable Objects (AMDO 2018), Palma de Mallorca, Spain.","DOI":"10.1007\/978-3-319-94544-6_10"},{"key":"ref_4","unstructured":"Arm (2021, February 28). Accelerating Autonomous Vehicle Technology. Available online: https:\/\/spectrum.ieee.org\/transportation\/self-driving\/accelerating-autonomous-vehicle-technology."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3782","DOI":"10.1109\/TITS.2019.2892405","article-title":"A survey on 3D object detection methods for autonomous driving applications","volume":"20","author":"Arnold","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Milakis, D., and van Wee, B. (2020). Implications of vehicle automation for accessibility and social inclusion of people on low income, people with physical and sensory disabilities, and older people. Demand for Emerging Transportation Systems: Modeling Adoption, Satisfaction, and Mobility Patterns, Elsevier.","DOI":"10.1016\/B978-0-12-815018-4.00004-8"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cui, G., Wang, S., Wang, Y., Liu, Z., Yuan, Y., and Wang, Q. (2019). Preceding Vehicle Detection Using Faster R-CNN Based on Speed Classification Random Anchor and Q-Square Penalty Coefficient. Electronics, 8.","DOI":"10.3390\/electronics8091024"},{"key":"ref_8","first-page":"309","article-title":"Introducing advanced driver assistance systems: Some legal issues","volume":"1","year":"2019","journal-title":"Eur. J. Transp. Infrastruct. Res."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jarunakarint, V., Uttama, S., and Rueangsirarak, W. (2020, January 21\u201322). Survey and Experimental Comparison of Machine Learning Models for Motorcycle Detection. Proceedings of the 5th International Conference on Information Technology (InCIT), Chonburi, Thailand.","DOI":"10.1109\/InCIT50588.2020.9310954"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.biosystemseng.2020.12.002","article-title":"Detection of maturity stages of coconuts in the complex background using Faster R-CNN model","volume":"202","author":"Parvathi","year":"2021","journal-title":"Biosyst. Eng."},{"key":"ref_11","first-page":"1","article-title":"Updating our understanding of situation awareness in relation to remote operators of autonomous vehicles","volume":"6","author":"Mutzenich","year":"2021","journal-title":"Cogn. Res. Princ. Implic."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"012016","DOI":"10.1088\/1757-899X\/819\/1\/012016","article-title":"System of Requirements and Testing Procedures for Autonomous Driving Technologies","volume":"Volume 819","author":"Ivanov","year":"2020","journal-title":"IOP Conference Series: Materials Science and Engineering"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lyu, N., Duan, Z., Xie, L., and Wu, C. (2017, January 8\u201310). Driving experience on the effectiveness of advanced driving assistant systems. Proceedings of the 2017 4th International Conference on Transportation Information and Safety (ICTIS), Banff, AB, Canada.","DOI":"10.1109\/ICTIS.2017.8047889"},{"key":"ref_14","unstructured":"Synopsys (2022, November 03). What is an Autonomous Car?\u2014How Self-Driving Cars Work. Available online: https:\/\/www.synopsys.com\/automotive\/what-is-autonomous-car.html."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Brazil, G., Yin, X., and Liu, X. (2017, January 22\u201329). Illuminating pedestrians via simultaneous detection & segmentation. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.530"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with regional proposed networks","volume":"39","author":"Ren","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"075050","DOI":"10.1088\/1757-899X\/768\/7\/072050","article-title":"Application of Railway Passenger Flow Statistics Based on Mask R-CNN","volume":"Volume 768","author":"Meng","year":"2020","journal-title":"IOP Conference Series: Materials Science and Engineering"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.aap.2020.105692","article-title":"The adaptability and challenges of an autonomous vehicle to pedestrians in urban China","volume":"145","author":"Wang","year":"2020","journal-title":"Accid. Anal. Prev."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.neucom.2019.11.051","article-title":"Adversarial attacks on Faster R-CNN object detector","volume":"382","author":"Wang","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yao, Y., Xu, M., Choi, C., Crandall, D.J., Atkins, E.M., and Dariush, B. (2019, January 20\u201324). Egocentric vision-based future vehicle localization for intelligent driving assistance systems. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794474"},{"key":"ref_21","unstructured":"Xu, Y., Xiao, T., Zhang, J., Yang, K., and Zhang, Z. (2014). Scale-invariant convolutional neural networks. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"283","DOI":"10.3103\/S1060992X19040118","article-title":"Object Detection with Deep Neural Networks for Reinforcement Learning in the Task of Autonomous Vehicle Path Planning at the Intersection","volume":"28","author":"Yudin","year":"2019","journal-title":"Opt. Mem. Neural Netw."},{"key":"ref_23","unstructured":"Li, F.-F., Andreeto, M., Ranzato, M., and Perona, P. (2022). Caltech 101, version 1.0, Caltech Library. CaltechDATA."},{"key":"ref_24","unstructured":"(2022, November 07). Papers with Code\u2014Caltech Pedestrian Dataset. Available online: https:\/\/paperswithcode.com\/dataset\/caltech-pedestrian-dataset."},{"key":"ref_25","unstructured":"Kiran, B.R., Sobh, I., Talpaert, V., Mannion, P., Sallab AA, A., Yogamani, S., and P\u00e9rez, P. (2020). Deep reinforcement learning for autonomous driving: A survey. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1729881419829651","article-title":"Pedestrian and cyclist detection based on deep neural network fast R-CNN","volume":"16","author":"Wang","year":"2019","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"33609","DOI":"10.1109\/ACCESS.2020.2973461","article-title":"Cyber-Physical and Social Networks in IoV (CPSN-IoV): A Multimodal Architecture in Edge-Based Networks for Optimal Route Selection Using 5G Technologies","volume":"8","author":"Arooj","year":"2020","journal-title":"IEEE Access"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tehseen, R., Farooq, M.S., and Abid, A. (2020). Earthquake prediction using expert systems: A systematic mapping study. Sustainability, 12.","DOI":"10.3390\/su12062420"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"875879","DOI":"10.1155\/2014\/875879","article-title":"An efficient algorithm for recognition of human actions","volume":"2014","author":"Khan","year":"2014","journal-title":"Sci. World J."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, S., Benenson, R., and Schiele, B. (2017). CityPersons: A Diverse Dataset for Pedestrian Detection. arXiv.","DOI":"10.1109\/CVPR.2017.474"},{"key":"ref_31","unstructured":"(2022, November 07). Papers with Code\u2014CityPersons Dataset. Available online: https:\/\/paperswithcode.com\/dataset\/citypersons."},{"key":"ref_32","unstructured":"(2022, November 07). Papers with Code\u2014KAIST Multispectral Pedestrian Detection Benchmark Dataset. Available online: https:\/\/paperswithcode.com\/dataset\/kaist-multispectral-pedestrian-detection."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"10357","DOI":"10.1109\/ACCESS.2021.3050338","article-title":"Collision avoidance in pedestrian-rich environments with deep reinforcement learning","volume":"9","author":"Everett","year":"2021","journal-title":"IEEE Access"},{"key":"ref_34","first-page":"985","article-title":"Scale-aware fast R-CNN for pedestrian detection","volume":"20","author":"Li","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hwang, S., Park, J., Kim, N., Choi, Y., and So Kweon, I. (2015, January 7\u201312). Multispectral pedestrian detection: Benchmark dataset and baseline. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298706"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5086","DOI":"10.1109\/TITS.2019.2948398","article-title":"Fast pedestrian detection with attention-enhanced multi-scale RPN and soft-cascaded decision trees","volume":"21","author":"Wang","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Moten, S., Celiberti, F., Grottoli, M., van der Heide, A., and Lemmens, Y. (2018, January 26\u201330). X-in-the-loop advanced driving simulation platform for the design, development, testing and validation of ADAS. Proceedings of the 2018 IEEE Intelligent Vehicle Symposium (IV), Changshu, China.","DOI":"10.1109\/IVS.2018.8500409"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sz\u0151ke, L., Aradi, S., B\u00e9csi, T., and G\u00e1sp\u00e1r, P. (2020, January 8\u201310). Driving on Highway by Using Reinforcement Learning with CNN and LSTM Networks. Proceedings of the 2020 IEEE 24th International Conference on Intelligent Engineering Systems (INES), Reykjavik, Iceland.","DOI":"10.1109\/INES49302.2020.9147185"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"32400","DOI":"10.1109\/ACCESS.2019.2901300","article-title":"Multi-agent deep reinforcement learning for the multi-object tracker","volume":"7","author":"Jiang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Liu, Y., Su, H., Zeng, C., and Li, X. (2021). A robust thermal infrared vehicle and pedestrian detection method in complex scenes. Sensors, 21.","DOI":"10.3390\/s21041240"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/1\/135\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:04:48Z","timestamp":1760119488000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/1\/135"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,9]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["e25010135"],"URL":"https:\/\/doi.org\/10.3390\/e25010135","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,9]]}}}