{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,11]],"date-time":"2026-01-11T14:44:15Z","timestamp":1768142655613,"version":"3.49.0"},"reference-count":60,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2023,8,12]],"date-time":"2023-08-12T00:00:00Z","timestamp":1691798400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Bus driver distraction and cognitive load lead to higher accident risk. Driver distraction sources and complex physical and psychological effects must be recognized and analyzed in real-world driving conditions to reduce risk and enhance overall road safety. The implementation of a camera-based system utilizing computer vision for face recognition emerges as a highly viable and effective driver monitoring approach applicable in public transport. Reliable, accurate, and unnoticeable software solutions need to be developed to reach the appropriate robustness of the system. The reliability of data recording depends mainly on external factors, such as vibration, camera lens contamination, lighting conditions, and other optical performance degradations. The current study introduces Capsule Networks (CapsNets) for image processing and face detection tasks. The authors\u2019 goal is to create a fast and accurate system compared to state-of-the-art Neural Network (NN) algorithms. Based on the seven tests completed, the authors\u2019 solution outperformed the other networks in terms of performance degradation in six out of seven cases. The results show that the applied capsule-based solution performs well, and the degradation in efficiency is noticeably smaller than for the presented convolutional neural networks when adversarial attack methods are used. From an application standpoint, ensuring the security and effectiveness of an image-based driver monitoring system relies heavily on the mitigation of disruptive occurrences, commonly referred to as \u201cimage distractions,\u201d which represent attacks on the neural network.<\/jats:p>","DOI":"10.3390\/computers12080161","type":"journal-article","created":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T10:20:14Z","timestamp":1692008414000},"page":"161","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Face Detection Using a Capsule Network for Driver Monitoring Application"],"prefix":"10.3390","volume":"12","author":[{"given":"J\u00e1nos","family":"Holl\u00f3si","sequence":"first","affiliation":[{"name":"Central Campus Gy\u0151r, Sz\u00e9chenyi Istv\u00e1n University, 9026 Gy\u0151r, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u00c1ron","family":"Ballagi","sequence":"additional","affiliation":[{"name":"Central Campus Gy\u0151r, Sz\u00e9chenyi Istv\u00e1n University, 9026 Gy\u0151r, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0166-6261","authenticated-orcid":false,"given":"G\u00e1bor","family":"Kov\u00e1cs","sequence":"additional","affiliation":[{"name":"Central Campus Gy\u0151r, Sz\u00e9chenyi Istv\u00e1n University, 9026 Gy\u0151r, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7298-9960","authenticated-orcid":false,"given":"Szabolcs","family":"Fischer","sequence":"additional","affiliation":[{"name":"Central Campus Gy\u0151r, Sz\u00e9chenyi Istv\u00e1n University, 9026 Gy\u0151r, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Viktor","family":"Nagy","sequence":"additional","affiliation":[{"name":"Central Campus Gy\u0151r, Sz\u00e9chenyi Istv\u00e1n University, 9026 Gy\u0151r, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Blades, L., Douglas, R., Early, J., Lo, C.Y., and Best, R. (2020). Advanced Driver-Assistance Systems for City Bus Applications, Sage. SAE Technical Papers.","DOI":"10.4271\/2020-01-1208"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1177\/0361198119847975","article-title":"Impacts on Driver Perceptions in Initial Exposure to ADAS Technologies","volume":"2673","author":"Nylen","year":"2019","journal-title":"Transp. Res. Rec."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1177\/03611981211004129","article-title":"Systematic Review of Research on Driver Distraction in the Context of Advanced Driver Assistance Systems","volume":"Volume 2675","author":"Hungund","year":"2021","journal-title":"Transportation Research Record"},{"key":"ref_4","unstructured":"Slootmans, F. (2021). European Road Safety Observatory\u2014Facts and Figures\u2014Light Trucks, European Commission."},{"key":"ref_5","unstructured":"Eurostat (2023, March 30). Passenger Transport by Buses and Coaches by Type of\u2014Vehicles Registered in the Reporting Country. Available online: https:\/\/ec.europa.eu\/eurostat\/databrowser\/view\/ROAD_PA_BUSCOA__custom_1210091\/bookmark\/table?lang=en&bookmarkId=d8cf5c80-4d26-4dfd-bda5-e94de54b8d49."},{"key":"ref_6","first-page":"177","article-title":"Impact of the Number of Vehicles on Traffic Safety: Multiphase Modeling","volume":"20","author":"Tanackov","year":"2022","journal-title":"Facta Univ. Ser. Mech. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.aap.2013.12.022","article-title":"Factors Affecting the Probability of Bus Drivers Being At-Fault in Bus-Involved Accidents","volume":"66","author":"Goh","year":"2014","journal-title":"Accid. Anal. Prev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.trf.2018.10.003","article-title":"Using Real-Life Alert-Based Data to Analyse Drowsiness and Distraction of Commercial Drivers","volume":"60","author":"Ferreira","year":"2019","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_9","unstructured":"Young, K., Regan, M., and Hammer, M. (2003). Driver Distraction: A Review of the Literature (Report), Monash University Accident Research Centre."},{"key":"ref_10","unstructured":"National Highway Traffic Safety Administration (2021). Distracted Driving, National Highway Traffic Safety Administration (NHTSA)."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1016\/j.aap.2005.04.011","article-title":"Sleepiness in Professional Drivers: Effect of Age and Time of Day","volume":"37","author":"Otmani","year":"2005","journal-title":"Accid. Anal. Prev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.sleep.2021.02.023","article-title":"Prevalence of Sleep Apnea and Daytime Sleepiness in Professional Truck Drivers","volume":"81","author":"Huhta","year":"2021","journal-title":"Sleep Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103296","DOI":"10.1016\/j.amsu.2022.103296","article-title":"Risk of Obstructive Sleep Apnea and Traffic Accidents among Male Bus Drivers in Ecuador: Is There a Significant Relationship?","volume":"74","author":"Felix","year":"2022","journal-title":"Ann. Med. Surg."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0001-4575(02)00014-3","article-title":"Monotony of Road Environment and Driver Fatigue: A Simulator Study","volume":"35","author":"Thiffault","year":"2003","journal-title":"Accid. Anal. Prev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"16937","DOI":"10.3390\/s121216937","article-title":"Detecting Driver Drowsiness Based on Sensors: A Review","volume":"12","author":"Sahayadhas","year":"2012","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hallac, D., Sharang, A., Stahlmann, R., Lamprecht, A., Huber, M., Roehder, M., Sosi\u010d, R., and Leskovec, J. (2016, January 1\u20134). Driver Identification Using Automobile Sensor Data from a Single Turn. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795670"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Tang, Y., Zhao, S., and Zhang, X. (2019, January 6\u20138). Real-Time Surface EMG Pattern Recognition for Hand Gestures Based on Support Vector Machine. Proceedings of the IEEE International Conference on Robotics and Biomimetics, ROBIO, Dali, China.","DOI":"10.1109\/ROBIO49542.2019.8961436"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Campos-Ferreira, A.E., Lozoya-Santos, J.d.J., Tudon-Martinez, J.C., Mendoza, R.A.R., Vargas-Mart\u00ednez, A., Morales-Menendez, R., and Lozano, D. (2023). Vehicle and Driver Monitoring System Using On-Board and Remote Sensors. Sensors, 23.","DOI":"10.3390\/s23020814"},{"key":"ref_19","first-page":"81","article-title":"Detection Process Of Energy Loss In Electric Railway Vehicles","volume":"21","author":"Fischer","year":"2023","journal-title":"Facta Univ. Ser. Mech. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.trf.2017.11.020","article-title":"Behaviours of Drivers in Serbia: Non-Professional versus Professional Drivers","volume":"52","author":"Lipovac","year":"2018","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1016\/j.trpro.2020.02.095","article-title":"An Experimental Analysis on Driving Behaviour for Professional Bus Drivers","volume":"45","author":"Fancello","year":"2020","journal-title":"Transp. Res. Procedia"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.iatssr.2022.07.003","article-title":"Impact of Driving Style, Behaviour and Anger on Crash Involvement among Iranian Intercity Bus Drivers","volume":"46","author":"Karimi","year":"2022","journal-title":"IATSS Res."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bonfati, L.V., Mendes Junior, J.J.A., Siqueira, H.V., and Stevan, S.L. (2023). Correlation Analysis of In-Vehicle Sensors Data and Driver Signals in Identifying Driving and Driver Behaviors. Sensors, 23.","DOI":"10.2139\/ssrn.4183382"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"103867","DOI":"10.1016\/j.apergo.2022.103867","article-title":"Distracted Worker: Using Pupil Size and Blink Rate to Detect Cognitive Load during Manufacturing Tasks","volume":"106","author":"Biondi","year":"2023","journal-title":"Appl. Ergon."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1080\/0014013031000090116","article-title":"Visual Attention While Driving: Sequences of Eye Fixations Made by Experienced and Novice Drivers","volume":"46","author":"Underwood","year":"2003","journal-title":"Ergonomics"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/S1369-8478(02)00008-6","article-title":"Visual Search While Driving: Skill and Awareness during Inspection of the Scene","volume":"5","author":"Underwood","year":"2002","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Nagy, V., Kov\u00e1cs, G., F\u00f6ldesi, P., Kurhan, D., Sysyn, M., Szalai, S., and Fischer, S. (2023). Testing Road Vehicle User Interfaces Concerning the Driver\u2019s Cognitive Load. Infrastructures, 8.","DOI":"10.3390\/infrastructures8030049"},{"key":"ref_28","unstructured":"Shi, Y., Xu, Y., Ferraioli, A., Piga, B., Mussone, L., and Caruso, G. (2020, January 8\u201311). A Method of Processing Eye-Tracking Data to Study Driver\u2019s Visual Perception in Simulated Driving Scenarios. Proceedings of the European Transport Conference, Online."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Reilly, J., Zuckerman, B., and Kelly, A.E. (2021). A Primer on Design and Data Analysis for Cognitive Pupillometry. Mod. Pupillometry, 9\u201325.","DOI":"10.31234\/osf.io\/j6sdt"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"73","DOI":"10.14257\/ijast.2014.64.07","article-title":"A Review on Driver Face Monitoring Systems for Fatigue and Distraction Detection","volume":"64","author":"Sigari","year":"2014","journal-title":"Int. J. Adv. Sci. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1504\/IJHFE.2016.083521","article-title":"Average Heart Rate for Driver Monitoring Systems","volume":"4","author":"Biondi","year":"2016","journal-title":"Int. J. Hum. Factors Ergon."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1769","DOI":"10.1109\/TBME.2018.2879346","article-title":"Heart Rate Variability-Based Driver Drowsiness Detection and Its Validation with EEG","volume":"66","author":"Fujiwara","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Dehzangi, O., Rajendra, V., and Taherisadr, M. (2018). Wearable Driver Distraction Identification On-the-Road via Continuous Decomposition of Galvanic Skin Responses. Sensors, 18.","DOI":"10.3390\/s18020503"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"20873","DOI":"10.3390\/s150820873","article-title":"A Context-Aware EEG Headset System for Early Detection of Driver Drowsiness","volume":"15","author":"Li","year":"2015","journal-title":"Sensors"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1007\/s13246-021-01020-3","article-title":"Development of Single-Channel Electroencephalography Signal Analysis Model for Real-Time Drowsiness Detection: SEEGDD","volume":"44","author":"Balam","year":"2021","journal-title":"Phys. Eng. Sci. Med."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Rahman, N.A.A., Mustafa, M., Sulaiman, N., Samad, R., and Abdullah, N.R.H. (2022). EMG Signal Segmentation to Predict Driver\u2019s Vigilance State: Notes in Mechanical Engineering, Springer.","DOI":"10.1007\/978-981-16-4115-2_3"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"100363","DOI":"10.1016\/j.imu.2020.100363","article-title":"A Review of Recent Approaches for Emotion Classification Using Electrocardiography and Electrodermography Signals","volume":"20","author":"Bulagang","year":"2020","journal-title":"Inform. Med. Unlocked"},{"key":"#cr-split#-ref_38.1","unstructured":"(2019). European Parliament Regulation"},{"key":"#cr-split#-ref_38.2","unstructured":"(EU) 2019\/2144 of the European Parliament and of the Council. Off. J. Eur. Union, L325, 32019R2144."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"105309","DOI":"10.1016\/j.engappai.2022.105309","article-title":"Detecting and Recognizing Driver Distraction through Various Data Modality Using Machine Learning: A Review, Recent Advances, Simplified Framework and Open Challenges (2014\u20132021)","volume":"115","author":"Koay","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_40","first-page":"41","article-title":"Researches Advanced in Face Recognition","volume":"49","author":"Liu","year":"2023","journal-title":"Highlights Sci. Eng. Technol. AMMSAC"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chaves, D., Fidalgo, E., Alegre, E., Alaiz-Rodr\u00edguez, R., J\u00e1\u00f1ez-Martino, F., and Azzopardi, G. (2020). Assessment and Estimation of Face Detection Performance Based on Deep Learning for Forensic Applications. Sensors, 20.","DOI":"10.3390\/s20164491"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Verma, B., and Choudhary, A. (2018, January 12\u201314). Deep Learning Based Real-Time Driver Emotion Monitoring. Proceedings of the 2018 IEEE International Conference on Vehicular Electronics and Safety, ICVES 2018, Madrid, Spain.","DOI":"10.1109\/ICVES.2018.8519595"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"6183","DOI":"10.1007\/s00521-020-05390-9","article-title":"Driver Distraction Detection Using Capsule Network","volume":"33","author":"Jain","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_44","first-page":"3820","article-title":"Feature Based Techniques for a Driver\u2019s Distraction Detection Using Supervised Learning Algorithms Based on Fixed Monocular Video Camera","volume":"12","author":"Ali","year":"2018","journal-title":"KSII Trans. Internet Inf. Syst."},{"key":"ref_45","unstructured":"Hinton, G.E., Krizhevsky, A., and Wang, S.D. (2014). Transforming Auto-Encoders, Springer."},{"key":"ref_46","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017, January 4\u20139). Dynamic Routing Between Capsules Sara. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_47","unstructured":"James, P., and Cukierski, W. (2017). Facial Keypoints Detection, Kaggle."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2016, January 19\u201322). Wide Residual Networks. Proceedings of the British Machine Vision Conference 2016 (BMVC 2016), York, UK.","DOI":"10.5244\/C.30.87"},{"key":"ref_49","unstructured":"An, S., Lee, M., Park, S., Yang, H., and So, J. (2020). An Ensemble of Simple Convolutional Neural Network Models for MNIST Digit Recognition. arXiv."},{"key":"ref_50","unstructured":"Krizhevsky, A. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto."},{"key":"ref_51","unstructured":"Netzer, Y., Wang, T., Coates, A., Bissacco, A., Wu, B., and Ng, A.Y. (2011, January 16). Reading Digits in Natural Images with Unsupervised Feature Learning. Proceedings of the NIPS Workshop on Deep Learning and Unsupervised Feature Learning 2011, Granada, Spain."},{"key":"ref_52","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer. 8693 LNCS."},{"key":"ref_53","unstructured":"LeCun, Y., Cortes, C., and Christopher, J.C. (2023, June 30). Burges. The MNIST Database of Handwritten Digits. Available online: http:\/\/yann.lecun.com\/exdb\/mnist\/."},{"key":"ref_54","unstructured":"Goodfellow, I.J., Shlens, J., and Szegedy, C. (2015, January 7\u20139). Explaining and Harnessing Adversarial Examples. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015\u2014Conference Track Proceedings, San Diego, CA, USA."},{"key":"ref_55","unstructured":"Wong, E., Rice, L., and Kolter, J.Z. (2020). Fast Is Better than Free: Revisiting Adversarial Training. arXiv."},{"key":"ref_56","unstructured":"Madry, A., Makelov, A., Schmidt, L., Tsipras, D., and Vladu, A. (May, January 30). Towards Deep Learning Models Resistant to Adversarial Attacks. Proceedings of the 6th International Conference on Learning Representations, ICLR 2018\u2014Conference Track Proceedings, Vancouver, BC, Canada."},{"key":"ref_57","unstructured":"Zhang, H., Yu, Y., Jiao, J., Xing, E.P., El Ghaoui, L., and Jordan, M.I. (2019, January 10\u201315). Theoretically Principled Trade-off between Robustness and Accuracy. Proceedings of the 36th International Conference on Machine Learning, ICML, Long Beach, CA, USA."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Joyce, J.M. (2011). Kullback-Leibler Divergence. International Encyclopedia of Statistical Science, Springer.","DOI":"10.1007\/978-3-642-04898-2_327"},{"key":"ref_59","unstructured":"Kurakin, A., Goodfellow, I.J., and Bengio, S. (2017, January 24\u201326). Adversarial Examples in the Physical World. Proceedings of the 5th International Conference on Learning Representations, ICLR 2017\u2014Workshop Track Proceedings, Toulon, France."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/12\/8\/161\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:32:28Z","timestamp":1760128348000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/12\/8\/161"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,12]]},"references-count":60,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["computers12080161"],"URL":"https:\/\/doi.org\/10.3390\/computers12080161","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,12]]}}}