{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T15:58:46Z","timestamp":1782316726326,"version":"3.54.5"},"reference-count":40,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,2,26]],"date-time":"2022-02-26T00:00:00Z","timestamp":1645833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100015624","name":"University of Jeddah","doi-asserted-by":"publisher","award":["UJ-04-18-ICP"],"award-info":[{"award-number":["UJ-04-18-ICP"]}],"id":[{"id":"10.13039\/501100015624","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Traditional methods for behavior detection of distracted drivers are not capable of capturing driver behavior features related to complex temporal features. With the goal to improve transportation safety and to reduce fatal accidents on roads, this research article presents a Hybrid Scheme for the Detection of Distracted Driving called HSDDD. This scheme is based on a strategy of aggregating handcrafted and deep CNN features. HSDDD is based on three-tiered architecture. The three tiers are named as Coordination tier, Concatenation tier and Classification tier. We first obtain HOG features by using handcrafted algorithms, and then at the coordination tier, we leverage four deep CNN models including AlexNet, Inception V3, Resnet50 and VGG-16 for extracting DCNN features. DCNN extracted features are fused with HOG extracted features at the Concatenation tier. Then PCA is used as a feature selection technique. PCA takes both the extracted features and removes the redundant and irrelevant information, and it improves the classification performance. After feature fusion and feature selection, the two classifiers, KNN and SVM, at the Classification tier take the selected features and classify the ten classes of distracted driving behaviors. We evaluate our proposed scheme and observe its performance by using the accuracy metrics.<\/jats:p>","DOI":"10.3390\/s22051864","type":"journal-article","created":{"date-parts":[[2022,2,27]],"date-time":"2022-02-27T20:48:33Z","timestamp":1645994913000},"page":"1864","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["HSDDD: A Hybrid Scheme for the Detection of Distracted Driving through Fusion of Deep Learning and Handcrafted Features"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7658-7085","authenticated-orcid":false,"given":"Monagi H.","family":"Alkinani","sequence":"first","affiliation":[{"name":"Department of Computer Science and Artificial Intelligence, College of Computer Science and Engineering, University of Jeddah, Jeddah 21959, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0819-4236","authenticated-orcid":false,"given":"Wazir Zada","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Wah, Wah Cantt 47040, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Quratulain","family":"Arshad","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Comsats University Islamabad, Wah Campus, Wah Cantt 47040, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mudassar","family":"Raza","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Comsats University Islamabad, Wah Campus, Wah Cantt 47040, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Abbas, M.K., Jung, L.T., Mahmood, A.K., and Abdulla, R. (2019, January 24\u201327). Intelligent Software Agents for Managing Road Speed Offences. Proceedings of the Computer Science On-Line Conference, Zlin, Czech Republic.","DOI":"10.1007\/978-3-030-19807-7_18"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Khandakar, A., Chowdhury, M.E., Ahmed, R., Dhib, A., Mohammed, M., Al-Emadi, N.A., and Michelson, D. (2019). Portable system for monitoring and controlling driver behavior and the use of a mobile phone while driving. Sensors, 19.","DOI":"10.3390\/s19071563"},{"key":"ref_3","unstructured":"Kumar, N., and Manoj, S. (2020, January 29\u201330). Smart Street Lights to Reduce Death Rates from Road Accidents. Proceedings of the International Conference on Recent Trends in Machine Learning, IoT, Smart Cities and Applications, Hyderabad, Telangana, India."},{"key":"ref_4","unstructured":"Fitch, G.M., Soccolich, S.A., Guo, F., McClafferty, J., Fang, Y., Olson, R.L., Perez, M.A., Hanowski, R.J., Hankey, J.M., and Dingus, T.A. (2013). The Impact of Hand-Held and Hands-Free Cell Phone Use on Driving Performance and Safety-Critical Event Risk, U.S. Department of Transportation National Highway Traffic Safety Administration. Tech. Rep."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3324","DOI":"10.1109\/TITS.2018.2875343","article-title":"Identifying heavy goods vehicle driving styles in the United Kingdom","volume":"20","author":"Figueredo","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Agrawal, U., Mase, J.M., Figueredo, G.P., Wagner, C., Mesgarpour, M., and John, R.I. (2019, January 27\u201330). Towards real-time heavy goods vehicle driving behaviour classification in the United Kingdom. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917446"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"105008","DOI":"10.1109\/ACCESS.2020.2999829","article-title":"Detecting human driver inattentive and aggressive driving behavior using deep learning: Recent advances, requirements and open challenges","volume":"8","author":"Alkinani","year":"2020","journal-title":"IEEE Access"},{"key":"ref_8","unstructured":"Zwaag, M.D. (2012). Music Directs Your Mood. [Ph.D. Thesis, University Library Groningen]."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dmitrenko, D., Maggioni, E., and Obrist, M. (2018, January 16\u201320). I smell trouble: Using multiple scents to convey driving-relevant information. Proceedings of the 2018 International Conference on Multimodal Interaction, Boulder, CO, USA.","DOI":"10.1145\/3242969.3243015"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"20","DOI":"10.2352\/ISSN.2470-1173.2017.10.IMAWM-162","article-title":"Distracted driver detection: Deep learning vs handcrafted features","volume":"2017","author":"Hssayeni","year":"2017","journal-title":"Electr. Imaging"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Streiffer, C., Raghavendra, R., Benson, T., and Srivatsa, M. (2017, January 11\u201315). Darnet: A deep learning solution for distracted driving detection. Proceedings of the 18th ACM\/IFIP\/USENIX Middleware Conference: Industrial Track, Las Vegas, NV, USA.","DOI":"10.1145\/3154448.3154452"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Okon, O.D., and Meng, L. (2017, January 12\u201316). Detecting distracted driving with deep learning. Proceedings of the International Conference on Interactive Collaborative Robotics, Hatfield, UK.","DOI":"10.1007\/978-3-319-66471-2_19"},{"key":"ref_13","unstructured":"Abouelnaga, Y., Eraqi, H.M., and Moustafa, M.N. (2017). Real-time distracted driver posture classification. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4125865","DOI":"10.1155\/2019\/4125865","article-title":"Driver distraction identification with an ensemble of convolutional neural networks","volume":"2019","author":"Eraqi","year":"2019","journal-title":"J. Adv. Transp."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Koesdwiady, A., Bedawi, S.M., Ou, C., and Karray, F. (2017, January 5\u20137). End-to-end deep learning for driver distraction recognition. Proceedings of the International Conference Image Analysis and Recognition, Montreal, QC, Canada.","DOI":"10.1007\/978-3-319-59876-5_2"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Leekha, M., Goswami, M., Shah, R.R., Yin, Y., and Zimmermann, R. (2019, January 11\u201313). Are you paying attention? Detecting distracted driving in real-time. Proceedings of the 2019 IEEE 5th International Conference on Multimedia Big Data (BigMM), Singapore.","DOI":"10.1109\/BigMM.2019.00-28"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Celaya-Padilla, J.M., Galv\u00e1n-Tejada, C.E., Lozano-Aguilar, J.S.A., Zanella-Calzada, L.A., Luna-Garc\u00eda, H., Galv\u00e1n-Tejada, J.I., Gamboa-Rosales, N.K., Velez Rodriguez, A., and Gamboa-Rosales, H. (2019). Texting & driving detection using deep convolutional neural networks. Appl. Sci., 9.","DOI":"10.3390\/app9152962"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jegham, I., Khalifa, A.B., Alouani, I., and Mahjoub, M.A. (2018, January 16\u201319). Safe driving: Driver action recognition using surf keypoints. Proceedings of the 2018 30th International Conference on Microelectronics (ICM), Sousse, Tunisia.","DOI":"10.1109\/ICM.2018.8704009"},{"key":"ref_19","first-page":"719413","article-title":"Driving posture recognition by joint application of motion history image and pyramid histogram of oriented gradients","volume":"2014","author":"Yan","year":"2014","journal-title":"Int. J. Veh. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Artan, Y., Bulan, O., Loce, R.P., and Paul, P. (2014, January 24\u201327). Driver cell phone usage detection from hov\/hot nir images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.42"},{"key":"ref_21","unstructured":"Craye, C., and Karray, F. (2015). Driver distraction detection and recognition using rgb-d sensor. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zheng, N., Wang, F., and He, Y. (2011, January 10\u201312). Visual recognition of driver hand-held cell phone use based on hidden crf. Proceedings of the 2011 IEEE International Conference on Vehicular Electronics and Safety, Beijing, China.","DOI":"10.1109\/ICVES.2011.5983823"},{"key":"ref_23","unstructured":"Mase, J.M., Chapman, P., Figueredo, G.P., and Torres, M.T. (2020, January 21\u201323). A hybrid deep learning approach for driver distraction detection. Proceedings of the 2020 International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Korea."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wu, M., Zhang, X., Shen, L., and Yu, H. (2021, January 10\u201315). Pose-aware multi-feature fusion network for driver distraction recognition. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9413337"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"18580","DOI":"10.1109\/ACCESS.2020.2968464","article-title":"A deep-learning-based scheme for detecting driver cell-phone use","volume":"8","author":"Jin","year":"2020","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"109335","DOI":"10.1109\/ACCESS.2020.3001159","article-title":"Hcf: A hybrid cnn framework for behavior detection of distracted drivers","volume":"8","author":"Huang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gumaei, A., Al-Rakhami, M., Hassan, M.M., Alamri, A., Alhussein, M., Razzaque, A., and Fortino, G. (2020). A deep learning-based driver distraction identification framework over edge cloud. Neural Comput. Appl., 1\u201316.","DOI":"10.1007\/s00521-020-05328-1"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1108\/JICV-03-2021-0004","article-title":"Dynamic prediction of traffic incident duration on urban expressways: A deep learning approach based on LSTM and MLP","volume":"4","author":"Zhu","year":"2021","journal-title":"J. Intell. Connect. Veh."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1049\/iet-its.2018.5172","article-title":"Real-time detection of distracted driving based on deep learning","volume":"12","author":"Tran","year":"2018","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_30","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_33","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very deep convolutional networks forlarge-scale image recognition. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"886","DOI":"10.1109\/CVPR.2005.177","article-title":"Histograms of oriented gradients for human detection","volume":"Volume 1","author":"Dalal","year":"2005","journal-title":"Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)"},{"key":"ref_35","first-page":"4109","article-title":"Performance comparison of deep cnn models for detecting driver\u2019s distraction","volume":"68","author":"Srinivasan","year":"2021","journal-title":"CMC-Comput. Mater. Contin."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Arefin, M.R., Makhmudkhujaev, F., Chae, O., and Kim, J. (2019, January 11\u201313). Aggregating cnn and hog features for real-time distracted driver detection. Proceedings of the 2019 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2019.8661970"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Moslemi, N., Azmi, R., and Soryani, M. (2019, January 6\u20137). Driver distraction recognition using 3d convolutional neural networks. Proceedings of the 2019 4th International Conference on Pattern Recognition and Image Analysis (IPRIA), Tehran, Iran.","DOI":"10.1109\/PRIA.2019.8786012"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1109\/TIV.2020.2995555","article-title":"Towards computationally efficient and realtime distracted driver detection with mobilevgg network","volume":"5","author":"Baheti","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"168080","DOI":"10.1109\/ACCESS.2021.3133797","article-title":"Robust Deep Learning-Based Driver Distraction Detection and Classification","volume":"9","author":"Ezzouhri","year":"2021","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Nguyen, D.L., Putro, M.D., Vo, X.T., and Jo, K.H. (2021, January 13\u201316). Light-weight Convolutional Neural Network for Distracted Driver Classification. Proceedings of the IECON 2021\u201347th Annual Conference of the IEEE Industrial Electronics Society, Toronto, ON, Canada.","DOI":"10.1109\/IECON48115.2021.9589212"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1864\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:28:19Z","timestamp":1760135299000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1864"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,26]]},"references-count":40,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22051864"],"URL":"https:\/\/doi.org\/10.3390\/s22051864","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,26]]}}}