{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T05:35:34Z","timestamp":1769924134751,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2022,5,23]],"date-time":"2022-05-23T00:00:00Z","timestamp":1653264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program","award":["2018YFB1600202"],"award-info":[{"award-number":["2018YFB1600202"]}]},{"name":"National Key Research and Development Program","award":["2021YFB1600205"],"award-info":[{"award-number":["2021YFB1600205"]}]},{"name":"National Key Research and Development Program","award":["52178407"],"award-info":[{"award-number":["52178407"]}]},{"name":"National Natural Science Foundation of China","award":["2018YFB1600202"],"award-info":[{"award-number":["2018YFB1600202"]}]},{"name":"National Natural Science Foundation of China","award":["2021YFB1600205"],"award-info":[{"award-number":["2021YFB1600205"]}]},{"name":"National Natural Science Foundation of China","award":["52178407"],"award-info":[{"award-number":["52178407"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Car crashes are among the top ten leading causes of death; they could mainly be attributed to distracted drivers. An advanced driver-assistance technique (ADAT) is a procedure that can notify the driver about a dangerous scenario, reduce traffic crashes, and improve road safety. The main contribution of this work involved utilizing the driver\u2019s attention to build an efficient ADAT. To obtain this \u201cattention value\u201d, the gaze tracking method is proposed. The gaze direction of the driver is critical toward understanding\/discerning fatal distractions, pertaining to when it is obligatory to notify the driver about the risks on the road. A real-time gaze tracking system is proposed in this paper for the development of an ADAT that obtains and communicates the gaze information of the driver. The developed ADAT system detects various head poses of the driver and estimates eye gaze directions, which play important roles in assisting the driver and avoiding any unwanted circumstances. The first (and more significant) task in this research work involved the development of a benchmark image dataset consisting of head poses and horizontal and vertical direction gazes of the driver\u2019s eyes. To detect the driver\u2019s face accurately and efficiently, the You Only Look Once (YOLO-V4) face detector was used by modifying it with the Inception-v3 CNN model for robust feature learning and improved face detection. Finally, transfer learning in the InceptionResNet-v2 CNN model was performed, where the CNN was used as a classification model for head pose detection and eye gaze angle estimation; a regression layer to the InceptionResNet-v2 CNN was added instead of SoftMax and the classification output layer. The proposed model detects and estimates head pose directions and eye directions with higher accuracy. The average accuracy achieved by the head pose detection system was 91%; the model achieved a RMSE of 2.68 for vertical and 3.61 for horizontal eye gaze estimations.<\/jats:p>","DOI":"10.3390\/s22103959","type":"journal-article","created":{"date-parts":[[2022,5,25]],"date-time":"2022-05-25T00:14:14Z","timestamp":1653437654000},"page":"3959","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["A Driver Gaze Estimation Method Based on Deep Learning"],"prefix":"10.3390","volume":"22","author":[{"given":"Sayyed Mudassar","family":"Shah","sequence":"first","affiliation":[{"name":"Information Engineering School, Chang\u2019an University, Xi\u2019an 710061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaoyun","family":"Sun","sequence":"additional","affiliation":[{"name":"Information Engineering School, Chang\u2019an University, Xi\u2019an 710061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8212-4696","authenticated-orcid":false,"given":"Khalid","family":"Zaman","sequence":"additional","affiliation":[{"name":"Information Engineering School, Chang\u2019an University, Xi\u2019an 710061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Altaf","family":"Hussain","sequence":"additional","affiliation":[{"name":"Department of Computer Science and IT, The University of Agriculture Peshawar, Peshawar 25000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muhammad","family":"Shoaib","sequence":"additional","affiliation":[{"name":"Department of Computer Science and IT, CECOS University, Peshawar 25000, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1084-8289","authenticated-orcid":false,"given":"Lili","family":"Pei","sequence":"additional","affiliation":[{"name":"Information Engineering School, Chang\u2019an University, Xi\u2019an 710061, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.trf.2017.11.019","article-title":"Driver anger in France: The relationships between sex, gender roles, trait and state driving anger and appraisals made while driving","volume":"52","author":"Albentosa","year":"2018","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.aap.2015.11.015","article-title":"Safety-critical event risk associated with cell phone tasks as measured in naturalistic driving studies: A systematic review and meta-analysis","volume":"87","author":"Simmons","year":"2016","journal-title":"Accid. Anal. Prev."},{"key":"ref_3","unstructured":"World Health Organization (2015). World Health Statistics 2015, World Health Organization."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sugiyanto, G., and Santi, M.Y. (2017). Road traffic crash cost using human capital method (Case study in Purbalingga, Central Java, Indonesia). J. Teknol., 60\u201379.","DOI":"10.11113\/jt.v79.5375"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MITS.2014.2336271","article-title":"Three Decades of Driver Assistance Systems: Review and Future Perspectives","volume":"6","author":"Bengler","year":"2014","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ledezma, A., Zamora, V., Sipele, O., Sesmero, M., and Sanchis, A. (2021). Implementing a Gaze Tracking Algorithm for Improving Advanced Driver Assistance Systems. Electronics, 10.","DOI":"10.3390\/electronics10121480"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.aap.2017.09.025","article-title":"Monitoring driver fatigue using a single-channel electroencephalographic device: A validation study by gaze-based, driving performance, and subjective data","volume":"109","author":"Rieiro","year":"2017","journal-title":"Accid. Anal. Prev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/s10470-018-1151-3","article-title":"Simulation of driver fatigue monitoring via blink rate detection, using 65 nm CMOS technology","volume":"95","author":"Yassine","year":"2018","journal-title":"Analog. Integr. Circuits Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/34.121789","article-title":"Recursive 3-d road and relative ego-state recognition","volume":"14","author":"Dickmanns","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1016\/j.trf.2018.05.032","article-title":"Learning about advanced driver assistance systems\u2014The case of ACC and FCW in a sample of Czech drivers","volume":"65","year":"2019","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_11","unstructured":"Singh, S. (2022, January 10\u201312). Critical reasons for crashes investigated in the national motor vehicle crash causation survey. Proceedings of the Road Safety on Five Continents Conference, Grapevine, TX, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Khan, M.Q., and Lee, S. (2019). Gaze and Eye Tracking: Techniques and Applications in ADAS. Sensors, 19.","DOI":"10.3390\/s19245540"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1049\/iet-cvi.2015.0296","article-title":"\u2018Owl\u2019and \u2018Lizard\u2019: Patterns of head pose and eye pose in driver gaze classification","volume":"10","author":"Fridman","year":"2016","journal-title":"IET Comput. Vision."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/TITS.2013.2247759","article-title":"A Gaze-Based Driver Distraction Warning System and Its Effect on Visual Behavior","volume":"14","author":"Kircher","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1240","DOI":"10.1177\/1541931213601289","article-title":"Which Eye Tracker Is Right for Your Research? Performance Evaluation of Several Cost Variant Eye Trackers","volume":"60","author":"Funke","year":"2016","journal-title":"Proc. Hum. Factors Ergon. Soc. Annu. Meet."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1109\/TITS.2007.895298","article-title":"Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines","volume":"8","author":"Liang","year":"2007","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"818","DOI":"10.1109\/TITS.2014.2300870","article-title":"Continuous Head Movement Estimator for Driver Assistance: Issues, Algorithms, and On-Road Evaluations","volume":"15","author":"Tawari","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Tawari, A., Chen, K.H., and Trivedi, M.M. (2014, January 8\u201311). Where is the driver looking: Analysis of head, eye and iris for robust gaze zone estimation. Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems (ITSC), Shandong, China.","DOI":"10.1109\/ITSC.2014.6957817"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1109\/TIV.2018.2843120","article-title":"Driver Gaze Zone Estimation Using Convolutional Neural Networks: A General Framework and Ablative Analysis","volume":"3","author":"Vora","year":"2018","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"109817","DOI":"10.1109\/ACCESS.2019.2933598","article-title":"Enhanced Detection and Recognition of Road Markings Based on Adaptive Region of Interest and Deep Learning","volume":"7","author":"Hoang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TEM.2019.2922936","article-title":"DeepCoin: A Novel Deep Learning and Blockchain-Based Energy Exchange Framework for Smart Grids","volume":"67","author":"Ferrag","year":"2019","journal-title":"IEEE Trans. Eng. Manag."},{"key":"ref_22","unstructured":"Smith, P., Shah, M., and Da Vitoria Lobo, N. (2000, January 3\u20137). Monitoring head\/eye motion for driver alertness with one camera. Proceedings of the 15th International Conference on Pattern Recognition, ICPR-2000, Barcelona, Spain."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Vasli, B., Martin, S., and Trivedi, M.M. (2016, January 1\u20134). On driver gaze estimation: Explorations and fusion of geometric and data driven approaches. Proceedings of the 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795623"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2739","DOI":"10.1109\/TITS.2016.2526050","article-title":"Driver-Gaze Zone Estimation Using Bayesian Filtering and Gaussian Processes","volume":"17","author":"Lundgren","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2014","DOI":"10.1109\/TITS.2015.2396031","article-title":"Driver Gaze Tracking and Eyes Off the Road Detection System","volume":"16","author":"Vicente","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1109\/TITS.2006.869598","article-title":"Real-time system for monitoring driver vigilance","volume":"7","author":"Bergasa","year":"2006","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mavely, A.G., Judith, J.E., Sahal, P.A., and Kuruvilla, S.A. (2017, January 20\u201321). Eye gaze tracking based driver monitoring system. Proceedings of the 2017 IEEE International Conference on Circuits and Systems (ICCS), Kerala, India.","DOI":"10.1109\/ICCS1.2017.8326022"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1825","DOI":"10.1109\/TITS.2013.2271052","article-title":"A Vision-Based System for Monitoring the Loss of Attention in Automotive Drivers","volume":"14","author":"Dasgupta","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Eren, H., Celik, U., and Poyraz, M. (2007, January 13\u201315). Stereo vision and statistical based behaviour prediction of driver. Proceedings of the 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey.","DOI":"10.1109\/IVS.2007.4290191"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tawari, A., and Trivedi, M.M. (2014, January 8\u201311). Robust and continuous estimation of driver gaze zone by dynamic analysis of multiple face videos. Proceedings of the 2014 IEEE Intelligent Vehicles Symposium, Ypsilanti, MI, USA.","DOI":"10.1109\/IVS.2014.6856607"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"61639","DOI":"10.1109\/ACCESS.2019.2915944","article-title":"Deep Learning-Based Super-Resolution Reconstruction and Marker Detection for Drone Landing","volume":"7","author":"Truong","year":"2019","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/j.compag.2018.12.048","article-title":"Development and evaluation of a low-cost and smart technology for precision weed management utilizing artificial intelligence","volume":"157","author":"Partel","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"7185","DOI":"10.1109\/TIA.2020.3025742","article-title":"Data-Driven Day-Ahead PV Estimation Using Autoencoder-LSTM and Persistence Model","volume":"56","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Ind. Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/10\/3959\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:17:09Z","timestamp":1760138229000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/10\/3959"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,23]]},"references-count":33,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["s22103959"],"URL":"https:\/\/doi.org\/10.3390\/s22103959","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,23]]}}}