{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T03:02:19Z","timestamp":1769310139760,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2020,7,6]],"date-time":"2020-07-06T00:00:00Z","timestamp":1593993600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100009392","name":"Prince Sattam bin Abdulaziz University","doi-asserted-by":"publisher","award":["2020\/01\/1174."],"award-info":[{"award-number":["2020\/01\/1174."]}],"id":[{"id":"10.13039\/100009392","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Various methods have been used to estimate the pupil location within an image or a real-time video frame in many fields. However, these methods lack the performance specifically in low-resolution images and varying background conditions. We propose a coarse-to-fine pupil localisation method using a composite of machine learning and image processing algorithms. First, a pre-trained model is employed for the facial landmark identification to extract the desired eye frames within the input image. Then, we use multi-stage convolution to find the optimal horizontal and vertical coordinates of the pupil within the identified eye frames. For this purpose, we define an adaptive kernel to deal with the varying resolution and size of input images. Furthermore, a dynamic threshold is calculated recursively for reliable identification of the best-matched candidate. We evaluated our method using various statistical and standard metrics along with a standardised distance metric that we introduce for the first time in this study. The proposed method outperforms previous works in terms of accuracy and reliability when benchmarked on multiple standard datasets. The work has diverse artificial intelligence and industrial applications including human computer interfaces, emotion recognition, psychological profiling, healthcare, and automated deception detection.<\/jats:p>","DOI":"10.3390\/s20133785","type":"journal-article","created":{"date-parts":[[2020,7,6]],"date-time":"2020-07-06T11:07:42Z","timestamp":1594033662000},"page":"3785","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["Pupil Localisation and Eye Centre Estimation Using Machine Learning and Computer Vision"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7511-3873","authenticated-orcid":false,"given":"Wasiq","family":"Khan","sequence":"first","affiliation":[{"name":"Computer Science Department, Liverpool John Moores University, Liverpool L33AF, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8413-0045","authenticated-orcid":false,"given":"Abir","family":"Hussain","sequence":"additional","affiliation":[{"name":"Computer Science Department, Liverpool John Moores University, Liverpool L33AF, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4279-4166","authenticated-orcid":false,"given":"Kaya","family":"Kuru","sequence":"additional","affiliation":[{"name":"School of Engineering, University of Central Lancashire, Preston PR12HE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1688-0669","authenticated-orcid":false,"given":"Haya","family":"Al-askar","sequence":"additional","affiliation":[{"name":"Computer Science Department, College of Engineering and Computer Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Monforte, P.H.B., Araujo, G.M., and De Lima, A.A. (2018, January 17\u201320). Evaluation of a New Kernel-Based Classifier in Eye Pupil Detection. In Proceeding of the 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA.","DOI":"10.1109\/ICMLA.2018.00063"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Al-Rahayfeh, A., and Faezipour, M. (2013). Eye tracking and head movement detection: A state-of-art survey. IEEE J. Transl. Eng. Health Med., 1.","DOI":"10.1109\/JTEHM.2013.2289879"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1109\/TITS.2012.2217377","article-title":"Automatic calibration method for driver\u2019s head orientation in natural driving environment","volume":"14","author":"Guan","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Horak, K. (2011, January 18\u201320). Fatigue features based on eye tracking for driver inattention system. In Proceeding of the 34th International Conference on Telecommunications and Signal Processing (TSP), Budapest, Hungary.","DOI":"10.1109\/TSP.2011.6043660"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Harischandra, J., and Perera, M.U.S. (2012, January 17\u201319). Intelligent emotion recognition system using brain signals (EEG). Proceedings of the 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences, Langkawi, Malaysia.","DOI":"10.1109\/IECBES.2012.6498050"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1109\/TPAMI.2009.30","article-title":"In the eye of the beholder: A survey of models for eyes and gaze","volume":"32","author":"Hansen","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"O\u2019Shea, J., Crockett, K., Wasiq, K., Kindynis, P., Antoniades, A., and Boultadakis, G. (2018, January 8\u201313). Intelligent Deception Detection through Machine Based Interviewing. Proceedings of the IEEE International Joint conference on Artificial Neural Networks (IJCNN), Rio de Janeiro, Brazil.","DOI":"10.1109\/IJCNN.2018.8489392"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Waheed, H., Hassan, S., Aljohani, N.R., Hardman, J., Alelyani, S., and Nawaz, R. (2020). Predicting academic performance of students with VLE big data using deep learning models. Comput. Hum. Behav., 104.","DOI":"10.1016\/j.chb.2019.106189"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"182210","DOI":"10.1016\/j.cviu.2004.07.014","article-title":"A Generative Framework for Real Time Object Detection and Classification","volume":"98","author":"Fasel","year":"2005","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1016\/S0167-8655(98)00065-8","article-title":"Variance Projection Function and Its Application to Eye Detection for Human Face Recognition","volume":"19","author":"Feng","year":"1998","journal-title":"Pattern Recognit. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1016\/S0031-3203(00)00042-X","article-title":"Multi-Cues Eye Detection on Gray Intensity Image","volume":"34","author":"Feng","year":"2001","journal-title":"Pattern Recognit."},{"key":"ref_12","unstructured":"Kawato, S., and Ohya, J. (2000, January 8\u201311). Two-Step Approach for Real-Time Eye Tracking with a New Filtering Technique. Proceedings of the SMC 2000 Conference Proceedings 2000 IEEE International Conference on Systems, Man and Cybernetics, Nashville, TN, USA."},{"key":"ref_13","unstructured":"Kawato, S., and Ohya, J. (2000, January 28\u201330). Real-Time Detection of Nodding and Head-Shaking by Directly Detecting and Tracking the BetweenEyes. Proceeding of IEEE Fourth International Conference on Automatic Face and Gesture Recognition, Grenoble, France."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1016\/j.imavis.2004.03.013","article-title":"Detection and Tracking of Eyes for Gaze-Camera Control","volume":"22","author":"Kawato","year":"2004","journal-title":"Img. Vis. Comp."},{"key":"ref_15","unstructured":"Kawato, S., and Tetsutani, N. (2002, January 23\u201325). Real-Time Detection of Between-the Eyes with a Circle Frequency Filter. Proceedings of the Asian Conference on Computer Vision \u201902, Melbourne, Australia."},{"key":"ref_16","unstructured":"Huang, W.M., and Mariani, R. (2000, January 3\u20137). Face Detection and Precise Eyes Location. Proceedings of the International Conference on Pattern Recognition, Barcelona, Spain."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Pentland, A., Moghaddam, B., and Starner, T. (1994, January 21\u201323). View-Based and Modular Eigenspaces for Face Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR.1994.323814"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1142\/S0218001499000562","article-title":"Eye Detection Using Optimal Wavelet Packets and Radial Basis Functions (RBFs)","volume":"13","author":"Huang","year":"1999","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"ref_19","unstructured":"Hansen, D.W., Hansen, J.P., Nielsen, M., Johansen, A.S., and Stegmann, M.B. (2003, January 4). Eye Typing Using Markov and Active Appearance Models. Proceedings of the IEEE Workshop Applications on Computer Vision, Orlando, FL, USA."},{"key":"ref_20","unstructured":"Hansen, D.W., and Hansen, J.P. (2006, January 17\u201322). Robustifying Eye Interaction. Proceedings of the Conference on Vision for Human Computer Interaction, New York, NY, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"108307","DOI":"10.1016\/j.jneumeth.2019.05.016","article-title":"DeepVOG: Open-source pupil segmentation and gaze estimation in neuroscience using deep learning","volume":"324","author":"Yiu","year":"2019","journal-title":"J. Neurosci. Methods"},{"key":"ref_22","unstructured":"Li, D., Winfield, D., and Parkhurst, D.J. (2005, January 21\u201323). Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_23","unstructured":"Fuhl, W., Santini, T., Kasneci, G., and Kasneci, E. (2016). Pupilnet: Convolutional Neural Networks for Robust Pupil Detection. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2501643.2501647","article-title":"Hybrid method based on topography for robust detection of iris centre and eye corners","volume":"25","author":"Villanueva","year":"2013","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Azzopardi, G., and Petkov, N. (2015). Robust pupil detection in real-world scenarios. Computer Analysis of Images and Patterns, Springer International Publishing.","DOI":"10.1007\/978-3-319-23192-1"},{"key":"ref_26","unstructured":"Liu, Y., Hsueh, P.Y., Lai, J., Sangin, M., Nussli, M.A., and Dillenbourg, P. (July, January 28). Who is the expert? Analyzing gaze data to predict expertise level in collaborative applications. Proceedings of the IEEE International Conference on Multimedia and Expo, New York, NY, USA."},{"key":"ref_27","first-page":"165","article-title":"Identifying cognitive state from eye metrics Aviation","volume":"78","author":"Marshall","year":"2007","journal-title":"Space Environ. Med."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Henderson, J.M., Shinkareva, S.V., Wang, J., Luke, S.G., and Olejarczyk, J. (2013). Predicting cognitive state from eye movements. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0064937"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1017\/S1930297500006720","article-title":"Novel approach to studying strategic decisions with eye-tracking and machine learning","volume":"12","year":"2017","journal-title":"Judgm. Decis. Mak."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2633043","article-title":"Inferring visualization task properties, user performance, and user cognitive abilities from eye gaze data","volume":"4","author":"Steichen","year":"2014","journal-title":"ACM Trans. Interact. Intell. Syst. (TIIS)"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.dss.2018.10.012","article-title":"Detecting task demand via an eye tracking machine learning system","volume":"116","author":"Shojaeizadeh","year":"2019","journal-title":"Decis. Support Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Krafka, K., Khosla, A., Kelnhofer, P., Kannan, H., Bhandarkar, S., Matusik, W., and Torralba, A. (2016, January 27\u201330). Eye tracking for everyone. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.239"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Naqvi, R.A., Arsalan, M., Batchuluun, G., Yoon, H.S., and Park, K.R. (2018). Deep Learning-based gaze detection system for automobile drivers using a NIR camera sensor. Sensors, 18.","DOI":"10.3390\/s18020456"},{"key":"ref_34","first-page":"85","article-title":"DeepEye: Deep convolutional network for pupil detection in real environments","volume":"26","author":"Melero","year":"2019","journal-title":"Integr. Comput.-Aided Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.imavis.2014.10.007","article-title":"Eye detection using discriminatory Haar features and a new efficient SVM","volume":"33","author":"Chen","year":"2015","journal-title":"Image Vis. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Borza, D., Itu, R., and Danescu, R. (2018). In the Eye of the Deceiver: Analyzing Eye Movements as a Cue to Deception. J. Imaging, 4.","DOI":"10.3390\/jimaging4100120"},{"key":"ref_37","first-page":"125","article-title":"Accurate eye centre localisation by means of gradients","volume":"11","author":"Timm","year":"2011","journal-title":"Visapp"},{"key":"ref_38","first-page":"1755","article-title":"Dlib-ml: A machine learning toolkit","volume":"10","author":"King","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Valenti, R., and Gevers, T. (2008, January 23\u201328). Accurate eye center location and tracking using isophote curvature. Proceedings of the IEEE CVPR, Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587529"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cristinacce, D., Cootes, T., and Scott, I. (2004). A Multi-Stage Approach to Facial Feature Detection. British Machine Vision Conference, BMVA Press.","DOI":"10.5244\/C.18.30"},{"key":"ref_41","unstructured":"Cootes, T. (2019, October 16). Talking Face Video. Available online: http:\/\/www-prima.inrialpes.fr\/FGnet\/data\/01-TalkingFace\/talking_face.html."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jesorsky, O., Kirchberg, K.J., and Frischholz, R.W. (2001, January 6\u20138). Robust face detection using the hausdorff distance. Proceedings of the International Conference on Audio-and Video-Based Biometric Person Authentication, Halmstad, Sweden.","DOI":"10.1007\/3-540-45344-X_14"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ponz, V., Villanueva, A., and Cabeza, R. (2012, January 5\u20138). Dataset for the evaluation of eye detector for gaze estimation. Proceedings of the ACM Conference on Ubiquitous Computing, Pittsburgh, PA, USA.","DOI":"10.1145\/2370216.2370364"},{"key":"ref_44","unstructured":"Asadifard, M., and Shanbezadeh, J. (2010, January 17\u201319). Automatic adaptive center of pupil detection using face detection and cdf analysis. Proceedings of the IMECS, Hong Kong, China."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1049\/iet-cvi.2015.0316","article-title":"Fast and Accurate Algorithm for Eye Localization for Gaze Tracking in Low Resolution Images","volume":"10","author":"George","year":"2016","journal-title":"IET Comput. Vis."},{"key":"ref_46","first-page":"207","article-title":"Pupil Localization Using Self-organizing Migrating Algorithm","volume":"Volume 554","author":"Zelinka","year":"2020","journal-title":"AETA 2018\u2014Recent Advances in Electrical Engineering and Related Sciences: Theory and Application. AETA 2018. Lecture Notes in Electrical Engineering"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/13\/3785\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:47:57Z","timestamp":1760176077000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/13\/3785"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,6]]},"references-count":46,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2020,7]]}},"alternative-id":["s20133785"],"URL":"https:\/\/doi.org\/10.3390\/s20133785","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,6]]}}}