{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:56:06Z","timestamp":1776106566870,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2019,3,5]],"date-time":"2019-03-05T00:00:00Z","timestamp":1551744000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The aim of the study is to develop a real-time eyeblink detection algorithm that can detect eyeblinks during the closing phase for a virtual reality headset (VR headset) and accordingly classify the eye\u2019s current state (open or closed). The proposed method utilises analysis of a motion vector for detecting eyelid closure, and a Haar cascade classifier (HCC) for localising the eye in the captured frame. When the downward motion vector (DMV) is detected, a cross-correlation between the current region of interest (eye in the current frame) and a template image for an open eye is used for verifying eyelid closure. A finite state machine is used for decision making regarding eyeblink occurrence and tracking the eye state in a real-time video stream. The main contributions of this study are, first, the ability of the proposed algorithm to detect eyeblinks during the closing or the pause phases before the occurrence of the reopening phase of the eyeblink. Second, realising the proposed approach by implementing a valid real-time eyeblink detection sensor for a VR headset based on a real case scenario. The sensor is used in the ongoing study that we are conducting. The performance of the proposed method was 83.9% for accuracy, 91.8% for precision and 90.40% for the recall. The processing time for each frame took approximately 11 milliseconds. Additionally, we present a new dataset for non-frontal eye monitoring configuration for eyeblink tracking inside a VR headset. The data annotations are also included, such that the dataset can be used for method validation and performance evaluation in future studies.<\/jats:p>","DOI":"10.3390\/s19051121","type":"journal-article","created":{"date-parts":[[2019,3,5]],"date-time":"2019-03-05T11:19:50Z","timestamp":1551784790000},"page":"1121","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Real-Time Eyeblink Detector and Eye State Classifier for Virtual Reality (VR) Headsets (Head-Mounted Displays, HMDs)"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9133-5495","authenticated-orcid":false,"given":"Nassr","family":"Alsaeedi","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Kassel, 34127 Kassel, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dieter","family":"Wloka","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Kassel, 34127 Kassel, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"16937","DOI":"10.3390\/s121216937","article-title":"Detecting driver drowsiness based on sensors: A review","volume":"12","author":"Sahayadhas","year":"2012","journal-title":"Sensors"},{"key":"ref_2","unstructured":"Jamil, T., Mohammed, I., and Awadalla, M.H. (April, January 30). Design and Implementation of an Eye Blinking Detector System for Automobile Accident Prevention. Proceedings of the SoutheastCon, Norfolk, VA, USA."},{"key":"ref_3","first-page":"26","article-title":"Driver fatigue monitoring system using eye closure","volume":"4","author":"Victoreia","year":"2014","journal-title":"Int. J. Mod. Eng. Res."},{"key":"ref_4","first-page":"202","article-title":"Efficient eye blink detection method for disabled-helping domain","volume":"5","author":"Aree","year":"2014","journal-title":"IJACSA"},{"key":"ref_5","unstructured":"Polatsek, P. (2013, January 23). Eye Blink Detection. Proceedings of the Informatics and Information Technologies IIT.SRC 2013, Bratislava, Slovakia."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.cviu.2016.03.011","article-title":"Eye blink detection based on motion vectors analysis","volume":"148","author":"Fogelton","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/s10209-011-0256-6","article-title":"Eye-blink detection system for human\u2013computer interaction","volume":"11","year":"2012","journal-title":"Univ. Access Inf. Soc."},{"key":"ref_8","first-page":"33","article-title":"Automatic Assessment of Eye Blinking Patterns through Statistical Shape Models","volume":"Volume 5815","author":"Fritz","year":"2009","journal-title":"Computer Vision Systems, Proceedings of the 7th International Conference on Computer Vision Systems, ICVS 2009 Li\u00e8ge, Belgium, 13\u201315 October 2009"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ishimaru, S., Kunze, K., Kise, K., Weppner, J., Dengel, A., Lukowicz, P., and Bulling, A. (2014, January 7\u20138). In the Blink of an Eye: Combining Head Motion and Eye Blink Frequency for Activity Recognition with Google Glass. Proceedings of the 5th Augmented Human International Conference, Kobe, Japan.","DOI":"10.1145\/2582051.2582066"},{"key":"ref_10","first-page":"111","article-title":"Studies of the movements of the eyelids of animals: Blinking","volume":"18","author":"Blount","year":"1927","journal-title":"Physiol. Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1093\/brain\/awn317","article-title":"Voluntary, spontaneous and reflex blinking in patients with clinically probable progressive supranuclear palsy","volume":"132","author":"Bologna","year":"2009","journal-title":"Brain"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"20130227","DOI":"10.1098\/rsif.2013.0227","article-title":"High-speed camera characterization of voluntary eye blinking kinematics","volume":"10","author":"Kwon","year":"2013","journal-title":"J. R. Soc. Interface"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/S1542-0124(11)70007-6","article-title":"Spontaneous eyeblink activity","volume":"9","author":"Cruz","year":"2011","journal-title":"Ocul. Surf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.1002\/mds.870120629","article-title":"Analysis of blink rate patterns in normal subjects","volume":"12","author":"Bentivoglio","year":"1997","journal-title":"Mov. Disord. Off. J. Mov. Disord. Soc."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1111\/j.1469-8986.1984.tb02312.x","article-title":"The endogenous eyeblink","volume":"21","author":"Stern","year":"1984","journal-title":"Psychophysiology"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1007\/s00421-003-0807-5","article-title":"Experimental evaluation of eye-blink parameters as a drowsiness measure","volume":"89","author":"Caffier","year":"2003","journal-title":"Eur. J. Appl. Physiol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1002\/dev.20357","article-title":"Sensitivity of the rate of spontaneous eye blinking to type of stimuli in young infants","volume":"51","author":"Bacher","year":"2009","journal-title":"Dev. Psychobiol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1002\/ana.410050509","article-title":"Ontogeny of spontaneous blinking and of habituation of the blink reflex","volume":"5","author":"Zametkin","year":"1979","journal-title":"Ann. Neurol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1006\/exer.1998.0571","article-title":"The exposed ocular surface and its relationship to spontaneous eyeblink rate in elderly caucasians","volume":"67","author":"Zaman","year":"1998","journal-title":"Exp. Eye Res."},{"key":"ref_20","first-page":"92","article-title":"Age-related changes in human blinks. Passive and active changes in eyelid kinematics","volume":"38","author":"Sun","year":"1997","journal-title":"Investig. Ophthamol. Vis. Sci."},{"key":"ref_21","unstructured":"Chambayil, B., Singla, R., and Jha, R. (July, January 30). EEG Eye Blink Classification Using Neural Network. Proceedings of the World Congress on Engineering, London, UK."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Supek, S., Su\u0161ac, A., Tiganj, Z., Mboup, M., Pouzat, C., and Belkoura, L. (April, January 28). An Algebraic Method for Eye Blink Artifacts Detection in Single Channel EEG Recordings. Proceedings of the 17th International Conference on Biomagnetism Advances in Biomagnetism\u2014Biomag2010, Dubrovnik, Croatia.","DOI":"10.1007\/978-3-642-12197-5"},{"key":"ref_23","unstructured":"Nakanishi, M., Mitsukura, Y., Wang, Y., Wang, Y.-T., and Jung, T.-P. (2012, January 23\u201326). Online Voluntary Eye Blink Detection using Electrooculogram. Proceedings of the 2012 International Symposium on Nonlinear Theory and its Applications, Palma de Majorca, Spain."},{"key":"ref_24","first-page":"51","article-title":"Classification of eye movements using electrooculography and neural networks","volume":"5","author":"Hema","year":"2014","journal-title":"Int. J. Recent Trends Hum. Comput. Interact."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Al-gawwam, S. (2018). Robust eye blink detection based on eye landmarks and Savitzky\u2013Golay filtering. Information, 9.","DOI":"10.3390\/info9040093"},{"key":"ref_26","unstructured":"Ivleva, I. (2016). Redirected Walking in Virtual Reality During Eye Blink. [Bechelor\u2019s Thesis, University of Bremen Faculty of Mathematics and Computer Science]."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Fuhl, W., Santini, T., and Kasneci, E. (2017, January 24\u201331). Fast and Robust Eyelid Outline and Aperture Detection in Real-World Scenarios. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.126"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Appel, T., Santini, T., and Kasneci, E. (2016, January 12\u201316). Brightness and Motion-Based Blink Detection for Head-Mounted Eye Trackers. Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.","DOI":"10.1145\/2968219.2968341"},{"key":"ref_29","unstructured":"Ho, T.K. (1995, January 14\u201316). Random Decision Forests. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QC, Canada."},{"key":"ref_30","unstructured":"OmniVision (2018). OV4689 4MP Product Brief, OmniVision."},{"key":"ref_31","first-page":"363","article-title":"Two-Frame Motion Estimation Based on Polynomial Expansion","volume":"Volume 2749","author":"Bigun","year":"2003","journal-title":"Proceedings of the 13th Scandinavian Conference, SCIA 2003"},{"key":"ref_32","unstructured":"Vishay Intertechnology (2011). High Speed Infrared Emitting Diode, 850 nm, GaAlAs Double Hetero, Vishay Intertechnology Inc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s10044-009-0150-5","article-title":"The architecture and performance of the face and eyes detection system based on the HAAR cascade classifiers","volume":"13","author":"Kasinski","year":"2010","journal-title":"Pattern Anal. Appl."},{"key":"ref_34","unstructured":"Ahmadi, A. (2018, July 05). Cascade Trainer GUI. Available online: http:\/\/amin-ahmadi.com\/cascade-trainer-gui\/."},{"key":"ref_35","unstructured":"Alsaeedi, N. (2019, February 15). Eye Blink Detection. Available online: https:\/\/data.mendeley.com\/datasets\/9yzdnng594\/1."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/5\/1121\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:36:28Z","timestamp":1760186188000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/5\/1121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,5]]},"references-count":36,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["s19051121"],"URL":"https:\/\/doi.org\/10.3390\/s19051121","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,5]]}}}