{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T21:26:36Z","timestamp":1775251596364,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2018,10,16]],"date-time":"2018-10-16T00:00:00Z","timestamp":1539648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006595","name":"Unitatea Executiva pentru Finantarea Invatamantului Superior, a Cercetarii, Dezvoltarii si Inovarii","doi-asserted-by":"publisher","award":["PN-III-P1-1.1-TE2016-0440 - DEEPSENSE"],"award-info":[{"award-number":["PN-III-P1-1.1-TE2016-0440 - DEEPSENSE"]}],"id":[{"id":"10.13039\/501100006595","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Deceit occurs in daily life and, even from an early age, children can successfully deceive their parents. Therefore, numerous book and psychological studies have been published to help people decipher the facial cues to deceit. In this study, we tackle the problem of deceit detection by analyzing eye movements: blinks, saccades and gaze direction. Recent psychological studies have shown that the non-visual saccadic eye movement rate is higher when people lie. We propose a fast and accurate framework for eye tracking and eye movement recognition and analysis. The proposed system tracks the position of the iris, as well as the eye corners (the outer shape of the eye). Next, in an offline analysis stage, the trajectory of these eye features is analyzed in order to recognize and measure various cues which can be used as an indicator of deception: the blink rate, the gaze direction and the saccadic eye movement rate. On the task of iris center localization, the method achieves within pupil localization in 91.47% of the cases. For blink localization, we obtained an accuracy of 99.3% on the difficult EyeBlink8 dataset. In addition, we proposed a novel metric, the normalized blink rate deviation to stop deceitful behavior based on blink rate. Using this metric and a simple decision stump, the deceitful answers from the Silesian Face database were recognized with an accuracy of 96.15%.<\/jats:p>","DOI":"10.3390\/jimaging4100120","type":"journal-article","created":{"date-parts":[[2018,10,16]],"date-time":"2018-10-16T11:07:51Z","timestamp":1539688071000},"page":"120","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["In the Eye of the Deceiver: Analyzing Eye Movements as a Cue to Deception"],"prefix":"10.3390","volume":"4","author":[{"given":"Diana","family":"Borza","sequence":"first","affiliation":[{"name":"Department of Computer Science, Technical University of Cluj-Napoca, Memorandumului Street 28, 400114 Cluj-Napoca, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8156-7313","authenticated-orcid":false,"given":"Razvan","family":"Itu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Technical University of Cluj-Napoca, Memorandumului Street 28, 400114 Cluj-Napoca, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4515-8114","authenticated-orcid":false,"given":"Radu","family":"Danescu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Technical University of Cluj-Napoca, Memorandumului Street 28, 400114 Cluj-Napoca, Romania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1007\/BF00987486","article-title":"Lying and nonverbal behavior: Theoretical issues and new findings","volume":"12","author":"Ekman","year":"1988","journal-title":"J. Nonverbal Behav."},{"key":"ref_2","first-page":"342","article-title":"Current research and potential applications of the concealed information test: An overview","volume":"3","year":"2012","journal-title":"Front. Psychol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1037\/h0046060","article-title":"The GSR in the detection of guilt","volume":"43","author":"Lykken","year":"1959","journal-title":"J. Appl. Psychol."},{"key":"ref_4","unstructured":"Ekman, P. (2009). Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage (Revised Edition), WW Norton & Company."},{"key":"ref_5","unstructured":"Bandler, R., and Grinder, J. (1975). The Structure of Magic, Science and Behavior Books."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wiseman, R., Watt, C., TenBrinke, L., Porter, S., Couper, S.L., and Rankin, C. (2012). The eyes don\u2019t have it: Lie detection and neuro-linguistic programming. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0040259"},{"key":"ref_7","first-page":"58","article-title":"Thirty-five years of research on Neuro-Linguistic Programming. NLP research data base. State of the art or pseudoscientific decoration?","volume":"41","author":"Witkowski","year":"2010","journal-title":"Pol. Psychol. Bull."},{"key":"ref_8","unstructured":"Ekman, P., Friesen, W.V., and Hager, J.C. Facial Action Coding System. Manual and Investigator\u2019s Guide, Nexus."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1111\/j.1469-8986.1984.tb02312.x","article-title":"The endogenous eyeblink","volume":"21","author":"Stern","year":"1984","journal-title":"Psychophysiology"},{"key":"ref_10","unstructured":"Schiffman, H.R. (1990). Sensation and Perception: An Integrated Approach, John Wiley & Sons."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gamer, M., and Pertzov, Y. (2018). Detecting concealed knowledge from ocular responses. Detecting Concealed Information and Deception, Academic Press.","DOI":"10.1016\/B978-0-12-812729-2.00008-2"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"736","DOI":"10.3389\/fpsyg.2013.00736","article-title":"Detecting false intent using eye blink measures","volume":"4","author":"Marchak","year":"2013","journal-title":"Front. Psychol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.ijpsycho.2013.03.003","article-title":"Fixations and eye-blinks allow for detecting concealed crime related memories","volume":"88","author":"Peth","year":"2013","journal-title":"Int. J. Psychophysiol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Danisman, T., Bilasco, I.M., Djeraba, C., and Ihaddadene, N. (2010, January 3\u20135). Drowsy driver detection system using eye blink patterns. Proceedings of the International Conference on Machine and Web Intelligence, Algiers, Algeria.","DOI":"10.1109\/ICMWI.2010.5648121"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4225","DOI":"10.3390\/s130404225","article-title":"Optical flow and driver\u2019s kinematics analysis for state of alert sensing","volume":"13","year":"2013","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/s10209-011-0256-6","article-title":"Eye-blink detection system for human\u2013computer interaction","volume":"11","year":"2012","journal-title":"Univ. Access Inf. Soc."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1353","DOI":"10.1016\/j.humov.2012.06.003","article-title":"The timing and temporal patterns of eye blinking are dynamically modulated byattention","volume":"31","author":"Oh","year":"2012","journal-title":"Hum. Mov. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Drutarovsky, T., and Fogelton, A. (2014, January 6\u201312). Eye blink detection using variance of motion vectors. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-16199-0_31"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Pan, G., Sun, L., Wu, Z., and Lao, S. (2007, January 14\u201321). Eyeblink-based anti-spoofing in face recognition from a generic webcamera. Proceedings of the 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409068"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sukno, F.M., Pavani, S.K., Butakoff, C., and Frangi, A.F. (2009, January 13\u201315). Automatic assessment of eye blinking patterns through statistical shape models. Proceedings of the International Conference on Computer Vision Systems, Li\u00e8ge, Belgium.","DOI":"10.1007\/978-3-642-04667-4_4"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lalonde, M., Byrns, D., Gagnon, L., Teasdale, N., and Laurendeau, D. (2007, January 28\u201330). Real-time eye blink detection with GPU-based SIFT tracking. Proceedings of the Fourth Canadian Conference on Computer and Robot Vision (CRV\u201907), Montreal, QC, Canada.","DOI":"10.1109\/CRV.2007.54"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1109\/TPAMI.2009.30","article-title":"In the eye of the beholder: A survey of models for eyes and gaze","volume":"32","author":"Hansen","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Borza, D., Darabant, A.S., and Danescu, R. (2016). Real-time detection and measurement of eye features from color images. Sensors, 16.","DOI":"10.3390\/s16071105"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Daugman, J. (2009). How iris recognition works. The Essential Guide to Image Processing, Elsevier.","DOI":"10.1016\/B978-0-12-374457-9.00025-1"},{"key":"ref_25","unstructured":"Borza, D., and Danescu, R. (December, January 28). Eye shape and corners detection in periocular images using particle filters. Proceedings of the 12th International Conference Signal-Image Technology & Internet-Based Systems (SITIS), Naples, Italy."},{"key":"ref_26","first-page":"125","article-title":"Accurate eye centre localisation by means of gradients","volume":"11","author":"Timm","year":"2011","journal-title":"Visapp"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Radu, P., Ferryman, J., and Wild, P. (2015, January 8\u201311). A robust sclera segmentation algorithm. Proceedings of the 7th International Conference on Biometrics Theory, Applications and Systems (BTAS), Virginia, WA, USA.","DOI":"10.1109\/BTAS.2015.7358746"},{"key":"ref_28","first-page":"277","article-title":"A multi-stage approach to facial feature detection","volume":"1","author":"Cristinacce","year":"2004","journal-title":"BMVC"},{"key":"ref_29","unstructured":"Breuer, R., and Kimmel, R. (arXiv, 2017). A deep learning perspective on the origin of facial expressions, arXiv, preprint."},{"key":"ref_30","unstructured":"Imai, F.H., Tr\u00e9meau, A., and Braz, J. (2018, January 27\u201329). Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018)\u2014Volume 5: VISAPP, Funcha, Madeira, Portugal."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wu, Z., Singh, B., Davis, L.S., and Subrahmanian, V. (arXiv, 2017). Deception detection in videos, arXiv, preprint.","DOI":"10.1609\/aaai.v32i1.11502"},{"key":"ref_32","first-page":"1755","article-title":"Dlib-ml: A machine learning toolkit","volume":"10","author":"King","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_33","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (arXiv, 2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications, arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2825","DOI":"10.1016\/j.patcog.2014.03.024","article-title":"Eyes closeness detection from still images with multi-scale histograms of principal oriented gradients","volume":"47","author":"Song","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1109\/TPAMI.2003.1217601","article-title":"Fast radial symmetry for detecting points of interest","volume":"25","author":"Loy","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Radlak, K., Bozek, M., and Smolka, B. (2015, January 9\u201313). Silesian Deception Database: Presentation and Analysis. Proceedings of the ACM on Workshop on Multimodal Deception Detection, Seattle, WA, USA.","DOI":"10.1145\/2823465.2823469"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.cviu.2016.03.011","article-title":"Eye blink detection based on motion vectors analysis","volume":"148","author":"Fogelton","year":"2016","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Jesorsky, O., Kirchberg, K.J., and Frischholz, R.W. (2001, January 6\u20138). Robust face detection using the hausdorff distance. Proceedings of the International Conference on Audio-and Video-Based Biometric Person Authentication, Halmstad, Sweden.","DOI":"10.1007\/3-540-45344-X_14"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Bigun, J., and Smeraldi, F. (2001, January 6\u20138). Proceedings of the Audio-and Video-Based Biometric Person Authentication: Third International Conference, AVBPA 2001, Halmstad, Sweden.","DOI":"10.1007\/3-540-45344-X"},{"key":"ref_40","unstructured":"Cootes, T. (2018, October 16). Talking Face Video. Available online: http:\/\/www-prima.inrialpes.fr\/FGnet\/data\/01-TalkingFace\/talking_face.html."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/4\/10\/120\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T20:16:50Z","timestamp":1775247410000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/4\/10\/120"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,16]]},"references-count":40,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,10]]}},"alternative-id":["jimaging4100120"],"URL":"https:\/\/doi.org\/10.3390\/jimaging4100120","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,16]]}}}