{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T12:13:40Z","timestamp":1775477620611,"version":"3.50.1"},"reference-count":38,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,18]],"date-time":"2020-09-18T00:00:00Z","timestamp":1600387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003052","name":"Ministry of Trade, Industry and Energy","doi-asserted-by":"publisher","award":["10073159"],"award-info":[{"award-number":["10073159"]}],"id":[{"id":"10.13039\/501100003052","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Brain disease can be screened using eye movements. Degenerative brain disorders change eye movement because they affect not only memory and cognition but also the cranial nervous system involved in eye movement. We compared the facial and eye movement patterns of patients with mild Alzheimer\u2019s disease and cognitively normal people to analyze the neurological signs of dementia. After detecting the facial landmarks, the coordinate values for the movements were extracted. We used Spearman\u2019s correlation coefficient to examine associations between horizontal and vertical facial and eye movements. We analyzed the correlation between facial and eye movements without using special eye-tracking equipment or complex conditions in order to measure the behavioral aspect of the natural human gaze. As a result, we found differences between patients with Alzheimer\u2019s disease and cognitively normal people. Patients suffering from Alzheimer\u2019s disease tended to move their face and eyes simultaneously in the vertical direction, whereas the cognitively normal people did not, as confirmed by a Mann\u2013Whitney\u2013Wilcoxon test. Our findings suggest that objective and accurate measurement of facial and eye movements can be used to screen such patients quickly. The use of camera-based testing for the early detection of patients showing signs of neurodegeneration can have a significant impact on the public care of dementia.<\/jats:p>","DOI":"10.3390\/s20185349","type":"journal-article","created":{"date-parts":[[2020,9,18]],"date-time":"2020-09-18T10:22:23Z","timestamp":1600424543000},"page":"5349","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["Analyzing Facial and Eye Movements to Screen for Alzheimer\u2019s Disease"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9324-5124","authenticated-orcid":false,"given":"Uiseo","family":"Nam","sequence":"first","affiliation":[{"name":"Department of Computer Science, Graduate School, Sangmyung University, Seoul 03016, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0634-1119","authenticated-orcid":false,"given":"Kunyoung","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Graduate School, Sangmyung University, Seoul 03016, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7135-3872","authenticated-orcid":false,"given":"Hyunwoong","family":"Ko","sequence":"additional","affiliation":[{"name":"Interdisciplinary Program in Cognitive Science, Seoul National University, Seoul 08826, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5893-3124","authenticated-orcid":false,"given":"Jun-Young","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Seoul National University College of Medicine &amp; SMG-SNU Boramae Medical Center, Seoul 03080, Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6504-3333","authenticated-orcid":false,"given":"Eui Chul","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Human-Centered Artificial Intelligence, Sangmyung University, Seoul 03016, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12126-010-9051-6","article-title":"The power of global aging","volume":"35","author":"Powell","year":"2010","journal-title":"Ageing Int."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jalz.2016.07.150","article-title":"The worldwide costs of dementia 2015 and comparisons with 2010","volume":"13","author":"Wimo","year":"2017","journal-title":"Alzheimer\u2019s Dement."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0277-9536(99)00471-2","article-title":"Self-identity in older persons suffering from dementia: Preliminary results","volume":"51","author":"Golander","year":"2000","journal-title":"Soc. Sci. Med."},{"key":"ref_4","unstructured":"Lu, Y., Zheng, W.L., Li, B., and Lu, B.L. (2015, January 25\u201331). Combining Eye Movements and EEG to Enhance Emotion Recognition. Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, Buenos Aires, Argentina."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1167\/14.13.14","article-title":"Eye movements during emotion recognition in faces","volume":"14","author":"Schurgin","year":"2014","journal-title":"J. Vis."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/S0920-9964(00)00181-X","article-title":"Stability of exploratory eye movements as a marker of schizophrenia\u2014A WHO multi-center study","volume":"52","author":"Kojima","year":"2001","journal-title":"Schizophr. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1212\/WNL.58.2.198","article-title":"Patterns of brain atrophy in frontotemporal dementia and semantic dementia","volume":"58","author":"Rosen","year":"2002","journal-title":"Neurology"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"S144","DOI":"10.1016\/j.parkreldis.2015.09.034","article-title":"Cognitive impairment in Parkinson\u2019s disease and dementia with Lewy bodies","volume":"22","author":"Aarsland","year":"2016","journal-title":"Parkinsonism Relat. Disord."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"817","DOI":"10.1097\/OPX.0b013e3181adff2d","article-title":"Visual impairment and dysfunction in combat-injured servicemembers with traumatic brain injury","volume":"86","author":"Brahm","year":"2009","journal-title":"Optom. Vis. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1002\/(SICI)1099-1166(199611)11:11<937::AID-GPS540>3.0.CO;2-0","article-title":"The role of general practice and the primary care team in dementia diagnosis and management","volume":"11","author":"Downs","year":"1996","journal-title":"Int. J. Geriatr. Psychiatry"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1126\/science.143.3611.1190","article-title":"Pupil size in relation to mental activity during simple problem-solving","volume":"143","author":"Hess","year":"1964","journal-title":"Science"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Iqbal, S.T., Zheng, X.S., and Bailey, B.P. (2004, January 24\u201329). Task-Evoked Pupillary Response to Mental Workload in Human-Computer Interaction. Proceedings of the CHI \u201804 Extended Abstracts on Human Factors in Computing Systems, Vienna, Austria.","DOI":"10.1145\/985921.986094"},{"key":"ref_13","first-page":"B165","article-title":"Identifying cognitive state from eye metrics","volume":"78","author":"Marshall","year":"2007","journal-title":"Aviat. Space Environ. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1097\/01.JTN.0000318921.90627.fe","article-title":"The pupillary response in traumatic brain injury: A guide for trauma nurses","volume":"14","author":"Adoni","year":"2007","journal-title":"J. Trauma Nurs."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1037\/a0014464","article-title":"Pupillary responses in art appreciation: Effects of aesthetic emotions","volume":"3","author":"Kuchinke","year":"2009","journal-title":"Psychol. Aesthet. Creat. Arts"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.janxdis.2009.12.006","article-title":"Eye tracking and visual attention to threatening stimuli in veterans of the Iraq war","volume":"24","author":"Kimble","year":"2010","journal-title":"J. Anxiety Disord."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.3233\/JAD-161078","article-title":"Pupillary responses as a biomarker of early risk for Alzheimer\u2019s disease","volume":"56","author":"Granholm","year":"2017","journal-title":"J. Alzheimer\u2019s Dis."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.janxdis.2019.05.005","article-title":"\u201cFear guides the eyes of the beholder\u201d: Assessing gaze avoidance in social anxiety disorder via covert eye tracking of dynamic social stimuli","volume":"65","author":"Weeks","year":"2019","journal-title":"J. Anxiety Disord."},{"key":"ref_19","first-page":"299","article-title":"Monitoring dementia with automatic eye movements analysis","volume":"57","author":"Zhang","year":"2016","journal-title":"Intell. Decis. Technol."},{"key":"ref_20","unstructured":"Dham, S., Sharma, A., and Dhall, A. (2017). Depression scale recognition from audio, visual and text analysis. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1212\/WNL.34.7.939","article-title":"Clinical diagnosis of Alzheimer\u2019s disease: Report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer\u2019s Disease","volume":"34","author":"McKhann","year":"1984","journal-title":"Neurology"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2412","DOI":"10.1212\/WNL.43.11.2412-a","article-title":"The Clinical Dementia Rating (CDR): Current version and scoring rules","volume":"43","author":"Morris","year":"1993","journal-title":"Neurology"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Baltru\u0161aitis, T., Zadeh, A., Lim, Y.C., and Morency, L.P. (2018, January 15\u201319). OpenFace 2.0: Facial Behavior Analysis Toolkit. Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00019"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 22\u201325). Realtime Multi-Person 2d Pose Estimation Using Part Affinity Fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), San Juan, Puerto Rico.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zadeh, A., Lim, Y.C., Baltru\u0161aitis, T., and Morency, L.P. (2017, January 22\u201329). Convolutional Experts Constrained Local Model for 3D Facial Landmark Detection. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.296"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Baltrusaitis, T., Robinson, P., and Morency, L.P. (2013, January 1\u20138). Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild. Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCVW), Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.54"},{"key":"ref_27","unstructured":"Wood, E., Baltrusaitis, T., Zhang, X., Sugano, Y., Robinson, P., and Bulling, A. (201, January 7\u201313). Rendering of Eyes for Eye-Shape Registration and Gaze Estimation. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1136\/bjsm.2003.007690","article-title":"Position related analysis of the appearance of and relationship between post-match physical and mental fatigue in university rugby football players","volume":"38","author":"Mashiko","year":"2004","journal-title":"Br. J. Sports Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3866","DOI":"10.1002\/cpe.3745","article-title":"Using Spearman\u2019s correlation coefficients for exploratory data analysis on big dataset","volume":"28","author":"Xiao","year":"2016","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"9676","DOI":"10.1016\/j.eswa.2012.02.153","article-title":"Alzheimer\u2019s Disease Neuroimaging Initiative. Computer aided diagnosis tool for Alzheimer\u2019s disease based on Mann\u2013Whitney\u2013Wilcoxon U-test","volume":"39","author":"Ramirez","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1080\/01621459.1967.10482916","article-title":"On the Kolmogorov-Smirnov test for normality with mean and variance unknown","volume":"62","author":"Lilliefors","year":"1967","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2045","DOI":"10.1016\/j.visres.2009.02.015","article-title":"Attentional release in the saccadic gap effect","volume":"49","author":"Jin","year":"2009","journal-title":"Vis. Res."},{"key":"ref_33","first-page":"264","article-title":"Eye movement dysfunction in dementia of the Alzheimer type","volume":"6","author":"Moser","year":"1995","journal-title":"Dementia"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1093\/brain\/awn047","article-title":"Oculomotor function in frontotemporal lobar degeneration, related disorders and Alzheimer\u2019s disease","volume":"131","author":"Garbutt","year":"2008","journal-title":"Brain"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1038\/eye.2014.276","article-title":"Ocular motor abnormalities in neurodegenerative disorders","volume":"29","author":"Antoniades","year":"2015","journal-title":"Eye"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1001\/archneur.1994.00540190062016","article-title":"Impairment of spatially directed attention in patients with probable Alzheimer\u2019s disease as measured by eye movements","volume":"51","author":"Scinto","year":"1994","journal-title":"Arch. Neurol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1093\/brain\/awh484","article-title":"Saccadic eye movement changes in Parkinson\u2019s disease dementia and dementia with Lewy bodies","volume":"128","author":"Mosimann","year":"2005","journal-title":"Brain"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1016\/S1474-4422(09)70042-0","article-title":"Progressive supranuclear palsy: Clinicopathological concepts and diagnostic challenges","volume":"8","author":"Williams","year":"2009","journal-title":"Lancet Neurol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5349\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:11:17Z","timestamp":1760177477000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5349"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,18]]},"references-count":38,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185349"],"URL":"https:\/\/doi.org\/10.3390\/s20185349","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,18]]}}}