{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T08:07:14Z","timestamp":1791274034363,"version":"4.1.0"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,9,9]],"date-time":"2022-09-09T00:00:00Z","timestamp":1662681600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Hum. Neurosci."],"abstract":"<jats:p>Eye-tracking technology has become a powerful tool for biomedical-related applications due to its simplicity of operation and low requirements on patient language skills. This study aims to use the machine-learning models and deep-learning networks to identify key features of eye movements in Alzheimer's Disease (AD) under specific visual tasks, thereby facilitating computer-aided diagnosis of AD. Firstly, a three-dimensional (3D) visuospatial memory task is designed to provide participants with visual stimuli while their eye-movement data are recorded and used to build an eye-tracking dataset. Then, we propose a novel deep-learning-based model for identifying patients with Alzheimer's Disease (PwAD) and healthy controls (HCs) based on the collected eye-movement data. The proposed model utilizes a nested autoencoder network to extract the eye-movement features from the generated fixation heatmaps and a weight adaptive network layer for the feature fusion, which can preserve as much useful information as possible for the final binary classification. To fully verify the performance of the proposed model, we also design two types of models based on traditional machine-learning and typical deep-learning for comparison. Furthermore, we have also done ablation experiments to verify the effectiveness of each module of the proposed network. Finally, these models are evaluated by four-fold cross-validation on the built eye-tracking dataset. The proposed model shows 85% average accuracy in AD recognition, outperforming machine-learning methods and other typical deep-learning networks.<\/jats:p>","DOI":"10.3389\/fnhum.2022.972773","type":"journal-article","created":{"date-parts":[[2022,9,9]],"date-time":"2022-09-09T06:50:12Z","timestamp":1662706212000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":51,"title":["A novel deep learning approach for diagnosing Alzheimer's disease based on eye-tracking data"],"prefix":"10.3389","volume":"16","author":[{"given":"Jinglin","family":"Sun","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peiguang","family":"Jing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong","family":"Ji","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,9,9]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1702.00837","article-title":"Eye-movement behavior identification for ad diagnosis","author":"Biondi","year":"2017","journal-title":"arXiv preprint arXiv:1702.00837"},{"key":"B2","doi-asserted-by":"publisher","first-page":"107191","DOI":"10.1016\/j.neuropsychologia.2019.107191","article-title":"Eye tracking-the overlooked method to measure cognition in neurodegeneration?","volume":"133","author":"Bueno","year":"2019","journal-title":"Neuropsychologia"},{"key":"B3","doi-asserted-by":"publisher","first-page":"22527","DOI":"10.1007\/s11042-017-4796-5","article-title":"Prediction of visual attention with deep cnn on artificially degraded videos for studies of attention of patients with dementia","volume":"76","author":"Chaabouni","year":"2017","journal-title":"Multimed. Tools Appl"},{"key":"B4","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1159\/000442383","article-title":"Exploring visual selective attention towards novel stimuli in alzheimer's disease patients","volume":"5","author":"Chau","year":"2015","journal-title":"Dement. Geriatr Cogn. Dis. Extra"},{"key":"B5","doi-asserted-by":"publisher","first-page":"563","DOI":"10.3389\/fnhum.2017.00563","article-title":"Eye gaze and aging: selective and combined effects of working memory and inhibitory control","volume":"11","author":"Crawford","year":"2017","journal-title":"Front. Hum. Neurosci"},{"key":"B6","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1177\/1533317509332093","article-title":"Eye tracking during a visual paired comparison task as a predictor of early dementia","volume":"24","author":"Crutcher","year":"2009","journal-title":"Am. J. Alzheimers Dis. Other Dementias"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1473","DOI":"10.3390\/diagnostics11081473","article-title":"Artificial intelligence for Alzheimer's disease: promise or challenge?","volume":"11","author":"Fabrizio","year":"2021","journal-title":"Diagnostics"},{"key":"B8","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/0022-3956(75)90026-6","article-title":"A practical method for grading the cognitive state of patients for the children","volume":"12","author":"Folstein","year":"1975","journal-title":"J. Psychiatr. Res"},{"key":"B9","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1007\/978-3-319-03176-7_4","article-title":"Breaking the pattern: study on stereoscopic web perception","volume-title":"Ubiquitous Computing and Ambient Intelligence. Context-Awareness and Context-Driven Interaction","author":"Gonz\u00e1lez-Z\u00fa\u00f1iga","year":"2013"},{"key":"B10","doi-asserted-by":"publisher","first-page":"166","DOI":"10.3389\/fnhum.2010.00166","article-title":"Worth a glance: using eye movements to investigate the cognitive neuroscience of memory","volume":"4","author":"Hannula","year":"2010","journal-title":"Front. Hum. Neurosci"},{"key":"B11","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1101\/lm.048124.118","article-title":"Vismet: a passive, efficient, and sensitive assessment of visuospatial memory in healthy aging, mild cognitive impairment, and Alzheimer's disease","volume":"26","author":"Haque","year":"2019","journal-title":"Learn. Mem"},{"key":"B12","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1109\/TBME.2020.2990734","article-title":"Deep convolutional neural networks and transfer learning for measuring cognitive impairment using eye-tracking in a distributed tablet-based environment","volume":"68","author":"Haque","year":"2020","journal-title":"IEEE Trans. Biomed. Eng"},{"key":"B13","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1111\/ggi.12492","article-title":"Characteristic features of cognitive, affective and daily living functions of late-elderly dementia","volume":"16","author":"Hishikawa","year":"2016","journal-title":"Geriatr. Gerontol. Int"},{"key":"B14","first-page":"3267","article-title":"Learning visual attention to identify people with autism spectrum disorder","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Jiang","year":"2017"},{"key":"B15","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1007\/s11065-017-9362-4","article-title":"Prosaccade and antisaccade paradigms in persons with Alzheimer's disease: a meta-analytic review","volume":"28","author":"Kahana Levy","year":"2018","journal-title":"Neuropsychol. Rev"},{"key":"B16","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1016\/j.jneumeth.2011.06.027","article-title":"Detecting cognitive impairment by eye movement analysis using automatic classification algorithms","volume":"201","author":"Lagun","year":"2011","journal-title":"J. Neurosci. Methods"},{"key":"B17","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.jalz.2011.03.005","article-title":"The diagnosis of dementia due to alzheimer's disease: Recommendations from the national institute on aging-alzheimer's association workgroups on diagnostic guidelines for alzheimer's disease","volume":"7","author":"McKhann","year":"2011","journal-title":"Alzheimer's & dementia"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1437","DOI":"10.3390\/diagnostics11081437","article-title":"Alzheimer's disease and frontotemporal dementia: a robust classification method of eeg signals and a comparison of validation methods","volume":"11","author":"Miltiadous","year":"2021","journal-title":"Diagnostics"},{"key":"B19","doi-asserted-by":"publisher","first-page":"940","DOI":"10.3390\/diagnostics11060940","article-title":"Vitamin d and folate as predictors of mmse in alzheimer's disease: a machine learning analysis","volume":"11","author":"Murdaca","year":"2021","journal-title":"Diagnostics"},{"key":"B20","doi-asserted-by":"publisher","first-page":"5349","DOI":"10.3390\/s20185349","article-title":"Analyzing facial and eye movements to screen for alzheimer's disease","volume":"20","author":"Nam","year":"2020","journal-title":"Sensors"},{"key":"B21","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","article-title":"The montreal cognitive assessment, moca: a brief screening tool for mild cognitive impairment","volume":"53","author":"Nasreddine","year":"2005","journal-title":"J. Am. Geriatr. Soc"},{"key":"B22","doi-asserted-by":"publisher","first-page":"221","DOI":"10.3389\/fnagi.2020.00221","article-title":"Early diagnosis of mild cognitive impairment based on eye movement parameters in an aging chinese population","volume":"12","author":"Nie","year":"2020","journal-title":"Front. Aging Neurosci"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1302","DOI":"10.1109\/TVCG.2017.2657018","article-title":"Emulation of physician tasks in eye-tracked virtual reality for remote diagnosis of neurodegenerative disease","volume":"23","author":"Orlosky","year":"2017","journal-title":"IEEE Trans. Vis. Comput. Graph"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-021-88001-4","article-title":"Eye-tracking indices of impaired encoding of visual short-term memory in familial alzheimer's disease","volume":"11","author":"Pavisic","year":"2021","journal-title":"Sci. Rep"},{"key":"B25","doi-asserted-by":"publisher","first-page":"e48214","DOI":"10.1371\/journal.pone.0048214","article-title":"Forgetting what was where: The fragility of object-location binding","volume":"7","author":"Pertzov","year":"2012","journal-title":"PLoS ONE"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1503","DOI":"10.3390\/brainsci11111503","article-title":"The potential of naturalistic eye movement tasks in the diagnosis of alzheimer's disease: a review","volume":"11","author":"Readman","year":"2021","journal-title":"Brain Sci"},{"key":"B27","doi-asserted-by":"publisher","first-page":"806330","DOI":"10.3389\/fnhum.2022.806330","article-title":"A machine learning approach for detecting cognitive interference based on eye-tracking data","volume":"16","author":"Rizzo","year":"2022","journal-title":"Front. Hum. Neurosci"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2104.12167","article-title":"A novel binocular eye-tracking systemwith stereo stimuli for 3d gaze estimation","author":"Sun","year":"2021","journal-title":"arXiv preprint arXiv:2104.12167"},{"key":"B29","doi-asserted-by":"publisher","first-page":"117529","DOI":"10.1016\/j.jns.2021.117529","article-title":"Early detection of cognitive decline in mild cognitive impairment and Alzheimer's disease with a novel eye tracking test","volume":"427","author":"Tadokoro","year":"2021","journal-title":"J. Neurol Sci"}],"container-title":["Frontiers in Human Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnhum.2022.972773\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,3]],"date-time":"2024-10-03T14:50:15Z","timestamp":1727967015000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnhum.2022.972773\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,9]]},"references-count":29,"alternative-id":["10.3389\/fnhum.2022.972773"],"URL":"https:\/\/doi.org\/10.3389\/fnhum.2022.972773","relation":{},"ISSN":["1662-5161"],"issn-type":[{"value":"1662-5161","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,9]]},"article-number":"972773"}}