{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T22:14:18Z","timestamp":1788300858108,"version":"build-2803163510"},"reference-count":59,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T00:00:00Z","timestamp":1720137600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>A rapid and reliable neuropsychological protocol is essential for the efficient assessment of neurocognitive constructs related to emergent neurodegenerative diseases. We developed an AI-assisted, digitally administered\/scored neuropsychological protocol that can be remotely administered in ~10 min. This protocol assesses the requisite neurocognitive constructs associated with emergent neurodegenerative illnesses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The protocol was administered to 77 ambulatory care\/memory clinic patients (56.40% women; 88.50% Caucasian). The protocol includes a 6-word version of the Philadelphia (repeatable) Verbal Learning Test [P(r)VLT], three trials of 5 digits backward from the Backwards Digit Span Test (BDST), and the \u201canimal\u201d fluency test. The protocol provides a comprehensive set of traditional \u201ccore\u201d measures that are typically obtained through paper-and-pencil tests (i.e., serial list learning, immediate and delayed free recall, recognition hits, percent correct serial order backward digit span, and \u201canimal\u201d fluency output). Additionally, the protocol includes variables that quantify errors and detail the processes used in administering the tests. It also features two separate, norm-referenced summary scores specifically designed to measure executive control and memory.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Using four core measures, we used cluster analysis to classify participants into four groups: cognitively unimpaired (CU;\n                      <jats:italic>n<\/jats:italic>\n                      = 23), amnestic mild cognitive impairment (MCI;\n                      <jats:italic>n<\/jats:italic>\n                      = 17), dysexecutive MCI (\n                      <jats:italic>n<\/jats:italic>\n                      = 23), and dementia (\n                      <jats:italic>n<\/jats:italic>\n                      = 14). Subsequent analyses of error and process variables operationally defined key features of amnesia (i.e., rapid forgetting, extra-list intrusions, profligate responding to recognition foils); key features underlying reduced executive abilities (i.e., BDST items and dysexecutive errors); and the strength of the semantic association between successive responses on the \u201canimal\u201d fluency test. Executive and memory index scores effectively distinguished between all four groups. There was over 90% agreement between how cluster analysis of digitally obtained measures classified patients compared to classification using a traditional comprehensive neuropsychological protocol. The correlations between digitally obtained outcome variables and analogous paper\/pencil measures were robust.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>The digitally administered protocol demonstrated a capacity to identify patterns of impaired performance and classification similar to those observed with standard paper\/pencil neuropsychological tests. The inclusion of both core measures and detailed error\/process variables suggests that this protocol can detect subtle, nuanced signs of early emergent neurodegenerative illness efficiently and comprehensively.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpsyg.2024.1415629","type":"journal-article","created":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T10:44:37Z","timestamp":1720176277000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Digital assessment of cognition in neurodegenerative disease: a data driven approach leveraging artificial intelligence"],"prefix":"10.3389","volume":"15","author":[{"given":"David J.","family":"Libon","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rod","family":"Swenson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catherine C.","family":"Price","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melissa","family":"Lamar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie","family":"Cosentino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ondrej","family":"Bezdicek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mitchel A.","family":"Kling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Tobyne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ali","family":"Jannati","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Russell","family":"Banks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alvaro","family":"Pascual-Leone","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,7,5]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1598","DOI":"10.1002\/alz.13016","article-title":"Alzheimer's disease facts and figures","volume":"19","year":"2023","journal-title":"Alzheimers Dement"},{"key":"B2","first-page":"504","article-title":"\u201cAmnestic disorders,\u201d","volume-title":"Clinical Neuropsychology, 5th Edn","author":"Bauer","year":"2012"},{"key":"B3","doi-asserted-by":"publisher","first-page":"690","DOI":"10.1017\/S1355617720000144","article-title":"Machine learning analysis of digital clock drawing test performance for differential classification of mild cognitive impairment subtypes versus Alzheimer's disease","volume":"26","author":"Binaco","year":"2020","journal-title":"J. Int. Neuropsychol. Soc."},{"key":"B4","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1037\/0894-4105.8.3.374","article-title":"Preclinical cognitive markers of dementia of the Alzheimer type","volume":"8","author":"Bondi","year":"1994","journal-title":"Neuropsychology"},{"key":"B5","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1097\/WAD.0b013e3181a6bebc","article-title":"Missed and delayed diagnosis of dementia in primary care: prevalence and contributing factors","volume":"23","author":"Bradford","year":"2009","journal-title":"Alzheimers Dis. Assoc. Disord."},{"key":"B6","first-page":"403","article-title":"\u201cAmnesic disorders,\u201d","volume-title":"Clinical Neuropsychology, 2nd Edn","author":"Butters","year":"1985"},{"key":"B7","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1097\/01.wnn.0000119564.08162.46","article-title":"Clock drawing errors in dementia: neuropsychological and neuroanatomical considerations","volume":"17","author":"Cosentino","year":"2004","journal-title":"Cogn. Behav. Neurol."},{"key":"B8","doi-asserted-by":"publisher","first-page":"47","DOI":"10.3233\/JAD-201129","article-title":"Classifying non-dementia and Alzheimer's disease\/vascular dementia patients using kinematic, time-based, and visuospatial parameters: The Digital Clock Drawing Test","volume":"82","author":"Davoudi","year":"2021","journal-title":"J. Alzheimers Dis."},{"key":"B9","volume-title":"The California Verbal Learning Test, 1st Edn","author":"Delis","year":"1987"},{"key":"B10","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1037\/1040-3590.3.1.19","article-title":"Profiles of demented and amnesic patients on the California Verbal Learning Test: implications for the assessment of memory disorders","volume":"3","author":"Delis","year":"1991","journal-title":"Psychol. Assess."},{"key":"B11","doi-asserted-by":"publisher","first-page":"73","DOI":"10.3233\/JAD-191089","article-title":"Cognitive correlates of Digital Clock Drawing metrics in older adults with and without mild cognitive impairment","volume":"75","author":"Dion","year":"2020","journal-title":"J. Alzheimers Dis."},{"key":"B12","doi-asserted-by":"publisher","first-page":"868500","DOI":"10.3389\/fnagi.2022.868500","article-title":"The functional connectivity and neuropsychology underlying mental planning operations: data from the digital clock drawing test","volume":"14","author":"Dion","year":"2022","journal-title":"Front. Aging Neurosci."},{"key":"B13","doi-asserted-by":"publisher","first-page":"5","DOI":"10.3233\/JAD-201125","article-title":"Neurocognitive constructs underlying executive control in statistically determined mild cognitive impairment","volume":"82","author":"Emrani","year":"","journal-title":"J. Alzheimers Dis."},{"key":"B14","doi-asserted-by":"publisher","first-page":"86","DOI":"10.37349\/emed.2021.00034","article-title":"Assessing the capacity for mental manipulation in patients with statistically determined mild cognitive impairment using digital technology","volume":"2","author":"Emrani","year":"","journal-title":"Explor. Med."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1535","DOI":"10.3233\/JAD-230288","article-title":"Neurocognitive operations underlying working memory abilities: an analysis of latency and time-based parameters","volume":"94","author":"Emrani","year":"2023","journal-title":"J. Alzheimers Dis."},{"key":"B16","doi-asserted-by":"publisher","first-page":"917","DOI":"10.3233\/JAD-170555","article-title":"Assessing working memory in mild cognitive impairment with serial order recall","volume":"61","author":"Emrani","year":"2018","journal-title":"J. Alzheimers Dis."},{"key":"B17","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1017\/S1355617711001238","article-title":"Dysexecutive functioning in mild cognitive impairment: derailment in temporal gradients","volume":"18","author":"Eppig","year":"2012","journal-title":"J. Int. Neuropsychol. Soc."},{"key":"B18","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/0022-3956(75)90026-6","article-title":"\u201cMini-mental state\u201d. A practical method for grading the cognitive state of patients for the clinician","volume":"12","author":"Folstein","year":"1975","journal-title":"J. Psychiatr. Res."},{"key":"B19","doi-asserted-by":"publisher","first-page":"1076","DOI":"10.1016\/j.neubiorev.2021.10.015","article-title":"Speech and language impairments in behavioral variant frontotemporal dementia: a systematic review","volume":"131","author":"Geraudie","year":"2021","journal-title":"Neurosci. Biobehav. Rev."},{"key":"B20","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1212\/WNL.12.10.675","article-title":"A human cerebral deconnection syndrome. A preliminary report","volume":"12","author":"Geschwind","year":"1962","journal-title":"Neurology"},{"key":"B21","doi-asserted-by":"publisher","first-page":"e6008","DOI":"10.1002\/gps.6008","article-title":"Financial capacity assessments and AI: a Greek drama for geriatric psychiatry?","volume":"38","author":"Giannouli","year":"2023","journal-title":"Int. J. Geriatr. Psychiatry"},{"key":"B22","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1037\/0894-4105.11.3.400","article-title":"Impairment in category fluency in ischemic vascular dementia","volume":"11","author":"Giovannetti","year":"1997","journal-title":"Neuropsychology"},{"key":"B23","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1037\/0894-4105.14.3.353","article-title":"A comparison of rCBF patterns during letter and semantic fluency","volume":"14","author":"Gourovitch","year":"2000","journal-title":"Neuropsychology"},{"key":"B24","volume-title":"Revised Comprehensive Norms for an Expanded Halstead-Reitan Battery: Demographically Adjusted Neuropsychological Norms for African American and Caucasian Adults Scoring Programs","author":"Heaton","year":"2004"},{"key":"B25","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1037\/a0034221","article-title":"Memory for serial order across domains: an overview of the literature and directions for future research","volume":"140","author":"Hurlstone","year":"2014","journal-title":"Psychol. Bull."},{"key":"B26","volume-title":"Crossing the Quality Chasm: A New Health System for the 21st Century","year":"2001"},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.1037\/10063-004","article-title":"\u201cA process approach to neuropsychological assessment,\u201d","author":"Kaplan","year":"1988","journal-title":"Clinical Neuropsychology and Brain Function: Research, Measurement, and Practice"},{"key":"B28","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1176\/jnp.2.1.72","article-title":"The process approach to neuropsychological assessment of psychiatric patients","volume":"2","author":"Kaplan","year":"1990","journal-title":"J. Neuropsychiatry Clin. Neurosci."},{"key":"B29","volume-title":"The WAIS-R as a Neuropsychological Instrument","author":"Kaplan","year":"1991"},{"key":"B30","doi-asserted-by":"publisher","first-page":"2597","DOI":"10.1016\/j.neuropsychologia.2008.04.007","article-title":"The impact of region-specific leukoaraiosis on working memory deficits in dementia","volume":"46","author":"Lamar","year":"2008","journal-title":"Neuropsychologia"},{"key":"B31","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1155\/2010\/505979","article-title":"The dysexecutive syndrome associated with ischaemic vascular disease and related subcortical neuropathology: a Boston process approach","volume":"22","author":"Lamar","year":"2010","journal-title":"Behav. Neurol."},{"key":"B32","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.neuropsychologia.2006.07.009","article-title":"Alterations in working memory as a function of leukoaraiosis in dementia","volume":"45","author":"Lamar","year":"2007","journal-title":"Neuropsychologia"},{"key":"B33","doi-asserted-by":"publisher","first-page":"113","DOI":"10.4172\/jmso.1000113","article-title":"Deficits in processing speed and decision making in relapsing-remitting multiple sclerosis: The Digit Clock Drawing Test (dCDT)","volume":"1","author":"Libon","year":"2014","journal-title":"J. Multiple Scler"},{"key":"B34","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1017\/S1355617711000944","article-title":"Verbal serial list learning in mild cognitive impairment: a profile analysis of interference, forgetting, and errors","volume":"17","author":"Libon","year":"2011","journal-title":"J. Int. Neuropsychol. Soc."},{"key":"B36","doi-asserted-by":"crossref","DOI":"10.1037\/0000076-016","article-title":"\u201cNeuropsychological evaluation for vascular dementia,\u201d","author":"Libon","year":"2018","journal-title":"APA Handbook of Dementia"},{"key":"B37","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1093\/arclin\/11.3.193","article-title":"Further analyses of clock drawings among demented and nondemented older subjects","volume":"11","author":"Libon","year":"1996","journal-title":"Arch. Clin. Neuropsychol."},{"key":"B38","doi-asserted-by":"publisher","first-page":"1280593","DOI":"10.3389\/fpsyg.2023.1280593","article-title":"Using digital assessment technology to detect neuropsychological problems in primary care settings","volume":"14","author":"Libon","year":"","journal-title":"Front. Psychol."},{"key":"B39","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1212\/WNL.0b013e3181b2a4f5","article-title":"Neurocognitive contributions to verbal fluency deficits in frontotemporal lobar degeneration","volume":"73","author":"Libon","year":"2009","journal-title":"Neurology"},{"key":"B40","doi-asserted-by":"publisher","first-page":"2497","DOI":"10.1093\/brain\/awt165","article-title":"Comparative semantic profiles in semantic dementia and Alzheimer's disease","author":"Libon","year":"2013","journal-title":"Brain"},{"key":"B41","article-title":"Double dissociation of verbal serial list learning and semantic fluency test performance through automated analysis of acoustics","author":"Libon","year":"","journal-title":"Front. Neurol."},{"key":"B42","doi-asserted-by":"publisher","first-page":"1419","DOI":"10.3233\/JAD-220096","article-title":"The Boston process approach and digital neuropsychological assessment: past research and future directions","volume":"87","author":"Libon","year":"2022","journal-title":"J. Alzheimers Dis."},{"key":"B43","doi-asserted-by":"publisher","first-page":"405","DOI":"10.1093\/arclin\/8.5.405","article-title":"Clock drawing as an assessment tool for dementia","volume":"8","author":"Libon","year":"1993","journal-title":"Arch. Clin. Neuropsychol."},{"key":"B44","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.neurobiolaging.2022.06.010","article-title":"Voice biomarkers as indicators of cognitive changes in middle and later adulthood","volume":"119","author":"Mahon","year":"2022","journal-title":"Neurobiol. Aging"},{"key":"B45","doi-asserted-by":"publisher","first-page":"4252","DOI":"10.1002\/alz.13051","article-title":"Expanding the use of brief cognitive assessments to detect suspected early-stage cognitive impairment in primary care","volume":"19","author":"Mattke","year":"2023","journal-title":"Alzheimers Dement."},{"key":"B46","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1017\/S1355617722000091","article-title":"Dissociating statistically determined normal cognitive abilities and mild cognitive impairment subtypes with DCTclock","volume":"29","author":"Matusz","year":"2023","journal-title":"J. Int. Neuropsychol. Soc."},{"key":"B47","doi-asserted-by":"publisher","first-page":"989","DOI":"10.1098\/rspb.1996.0146","article-title":"Generating 'tiger' as an animal name or a word beginning with T: differences in brain activation","volume":"263","author":"Mummery","year":"1996","journal-title":"Proc. Biol. Sci."},{"key":"B48","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","article-title":"The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment","volume":"53","author":"Nasreddine","year":"2005","journal-title":"J. Am. Geriatr. Soc."},{"key":"B49","article-title":"\u201cThe Digital Clock Drawing Test (dCDT) - II: A new computerized quantitative System,\u201d","volume-title":"Abstract Presented at the 39TH Annual Meeting of the International Neuropsychological Society","author":"Penney","year":""},{"key":"B50","article-title":"\u201cThe Digital Clock Drawing Test (dCDT) - III: Clinician reliability for a new quantitative system,\u201d","volume-title":"Abstract Presented at the 39TH Annual Meeting of the International Neuropsychological Society","author":"Penney","year":""},{"key":"B51","article-title":"\u201cDigital Clock Drawing Test (dCBT) - IV: Total clock drawing and inter-stroke latencies or information revealed between the lines,\u201d","volume-title":"Abstract Presented at the 39TH Annual Meeting of the International Neuropsychological Society","author":"Penney","year":""},{"key":"B52","doi-asserted-by":"publisher","first-page":"1611","DOI":"10.3233\/JAD-170444","article-title":"Age and graphomotor decision making assessed with the digital clock drawing test: the Framingham Heart Study","volume":"60","author":"Piers","year":"2017","journal-title":"J. Alzheimers Dis."},{"key":"B53","doi-asserted-by":"publisher","first-page":"944","DOI":"10.1080\/13854040802681664","article-title":"Leukoaraiosis severity and list-learning in dementia","volume":"23","author":"Price","year":"2009","journal-title":"Clin. Neuropsychol."},{"key":"B54","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1037\/0894-4105.21.1.20","article-title":"Disparate letter and semantic category fluency deficits in autopsy-confirmed frontotemporal dementia and Alzheimer's disease","volume":"21","author":"Rascovsky","year":"2007","journal-title":"Neuropsychology"},{"key":"B55","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1001\/jama.2023.13239","article-title":"Donanemab in early symptomatic Alzheimer disease: the TRAILBLAZER-ALZ 2 randomized clinical trial","volume":"330","author":"Sims","year":"2023","journal-title":"JAMA"},{"key":"B56","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1007\/s10994-015-5529-5","article-title":"Learning classification models of cognitive conditions from subtle behaviors in the digital clock drawing test","volume":"102","author":"Souillard-Mandar","year":"2016","journal-title":"Mach. Learn."},{"key":"B57","doi-asserted-by":"publisher","first-page":"750661","DOI":"10.3389\/fdgth.2021.750661","article-title":"DCTclock: clinically interpretable and automated artificial intelligence analysis of drawing behavior for capturing cognition","volume":"3","author":"Souillard-Mandar","year":"2021","journal-title":"Fronti. Digit. Health"},{"key":"B58","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1037\/neu0000413","article-title":"Word-list intrusion errors predict progression to mild cognitive impairment","volume":"32","author":"Thomas","year":"2018","journal-title":"Neuropsychology"},{"key":"B59","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1056\/NEJMoa2212948","article-title":"Lecanemab in early Alzheimer's disease","volume":"388","author":"van Dyck","year":"2023","journal-title":"N. Engl. J. Med."},{"key":"B60","volume-title":"The Wechsler Adult Intelligence Scale-III","author":"Wechsler","year":"1997"}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2024.1415629\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T10:44:49Z","timestamp":1720176289000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2024.1415629\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,5]]},"references-count":59,"alternative-id":["10.3389\/fpsyg.2024.1415629"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2024.1415629","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,5]]},"article-number":"1415629"}}