{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T02:09:33Z","timestamp":1788487773441,"version":"build-2803163510"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"14","license":[{"start":{"date-parts":[[2025,7,9]],"date-time":"2025-07-09T00:00:00Z","timestamp":1752019200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,9]],"date-time":"2025-07-09T00:00:00Z","timestamp":1752019200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Davos Alzheimer's Collaborative"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J GEN INTERN MED"],"published-print":{"date-parts":[[2025,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Digital cognitive assessment solutions can overcome some barriers to cognitive screening in primary care by providing rapidly obtained objective insights without requiring specialty trained examiners. Real-world comparison of digital assessments to standard screenings in primary care is limited.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Our objective was to compare performance on the Linus Health Digital Clock and Recall (DCR\u2122) to the Montreal Cognitive Assessment (MOCA), which is a traditional \u201cgold standard\u201d cognitive screening test in primary care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Participants<\/jats:title>\n                    <jats:p>\n                      A total of 114 primary care patients\u2009\u2265\u200965\u00a0years old completed a DCR as part of routine primary care and scored in the \u201c\n                      <jats:italic>Borderline<\/jats:italic>\n                      \u201d or \u201c\n                      <jats:italic>Impaired<\/jats:italic>\n                      \u201d ranges, and subsequently completed a MOCA at a follow-up primary care visit.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design<\/jats:title>\n                    <jats:p>\n                      Criterion and convergent validity analyses were conducted using Mann\u2013Whitney\n                      <jats:italic>U<\/jats:italic>\n                      tests, concordance (agreement) rates, polychoric or polyserial correlations, and exploratory factor analysis.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Main Measures<\/jats:title>\n                    <jats:p>DCR and MOCA Total Scores and subcomponent scores.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Key Results<\/jats:title>\n                    <jats:p>DCR Total Score and select process scores successfully discriminated impairment on the MOCA using traditional cutoffs, and both agreement rates and correlations were strong between DCR and MOCA components\u2014especially Total Scores comparisons. Exploratory factor analysis revealed a five-factor model whereby one factor was comprised of memory subtests from both the DCR and MOCA, and another was comprised of non-memory MOCA subtests and Information Processing\/Spatial Reasoning subcomponents of the DCR.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Screening in primary care using the DCR is feasible, and shows criterion and convergent validity with a \u201cgold standard\u201d screening tool for detecting cognitive impairment\u2014the MOCA. When paired with parallel advancements in detection of plasma-based biomarkers and recent FDA approvals for disease-modifying treatments for Alzheimer\u2019s disease, the DCR and similar digital cognitive assessment tools have the potential to triage patients for both Alzheimer\u2019s disease diagnostic workups and subsequent treatments beyond specialty care.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s11606-025-09702-4","type":"journal-article","created":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T09:42:44Z","timestamp":1752140564000},"page":"3394-3402","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Performance of Older Adults on the Digital Clock and Recall Test Compared to the Montreal Cognitive Assessment in Primary Care Settings"],"prefix":"10.1007","volume":"40","author":[{"given":"Dustin B.","family":"Hammers","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Schulman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicole R.","family":"Fowler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jane","family":"Musema","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jared R.","family":"Brosch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diana","family":"Summanwar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristen","family":"Swartzell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Connor","family":"Higgins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Russell","family":"Banks","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine J.","family":"Selzler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timothy","family":"MacLeod","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"Tobyne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Deanna R.","family":"Willis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,9]]},"reference":[{"issue":"1","key":"9702_CR1","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1177\/1533317514522852","volume":"30","author":"S Zygouris","year":"2015","unstructured":"Zygouris S, Tsolaki M. Computerized cognitive testing for older adults: a review. Am J Alzheimers Dis Other Demen. 2015;30(1):13-28. https:\/\/doi.org\/10.1177\/1533317514522852.","journal-title":"Am J Alzheimers Dis Other Demen."},{"key":"9702_CR2","doi-asserted-by":"crossref","unstructured":"Hammers D. Teleneuropsychology and Applications of Technology. In: Bush SS, Yochim BP, eds. A Handbook of Geriatric Neuropsychology. In: 2nd ed. New York: Routledge; 2022:267\u201385","DOI":"10.4324\/9781003100058-18"},{"issue":"4","key":"9702_CR3","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1177\/1533317511411907","volume":"26","author":"D Hammers","year":"2011","unstructured":"Hammers D, Spurgeon E, Ryan K, et al. Reliability of repeated cognitive assessment of dementia using a brief computerized battery. Am J Alzheimers Dis Other Demen. 2011;26(4):326-33. https:\/\/doi.org\/10.1177\/1533317511411907.","journal-title":"Am J Alzheimers Dis Other Demen."},{"issue":"4","key":"9702_CR4","doi-asserted-by":"publisher","first-page":"3407","DOI":"10.3390\/ijerph20043407","volume":"20","author":"AI Stoumpos","year":"2023","unstructured":"Stoumpos AI, Kitsios F, Talias MA. Digital Transformation in Healthcare: Technology Acceptance and Its Applications. Int J Environ Res Public Health. 2023;20(4):3407. https:\/\/doi.org\/10.3390\/ijerph20043407.","journal-title":"Int J Environ Res Public Health."},{"issue":"7\u20138","key":"9702_CR5","doi-asserted-by":"publisher","first-page":"1411","DOI":"10.1080\/13854046.2020.1769192","volume":"34","author":"DE Marra","year":"2020","unstructured":"Marra DE, Hamlet KM, Bauer RM, Bowers D. Validity of teleneuropsychology for older adults in response to COVID-19: A systematic and critical review. Clin Neuropsychol. 2020;34(7-8):1411-52. https:\/\/doi.org\/10.1080\/13854046.2020.1769192.","journal-title":"Clin Neuropsychol."},{"issue":"11","key":"9702_CR6","doi-asserted-by":"publisher","first-page":"1021","DOI":"10.1002\/1099-1166(200011)15:11<1021::aid-gps234>3.0.co;2-6","volume":"15","author":"S Borson","year":"2000","unstructured":"Borson S, Scanlan J, Brush M, Vitaliano P, Dokmak A. The mini-cog: a cognitive \u2018vital signs\u2019 measure for dementia screening in multi-lingual elderly. Int J Geriatr Psychiatry. 2000;15(11):1021-27. https:\/\/doi.org\/10.1002\/1099-1166(200011)15:11<1021::aid-gps234>3.0.co;2-6.","journal-title":"Int J Geriatr Psychiatry."},{"key":"9702_CR7","doi-asserted-by":"crossref","unstructured":"Folstein MF, Folstein SE, McHugh PR. \u201cMini-mental state\u201d. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189\u2013198. 0.1016\/0022\u20133956(75)90026\u20136.","DOI":"10.1016\/0022-3956(75)90026-6"},{"key":"9702_CR8","doi-asserted-by":"publisher","unstructured":"Gomes-Osman J, Borson S, Toro-Serey C, Banks R, Ciesla M, Jannati A, Morrow WI, Swenson R, Libon D, Bates D, Showalter J, Tobyne S, Pascual-Leone, A. Front Hum Neurosci. 2024; 18. https:\/\/doi.org\/10.3389\/fnhum.20241337851.","DOI":"10.3389\/fnhum.20241337851"},{"issue":"1","key":"9702_CR9","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/s13195-023-01367-7","volume":"16","author":"A Jannati","year":"2024","unstructured":"Jannati A, Toro-Serey C, Gomes-Osman J, et al. Digital Clock and Recall is superior to the Mini-Mental State Examination for the detection of mild cognitive impairment and mild dementia. Alzheimers Res Ther. 2024;16(1):2. https:\/\/doi.org\/10.1186\/s13195-023-01367-7.","journal-title":"Alzheimers Res Ther."},{"key":"9702_CR10","doi-asserted-by":"publisher","first-page":"1328333","DOI":"10.3389\/fnagi.2023.1328333","volume":"15","author":"M Ciesla","year":"2024","unstructured":"Ciesla M, Pobst J, Gomes-Osman J, et al. Estimating dementia risk in an African American population using the DCTclock. Front Aging Neurosci. 2024;15:1328333. https:\/\/doi.org\/10.3389\/fnagi.2023.1328333.","journal-title":"Front Aging Neurosci."},{"issue":"4","key":"9702_CR11","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","volume":"53","author":"ZS Nasreddine","year":"2005","unstructured":"Nasreddine ZS, Phillips NA, B\u00e9dirian V, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695-99. https:\/\/doi.org\/10.1111\/j.1532-5415.2005.53221.x","journal-title":"J Am Geriatr Soc."},{"key":"9702_CR12","unstructured":"Siddiqui M, Nyahoda T, Traber C, Elliott S, Wang V, Toledo-Franco L, Rodin MB. Screening for Cognitive Impairment in Primary Care: Rationale and Tools. Missouri Med. 2023 Nov-Dec;120(6):431\u2013439. PMID: 38144923; PMCID: PMC10743330."},{"key":"9702_CR13","doi-asserted-by":"crossref","unstructured":"Fowler NR, Hammers DB, Perkins AJ, Summanwar D, Higbie A, Swartzell K, Brosch JR, Willis DR. Feasibility and acceptability of implementing a digital cognitive assessment for Alzheimer's disease and related dementias in Primary Care. 2024 Annals of Family Medicine (Under Review).","DOI":"10.1370\/afm.240293"},{"key":"9702_CR14","doi-asserted-by":"publisher","unstructured":"Souillard-Mandar W, Penney D, Schaible B, Pascual-Leone A, Au R, Davis R (2021) DCTclock: Clinically-Interpretable and Automated Artificial Intelligence Analysis of Drawing Behavior for Capturing Cognition. Front Digit Health. 3. https:\/\/doi.org\/10.3389\/fdgth.2021.750661","DOI":"10.3389\/fdgth.2021.750661"},{"key":"9702_CR15","unstructured":"United States Food and Drug Administration. Statistical Guidance on Reporting Results from Studies Evaluating Diagnostic Tests \u2013 Guidance for Industry and FDA Staff. Available at: https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/statistical-guidance-reporting-results-studies-evaluating-diagnostic-tests-guidance-industry-and-fda. Accessed August 19, 2024."},{"issue":"2","key":"9702_CR16","doi-asserted-by":"publisher","first-page":"119","DOI":"10.2307\/2685469","volume":"52","author":"A Agresti","year":"1998","unstructured":"Agresti A, Coull BA. Approximate is better than \u201cexact\u201d for interval estimation of binomial proportions. Am Stat. 1998;52(2):119-26. https:\/\/doi.org\/10.2307\/2685469.","journal-title":"Am Stat."},{"issue":"1","key":"9702_CR17","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/s11135-008-9190-y","volume":"44","author":"FP Holgado-Tello","year":"2010","unstructured":"Holgado-Tello, F. P., Chac\u00f3n-Moscoso, S., Barbero-Garc\u00eda, I., & Vila-Abad, E. (2010). Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Quality & Quantity: International Journal of Methodology, 44(1), 153-166. https:\/\/doi.org\/10.1007\/s11135-008-9190-y","journal-title":"Quality & Quantity: International Journal of Methodology"},{"issue":"4","key":"9702_CR18","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1037\/met0000230","volume":"24","author":"S Lim","year":"2019","unstructured":"Lim S, Jahng S (2019) Determining the number of factors using parallel analysis and its recent variants. Psychol Methods 24(4):452\u2013467. https:\/\/doi.org\/10.1037\/met0000230","journal-title":"Psychol Methods"},{"issue":"3","key":"9702_CR19","doi-asserted-by":"publisher","first-page":"e0298686","DOI":"10.1371\/journal.pone.0298686","volume":"19","author":"SN Abayomi","year":"2024","unstructured":"Abayomi SN, Sritharan P, Yan E et al (2024) The diagnostic accuracy of the Mini-Cog screening tool for the detection of cognitive impairment-A systematic review and meta-analysis. PLoS One. 19(3):e0298686. https:\/\/doi.org\/10.1371\/journal.pone.0298686","journal-title":"PLoS One."},{"issue":"3","key":"9702_CR20","doi-asserted-by":"publisher","first-page":"750661","DOI":"10.3389\/fdgth.2021.750661.PMID:34723243;PMCID:PMC8553980","volume":"15","author":"W Souillard-Mandar","year":"2021","unstructured":"Souillard-Mandar W, Penney D, Schaible B, Pascual-Leone A, Au R, Davis R (2021) DCTclock: Clinically-Interpretable and Automated Artificial Intelligence Analysis of Drawing Behavior for Capturing Cognition. Front Digit Health. 15(3):750661. https:\/\/doi.org\/10.3389\/fdgth.2021.750661.PMID:34723243;PMCID:PMC8553980","journal-title":"Front Digit Health."},{"issue":"14","key":"9702_CR21","doi-asserted-by":"publisher","first-page":"e1844","DOI":"10.1212\/WNL.0000000000011697","volume":"96","author":"DM Rentz","year":"2021","unstructured":"Rentz DM, Papp KV, Mayblyum DV, et al. Association of Digital Clock Drawing With PET Amyloid and Tau Pathology in Normal Older Adults. Neurology. 2021;96(14):e1844-54. https:\/\/doi.org\/10.1212\/WNL.0000000000011697.","journal-title":"Neurology."},{"key":"9702_CR22","first-page":"24","volume":"2020","author":"AM Staffaroni","year":"2020","unstructured":"Staffaroni AM, Tsoy E, Taylor J, Boxer AL, Possin KL (2020) Digital Cognitive Assessments for Dementia: Digital assessments may enhance the efficiency of evaluations in neurology and other clinics. Pract Neurol (Fort Wash Pa) 2020:24\u201345","journal-title":"Pract Neurol (Fort Wash Pa)"},{"issue":"1","key":"9702_CR23","doi-asserted-by":"publisher","first-page":"e12217","DOI":"10.1002\/dad2.12217","volume":"13","author":"F \u00d6hman","year":"2021","unstructured":"\u00d6hman F, Hassenstab J, Berron D, Sch\u00f6ll M, Papp KV (2021) Current advances in digital cognitive assessment for preclinical Alzheimer\u2019s disease. Alzheimer\u2019s & Dementia: Diagnosis, Assessment & Disease Monitoring 13(1):e12217. https:\/\/doi.org\/10.1002\/dad2.12217","journal-title":"Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring"},{"key":"9702_CR24","doi-asserted-by":"crossref","unstructured":"Bush, S. (2004). A Casebook of Ethical Challenges in Neuropsychology: Taylor & Francis.","DOI":"10.4324\/9780203025505"},{"key":"9702_CR25","doi-asserted-by":"publisher","unstructured":"van der Landen, S. M., van den Berg, R. L., Keijzer, M. J., van Liere, M. N., de Boer, C., Visser, L. N. C., . . . Sikkes, S. A. M. (2025). Focus groups on digital cognitive assessment in the context of Alzheimer's disease. Digit Health, 11, 20552076251318903. https:\/\/doi.org\/10.1177\/20552076251318903","DOI":"10.1177\/20552076251318903"},{"issue":"1","key":"9702_CR26","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1186\/s13584-021-00465-x","volume":"10","author":"A Bloch","year":"2021","unstructured":"Bloch A, Maril S, Kav\u00e9 G (2021) How, when, and for whom: decisions regarding remote neuropsychological assessment during the 2020 COVID-19 pandemic. Isr J Health Policy Res 10(1):31. https:\/\/doi.org\/10.1186\/s13584-021-00465-x","journal-title":"Isr J Health Policy Res"},{"key":"9702_CR27","doi-asserted-by":"publisher","first-page":"426","DOI":"10.1038\/s41582-024-00977-5","volume":"20","author":"SE Schindler","year":"2024","unstructured":"Schindler SE, Galasko D, Pereira AC et al (2024) Acceptable performance of blood biomarker tests of amyloid pathology \u2014 recommendations from the Global CEO Initiative on Alzheimer\u2019s Disease. Nat Rev Neurol 20:426\u2013439. https:\/\/doi.org\/10.1038\/s41582-024-00977-5","journal-title":"Nat Rev Neurol"},{"issue":"2","key":"9702_CR28","doi-asserted-by":"publisher","first-page":"101","DOI":"10.2307\/1165329","volume":"25","author":"A Vargha","year":"2000","unstructured":"Vargha A, Delaney HD (2000) A critique and improvement of the CL common language effect size statistics of McGraw and Wong. J Educ Behav Stat. 25(2):101\u2013132. https:\/\/doi.org\/10.2307\/1165329","journal-title":"J Educ Behav Stat."}],"updated-by":[{"DOI":"10.1007\/s11606-026-10271-3","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T00:00:00Z","timestamp":1772064000000}}],"container-title":["Journal of General Internal Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11606-025-09702-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11606-025-09702-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11606-025-09702-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T21:27:34Z","timestamp":1772141254000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11606-025-09702-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,9]]},"references-count":28,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2025,11]]}},"alternative-id":["9702"],"URL":"https:\/\/doi.org\/10.1007\/s11606-025-09702-4","relation":{},"ISSN":["0884-8734","1525-1497"],"issn-type":[{"value":"0884-8734","type":"print"},{"value":"1525-1497","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,9]]},"assertion":[{"value":"21 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 February 2026","order":5,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":6,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s11606-026-10271-3","URL":"https:\/\/doi.org\/10.1007\/s11606-026-10271-3","order":8,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations:"}},{"value":"DBH, NRF, JM, JRB, DS, KS, RB, KJS, TM, and DRW have no conflicts of interest.DS, CH, and ST are employees of Linus Health.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest:"}},{"value":"Institutional Review Board approval was provided by Indiana University, with a waiver of written consent obtained.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Human Ethics and Consent to Participate:"}}]}}