{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T22:49:37Z","timestamp":1781909377772,"version":"3.54.5"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["U19 AG062418"],"award-info":[{"award-number":["U19 AG062418"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["U19 AG062418"],"award-info":[{"award-number":["U19 AG062418"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["U19 AG062418"],"award-info":[{"award-number":["U19 AG062418"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["U19 AG062418"],"award-info":[{"award-number":["U19 AG062418"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["U19 AG062418"],"award-info":[{"award-number":["U19 AG062418"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"National Institute on Aging","doi-asserted-by":"publisher","award":["U19 AG062418"],"award-info":[{"award-number":["U19 AG062418"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>COVID-19 has highlighted the need for remote cognitive testing, but the reliability and validity of virtual cognitive testing in Parkinson disease (PD) is unknown. Therefore, we assessed PD participants enrolled in an observational, cognition-focused study with an extensive cognitive battery completed both in-person and via video conference close in time. Data for 35 PD participants with normal cognition to mild dementia were analyzed. Only one test (semantic verbal fluency) demonstrated a difference in score by administration type, with a significantly better score virtually. Only three tests demonstrated good reliability for in-person versus virtual testing, but reliability values for visit 1 versus visit 2 were similarly low overall. Trail Making Test B was successfully administered virtually to only 18 participants due to technical issues. Virtual and in-person cognitive testing generate similar scores at the group level, but with poor to moderate reliability for most tests. Mode of test administration, learning effects, and technical difficulties explained little of the low test\u2013retest reliability, indicating possible significant short-term variability in cognitive performance in PD in general, which has implications for clinical care and research. In-person cognitive testing with a neuropsychologist remains the gold standard, and it remains to be determined if virtual cognitive testing is feasible in PD.<\/jats:p>","DOI":"10.1038\/s41598-023-42934-0","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T14:03:10Z","timestamp":1695823390000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Validating virtual administration of neuropsychological testing in Parkinson disease: a pilot study"],"prefix":"10.1038","volume":"13","author":[{"given":"Julia","family":"Gallagher","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eugenia","family":"Mamikonyan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sharon X.","family":"Xie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baochan","family":"Tran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah","family":"Shaw","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Weintraub","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"issue":"7","key":"42934_CR1","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1080\/13854046.2011.609840","volume":"25","author":"MC Grosch","year":"2011","unstructured":"Grosch, M. C., Gottlieb, M. C. & Cullum, C. M. Initial practice recommendations for teleneuropsychology. Clin. Neuropsychol. 25(7), 1119\u20131133 (2011).","journal-title":"Clin. Neuropsychol."},{"issue":"6","key":"42934_CR2","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1093\/arclin\/acaa046","volume":"35","author":"RM Bilder","year":"2020","unstructured":"Bilder, R. M. et al. Inter organizational practice committee recommendations\/guidance for teleneuropsychology in response to the COVID-19 pandemic. Arch. Clin. Neuropsychol. 35(6), 647\u2013659 (2020).","journal-title":"Arch. Clin. Neuropsychol."},{"issue":"6","key":"42934_CR3","doi-asserted-by":"publisher","first-page":"1429","DOI":"10.1111\/jgs.17190","volume":"69","author":"JA Watt","year":"2021","unstructured":"Watt, J. A. et al. Diagnostic accuracy of virtual cognitive assessment and testing: Systematic review and meta-analysis. J. Am. Geriatr. Soc. 69(6), 1429\u20131440 (2021).","journal-title":"J. Am. Geriatr. Soc."},{"issue":"2","key":"42934_CR4","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1007\/s11065-017-9349-1","volume":"27","author":"TW Brearly","year":"2017","unstructured":"Brearly, T. W. et al. Neuropsychological test administration by videoconference: A systematic review and meta-analysis. Neuropsychol. Rev. 27(2), 174\u2013186 (2017).","journal-title":"Neuropsychol. Rev."},{"issue":"7","key":"42934_CR5","doi-asserted-by":"publisher","first-page":"920","DOI":"10.1089\/tmj.2019.0134","volume":"26","author":"K Iiboshi","year":"2020","unstructured":"Iiboshi, K. et al. A validation study of the remotely administered Montreal Cognitive Assessment tool in the elderly Japanese population. Telemed E-Health 26(7), 920\u2013928 (2020).","journal-title":"Telemed E-Health"},{"issue":"2","key":"42934_CR6","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.jagp.2018.10.009","volume":"27","author":"MT Gentry","year":"2019","unstructured":"Gentry, M. T., Lapid, M. I. & Rummans, T. A. Geriatric telepsychiatry: Systematic review and policy considerations. Am. J. Geriatr. Psychiatry 27(2), 109\u2013127 (2019).","journal-title":"Am. J. Geriatr. Psychiatry"},{"issue":"5","key":"42934_CR7","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1177\/1073191120911098","volume":"28","author":"PR Lee Meeuw Kjoe","year":"2021","unstructured":"Lee Meeuw Kjoe, P. R., Agelink van Rentergem, J. A., Vermeulen, I. E. & Schagen, S. B. How to correct for computer experience in online cognitive testing?. Assessment 28(5), 1247\u20131255 (2021).","journal-title":"Assessment"},{"issue":"1","key":"42934_CR8","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1038\/s41531-021-00177-8","volume":"7","author":"A Naito","year":"2021","unstructured":"Naito, A. et al. Expediting telehealth use in clinical research studies: Recommendations for overcoming barriers in North America. NPJ Parkinsons Dis. 7(1), 34 (2021).","journal-title":"NPJ Parkinsons Dis."},{"issue":"11","key":"42934_CR9","doi-asserted-by":"publisher","first-page":"1897","DOI":"10.1002\/mds.28296","volume":"35","author":"ER Dorsey","year":"2020","unstructured":"Dorsey, E. R., Bloem, B. R. & Okun, M. S. A new day: The role of telemedicine in reshaping care for persons with movement disorders. Mov. Disord. 35(11), 1897\u20131902 (2020).","journal-title":"Mov. Disord."},{"key":"42934_CR10","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.parkreldis.2022.04.009","volume":"98","author":"M Sarno","year":"2022","unstructured":"Sarno, M. et al. Success of home-to-home tele-neuropsychology (TeleNP) in deep brain stimulation (DBS) candidacy assessments: COVID-19 and beyond. Parkinsonism Relat. Disord. 98, 56\u201361 (2022).","journal-title":"Parkinsonism Relat. Disord."},{"key":"42934_CR11","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.parkreldis.2021.04.029","volume":"86","author":"MK York","year":"2021","unstructured":"York, M. K. et al. The global pandemic has permanently changed the state of practice for pre-DBS neuropsychological evaluations. Parkinsonism Relat. Disord. 86, 135\u2013138 (2021).","journal-title":"Parkinsonism Relat. Disord."},{"key":"42934_CR12","doi-asserted-by":"publisher","first-page":"2549","DOI":"10.1002\/mds.28548","volume":"36","author":"RD Dobkin","year":"2021","unstructured":"Dobkin, R. D. et al. Innovating Parkinson\u2019s care: A randomized controlled trial of telemedicine depression treatment. Mov. Disord. 36, 2549\u20132558 (2021).","journal-title":"Mov. Disord."},{"issue":"1","key":"42934_CR13","doi-asserted-by":"publisher","first-page":"910","DOI":"10.1186\/s13063-021-05879-1","volume":"22","author":"AC Lajoie","year":"2021","unstructured":"Lajoie, A. C. et al. Feasibility of remote neurocognitive assessment: Pandemic adaptations for a clinical trial, the Cognition and Obstructive Sleep Apnea in Parkinson\u2019s Disease, Effect of Positive Airway Pressure Therapy (COPE-PAP) study. Trials 22(1), 910 (2021).","journal-title":"Trials"},{"issue":"6","key":"42934_CR14","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1111\/1440-1630.12288","volume":"63","author":"T Stillerova","year":"2016","unstructured":"Stillerova, T., Liddle, J., Gustafsson, L., Lamont, R. & Silburn, P. Could everyday technology improve access to assessments? A pilot study on the feasibility of screening cognition in people with Parkinson\u2019s disease using the Montreal Cognitive Assessment via Internet videoconferencing. Aust. Occup. Ther. J. 63(6), 373\u2013380 (2016).","journal-title":"Aust. Occup. Ther. J."},{"issue":"2","key":"42934_CR15","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1177\/1460458214556373","volume":"22","author":"A Abdolahi","year":"2016","unstructured":"Abdolahi, A. et al. A feasibility study of conducting the Montreal Cognitive Assessment remotely in individuals with movement disorders. Health Inform. J. 22(2), 304\u2013311 (2016).","journal-title":"Health Inform. J."},{"issue":"s1","key":"42934_CR16","doi-asserted-by":"publisher","first-page":"S27","DOI":"10.3233\/JPD-202381","volume":"11","author":"DN Larson","year":"2021","unstructured":"Larson, D. N., Schneider, R. B. & Simuni, T. A new era: The growth of video-based visits for remote management of persons with Parkinson\u2019s disease. J Parkinsons Dis. 11(s1), S27\u2013S34 (2021).","journal-title":"J Parkinsons Dis."},{"key":"42934_CR17","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2020.579934","volume":"11","author":"AP Owens","year":"2020","unstructured":"Owens, A. P. et al. Implementing remote memory clinics to enhance clinical care during and after COVID-19. Front. Psychiatry 11, 579934 (2020).","journal-title":"Front. Psychiatry"},{"issue":"1","key":"42934_CR18","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1186\/s12984-018-0457-9","volume":"15","author":"B Dobbs","year":"2018","unstructured":"Dobbs, B. et al. Generalizing remotely supervised transcranial direct current stimulation (tDCS): Feasibility and benefit in Parkinson\u2019s disease. J. Neuroeng. Rehabil. 15(1), 114 (2018).","journal-title":"J. Neuroeng. Rehabil."},{"key":"42934_CR19","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1212\/WNL.0000000000000066","volume":"82","author":"A Yarnall","year":"2014","unstructured":"Yarnall, A. et al. Characterizing mild cognitive impairment in incident Parkinson disease: The ICICLE-PD study. Neurology 82, 308\u2013316 (2014).","journal-title":"Neurology"},{"issue":"3","key":"42934_CR20","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1080\/13803395.2017.1339017","volume":"40","author":"HEM Feenstra","year":"2018","unstructured":"Feenstra, H. E. M., Murre, J. M. J., Vermeulen, I. E., Kieffer, J. M. & Schagen, S. B. Reliability and validity of a self-administered tool for online neuropsychological testing: The Amsterdam Cognition Scan. J. Clin. Exp. Neuropsychol. 40(3), 253\u2013273 (2018).","journal-title":"J. Clin. Exp. Neuropsychol."},{"issue":"15","key":"42934_CR21","doi-asserted-by":"publisher","first-page":"1276","DOI":"10.1212\/WNL.0000000000002001","volume":"85","author":"K Pigott","year":"2015","unstructured":"Pigott, K. et al. Longitudinal study of normal cognition in Parkinson disease. Neurology 85(15), 1276\u20131282 (2015).","journal-title":"Neurology"},{"key":"42934_CR22","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","volume":"53","author":"Z Nasreddine","year":"2005","unstructured":"Nasreddine, Z. et al. The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. J. Am. Geriatr. Soc. 53, 695\u2013699 (2005).","journal-title":"J. Am. Geriatr. Soc."},{"key":"42934_CR23","first-page":"2001","volume-title":"Dementia Rating Scale-2","author":"S Mattis","year":"2001","unstructured":"Mattis, S. Dementia Rating Scale-2 2001 (Psychological Assessment Resources, Inc., 2001)."},{"key":"42934_CR24","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1177\/107319119900600204","volume":"6","author":"J Gladsjo","year":"1999","unstructured":"Gladsjo, J. et al. Norms for letter and category fluency: Demographic corrections for age, education, and ethnicity. Assessment 6, 147\u2013178 (1999).","journal-title":"Assessment"},{"key":"42934_CR25","volume-title":"The Hopkins Verbal Learning Test-Revised","author":"J Brandt","year":"2001","unstructured":"Brandt, J. & Benedict, R. The Hopkins Verbal Learning Test-Revised (Psychological Assessment Resources, Odessa, 2001)."},{"key":"42934_CR26","first-page":"1997","volume-title":"WMS-III Administration and Scoring Manual","author":"D Wechsler","year":"1997","unstructured":"Wechsler, D. WMS-III Administration and Scoring Manual 1997 (The Psychological Corporation, 1997)."},{"key":"42934_CR27","volume-title":"Symbol Digit Modalities Test: Manual","author":"A Smith","year":"1982","unstructured":"Smith, A. Symbol Digit Modalities Test: Manual (Western Psychological Services, Los Angeles, 1982)."},{"key":"42934_CR28","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/j.acn.2007.12.003","volume":"23","author":"E Hubbard","year":"2008","unstructured":"Hubbard, E. et al. Clock drawing performance in cognitively normal elderly. Arch. Clin. Neuropsychol. 23, 295\u2013327 (2008).","journal-title":"Arch. Clin. Neuropsychol."},{"key":"42934_CR29","doi-asserted-by":"publisher","first-page":"271","DOI":"10.2466\/pms.1958.8.3.271","volume":"8","author":"R Reitan","year":"1958","unstructured":"Reitan, R. Validity of the Trail Making Test as an indicator of organic brain disease. Percept. Psychomotor Skills 8, 271\u2013276 (1958).","journal-title":"Percept. Psychomotor Skills"},{"key":"42934_CR30","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1001\/archneur.1978.00500300038006","volume":"35","author":"A Benton","year":"1978","unstructured":"Benton, A., Varney, N. & Hamsher, K. Visuospatial judgment: A clinical test. Arch. Neurol. 35, 364\u2013367 (1978).","journal-title":"Arch. Neurol."},{"key":"42934_CR31","first-page":"1983","volume-title":"Boston Naming Test","author":"E Kaplan","year":"1983","unstructured":"Kaplan, E., Goodglass, H. & Weintraub, S. Boston Naming Test 1983 (Lea and Febiger, 1983)."},{"key":"42934_CR32","unstructured":"Fahn, S., Elton, R. & members Up. Unified Parkinsons disease rating scale, in Recent developments in Parkinson's disease (eds Fahn, S., Marsden, C., Goldstein, M. & Calne D.) 153\u201363 (Macmillan Healthcare Information, Florham Park, NJ, 1987)."},{"key":"42934_CR33","first-page":"165","volume-title":"Clinical Gerontology: A Guide to Assessment and Intervention","author":"J Sheikh","year":"1986","unstructured":"Sheikh, J. & Yesavage, J. Geriatric Depression Scale (GDS): recent evidence and development of a shorter version. In Clinical Gerontology: A Guide to Assessment and Intervention (ed. Brink, T. L.) 165\u2013173 (The Haworth Press, New York, 1986)."},{"key":"42934_CR34","doi-asserted-by":"publisher","first-page":"2649","DOI":"10.1002\/mds.23429","volume":"25","author":"C Tomlinson","year":"2010","unstructured":"Tomlinson, C. et al. Systematic review of levodopa dose equivalency reporting in Parkinson\u2019s disease. Mov. Disord. 25, 2649\u20132653 (2010).","journal-title":"Mov. Disord."},{"key":"42934_CR35","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.parkreldis.2016.02.020","volume":"25","author":"L Brennan","year":"2016","unstructured":"Brennan, L. et al. The Penn Parkinson\u2019s Daily Activities Questionnaire-15: Psychometric properties of a brief assessment of cognitive instrumental activities of daily living in Parkinson\u2019s disease. Parkinsonism Relat. Disord. 25, 21\u201326 (2016).","journal-title":"Parkinsonism Relat. Disord."},{"issue":"2 Suppl","key":"42934_CR36","doi-asserted-by":"publisher","first-page":"33S","DOI":"10.1097\/00002093-199700112-00005","volume":"11","author":"D Galasko","year":"1997","unstructured":"Galasko, D. et al. An inventory to assess activities of daily living for clinical trials in Alzheimer\u2019s disease. Alzheimer Dis. Assoc. Disord. 11(2 Suppl), 33S-S39 (1997).","journal-title":"Alzheimer Dis. Assoc. Disord."},{"issue":"6","key":"42934_CR37","doi-asserted-by":"publisher","first-page":"909","DOI":"10.1002\/mds.27386","volume":"33","author":"K Ray Chaudhuri","year":"2018","unstructured":"Ray Chaudhuri, K., Poewe, W. & Brooks, D. Motor and nonmotor complications of levodopa: Phenomenology, risk factors, and imaging features. Mov. Disord. 33(6), 909\u2013919 (2018).","journal-title":"Mov. Disord."},{"issue":"1","key":"42934_CR38","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1212\/WNL.0000000000004058","volume":"89","author":"IG McKeith","year":"2017","unstructured":"McKeith, I. G. et al. Diagnosis and management of dementia with Lewy bodies: Fourth consensus report of the DLB Consortium. Neurology 89(1), 88\u2013100 (2017).","journal-title":"Neurology"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-42934-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-42934-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-42934-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T20:27:26Z","timestamp":1700339246000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-42934-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["42934"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-42934-0","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]},"assertion":[{"value":"26 April 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"DW: In the past year Dr. Weintraub has received research funding or support from Michael J. Fox Foundation for Parkinson's Research, Alzheimer's Therapeutic Research Initiative (ATRI), Alzheimer's Disease Cooperative Study (ADCS), International Parkinson and Movement Disorder Society (IPMDS), National Institute on Health (NIH), Parkinson's Foundation; U.S. Department of Veterans Affairs and Acadia Pharmaceuticals; honoraria for consultancy from Acadia Pharmaceuticals, Alkahest, Aptinyx, Cerevel Therapeutics, CHDI Foundation, Clintrex LLC (Otsuka), EcoRl Capital, Eisai, Perring, Gray Matter Technologies, Great Lake Neurotechnologies, Intra-Cellular Therapies, Janssen, Merck, Sage, Scion and Signant Health; and license fee payments from the University of Pennsylvania for the QUIP and QUIP-RS. SX: Dr. Xie receives research funding from U.S. National Institute of Health; serves as a consultant to Roche on a cancer clinical trial. Authors JG, EM, SS, and BT declare no financial or non-financial competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16243"}}