{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:34:14Z","timestamp":1790703254271,"version":"4.1.0"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,12,8]],"date-time":"2020-12-08T00:00:00Z","timestamp":1607385600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,12,8]],"date-time":"2020-12-08T00:00:00Z","timestamp":1607385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Parkinsons Dis."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Digital assessments of motor severity could improve the sensitivity of clinical trials and personalise treatment in Parkinson\u2019s disease (PD) but have yet to be widely adopted. Their ability to capture <jats:italic>individual<\/jats:italic> change across the heterogeneous motor presentations typical of PD remains inadequately tested against current clinical reference standards. We conducted a prospective, dual-site, crossover-randomised study to determine the ability of a 16-item smartphone-based assessment (the index test) to predict subitems from the Movement Disorder Society-Unified Parkinson\u2019s Disease Rating Scale part III (MDS-UPDRS III) as assessed by three blinded clinical raters (the reference-standard). We analysed data from 60 subjects (990 smartphone tests, 2628 blinded video MDS-UPDRS III subitem ratings). Subject-level predictive performance was quantified as the leave-one-subject-out cross-validation (LOSO-CV) accuracy. A pre-specified analysis classified 70.3% (SEM 5.9%) of subjects into a similar category to any of three blinded clinical raters and was better than random (36.7%; SEM 4.3%) classification. Post hoc optimisation of classifier and feature selection improved performance further (78.7%, SEM 5.1%), although individual subtests were variable (range 53.2\u201397.0%). Smartphone-based measures of motor severity have predictive value at the subject level. Future studies should similarly mitigate against subjective and feature selection biases and assess performance across a range of motor features as part of a broader strategy to avoid overly optimistic performance estimates.<\/jats:p>","DOI":"10.1038\/s41531-020-00135-w","type":"journal-article","created":{"date-parts":[[2020,12,8]],"date-time":"2020-12-08T11:04:42Z","timestamp":1607425482000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["The CloudUPDRS smartphone software in Parkinson\u2019s study: cross-validation against blinded human raters"],"prefix":"10.1038","volume":"6","author":[{"given":"Ashwani","family":"Jha","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisa","family":"Menozzi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rebecca","family":"Oyekan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Latorre","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eoin","family":"Mulroy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian R.","family":"Schreglmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cosmin","family":"Stamate","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ioannis","family":"Daskalopoulos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Kueppers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Luchini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John C.","family":"Rothwell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7665-7303","authenticated-orcid":false,"given":"George","family":"Roussos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kailash P.","family":"Bhatia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,12,8]]},"reference":[{"key":"135_CR1","doi-asserted-by":"publisher","first-page":"2129","DOI":"10.1002\/mds.22340","volume":"23","author":"CG Goetz","year":"2008","unstructured":"Goetz, C. G. et al. Movement Disorder Society-sponsored revision of the Unified Parkinson\u2019s Disease Rating Scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov. Disord. 23, 2129\u20132170 (2008).","journal-title":"Mov. Disord."},{"key":"135_CR2","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1056\/NEJMoa1809983","volume":"380","author":"CVM Verschuur","year":"2019","unstructured":"Verschuur, C. V. M. et al. Randomized delayed-start trial of Levodopa in Parkinson\u2019s disease. N. Engl. J. Med. 380, 315\u2013324 (2019).","journal-title":"N. Engl. J. Med."},{"key":"135_CR3","doi-asserted-by":"publisher","first-page":"1927","DOI":"10.1007\/s00415-019-09348-3","volume":"266","author":"A Regnault","year":"2019","unstructured":"Regnault, A. et al. Does the MDS-UPDRS provide the precision to assess progression in early Parkinson\u2019s disease? Learnings from the Parkinson\u2019s progression marker initiative cohort. J. Neurol. 266, 1927\u20131936, https:\/\/doi.org\/10.1007\/s00415-019-09348-3 (2019).","journal-title":"J. Neurol."},{"key":"135_CR4","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/nrneurol.2014.226","volume":"11","author":"D Athauda","year":"2015","unstructured":"Athauda, D. & Foltynie, T. The ongoing pursuit of neuroprotective therapies in Parkinson disease. Nat. Rev. Neurol. 11, 25\u201340 (2015).","journal-title":"Nat. Rev. Neurol."},{"key":"135_CR5","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1159\/000477383","volume":"1","author":"ER Dorsey","year":"2017","unstructured":"Dorsey, E. R., Papapetropoulos, S., Xiong, M. & Kieburtz, K. The first frontier: digital biomarkers for neurodegenerative disorders. Digit. Biomark 1, 6\u201313 (2017).","journal-title":"Digit. Biomark"},{"key":"135_CR6","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1002\/mdc3.12239","volume":"3","author":"P Kassavetis","year":"2015","unstructured":"Kassavetis, P., Saifee, T. A., Roussos, G., Drougkas, L. & Kojovic, M. Developing a tool for remote digital assessment of Parkinsonas disease. Mov. Disord. Clin. Pract. 3, 59\u201364 (2015).","journal-title":"Mov. Disord. Clin. Pract."},{"key":"135_CR7","doi-asserted-by":"publisher","first-page":"650","DOI":"10.1016\/j.parkreldis.2015.02.026","volume":"21","author":"S Arora","year":"2015","unstructured":"Arora, S. et al. Detecting and monitoring the symptoms of Parkinson\u2019 s disease using smartphones: a pilot study. Park. Relat. Disord. 21, 650\u2013653 (2015).","journal-title":"Park. Relat. Disord."},{"key":"135_CR8","doi-asserted-by":"publisher","first-page":"876","DOI":"10.1001\/jamaneurol.2018.0809","volume":"75","author":"A Zhan","year":"2018","unstructured":"Zhan, A. et al. Using smartphones and machine learning to quantify Parkinson disease severity the mobile Parkinson disease score. JAMA Neurol. 75, 876\u2013880 (2018).","journal-title":"JAMA Neurol."},{"key":"135_CR9","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1002\/mds.27671","volume":"34","author":"AJ Espay","year":"2019","unstructured":"Espay, A. J. et al. A roadmap for implementation of patient-centered digital outcome measures in Parkinson\u2019s disease obtained using mobile health technologies. Mov. Disord. 34, 657\u2013663 (2019).","journal-title":"Mov. Disord."},{"key":"135_CR10","doi-asserted-by":"publisher","first-page":"1287","DOI":"10.1002\/mds.27376","volume":"33","author":"F Lipsmeier","year":"2018","unstructured":"Lipsmeier, F. et al. Evaluation of smartphone-based testing to generate exploratory outcome measures in a phase 1 Parkinson\u2019s disease clinical trial. Mov. Disord. 33, 1287\u20131297 (2018).","journal-title":"Mov. Disord."},{"key":"135_CR11","doi-asserted-by":"publisher","first-page":"E1528","DOI":"10.1212\/WNL.0000000000006366","volume":"91","author":"S Arora","year":"2018","unstructured":"Arora, S. et al. Smartphone motor testing to distinguish idiopathic REM sleep behavior disorder, controls, and PD. Neurology 91, E1528\u2013E1538 (2018).","journal-title":"Neurology"},{"key":"135_CR12","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1111\/ejn.14094","volume":"49","author":"JC Greenland","year":"2019","unstructured":"Greenland, J. C., Williams-Gray, C. H. & Barker, R. A. The clinical heterogeneity of Parkinson\u2019s disease and its therapeutic implications. Eur. J. Neurosci. 49, 328\u2013338 (2019).","journal-title":"Eur. J. Neurosci."},{"key":"135_CR13","doi-asserted-by":"publisher","unstructured":"Lee, C. Y. et al. A validation study of a smartphone-based finger tapping application for quantitative assessment of bradykinesia in Parkinson\u2019s disease. PLoS ONE 11, e0158852, https:\/\/doi.org\/10.1371\/journal.pone.0158852 (2016).","DOI":"10.1371\/journal.pone.0158852"},{"key":"135_CR14","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1016\/j.parkreldis.2014.02.022","volume":"20","author":"DA Heldman","year":"2014","unstructured":"Heldman, D. A., Espay, A. J., LeWitt, P. A. & Giuffrida, J. P. Clinician versus machine: reliability and responsiveness of motor endpoints in Parkinson\u2019s disease. Park. Relat. Disord. 20, 590\u2013595 (2014).","journal-title":"Park. Relat. Disord."},{"key":"135_CR15","doi-asserted-by":"publisher","first-page":"160011","DOI":"10.1038\/sdata.2016.11","volume":"3","author":"BM Bot","year":"2016","unstructured":"Bot, B. M. et al. The mPower study, Parkinson disease mobile data collected using ResearchKit. Sci. Data 3, 160011 (2016).","journal-title":"Sci. Data"},{"key":"135_CR16","doi-asserted-by":"publisher","first-page":"462","DOI":"10.1002\/mdc3.12798","volume":"6","author":"H Hasan","year":"2019","unstructured":"Hasan, H. et al. The BRadykinesia Akinesia INcoordination (BRAIN) tap test: capturing the sequence effect. Mov. Disord. Clin. Pract. 6, 462\u2013469 (2019).","journal-title":"Mov. Disord. Clin. Pract."},{"key":"135_CR17","doi-asserted-by":"publisher","unstructured":"Printy, B. P. et al. Smartphone application for classification of motor impairment severity in Parkinson\u2019s disease. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2014, 2686\u20132689. https:\/\/doi.org\/10.1109\/EMBC.2014.6944176 (2014).","DOI":"10.1109\/EMBC.2014.6944176"},{"key":"135_CR18","doi-asserted-by":"publisher","unstructured":"Kostikis, N., Hristu-Varsakelis, D., Arnaoutoglou, M. & Kotsavasiloglou, C. Smartphone-based evaluation of parkinsonian hand tremor: Quantitative measurements vs clinical assessment scores. Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 2014, 906\u2013909. https:\/\/doi.org\/10.1109\/EMBC.2014.6943738 (2014).","DOI":"10.1109\/EMBC.2014.6943738"},{"key":"135_CR19","doi-asserted-by":"publisher","first-page":"65","DOI":"10.4103\/jmss.JMSS_50_17","volume":"8","author":"O Bazgir","year":"2018","unstructured":"Bazgir, O., Habibi, S. A. H., Palma, L., Pierleoni, P. & Nafees, S. A classification system for assessment and home monitoring of tremor in patients with Parkinson\u2019s disease. J. Med. Signals Sens. 8, 65\u201372 (2018).","journal-title":"J. Med. Signals Sens."},{"key":"135_CR20","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1136\/jnnp.51.6.745","volume":"51","author":"WRG Gibb","year":"1988","unstructured":"Gibb, W. R. G. & Lees, A. J. The relevance of the Lewy body to the pathogenesis of idiopathic Parkinson\u2019s disease. J. Neurol. Neurosurg. Psychiatry 51, 745\u2013752 (1988).","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"135_CR21","doi-asserted-by":"publisher","first-page":"1272","DOI":"10.1212\/WNL.0b013e318230208a","volume":"77","author":"HC Rossetti","year":"2011","unstructured":"Rossetti, H. C., Lacritz, L. H., Munro Cullum, C. & Weiner, M. F. Normative data for the Montreal Cognitive Assessment (MoCA) in a population-based sample. Neurology 77, 1272\u20131275 (2011).","journal-title":"Neurology"},{"key":"135_CR22","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/0272-7358(88)90050-5","volume":"8","author":"AT Beck","year":"1988","unstructured":"Beck, A. T., Steer, R. A. & Carbin, M. G. Psychometric properties of the Beck Depression Inventory: twenty-five years of evaluation. Clin. Psychol. Rev. 8, 77\u2013100 (1988).","journal-title":"Clin. Psychol. Rev."},{"key":"135_CR23","unstructured":"Crispin, J, Fitzpatrick, R. and Peto, V. Parkinson\u2019s Disease Quality of Life Questionnaire (PDQ-39) (Oxford University, 1993)."},{"key":"135_CR24","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1212\/WNL.17.5.427","volume":"17","author":"MM Hoehn","year":"1967","unstructured":"Hoehn, M. M. & Yahr, M. D. Parkinsonism: onset, progression, and mortality. Neurology 17, 427\u2013442 (1967).","journal-title":"Neurology"},{"key":"135_CR25","unstructured":"Kueppers, S. et al. From wellness to medical diagnostic apps: the Parkinson\u2019s disease case. In Giokas K., Bokor L., Hopfgartner F. (eds) eHealth 360\u00b0. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, Vol. 181. Springer, Cham (2017)."},{"key":"135_CR26","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1016\/j.pmcj.2017.12.005","volume":"43","author":"C Stamate","year":"2018","unstructured":"Stamate, C. et al. The cloudUPDRS app: a medical device for the clinical assessment of Parkinson\u2019s Disease. Pervasive Mob. Comput. 43, 146\u2013166 (2018).","journal-title":"Pervasive Mob. Comput."},{"key":"135_CR27","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1037\/h0031619","volume":"76","author":"JL Fleiss","year":"1971","unstructured":"Fleiss, J. L. Measuring nominal scale agreement among many raters. Psychol. Bull. 76, 378\u2013382 (1971).","journal-title":"Psychol. Bull."}],"container-title":["npj Parkinson's Disease"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41531-020-00135-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41531-020-00135-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41531-020-00135-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,6]],"date-time":"2022-12-06T03:04:44Z","timestamp":1670295884000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41531-020-00135-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,8]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["135"],"URL":"https:\/\/doi.org\/10.1038\/s41531-020-00135-w","relation":{},"ISSN":["2373-8057"],"issn-type":[{"value":"2373-8057","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,8]]},"assertion":[{"value":"29 May 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 October 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 December 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"None concerning the research presented here. A.J. has received fees from Sanofi\/Genzyme, Britannia and Novartis. All other authors declare no financial or non-financial competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"36"}}