{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T14:07:52Z","timestamp":1772028472108,"version":"3.50.1"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T00:00:00Z","timestamp":1630627200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T00:00:00Z","timestamp":1630627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000065","name":"U.S. Department of Health & Human Services | NIH | National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["P50NS108676"],"award-info":[{"award-number":["P50NS108676"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A prevalent symptom of Parkinson\u2019s disease (PD) is hypomimia \u2014 reduced facial expressions. In this paper, we present a method for diagnosing PD that utilizes the study of micro-expressions. We analyzed the facial action units (AU) from 1812 videos of 604 individuals (61 with PD and 543 without PD, with a mean age 63.9\u2009y\/o, sd. 7.8) collected online through a web-based tool (<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/www.parktest.net\">www.parktest.net<\/jats:ext-link>). In these videos, participants were asked to make three facial expressions (a smiling, disgusted, and surprised face) followed by a neutral face. Using techniques from computer vision and machine learning, we objectively measured the variance of the facial muscle movements and used it to distinguish between individuals with and without PD. The prediction accuracy using the facial micro-expressions was comparable to methodologies that utilize motor symptoms. Logistic regression analysis revealed that participants with PD had less variance in AU6 (cheek raiser), AU12 (lip corner puller), and AU4 (brow lowerer) than non-PD individuals. An automated classifier using Support Vector Machine was trained on the variances and achieved 95.6% accuracy. Using facial expressions as a future digital biomarker for PD could be potentially transformative for patients in need of remote diagnoses due to physical separation (e.g., due to COVID) or immobility.<\/jats:p>","DOI":"10.1038\/s41746-021-00502-8","type":"journal-article","created":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T12:22:07Z","timestamp":1630671727000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["RETRACTED ARTICLE: Facial expressions can detect Parkinson\u2019s disease: preliminary evidence from videos collected online"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7878-7910","authenticated-orcid":false,"given":"Mohammad Rafayet","family":"Ali","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taylor","family":"Myers","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ellen","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Harshil","family":"Ratnu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5140-1248","authenticated-orcid":false,"given":"E. Ray","family":"Dorsey","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ehsan","family":"Hoque","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,9,3]]},"reference":[{"key":"502_CR1","unstructured":"Stoker, T. B. & Greenland, J.C. Parkinson\u2019s Disease: Pathogenesis and Clinical Aspects. Parkinson\u2019s Disease: Pathogenesis and Clinical Aspects (exon publications, 2018)."},{"key":"502_CR2","doi-asserted-by":"publisher","unstructured":"Rinn, W. E. The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions. Psychol. Bull. https:\/\/doi.org\/10.1037\/0033-2909.95.1.52 (1984).","DOI":"10.1037\/0033-2909.95.1.52"},{"key":"502_CR3","unstructured":"Novellino, F. & Salsone, M. A Tool for Evaluating Facial Expression for Early Diagnosis of Parkinson\u2019s Disease. (The Michael J. Fox Foundation, 2018)."},{"key":"502_CR4","doi-asserted-by":"crossref","unstructured":"Vinokurov, N., D. Arkadir, E. Linetsky, H. Bergman, & D. Weinshall. \u201cQuantifying hypomimia in parkinson patients using a depth camera.\u201d In International Symposium on Pervasive Computing Paradigms for Mental Health, pp. 63\u201371 (Springer, 2015).","DOI":"10.1007\/978-3-319-32270-4_7"},{"key":"502_CR5","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1017\/S135561770410413X","volume":"10","author":"G Simons","year":"2004","unstructured":"Simons, G., Pasqualini, M. C. S., Reddy, V. & Wood, J. Emotional and nonemotional facial expressions in people with Parkinson\u2019s disease. J. Int. Neuropsychol. Soc.10, 521 (2004).","journal-title":"J. Int. Neuropsychol. Soc."},{"key":"502_CR6","doi-asserted-by":"publisher","first-page":"1775","DOI":"10.3389\/fneur.2020.603582","volume":"11","author":"T Maycas-Cepeda","year":"2021","unstructured":"Maycas-Cepeda, T. et al. Hypomimia in Parkinson\u2019s disease: what is it telling us? Front. Neurol.11, 1775 (2021).","journal-title":"Front. Neurol."},{"key":"502_CR7","doi-asserted-by":"publisher","unstructured":"Gunnery, S. D., Habermann, B., Saint-Hilaire, M., Thomas, C. A. & Tickle-Degnen, L. The relationship between the experience of hypomimia and social wellbeing in people with Parkinson\u2019s disease and their care partners. J. Parkinsons Dis. https:\/\/doi.org\/10.3233\/JPD-160782 (2016).","DOI":"10.3233\/JPD-160782"},{"key":"502_CR8","doi-asserted-by":"publisher","unstructured":"Lonini, L. et al. Wearable sensors for Parkinson\u2019s disease: which data are worth collecting for training symptom detection models. npj Digit. Med. https:\/\/doi.org\/10.1038\/s41746-018-0071-z (2018).","DOI":"10.1038\/s41746-018-0071-z"},{"key":"502_CR9","doi-asserted-by":"publisher","unstructured":"Schlachetzki, J. C. M. et al. Wearable sensors objectively measure gait parameters in Parkinson\u2019s disease. PLoS ONEhttps:\/\/doi.org\/10.1371\/journal.pone.0183989 (2017).","DOI":"10.1371\/journal.pone.0183989"},{"key":"502_CR10","doi-asserted-by":"crossref","unstructured":"Ekman, P. & Friesen, W. V. Facial Action Coding System: A Technique for the Measurement of Facial Movement (Consulting Psychologists Press, 1978).","DOI":"10.1037\/t27734-000"},{"key":"502_CR11","unstructured":"Rafayet Ali, M., Hernandez, J., Ray Dorsey, E., Hoque, E. & McDuff, D. Spatio-temporal attention and magnification for classification of Parkinson\u2019s disease from videos collected via the internet. in 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)(FG) (2020)."},{"key":"502_CR12","doi-asserted-by":"crossref","unstructured":"Smith, M. C., Smith, M. K. & Ellgring, H. Spontaneous and posed facial expression in Parkinson\u2019s Disease. J. Int. Neuropsychol. Soc. 2, 383\u2013391 (1996).","DOI":"10.1017\/S1355617700001454"},{"key":"502_CR13","doi-asserted-by":"publisher","unstructured":"Lopez Valdes, E. et al. Isolated eyebrow tremor as an initial presentation form of Parkinson\u2019s disease. Mov. Disord. https:\/\/doi.org\/10.1002\/mds.26688 (2016).","DOI":"10.1002\/mds.26688"},{"key":"502_CR14","doi-asserted-by":"publisher","unstructured":"Bower, J. H. & Zenebe, G. Neurologic services in the nations of Africa. Neurologyhttps:\/\/doi.org\/10.1212\/01.WNL.0000150894.53961.E2 (2005).","DOI":"10.1212\/01.WNL.0000150894.53961.E2"},{"key":"502_CR15","unstructured":"Silver, L. & Johnson, C. Majorities In Sub-Saharan Africa Own Mobile Phones, But Smartphone Adoption Is Modest (Pew Research Center, 2019)."},{"key":"502_CR16","doi-asserted-by":"publisher","first-page":"623","DOI":"10.1212\/WNL.0000000000001224","volume":"84","author":"C-T Tan","year":"2015","unstructured":"Tan, C.-T. Neurology in Asia. Neurology84, 623\u2013625 (2015).","journal-title":"Neurology"},{"key":"502_CR17","doi-asserted-by":"publisher","unstructured":"Langevin, R. et al. The PARK Framework for Automated Analysis of Parkinson\u2019s Disease Characteristics. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. Vol. 3. https:\/\/doi.org\/10.1145\/3328925 (2019).","DOI":"10.1145\/3328925"},{"key":"502_CR18","doi-asserted-by":"crossref","unstructured":"Baltrusaitis, T., Zadeh, A., Lim, Y. C. & Morency, L.-P. Openface 2.0: facial behavior analysis toolkit. in 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) 59\u201366 (2018).","DOI":"10.1109\/FG.2018.00019"},{"key":"502_CR19","unstructured":"Amos, B., B. Ludwiczuk, & M. Satyanarayanan. \u201cOpenface: A general-purpose face recognition library with mobile applications.\u201d CMU School of Computer Science. Technical Report CMU-CS-16-118 (2016)."},{"key":"502_CR20","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1016\/j.procs.2018.08.203","volume":"135","author":"K Santoso","year":"2018","unstructured":"Santoso, K. & Kusuma, G. P. Face recognition using modified OpenFace. Proc. Comput. Sci.135, 510\u2013517 (2018).","journal-title":"Proc. Comput. Sci."},{"key":"502_CR21","doi-asserted-by":"crossref","unstructured":"Li, L., Z. Jun, J. Fei, & S. Li. \u201cAn incremental face recognition system based on deep learning.\u201d In 2017 Fifteenth IAPR international conference on machine vision applications (MVA). p. 238\u2013241 (IEEE, 2017).","DOI":"10.23919\/MVA.2017.7986845"},{"key":"502_CR22","doi-asserted-by":"crossref","unstructured":"Ekman, P., Friesen, W. V. & Hager, J. C. Facial action coding system (FACS). A Technique for the Measurement of Facial Action. Consulting, Palo Alto. Vol. 22 (Consulting Psychologists Press, 1978).","DOI":"10.1037\/t27734-000"},{"key":"502_CR23","doi-asserted-by":"crossref","unstructured":"Du, S., Tao, Y. & Martinez, A. M. Compound facial expressions of emotion. Proc. Natl. Acad. Sci. USA2014, E1454\u2013E1462 (2014).","DOI":"10.1073\/pnas.1322355111"},{"key":"502_CR24","doi-asserted-by":"publisher","unstructured":"Armstrong, R. A. When to use the Bonferroni correction. Ophthalmic Physiol. Opt.https:\/\/doi.org\/10.1111\/opo.12131 (2014).","DOI":"10.1111\/opo.12131"},{"key":"502_CR25","doi-asserted-by":"publisher","unstructured":"Chawla, N. V., Bowyer, K. W., Hall, L. O. & Kegelmeyer, W. P. SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. https:\/\/doi.org\/10.1613\/jair.953 (2002).","DOI":"10.1613\/jair.953"}],"updated-by":[{"DOI":"10.1038\/s41746-023-00761-7","type":"retraction","label":"Retraction","source":"retraction-watch","updated":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T00:00:00Z","timestamp":1675382400000},"record-id":"42467"},{"DOI":"10.1038\/s41746-023-00761-7","type":"retraction","label":"Retraction","source":"publisher","updated":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T00:00:00Z","timestamp":1675382400000}}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00502-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00502-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00502-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T12:13:25Z","timestamp":1675426405000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00502-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,3]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["502"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00502-8","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,3]]},"assertion":[{"value":"9 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 September 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2023","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"This article has been retracted. Please see the Retraction Notice for more detail:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1038\/s41746-023-00761-7","URL":"https:\/\/doi.org\/10.1038\/s41746-023-00761-7","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"129"}}