{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T08:11:42Z","timestamp":1783411902477,"version":"3.54.6"},"reference-count":51,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2023,11,13]],"date-time":"2023-11-13T00:00:00Z","timestamp":1699833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC)"},{"name":"Canadian Institutes of Health Research (CIHR)"},{"name":"Collaborative Health Research Project (CHRP)"},{"name":"John Nichol Chair in Parkinson\u2019s Research"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The utilization of Artificial Intelligence (AI) for assessing motor performance in Parkinson\u2019s Disease (PD) offers substantial potential, particularly if the results can be integrated into clinical decision-making processes. However, the precise quantification of PD symptoms remains a persistent challenge. The current standard Unified Parkinson\u2019s Disease Rating Scale (UPDRS) and its variations serve as the primary clinical tools for evaluating motor symptoms in PD, but are time-intensive and prone to inter-rater variability. Recent work has applied data-driven machine learning techniques to analyze videos of PD patients performing motor tasks, such as finger tapping, a UPDRS task to assess bradykinesia. However, these methods often use abstract features that are not closely related to clinical experience. In this paper, we introduce a customized machine learning approach for the automated scoring of UPDRS bradykinesia using single-view RGB videos of finger tapping, based on the extraction of detailed features that rigorously conform to the established UPDRS guidelines. We applied the method to 75 videos from 50 PD patients collected in both a laboratory and a realistic clinic environment. The classification performance agreed well with expert assessors, and the features selected by the Decision Tree aligned with clinical knowledge. Our proposed framework was designed to remain relevant amid ongoing patient recruitment and technological progress. The proposed approach incorporates features that closely resonate with clinical reasoning and shows promise for clinical implementation in the foreseeable future.<\/jats:p>","DOI":"10.3390\/s23229149","type":"journal-article","created":{"date-parts":[[2023,11,13]],"date-time":"2023-11-13T08:44:27Z","timestamp":1699865067000},"page":"9149","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Clinically Informed Automated Assessment of Finger Tapping Videos in Parkinson\u2019s Disease"],"prefix":"10.3390","volume":"23","author":[{"given":"Tianze","family":"Yu","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC V6T 1Z4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8071-9968","authenticated-orcid":false,"given":"Kye Won","family":"Park","sequence":"additional","affiliation":[{"name":"Pacific Parkinson Research Centre, University of British Columbia, Vancouver, BC V6T 1Z4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4048-0817","authenticated-orcid":false,"given":"Martin J.","family":"McKeown","sequence":"additional","affiliation":[{"name":"Pacific Parkinson Research Centre, University of British Columbia, Vancouver, BC V6T 1Z4, Canada"},{"name":"Department of Neurology, Faculty of Medicine, University of British Columbia, Vancouver, BC V6T 1Z4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Z. Jane","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, BC V6T 1Z4, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1111\/ene.14108","article-title":"Parkinson disease","volume":"27","author":"Balestrino","year":"2020","journal-title":"Eur. J. Neurol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kreutzer, J.S., DeLuca, J., and Caplan, B. (2011). Encyclopedia of Clinical Neuropsychology, Springer.","DOI":"10.1007\/978-0-387-79948-3"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1002\/mds.22340","article-title":"Movement Disorder Society-sponsored revision of the Unified Parkinson\u2019s Disease Rating Scale (MDS-UPDRS): Scale presentation and clinimetric testing results","volume":"23","author":"Goetz","year":"2008","journal-title":"Mov. Disord. Off. J. Mov. Disord. Soc."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1038\/s41531-023-00454-8","article-title":"Computer vision quantification of whole-body Parkinsonian bradykinesia using a large multi-site population","volume":"9","author":"Morinan","year":"2023","journal-title":"NPJ Park. Dis."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"411","DOI":"10.4283\/JMAG.2022.27.4.411","article-title":"Quantifying Finger-tapping-test Scores using a Three-dimensional Motion Analysis Program: A Preliminary Study","volume":"27","author":"Park","year":"2022","journal-title":"J. Magn."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Lu, M., Poston, K., Pfefferbaum, A., Sullivan, E.V., Fei-Fei, L., Pohl, K.M., Niebles, J.C., and Adeli, E. (2020, January 4\u20138). Vision-based estimation of MDS-UPDRS gait scores for assessing Parkinson\u2019s disease motor severity. Proceedings of the Medical Image Computing and Computer Assisted Intervention\u2013MICCAI 2020: 23rd International Conference, Lima, Peru. Proceedings, Part III 23.","DOI":"10.1007\/978-3-030-59716-0_61"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"14499","DOI":"10.1007\/s00521-021-06626-y","article-title":"Automated methods for diagnosis of Parkinson\u2019s disease and predicting severity level","volume":"35","author":"Ayaz","year":"2023","journal-title":"Neural Comput. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"35219","DOI":"10.1109\/ACCESS.2022.3162844","article-title":"Parkinson\u2019s disease management via wearable sensors: A systematic review","volume":"10","author":"Mughal","year":"2022","journal-title":"IEEE Access"},{"key":"ref_9","first-page":"5","article-title":"Role of wearable sensors with machine learning approaches in gait analysis for Parkinson\u2019s disease assessment: A review","volume":"19","author":"Balakrishnan","year":"2022","journal-title":"Eng. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.3389\/fneur.2019.01027","article-title":"PKG movement recording system use shows promise in routine clinical care of patients with Parkinson\u2019s disease","volume":"10","author":"Joshi","year":"2019","journal-title":"Front. Neurol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1159\/000518571","article-title":"Real-world evidence for a smartwatch-based parkinson\u2019s motor assessment app for patients undergoing therapy changes","volume":"5","author":"Hadley","year":"2021","journal-title":"Digit. Biomarkers"},{"key":"ref_12","first-page":"1379","article-title":"Remote administration of the MDS-UPDRS in the time of COVID-19 and beyond","volume":"10","author":"Schneider","year":"2020","journal-title":"J. Park. Dis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1002\/mds.29325","article-title":"Potential Pitfalls of Remote and Automated Video Assessments of Movements Disorders","volume":"38","author":"Park","year":"2023","journal-title":"Mov. Disord."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1097\/NRL.0000000000000413","article-title":"Clinical Review of Smartphone Applications in Parkinson\u2019s Disease","volume":"27","author":"Tripathi","year":"2022","journal-title":"Neurologist"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Jeon, H., Lee, W., Park, H., Lee, H.J., Kim, S.K., Kim, H.B., Jeon, B., and Park, K.S. (2017). Automatic classification of tremor severity in Parkinson\u2019s disease using a wearable device. Sensors, 17.","DOI":"10.3390\/s17092067"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1038\/s41746-019-0217-7","article-title":"Development of digital biomarkers for resting tremor and bradykinesia using a wrist-worn wearable device","volume":"3","author":"Mahadevan","year":"2020","journal-title":"NPJ Digit. Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"102459","DOI":"10.1016\/j.artmed.2022.102459","article-title":"Real-time detection of freezing of gait in Parkinson\u2019s disease using multi-head convolutional neural networks and a single inertial sensor","volume":"135","author":"Sigcha","year":"2023","journal-title":"Artif. Intell. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.parkreldis.2022.06.012","article-title":"Quantitative assessment of gait characteristics in patients with Parkinson\u2019s disease using 2D video","volume":"101","author":"Liu","year":"2022","journal-title":"Park. Relat. Disord."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2509910","DOI":"10.1109\/TIM.2022.3176898","article-title":"Comparative study of wearable sensors, video, and handwriting to detect Parkinson\u2019s disease","volume":"71","author":"Talitckii","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ngo, Q.C., Motin, M.A., Pah, N.D., Drot\u00e1r, P., Kempster, P., and Kumar, D. (2022). Computerized analysis of speech and voice for Parkinson\u2019s disease: A systematic review. Comput. Methods Programs Biomed., 226.","DOI":"10.1016\/j.cmpb.2022.107133"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"11923","DOI":"10.1007\/s11042-022-13759-2","article-title":"A literature review of online handwriting analysis to detect Parkinson\u2019s disease at an early stage","volume":"82","author":"Aouraghe","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2207","DOI":"10.1038\/s41591-022-01932-x","article-title":"Artificial intelligence-enabled detection and assessment of Parkinson\u2019s disease using nocturnal breathing signals","volume":"28","author":"Yang","year":"2022","journal-title":"Nat. Med."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3848","DOI":"10.1109\/JBHI.2022.3162386","article-title":"Vision-based finger tapping test in patients with Parkinson\u2019s disease via spatial-temporal 3D hand pose estimation","volume":"26","author":"Guo","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_24","first-page":"563","article-title":"Objective arm swing analysis in early-stage Parkinson\u2019s disease using an RGB-D camera (Kinect\u00ae)","volume":"8","author":"Ospina","year":"2018","journal-title":"J. Park. Dis."},{"key":"ref_25","first-page":"5050182","article-title":"Age matters: Objective gait assessment in early parkinson\u2019s disease using an RGB-D camera","volume":"2019","author":"Navarro","year":"2019","journal-title":"Park. Dis."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1186\/s12984-019-0593-x","article-title":"Leap motion controlled video game-based therapy for upper limb rehabilitation in patients with Parkinson\u2019s disease: A feasibility study","volume":"16","year":"2019","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12938-018-0600-7","article-title":"Objective and automatic classification of Parkinson disease with Leap Motion controller","volume":"17","author":"Butt","year":"2018","journal-title":"Biomed. Eng. Online"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Khwaounjoo, P., Singh, G., Grenfell, S., \u00d6zsoy, B., MacAskill, M.R., Anderson, T.J., and \u00c7akmak, Y.O. (2022). Non-Contact Hand Movement Analysis for Optimal Configuration of Smart Sensors to Capture Parkinson\u2019s Disease Hand Tremor. Sensors, 22.","DOI":"10.3390\/s22124613"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Moshkova, A., Samorodov, A., Voinova, N., Volkov, A., Ivanova, E., and Fedotova, E. (2020, January 20\u201324). Parkinson\u2019s disease detection by using machine learning algorithms and hand movement signal from LeapMotion sensor. Proceedings of the 2020 26th Conference of Open Innovations Association (FRUCT), Yaroslavl, Russia.","DOI":"10.23919\/FRUCT48808.2020.9087433"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5032","DOI":"10.1109\/JBHI.2023.3298530","article-title":"Video-based activity recognition for automated motor assessment of Parkinson\u2019s disease","volume":"10","author":"Sarapata","year":"2023","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Islam, M.S., Rahman, W., Abdelkader, A., Yang, P.T., Lee, S., Adams, J.L., Schneider, R.B., Dorsey, E., and Hoque, E. (2023). Using AI to Measure Parkinson\u2019s Disease Severity at Home. arXiv.","DOI":"10.1038\/s41746-023-00905-9"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e1761","DOI":"10.1212\/WNL.0000000000011654","article-title":"Machine learning\u2013based automatic rating for cardinal symptoms of Parkinson disease","volume":"96","author":"Park","year":"2021","journal-title":"Neurology"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e13517","DOI":"10.7717\/peerj.13517","article-title":"Healthcare applications of single camera markerless motion capture: A scoping review","volume":"10","author":"Scott","year":"2022","journal-title":"PeerJ"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Moro, M., Marchesi, G., Hesse, F., Odone, F., and Casadio, M. (2022). Markerless vs. marker-based gait analysis: A proof of concept study. Sensors, 22.","DOI":"10.3390\/s22052011"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 21\u201326). Realtime multi-person 2d pose estimation using part affinity fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_36","unstructured":"Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C.L., Yong, M.G., and Lee, J. (2004). MediaPipe: A framework for building perception pipelines. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"7157","DOI":"10.1109\/TPAMI.2022.3222784","article-title":"Alphapose: Whole-body regional multi-person pose estimation and tracking in real-time","volume":"45","author":"Fang","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","first-page":"2211","article-title":"Video-Based Automated Assessment of Movement Parameters Consistent with MDS-UPDRS III in Parkinson\u2019s Disease","volume":"12","author":"Vignoud","year":"2022","journal-title":"J. Park. Dis."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"102754","DOI":"10.1016\/j.media.2023.102754","article-title":"Vision-based estimation of MDS-UPDRS scores for quantifying Parkinson\u2019s disease tremor severity","volume":"85","author":"Liu","year":"2023","journal-title":"Med. Image Anal."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.neucom.2021.02.011","article-title":"Automated assessment of Parkinsonian finger tapping tests through a vision-based fine-grained classification model","volume":"441","author":"Li","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Liang, J., Lugmayr, A., Zhang, K., Danelljan, M., Van Gool, L., and Timofte, R. (2021). Hierarchical conditional flow: A unified framework for image super-resolution and image rescaling. arXiv.","DOI":"10.1109\/ICCV48922.2021.00404"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Pan, Z., Li, B., He, D., Yao, M., Wu, W., Lin, T., Li, X., and Ding, E. (2022). Towards bidirectional arbitrary image rescaling: Joint optimization and cycle idempotence. arXiv.","DOI":"10.1109\/CVPR52688.2022.01687"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"012080","DOI":"10.1088\/1742-6596\/1570\/1\/012080","article-title":"Research on Motion Blur Image of Infrared Target Deblurring Based on Wavelet Transform","volume":"1570","author":"Li","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Shi, Z., Xu, X., Liu, X., Chen, J., and Yang, M.H. (2022). Video frame interpolation transformer. arXiv.","DOI":"10.1109\/CVPR52688.2022.01696"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"102918","DOI":"10.1016\/j.media.2023.102918","article-title":"Segment anything model for medical image analysis: An experimental study","volume":"89","author":"Mazurowski","year":"2023","journal-title":"Med. Image Anal."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1080\/15548627.2019.1603545","article-title":"Age-dependent accumulation of oligomeric SNCA\/\u03b1-synuclein from impaired degradation in mutant LRRK2 knockin mouse model of Parkinson disease: Role for therapeutic activation of chaperone-mediated autophagy (CMA)","volume":"16","author":"Ho","year":"2020","journal-title":"Autophagy"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"e28643","DOI":"10.1097\/MD.0000000000028643","article-title":"Gender differences in motor and non-motor symptoms in early Parkinson disease","volume":"101","author":"Kang","year":"2022","journal-title":"Medicine"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"734","DOI":"10.1016\/S1474-4422(11)70143-0","article-title":"Freezing of gait: Moving forward on a mysterious clinical phenomenon","volume":"10","author":"Nutt","year":"2011","journal-title":"Lancet Neurol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1007\/s40846-022-00701-y","article-title":"An Automatic Evaluation Method for Parkinson\u2019s Dyskinesia Using Finger Tapping Video for Small Samples","volume":"42","author":"Li","year":"2022","journal-title":"J. Med. Biol. Eng."},{"key":"ref_50","first-page":"525","article-title":"Parkinsonian hand or clinician\u2019s eye? Finger tap Bradykinesia interrater reliability for 21 movement disorder experts","volume":"13","author":"Williams","year":"2023","journal-title":"J. Park. Dis."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1422","DOI":"10.1111\/j.1460-9568.2009.06681.x","article-title":"Upper limb movement interruptions are correlated to freezing of gait in Parkinson\u2019s disease","volume":"29","author":"Nieuwboer","year":"2009","journal-title":"Eur. J. Neurosci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/22\/9149\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:22:16Z","timestamp":1760131336000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/22\/9149"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,13]]},"references-count":51,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["s23229149"],"URL":"https:\/\/doi.org\/10.3390\/s23229149","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,13]]}}}