{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T23:02:22Z","timestamp":1781737342190,"version":"3.54.5"},"reference-count":38,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T00:00:00Z","timestamp":1722384000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Mayson Family Fund"},{"name":"the McCamish Parkinson\u2019s Disease Innovation Program"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Tremor, defined as an \u201cinvoluntary, rhythmic, oscillatory movement of a body part\u201d, is a key feature of many neurological conditions including Parkinson\u2019s disease and essential tremor. Clinical assessment continues to be performed by visual observation with quantification on clinical scales. Methodologies for objectively quantifying tremor are promising but remain non-standardized across centers. Our center performs full-body behavioral testing with 3D motion capture for clinical and research purposes in patients with Parkinson\u2019s disease, essential tremor, and other conditions. The objective of this study was to assess the ability of several candidate processing pipelines to identify the presence or absence of tremor in kinematic data from patients with confirmed movement disorders and compare them to expert ratings from movement disorders specialists. We curated a database of 2272 separate kinematic data recordings from our center, each of which was contemporaneously annotated as tremor present or absent by a movement physician. We compared the ability of six separate processing pipelines to recreate clinician ratings based on F1 score, in addition to accuracy, precision, and recall. The performance across algorithms was generally comparable. The average F1 score was 0.84\u00b10.02 (mean \u00b1 SD; range 0.81\u20130.87). The second highest performing algorithm (cross-validated F1=0.87) was a hybrid that used engineered features adapted from an algorithm in longstanding clinical use with a modern Support Vector Machine classifier. Taken together, our results suggest the potential to update legacy clinical decision support systems to incorporate modern machine learning classifiers to create better-performing tools.<\/jats:p>","DOI":"10.3390\/s24154960","type":"journal-article","created":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T10:34:43Z","timestamp":1722422083000},"page":"4960","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Development of a Tremor Detection Algorithm for Use in an Academic Movement Disorders Center"],"prefix":"10.3390","volume":"24","author":[{"given":"Mark","family":"Saad","sequence":"first","affiliation":[{"name":"Jean and Paul Amos Parkinson\u2019s Disease and Movement Disorders Program, Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sofia","family":"Hefner","sequence":"additional","affiliation":[{"name":"Department of Neuroscience, Georgia Institute of Technology, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0145-5651","authenticated-orcid":false,"given":"Suzann","family":"Donovan","sequence":"additional","affiliation":[{"name":"Department of Neuroscience and Behavioral Biology, College of Arts and Sciences, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Doug","family":"Bernhard","sequence":"additional","affiliation":[{"name":"Jean and Paul Amos Parkinson\u2019s Disease and Movement Disorders Program, Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8228-9052","authenticated-orcid":false,"given":"Richa","family":"Tripathi","sequence":"additional","affiliation":[{"name":"Jean and Paul Amos Parkinson\u2019s Disease and Movement Disorders Program, Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0449-973X","authenticated-orcid":false,"given":"Stewart A.","family":"Factor","sequence":"additional","affiliation":[{"name":"Jean and Paul Amos Parkinson\u2019s Disease and Movement Disorders Program, Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3494-2376","authenticated-orcid":false,"given":"Jeanne M.","family":"Powell","sequence":"additional","affiliation":[{"name":"Department of Psychology, Laney Graduate School, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5693-3278","authenticated-orcid":false,"given":"Hyeokhyen","family":"Kwon","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4913-6825","authenticated-orcid":false,"given":"Reza","family":"Sameni","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA"},{"name":"Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1093-6537","authenticated-orcid":false,"given":"Christine D.","family":"Esper","sequence":"additional","affiliation":[{"name":"Jean and Paul Amos Parkinson\u2019s Disease and Movement Disorders Program, Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8361-8943","authenticated-orcid":false,"given":"J. Lucas","family":"McKay","sequence":"additional","affiliation":[{"name":"Jean and Paul Amos Parkinson\u2019s Disease and Movement Disorders Program, Department of Neurology, School of Medicine, Emory University, Atlanta, GA 30322, USA"},{"name":"Department of Biomedical Informatics, School of Medicine, Emory University, Atlanta, GA 30322, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1002\/mds.29376","article-title":"Machine Learning in Tremor Analysis: Critique and Directions","volume":"38","author":"De","year":"2023","journal-title":"Mov. Disord."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1002\/mds.870131303","article-title":"Consensus statement of the Movement Disorder Society on Tremor","volume":"13","author":"Deuschl","year":"1998","journal-title":"Mov. Disord."},{"key":"ref_3","unstructured":"Testa, C.M., Haubenberger, D., Patel, M., Caughman, C.Y., and Factor, S.A. (2024, July 27). Tremor in Medicine and Other Secondary Tremors, Tremors, Available online: http:\/\/xxx.lanl.gov\/abs\/https:\/\/academic.oup.com\/book\/0\/chapter\/369585583\/chapter-ag-pdf\/49059420\/book_43955_section_369585583.ag.pdf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1002\/mds.27121","article-title":"Consensus Statement on the classification of tremors. from the task force on tremor of the International Parkinson and Movement Disorder Society","volume":"33","author":"Bhatia","year":"2018","journal-title":"Mov. Disord. Off. J. Mov. Disord. Soc."},{"key":"ref_5","unstructured":"Jankovic, J. (2012). Distinguishing Essential Tremor From Parkinson\u2019s Disease. Pract. Neurol., 36\u201338."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1002\/mds.22340","article-title":"Movement Disorder Society-sponsored revision of the Unified Parkinson\u2019s Disease Rating Scale (MDS-UPDRS): Scale presentation and clinimetric testing results","volume":"23","author":"Goetz","year":"2008","journal-title":"Mov. Disord. Off. J. Mov. Disord. Soc."},{"key":"ref_7","unstructured":"Fahn, S., Tolosa, E., and Marin, C. (1988). Clinical Rating Scale for Tremor. Parkinson\u2019s Disease and Movement Disorders, Urban & Schwarzenberg."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1002\/mds.25162","article-title":"Reliability of a New Scale for Essential Tremor","volume":"27","author":"Elble","year":"2012","journal-title":"Mov. Disord."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4755","DOI":"10.1007\/s10462-021-10116-x","article-title":"Human Activity Recognition in Artificial Intelligence Framework: A Narrative Review","volume":"55","author":"Gupta","year":"2022","journal-title":"Artif. Intell. Rev."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Merenda, M., Porcaro, C., and Iero, D. (2020). Edge Machine Learning for AI-Enabled IoT Devices: A Review. Sensors, 20.","DOI":"10.3390\/s20092533"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12984-020-00774-3","article-title":"Measuring freezing of gait during daily-life: An open-source, wearable sensors approach","volume":"18","author":"Mancini","year":"2021","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kwon, H., Clifford, G., Genias, I., Bernhard, D., Esper, C., Factor, S., and McKay, J. (2023). An Explainable Spatial-Temporal Graphical Convolutional Network to Score Freezing of Gait in Parkinsonian Patients. Sensors, 23.","DOI":"10.1101\/2023.01.13.23284535"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/j.gaitpost.2020.05.026","article-title":"A data-driven approach for detecting gait events during turning in people with Parkinson\u2019s disease and freezing of gait","volume":"80","author":"Filtjens","year":"2020","journal-title":"Gait Posture"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, W., Chen, X., Zhang, J., Lu, J., Zhang, C., Bai, H., Liang, J., Wang, J., Du, H., and Xue, G. (2022). Recognition of Freezing of Gait in Parkinson\u2019s Disease Based on Machine Vision. Front. Aging Neurosci., 14.","DOI":"10.3389\/fnagi.2022.921081"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"G\u00fcney, G., Jansen, T.S., Dill, S., Schulz, J.B., Dafotakis, M., Hoog Antink, C., and Braczynski, A.K. (2022). Video-Based Hand Movement Analysis of Parkinson Patients before and after Medication Using High-Frame-Rate Videos and MediaPipe. Sensors, 22.","DOI":"10.3390\/s22207992"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Friedrich, M., Roenn, A.J., Palmisano, C., Alty, J., Paschen, S., Deuschl, G., Ip, C.W., Volkmann, J., Muthuraman, M., and Peach, R. (Preprint, 2023). Visual Perceptive Deep Learning for Smartphone Video-Based Tremor Analysis: VIPER-Tremor, Preprint, In Review.","DOI":"10.21203\/rs.3.rs-3692906\/v1"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1002\/mds.870110113","article-title":"Quantification of essential tremor in writing and drawing","volume":"11","author":"Elble","year":"1996","journal-title":"Mov. Disord. Off. J. Mov. Disord. Soc."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2660","DOI":"10.1093\/brain\/awl190","article-title":"Tremor amplitude is logarithmically related to 4- and 5-point tremor rating scales","volume":"129","author":"Elble","year":"2006","journal-title":"Brain"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Bronte-Stewart, H., Gala, A., Wilkins, K., Pettruci, M., Kehnemouyi, Y., Velisar, A., and Trager, M. (Res. Sq., 2023). The digital signature of emergent tremor in Parkinson\u2019s disease, Res. Sq., Preprint.","DOI":"10.21203\/rs.3.rs-3467667\/v1"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1152\/jappl.1964.19.2.357","article-title":"Power spectral analysis of finger acceleration tremor","volume":"19","author":"Randall","year":"1964","journal-title":"J. Appl. Physiol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, C., Wang, G., Zhao, J., Gao, P., Lin, J., and Yang, H. (2017, January 20\u201321). Patient-specific ECG classification based on recurrent neural networks and clustering technique. Proceedings of the 2017 13th IASTED International Conference on Biomedical Engineering (BioMed), Innsbruck, Austria.","DOI":"10.2316\/P.2017.852-029"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Reyna, M.A., Kiarashi, Y., Elola, A., Oliveira, J., Renna, F., Gu, A., Perez Alday, E.A., Sadr, N., Sharma, A., and Kpodonu, J. (2022). Heart murmur detection from phonocardiogram recordings: The George B. Moody PhysioNet Challenge 2022. MedRxiv.","DOI":"10.1101\/2022.08.11.22278688"},{"key":"ref_23","unstructured":"Tripathi, R., McKay, J., and Esper, C.E. (Pract. Neurol., 2023). Use of 3D motion capture for kinematic analysis in movement disorders, Pract. Neurol., in press."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4306","DOI":"10.1212\/WNL.0000000000203887","article-title":"Phenotyping Motor-subtypes of Parkinsonism from Full-body Kinematics using Machine Learning (P6-11.007)","volume":"100","author":"Gong","year":"2023","journal-title":"Neurology"},{"key":"ref_25","unstructured":"Elble, R.J. (2016). The Essential Tremor Rating Assessment Scale. J. Neurol., 5."},{"key":"ref_26","unstructured":"American Medical Association (2023, December 28). CPT\u2014Current Procedural Terminology. Available online: https:\/\/www.ama-assn.org\/amaone\/cpt-current-procedural-terminology."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/s41531-019-0099-z","article-title":"Freezing of Gait can persist after an acute levodopa challenge in Parkinson\u2019s disease","volume":"5","author":"McKay","year":"2019","journal-title":"NPJ Park. Dis."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1109\/T-AIEE.1928.5055024","article-title":"Certain Topics in Telegraph Transmission Theory","volume":"47","author":"Nyquist","year":"1928","journal-title":"Trans. Am. Inst. Electr. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3197517.3201302","article-title":"Robust Solving of Optical Motion Capture Data by Denoising","volume":"37","author":"Holden","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1016\/j.spinee.2021.02.007","article-title":"Using a National Surgical Database to Predict Complications Following Posterior Lumbar Surgery and Comparing the Area under the Curve and F1-score for the Assessment of Prognostic Capability","volume":"21","author":"DeVries","year":"2021","journal-title":"Spine J."},{"key":"ref_33","unstructured":"Lundberg, S., and Lee, S.I. (2017). A Unified Approach to Interpreting Model Predictions. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1111\/j.2517-6161.1964.tb00553.x","article-title":"An Analysis of Transformations","volume":"26","author":"Box","year":"1964","journal-title":"J. R. Stat. Soc. Ser. B (Methodol.)"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.cnp.2019.06.002","article-title":"How to Do an Electrophysiological Study of Tremor","volume":"4","author":"Vial","year":"2019","journal-title":"Clin. Neurophysiol. Pract."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1007\/s10072-017-2852-6","article-title":"Tremor analysis separates Parkinson\u2019s disease and dopamine receptor blockers induced parkinsonism","volume":"38","author":"Shaikh","year":"2017","journal-title":"Neurol. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1842","DOI":"10.1212\/WNL.98.18_supplement.1842","article-title":"Quantitative motion analysis and clinical characteristics of Holmes tremor as compared to other tremor types (S32.008)","volume":"98","author":"Williams","year":"2022","journal-title":"Neurology"},{"key":"ref_38","first-page":"307","article-title":"Measurement in Medicine: The Analysis of Method Comparison Studies","volume":"32","author":"Altman","year":"2018","journal-title":"J. R. Stat. Soc. Ser. D Stat."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/15\/4960\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:27:08Z","timestamp":1760110028000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/15\/4960"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,31]]},"references-count":38,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["s24154960"],"URL":"https:\/\/doi.org\/10.3390\/s24154960","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.03.13.24304101","asserted-by":"object"}]},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,31]]}}}