{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T08:56:02Z","timestamp":1768208162552,"version":"3.49.0"},"reference-count":36,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,20]],"date-time":"2022-08-20T00:00:00Z","timestamp":1660953600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Koneksa Health"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Numerous studies have sought to demonstrate the utility of digital measures of motor function in Parkinson\u2019s disease. Frameworks, such as V3, document digital measure development: technical verification, analytical and clinical validation. We present the results of a study to (1) technically verify accelerometers in an Apple iPhone 8 Plus and ActiGraph GT9X versus an oscillating table and (2) analytically validate software tasks for walking and pronation\/supination on the iPhone plus passively detect walking measures with the ActiGraph in healthy volunteers versus human raters. In technical verification, 99.4% of iPhone and 91% of ActiGraph tests show good or excellent agreement versus the oscillating table as the gold standard. For the iPhone software task and algorithms, intraclass correlation coefficients (ICCs) &gt; 0.75 are achieved versus the human raters for measures when walking distance is &gt;10 s and pronation\/supination when the arm is rotated more than two times. Passively detected walking start and end time was accurate to approx. 1 s and walking measures were accurate to one unit, e.g., one step. The results suggest that the Apple iPhone and ActiGraph GT9X accelerometers are fit for purpose and that task and passively collected measures are sufficiently analytically valid to assess usability and clinical validity in Parkinson\u2019s patients.<\/jats:p>","DOI":"10.3390\/s22166275","type":"journal-article","created":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T01:56:40Z","timestamp":1661133400000},"page":"6275","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Sensor Verification and Analytical Validation of Algorithms to Measure Gait and Balance and Pronation\/Supination in Healthy Volunteers"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9772-7446","authenticated-orcid":false,"given":"Robert","family":"Ellis","sequence":"first","affiliation":[{"name":"Koneksa Health, New York, NY 10038, USA"}]},{"given":"Peter","family":"Kelly","sequence":"additional","affiliation":[{"name":"Koneksa Health, New York, NY 10038, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8976-460X","authenticated-orcid":false,"given":"Chengrui","family":"Huang","sequence":"additional","affiliation":[{"name":"Koneksa Health, New York, NY 10038, USA"}]},{"given":"Andrew","family":"Pearlmutter","sequence":"additional","affiliation":[{"name":"Koneksa Health, New York, NY 10038, USA"}]},{"given":"Elena S.","family":"Izmailova","sequence":"additional","affiliation":[{"name":"Koneksa Health, New York, NY 10038, USA"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1136\/jnnp.2007.131045","article-title":"Parkinson\u2019s disease: Clinical features and diagnosis","volume":"79","author":"Jankovic","year":"2008","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1002\/mds.22340","article-title":"Movement Disorder Society-sponsored revision of the Unified Parkinson\u2019s Disease Rating Scale (MDS-UPDRS): Scale presentation and clinimetric testing results","volume":"23","author":"Goetz","year":"2008","journal-title":"Mov. Disord."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"160011","DOI":"10.1038\/sdata.2016.11","article-title":"The mPower study, Parkinson disease mobile data collected using ResearchKit","volume":"3","author":"Bot","year":"2016","journal-title":"Sci. Data"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1002\/mds.27376","article-title":"Evaluation of smartphone-based testing to generate exploratory outcome measures in a phase 1 Parkinson\u2019s disease clinical trial","volume":"33","author":"Lipsmeier","year":"2018","journal-title":"Mov. Disord."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1038\/s41746-022-00607-8","article-title":"Virtual exam for Parkinson\u2019s disease enables frequent and reliable remote measurements of motor function","volume":"5","author":"Burq","year":"2022","journal-title":"NPJ Digit. Med."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Barrachina-Fern\u00e1ndez, M., Mait\u00edn, A.M., S\u00e1nchez-\u00c1vila, C., and Romero, J.P. (2021). Wearable Technology to Detect Motor Fluctuations in Parkinson\u2019s Disease Patients: Current State and Challenges. Sensors, 21.","DOI":"10.3390\/s21124188"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1038\/s41746-020-0260-4","article-title":"Verification, analytical validation, and clinical validation (V3): The foundation of determining fit-for-purpose for Biometric Monitoring Technologies (BioMeTs)","volume":"3","author":"Goldsack","year":"2020","journal-title":"NPJ Digit. Med."},{"key":"ref_8","unstructured":"Food and Drug Administration (2022, June 08). Software as a Medical Device (SAMD): Clinical Evaluation\u2014Guidance for Industry and Food and Drug Administration Staff, Available online: https:\/\/www.fda.gov\/media\/100714\/download."},{"key":"ref_9","unstructured":"Food and Drug Administration (2022, June 09). Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims, Available online: https:\/\/www.fda.gov\/media\/77832\/download."},{"key":"ref_10","unstructured":"Food and Drug Administration (2022, June 08). Digital Health Technologies for Remote Data Acquisition in Clinical Investigations\u2014Guidance for Industry, Investigators, and Other Stakeholders, Available online: https:\/\/www.fda.gov\/media\/155022\/download."},{"key":"ref_11","unstructured":"Pearlmutter, A., Nantes, J., Giladi, N., Horak, F., Alcalay, R., Hausdorff, J., Simuni, T., Little, A., Jha, A., and Bozzi, S. (2021, January 17\u201322). Clinical Trial Digital Endpoint Development: Patient and Provider Perspectives on the Most Impactful Functional Aspects of Parkinson\u2019s Disease. Proceedings of the MDS Virtual Congress, Virtual."},{"key":"ref_12","unstructured":"Pearlmutter, A., Wong, N., Levin, M., Zheng, R., Ellis, R., Kelly, P., and Peterschmitt, M. (2021, January 17\u201322). Parkinson\u2019s Disease Functional Impacts Digital Instrument (PD-FIDI): Studies Preceding Clinical Validation. Proceedings of the MDS Virtual Congress, Virtual."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1191\/0962280204sm365ra","article-title":"Sample size requirements for the design of reliability study: Review and new results","volume":"4","author":"Shoukri","year":"2004","journal-title":"Stat. Methods Med. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1002\/mds.10011","article-title":"Test\u2013retest reliability of the unified Parkinson\u2019s disease rating scale in patients with early Parkinson\u2019s disease: Results from a multicenter clinical trial","volume":"17","author":"Siderowf","year":"2002","journal-title":"Mov. Disord."},{"key":"ref_15","unstructured":"(2022, June 02). Apple iPhone 8 Plus Technical Specification. Available online: https:\/\/support.apple.com\/kb\/sp768?locale=en_US."},{"key":"ref_16","unstructured":"(2022, June 02). ActiGraph GT9X Link. Available online: https:\/\/actigraphcorp.com\/actigraph-link\/."},{"key":"ref_17","unstructured":"(2022, June 02). Quanser Shake Table II. Available online: https:\/\/www.quanser.com\/products\/shake-table-ii\/."},{"key":"ref_18","unstructured":"(2022, June 02). Quanser QUARC Software. Available online: https:\/\/www.quanser.com\/products\/quarc-real-time-control-software\/."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1007\/s00779-016-0946-4","article-title":"Validation of smartphone gyroscopes for mobile biofeedback applications","volume":"20","author":"Umek","year":"2016","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_20","unstructured":"(2022, June 02). Matlab R2019b Release. Available online: https:\/\/www.mathworks.com\/products\/new_products\/release2019b.html."},{"key":"ref_21","unstructured":"SensorLog Application (2022, June 02). Apple App Store. Available online: https:\/\/apps.apple.com\/us\/app\/sensorlog\/id388014573."},{"key":"ref_22","unstructured":"ActiGraph CenterPoint Platform (2022, June 02). ActiGraph Corporation. Available online: https:\/\/actigraphcorp.com\/centrepoint\/."},{"key":"ref_23","unstructured":"ActiGraph ActiLife Software (2022, June 02). ActiGraph Corporation. Available online: https:\/\/actigraphcorp.com\/actilife\/."},{"key":"ref_24","unstructured":"(2022, June 02). Python 3.6.5 Release Specification. Available online: https:\/\/www.python.org\/downloads\/release\/python-365\/."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1016\/j.theriogenology.2010.01.003","article-title":"Method agreement analysis: A review of correct methodology","volume":"73","author":"Watson","year":"2010","journal-title":"Theriogenology"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_27","unstructured":"(2022, June 02). Quanser Installation Qualification Manual. Available online: https:\/\/quanserinc.app.box.com\/s\/35ek73astl83h4z42q5r2dp69kk8r74w\/file\/168369015496."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1136\/jnnp.50.5.561","article-title":"Frequency\/amplitude characteristics of postural tremor of the hands in a population of patients with bilateral essential tremor: Implications for the classification and mechanism of essential tremor","volume":"50","author":"Calzetti","year":"1987","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1136\/jnnp.67.5.646","article-title":"Re-emergent tremor of Parkinson\u2019s disease","volume":"67","author":"Jankovic","year":"1999","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sigcha, L., Pavon, I., Costa, N., Costa, S., Gago, M., Arezes, P., Lopez, J.M., and Arcas, G. (2021). Automatic Resting Tremor Assessment in Parkinson\u2019s Disease Using Smartwatches and Multitask Convolutional Neural Networks. Sensors, 21.","DOI":"10.3390\/s21010291"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kiprijanovska, I., Gjoreski, H., and Gams, M. (2020). Detection of Gait Abnormalities for Fall Risk Assessment Using Wrist-Worn Inertial Sensors and Deep Learning. Sensors, 20.","DOI":"10.3390\/s20185373"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1186\/s12966-015-0314-1","article-title":"Systematic review of the validity and reliability of consumer-wearable activity trackers","volume":"12","author":"Evenson","year":"2015","journal-title":"Int. J. Behav. Nutr. Phys. Act"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"13434","DOI":"10.1038\/s41598-019-49798-3","article-title":"Estimating dyskinesia severity in Parkinson\u2019s disease by using a waist-worn sensor: Concurrent validity study","volume":"9","author":"Sama","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hssayeni, M.D., Jimenez-Shahed, J., Burack, M.A., and Ghoraani, B. (2019). Wearable Sensors for Estimation of Parkinsonian Tremor Severity during Free Body Movements. Sensors, 19.","DOI":"10.3390\/s19194215"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Tedesco, S., Sica, M., Ancillao, A., Timmons, S., Barton, J., and O\u2019Flynn, B. (2019). Accuracy of consumer-level and research-grade activity trackers in ambulatory settings in older adults. PLOS ONE, 14.","DOI":"10.1371\/journal.pone.0216891"},{"key":"ref_36","unstructured":"(2022, August 09). Qualification Opinion on Stride Velocity 95th Centile as a Secondary Endpoint in Duchenne Muscular Dystrophy Measured by a valid and Suitable Wearable Device. Available online: https:\/\/www.ema.europa.eu\/en\/documents\/scientific-guideline\/qualification-opinion-stride-velocity-95th-centile-secondary-endpoint-duchenne-muscular-dystrophy_en.pdf."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6275\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:12:59Z","timestamp":1760141579000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6275"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,20]]},"references-count":36,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22166275"],"URL":"https:\/\/doi.org\/10.3390\/s22166275","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,20]]}}}