{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T05:08:45Z","timestamp":1772082525005,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,2,28]],"date-time":"2023-02-28T00:00:00Z","timestamp":1677542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institute of Health\/National Institute of Child and Human Development","award":["1R15HD095403"],"award-info":[{"award-number":["1R15HD095403"]}]},{"name":"National Institute of Health\/National Institute of Child and Human Development","award":["R01HD58301"],"award-info":[{"award-number":["R01HD58301"]}]},{"name":"National Institute of Health\/National Institute of Child and Human Development","award":["R01NS085122"],"award-info":[{"award-number":["R01NS085122"]}]},{"name":"National Institute of Health\/National Institute of Child and Human Development","award":["#90RE5021"],"award-info":[{"award-number":["#90RE5021"]}]},{"name":"National Institute of Health\/National Institute of Child and Human Development","award":["UL1 TR003017"],"award-info":[{"award-number":["UL1 TR003017"]}]},{"name":"National Institute of Health\/National Institute of Child and Human Development","award":["#2101981"],"award-info":[{"award-number":["#2101981"]}]},{"name":"National Institute of Neurological Disorders and Stroke","award":["1R15HD095403"],"award-info":[{"award-number":["1R15HD095403"]}]},{"name":"National Institute of Neurological Disorders and Stroke","award":["R01HD58301"],"award-info":[{"award-number":["R01HD58301"]}]},{"name":"National Institute of Neurological Disorders and Stroke","award":["R01NS085122"],"award-info":[{"award-number":["R01NS085122"]}]},{"name":"National Institute of Neurological Disorders and Stroke","award":["#90RE5021"],"award-info":[{"award-number":["#90RE5021"]}]},{"name":"National Institute of Neurological Disorders and Stroke","award":["UL1 TR003017"],"award-info":[{"award-number":["UL1 TR003017"]}]},{"name":"National Institute of Neurological Disorders and Stroke","award":["#2101981"],"award-info":[{"award-number":["#2101981"]}]},{"name":"National Institute on Disability, Independent Living, and Rehabilitation Research","award":["1R15HD095403"],"award-info":[{"award-number":["1R15HD095403"]}]},{"name":"National Institute on Disability, Independent Living, and Rehabilitation Research","award":["R01HD58301"],"award-info":[{"award-number":["R01HD58301"]}]},{"name":"National Institute on Disability, Independent Living, and Rehabilitation Research","award":["R01NS085122"],"award-info":[{"award-number":["R01NS085122"]}]},{"name":"National Institute on Disability, Independent Living, and Rehabilitation Research","award":["#90RE5021"],"award-info":[{"award-number":["#90RE5021"]}]},{"name":"National Institute on Disability, Independent Living, and Rehabilitation Research","award":["UL1 TR003017"],"award-info":[{"award-number":["UL1 TR003017"]}]},{"name":"National Institute on Disability, Independent Living, and Rehabilitation Research","award":["#2101981"],"award-info":[{"award-number":["#2101981"]}]},{"name":"New Jersey Alliance for Clinical and Translational Science","award":["1R15HD095403"],"award-info":[{"award-number":["1R15HD095403"]}]},{"name":"New Jersey Alliance for Clinical and Translational Science","award":["R01HD58301"],"award-info":[{"award-number":["R01HD58301"]}]},{"name":"New Jersey Alliance for Clinical and Translational Science","award":["R01NS085122"],"award-info":[{"award-number":["R01NS085122"]}]},{"name":"New Jersey Alliance for Clinical and Translational Science","award":["#90RE5021"],"award-info":[{"award-number":["#90RE5021"]}]},{"name":"New Jersey Alliance for Clinical and Translational Science","award":["UL1 TR003017"],"award-info":[{"award-number":["UL1 TR003017"]}]},{"name":"New Jersey Alliance for Clinical and Translational Science","award":["#2101981"],"award-info":[{"award-number":["#2101981"]}]},{"name":"National Science Foundation STTR Phase I","award":["1R15HD095403"],"award-info":[{"award-number":["1R15HD095403"]}]},{"name":"National Science Foundation STTR Phase I","award":["R01HD58301"],"award-info":[{"award-number":["R01HD58301"]}]},{"name":"National Science Foundation STTR Phase I","award":["R01NS085122"],"award-info":[{"award-number":["R01NS085122"]}]},{"name":"National Science Foundation STTR Phase I","award":["#90RE5021"],"award-info":[{"award-number":["#90RE5021"]}]},{"name":"National Science Foundation STTR Phase I","award":["UL1 TR003017"],"award-info":[{"award-number":["UL1 TR003017"]}]},{"name":"National Science Foundation STTR Phase I","award":["#2101981"],"award-info":[{"award-number":["#2101981"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We have developed the New Jersey Institute of Technology\u2014Home Virtual Rehabilitation System (NJIT\u2014HoVRS) to facilitate intensive, hand-focused rehabilitation in the home. We developed testing simulations with the goal of providing richer information for clinicians performing remote assessments. This paper presents the results of reliability testing examining differences between in-person and remote testing as well as discriminatory and convergent validity testing of a battery of six kinematic measures collected with NJIT\u2014HoVRS. Two different groups of persons with upper extremity impairments due to chronic stroke participated in two separate experiments. Data Collection: All data collection sessions included six kinematic tests collected with the Leap Motion Controller. Measurements collected include hand opening range, wrist extension range, pronation-supination range, hand opening accuracy, wrist extension accuracy, and pronation-supination accuracy. The system usability was evaluated by therapists performing the reliability study using the System Usability Scale. When comparing the in-laboratory collection and the first remote collection, the intra-class correlation coefficients (ICC) for three of the six measurements were above 0.900 and the other three were between 0.500 and 0.900. Two of the first remote collection\/second remote collection ICCs were above 0.900, and the other four were between 0.600 and 0.900. The 95% confidence intervals for these ICC were broad, suggesting that these preliminary analyses need to be confirmed by studies with larger samples. The therapist\u2019s SUS scores ranged from 70 to 90. The mean was 83.1 (SD = 6.4), which is consistent with industry adoption. There were statistically significant differences in the kinematic scores when comparing unimpaired and impaired UE for all six measures. Five of six impaired hand kinematic scores and five of six impaired\/unimpaired hand difference scores demonstrated correlations between 0.400 and 0.700 with UEFMA scores. Reliability for all measures was acceptable for clinical practice. Discriminant and convergent validity testing suggest that scores on these tests may be meaningful and valid. Further testing in a remote setting is necessary to validate this process.<\/jats:p>","DOI":"10.3390\/s23052656","type":"journal-article","created":{"date-parts":[[2023,2,28]],"date-time":"2023-02-28T04:28:41Z","timestamp":1677558521000},"page":"2656","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Laboratory-Based Examination of the Reliability and Validity of Kinematic Measures of Wrist and Finger Function Collected by a Telerehabilitation System in Persons with Chronic Stroke"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2062-6663","authenticated-orcid":false,"given":"Ashley","family":"MontJohnson","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ 07105, USA"},{"name":"NeurotechR3 Inc., Warren, NJ 07059, USA"}]},{"given":"Amanda","family":"Cronce","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ 07105, USA"},{"name":"NeurotechR3 Inc., Warren, NJ 07059, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0417-8722","authenticated-orcid":false,"given":"Qinyin","family":"Qiu","sequence":"additional","affiliation":[{"name":"NeurotechR3 Inc., Warren, NJ 07059, USA"},{"name":"School of Health Professions, Department of Rehabilitation and Movement Sciences, Rutgers, The State University of New Jersey, Newark, NJ 07102, USA"}]},{"given":"Jigna","family":"Patel","sequence":"additional","affiliation":[{"name":"School of Health Professions, Department of Rehabilitation and Movement Sciences, Rutgers, The State University of New Jersey, Newark, NJ 07102, USA"}]},{"given":"Mee","family":"Eriksson","sequence":"additional","affiliation":[{"name":"NeurotechR3 Inc., Warren, NJ 07059, USA"}]},{"given":"Alma","family":"Merians","sequence":"additional","affiliation":[{"name":"School of Health Professions, Department of Rehabilitation and Movement Sciences, Rutgers, The State University of New Jersey, Newark, NJ 07102, USA"}]},{"given":"Sergei","family":"Adamovich","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ 07105, USA"},{"name":"School of Health Professions, Department of Rehabilitation and Movement Sciences, Rutgers, The State University of New Jersey, Newark, NJ 07102, USA"}]},{"given":"Gerard","family":"Fluet","sequence":"additional","affiliation":[{"name":"School of Health Professions, Department of Rehabilitation and Movement Sciences, Rutgers, The State University of New Jersey, Newark, NJ 07102, USA"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e67","DOI":"10.1161\/CIR.0000000000000558","article-title":"Heart Disease and Stroke Statistics-2018 Update: A Report From the American Heart Association","volume":"137","author":"Benjamin","year":"2018","journal-title":"Circulation"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1111\/j.1747-4949.2012.00967.x","article-title":"Predicting Activities after Stroke: What is Clinically Relevant?","volume":"8","author":"Kwakkel","year":"2012","journal-title":"Int. J. Stroke"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.jht.2011.01.002","article-title":"Upper Extremity Function in Stroke Subjects: Relationships between the International Classification of Functioning, Disability, and Health Domains","volume":"24","author":"Michaelsen","year":"2011","journal-title":"J. Hand Ther."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"986","DOI":"10.1016\/j.apmr.2013.10.032","article-title":"Incidence, Prevalence, Costs, and Impact on Disability of Common Conditions Requiring Rehabilitation in the United States: Stroke, Spinal Cord Injury, Traumatic Brain Injury, Multiple Sclerosis, Osteoarthritis, Rheumatoid Arthritis, Limb Loss, and Back Pain","volume":"95","author":"Ma","year":"2014","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1524","DOI":"10.1080\/09638288.2016.1226421","article-title":"Motor skill changes and neurophysiologic adaptation to recovery-oriented virtual rehabilitation of hand function in a person with subacute stroke: A case study","volume":"39","author":"Fluet","year":"2016","journal-title":"Disabil. Rehabil."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1692","DOI":"10.1016\/j.apmr.2009.04.005","article-title":"Observation of Amounts of Movement Practice Provided During Stroke Rehabilitation","volume":"90","author":"Lang","year":"2009","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_7","first-page":"CD010255","article-title":"Telerehabilitation services for stroke","volume":"1","author":"Laver","year":"2020","journal-title":"Cochrane Database Syst. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1186\/s12984-020-00789-w","article-title":"Development of the Home based Virtual Rehabilitation System (HoVRS) to remotely deliver an intense and customized upper extremity training","volume":"17","author":"Qiu","year":"2020","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1089\/g4h.2019.0012","article-title":"Autonomous Use of the Home Virtual Rehabilitation System: A Feasibility and Pilot Study","volume":"8","author":"Fluet","year":"2019","journal-title":"Games Health J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"623261","DOI":"10.3389\/fneur.2021.623261","article-title":"Virtual Rehabilitation of the Paretic Hand and Arm in Persons with Stroke: Translation from Laboratory to Rehabilitation Centers and the Patient\u2019s Home","volume":"12","author":"Fluet","year":"2021","journal-title":"Front. Neurol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1177\/1357633X16656235","article-title":"Scoping review of outcome measures used in telerehabilitation and virtual reality for post-stroke rehabilitation","volume":"23","author":"Veras","year":"2016","journal-title":"J. Telemed. Telecare"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1177\/1545968312440745","article-title":"Getting neurorehabilitation right what can be learned from animal models?","volume":"26","author":"Krakauer","year":"2012","journal-title":"Neurorehabilit. Neural Repair"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1177\/1747493017711816","article-title":"Agreed definitions and a shared vision for new standards in stroke recovery research: The Stroke Recovery and Rehabilitation Roundtable taskforce","volume":"12","author":"Bernhardt","year":"2017","journal-title":"Int. J. Stroke"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1177\/1545968308328727","article-title":"What do motor \u201crecovery\u201d and \u201ccompensation\u201d mean in patients following stroke?","volume":"23","author":"Levin","year":"2009","journal-title":"Neurorehabilit. Neural Repair"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"472","DOI":"10.3389\/fneur.2018.00472","article-title":"Kinematic Components of the Reach-to-Target Movement After Stroke for Focused Rehabilitation Interventions: Systematic Review and Meta-Analysis","volume":"9","author":"Collins","year":"2018","journal-title":"Front. Neurol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3702","DOI":"10.3390\/s140203702","article-title":"An Analysis of the Precision and Reliability of the Leap Motion Sensor and Its Suitability for Static and Dynamic Tracking","volume":"14","author":"Guna","year":"2014","journal-title":"Sensors"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ganguly, A., Rashidi, G., and Mombaur, K. (2021). Comparison of the Performance of the Leap Motion ControllerTM with a Standard Marker-Based Motion Capture System. Sensors, 21.","DOI":"10.3390\/s21051750"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1016\/j.jbiomech.2016.04.006","article-title":"Validation of the Leap Motion Controller using markered motion capture technology","volume":"49","author":"Smeragliuolo","year":"2016","journal-title":"J. Biomech."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/j.hansur.2021.03.007","article-title":"The validity of an objective measurement method using the Leap Motion Controller for fingers wrist, and forearm ranges of motion","volume":"40","author":"Arman","year":"2021","journal-title":"Hand Surg. Rehabil."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Butt, A.H., Rovini, E., Dolciotti, C., Bongioanni, P., De Petris, G., and Cavallo, F. (2017, January 17\u201320). Leap motion evaluation for assessment of upper limb motor skills in Parkinson\u2019s disease. Proceedings of the 2017 International Conference on Rehabilitation Robotics (ICORR), London, UK.","DOI":"10.1109\/ICORR.2017.8009232"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gieser, S.N., Boisselle, A., and Makedon, F. (2015, January 2\u20137). Real-Time Static Gesture Recognition for Upper Extremity Rehabilitation Using the Leap Motion. Proceedings of the International Conference on Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management 2015, Los Angeles, CA, USA.","DOI":"10.1007\/978-3-319-21070-4_15"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"13","DOI":"10.2340\/1650197771331","article-title":"The post-stroke hemiplegic patient. I. A method for evaluation of physical performance","volume":"7","author":"Leyman","year":"1975","journal-title":"Scand. J. Rehabil. Med."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","article-title":"The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment","volume":"53","author":"Nasreddine","year":"2005","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_24","first-page":"4","article-title":"SUS: A \u2019Quick and Dirty\u2019 Usability Scale","volume":"189","author":"Brooke","year":"1996","journal-title":"Usability Eval. Ind."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor","year":"2008","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1016\/S0031-9406(05)60502-0","article-title":"Rough guide to the Fugl-Meyer Assessment: Upper limb section","volume":"89","author":"Deakin","year":"2003","journal-title":"Physiotherapy"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1097\/01.phm.0000176452.17771.20","article-title":"How to Assess the Reliability of Measurements in Rehabilitation","volume":"84","author":"Lexell","year":"2005","journal-title":"Am. J. Phys. Med. Rehabilitation"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"342","DOI":"10.5014\/ajot.44.4.342","article-title":"The Reliability of Goniometric Measurements of Active and Passive Wrist Motions","volume":"44","author":"Horger","year":"1990","journal-title":"Am. J. Occup. Ther."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1093\/ptj\/80.4.386","article-title":"Examination and Treatment of a Patient with Hypermobility Syndrome","volume":"80","author":"Russek","year":"2000","journal-title":"Phys. Ther."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"245","DOI":"10.3233\/IES-182178","article-title":"Reliability of manual muscle testing: A systematic review","volume":"26","author":"Bohannon","year":"2018","journal-title":"Isokinet. Exerc. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2042","DOI":"10.1109\/JSEN.2018.2790801","article-title":"Sensor Fusion of Leap Motion Controller and Flex Sensors Using Kalman Filter for Human Finger Tracking","volume":"18","author":"Ponraj","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1088\/0967-3334\/36\/5\/1025","article-title":"Evaluation of a portable markerless finger position capture device: Accuracy of the Leap Motion controller in healthy adults","volume":"36","author":"Tung","year":"2015","journal-title":"Physiol. Meas."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1186\/s12984-022-00981-0","article-title":"Concurrent validity of an immersive virtual reality version of the Box and Block Test to assess manual dexterity among patients with stroke","volume":"19","author":"Everard","year":"2022","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_34","unstructured":"Grosmaire, A.-G., David, L., Koeppel, T., Bouyer, G., Otmane, S., Pila, O., and Duret, C. (2020, January 7\u201311). Usability of a user-centered virtual reality system for upper limb motor rehabilitation in chronic stroke patients. Proceedings of the 11th Congress of World Federation for Neurorehabilitation (WFNR 2020), online."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"654","DOI":"10.3389\/fneur.2017.00654","article-title":"Usability of Videogame-Based Dexterity Training in the Early Rehabilitation Phase of Stroke Patients: A Pilot Study","volume":"8","author":"Vanbellingen","year":"2017","journal-title":"Front. Neurol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/10447318.2018.1455307","article-title":"The system usability scale: Past, present, and future","volume":"34","author":"Lewis","year":"2018","journal-title":"Int. J. Hum.-Comput. Interact."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/5\/2656\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:43:59Z","timestamp":1760121839000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/5\/2656"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,28]]},"references-count":36,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23052656"],"URL":"https:\/\/doi.org\/10.3390\/s23052656","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,28]]}}}