{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T13:01:56Z","timestamp":1770814916572,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,16]],"date-time":"2023-02-16T00:00:00Z","timestamp":1676505600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ricerca Corrente funding scheme of the Italian Ministry of Health"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Easy-to-use evaluation of Range Of Motion (ROM) during walking is necessary to make decisions during neurological rehabilitation programs and during follow-up visits in clinical and remote settings. This study discussed goniometer applications (DrGoniometer and Angles - Video Goniometer) that measure knee joint ROM during walking through smartphone cameras. The primary aim of the study is to test the inter-rater and intra-rater reliability of the collected measurements as well as their concurrent validity with an electro-goniometer. The secondary aim is to evaluate the usability of the two mobile applications. A total of 22 patients with Parkinson\u2019s disease (18 males, age 72 (8) years), 22 post-stroke patients (17 males, age 61 (13) years), and as many healthy volunteers (8 males, age 45 (5) years) underwent knee joint ROM evaluations during walking. Clinicians and inexperienced examiners used the two mobile applications to calculate the ROM, and then rated their perceived usability through the System Usability Scale (SUS). Intraclass correlation coefficients (ICC) and correlation coefficients (corr) were calculated. Both applications showed good reliability (ICC &gt; 0.69) and validity (corr &gt; 0.61), and acceptable usability (SUS &gt; 68). Smartphone-based video goniometers could be used to assess the knee ROM during walking in neurological patients, because of their acceptable degree of reliability, validity and usability.<\/jats:p>","DOI":"10.3390\/s23042232","type":"journal-article","created":{"date-parts":[[2023,2,16]],"date-time":"2023-02-16T04:01:52Z","timestamp":1676520112000},"page":"2232","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Video-based Goniometer Applications for Measuring Knee Joint Angles during Walking in Neurological Patients: A Validity, Reliability and Usability Study"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7836-7246","authenticated-orcid":false,"given":"Monica","family":"Parati","sequence":"first","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Milan, Italy"},{"name":"Istituti Clinici Scientifici Maugeri IRCCS, 20138 Milan, Milan, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6425-7276","authenticated-orcid":false,"given":"Matteo","family":"Gallotta","sequence":"additional","affiliation":[{"name":"Istituti Clinici Scientifici Maugeri IRCCS, 20138 Milan, Milan, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5360-3137","authenticated-orcid":false,"given":"Beatrice","family":"De Maria","sequence":"additional","affiliation":[{"name":"Istituti Clinici Scientifici Maugeri IRCCS, 20138 Milan, Milan, Italy"}]},{"given":"Annalisa","family":"Pirola","sequence":"additional","affiliation":[{"name":"Istituti Clinici Scientifici Maugeri IRCCS, 20138 Milan, Milan, Italy"}]},{"given":"Matteo","family":"Morini","sequence":"additional","affiliation":[{"name":"Istituti Clinici Scientifici Maugeri IRCCS, 20138 Milan, Milan, Italy"}]},{"given":"Luca","family":"Longoni","sequence":"additional","affiliation":[{"name":"Istituti Clinici Scientifici Maugeri, 20851 Lissone, Monza Brianza, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6527-0779","authenticated-orcid":false,"given":"Emilia","family":"Ambrosini","sequence":"additional","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Milan, Italy"}]},{"given":"Giorgio","family":"Ferriero","sequence":"additional","affiliation":[{"name":"Istituti Clinici Scientifici Maugeri IRCCS Tradate, 21049 Tradate, Varese, Italy"},{"name":"Department of Biotechnology and Life Sciences, University of Insubria, 21110 Varese, Varese, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7835-1965","authenticated-orcid":false,"given":"Simona","family":"Ferrante","sequence":"additional","affiliation":[{"name":"Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milan, Milan, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1186\/s40634-018-0161-5","article-title":"Accuracy and reliability of knee goniometry methods","volume":"5","author":"Hancock","year":"2018","journal-title":"J. Exp. Orthop."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1016\/j.clinbiomech.2010.10.007","article-title":"Lower limb coordination patterns in hemiparetic gait: Factors of knee flexion impairment","volume":"26","author":"Hutin","year":"2011","journal-title":"Clin. Biomech."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"752","DOI":"10.1038\/s41598-020-80768-2","article-title":"Gait parameters of Parkinson\u2019s disease compared with healthy controls: A systematic review and meta-analysis","volume":"11","author":"Zanardi","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"15","DOI":"10.3389\/fdgth.2020.00015","article-title":"A Smartphone Application Designed to Engage the Elderly in Home-Based Rehabilitation","volume":"2","author":"Androutsou","year":"2020","journal-title":"Front. Digit. Health"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1093\/ptj\/71.2.90","article-title":"Reliability of goniometric measurements and visual estimates of ankle joint active range of motion obtained in a clinical setting","volume":"71","author":"Watkins","year":"1991","journal-title":"Phys. Ther."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1016\/S0031-9406(05)60695-5","article-title":"Validation of flexible electrogoniometry as a measure of joint kinematics","volume":"87","author":"Rowe","year":"2001","journal-title":"Physiotherapy"},{"key":"ref_7","first-page":"186","article-title":"Human movement analysis using stereophotogrammetry. Part 1: Theoretical background","volume":"21","author":"Cappozzo","year":"2005","journal-title":"Gait Posture"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.knee.2006.10.006","article-title":"Psychometric properties of measurement tools for quantifying knee joint position and movement: A systematic review","volume":"14","author":"Piriyaprasarth","year":"2007","journal-title":"Knee"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.gaitpost.2007.11.009","article-title":"Quantitative comparison of five current protocols in gait analysis","volume":"28","author":"Ferrari","year":"2008","journal-title":"Gait Posture"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"28435","DOI":"10.3390\/s151128435","article-title":"Wearable goniometer and accelerometer sensory fusion for knee joint angle measurement in daily life","volume":"15","author":"Tognetti","year":"2015","journal-title":"Sensors"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"8430","DOI":"10.3390\/s140508430","article-title":"The use of accelerometers and gyroscopes to estimate hip and knee angles on gait analysis","volume":"14","author":"Alonge","year":"2014","journal-title":"Sensors"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"17064","DOI":"10.1109\/JSEN.2021.3081188","article-title":"Validation of a 3D Markerless System for Gait Analysis Based on OpenPose and Two RGB Webcams","volume":"21","author":"Taborri","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Albert, J.A., Owolabi, V., Gebel, A., Brahms, C.M., Granacher, U., and Arnrich, B. (2020). Evaluation of the pose tracking performance of the azure kinect and kinect v2 for gait analysis in comparison with a gold standard: A pilot study. Sensors, 20.","DOI":"10.3390\/s20185104"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1097\/MRR.0000000000000332","article-title":"Smartphone applications validated for joint angle measurement: A systematic review","volume":"42","author":"Longoni","year":"2019","journal-title":"Int. J. Rehabil. Res."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Keogh, J.W., Cox, A., Anderson, S., Liew, B., Olsen, A., Schram, B., and Furness, J. (2019). Reliability and validity of clinically accessible smartphone applications to measure joint range of motion: A systematic review. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0215806"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1055\/s-0031-1299669","article-title":"Validation of a novel smartphone accelerometer-based knee goniometer","volume":"25","author":"Ockendon","year":"2012","journal-title":"J. Knee Surg."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1016\/j.jbmt.2016.11.008","article-title":"Evaluation of knee range of motion: Correlation between measurements using a universal goniometer and a smartphone goniometric application","volume":"21","author":"Derhon","year":"2017","journal-title":"J. Bodyw. Mov. Ther."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1097\/MRR.0b013e32835b8269","article-title":"Reliability of a smartphone-based goniometer for knee joint goniometry","volume":"36","author":"Ferriero","year":"2013","journal-title":"Int. J. Rehabil. Res."},{"key":"ref_19","first-page":"417","article-title":"Accuracy and reliability of a smartphone application for measuring the knee joint angle","volume":"33","author":"Ishii","year":"2021","journal-title":"J. Phys. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"541","DOI":"10.26603\/001c.33043","article-title":"Can a Patient use an App at Home to Measure Knee Range of Motion? Utilizing a Mobile App, Curovate, to Improve Access and Adherence to Knee Range of Motion Measurements","volume":"17","author":"Shah","year":"2022","journal-title":"Int. J. Sports Phys. Ther."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.apmr.2019.07.008","article-title":"Assessing the Validity and Reliability of a New Video Goniometer App for Measuring Joint Angles in Adults and Children","volume":"101","author":"Cunha","year":"2020","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1091","DOI":"10.1161\/01.STR.0000258355.23810.c6","article-title":"Outcomes validity and reliability of the modified rankin scale: Implications for stroke clinical trials\u2014A literature review and synthesis","volume":"38","author":"Banks","year":"2007","journal-title":"Stroke"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2129","DOI":"10.1002\/mds.22340","article-title":"Movement Disorder Society-Sponsored Revision of the Unified Parkinson\u2019s Disease Rating Scale (MDS-UPDRS): Scale presentation and clinimetric testing results","volume":"23","author":"Goetz","year":"2008","journal-title":"Mov. Disord."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1016\/j.pmrj.2011.05.014","article-title":"Reliability of a New Application for Smartphones (DrGoniometer) for Elbow Angle Measurement","volume":"3","author":"Ferriero","year":"2011","journal-title":"PM R"},{"key":"ref_25","first-page":"4","article-title":"SUS: A \u201cQuick and Dirty\u201d Usability Scale","volume":"189","author":"Brooke","year":"1996","journal-title":"Usability Eval. Ind."},{"key":"ref_26","first-page":"158","article-title":"Item Benchmarks for the System Usability Scale","volume":"13","author":"Lewis","year":"2018","journal-title":"J. Usability Stud."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"217","DOI":"10.2165\/00007256-199826040-00002","article-title":"Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine","volume":"26","author":"Atkinson","year":"1998","journal-title":"Sports Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.jclinepi.2006.03.012","article-title":"Quality criteria were proposed for measurement properties of health status questionnaires","volume":"60","author":"Terwee","year":"2007","journal-title":"J. Clin. Epidemiol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1177\/096228029900800204","article-title":"Measuring agreement in method comparison studies","volume":"8","author":"Bland","year":"1999","journal-title":"Stat. Methods Med. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1016\/j.gaitpost.2008.09.003","article-title":"The reliability of three-dimensional kinematic gait measurements: A systematic review","volume":"29","author":"McGinley","year":"2009","journal-title":"Gait Posture"},{"key":"ref_32","first-page":"69","article-title":"Statistics Corner: A guide to appropriate use of Correlation coefficient in medical research","volume":"24","author":"Mukaka","year":"2012","journal-title":"Malawi Med. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1002\/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E","article-title":"Sample size and optimal designs for reliability studies","volume":"17","author":"Walter","year":"1998","journal-title":"Stat. Med."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1016\/j.math.2014.05.009","article-title":"Reliability and concurrent validity of knee angle measurement : Smart phone app versus universal goniometer used by experienced and novice clinicians","volume":"19","author":"Milanese","year":"2014","journal-title":"Man. Ther."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1097\/MRR.0000000000000276","article-title":"Smartphone technology: A reliable and valid measure of knee movement in knee replacement","volume":"41","author":"Castle","year":"2018","journal-title":"Int. J. Rehabil. Res."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1080\/03091902.2020.1713240","article-title":"Accuracy of an electrogoniometer relative to optical motion tracking for quantifying wrist range of motion","volume":"44","author":"McHugh","year":"2020","journal-title":"J. Med. Eng. Technol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Puig-Div\u00ed, A., Escalona-Marfil, C., Padull\u00e9s-Riu, J.M., Busquets, A., Padull\u00e9s-Chando, X., and Marcos-Ruiz, D. (2019). Validity and reliability of the Kinovea program in obtaining angles and distances using coordinates in 4 perspectives. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0216448"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.gaitpost.2013.05.003","article-title":"A method to differentiate the causes of stiff-knee gait in stroke patients","volume":"38","author":"Campanini","year":"2013","journal-title":"Gait Posture"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"373","DOI":"10.23736\/S1973-9087.22.07037-X","article-title":"The reliability of gait parameters captured via instrumented walkways: A systematic review and meta-analysis","volume":"58","author":"Parati","year":"2022","journal-title":"Eur. J. Phys. Rehabil. Med."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/s40734-016-0029-8","article-title":"Postural deformities in Parkinson\u2019s disease \u2013Mutual relationships among neck flexion, fore-bent, knee-bent and lateral-bent angles and correlations with clinical predictors","volume":"3","author":"Yoshii","year":"2016","journal-title":"J. Clin. Mov. Disord."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/2232\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:37:56Z","timestamp":1760121476000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/2232"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,16]]},"references-count":40,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23042232"],"URL":"https:\/\/doi.org\/10.3390\/s23042232","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,16]]}}}