{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T09:44:54Z","timestamp":1770284694695,"version":"3.49.0"},"reference-count":31,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,27]],"date-time":"2023-12-27T00:00:00Z","timestamp":1703635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia (FCT)","doi-asserted-by":"publisher","award":["SFRH\/BD\/140874\/2018"],"award-info":[{"award-number":["SFRH\/BD\/140874\/2018"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia (FCT)","doi-asserted-by":"publisher","award":["UIDB\/05210\/2020"],"award-info":[{"award-number":["UIDB\/05210\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia (FCT)","doi-asserted-by":"publisher","award":["NORTE-01-0145-FEDER-000045"],"award-info":[{"award-number":["NORTE-01-0145-FEDER-000045"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"R&amp;D Unit funding","doi-asserted-by":"publisher","award":["SFRH\/BD\/140874\/2018"],"award-info":[{"award-number":["SFRH\/BD\/140874\/2018"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"R&amp;D Unit funding","doi-asserted-by":"publisher","award":["UIDB\/05210\/2020"],"award-info":[{"award-number":["UIDB\/05210\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"R&amp;D Unit funding","doi-asserted-by":"publisher","award":["NORTE-01-0145-FEDER-000045"],"award-info":[{"award-number":["NORTE-01-0145-FEDER-000045"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fundo Europeu de Desenvolvimento Regional (FEDER)","award":["SFRH\/BD\/140874\/2018"],"award-info":[{"award-number":["SFRH\/BD\/140874\/2018"]}]},{"name":"Fundo Europeu de Desenvolvimento Regional (FEDER)","award":["UIDB\/05210\/2020"],"award-info":[{"award-number":["UIDB\/05210\/2020"]}]},{"name":"Fundo Europeu de Desenvolvimento Regional (FEDER)","award":["NORTE-01-0145-FEDER-000045"],"award-info":[{"award-number":["NORTE-01-0145-FEDER-000045"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Shoulder rehabilitation is a process that requires physical therapy sessions to recover the mobility of the affected limbs. However, these sessions are often limited by the availability and cost of specialized technicians, as well as the patient\u2019s travel to the session locations. This paper presents a novel smartphone-based approach using a pose estimation algorithm to evaluate the quality of the movements and provide feedback, allowing patients to perform autonomous recovery sessions. This paper reviews the state of the art in wearable devices and camera-based systems for human body detection and rehabilitation support and describes the system developed, which uses MediaPipe to extract the coordinates of 33 key points on the patient\u2019s body and compares them with reference videos made by professional physiotherapists using cosine similarity and dynamic time warping. This paper also presents a clinical study that uses QTM, an optoelectronic system for motion capture, to validate the methods used by the smartphone application. The results show that there are statistically significant differences between the three methods for different exercises, highlighting the importance of selecting an appropriate method for specific exercises. This paper discusses the implications and limitations of the findings and suggests directions for future research.<\/jats:p>","DOI":"10.3390\/s24010158","type":"journal-article","created":{"date-parts":[[2023,12,27]],"date-time":"2023-12-27T10:23:54Z","timestamp":1703672634000},"page":"158","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Machine Learning App for Monitoring Physical Therapy at Home"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-0923-650X","authenticated-orcid":false,"given":"Bruno","family":"Pereira","sequence":"first","affiliation":[{"name":"Instituto Superior de Engenharia do Porto (ISEP), Polytechnic of Porto, Rua Dr. Ant\u00f3nio Bernardino de Almeida, 4249-015 Porto, Portugal"},{"name":"Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8661-3080","authenticated-orcid":false,"given":"Bruno","family":"Cunha","sequence":"additional","affiliation":[{"name":"Instituto Superior de Engenharia do Porto (ISEP), Polytechnic of Porto, Rua Dr. Ant\u00f3nio Bernardino de Almeida, 4249-015 Porto, Portugal"},{"name":"Center for Rehabilitation Research (CIR), ESS, Polytechnic of Porto, rua Dr. Ant\u00f3nio Bernardino de Almeida, 4200-072 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8447-2360","authenticated-orcid":false,"given":"Paula","family":"Viana","sequence":"additional","affiliation":[{"name":"Instituto Superior de Engenharia do Porto (ISEP), Polytechnic of Porto, Rua Dr. Ant\u00f3nio Bernardino de Almeida, 4249-015 Porto, Portugal"},{"name":"Institute for Systems and Computer Engineering, Technology and Science (INESC TEC), 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0949-0918","authenticated-orcid":false,"given":"Maria","family":"Lopes","sequence":"additional","affiliation":[{"name":"Center for Rehabilitation Research (CIR), ESS, Polytechnic of Porto, rua Dr. Ant\u00f3nio Bernardino de Almeida, 4200-072 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7001-0157","authenticated-orcid":false,"given":"Ana","family":"Melo","sequence":"additional","affiliation":[{"name":"Center for Rehabilitation Research (CIR), ESS, Polytechnic of Porto, rua Dr. Ant\u00f3nio Bernardino de Almeida, 4200-072 Porto, Portugal"},{"name":"Porto Biomechanics Laboratory (LABIOMEP-UP), University of Porto, Rua Dr. Pl\u00e1cido Costa, 91, 4200-450 Porto, Portugal"},{"name":"Center for Interdisciplinary Applied Research in Health (CIIAS), School of Health, Setubal Polytechnic Institute, Campus do IPS Estefanilha, 2914-503 Setubal, Portugal"},{"name":"Research Centre in Physical Activity, Health and Leisure (CIAFEL), Faculty of Sport, University of Porto, Rua Dr. Pl\u00e1cido Costa, 91, 4200-450 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9528-1463","authenticated-orcid":false,"given":"Andreia","family":"Sousa","sequence":"additional","affiliation":[{"name":"Center for Rehabilitation Research (CIR), ESS, Polytechnic of Porto, rua Dr. Ant\u00f3nio Bernardino de Almeida, 4200-072 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lopes, M., Melo, A.S.C., Cunha, B., and Sousa, A.S.P. (2023). Smartphone-Based Video Analysis for Guiding Shoulder Therapeutic Exercises: Concurrent Validity for Movement Quality Control. Appl. Sci., 13.","DOI":"10.3390\/app132212282"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Carnevale, A., Longo, U.G., Schena, E., Massaroni, C., Lo Presti, D., Berton, A., Candela, V., and Denaro, V. (2019). Wearable systems for shoulder kinematics assessment: A systematic review. BMC Musculoskelet. Disord., 20.","DOI":"10.1186\/s12891-019-2930-4"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Viana, P., Ferreira, T., Castro, L., Soares, M., Pinto, J.P., Andrade, T., and Carvalho, P. (2018, January 4\u20136). GymApp: A Real Time Physical Activity Trainner on Wearable Devices. Proceedings of the 2018 11th International Conference on Human System Interaction (HSI), Gdansk, Poland.","DOI":"10.1109\/HSI.2018.8431358"},{"key":"ref_4","first-page":"524","article-title":"Dynamic time warping (dtw) algorithm in speech: A review","volume":"6","author":"Yadav","year":"2018","journal-title":"Int. J. Res. Electron. Comput. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bowman, T., Gervasoni, E., Arienti, C., Lazzarini, S.G., Negrini, S., Crea, S., Cattaneo, D., and Carrozza, M.C. (2021). Wearable Devices for Biofeedback Rehabilitation: A Systematic Review and Meta-Analysis to Design Application Rules and Estimate the Effectiveness on Balance and Gait Outcomes in Neurological Diseases. Sensors, 21.","DOI":"10.3390\/s21103444"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1186\/s12984-019-0612-y","article-title":"Wearable technology in stroke rehabilitation: Towards improved diagnosis and treatment of upper-limb motor impairment","volume":"16","author":"Popa","year":"2019","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Fred, A., Filipe, J., and Gamboa, H. (2009). Proceedings of the Biomedical Engineering Systems and Technologies, Springer.","DOI":"10.1007\/978-3-540-92219-3"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/s00530-021-00815-4","article-title":"A review of computer vision-based approaches for physical rehabilitation and assessment","volume":"28","author":"Debnath","year":"2022","journal-title":"Multimed. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Leu, A., Risti\u0107-Durrant, D., and Gr\u00e4ser, A. (2011, January 19\u201321). A robust markerless vision-based human gait analysis system. Proceedings of the 2011 6th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI), Timisoara, Romania.","DOI":"10.1109\/SACI.2011.5873039"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Natarajan, S.K., Wang, X., Spranger, M., and Gr\u00e4ser, A. (2017, January 20\u201321). Reha@Home\u2014A vision based markerless gait analysis system for rehabilitation at home. Proceedings of the 2017 13th IASTED International Conference on Biomedical Engineering (BioMed), Innsbruck, Austria.","DOI":"10.2316\/P.2017.852-042"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chang, C.Y., Lange, B., Zhang, M., Koenig, S., Requejo, P., Somboon, N., Sawchuk, A.A., and Rizzo, A.A. (2012, January 21\u201324). Towards pervasive physical rehabilitation using Microsoft Kinect. Proceedings of the 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops, San Diego, CA, USA.","DOI":"10.4108\/icst.pervasivehealth.2012.248714"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Fern\u2019ndez-Baena, A., Sus\u00edn, A., and Lligadas, X. (2012, January 19\u201321). Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments. Proceedings of the 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems, Bucharest, Romania.","DOI":"10.1109\/iNCoS.2012.66"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Gama, A.D., Chaves, T., Figueiredo, L., and Teichrieb, V. (2012, January 28\u201331). Guidance and Movement Correction Based on Therapeutics Movements for Motor Rehabilitation Support Systems. Proceedings of the 2012 14th Symposium on Virtual and Augmented Reality, Rio de Janeiro, Brazil.","DOI":"10.1109\/SVR.2012.15"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1117\/12.503470","article-title":"Object and event recognition for stroke rehabilitation","volume":"Volume 5150","author":"Ebrahimi","year":"2003","journal-title":"Proceedings of the Visual Communications and Image Processing 2003"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.cmpb.2016.07.014","article-title":"MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system","volume":"135","author":"Chaves","year":"2016","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1016\/j.asoc.2014.04.020","article-title":"Kinect-enabled home-based rehabilitation system using Dynamic Time Warping and fuzzy logic","volume":"22","author":"Su","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1109\/TNSRE.2014.2360149","article-title":"Assessing Upper Extremity Motor Function in Practice of Virtual Activities of Daily Living","volume":"23","author":"Adams","year":"2015","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"24955","DOI":"10.1007\/s11042-018-5730-1","article-title":"VRheab: A fully immersive motor rehabilitation system based on recurrent neural network","volume":"77","author":"Avola","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_19","unstructured":"RehabGuru (2023, October 07). Exercise Prescription Software for professionals, Physiotherapy and Patients. Available online: https:\/\/www.rehabguru.com."},{"key":"ref_20","unstructured":"Pal, H.T. (2023, October 25). Pt Pal Pro. Available online: https:\/\/play.google.com\/store\/apps\/details?id=com.ptpal.pro."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"36","DOI":"10.5114\/areh.2020.100774","article-title":"Using mobile applications in the process of enhancing and restoring abilities in individuals with intellectual disability and other disabilities\u2014A literature review","volume":"34","author":"Korczak","year":"2020","journal-title":"Adv. Rehabil."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"198","DOI":"10.7326\/M21-2388","article-title":"Comparing video-based, telehealth-delivered exercise and weight loss programs with online education on outcomes of knee osteoarthritis: A randomized trial","volume":"175","author":"Bennell","year":"2022","journal-title":"Ann. Intern. Med."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"12073","DOI":"10.1007\/s11042-017-4859-7","article-title":"Effective and efficient similarity searching in motion capture data","volume":"77","author":"Sedmidubsky","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1007\/s11045-018-0611-3","article-title":"Dynamic time warping in classification and selection of motion capture data","volume":"30","author":"Switonski","year":"2019","journal-title":"Multidimens. Syst. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Moroney, L., Moroney, A. (2017). Definitive Guide to Firebase, Springer.","DOI":"10.1007\/978-1-4842-2943-9"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"197","DOI":"10.12968\/bjsn.2015.10.4.197","article-title":"What do you really know about colour blindness?","volume":"10","year":"2015","journal-title":"Br. J. Sch. Nurs."},{"key":"ref_27","unstructured":"Neiva, M. (2017). Injuries and Health Problems in Football: What Everyone Should Know, Springer."},{"key":"ref_28","unstructured":"Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F., and Grundmann, M. (2020). BlazePose: On-device Real-time Body Pose tracking. arXiv."},{"key":"ref_29","unstructured":"Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C.L., Yong, M., and Lee, J. (2019, January 17). MediaPipe: A Framework for Perceiving and Processing Reality. Proceedings of the Third Workshop on Computer Vision for AR\/VR at IEEE Computer Vision and Pattern Recognition (CVPR) 2019, Long Beach, CA, USA."},{"key":"ref_30","first-page":"10","article-title":"Converting video formats with FFmpeg","volume":"2006","author":"Tomar","year":"2006","journal-title":"Linux J."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"561","DOI":"10.3233\/IDA-2007-11508","article-title":"Toward accurate dynamic time warping in linear time and space","volume":"11","author":"Salvador","year":"2007","journal-title":"Intell. Data Anal."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/158\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:42:50Z","timestamp":1760132570000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,27]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24010158"],"URL":"https:\/\/doi.org\/10.3390\/s24010158","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,27]]}}}