{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T06:35:19Z","timestamp":1763620519501,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,1,30]],"date-time":"2019-01-30T00:00:00Z","timestamp":1548806400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Consorcio Ecuatoriano para el Desarrollo de Internet Avanzado CEDIA","award":["CEPRA-XI-2017-15"],"award-info":[{"award-number":["CEPRA-XI-2017-15"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>The goal of a telerehabilitation platform is to safely and securely facilitate the rehabilitation of patients through the use of telecommunication technologies complemented with the use of biomedical smart sensors. The purpose of this study was to perform a usability evaluation of a telerehabilitation platform. To improve the level of usability, the researchers developed and proposed an iterative process. The platform uses a digital representation of the patient which duplicates the therapeutic exercise being executed by the patient; this is detected by a Kinect camera and sensors in real time. This study used inspection methods to perform a usability evaluation of an exploratory prototype of a telerehabilitation platform. In addition, a cognitive workload assessment was performed to complement the usability evaluation. Users were involved through all the stages of the iterative refinement process. Usability issues were progressively reduced from the first iteration to the fourth iteration according to improvements which were developed and applied by the experts. Usability issues originally cataloged as catastrophic were reduced to zero, major usability problems were reduced to ten (2.75%) and minor usability problems were decreased to 141 (38.74%). This study also intends to serve as a guide to improve the usability of e-Health systems in alignment with the software development cycle.<\/jats:p>","DOI":"10.3390\/app9030480","type":"journal-article","created":{"date-parts":[[2019,1,30]],"date-time":"2019-01-30T10:58:27Z","timestamp":1548845907000},"page":"480","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["An Agile Approach to Improve the Usability of a Physical Telerehabilitation Platform"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9614-4572","authenticated-orcid":false,"given":"Hennry","family":"Pilco","sequence":"first","affiliation":[{"name":"Department of Informatics and Computer Science, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2940-7010","authenticated-orcid":false,"given":"Sandra","family":"Sanchez-Gordon","sequence":"additional","affiliation":[{"name":"Department of Informatics and Computer Science, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0871-6954","authenticated-orcid":false,"given":"Tania","family":"Calle-Jimenez","sequence":"additional","affiliation":[{"name":"Department of Informatics and Computer Science, Escuela Polit\u00e9cnica Nacional, Quito 170525, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4864-0480","authenticated-orcid":false,"given":"Jorge","family":"P\u00e9rez-Medina","sequence":"additional","affiliation":[{"name":"Intelligent &amp; Interactive Systems Lab (SI2 Lab), Universidad de Las Am\u00e9ricas, Quito 170125, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3650-9162","authenticated-orcid":false,"given":"Yves","family":"Rybarczyk","sequence":"additional","affiliation":[{"name":"Intelligent &amp; Interactive Systems Lab (SI2 Lab), Universidad de Las Am\u00e9ricas, Quito 170125, Ecuador"},{"name":"Faculty of Science and Technology, Universidade NOVA de Lisboa, 2829-516 Monte de Caparica, Portugal"},{"name":"School of Informatics, University of Sk\u00f6vde, 54128 Sk\u00f6vde, Sweden"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3616-2074","authenticated-orcid":false,"given":"Janio","family":"Jad\u00e1n-Guerrero","sequence":"additional","affiliation":[{"name":"Institute of Research, Development and Innovation, Mechatronics and Interactive Systems Center MIST, Universidad Tecnol\u00f3gica Indoam\u00e9rica, 170301 Quito, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1571-5829","authenticated-orcid":false,"given":"C\u00e9sar","family":"Maldonado","sequence":"additional","affiliation":[{"name":"Institute of Research, Development and Innovation, Mechatronics and Interactive Systems Center MIST, Universidad Tecnol\u00f3gica Indoam\u00e9rica, 170301 Quito, Ecuador"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0428-0930","authenticated-orcid":false,"given":"Isabel","family":"Nunes","sequence":"additional","affiliation":[{"name":"Faculty of Science and Technology, Universidade NOVA de Lisboa, 2829-516 Monte de Caparica, Portugal"},{"name":"UNIDEMI, Universidade NOVA de Lisboa, 2829-516 Monte de Caparica, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,30]]},"reference":[{"key":"ref_1","unstructured":"International Organization for Standardization ISO 9241-11 (2018, August 10). Ergonomics of Human-System Interaction. Available online: https:\/\/www.iso.org\/standard\/63500.html."},{"key":"ref_2","unstructured":"Ivanc, D., and Onita, M. (2015, January 13\u201315). Usability evaluation of a LMS mobile web interface. Proceedings of the International Conference on Information and Software Technologies, Druskininkai, Lithuania."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mayhew, D. (1999, January 15\u201320). The Usability Engineering Lifecycle. Proceedings of the CHI \u201999 Extended Abstracts on Human Factors in Computing Systems, Pittsburgh, PA, USA.","DOI":"10.1145\/632716.632805"},{"key":"ref_4","unstructured":"Sherman, P. (2006). How Organizations Improve By Making Easier-To-Use Software and Web Sites. Usability Success Stories, Gower Publishing."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jiang, Y., Wu, D., and Liu, P. (2016, January 10\u201314). JRed: Program Customization and Bloatware Mitigation Based on Static Analysis. Proceedings of the 2016 IEEE 40th Annual Computer Software and Applications Conference (COMPSAC), Atlanta, GA, USA.","DOI":"10.1109\/COMPSAC.2016.146"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1016\/S0953-5438(03)00055-9","article-title":"Why usability gets lost or usability in in-house software development","volume":"15","author":"Boivie","year":"2003","journal-title":"Interact. Comput."},{"key":"ref_7","first-page":"165","article-title":"Usability Evaluation Methods and Principles for the Web","volume":"4","author":"Mvungi","year":"2015","journal-title":"Int. J. Comput. Sci. Softw. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rybarczyk, Y., Deters, J., Cointe, C., Ari\u00e1n, G., and Esparza, D. (2017, January 16\u201320). Telerehabilitation Platform for Hip Surgery Recovery. Proceedings of the IEEE Conference Second Ecuador Technical Chapters Meeting (ETCM), Salinas, Ecuador.","DOI":"10.1109\/ETCM.2017.8247531"},{"key":"ref_9","unstructured":"Board, G.T. (2018, August 10). International Software Testing Qualifications Board Advanced Level Syllabus Usability Tester. Available online: https:\/\/www.istqb.org."},{"key":"ref_10","unstructured":"American Academy of Orthopaedic Surgeons (2018, August 10). Third AJRR Annual Report on Hip and Knee Arthroplasty. Available online: http:\/\/www.ajrr.net\/images\/annual_reports\/AJRR_2016_Annual_Report_final.pdf."},{"key":"ref_11","first-page":"352","article-title":"Fractura de cadera como factor de riesgo en la mortalidad en pacientes mayores de 65 a\u00f1os. Estudio de casos y controles","volume":"28","year":"2014","journal-title":"Acta Ortop. Mex."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rybarczyk, Y., Kleine, D., Cl\u00e9ment, J., and Esparza, D. (2018). Smart Web-Based Platform to Support Physical Rehabilitation. Sensors, 18.","DOI":"10.3390\/s18051344"},{"key":"ref_13","unstructured":"Perez-Medina, J., and Vanderdonckt, J. (2016, January 6\u20139). A Tool for Multi-Surface Collaborative Sketching. Proceedings of the WorkShop Cross-Surface 2016: Third International Workshop on Interacting with Multi-Device Ecologies in the Wild, Niagara Falls, ON, Canada."},{"key":"ref_14","first-page":"221","article-title":"Integrating Heuristic Evaluation with Cognitive Walkthrough: Development of a Hybrid Usability Inspection Method","volume":"208","author":"Kushniruk","year":"2015","journal-title":"Stud. Health Technol. Inform."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xiao, L., Yan, X., and Emery, A. (2013, January 1\u20135). Design and Evaluation of Web Interfaces for Informal Care Providers in Senior Monitoring. Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries, Montreal, QC, Canada.","DOI":"10.1002\/meet.14505001034"},{"key":"ref_16","first-page":"990","article-title":"Critical analysis on usability evaluation techniques","volume":"4","author":"Gulati","year":"2012","journal-title":"Int. J. Eng. Sci. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s11423-011-9222-5","article-title":"Improving the usability of the user interface for a digital textbook platform for elementary-school students","volume":"60","author":"Lim","year":"2012","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Suranto, B. (2015, January 25\u201327). Software prototypes: Enhancing the quality of requirements engineering process. Proceedings of the 2015 International Symposium on Technology Management and Emerging Technologies (ISTMET), Langkawai Island, Malaysia.","DOI":"10.1109\/ISTMET.2015.7359019"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Arnowitz, J., Arent, M., and Berger, N. (2006). Why Prototyping. Effective Prototyping for Software Makers, Morgan Kaufmann.","DOI":"10.1016\/B978-012088568-8\/50002-3"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/2.121503","article-title":"The Usability Engineering Life Cycle","volume":"25","author":"Nielsen","year":"1992","journal-title":"Computer"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bahr, B. (2017). State of Prototyping Mobile Application User-Interfaces. Prototyping of User Interfaces for Mobile Applications, Springer.","DOI":"10.1007\/978-3-319-53210-3"},{"key":"ref_22","unstructured":"Shitkova, M., Holler, J., Heide, T., Clever, N., and Becker, J. (2015, January 4\u20136). Towards Usability Guidelines for Mobile Websites and Applications. Proceedings of the 12th International Conference on Wirtschaftsinformatik, Osnabr\u00fcck, Germany."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1016\/j.procs.2016.09.193","article-title":"Cognitive Walkthrough: An Element in System Development and Evaluation\u2014Experiences from the eWALL Telehealth System","volume":"100","author":"Schaarup","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Nielsen, J., and Molich, R. (1990, January 1\u20135). Heuristic Evaluation of User Interfaces. Proceedings of the CHI \u201990, SIGCHI Conference on Human Factors in Computing Systems, Seattle, WA, USA.","DOI":"10.1145\/97243.97281"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.csi.2017.03.009","article-title":"How to Develop Usability Heuristics: A Systematic Literature Review","volume":"53","author":"Quinones","year":"2017","journal-title":"Comput. Stand. Interfaces"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1080\/0144929X.2013.810777","article-title":"Redesigning websites for older adults: A case study","volume":"33","author":"Patsoulea","year":"2014","journal-title":"Behav. Inf. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Pilco, H., Sanchez-Gord\u00f3n, S., Calle-Jimenez, T., Rybarczyk, Y., Jad\u00e1n, J., Villarreal, S., Esparza, D., Acosta-Vargas, P., Guevara, C., and Nunes, I. (2018, January 21\u201325). Analysis and improvement of the usability of a tele-rehabilitation platform for hip surgery patients. Proceedings of the AHFE 2018 International Conference on Human Factors and Systems Interaction, Orlando, FL, USA.","DOI":"10.1007\/978-3-319-94334-3_21"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1080\/10447311003781409","article-title":"State of the art on the cognitive walkthrough method, its variants and evolutions","volume":"26","author":"Mahatody","year":"2010","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Guevara, C., Jad\u00e1n-Guerrero, J., Rybarczyk, Y., Acosta-Vargas, P., Esparza, W., Gonz\u00e1lez, M., Villarreal, S., Sanchez-Gord\u00f3n, S., Calle-Jimenez, T., and Nunes, I. (2018, January 21\u201325). A Real-Time Algorithm for Movement Assessment Using Fuzzy Logic of Hip Arthroplasty Patients. Proceedings of the AHFE 2018 International Conference on Human Factors and Systems Interaction, Orlando, FL, USA.","DOI":"10.1007\/978-3-319-94334-3_27"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Nielsen, J., and Landauer, T. (1993, January 24\u201329). A Mathematical Model of the Finding of Usability Problems. Proceedings of the INTERACT \u201993 and CHI \u201993 Conference on Human Factors in Computing Systems, Amsterdam, The Netherlands.","DOI":"10.1145\/169059.169166"},{"key":"ref_31","unstructured":"Rusu, C., Roncagliolo, S., Rusu, V., and Collazos, C. (2011, January 23\u201328). A methodology to establish usability heuristics. Proceedings of the Fourth International Conference on Advances in Computer-Human Interactions, Guadeloupe, France."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0166-4115(08)62386-9","article-title":"Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research","volume":"52","author":"Hart","year":"1988","journal-title":"Hum. Ment. Workload"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"7932","DOI":"10.1109\/ACCESS.2018.2889257","article-title":"Usability study of a Web-Based Platform for Home Motor Rehabilitation","volume":"7","author":"Pilco","year":"2019","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1213","DOI":"10.1016\/j.jss.2012.02.033","article-title":"A decade of agile methodologies: Towards explaining agile software development","volume":"85","author":"Nerur","year":"2012","journal-title":"J. Syst. Softw."},{"key":"ref_35","unstructured":"(2018, August 25). Balsamiq. Available online: https:\/\/balsamiq.com."},{"key":"ref_36","unstructured":"Harada, A., and Igarashi, H. (2006, January 22\u201327). Influences of personal preference on product usability. Proceedings of the CHI 06 Extended Abstracts on Human Factors in Computing Systems, Montr\u00e9al, QC, Canada."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1089\/tmj.2010.0198","article-title":"Patients\u2019 Satisfaction of Healthcare Services and Perception with In-Home Telerehabilitation and Physiotherapists\u2019 Satisfaction Toward Technology for Post-Knee Arthroplasty","volume":"17","author":"Tousignant","year":"2011","journal-title":"Telemed. J. e-Health"},{"key":"ref_38","unstructured":"Tracy, J., and Albers, M. (2006, January 7\u201310). Measuring cognitive load to test the usability of web sites. Proceedings of the Annual Conference-Society for Technical, Las Vegas, NV, USA."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Nielsen, C., Overgaard, M., Pedersen, M., Stage, J., and Stenild, S. (2006, January 14\u201318). It\u2019s worth the hassle!: The added value of evaluating the usability of mobile systems in the field. Proceedings of the 4th Nordic Conference on Human-Computer Interaction: Changing Roles, Oslo, Norway.","DOI":"10.1145\/1182475.1182504"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Bahr, B. (2017). Prototyping Requirements. Prototyping of User Interfaces for Mobile Applications, Springer.","DOI":"10.1007\/978-3-319-53210-3"}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/9\/3\/480\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:29:49Z","timestamp":1760185789000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/9\/3\/480"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,30]]},"references-count":40,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["app9030480"],"URL":"https:\/\/doi.org\/10.3390\/app9030480","relation":{},"ISSN":["2076-3417"],"issn-type":[{"type":"electronic","value":"2076-3417"}],"subject":[],"published":{"date-parts":[[2019,1,30]]}}}