{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T04:42:26Z","timestamp":1784868146617,"version":"3.55.0"},"reference-count":43,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>Musculoskeletal disorders (MSDs) can significantly impact individuals\u2019 quality of life (QoL), often requiring effective rehabilitation strategies to promote recovery. However, traditional rehabilitation methods can be expensive and may lack engagement, leading to poor adherence to therapy exercise routines. An exergame system can be a solution to this problem. In this paper, we investigate appropriate hand gestures for controlling video games in a rehabilitation exergame system. The Mediapipe Python library is adopted for the real-time recognition of gestures. We choose 10 easy gestures among 32 possible simple gestures. Then, we specify and compare the best and the second-best groups used to control the game. Comprehensive experiments are conducted with 16 students at Andalas University, Indonesia, to find appropriate gestures and evaluate user experiences of the system using the System Usability Scale (SUS) and User Experience Questionnaire (UEQ). The results show that the hand gestures in the best group are more accessible than in the second-best group. The results suggest appropriate hand gestures for game controls and confirm the proposal\u2019s validity. In future work, we plan to enhance the exergame system by integrating a diverse set of video games, while expanding its application to a broader and more diverse sample. We will also study other practical applications of the hand gesture control function.<\/jats:p>","DOI":"10.3390\/computers14010025","type":"journal-article","created":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T09:01:02Z","timestamp":1736931662000},"page":"25","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["An Investigation of Hand Gestures for Controlling Video Games in a Rehabilitation Exergame System"],"prefix":"10.3390","volume":"14","author":[{"given":"Radhiatul","family":"Husna","sequence":"first","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2896-6686","authenticated-orcid":false,"given":"Komang Candra","family":"Brata","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"},{"name":"Department of Informatics Engineering, Universitas Brawijaya, Malang 65145, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2755-3743","authenticated-orcid":false,"given":"Irin Tri","family":"Anggraini","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nobuo","family":"Funabiki","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Systems, Okayama University, Okayama 700-8530, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alfiandi Aulia","family":"Rahmadani","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, State Polytechnic of Malang, Malang 65141, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0585-975X","authenticated-orcid":false,"given":"Chih-Peng","family":"Fan","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Chung Hsing University, Taichung 402, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,15]]},"reference":[{"key":"ref_1","unstructured":"(2024, May 11). Musculoskeletal Health. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/musculoskeletal-conditions."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.12691\/ajssm-5-2-3","article-title":"Stretching exercises to prevent work-related musculoskeletal disorders: A review article","volume":"5","author":"Gasibat","year":"2017","journal-title":"Am. J. Sport Sci. Med."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Klein, S., Chiu, K., Clinch, J., and Liossi, C. (2024). Musculoskeletal pain in children and young people. Managing Pain in Children and Young People: A Clinical Guide, Wiley.","DOI":"10.1002\/9781119645641.ch9"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1097\/NPT.0000000000000017","article-title":"Video games and rehabilitation: Using design principles to enhance engagement in physical therapy","volume":"37","author":"Lohse","year":"2013","journal-title":"J. Neurol. Phys. Ther."},{"key":"ref_5","unstructured":"(2024, February 07). Exergame, Available online: https:\/\/healthysd.gov\/what-is-exergaming\/."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Pereira, M.F., Prahm, C., Kolbenschlag, J., Oliveira, E., and Rodrigues, N.F. (2020, January 12\u201314). A virtual reality serious game for hand rehabilitation therapy. Proceedings of the 2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH), Vancouver, BC, Canada.","DOI":"10.1109\/SeGAH49190.2020.9201789"},{"key":"ref_7","unstructured":"Knight, J. (2024, February 05). The Importance of Hand Exercises. Available online: https:\/\/handandwristinstitute.com\/the-importance-of-hand-exercises\/."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.entcom.2011.03.008","article-title":"The promise of exergames as tools to measure physical health","volume":"2","author":"Staiano","year":"2011","journal-title":"Entertain. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Macvean, A., and Robertson, J. (2013, January 27). Understanding exergame users\u2019 physical activity, motivation and behavior over time. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, NY, USA.","DOI":"10.1145\/2470654.2466163"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1123\/jpah.2011-0425","article-title":"The role of exergaming in improving physical activity: A review","volume":"11","author":"Sween","year":"2014","journal-title":"J. Phys. Act. Health"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Demers, M., Martinie, O., Winstein, C., and Robert, M.T. (2020). Active video games and low-cost virtual reality: An ideal therapeutic modality for children with physical disabilities during a global pandemic. Front. Neurol., 11.","DOI":"10.3389\/fneur.2020.601898"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Xue, Y., Zhao, L., Xue, M., and Fu, J. (2018, January 12\u201314). Gesture interaction and augmented reality based hand rehabilitation supplementary system. Proceedings of the 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.","DOI":"10.1109\/IAEAC.2018.8577476"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1007\/s12178-022-09797-w","article-title":"Gamification in musculoskeletal rehabilitation","volume":"15","author":"Alfieri","year":"2022","journal-title":"Curr. Rev. Musculoskelet. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"103099","DOI":"10.1016\/j.ijhcs.2023.103099","article-title":"Exergames for hand rehabilitation in elders using Leap Motion Controller: A feasibility pilot study","volume":"178","author":"Pirbabaei","year":"2023","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_15","unstructured":"(2024, March 12). Mediapipe 0.10.11. Available online: https:\/\/pypi.org\/project\/mediapipe\/."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Yeng, A.C.M., Han, P.Y., How, K.W., and Yin, O.S. (2022). Hand gesture controlled game for hand rehabilitation. Proceedings of the International Conference on Computer, Information Technology and Intelligent Computing (CITIC 2022), Atlantis Press.","DOI":"10.2991\/978-94-6463-094-7_17"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Fonteles, J.H., Serpa, Y.R., Barbosa, R.G., Rodrigues, M.A.F., and Alves, M.S.P.L. (2018, January 16\u201318). Gesture-controlled interactive musical game to practice hand therapy exercises and learn rhythm and melodic structures. Proceedings of the 2018 IEEE 6th International Conference on Serious Games and Applications for Health (Segah), Vienna, Austria.","DOI":"10.1109\/SeGAH.2018.8401367"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Saman, O., and Stanciu, L. (2019, January 29\u201331). Hand mobility recovery through game controlled by gestures. Proceedings of the 2019 IEEE 13th International Symposium on Applied Computational Intelligence and Informatics (SACI), Timisoara, Romania.","DOI":"10.1109\/SACI46893.2019.9111632"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nasri, N., Orts-Escolano, S., and Cazorla, M. (2020). An semg-controlled 3d game for rehabilitation therapies: Real-time time hand gesture recognition using deep learning techniques. Sensors, 20.","DOI":"10.3390\/s20226451"},{"key":"ref_20","unstructured":"Farahanipad, F., Nambiappan, H.R., Jaiswal, A., Kyrarini, M., and Makedon, F. (July, January 30). HAND-REHA: Dynamic hand gesture recognition for game-based wrist rehabilitation. Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments, Corfu, Greece."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sophiya, E., and Reddy, S.S. (2024, January 15\u201316). Hand gesture-driven gaming for effective rehabilitation and improved quality of life-a review. Proceedings of the 2024 5th International Conference on Innovative Trends in Information Technology (ICITIIT), Kottayam, India.","DOI":"10.1109\/ICITIIT61487.2024.10580667"},{"key":"ref_22","first-page":"21","article-title":"Defining exergames & exergaming","volume":"2010","author":"Oh","year":"2010","journal-title":"Proc. Meaningful Play"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Brox, E., Luque, L.F., Evertsen, G.J., and Hern\u00e1ndez, J.E.G. (2011, January 23\u201326). Exergames for elderly: Social exergames to persuade seniors to increase physical activity. Proceedings of the 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops, Dublin, Ireland.","DOI":"10.4108\/icst.pervasivehealth.2011.246049"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1016\/j.chb.2016.12.086","article-title":"Can using exergames improve physical fitness? A 12-week randomized controlled trial","volume":"70","author":"Huang","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yu, T.C., Chiang, C.H., Wu, P.T., Wu, W.L., and Chu, I.H. (2020). Effects of exergames on physical fitness in middle-aged and older adults in Taiwan. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17072565"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.entcom.2015.10.002","article-title":"Exergaming and rehabilitation: A methodology for the design of effective and safe therapeutic exergames","volume":"14","author":"Pirovano","year":"2016","journal-title":"Entertain. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kaur, H., and Rani, J. (2016, January 4\u20136). A review: Study of various techniques of hand gesture recognition. Proceedings of the 2016 IEEE 1st International Conference on Power Electronics, Intelligent Control and Energy Systems (ICPEICES), Delhi, India.","DOI":"10.1109\/ICPEICES.2016.7853514"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Quan, C., and Liang, J. (2016, January 15\u201317). A simple and effective method for hand gesture recognition. Proceedings of the 2016 International Conference on Network and Information Systems for Computers (ICNISC), Wuhan, China.","DOI":"10.1109\/ICNISC.2016.072"},{"key":"ref_29","first-page":"1","article-title":"Gaming using different hand gestures using artificial neural network","volume":"10","author":"Prema","year":"2024","journal-title":"EAI Endorsed Trans. Internet Things"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Eshitha, K., and Jose, S. (2018, January 21\u201322). Hand gesture recognition using artificial neural network. Proceedings of the 2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET), Kottayam, India.","DOI":"10.1109\/ICCSDET.2018.8821076"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhu, Y., and Yuan, B. (2014, January 6\u201311). Real-time hand gesture recognition with Kinect for playing racing video games. Proceedings of the 2014 International Joint Conference on Neural Networks (IJCNN), Beijing, China.","DOI":"10.1109\/IJCNN.2014.6889481"},{"key":"ref_32","first-page":"4149","article-title":"Recognization of hand gestures using Mediapipe hands","volume":"4","author":"Kavana","year":"2022","journal-title":"Int. Res. J. Mod. Eng. Technol. Sci."},{"key":"ref_33","unstructured":"(2024, January 18). Google AI Blog, On-Device, Real-Time Hand Tracking with MediaPipe. Available online: https:\/\/ai.googleblog.com\/2019\/08\/on-device-real-time-hand-tracking-with.html."},{"key":"ref_34","unstructured":"(2024, January 12). MazeGame. Available online: https:\/\/www.sourcecodester.com\/javascript\/16517\/simple-hunger-maze-game-javascript-free-source-code.html."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Nef, T., Chesham, A., Sch\u00fctz, N., Botros, A.A., Vanbellingen, T., Burgunder, J.M., M\u00fcllner, J., Martin M\u00fcri, R., and Urwyler, P. (2020). Development and evaluation of maze-like puzzle games to assess cognitive and motor function in aging and neurodegenerative diseases. Front. Aging Neurosci., 12.","DOI":"10.3389\/fnagi.2020.00087"},{"key":"ref_36","unstructured":"(2024, January 10). SUS: System Usability Scale, Available online: https:\/\/www.usability.gov\/how-to-and-tools\/methods\/system-usability-scale.html."},{"key":"ref_37","first-page":"4","article-title":"SUS-A quick and dirty usability scale","volume":"189","author":"Brooke","year":"1996","journal-title":"Usability Eval. Ind."},{"key":"ref_38","unstructured":"(2024, July 01). UEQ: User Experience Questionnaire. Available online: https:\/\/www.ueq-online.org\/."},{"key":"ref_39","unstructured":"Schrepp, M. (2015). User experience questionnaire handbook. All You Need to Know to Apply the UEQ Successfully in Your Project, ResearchGate."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Lee, Y.E., and Fan, C.P. (2024, January 3\u20136). Identification of user\u2019s interests by deep-learning based pose estimation with angle relationship from keypoints for smart advertising displays. Proceedings of the 2024 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Danang, Vietnam.","DOI":"10.1109\/ICCE-Asia63397.2024.10773973"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1196","DOI":"10.25046\/aj0505145","article-title":"A proposal of exercise and performance learning assistant system for self-practice at home","volume":"5","author":"Anggraini","year":"2020","journal-title":"Adv. Sci. Technol. Eng. Syst. J."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, W.C., Shih, C.L., Anggraini, I.T., Funabiki, N., and Fan, C.P. (2023, January 18\u201320). Human\u2019s reaction time-based score calculation of self-practice dynamic yoga system for user\u2019s feedback by open pose and fuzzy rules. Proceedings of the 2023 11th International Conference on Information and Education Technology (ICIET), Fujisawa, Japan.","DOI":"10.1109\/ICIET56899.2023.10111121"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Shih, C.L., Liu, J.Y., Anggraini, I.T., Xiao, Y., Funabiki, N., and Fan, C.P. (2024, January 5\u20137). Difficulty evaluation of yoga poses by angular velocity and body area calculation for GPU-based yoga self-practice system. Proceedings of the 2024 IEEE Gaming, Entertainment, and Media Conference (GEM), Turin, Italy.","DOI":"10.1109\/GEM61861.2024.10585480"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/1\/25\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:29:14Z","timestamp":1759919354000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/1\/25"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,15]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["computers14010025"],"URL":"https:\/\/doi.org\/10.3390\/computers14010025","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,15]]}}}