{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T22:28:51Z","timestamp":1776119331404,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T00:00:00Z","timestamp":1670457600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Hand gesture recognition systems (HGR) based on electromyography signals (EMGs) and inertial measurement unit signals (IMUs) have been studied for different applications in recent years. Most commonly, cutting-edge HGR methods are based on supervised machine learning methods. However, the potential benefits of reinforcement learning (RL) techniques have shown that these techniques could be a viable option for classifying EMGs. Methods based on RL have several advantages such as promising classification performance and online learning from experience. In this work, we developed an HGR system made up of the following stages: pre-processing, feature extraction, classification, and post-processing. For the classification stage, we built an RL-based agent capable of learning to classify and recognize eleven hand gestures\u2014five static and six dynamic\u2014using a deep Q-network (DQN) algorithm based on EMG and IMU information. The proposed system uses a feed-forward artificial neural network (ANN) for the representation of the agent policy. We carried out the same experiments with two different types of sensors to compare their performance, which are the Myo armband sensor and the G-force sensor. We performed experiments using training, validation, and test set distributions, and the results were evaluated for user-specific HGR models. The final accuracy results demonstrated that the best model was able to reach up to 97.50%\u00b11.13% and 88.15%\u00b12.84% for the classification and recognition, respectively, with regard to static gestures, and 98.95%\u00b10.62% and 90.47%\u00b14.57% for the classification and recognition, respectively, with regard to dynamic gestures with the Myo armband sensor. The results obtained in this work demonstrated that RL methods such as the DQN are capable of learning a policy from online experience to classify and recognize static and dynamic gestures using EMG and IMU signals.<\/jats:p>","DOI":"10.3390\/s22249613","type":"journal-article","created":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T03:35:53Z","timestamp":1670470553000},"page":"9613","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Hand Gesture Recognition Using EMG-IMU Signals and Deep Q-Networks"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6372-7405","authenticated-orcid":false,"given":"Juan Pablo","family":"V\u00e1sconez","sequence":"first","affiliation":[{"name":"Artificial Intelligence and Computer Vision Research Lab, Escuela Polit\u00e9cnica Nacional, Quito 170517, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5184-3759","authenticated-orcid":false,"given":"Lorena Isabel","family":"Barona L\u00f3pez","sequence":"additional","affiliation":[{"name":"Artificial Intelligence and Computer Vision Research Lab, Escuela Polit\u00e9cnica Nacional, Quito 170517, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3502-020X","authenticated-orcid":false,"given":"\u00c1ngel Leonardo","family":"Valdivieso Caraguay","sequence":"additional","affiliation":[{"name":"Artificial Intelligence and Computer Vision Research Lab, Escuela Polit\u00e9cnica Nacional, Quito 170517, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5275-7262","authenticated-orcid":false,"given":"Marco E.","family":"Benalc\u00e1zar","sequence":"additional","affiliation":[{"name":"Artificial Intelligence and Computer Vision Research Lab, Escuela Polit\u00e9cnica Nacional, Quito 170517, Ecuador"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Jaramillo-Y\u00e1nez, A., Benalc\u00e1zar, M.E., and Mena-Maldonado, E. (2020). Real-Time Hand Gesture Recognition Using Surface Electromyography and Machine Learning: A Systematic Literature Review. Sensors, 20.","DOI":"10.3390\/s20092467"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kim, J., Yang, S., Koo, B., Lee, S., Park, S., Kim, S., Cho, K.H., and Kim, Y. (2022). sEMG-Based Hand Posture Recognition and Visual Feedback Training for the Forearm Amputee. Sensors, 22.","DOI":"10.3390\/s22207984"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Lin, W., Li, C., and Zhang, Y. (2022). Interactive Application of Data Glove Based on Emotion Recognition and Judgment System. Sensors, 22.","DOI":"10.3390\/s22176327"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chico, A., Cruz, P.J., V\u00e1sconez, J.P., Benalc\u00e1zar, M.E., \u00c1lvarez, R., Barona, L., and Valdivieso, \u00c1.L. (2021, January 12\u201315). Hand Gesture Recognition and Tracking Control for a Virtual UR5 Robot Manipulator. Proceedings of the 2021 IEEE Fifth Ecuador Technical Chapters Meeting (ETCM), Cuenca, Ecuador.","DOI":"10.1109\/ETCM53643.2021.9590677"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Romero, R., Cruz, P.J., V\u00e1sconez, J.P., Benalc\u00e1zar, M., \u00c1lvarez, R., Barona, L., and Valdivieso, \u00c1.L. (2022). Hand Gesture and Arm Movement Recognition for Multimodal Control of a 3-DOF Helicopter. International Conference on Robot Intelligence Technology and Applications, Springer.","DOI":"10.1007\/978-3-030-97672-9_32"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Benalc\u00e1zar, M.E., Jaramillo, A.G., Zea, A., P\u00e1ez, A., and Andaluz, V.H. (September, January 28). Hand gesture recognition using machine learning and the Myo armband. Proceedings of the 2017 25th European Signal Processing Conference (EUSIPCO), Kos, Greece.","DOI":"10.23919\/EUSIPCO.2017.8081366"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nuzzi, C., Pasinetti, S., Lancini, M., Docchio, F., and Sansoni, G. (2018, January 16\u201318). Deep learning based machine vision: First steps towards a hand gesture recognition set up for collaborative robots. Proceedings of the 2018 Workshop on Metrology for Industry 4.0 and IoT, Brescia, Italy.","DOI":"10.1109\/METROI4.2018.8439044"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yang, L., Chen, J., and Zhu, W. (2020). Dynamic hand gesture recognition based on a leap motion controller and two-layer bidirectional recurrent neural network. Sensors, 20.","DOI":"10.3390\/s20072106"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kim, M., Cho, J., Lee, S., and Jung, Y. (2019). IMU sensor-based hand gesture recognition for human-machine interfaces. Sensors, 19.","DOI":"10.3390\/s19183827"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2000261","DOI":"10.1002\/advs.202000261","article-title":"Machine learning glove using self-powered conductive superhydrophobic triboelectric textile for gesture recognition in VR\/AR applications","volume":"7","author":"Wen","year":"2020","journal-title":"Adv. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1007\/s10846-017-0725-0","article-title":"Hand gesture recognition based omnidirectional wheelchair control using IMU and EMG sensors","volume":"91","author":"Kundu","year":"2018","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5775","DOI":"10.1109\/JSEN.2019.2904595","article-title":"Cooperative sensing and wearable computing for sequential hand gesture recognition","volume":"19","author":"Zhang","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3376","DOI":"10.1109\/TII.2017.2779814","article-title":"Feasibility of wrist-worn, real-time hand, and surface gesture recognition via sEMG and IMU sensing","volume":"14","author":"Jiang","year":"2017","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Benalc\u00e1zar, M.E., Motoche, C., Zea, J.A., Jaramillo, A.G., Anchundia, C.E., Zambrano, P., Segura, M., Palacios, F.B., and P\u00e9rez, M. (2017, January 16\u201320). Real-time hand gesture recognition using the Myo armband and muscle activity detection. Proceedings of the 2017 IEEE Second Ecuador Technical Chapters Meeting (ETCM), Salinas, Ecuador.","DOI":"10.1109\/ETCM.2017.8247458"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1109\/TBME.2003.813539","article-title":"A robust, real-time control scheme for multifunction myoelectric control","volume":"50","author":"Englehart","year":"2003","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"V\u00e1sconez, J.P., L\u00f3pez, L.I.B., Caraguay, \u00c1.L.V., Cruz, P.J., \u00c1lvarez, R., and Benalc\u00e1zar, M.E. (2021). A Hand Gesture Recognition System Using EMG and Reinforcement Learning: A Q-Learning Approach. International Conference on Artificial Neural Networks, Springer.","DOI":"10.1007\/978-3-030-86380-7_47"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, C., Wang, Z., An, Q., Li, S., Hoorfar, A., and Kou, C. (2022). Clustering-Driven DGS-Based Micro-Doppler Feature Extraction for Automatic Dynamic Hand Gesture Recognition. Sensors, 22.","DOI":"10.3390\/s22218535"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Jiang, Y., Song, L., Zhang, J., Song, Y., and Yan, M. (2022). Multi-Category Gesture Recognition Modeling Based on sEMG and IMU Signals. Sensors, 22.","DOI":"10.3390\/s22155855"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3172","DOI":"10.1109\/TCYB.2020.3007173","article-title":"A hierarchical hand gesture recognition framework for sports referee training-based EMG and accelerometer sensors","volume":"52","author":"Pan","year":"2022","journal-title":"IEEE Trans. Cybern."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Colli Alfaro, J.G., and Trejos, A.L. (2022). User-Independent Hand Gesture Recognition Classification Models Using Sensor Fusion. Sensors, 22.","DOI":"10.3390\/s22041321"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Seok, W., Kim, Y., and Park, C. (2018, January 10\u201312). Pattern recognition of human arm movement using deep reinforcement learning. Proceedings of the 2018 International Conference on Information Networking (ICOIN), Chiang Mai, Thailand.","DOI":"10.1109\/ICOIN.2018.8343257"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Song, C., Chen, C., Li, Y., and Wu, X. (2018, January 25\u201327). Deep Reinforcement Learning Apply in Electromyography Data Classification. Proceedings of the 2018 IEEE International Conference on Cyborg and Bionic Systems (CBS), Shenzhen, China.","DOI":"10.1109\/CBS.2018.8612213"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sharma, R., and Kukker, A. (2017, January 27\u201330). Neural Reinforcement Learning based Identifier for Typing Keys using Forearm EMG Signals. Proceedings of the 9th International Conference on Signal Processing Systems, Auckland, New Zealand.","DOI":"10.1145\/3163080.3163117"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5111","DOI":"10.3233\/JIFS-169795","article-title":"Neural reinforcement learning classifier for elbow, finger and hand movements","volume":"35","author":"Kukker","year":"2018","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Barona L\u00f3pez, L.I., Valdivieso Caraguay, \u00c1.L., Vimos, V.H., Zea, J.A., V\u00e1sconez, J.P., \u00c1lvarez, M., and Benalc\u00e1zar, M.E. (2020). An Energy-Based Method for Orientation Correction of EMG Bracelet Sensors in Hand Gesture Recognition Systems. Sensors, 20.","DOI":"10.3390\/s20216327"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A., and Silver, D. (2016, January 12\u201317). Deep reinforcement learning with double q-learning. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"ref_27","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_29","unstructured":"Kapturowski, S., Ostrovski, G., Quan, J., Munos, R., and Dabney, W. (May, January 30). Recurrent experience replay in distributed reinforcement learning. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9613\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:36:17Z","timestamp":1760146577000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9613"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,8]]},"references-count":29,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22249613"],"URL":"https:\/\/doi.org\/10.3390\/s22249613","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,8]]}}}