{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T15:22:14Z","timestamp":1783610534950,"version":"3.55.0"},"reference-count":55,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,4,5]],"date-time":"2021-04-05T00:00:00Z","timestamp":1617580800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003995","name":"Anhui Provincial Natural Science Foundation","doi-asserted-by":"publisher","award":["1908085MF196"],"award-info":[{"award-number":["1908085MF196"]}],"id":[{"id":"10.13039\/501100003995","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The Open Funding Project of National Key Laboratory of Human Factors Engineering","award":["6142222190311"],"award-info":[{"award-number":["6142222190311"]}]},{"name":"The Key Research and Development Plan of Jiangsu Province","award":["BE2017007-1"],"award-info":[{"award-number":["BE2017007-1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent years, surface electromyography (sEMG)-based human\u2013computer interaction has been developed to improve the quality of life for people. Gesture recognition based on the instantaneous values of sEMG has the advantages of accurate prediction and low latency. However, the low generalization ability of the hand gesture recognition method limits its application to new subjects and new hand gestures, and brings a heavy training burden. For this reason, based on a convolutional neural network, a transfer learning (TL) strategy for instantaneous gesture recognition is proposed to improve the generalization performance of the target network. CapgMyo and NinaPro DB1 are used to evaluate the validity of our proposed strategy. Compared with the non-transfer learning (non-TL) strategy, our proposed strategy improves the average accuracy of new subject and new gesture recognition by 18.7% and 8.74%, respectively, when up to three repeated gestures are employed. The TL strategy reduces the training time by a factor of three. Experiments verify the transferability of spatial features and the validity of the proposed strategy in improving the recognition accuracy of new subjects and new gestures, and reducing the training burden. The proposed TL strategy provides an effective way of improving the generalization ability of the gesture recognition system.<\/jats:p>","DOI":"10.3390\/s21072540","type":"journal-article","created":{"date-parts":[[2021,4,5]],"date-time":"2021-04-05T11:48:29Z","timestamp":1617623309000},"page":"2540","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":49,"title":["Surface EMG-Based Instantaneous Hand Gesture Recognition Using Convolutional Neural Network with the Transfer Learning Method"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4526-8217","authenticated-orcid":false,"given":"Zhipeng","family":"Yu","sequence":"first","affiliation":[{"name":"Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianghai","family":"Zhao","sequence":"additional","affiliation":[{"name":"Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yucheng","family":"Wang","sequence":"additional","affiliation":[{"name":"Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linglong","family":"He","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaonan","family":"Wang","sequence":"additional","affiliation":[{"name":"Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,5]]},"reference":[{"key":"ref_1","first-page":"480","article-title":"EMG signal classification for human computer interaction: A review","volume":"33","author":"Ahsan","year":"2009","journal-title":"Eur. J. Sci. Res."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Tagliamonte, N.L., Sergi, F., Carpino, G., Accoto, D., and Guglielmelli, E. (2013, January 24\u201326). Human-robot interaction tests on a novel robot for gait assistance. Proceedings of the 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR), Seattle, WA, USA.","DOI":"10.1109\/ICORR.2013.6650387"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhang, L., Liu, G., Han, B., Wang, Z., and Zhang, T. (2019). sEMG based human motion intention recognition. J. Robot., 2019.","DOI":"10.1155\/2019\/3679174"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1590\/2446-4740.07417","article-title":"Control of a robotic knee exoskeleton for assistance and rehabilitation based on motion intention from sEMG","volume":"34","author":"Botelho","year":"2018","journal-title":"Res. Biomed. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"24","DOI":"10.3389\/fnbot.2017.00024","article-title":"A human\u2013robot interaction perspective on assistive and rehabilitation robotics","volume":"11","author":"Beckerle","year":"2017","journal-title":"Front. Neurorobot."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1109\/TSMCB.2012.2185843","article-title":"An EMG-based control for an upper-limb power-assist exoskeleton robot","volume":"42","author":"Kiguchi","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Part B (Cybern.)"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.robot.2014.09.032","article-title":"Review of assistive strategies in powered lower-limb orthoses and exoskeletons","volume":"64","author":"Yan","year":"2015","journal-title":"Robot. Auton. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Phinyomark, A., N Khushaba, R., and Scheme, E. (2018). Feature extraction and selection for myoelectric control based on wearable EMG sensors. Sensors, 18.","DOI":"10.3390\/s18051615"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Parajuli, N., Sreenivasan, N., Bifulco, P., Cesarelli, M., Savino, S., Niola, V., Esposito, D., Hamilton, T.J., Naik, G.R., and Gunawardana, U. (2019). Real-time EMG based pattern recognition control for hand prostheses: A review on existing methods, challenges and future implementation. Sensors, 19.","DOI":"10.3390\/s19204596"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.jbmt.2006.12.005","article-title":"EMG-based analysis of change in muscle activity during simulated driving","volume":"11","author":"Balasubramanian","year":"2007","journal-title":"J. Bodyw. Mov. Ther."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1016\/j.bspc.2007.07.009","article-title":"Myoelectric control systems\u2014A survey","volume":"2","author":"Oskoei","year":"2007","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1109\/TNSRE.2010.2100828","article-title":"Determining the optimal window length for pattern recognition-based myoelectric control: Balancing the competing effects of classification error and controller delay","volume":"19","author":"Smith","year":"2010","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.bspc.2015.02.009","article-title":"Current state of digital signal processing in myoelectric interfaces and related applications","volume":"18","author":"Hakonen","year":"2015","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Nazmi, N., Abdul Rahman, M.A., Yamamoto, S.I., Ahmad, S.A., Zamzuri, H., and Mazlan, S.A. (2016). A review of classification techniques of EMG signals during isotonic and isometric contractions. Sensors, 16.","DOI":"10.3390\/s16081304"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"12431","DOI":"10.3390\/s130912431","article-title":"Surface electromyography signal processing and classification techniques","volume":"13","author":"Chowdhury","year":"2013","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1682\/JRRD.2010.09.0177","article-title":"Electromyogram pattern recognition for control of powered upper-limb prostheses: State of the art and challenges for clinical use","volume":"48","author":"Scheme","year":"2011","journal-title":"J. Rehabil. Res. Dev."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"36571","DOI":"10.1038\/srep36571","article-title":"Gesture recognition by instantaneous surface EMG images","volume":"6","author":"Geng","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Du, Y., Jin, W., Wei, W., Hu, Y., and Geng, W. (2017). Surface EMG-based inter-session gesture recognition enhanced by deep domain adaptation. Sensors, 17.","DOI":"10.3390\/s17030458"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Atzori, M., Gijsberts, A., Heynen, S., Hager, A.G.M., Deriaz, O., Van Der Smagt, P., Castellini, C., Caputo, B., and M\u00fcller, H. (2012, January 24\u201327). Building the Ninapro database: A resource for the biorobotics community. Proceedings of the 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, Italy.","DOI":"10.1109\/BioRob.2012.6290287"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Yang, K., Qian, J., and Zhang, L. (2019). Real-Time Surface EMG Pattern Recognition for Hand Gestures Based on an Artificial Neural Network. Sensors, 19.","DOI":"10.3390\/s19143170"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"C\u00f4t\u00e9 Allard, U., Nougarou, F., Fall, C.L., Gigu\u00e8re, P., Gosselin, C., Laviolette, F., and Gosselin, B. (2016, January 9\u201314). A convolutional neural network for robotic arm guidance using sEMG based frequency-features. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759384"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, L., Fu, J., Wu, Y., Li, H., and Zheng, B. (2020). Hand gesture recognition using compact CNN via surface electromyography signals. Sensors, 20.","DOI":"10.3390\/s20030672"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, W., Luo, Z., Jin, Y., and Xi, X. (2021). Gesture Recognition Based on Multiscale Singular Value Entropy and Deep Belief Network. Sensors, 21.","DOI":"10.3390\/s21010119"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Park, K.H., and Lee, S.W. (2016, January 22\u201324). Movement intention decoding based on deep learning for multiuser myoelectric interfaces. Proceedings of the 2016 4th International Winter Conference on Brain-Computer Interface (BCI), Gangwon-do, Korea.","DOI":"10.1109\/IWW-BCI.2016.7457459"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"9","DOI":"10.3389\/fnbot.2016.00009","article-title":"Deep learning with convolutional neural networks applied to electromyography data: A resource for the classification of movements for prosthetic hands","volume":"10","author":"Atzori","year":"2016","journal-title":"Front. Neurorobot."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ding, Z., Yang, C., Tian, Z., Yi, C., Fu, Y., and Jiang, F. (2018). sEMG-based gesture recognition with convolution neural networks. Sustainability, 10.","DOI":"10.3390\/su10061865"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Asif, A.R., Waris, A., Gilani, S.O., Jamil, M., Ashraf, H., Shafique, M., and Niazi, I.K. (2020). Performance Evaluation of Convolutional Neural Network for Hand Gesture Recognition Using EMG. Sensors, 20.","DOI":"10.3390\/s20061642"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, Z., He, C., and Yang, K. (2020). A Novel Surface Electromyographic Signal-Based Hand Gesture Prediction Using a Recurrent Neural Network. Sensors, 20.","DOI":"10.3390\/s20143994"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1016\/j.promfg.2018.07.152","article-title":"Worker Activity Recognition in Smart Manufacturing Using IMU and sEMG Signals with Convolutional Neural Networks","volume":"26","author":"Tao","year":"2018","journal-title":"Procedia Manuf."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"103868","DOI":"10.1016\/j.engappai.2020.103868","article-title":"Multi-modal recognition of worker activity for human-centered intelligent manufacturing","volume":"95","author":"Tao","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018). A Survey on Deep Transfer Learning, 2018. arXiv.","DOI":"10.1007\/978-3-030-01424-7_27"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cote-Allard, U., Fall, C.L., Campeau-Lecours, A., Gosselin, C., Laviolette, F., and Gosselin, B. (2017, January 5\u20138). Transfer learning for sEMG hand gestures recognition using convolutional neural networks. Proceedings of the 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, Canada.","DOI":"10.1109\/SMC.2017.8122854"},{"key":"ref_34","unstructured":"Rusu, A.A., Rabinowitz, N.C., Desjardins, G., Soyer, H., Kirkpatrick, J., Kavukcuoglu, K., Pascanu, R., and Hadsell, R. (2016). Progressive neural networks. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1109\/TNSRE.2019.2896269","article-title":"Deep learning for electromyographic hand gesture signal classification using transfer learning","volume":"27","author":"Fall","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chen, X., Li, Y., Hu, R., Zhang, X., and Chen, X. (2020). Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method. IEEE J. Biomed. Health Inform.","DOI":"10.1109\/JBHI.2020.3009383"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ketyk\u00f3, I., Kov\u00e1cs, F., and Varga, K.Z. (2019, January 14\u201319). Domain adaptation for semg-based gesture recognition with recurrent neural networks. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852018"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/TNSRE.2019.2946625","article-title":"A Subject-Transfer Framework Based on Single-Trial EMG Analysis Using Convolutional Neural Networks","volume":"28","author":"Kim","year":"2019","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_39","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014, January 8\u201313). How transferable are features in deep neural networks?. Proceedings of the 27th International Conference on Neural Information Processing Systems (NIPS), Montr\u00e9al, QC, Canada."},{"key":"ref_40","unstructured":"Santurkar, S., Tsipras, D., Ilyas, A., and Madry, A. (2018, January 2\u20138). How does batch normalization help optimization?. Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS), Montr\u00e9al, QC, Canada."},{"key":"ref_41","unstructured":"Agarap, A.F. (2018). Deep learning using rectified linear units (relu). arXiv."},{"key":"ref_42","first-page":"2814","article-title":"Understanding dropout","volume":"26","author":"Baldi","year":"2013","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_43","unstructured":"Krogh, A., and Hertz, J.A. (1991, January 2\u20135). A simple weight decay can improve generalization. Proceedings of the 4th International Conference on Neural Information Processing Systems (NIPS), Denver, CO, USA."},{"key":"ref_44","unstructured":"Kaur, G., Arora, A.S., and Jain, V. (2009, January 7\u20139). Comparison of the techniques used for segmentation of EMG signals. Proceedings of the 11th WSEAS International Conference on Mathematical and Computational Methods in Science and Engineering, World Scientific and Engineering Academy and Society (WSEAS), Baltimore, MD, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.1109\/TBME.2019.2947089","article-title":"Training-Free Bayesian Self-Adaptive Classification for sEMG Pattern Recognition Including Motion Transition","volume":"67","author":"Park","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1109\/TBME.2003.813539","article-title":"A robust, real-time control scheme for multifunction myoelectric control","volume":"50","author":"Englehart","year":"2003","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_47","unstructured":"Chan, A.D., and Englehart, K. (2003, January 17\u201321). Continuous classification of myoelectric signals for powered prostheses using Gaussian mixture models. Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No. 03CH37439), Cancun, Mexico."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Wang, X., Zhao, J., Yang, D., Li, N., Sun, C., and Liu, H. (2010, January 26\u201329). Biomechatronic approach to a multi-fingered hand prosthesis. Proceedings of the 2010 3rd IEEE RAS EMBS International Conference on Biomedical Robotics and Biomechatronics, Tokyo, Japan.","DOI":"10.1109\/BIOROB.2010.5627734"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.bspc.2012.08.005","article-title":"Pattern recognition of number gestures based on a wireless surface EMG system","volume":"8","author":"Chen","year":"2013","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_50","unstructured":"Abduo, M., and Galster, M. (2015). Myo Gesture Control Armband for Medical Applications, University of Canterbury."},{"key":"ref_51","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Li, M., Zhang, T., Chen, Y., and Smola, A.J. (2014, January 24\u201327). Efficient mini-batch training for stochastic optimization. Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA.","DOI":"10.1145\/2623330.2623612"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., and Zhang, C. (2017, January 22\u201329). Learning efficient convolutional networks through network slimming. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.298"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Patricia, N., Tommasit, T., and Caputo, B. (2014, January 24\u201328). Multi-source Adaptive Learning for Fast Control of Prosthetics Hand. Proceedings of the 2014 22nd International Conference on Pattern Recognition, Stockholm, Sweden.","DOI":"10.1109\/ICPR.2014.477"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Tomczy\u0144ski, J., Ma\u0144kowski, T., and Kaczmarek, P. (2017, January 20\u201322). Influence of sEMG electrode matrix configuration on hand gesture recognition performance. Proceedings of the 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA), Poznan, Poland.","DOI":"10.23919\/SPA.2017.8166835"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2540\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:26:19Z","timestamp":1760361979000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2540"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,5]]},"references-count":55,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21072540"],"URL":"https:\/\/doi.org\/10.3390\/s21072540","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,5]]}}}