{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T15:42:40Z","timestamp":1775144560387,"version":"3.50.1"},"reference-count":35,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,19]],"date-time":"2023-10-19T00:00:00Z","timestamp":1697673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Interdisciplinary Research Project for Young Teachers of USTB","award":["FRF-IDRY-21-005"],"award-info":[{"award-number":["FRF-IDRY-21-005"]}]},{"name":"Interdisciplinary Research Project for Young Teachers of USTB","award":["FRF-IDRY-22-009"],"award-info":[{"award-number":["FRF-IDRY-22-009"]}]},{"name":"Interdisciplinary Research Project for Young Teachers of USTB","award":["2020YFB1708800"],"award-info":[{"award-number":["2020YFB1708800"]}]},{"name":"Interdisciplinary Research Project for Young Teachers of USTB","award":["62206016"],"award-info":[{"award-number":["62206016"]}]},{"name":"National Key R&amp;D Program of China","award":["FRF-IDRY-21-005"],"award-info":[{"award-number":["FRF-IDRY-21-005"]}]},{"name":"National Key R&amp;D Program of China","award":["FRF-IDRY-22-009"],"award-info":[{"award-number":["FRF-IDRY-22-009"]}]},{"name":"National Key R&amp;D Program of China","award":["2020YFB1708800"],"award-info":[{"award-number":["2020YFB1708800"]}]},{"name":"National Key R&amp;D Program of China","award":["62206016"],"award-info":[{"award-number":["62206016"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["FRF-IDRY-21-005"],"award-info":[{"award-number":["FRF-IDRY-21-005"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["FRF-IDRY-22-009"],"award-info":[{"award-number":["FRF-IDRY-22-009"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2020YFB1708800"],"award-info":[{"award-number":["2020YFB1708800"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62206016"],"award-info":[{"award-number":["62206016"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Hand Gesture Recognition (HGR) using Frequency Modulated Continuous Wave (FMCW) radars is difficult because of the inherent variability and ambiguity caused by individual habits and environmental differences. This paper proposes a deformable dual-stream fusion network based on CNN-TCN (DDF-CT) to solve this problem. First, we extract range, Doppler, and angle information from radar signals with the Fast Fourier Transform to produce range-time (RT) and range-angle (RA) maps. Then, we reduce the noise of the feature map. Subsequently, the RAM sequence (RAMS) is generated by temporally organizing the RAMs, which captures a target\u2019s range and velocity characteristics at each time point while preserving the temporal feature information. To improve the accuracy and consistency of gesture recognition, DDF-CT incorporates deformable convolution and inter-frame attention mechanisms, which enhance the extraction of spatial features and the learning of temporal relationships. The experimental results show that our method achieves an accuracy of 98.61%, and even when tested in a novel environment, it still achieves an accuracy of 97.22%. Due to its robust performance, our method is significantly superior to other existing HGR approaches.<\/jats:p>","DOI":"10.3390\/s23208570","type":"journal-article","created":{"date-parts":[[2023,10,19]],"date-time":"2023-10-19T07:15:36Z","timestamp":1697699736000},"page":"8570","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Robust Hand Gesture Recognition Using a Deformable Dual-Stream Fusion Network Based on CNN-TCN for FMCW Radar"],"prefix":"10.3390","volume":"23","author":[{"given":"Meiyi","family":"Zhu","sequence":"first","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chaoyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianquan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2986-8239","authenticated-orcid":false,"given":"Lei","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2036-2784","authenticated-orcid":false,"given":"Meixia","family":"Fu","sequence":"additional","affiliation":[{"name":"School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Key Laboratory of Knowledge Automation for Industrial Processes of Ministry of Education, University of Science and Technology Beijing, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"5619","DOI":"10.1109\/JIOT.2020.3032623","article-title":"Device-free secure interaction with hand gestures in WiFi-enabled IoT environment","volume":"8","author":"Zhao","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jayaweera, N., Gamage, B., Samaraweera, M., Liyanage, S., Lokuliyana, S., and Kuruppu, T. (2020, January 21\u201325). Gesture driven smart home solution for bedridden people. Proceedings of the 35th IEEE\/ACM International Conference on Automated Software Engineering, Virtual Event.","DOI":"10.1145\/3417113.3422998"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6039","DOI":"10.1109\/LRA.2021.3089999","article-title":"Multi-sensor guided hand gesture recognition for a teleoperated robot using a recurrent neural network","volume":"6","author":"Qi","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2597","DOI":"10.1109\/TVCG.2021.3067689","article-title":"Gestonhmd: Enabling gesture-based interaction on low-cost vr head-mounted display","volume":"27","author":"Chen","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Suarez, J., and Murphy, R.R. (2012, January 9\u201313). Hand gesture recognition with depth images: A review. Proceedings of the 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, Paris, France.","DOI":"10.1109\/ROMAN.2012.6343787"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/TMM.2014.2374357","article-title":"Superpixel-based hand gesture recognition with kinect depth camera","volume":"17","author":"Wang","year":"2014","journal-title":"IEEE Trans. Multimed."},{"key":"ref_7","first-page":"539","article-title":"Hand gesture recognition using deep feature fusion network based on wearable sensors","volume":"21","author":"Yuan","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/RBME.2021.3078190","article-title":"Emerging wearable interfaces and algorithms for hand gesture recognition: A survey","volume":"15","author":"Jiang","year":"2021","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ahmed, S., Kallu, K.D., Ahmed, S., and Cho, S.H. (2021). Hand gestures recognition using radar sensors for human-computer-interaction: A review. Remote Sens., 13.","DOI":"10.3390\/rs13030527"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1109\/TMTT.2011.2178427","article-title":"Millimeter-wave technology for automotive radar sensors in the 77 GHz frequency band","volume":"60","author":"Hasch","year":"2012","journal-title":"IEEE Trans. Microw. Theory Tech."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tang, G., Wu, T., and Li, C. (2023). Dynamic Gesture Recognition Based on FMCW Millimeter Wave Radar: Review of Methodologies and Results. Sensors, 23.","DOI":"10.3390\/s23177478"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, S., Song, J., Lien, J., Poupyrev, I., and Hilliges, O. (2016, January 16\u201319). Interacting with soli: Exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum. Proceedings of the 29th Annual Symposium on User Interface Software and Technology, Tokyo, Japan.","DOI":"10.1145\/2984511.2984565"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hayashi, E., Lien, J., Gillian, N., Giusti, L., Weber, D., Yamanaka, J., Bedal, L., and Poupyrev, I. (2021, January 8\u201313). Radarnet: Efficient gesture recognition technique utilizing a miniature radar sensor. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445367"},{"key":"ref_14","first-page":"3943","article-title":"Deep learning for visual tracking: A comprehensive survey","volume":"23","author":"Cheng","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Malysa, G., Wang, D., Netsch, L., and Ali, M. (2016, January 7\u20139). Hidden Markov model-based gesture recognition with FMCW radar. Proceedings of the 2016 IEEE Global Conference on Signal and information processing (GlobalSIP), Washington, DC, USA.","DOI":"10.1109\/GlobalSIP.2016.7905995"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1109\/TAES.2017.2761229","article-title":"Sparsity-driven micro-Doppler feature extraction for dynamic hand gesture recognition","volume":"54","author":"Li","year":"2017","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"7593","DOI":"10.1109\/JSEN.2018.2859815","article-title":"Feature-based hand gesture recognition using an FMCW radar and its temporal feature analysis","volume":"18","author":"Ryu","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"24713","DOI":"10.1109\/ACCESS.2020.2971064","article-title":"A hybrid CNN\u2013LSTM network for the classification of human activities based on micro-Doppler radar","volume":"8","author":"Zhu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1178","DOI":"10.1109\/LGRS.2019.2942097","article-title":"Classification of human activity based on radar signal using 1-D convolutional neural network","volume":"17","author":"Chen","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"33610","DOI":"10.1109\/ACCESS.2019.2903586","article-title":"Short-range radar based real-time hand gesture recognition using LSTM encoder","volume":"7","author":"Choi","year":"2019","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"7955","DOI":"10.1109\/TGRS.2020.2985421","article-title":"Negative latency recognition method for fine-grained gestures based on terahertz radar","volume":"58","author":"Wang","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","first-page":"3507005","article-title":"Multifeature fusion-based hand gesture sensing and recognition system","volume":"19","author":"Wang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"7001804","DOI":"10.1109\/LSENS.2018.2882642","article-title":"Robust gesture recognition using millimetric-wave radar system","volume":"2","author":"Hazra","year":"2018","journal-title":"IEEE Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"119042","DOI":"10.1016\/j.eswa.2022.119042","article-title":"mmGesture: Semi-supervised gesture recognition system using mmWave radar","volume":"213","author":"Yan","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wang, D., Fu, Y., Yao, D., Xie, L., and Zhou, M. (2022). Multi-Hand Gesture Recognition Using Automotive FMCW Radar Sensor. Remote Sens., 14.","DOI":"10.3390\/rs14102374"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"8904","DOI":"10.1109\/JSEN.2022.3163449","article-title":"Gesture recognition system using 24 GHz FMCW radar sensor realized on real-time edge computing platform","volume":"22","author":"Gan","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_27","first-page":"1408","article-title":"Two-stream fusion neural network approach for hand gesture recognition based on FMCW radar","volume":"47","author":"Wang","year":"2019","journal-title":"Acta Electonica Sin."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"16945","DOI":"10.1109\/JSEN.2021.3079564","article-title":"Hand gesture recognition based on trajectories features and computation-efficient reused LSTM network","volume":"21","author":"Yang","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1819","DOI":"10.1109\/TMM.2022.3168137","article-title":"Joint-bone fusion graph convolutional network for semi-supervised skeleton action recognition","volume":"25","author":"Tu","year":"2022","journal-title":"IEEE Trans. Multimed."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"105820","DOI":"10.1016\/j.asoc.2019.105820","article-title":"Human action recognition using two-stream attention based LSTM networks","volume":"86","author":"Dai","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zang, B., Ding, L., Feng, Z., Zhu, M., Lei, T., Xing, M., and Zhou, X. (2021). CNN-LRP: Understanding convolutional neural networks performance for target recognition in SAR images. Sensors, 21.","DOI":"10.3390\/s21134536"},{"key":"ref_33","unstructured":"Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhu, X., Hu, H., Lin, S., and Dai, J. (2019, January 15\u201320). Deformable convnets v2: More deformable, better results. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00953"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8570\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:09:23Z","timestamp":1760130563000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8570"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,19]]},"references-count":35,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208570"],"URL":"https:\/\/doi.org\/10.3390\/s23208570","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,19]]}}}