{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T07:52:41Z","timestamp":1781250761952,"version":"3.54.1"},"reference-count":30,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2022,11,1]],"date-time":"2022-11-01T00:00:00Z","timestamp":1667260800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 110-2221-E-305-001"],"award-info":[{"award-number":["MOST 110-2221-E-305-001"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 109-2221-E-305-004-MY3"],"award-info":[{"award-number":["MOST 109-2221-E-305-004-MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 109-2622-E-305-004"],"award-info":[{"award-number":["MOST 109-2622-E-305-004"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 110-2221-E-305-001"],"award-info":[{"award-number":["MOST 110-2221-E-305-001"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 109-2221-E-305-004-MY3"],"award-info":[{"award-number":["MOST 109-2221-E-305-004-MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 109-2622-E-305-004"],"award-info":[{"award-number":["MOST 109-2622-E-305-004"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 110-2221-E-305-001"],"award-info":[{"award-number":["MOST 110-2221-E-305-001"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 109-2221-E-305-004-MY3"],"award-info":[{"award-number":["MOST 109-2221-E-305-004-MY3"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["MOST 109-2622-E-305-004"],"award-info":[{"award-number":["MOST 109-2622-E-305-004"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Doppler-radar-based continuous human motion recognition recently has attracted extensive attention, which is a favorable choice for privacy and personal security. Existing results of continuous human motion recognition (CHMR) using mmWave FMCW Radar are not considered the continuous human motion with the high similarity problem. In this paper, we proposed a new CHMR algorithm with the consideration of the high similarity (HS) problem, called as CHMR-HS, by using the modified Transformer-based learning model. As far as we know, this is the first result in the literature to investigate the continuous HMR with the high similarity. To obtain the clear FMCW radar images, the background and target signals of the detected human are separated through the background denoising and the target extraction algorithms. To investigate the effects of the spectral-temporal multi-features with different dimensions, Doppler, range, and angle signatures are extracted as the 2D features and range-Doppler-time and range-angle-time signatures are extracted as the 3D features. The 2D\/3D features are trained into the adjusted Transformer-encoder model to distinguish the difference of the high-similarity human motions. The conventional Transformer-decoder model is also re-designed to be Transformer-sequential-decoder model such that Transformer-sequential-decoder model can successfully recognize the continuous human motions with the high similarity. The experimental results show that the accuracy of our proposed CHMR-HS scheme are 95.2% and 94.5% if using 3D and 2D features, the simulation results also illustrates that our CHMR-HS scheme has advantages over existing CHMR schemes.<\/jats:p>","DOI":"10.3390\/s22218409","type":"journal-article","created":{"date-parts":[[2022,11,2]],"date-time":"2022-11-02T03:44:17Z","timestamp":1667360657000},"page":"8409","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2784-9616","authenticated-orcid":false,"given":"Yuh-Shyan","family":"Chen","sequence":"first","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University, No. 151, University Rd., San Shia District, New Taipei City 23741, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kuang-Hung","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University, No. 151, University Rd., San Shia District, New Taipei City 23741, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"You-An","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University, No. 151, University Rd., San Shia District, New Taipei City 23741, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tong-Ying","family":"Juang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, National Taipei University, No. 151, University Rd., San Shia District, New Taipei City 23741, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"6487","DOI":"10.1109\/JSEN.2020.3040865","article-title":"An End-to-End Network for Continuous Human Motion Recognition via Radar Radios","volume":"21","author":"Zhao","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3278","DOI":"10.1109\/JSEN.2018.2808688","article-title":"Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor","volume":"18","author":"Zhang","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Yu, C., Fang, S.-H., Lin, L., Chien, Y.-R., and Xu, Z. (2020, January 26\u201328). The Impact of Environmental Factors on mm-Wave Radar Point-Clouds for Human Activity Recognition. Proceedings of the IEEE International Workshop on Electromagnetics: Applications and Student Innovation Competition (iWEM), Penghu, Taiwan.","DOI":"10.1109\/iWEM49354.2020.9237398"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ahmed, S., Park, J., and Cho, S.H. (2022, January 6\u20139). FMCW Radar Sensor Based Human Activity Recognition using Deep Learning. Proceedings of the International Conference on Electronics Information and Communication (ICEIC), Jeju, Korea.","DOI":"10.1109\/ICEIC54506.2022.9748776"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, L., and Lu, Y. (2019, January 11\u201313). Classification and Identification of Micro-Doppler Signatures of Pedestrian and Cyclists Using Simulated Data and ELM. Proceedings of the IEEE International Conference on Signal, Information and Data Processing, (ICSIDP), Chongqing, China.","DOI":"10.1109\/ICSIDP47821.2019.9173324"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sun, Y., Fei, T., Schliep, F., and Pohl, N. (2018, January 15\u201317). Gesture Classification with Handcrafted Micro-Doppler Features using a FMCW Radar. Proceedings of the IEEE MTT-S International Conference on Microwaves for Intelligent Mobility, (ICMIM), Munich, Germany.","DOI":"10.1109\/ICMIM.2018.8443507"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Saeed, U., Shah, S.Y., Shah, S.A., Ahmad, J., Alotaibi, A.A., Althobaiti, T., Ramzan, N., Alomainy, A., and Abbasi, Q.H. (2021). Discrete Human Activity Recognition and Fall Detection by Combining FMCW RADAR Data of Heterogeneous Environments for Independent Assistive Living. Electronics, 10.","DOI":"10.3390\/electronics10182237"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"6586","DOI":"10.1109\/TGRS.2020.3028223","article-title":"Human Motion Recognition With Limited Radar Micro-Doppler Signatures","volume":"59","author":"Li","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sakagami, F., Yamada, H., and Muramatsu, S. (2021, January 25\u201328). Accuracy Improvement of Human Motion Recognition with MW-FMCW Radar Using CNN. Proceedings of the International Symposium on Antennas and Propagation (ISAP), Osaka, Japan.","DOI":"10.23919\/ISAP47053.2021.9391487"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"13607","DOI":"10.1109\/JSEN.2020.3006386","article-title":"Continuous Human Activity Classification From FMCW Radar with Bi-LSTM Networks","volume":"20","author":"Shrestha","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5022","DOI":"10.1109\/JSEN.2020.3033278","article-title":"Continuous Human Motion Recognition Using Micro-Doppler Signatures in the Scenario with Micro Motion Interference","volume":"21","author":"Zhao","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Papanastasiou, V.S., Trommel, R.P., Harmanny, R.I.A., and Yarovoy, A. (2021, January 13\u201315). Deep Learning-based Identification of Human Gait by Radar Micro-Doppler Measurements. Proceedings of the 17th European Radar Conference (EuRAD), Utrecht, The Netherlands.","DOI":"10.1109\/EuRAD48048.2021.00024"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zheng, L., Bai, J., Zhu, X., Huang, L., Shan, C., Wu, Q., and Zhang, L. (2021). Dynamic Hand Gesture Recognition in In-Vehicle Environment Based on FMCW Radar and Transformer. Sensors, 21.","DOI":"10.3390\/s21196368"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Graves, A., Fern\u00e1ndez, S., Gomez, F., and Schmidhuber, J. (2006, January 25\u201329). Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks. Proceedings of the 23rd International Conference on Machine learning (ICML), Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143891"},{"key":"ref_15","unstructured":"Chen, V.C. (2000, January 16). Analysis of radar micro-Doppler with time-frequency transform. Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing, Pocono Manor, PA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4167","DOI":"10.1109\/JSEN.2018.2823588","article-title":"On the Application of Digital Moving Target Indication Techniques to Short-Range FMCW Radar Data","volume":"18","author":"Ash","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_17","first-page":"1","article-title":"CFAR-Based Interference Mitigation for FMCW Automotive Radar Systems","volume":"23","author":"Wang","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/LGRS.2015.2491329","article-title":"Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks","volume":"13","author":"Kim","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"24509","DOI":"10.1109\/ACCESS.2022.3150838","article-title":"Multi-View CNN-LSTM Architecture for Radar-Based Human Activity Recognition","volume":"10","author":"Khalid","year":"2022","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Guendel, R.G., Unterhorst, M., Gambi, E., Fioranelli, F., and Yarovoy, A. (2021, January 7\u201314). Continuous Human Activity Recognition for Arbitrary Directions with Distributed Radars. Proceedings of the IEEE Radar Conference (RadarConf21), Atlanta, GA, USA.","DOI":"10.1109\/RadarConf2147009.2021.9454972"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6821","DOI":"10.1109\/TGRS.2019.2908758","article-title":"Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar","volume":"57","author":"Ding","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention Is All You Need. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hu, R., and Singh, A. (2021, January 10\u201317). UniT: Multimodal Multitask Learning with a Unified Transformer. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Virtual.","DOI":"10.1109\/ICCV48922.2021.00147"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lohrenz, T., Li, Z., and Fingscheidt, T. (2021). Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognition. arXiv.","DOI":"10.21437\/Interspeech.2021-555"},{"key":"ref_25","unstructured":"(2022, October 07). AWR1642 Obstacle Detection Sensor with Wide Field-of-View (FOV) Antenna Evaluation Module. Available online: https:\/\/www.ti.com\/tool\/AWR1642BOOST-ODS."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Polat, G., Ergenc, I., Kani, H.T., Alahdab, Y.O., Atug, O., and Temizel, A. (2022). Class Distance Weighted Cross-Entropy Loss for Ulcerative Colitis Severity Estimation. arXiv.","DOI":"10.1007\/978-3-031-12053-4_12"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, C., Gonzalez, H.A., Vogginger, B., and Mayr, C.G. (2021, January 17\u201322). Phase-based Doppler Disambiguation in TDM and BPM MIMO FMCW Radars. Proceedings of the IEEE Radio and Wireless Symposium (RWS), San Diego, CA, USA.","DOI":"10.1109\/RWS50353.2021.9360348"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"K\u0131l\u0131\u00e7, B., and Ar\u0131kan, O. (2021, January 9\u201311). Capon\u2019s Beamformer and Minimum Mean Square Error Beamforming Techniques in Direction of Arrival Estimation. Proceedings of the 29th IEEE Signal Processing and Communications Applications Conference (SIU), Istanbul, Turkey.","DOI":"10.1109\/SIU53274.2021.9477868"},{"key":"ref_29","unstructured":"(2022, October 07). Create Production-Grade Machine Learning Models with TensorFlow. Available online: https:\/\/www.tensorflow.org\/?hl=zh-tw."},{"key":"ref_30","unstructured":"(2022, October 07). Real-Time Data-Capture Adapter for Radar Sensing Evaluation Module. Available online: https:\/\/www.ti.com\/tool\/DCA1000EVM."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8409\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:08:58Z","timestamp":1760144938000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8409"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,1]]},"references-count":30,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22218409"],"URL":"https:\/\/doi.org\/10.3390\/s22218409","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,1]]}}}