{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T20:26:56Z","timestamp":1773347216047,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,11,4]],"date-time":"2019-11-04T00:00:00Z","timestamp":1572825600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61901049"],"award-info":[{"award-number":["61901049"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the BUPT Basic Research Funding","award":["500419757"],"award-info":[{"award-number":["500419757"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Short-range radar has become one of the latest sensor technologies for the Internet of Things (IoT), and it plays an increasingly vital role in IoT applications. As the essential task for various smart-sensing applications, radar-based human activity recognition and person identification have received more attention due to radar\u2019s robustness to the environment and low power consumption. Activity recognition and person identification are generally treated as separate problems. However, designing different networks for these two tasks brings a high computational complexity and wastes of resources to some extent. Furthermore, there are some correlations in activity recognition and person identification tasks. In this work, we propose a multiscale residual attention network (MRA-Net) for joint activity recognition and person identification with radar micro-Doppler signatures. A fine-grained loss weight learning (FLWL) mechanism is presented for elaborating a multitask loss to optimize MRA-Net. In addition, we construct a new radar micro-Doppler dataset with dual labels of activity and identity. With the proposed model trained on this dataset, we demonstrate that our method achieves the state-of-the-art performance in both radar-based activity recognition and person identification tasks. The impact of the FLWL mechanism was further investigated, and ablation studies of the efficacy of each component in MRA-Net were also conducted.<\/jats:p>","DOI":"10.3390\/rs11212584","type":"journal-article","created":{"date-parts":[[2019,11,4]],"date-time":"2019-11-04T10:49:07Z","timestamp":1572864547000},"page":"2584","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":34,"title":["A Mutiscale Residual Attention Network for Multitask Learning of Human Activity Using Radar Micro-Doppler Signatures"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7578-8515","authenticated-orcid":false,"given":"Yuan","family":"He","sequence":"first","affiliation":[{"name":"Key Laboratory of Trustworthy Distributed Computing and Service (BUPT), Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1919-2327","authenticated-orcid":false,"given":"Xinyu","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Trustworthy Distributed Computing and Service (BUPT), Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]},{"given":"Xiaojun","family":"Jing","sequence":"additional","affiliation":[{"name":"Key Laboratory of Trustworthy Distributed Computing and Service (BUPT), Ministry of Education, Beijing University of Posts and Telecommunications, Beijing 100876, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1145\/2897824.2925953","article-title":"Soli: Ubiquitous gesture sensing with millimeter wave radar","volume":"35","author":"Lien","year":"2016","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/MCOM.2017.1700170","article-title":"Wi-Fi radar: Recognizing human behavior with commodity Wi-Fi","volume":"55","author":"Zou","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/j.bushor.2015.03.008","article-title":"The Internet of Things (IoT): Applications, investments, and challenges for enterprises","volume":"58","author":"Lee","year":"2015","journal-title":"Bus. Horizons"},{"key":"ref_4","first-page":"40","article-title":"Online Cross-Modal Adaptation for Audio\u2013Visual Person Identification With Wearable Cameras","volume":"47","author":"Brutti","year":"2017","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3941","DOI":"10.1109\/TGRS.2018.2816812","article-title":"Indoor Person Identification Using a Low-Power FMCW Radar","volume":"56","author":"Vandersmissen","year":"2018","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1328","DOI":"10.1109\/TGRS.2009.2012849","article-title":"Human activity classification based on micro-Doppler signatures using a support vector machine","volume":"47","author":"Kim","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, K., Liu, W., Gan, C., Tan, M., and Ma, H. (2018, January 2\u20137). T-C3D: Temporal convolutional 3D network for real-time action recognition. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12333"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.displa.2018.08.001","article-title":"deepGesture: Deep learning-based gesture recognition scheme using motion sensors","volume":"55","author":"Kim","year":"2018","journal-title":"Displays"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1109\/TAES.2018.2799758","article-title":"Deep convolutional autoencoder for radar-based classification of similar aided and unaided human activities","volume":"54","author":"Gurbuz","year":"2018","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1070","DOI":"10.1109\/TPAMI.2015.2477843","article-title":"A multi-task learning framework for head pose estimation under target motion","volume":"38","author":"Yan","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/TPAMI.2016.2537337","article-title":"Hierarchical Clustering Multi-Task Learning for Joint Human Action Grouping and Recognition","volume":"39","author":"Liu","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","unstructured":"Ruder, S. (2017). An overview of multi-task learning in deep neural networks. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., Wang, X., and Tang, X. (2017). Residual attention network for image classification. arXiv.","DOI":"10.1109\/CVPR.2017.683"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TPAMI.2017.2781233","article-title":"Hyperface: A deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition","volume":"41","author":"Ranjan","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Tian, Y., Luo, P., Wang, X., and Tang, X. (2015, January 8\u201310). Pedestrian detection aided by deep learning semantic tasks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299143"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liang, G., Lan, X., Zheng, K., Wang, S., and Zheng, N. (2018, January 2\u20137). Cross-View Person Identification by Matching Human Poses Estimated with Confidence on Each Body Joint. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12236"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ali, M.M., Mahale, V.H., Yannawar, P., and Gaikwad, A. (2016, January 27\u201328). Fingerprint recognition for person identification and verification based on minutiae matching. Proceedings of the IEEE 6th International Conference on Advanced Computing (IACC), Bhimavaram, India.","DOI":"10.1109\/IACC.2016.69"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zeng, Y., Pathak, P.H., and Mohapatra, P. (2016, January 11\u201314). WiWho: Wifi-based person identification in smart spaces. Proceedings of the 15th International Conference on Information Processing in Sensor Networks, Vienna, Austria.","DOI":"10.1109\/IPSN.2016.7460727"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"729","DOI":"10.1049\/iet-rsn.2017.0511","article-title":"Radar-ID: Human identification based on radar micro-Doppler signatures using deep convolutional neural networks","volume":"12","author":"Cao","year":"2018","journal-title":"IET Radar Sonar Navig."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"5316","DOI":"10.1109\/TVT.2016.2616883","article-title":"Indoor device-free activity recognition based on radio signal","volume":"66","author":"Huang","year":"2017","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, T., Li, N., Huang, J., Zhong, J.X., and Li, G. (2018, January 7\u201310). An Active Action Proposal Method Based on Reinforcement Learning. Proceedings of the 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451741"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2018.02.010","article-title":"Deep learning for sensor-based activity recognition: A survey","volume":"119","author":"Wang","year":"2019","journal-title":"Pattern Recognit. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/LGRS.2015.2491329","article-title":"Human detection and activity classification based on micro-Doppler signatures using deep convolutional neural networks","volume":"13","author":"Kim","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Le, H.T., Phung, S.L., Bouzerdoum, A., and Tivive, F.H.C. (2018, January 15\u201320). Human Motion Classification with Micro-Doppler Radar and Bayesian-Optimized Convolutional Neural Networks. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8461847"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mioranda-Correa, J.A., and Patras, I. (2018, January 15\u201319). A Multi-Task Cascaded Network for Prediction of Affect, Personality, Mood and Social Context Using EEG Signals. Proceedings of the IEEE International Conference on Automatic Face & Gesture Recognition, Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00060"},{"key":"ref_27","unstructured":"Kendall, A., Gal, Y., and Cipolla, R. (2017). Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1109\/TIP.2017.2765830","article-title":"Multi-task convolutional neural network for pose-invariant face recognition","volume":"27","author":"Yin","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cai, Z., Fan, Q., Feris, R.S., and Vasconcelos, N. (2016, January 8\u201316). A unified multi-scale deep convolutional neural network for fast object detection. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_22"},{"key":"ref_30","unstructured":"Vignaud, L., Ghaleb, A., Le Kernec, J., and Nicolas, J.M. (2009, January 12\u201316). Radar high resolution range & micro-doppler analysis of human motions. Proceedings of the 2009 International Radar Conference \u201cSurveillance for a Safer World\u201d (RADAR 2009), Bordeaux, France."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.dsp.2019.01.013","article-title":"Human motion recognition exploiting radar with stacked recurrent neural network","volume":"87","author":"Wang","year":"2019","journal-title":"Digit. Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Lang, Y., Wang, Q., Yang, Y., Hou, C., Liu, H., and He, Y. (2019). Joint Motion Classification and Person Identification via Multi-Task Learning for Smart Homes. IEEE Internet Things J.","DOI":"10.1109\/JIOT.2019.2929833"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/21\/2584\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:31:47Z","timestamp":1760189507000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/21\/2584"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,4]]},"references-count":32,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["rs11212584"],"URL":"https:\/\/doi.org\/10.3390\/rs11212584","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,4]]}}}