{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T18:08:33Z","timestamp":1775671713599,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T00:00:00Z","timestamp":1610409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Human pose reconstruction has been a fundamental research in computer vision. However, existing pose reconstruction methods suffer from the problem of wall occlusion that cannot be solved by a traditional optical sensor. This article studies a novel human target pose reconstruction framework using low-frequency ultra-wideband (UWB) multiple-input multiple-output (MIMO) radar and a convolutional neural network (CNN), which is used to detect targets behind the wall. In the proposed framework, first, we use UWB MIMO radar to capture the human body information. Then, target detection and tracking are used to lock the target position, and the back-projection algorithm is adopted to construct three-dimensional (3D) images. Finally, we take the processed 3D image as input to reconstruct the 3D pose of the human target via the designed 3D CNN model. Field detection experiments and comparison results show that the proposed framework can achieve pose reconstruction of human targets behind a wall, which indicates that our research can make up for the shortcomings of optical sensors and significantly expands the application of the UWB MIMO radar system.<\/jats:p>","DOI":"10.3390\/rs13020241","type":"journal-article","created":{"date-parts":[[2021,1,12]],"date-time":"2021-01-12T20:11:31Z","timestamp":1610482291000},"page":"241","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":56,"title":["Through-Wall Human Pose Reconstruction via UWB MIMO Radar and 3D CNN"],"prefix":"10.3390","volume":"13","author":[{"given":"Yongkun","family":"Song","sequence":"first","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Tian","family":"Jin","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Yongpeng","family":"Dai","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Yongping","family":"Song","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]},{"given":"Xiaolong","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1016\/j.imavis.2009.11.014","article-title":"A survey on vision-based human action recognition","volume":"28","author":"Poppe","year":"2010","journal-title":"Image Vis. Comput."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Guo, Y., He, D., and Chai, L. (2020). A Machine Vision-Based Method for Monitoring Scene-Interactive Behaviors of Dairy Calf. Animals, 10.","DOI":"10.3390\/ani10020190"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4025","DOI":"10.1109\/JSEN.2019.2952447","article-title":"Visual Sensors Hardware Platforms: A Review","volume":"20","author":"Costa","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1109\/MNET.011.1900257","article-title":"Energy-Efficient Monitoring of Fire Scenes for Intelligent Networks","volume":"34","author":"Muhammad","year":"2020","journal-title":"IEEE Netw."},{"key":"ref_5","unstructured":"Oghaz, M.M.D., Razaak, M., Kerdegari, H., Argyriou, V., and Remagnino, P. (2019, January 29\u201331). Scene and Environment Monitoring Using Aerial Imagery and Deep Learning. Proceedings of the 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS), Santorini, Greece."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"34S","DOI":"10.1177\/1527154406293968","article-title":"The Global Nursing Shortage: An Overview of Issues and Actions","volume":"7","author":"Oulton","year":"2006","journal-title":"Policy Politics Nurs. Pract."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/j.ergon.2017.02.004","article-title":"Gesture recognition for human-robot collaboration: A review","volume":"68","author":"Liu","year":"2018","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhang, F., Zhu, X., and Ye, M. (2019, January 16\u201320). Fast Human Pose Estimation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00363"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1007\/s11263-018-1118-y","article-title":"Fusing Visual and Inertial Sensors with Semantics for 3D Human Pose Estimation","volume":"127","author":"Gilbert","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_10","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of oriented gradients for human detection. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation Applied to Handwritten Zip Code Recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Toshev, A., and Szegedy, C. (2014, January 23\u201328). DeepPose: Human Pose Estimation via Deep Neural Networks. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.214"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.-E., and Sheikh, Y. (2017, January 21\u201326). Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.diii.2019.03.002","article-title":"Automatic knee meniscus tear detection and orientation classification with Mask-RCNN","volume":"100","author":"Couteaux","year":"2019","journal-title":"Diagn. Interv. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Pishchulin, L., Insafutdinov, E., Tang, S., Andres, B., Andriluka, M., Gehler, P., and Schiele, B. (2016, January 27\u201330). DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.533"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chen, Y., Wang, Z., Peng, Y., Zhang, Z., Yu, G., and Sun, J. (2018, January 18\u201322). Cascaded Pyramid Network for Multi-person Pose Estimation. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00742"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fang, H.-S., Xie, S., Tai, Y.-W., and Lu, C. (2017, January 22\u201329). RMPE: Regional Multi-person Pose Estimation. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.256"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tome, D., Russell, C., and Agapito, L. (2017, January 21\u201326). Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Image. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.603"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Pavlakos, G., Zhou, X., Derpanis, K.G., and Daniilidis, K. (2017, January 21\u201326). Coarse-to-Fine volumetric prediction for single-image 3d human pose. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.139"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhou, X., Huang, Q., Sun, X., Xue, X., and Wei, Y. (2017, January 22\u201329). Towards 3D Human Pose Estimation in the Wild: A Weakly-Supervised Ap-proach. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.51"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wandt, B., and Rosenhahn, B. (2019, January 16\u201320). RepNet: Weakly Supervised Training of an Adversarial Reprojection Network for 3D Human Pose Estimation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00797"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.jvcir.2013.03.011","article-title":"An adaptable system for RGB-D based human body detection and pose estimation","volume":"25","author":"Buys","year":"2014","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Pavllo, D., Feichtenhofer, C., Grangier, D., and Auli, M. (2019, January 16\u201320). 3D Human Pose Estimation in Video With Temporal Convolutions and Semi-Supervised Training. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00794"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mitra, R., Gundavarapu, N.B., Sharma, A., and Jain, A. (2020, January 13\u201319). Multiview-Consistent Semi-Supervised Learning for 3D Human Pose Estimation. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00694"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"Lecun","year":"2015","journal-title":"Nature"},{"key":"ref_27","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in neural information processing systems, Lake Tahoe, NV, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1109\/LGRS.2012.2190707","article-title":"Through-Wall Detection of Human Being\u2019s Movement by UWB Radar","volume":"9","author":"Li","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/LGRS.2019.2930636","article-title":"A Three-Dimensional Deep Learning Framework for Human Behavior Analysis Using Range-Doppler Time Points","volume":"17","author":"Du","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Qi, F., Lv, H., Liang, F., Li, Z., Yu, X., and Wang, J. (2017). MHHT-Based Method for Analysis of Micro-Doppler Signatures for Human Finer-Grained Activity Using Through-Wall SFCW Radar. Remote Sens., 9.","DOI":"10.3390\/rs9030260"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhao, M.M., Li, T.H., and Mohammad, A.A. (2018, January 18\u201323). Through-Wall Human Pose Estimation Using Radio Signals. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00768"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhao, M., Tian, Y., Zhao, H., Abu Alsheikh, M., Li, T., Hristov, R., Kabelac, Z., Katabi, D., and Torralba, A. (2018, January 20\u201325). RF-based 3D skeletons. Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, Budapest, Hungary.","DOI":"10.1145\/3230543.3230579"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"10032","DOI":"10.1109\/JSEN.2020.2991741","article-title":"mm-Pose: Real-Time Human Skeletal Posture Estimation Using mmWave Radars and CNNs","volume":"20","author":"Sengupta","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Nag, S., Barnes, M.A., Payment, T., and Holladay, G. (2002, January 30). Ultrawideband through-wall radar for detecting the motion of people in real time. Proceedings of the Radar Sensor Technology and Data Visualization, Orlando, FL, USA.","DOI":"10.1117\/12.488285"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MAES.2008.4523914","article-title":"UWB radar for human being detection [same as \"UWB radar for human being detection\", ibid., vol. 21, n. 11, 06]","volume":"23","author":"Yarovoy","year":"2008","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ma, Y., Liang, F., Wang, P., Lv, H., Yu, X., Zhang, Y., and Wang, J. (2019). An Accurate Method to Distinguish Between Stationary Hu-man and Dog Targets Under Through-Wall Condition Using UWB Radar. Remote Sens., 11.","DOI":"10.3390\/rs11212571"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Lv, H., Qi, F., Zhang, Y., Jiao, T., Liang, F., Li, Z., and Wang, J. (2016). Improved Detection of Human Respiration Using Data Fusion Basedon a Multistatic UWB Radar. Remote Sens., 8.","DOI":"10.3390\/rs8090773"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1109\/LGRS.2008.915742","article-title":"Three-Dimensional Wideband Beamforming for Imaging Through a Single Wall","volume":"5","author":"Ahmad","year":"2008","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","unstructured":"Kong, L., Cui, G., Yang, X., and Yang, J. (2009, January 4\u20138). Three-dimensional human imaging for through-the-wall radar. Proceedings of the 2009 IEEE Radar Conference, Pasadena, CA, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhao, D., Jin, T., Dai, Y., Song, Y., and Su, X. (2018). A Three-Dimensional Enhanced Imaging Method on Human Body for Ultra-Wideband Multiple-Input Multiple-Output Radar. Electronics, 7.","DOI":"10.3390\/electronics7070101"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2816795.2818072","article-title":"Capturing the human figure through a wall","volume":"34","author":"Adib","year":"2015","journal-title":"ACM Trans. Graph."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Hu, Z., Zeng, Z., Wang, K., Feng, W., Zhang, J., Lu, Q., and Kang, X. (2019). Design and Analysis of a UWB MIMO Radar System with Miniaturized Vivaldi Antenna for Through-Wall Imaging. Remote Sens., 11.","DOI":"10.3390\/rs11161867"},{"key":"ref_43","unstructured":"Lu, B., Song, Q., Zhou, Z., and Wang, H. (2011, January 12\u201314). A SFCW radar for through wall imaging and motion detection. Proceedings of the 2011 8th European Radar Conference, Manchester, UK."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"7274","DOI":"10.1109\/TVT.2015.2490099","article-title":"Destination-Aided Cooperative Jamming for Dual-Hop Amplify-and-Forward MIMO Untrusted Relay Systems","volume":"65","author":"Xiong","year":"2016","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1109\/TAES.2013.120329","article-title":"Noncoherent Approach for Through-the-Wall Moving Target Indication","volume":"50","author":"Martone","year":"2014","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"4571","DOI":"10.1109\/TIP.2013.2256916","article-title":"Multipath Exploitation in Through-Wall Radar Imaging Via Point Spread Functions","volume":"22","author":"Setlur","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1109\/LGRS.2018.2834501","article-title":"Building Layout Reconstruction in Concealed Human Target Sensing via UWB MIMO Through-Wall Imaging Radar","volume":"15","author":"Song","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_50","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Neapolitan, R.E. (2018). Neural Networks and Deep Learning. Artificial Intelligence, Sterling Publishing Co., Inc.","DOI":"10.1201\/b22400-15"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1080\/09205071.2016.1159996","article-title":"MIMO through-wall radar 3-D imaging of a human body in different postures","volume":"30","author":"Liu","year":"2016","journal-title":"J. Electromagn. Waves Appl."},{"key":"ref_54","unstructured":"Chen, V.C. (2011). The Micro-Doppler Effect in Radar, Artech House."},{"key":"ref_55","unstructured":"Kingma, D.P., and Ba, J.L. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_56","first-page":"315","article-title":"Deep sparse rectifier neural networks","volume":"15","author":"Glorot","year":"2011","journal-title":"J. Mach. Learn. Res."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/2\/241\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:10:19Z","timestamp":1760159419000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/2\/241"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,12]]},"references-count":56,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["rs13020241"],"URL":"https:\/\/doi.org\/10.3390\/rs13020241","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,12]]}}}