{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T04:54:52Z","timestamp":1771649692887,"version":"3.50.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62172277, 62072304"],"award-info":[{"award-number":["62172277, 62072304"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shanghai East Talents Program","award":["177"],"award-info":[{"award-number":["177"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2025,9,3]]},"abstract":"<jats:p>Nowadays, 3D human mesh reconstruction technology has drawn great attention in the metaverse for building digital humans. As current mainstream solutions, vision-based systems suffer from privacy leakage and depend on lighting conditions. Towards a more privacy-preserving and illumination-robust manner, recent works have exploited radio frequency signals to realize 3D human mesh reconstruction. However, these studies cannot handle occlusion scenarios with proximity or overlap in multi-user scenarios. This paper presents an occlusion-aware 3D human mesh reconstruction system, OccMesh, which uses mmWave signals to estimate body skeletons and reconstruct human meshes of users with proximity or overlap. In this paper, OccMesh first detects subjects and generates point clouds through mmWave signals, and then segments point clouds to identify and locate each user. OccMesh next estimates human body keypoints of multiple users through a designed RBF Value Estimator. When there are multiple users in close proximity or overlapped, OccMesh infers the occluded human body parts and generates the skeletons of occluded users with a ResGCN-Attention-Block-based Skeleton Inferer. Based on the generated skeletons, OccMesh further reconstructs human meshes for users in occlusion scenarios. Experiments conducted in occlusion scenarios validate the accuracy and robustness of OccMesh in multi-user 3D human mesh reconstruction.<\/jats:p>","DOI":"10.1145\/3749514","type":"journal-article","created":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T17:15:45Z","timestamp":1756919745000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["OccMesh: Occlusion-aware Multi-user 3D Human Mesh Reconstruction Using mmWave Signals"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-6125-6613","authenticated-orcid":false,"given":"Haoran","family":"Cao","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Department of Computer Science and Engineering, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0207-9643","authenticated-orcid":false,"given":"Jiadi","family":"Yu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Department of Computer Science and Engineering, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0871-9795","authenticated-orcid":false,"given":"Hao","family":"Kong","sequence":"additional","affiliation":[{"name":"Shanghai University, School of computer Engineering and Science, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0782-4953","authenticated-orcid":false,"given":"Yi-Chao","family":"Chen","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Department of Computer Science and Engineering, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6406-4992","authenticated-orcid":false,"given":"Yanmin","family":"Zhu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Department of Computer Science and Engineering, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9266-3044","authenticated-orcid":false,"given":"Linghe","family":"Kong","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Department of Computer Science and Engineering, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1384-198X","authenticated-orcid":false,"given":"Feilong","family":"Tang","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Department of Computer Science and Engineering, Shanghai, China"}]}],"member":"320","published-online":{"date-parts":[[2025,9,3]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proc. IEEE VS-PETS'03","author":"Boulay Bernard","year":"2003","unstructured":"Bernard Boulay, Fran\u00e7ois Bremond, and Monique Thonnat. 2003. Human posture recognition in video sequence. In Proc. IEEE VS-PETS'03. Dallas, USA."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.143"},{"key":"e_1_2_1_3_1","first-page":"1","article-title":"Mmecare: Enabling fine-grained vital sign monitoring for emergency care with handheld mmwave radars","volume":"8","author":"Chang Zhaoxin","year":"2024","unstructured":"Zhaoxin Chang, Fusang Zhang, Xujun Ma, Pei Wang, Weiyan Chen, Duo Zhang, Badii Jouaber, and Daqing Zhang. 2024. Mmecare: Enabling fine-grained vital sign monitoring for emergency care with handheld mmwave radars. ACM IMWUT 8, 4 (2024), 1--24.","journal-title":"ACM IMWUT"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447993.3483251"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00153"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00073"},{"key":"e_1_2_1_7_1","volume-title":"Proc. ACM KDD'96","author":"Ester Martin","year":"1996","unstructured":"Martin Ester, Hans-Peter Kriegel, J\u00f6rg Sander, Xiaowei Xu, et al. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proc. ACM KDD'96. Portland, USA."},{"key":"e_1_2_1_8_1","volume-title":"Learning to forget: Continual prediction with LSTM. Neural computation 12, 10","author":"Gers Felix A","year":"2000","unstructured":"Felix A Gers, J\u00fcrgen Schmidhuber, and Fred Cummins. 2000. Learning to forget: Continual prediction with LSTM. Neural computation 12, 10 (2000), 2451--2471."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3390\/s23104720"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3349624.3356765"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01148"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.248"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-24136-9_20"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372224.3419202"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372224.3380900"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806333"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11831-022-09815-7"},{"key":"e_1_2_1_18_1","volume-title":"A survey of mmwave radar-based sensing in autonomous vehicles, smart homes and industry","author":"Kong Hao","year":"2024","unstructured":"Hao Kong, Cheng Huang, Jiadi Yu, and Xuemin Shen. 2024. A survey of mmwave radar-based sensing in autonomous vehicles, smart homes and industry. IEEE COMST (2024)."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3498361.3538926"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01215"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00936"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3384419.3430779"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00836"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_1_25_1","first-page":"1","article-title":"Vocallock: Sensing vocal tract for passphrase-independent user authentication leveraging acoustic signals on smartphones","volume":"4","author":"Lu Li","year":"2020","unstructured":"Li Lu, Jiadi Yu, Yingying Chen, and Yan Wang. 2020. Vocallock: Sensing vocal tract for passphrase-independent user authentication leveraging acoustic signals on smartphones. ACM IMWUT 4, 2 (2020), 1--24.","journal-title":"ACM IMWUT"},{"key":"e_1_2_1_26_1","volume-title":"Proc. Berkeley Symp. Math. Stat. Probab.'67","author":"James","unstructured":"James MacQueen et al. 1967. Some methods for classification and analysis of multivariate observations. In Proc. Berkeley Symp. Math. Stat. Probab.'67. Oakland, USA."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5430"},{"key":"e_1_2_1_28_1","unstructured":"Microsoft. 2021. Kinect for Windows. [Online]. Available: https:\/\/developer.microsoft.com\/en-us\/windows\/kinect\/."},{"key":"e_1_2_1_29_1","volume-title":"A simplex method for function minimization. The computer journal 7, 4","author":"Nelder John A","year":"1965","unstructured":"John A Nelder and Roger Mead. 1965. A simplex method for function minimization. The computer journal 7, 4 (1965), 308--313."},{"key":"e_1_2_1_30_1","volume-title":"Star: Sparse trained articulated human body regressor. In Proc","author":"Osman Ahmed AA","year":"2020","unstructured":"Ahmed AA Osman, Timo Bolkart, and Michael J Black. 2020. Star: Sparse trained articulated human body regressor. In Proc. Springer ECCV'20. Glasgow, UK."},{"key":"e_1_2_1_31_1","volume-title":"IEEE\/CVF CVPR'17","author":"Qi Charles R","year":"2017","unstructured":"Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017. Pointnet: Deep learning on point sets for 3d classification and segmentation. In IEEE\/CVF CVPR'17. Honolulu, USA."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58529-7_29"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2015.7301338"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00128"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2021.3085489"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/RadarConf2043947.2020.9266600"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.2991741"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01099"},{"key":"e_1_2_1_39_1","unstructured":"Texas Instruments. 2021. AWR1443 Single-Chip 76-GHz to 81-GHz Automotive Radar Sensor Integrating MCU and Hardware Accelerator. [Online]. Available: https:\/\/www.ti.com\/product\/AWR1443."},{"key":"e_1_2_1_40_1","unstructured":"Texas Instruments. 2021. DCA1000evm real-time data-capture adapter for radar sensing evaluation module. [Online]. Available: https:\/\/www.ti.com\/tool\/DCA1000EVM."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01249-6_37"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3560905.3568536"},{"key":"e_1_2_1_43_1","first-page":"1","article-title":"Multi-Subject 3D Human Mesh Construction Using Commodity WiFi","volume":"8","author":"Wang Yichao","year":"2024","unstructured":"Yichao Wang, Yili Ren, and Jie Yang. 2024. Multi-Subject 3D Human Mesh Construction Using Commodity WiFi. ACM IMWUT 8, 1 (2024), 1--25.","journal-title":"ACM IMWUT"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307334.3326073"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM48880.2022.9796912"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3560905.3568545"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458864.3467679"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM41043.2020.9155471"},{"key":"e_1_2_1_49_1","volume-title":"Super normal vector for human activity recognition with depth cameras","author":"Yang Xiaodong","year":"2016","unstructured":"Xiaodong Yang and YingLi Tian. 2016. Super normal vector for human activity recognition with depth cameras. IEEE transactions on pattern analysis and machine intelligence 39, 5 (2016), 1028--1039."},{"key":"e_1_2_1_50_1","volume-title":"Hongyi Xu","author":"Zanfir Andrei","year":"2020","unstructured":"Andrei Zanfir, Eduard Gabriel Bazavan, Hongyi Xu, William T Freeman, Rahul Sukthankar, and Cristian Sminchisescu. 2020. Weakly supervised 3d human pose and shape reconstruction with normalizing flows. In Proc. Springer ECCV'20. Glasgow, UK."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01125"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01595"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.01021"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM41043.2020.9155526"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1186\/1687-1499-2014-137"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.00111"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3749514","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T16:27:41Z","timestamp":1758817661000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3749514"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,3]]},"references-count":56,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,3]]}},"alternative-id":["10.1145\/3749514"],"URL":"https:\/\/doi.org\/10.1145\/3749514","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,3]]},"assertion":[{"value":"2025-09-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}