{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T00:41:37Z","timestamp":1776127297302,"version":"3.50.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T00:00:00Z","timestamp":1715558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ational Natural Science Foundation of China","award":["Grant 62072420"],"award-info":[{"award-number":["Grant 62072420"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,5,13]]},"abstract":"<jats:p>Humans spend about one-third of their lives resting. Reconstructing human dynamics in in-bed scenarios is of considerable significance in sleep studies, bedsore monitoring, and biomedical factor extractions. However, the mainstream human pose and shape estimation methods mainly focus on visual cues, facing serious issues in non-line-of-sight environments. Since in-bed scenarios contain complicated human-environment contact, pressure-sensing bedsheets provide a non-invasive and privacy-preserving approach to capture the pressure distribution on the contact surface, and have shown prospects in many downstream tasks. However, few studies focus on in-bed human mesh recovery. To explore the potential of reconstructing human meshes from the sensed pressure distribution, we first build a high-quality temporal human in-bed pose dataset, TIP, with 152K multi-modality synchronized images. We then propose a label generation pipeline for in-bed scenarios to generate reliable 3D mesh labels with a SMPLify-based optimizer. Finally, we present PIMesh, a simple yet effective temporal human shape estimator to directly generate human meshes from pressure image sequences. We conduct various experiments to evaluate PIMesh's performance, showing that PIMesh archives 79.17mm joint position errors on our TIP dataset. The results demonstrate that the pressure-sensing bedsheet could be a promising alternative for long-term in-bed human shape estimation.<\/jats:p>","DOI":"10.1145\/3659612","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T12:20:41Z","timestamp":1715775641000},"page":"1-39","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Seeing through the Tactile"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-8190-7174","authenticated-orcid":false,"given":"Ziyu","family":"Wu","sequence":"first","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8064-5436","authenticated-orcid":false,"given":"Fangting","family":"Xie","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4094-3455","authenticated-orcid":false,"given":"Yiran","family":"Fang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4975-5482","authenticated-orcid":false,"given":"Zhen","family":"Liang","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2840-3763","authenticated-orcid":false,"given":"Quan","family":"Wan","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-9415-2544","authenticated-orcid":false,"given":"Yufan","family":"Xiong","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4416-7887","authenticated-orcid":false,"given":"Xiaohui","family":"Cai","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China, Hefei, China"}]}],"member":"320","published-online":{"date-parts":[[2024,5,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46720-7_57"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073207"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00351"},{"key":"e_1_2_1_4_1","volume-title":"Jamie Ryan Kiros, and Geoffrey E Hinton","author":"Ba Jimmy Lei","year":"2016","unstructured":"Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton. 2016. Layer normalization. arXiv preprint arXiv:1607.06450 (2016)."},{"key":"e_1_2_1_5_1","volume-title":"Janet Cuddigan, Becky Dorner, Laura Edsberg, Diane Langemo, Mary Ellen Posthauer, Catherine Ratliff, George Taler, et al.","author":"Black Joyce","year":"2007","unstructured":"Joyce Black, Mona Mylene Baharestani, Janet Cuddigan, Becky Dorner, Laura Edsberg, Diane Langemo, Mary Ellen Posthauer, Catherine Ratliff, George Taler, et al. 2007. National Pressure Ulcer Advisory Panel's updated pressure ulcer staging system. Advances in skin & wound care 20, 5 (2007), 269--274."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_34"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.143"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-018-1895-3"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264908"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Kenny Chen Paolo Gabriel Abdulwahab Alasfour Chenghao Gong Werner K Doyle Orrin Devinsky Daniel Friedman Patricia Dugan Lucia Melloni Thomas Thesen et al. 2018. Patient-specific pose estimation in clinical environments. IEEE journal of translational engineering in health and medicine 6 (2018) 1--11.","DOI":"10.1109\/JTEHM.2018.2875464"},{"key":"e_1_2_1_11_1","volume-title":"Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio.","author":"Cho Kyunghyun","year":"2014","unstructured":"Kyunghyun Cho, Bart Van Merri\u00ebnboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00200"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Yunho Choi Dong-Hyeok Park Sungha Lee Isaac Han Ecehan Akan Hyeon-Chang Jeon Yiyue Luo SeungJun Kim Wojciech Matusik Daniela Rus et al. 2023. Seamless-walk: natural and comfortable virtual reality locomotion method with a high-resolution tactile sensor. Virtual Reality (2023) 1--15.","DOI":"10.1007\/s10055-023-00750-x"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00625"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3158902"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2018.8593545"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP49357.2023.10095238"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP39728.2021.9413516"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3580861","article-title":"MI-Mesh: 3D Human Mesh Construction by Fusing Image and Millimeter Wave","volume":"7","author":"Ding Han","year":"2023","unstructured":"Han Ding, Zhenbin Chen, Cui Zhao, Fei Wang, Ge Wang, Wei Xi, and Jizhong Zhao. 2023. MI-Mesh: 3D Human Mesh Construction by Fusing Image and Millimeter Wave. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1--24.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_21_1","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)."},{"key":"e_1_2_1_22_1","volume-title":"Statistical methods for tomographic image reconstruction. Bull Int Stat Inst LII-4 (01","author":"Geman Stuart","year":"1987","unstructured":"Stuart Geman and D. McClure. 1987. Statistical methods for tomographic image reconstruction. Bull Int Stat Inst LII-4 (01 1987)."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02291478"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11548-012-0694-5"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2001.933111"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00237"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_1_29_1","volume-title":"Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415","author":"Hendrycks Dan","year":"2016","unstructured":"Dan Hendrycks and Kevin Gimpel. 2016. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415 (2016)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491245"},{"key":"e_1_2_1_31_1","unstructured":"Glenn Jocher Ayush Chaurasia and Jing Qiu. 2023. YOLO by Ultralytics. https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00744"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00576"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00530"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00234"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1080\/01691864.2021.1873844"},{"key":"e_1_2_1_37_1","volume-title":"Fractalnet: Ultra-deep neural networks without residuals. arXiv preprint arXiv:1605.07648","author":"Larsson Gustav","year":"2016","unstructured":"Gustav Larsson, Michael Maire, and Gregory Shakhnarovich. 2016. Fractalnet: Ultra-deep neural networks without residuals. arXiv preprint arXiv:1605.07648 (2016)."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.500"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01243"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00339"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20065-6_34"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_2_1_43_1","volume-title":"Bodypart localization for pressure ulcer prevention. In 2014 36th annual international conference of the ieee engineering in medicine and biology society","author":"Liu Jason J","unstructured":"Jason J Liu, Ming-Chun Huang, Wenyao Xu, and Majid Sarrafzadeh. 2014. Bodypart localization for pressure ulcer prevention. In 2014 36th annual international conference of the ieee engineering in medicine and biology society. IEEE, 766--769."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3155712"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32239-7_27"},{"key":"e_1_2_1_46_1","volume-title":"In-bed pose estimation: Deep learning with shallow 16","author":"Liu Shuangjun","year":"2019","unstructured":"Shuangjun Liu, Yu Yin, and Sarah Ostadabbas. 2019. In-bed pose estimation: Deep learning with shallow 16. IEEE journal of translational engineering in health and medicine 7 (2019), 1--12."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_2_1_48_1","volume-title":"Intelligent Textiles for Physical Human-Environment Interactions. In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1--5.","author":"Luo Yiyue","year":"2023","unstructured":"Yiyue Luo. 2023. Intelligent Textiles for Physical Human-Environment Interactions. In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1--5."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01110"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00554"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00986"},{"key":"e_1_2_1_52_1","volume-title":"Indian journal of surgery 70","author":"Nayak Debashish","year":"2008","unstructured":"Debashish Nayak, K Srinivasan, Sadasivan Jagdish, Roma Rattan, and Vinayaka S Chatram. 2008. Bedsores:\"top to bottom\" and \"bottom to top\". Indian journal of surgery 70 (2008), 161--168."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2018.00062"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01123"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/BHI.2017.7897206"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.4822961"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01129"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.4037\/ajcc2015781"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00858"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2636088"},{"key":"e_1_2_1_61_1","doi-asserted-by":"crossref","unstructured":"Matthias Teschner Stefan Kimmerle Bruno Heidelberger Gabriel Zachmann Laks Raghupathi Arnulph Fuhrmann M-P Cani Fran\u00e7ois Faure Nadia Magnenat-Thalmann Wolfgang Strasser et al. 2005. Collision detection for deformable objects. In Computer graphics forum Vol. 24. Wiley Online Library 61--81.","DOI":"10.1111\/j.1467-8659.2005.00829.x"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00457"},{"key":"e_1_2_1_63_1","volume-title":"Attention is all you need. Advances in neural information processing systems 30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01286"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/PERCOM56429.2023.10099301"},{"key":"e_1_2_1_66_1","first-page":"38571","article-title":"Vitpose: Simple vision transformer baselines for human pose estimation","volume":"35","author":"Xu Yufei","year":"2022","unstructured":"Yufei Xu, Jing Zhang, Qiming Zhang, and Dacheng Tao. 2022. Vitpose: Simple vision transformer baselines for human pose estimation. Advances in Neural Information Processing Systems 35 (2022), 38571--38584.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00053"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548063"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397311"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01125"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-04891-8_14"},{"key":"e_1_2_1_73_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3534610","article-title":"Quali-mat: Evaluating the quality of execution in body-weight exercises with a pressure sensitive sports mat","volume":"6","author":"Zhou Bo","year":"2022","unstructured":"Bo Zhou, Sungho Suh, Vitor Fortes Rey, Carlos Andres Velez Altamirano, and Paul Lukowicz. 2022. Quali-mat: Evaluating the quality of execution in body-weight exercises with a pressure sensitive sports mat. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--45.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659612","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3659612","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:03:58Z","timestamp":1755882238000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659612"}},"subtitle":["3D Human Shape Estimation from Temporal In-Bed Pressure Images"],"short-title":[],"issued":{"date-parts":[[2024,5,13]]},"references-count":73,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,5,13]]}},"alternative-id":["10.1145\/3659612"],"URL":"https:\/\/doi.org\/10.1145\/3659612","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,13]]},"assertion":[{"value":"2024-05-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}