{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T07:59:14Z","timestamp":1773734354431,"version":"3.50.1"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,9,25]],"date-time":"2023-09-25T00:00:00Z","timestamp":1695600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62072383, 61702433, 62077039, 61962021"],"award-info":[{"award-number":["62072383, 61702433, 62077039, 61962021"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["20720210044, 20720190006"],"award-info":[{"award-number":["20720210044, 20720190006"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Open Project Program of State Key Laboratory of Virtual Reality Technology and Systems, Beihang University","award":["VRLAB2020B17"],"award-info":[{"award-number":["VRLAB2020B17"]}]},{"name":"Science and Technology Guiding Project of Fujian Province"},{"name":"Key Research Program of Jiangxi Province"},{"name":"Natural Science Foundation of Fujian Province of China","award":["2021J011169, 2020J01435"],"award-info":[{"award-number":["2021J011169, 2020J01435"]}]},{"name":"Key Project of National Key R&D Project","award":["2017YFC1703303"],"award-info":[{"award-number":["2017YFC1703303"]}]},{"name":"Industry-University-Research Cooperation Project of Fujian Science and Technology Planning","award":["2022H6012"],"award-info":[{"award-number":["2022H6012"]}]},{"name":"Industry-University-Research Cooperation Project of Ningde City and Xiamen University","award":["2020C001"],"award-info":[{"award-number":["2020C001"]}]},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"crossref","award":["202006310161"],"award-info":[{"award-number":["202006310161"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000288","name":"Royal Society","doi-asserted-by":"crossref","award":["IEC\\NSFC\\211022"],"award-info":[{"award-number":["IEC\\NSFC\\211022"]}],"id":[{"id":"10.13039\/501100000288","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>Human motion tracking is a fundamental building block for various applications including computer animation, human-computer interaction, healthcare, and so on. To reduce the burden of wearing multiple sensors, human motion prediction from sparse sensor inputs has become a hot topic in human motion tracking. However, such predictions are non-trivial as (i) the widely adopted data-driven approaches can easily collapse to average poses, and (ii) the predicted motions contain unnatural jitters. In this work, we address the aforementioned issues by proposing a novel framework which can accurately predict the human joint moving angles from the signals of only four flexible sensors, thereby achieving the tracking of human joints in multi-degrees of freedom. Specifically, we mitigate the collapse to average poses by implementing the model with a Bi-LSTM neural network that makes full use of short-time sequence information; we reduce jitters by adding a median pooling layer to the network, which smooths consecutive motions. Although being bio-compatible and ideal for improving the wearing experience, the flexible sensors are prone to aging which increases prediction errors. Observing that the aging of flexible sensors usually results in drifts of their resistance ranges, we further propose a novel dynamic calibration technique to rescale sensor ranges, which further improves the prediction accuracy. Experimental results show that our method achieves a low and stable tracking error of 4.51 degrees across different motion types with only four sensors.<\/jats:p>","DOI":"10.1145\/3564700","type":"journal-article","created":{"date-parts":[[2022,9,29]],"date-time":"2022-09-29T11:48:36Z","timestamp":1664452116000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0027-2420","authenticated-orcid":false,"given":"Xiaowei","family":"Chen","sequence":"first","affiliation":[{"name":"School of Informatics, Xiamen University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4525-435X","authenticated-orcid":false,"given":"Xiao","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Informatics, Xiamen University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6008-1450","authenticated-orcid":false,"given":"Lishuang","family":"Zhan","sequence":"additional","affiliation":[{"name":"School of Informatics, Xiamen University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1473-297X","authenticated-orcid":false,"given":"Shihui","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Informatics &amp; Jiujiang Research Institute, Xiamen University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6679-8655","authenticated-orcid":false,"given":"Qunsheng","family":"Ruan","sequence":"additional","affiliation":[{"name":"School of Informatics, Xiamen University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2028-8825","authenticated-orcid":false,"given":"Guoliang","family":"Luo","sequence":"additional","affiliation":[{"name":"East China Jiao Tong University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0197-7273","authenticated-orcid":false,"given":"Minghong","family":"Liao","sequence":"additional","affiliation":[{"name":"School of Informatics, Xiamen University, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1551-9126","authenticated-orcid":false,"given":"Yipeng","family":"Qin","sequence":"additional","affiliation":[{"name":"School of Computer Science and Informatics, Cardiff University, UK"}]}],"member":"320","published-online":{"date-parts":[[2023,9,25]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/2998559.2998564"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.3390\/s150818813"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21082667"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1155\/2017\/1605101"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3476839"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.05-07-01688.1985"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICM46511.2021.9385684"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00430"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/2019406.2019424"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2018.10.009"},{"key":"e_1_3_3_12_2","article-title":"Integral-free spatial orientation estimation method and wearable rotation measurement device for robot-assisted catheter intervention","author":"Hooshiar Amir","year":"2021","unstructured":"Amir Hooshiar, Amir Sayadi, Javad Dargahi, and Siamak Najarian. 2021. Integral-free spatial orientation estimation method and wearable rotation measurement device for robot-assisted catheter intervention. IEEE\/ASME Transactions on Mechatronics (2021).","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275108"},{"key":"e_1_3_3_14_2","article-title":"Transformer inertial poser: Attention-based real-time human motion reconstruction from sparse IMUs","author":"Jiang Yifeng","year":"2022","unstructured":"Yifeng Jiang, Yuting Ye, Deepak Gopinath, Jungdam Won, Alexander W. Winkler, and C. Karen Liu. 2022. Transformer inertial poser: Attention-based real-time human motion reconstruction from sparse IMUs. arXiv preprint arXiv:2203.15720 (2022).","journal-title":"arXiv preprint arXiv:2203.15720"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3341162.3343776"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMECH.2018.2874647"},{"key":"e_1_3_3_17_2","article-title":"Using inertial sensors for position and orientation estimation","author":"Kok Manon","year":"2017","unstructured":"Manon Kok, Jeroen D. Hol, and Thomas B. Sch\u00f6n. 2017. Using inertial sensors for position and orientation estimation. arXiv preprint arXiv:1704.06053 (2017).","journal-title":"arXiv preprint arXiv:1704.06053"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TASSP.1985.1164591"},{"issue":"1","key":"e_1_3_3_19_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3372207","article-title":"Cross refinement techniques for markerless human<? brk?> motion capture","volume":"16","author":"Li Miaopeng","year":"2020","unstructured":"Miaopeng Li, Zimeng Zhou, and Xinguo Liu. 2020. Cross refinement techniques for markerless human<? brk?> motion capture. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 16, 1 (2020), 1\u201318.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)"},{"key":"e_1_3_3_20_2","volume-title":"Human Motion Prediction","author":"Li Yanran","year":"2021","unstructured":"Yanran Li. 2021. Human Motion Prediction. Ph. D. Dissertation. Bournemouth University."},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2019.2911756"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/BMEiCon.2013.6687719"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1587\/transinf.2019MVP0007"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1177\/0278364914543793"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2020.2968869"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.3390\/s17112589"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1063\/1.4767217"},{"key":"e_1_3_3_28_2","first-page":"8026","article-title":"PyTorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et\u00a0al. 2019. PyTorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32 (2019), 8026\u20138037.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2021.11.006"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22689"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/VS-Games.2018.8493410"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/2933242.2933263"},{"key":"e_1_3_3_33_2","first-page":"1","article-title":"Xsens MVN: Full 6DOF human motion tracking using miniature inertial sensors","volume":"1","author":"Roetenberg Daniel","year":"2009","unstructured":"Daniel Roetenberg, Henk Luinge, and Per Slycke. 2009. Xsens MVN: Full 6DOF human motion tracking using miniature inertial sensors. Xsens Motion Technologies BV, Tech. Rep. 1 (2009), 1\u20137.","journal-title":"Xsens Motion Technologies BV, Tech. Rep."},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139569"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"e_1_3_3_36_2","first-page":"159","volume-title":"3D Physiological Human Workshop","author":"Schwarz Loren Arthur","year":"2009","unstructured":"Loren Arthur Schwarz, Diana Mateus, and Nassir Navab. 2009. Discriminative human full-body pose estimation from wearable inertial sensor data. In 3D Physiological Human Workshop. Springer, 159\u2013172."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/1966394.1966397"},{"key":"e_1_3_3_38_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01249-6_37"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2522398"},{"key":"e_1_3_3_41_2","first-page":"349","volume-title":"Computer Graphics Forum","author":"Marcard Timo von","year":"2017","unstructured":"Timo von Marcard, Bodo Rosenhahn, Michael J. Black, and Gerard Pons-Moll. 2017. Sparse inertial poser: Automatic 3D human pose estimation from sparse IMUs. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 349\u2013360."},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/MeMeA.2011.5966732"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.330110063"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11390-017-1742-y"},{"key":"e_1_3_3_45_2","first-page":"265","volume-title":"Computer Graphics Forum","author":"Yang Dongseok","year":"2021","unstructured":"Dongseok Yang, Doyeon Kim, and Sung-Hee Lee. 2021. LoBSTr: Real-time lower-body pose prediction from sparse upper-body tracking signals. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 265\u2013275."},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01282"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459786"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.23919\/CCC50068.2020.9188413"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3351079"},{"issue":"1","key":"e_1_3_3_50_2","first-page":"163","article-title":"Whole-body pose estimation in human bicycle riding using a small set of wearable sensors","volume":"21","author":"Zhang Yizhai","year":"2015","unstructured":"Yizhai Zhang, Kuo Chen, Jingang Yi, Tao Liu, and Quan Pan. 2015. Whole-body pose estimation in human bicycle riding using a small set of wearable sensors. IEEE\/ASME Transactions on Mechatronics 21, 1 (2015), 163\u2013174.","journal-title":"IEEE\/ASME Transactions on Mechatronics"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01240-3_24"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3564700","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3564700","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:30Z","timestamp":1750182570000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3564700"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,25]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3564700"],"URL":"https:\/\/doi.org\/10.1145\/3564700","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,25]]},"assertion":[{"value":"2021-10-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-08-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}