{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T19:42:53Z","timestamp":1776109373131,"version":"3.50.1"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,9,6]],"date-time":"2022-09-06T00:00:00Z","timestamp":1662422400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,9,6]]},"abstract":"<jats:p>In this paper, we present BodyTrak, an intelligent sensing technology that can estimate full body poses on a wristband. It only requires one miniature RGB camera to capture the body silhouettes, which are learned by a customized deep learning model to estimate the 3D positions of 14 joints on arms, legs, torso, and head. We conducted a user study with 9 participants in which each participant performed 12 daily activities such as walking, sitting, or exercising, in varying scenarios (wearing different clothes, outdoors\/indoors) with a different number of camera settings on the wrist. The results show that our system can infer the full body pose (3D positions of 14 joints) with an average error of 6.9 cm using only one miniature RGB camera (11.5mm x 9.5mm) on the wrist pointing towards the body. Based on the results, we disscuss the possible application, challenges, and limitations to deploy our system in real-world scenarios.<\/jats:p>","DOI":"10.1145\/3552312","type":"journal-article","created":{"date-parts":[[2022,9,7]],"date-time":"2022-09-07T14:54:27Z","timestamp":1662562467000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["BodyTrak"],"prefix":"10.1145","volume":"6","author":[{"given":"Hyunchul","family":"Lim","sequence":"first","affiliation":[{"name":"Cornell University, Ithaca, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaxuan","family":"Li","sequence":"additional","affiliation":[{"name":"McGill University, Montreal, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew","family":"Dressa","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fang","family":"Hu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jae Hoon","family":"Kim","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruidong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,9,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2021.02.013"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Karan Ahuja Andy Kong Mayank Goel and Chris Harrison. 2020. Direction-of-Voice (DoV) Estimation for Intuitive Speech Interaction with Smart Devices Ecosystems.. In UIST. 1121--1131.","DOI":"10.1145\/3379337.3415588"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445582"},{"key":"e_1_2_1_4_1","volume-title":"Test Speed of Chargers, Cables, Capacity of Power Banks,Black. [EB\/OL]. https:\/\/www.amazon.com\/Musou-Digital-Multimeter-Chargers-Capacity\/dp\/B071214RD8 Accessed","year":"2020","unstructured":"Amonzon. [n.d.]. Musou USB Safety Tester,USB Digital Power Meter Tester Multimeter Current and Voltage Monitor DC 5.1A 30V Amp Voltage Power Meter, Test Speed of Chargers, Cables, Capacity of Power Banks,Black. [EB\/OL]. https:\/\/www.amazon.com\/Musou-Digital-Multimeter-Chargers-Capacity\/dp\/B071214RD8 Accessed Oct 4, 2020."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbmt.2016.02.004"},{"key":"e_1_2_1_6_1","volume-title":"Maarten Verduin, Rens Kodde, and Jan D Janssen.","author":"Bouten Carlijn VC","year":"1997","unstructured":"Carlijn VC Bouten, Karel TM Koekkoek, Maarten Verduin, Rens Kodde, and Jan D Janssen. 1997. A triaxial accelerometer and portable data processing unit for the assessment of daily physical activity. IEEE transactions on biomedical engineering 44, 3 (1997), 136--147."},{"key":"e_1_2_1_7_1","volume-title":"OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields","author":"Cao Zhe","year":"2019","unstructured":"Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2019. OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. IEEE transactions on pattern analysis and machine intelligence 43, 1 (2019), 172--186."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3494977"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415879"},{"key":"e_1_2_1_10_1","unstructured":"Intel Corporation. 2021. RealSense. In https:\/\/www.intelrealsense.com\/."},{"key":"e_1_2_1_11_1","unstructured":"Microsoft Corporation. 2021. Microsoft Kinect.. In https:\/\/en.wikipedia.org\/wiki\/Kinect."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2004.838501"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2017.7952187"},{"key":"e_1_2_1_14_1","volume-title":"Posture recognition using an RGB-D camera: exploring 3D body modeling and deep learning approaches. In 2018 IEEE life sciences conference (LSC)","author":"Amine Elforaici Mohamed El","unstructured":"Mohamed El Amine Elforaici, Ismail Chaaraoui, Wassim Bouachir, Youssef Ouakrim, and Neila Mezghani. 2018. Posture recognition using an RGB-D camera: exploring 3D body modeling and deep learning approaches. In 2018 IEEE life sciences conference (LSC). IEEE, 69--72."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00762"},{"key":"e_1_2_1_16_1","volume-title":"6th International Annual Engineering Seminar (InAES). IEEE, 1--5.","author":"Gandang Samuel","unstructured":"Samuel Gandang Gunanto et al. 2016. 2D to 3D space transformation for facial animation based on marker data. In 2016 6th International Annual Engineering Seminar (InAES). IEEE, 1--5."},{"key":"e_1_2_1_17_1","volume-title":"Using convolutional neural networks for image recognition","author":"Hijazi Samer","year":"2015","unstructured":"Samer Hijazi, Rishi Kumar, and Chris Rowen. 2015. Using convolutional neural networks for image recognition. Cadence Design Systems Inc.: San Jose, CA, USA (2015), 1--12."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP42928.2021.9506043"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397306"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432202"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2016.102"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2019.8798267"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415856"},{"key":"e_1_2_1_24_1","unstructured":"NaturalPoint Inc. 2021. OptiTrack. In http:\/\/optitrack.com."},{"key":"e_1_2_1_25_1","unstructured":"Northern Digital Inc. 2021. trakSTAR. In https:\/\/www.ndigital.com\/msci\/products\/drivebay-trakstar\/."},{"key":"e_1_2_1_26_1","unstructured":"PhaseSpace Inc. 2021. PhaseSpace. In https:\/\/phasespace.com\/."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372224.3380900"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2010.80"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.336"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380139"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2020.2995122"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2020.09.029"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307334.3326109"},{"key":"e_1_2_1_34_1","unstructured":"ALT LLC. 2021. Antilatency. In https:\/\/antilatency.com\/."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"e_1_2_1_36_1","unstructured":"Vicon Motion Systems Ltd. 2021. Vicon. In https:\/\/vicon.com\/."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2017.00064"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2004.1315182"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00991"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-03493-1_54"},{"key":"e_1_2_1_41_1","first-page":"1","article-title":"Xsens MVN: Full 6DOF human motion tracking using miniature inertial sensors. Xsens Motion Technologies BV","volume":"1","author":"Roetenberg Daniel","year":"2009","unstructured":"Daniel Roetenberg, Henk Luinge, and Per Slycke. 2009. Xsens MVN: Full 6DOF human motion tracking using miniature inertial sensors. Xsens Motion Technologies BV, Tech. Rep 1 (2009), 1--7.","journal-title":"Tech. Rep"},{"key":"e_1_2_1_42_1","volume-title":"C Seifried, and R Hilker.","author":"Roggendorf J","year":"2012","unstructured":"J Roggendorf, S Chen, S Baudrexel, S Van De Loo, C Seifried, and R Hilker. 2012. Arm swing asymmetry in Parkinson's disease measured with ultrasound based motion analysis during treadmill gait. Gait & posture 35, 1 (2012), 116--120."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0021-9290(99)00036-6"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2906388.2906407"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964926"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2012.2201950"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.3390\/inventions5030049"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00782"},{"key":"e_1_2_1_49_1","unstructured":"Vive. 2021. HTC VIVE.. In https:\/\/www.vive.com\/."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/MLSP.2019.8918863"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415897"},{"key":"e_1_2_1_52_1","volume-title":"Mo 2 cap 2: Real-time mobile 3d motion capture with a cap-mounted fisheye camera","author":"Xu Weipeng","year":"2019","unstructured":"Weipeng Xu, Avishek Chatterjee, Michael Zollhoefer, Helge Rhodin, Pascal Fua, Hans-Peter Seidel, and Christian Theobalt. 2019. Mo 2 cap 2: Real-time mobile 3d motion capture with a cap-mounted fisheye camera. IEEE transactions on visualization and computer graphics 25, 5 (2019), 2093--2101."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376427"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502045"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00768"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3552312","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3552312","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:40:24Z","timestamp":1752468024000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3552312"}},"subtitle":["Inferring Full-body Poses from Body Silhouettes Using a Miniature Camera on a Wristband"],"short-title":[],"issued":{"date-parts":[[2022,9,6]]},"references-count":55,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,9,6]]}},"alternative-id":["10.1145\/3552312"],"URL":"https:\/\/doi.org\/10.1145\/3552312","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,6]]},"assertion":[{"value":"2022-09-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}