{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T09:47:28Z","timestamp":1778665648337,"version":"3.51.4"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2014,11,19]],"date-time":"2014-11-19T00:00:00Z","timestamp":1416355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000145","name":"Division of Information and Intelligent Systems","doi-asserted-by":"publisher","award":["IIS-1055046, IIS-1065384, IIS-1064983"],"award-info":[{"award-number":["IIS-1055046, IIS-1065384, IIS-1064983"]}],"id":[{"id":"10.13039\/100000145","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 NS069655-05"],"award-info":[{"award-number":["R01 NS069655-05"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2014,11,19]]},"abstract":"<jats:p>\n            We present a new method for full-body motion capture that uses input data captured by three depth cameras and a pair of pressure-sensing shoes. Our system is appealing because it is low-cost, non-intrusive and fully automatic, and can accurately reconstruct both full-body kinematics and dynamics data. We first introduce a novel tracking process that automatically reconstructs 3D skeletal poses using input data captured by three\n            <jats:italic>Kinect<\/jats:italic>\n            cameras and wearable pressure sensors. We formulate the problem in an optimization framework and incrementally update 3D skeletal poses with observed depth data and pressure data via iterative linear solvers. The system is highly accurate because we integrate depth data from multiple depth cameras, foot pressure data, detailed full-body geometry, and environmental contact constraints into a unified framework. In addition, we develop an efficient physics-based motion reconstruction algorithm for solving internal joint torques and contact forces in the quadratic programming framework. During reconstruction, we leverage Newtonian physics, friction cone constraints, contact pressure information, and 3D kinematic poses obtained from the kinematic tracking process to reconstruct full-body dynamics data. We demonstrate the power of our approach by capturing a wide range of human movements and achieve state-of-the-art accuracy in our comparison against alternative systems.\n          <\/jats:p>","DOI":"10.1145\/2661229.2661286","type":"journal-article","created":{"date-parts":[[2014,11,18]],"date-time":"2014-11-18T14:21:03Z","timestamp":1416320463000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":59,"title":["Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture"],"prefix":"10.1145","volume":"33","author":[{"given":"Peizhao","family":"Zhang","sequence":"first","affiliation":[{"name":"Texas A&amp;M University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kristin","family":"Siu","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianjie","family":"Zhang","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C. Karen","family":"Liu","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinxiang","family":"Chai","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,11,19]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"IEEE Proceedings of the 8th International Conference on Intelligent Sensors, Sensor Networks and Information Processing.","author":"Adelsberger R.","unstructured":"Adelsberger , R. , and Tr\u00f6ster , G . 2013. Pimu: A wireless pressure-sensing imu. In ISSNIP , IEEE Proceedings of the 8th International Conference on Intelligent Sensors, Sensor Networks and Information Processing. Adelsberger, R., and Tr\u00f6ster, G. 2013. Pimu: A wireless pressure-sensing imu. In ISSNIP, IEEE Proceedings of the 8th International Conference on Intelligent Sensors, Sensor Networks and Information Processing."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882311"},{"key":"e_1_2_2_3_1","unstructured":"Ascension 2014. http:\/\/www.ascension-tech.com\/.  Ascension 2014. http:\/\/www.ascension-tech.com\/."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126356"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000011203.00237.9b"},{"key":"e_1_2_2_6_1","volume-title":"Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 28--36","author":"Bridson R.","unstructured":"Bridson , R. , Marino , S. , and Fedkiw , R . 2003. Simulation of clothing with folds and wrinkles . In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 28--36 . Bridson, R., Marino, S., and Fedkiw, R. 2003. Simulation of clothing with folds and wrinkles. In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 28--36."},{"key":"e_1_2_2_7_1","volume-title":"Proceedings of IEEE CVPR.","author":"Brubaker M. A.","unstructured":"Brubaker , M. A. , and Fleet , D. J . 2008. The Kneed Walker for human pose tracking . In Proceedings of IEEE CVPR. Brubaker, M. A., and Fleet, D. J. 2008. The Kneed Walker for human pose tracking. In Proceedings of IEEE CVPR."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237269"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360697"},{"key":"e_1_2_2_10_1","first-page":"681","article-title":"Inferring 3D body pose from silhouettes using activity manifold learning","volume":"2","author":"Elgammal A.","year":"2004","unstructured":"Elgammal , A. , and Lee , C. 2004 . Inferring 3D body pose from silhouettes using activity manifold learning . In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2 : 681 -- 688 . Elgammal, A., and Lee, C. 2004. Inferring 3D body pose from silhouettes using activity manifold learning. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2: 681--688.","journal-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/358669.358692"},{"key":"e_1_2_2_12_1","volume-title":"Proceedings of the Eurographic Workshop on Computer Animation and Simulation, Springer-Verlag New York, Inc.","author":"Fisher S.","unstructured":"Fisher , S. , and Lin , M. C . 2001. Deformed distance fields for simulation of non-penetrating flexible bodies . In Proceedings of the Eurographic Workshop on Computer Animation and Simulation, Springer-Verlag New York, Inc. , New York, NY, USA, 99--111. Fisher, S., and Lin, M. C. 2001. Deformed distance fields for simulation of non-penetrating flexible bodies. In Proceedings of the Eurographic Workshop on Computer Animation and Simulation, Springer-Verlag New York, Inc., New York, NY, USA, 99--111."},{"key":"e_1_2_2_13_1","volume-title":"Proceedings of the 15th Scandinavian Conference on Image Analysis (SCIA), 719--729","author":"Grest D.","unstructured":"Grest , D. , Kruger , V. , and Koch , R . 2007. Single view motion tracking by depth and silhouette information . In Proceedings of the 15th Scandinavian Conference on Image Analysis (SCIA), 719--729 . Grest, D., Kruger, V., and Koch, R. 2007. Single view motion tracking by depth and silhouette information. In Proceedings of the 15th Scandinavian Conference on Image Analysis (SCIA), 719--729."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882358"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2019406.2019424"},{"key":"e_1_2_2_16_1","volume-title":"-P","author":"Hasler N.","year":"2009","unstructured":"Hasler , N. , Stoll , C. , Sunkel , M. , Rosenhahn , B. , and Seidel , H . -P . 2009 . A statistical model of human pose and body shape. In Computer Graphics Forum (Proc. Eurographics 2008), P. Dutr'e and M. Stamminger, Eds ., vol. 2 . Hasler, N., Stoll, C., Sunkel, M., Rosenhahn, B., and Seidel, H.-P. 2009. A statistical model of human pose and body shape. In Computer Graphics Forum (Proc. Eurographics 2008), P. Dutr'e and M. Stamminger, Eds., vol. 2."},{"key":"e_1_2_2_17_1","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 1686--1691","author":"Knoop S.","unstructured":"Knoop , S. , Vacek , S. , and Dillmann , R . 2006. Sensor fusion for 3d human body tracking with an articulated 3d body model . In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 1686--1691 . Knoop, S., Vacek, S., and Dillmann, R. 2006. Sensor fusion for 3d human body tracking with an articulated 3d body model. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), 1686--1691."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545277"},{"key":"e_1_2_2_19_1","unstructured":"Microsoft Kinect API for Windows 2014. http:\/\/www.microsoft.com\/en-us\/kinectforwindows\/.  Microsoft Kinect API for Windows 2014. http:\/\/www.microsoft.com\/en-us\/kinectforwindows\/."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2006.08.002"},{"key":"e_1_2_2_21_1","first-page":"981","article-title":"Learning Switching Linear Models of Human Motion","volume":"13","author":"Pavlovi\u0107 V.","year":"2000","unstructured":"Pavlovi\u0107 , V. , Rehg , J. M. , and MacCormick , J. 2000 . Learning Switching Linear Models of Human Motion . In Advances in Neural Information Processing Systems 13 , 981 -- 987 . Pavlovi\u0107, V., Rehg, J. M., and MacCormick, J. 2000. Learning Switching Linear Models of Human Motion. In Advances in Neural Information Processing Systems 13, 981--987.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_22_1","volume-title":"Proceedings of International Conferences on Robotics and Automation (ICRA","author":"Plagemann C.","year":"2010","unstructured":"Plagemann , C. , Ganapathi , V. , Koller , D. , and Thrun , S . 2010. Realtime identification and localization of body parts from depth images . In Proceedings of International Conferences on Robotics and Automation (ICRA 2010 ), 3108--3113. Plagemann, C., Ganapathi, V., Koller, D., and Thrun, S. 2010. Realtime identification and localization of body parts from depth images. In Proceedings of International Conferences on Robotics and Automation (ICRA 2010), 3108--3113."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/822088.823438"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"e_1_2_2_25_1","unstructured":"Tekscan 2014. http:\/\/www.tekscan.com\/.  Tekscan 2014. http:\/\/www.tekscan.com\/."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.193"},{"key":"e_1_2_2_27_1","unstructured":"Vicon Systems 2014. http:\/\/www.vicon.com.  Vicon Systems 2014. http:\/\/www.vicon.com."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360696"},{"key":"e_1_2_2_29_1","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition, 1--8.","author":"Vondrak M.","unstructured":"Vondrak , M. , Sigal , L. , and Jenkins , O. C . 2008. Physical simulation for probabilistic motion tracking . In IEEE Conference on Computer Vision and Pattern Recognition, 1--8. Vondrak, M., Sigal, L., and Jenkins, O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 1--8."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185523"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778779"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366207"},{"key":"e_1_2_2_33_1","unstructured":"Xsens 2014. http:\/\/www.xsens.com.  Xsens 2014. http:\/\/www.xsens.com."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126310"},{"key":"e_1_2_2_35_1","volume-title":"Footsee: An interactive animation system. In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation","author":"Yin K.","year":"2003","unstructured":"Yin , K. , and Pai , D. K . 2003 . Footsee: An interactive animation system. In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation , Eurographics Association , Aire-la- Ville, Switzerland , Switzerland, SCA '03, 329--338. Yin, K., and Pai, D. K. 2003. Footsee: An interactive animation system. In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SCA '03, 329--338."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2661229.2661286","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2661229.2661286","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:13:05Z","timestamp":1750227185000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2661229.2661286"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,11,19]]},"references-count":35,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2014,11,19]]}},"alternative-id":["10.1145\/2661229.2661286"],"URL":"https:\/\/doi.org\/10.1145\/2661229.2661286","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,11,19]]},"assertion":[{"value":"2014-11-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}