{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T19:07:15Z","timestamp":1769972835806,"version":"3.49.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2012,7,1]],"date-time":"2012-07-01T00:00:00Z","timestamp":1341100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["PECASE Award N000140810910YIP Award N000140710141"],"award-info":[{"award-number":["PECASE Award N000140810910YIP Award N000140710141"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2012,8,5]]},"abstract":"<jats:p>\n            Marker-less motion capture is a challenging problem, particularly when only monocular video is available. We estimate human motion from monocular video by recovering three-dimensional controllers capable of implicitly simulating the observed human behavior and replaying this behavior in other environments and under physical perturbations. Our approach employs a state-space biped controller with a balance feedback mechanism that encodes control as a sequence of simple control tasks. Transitions among these tasks are triggered on time and on proprioceptive events (\n            <jats:italic>e.g<\/jats:italic>\n            ., contact). Inference takes the form of optimal control where we optimize a high-dimensional vector of control parameters and the structure of the controller based on an objective function that compares the resulting simulated motion with input observations. We illustrate our approach by automatically estimating controllers for a variety of motions directly from monocular video. We show that the estimation of controller structure through incremental optimization and refinement leads to controllers that are more stable and that better approximate the reference motion. We demonstrate our approach by capturing sequences of walking, jumping, and gymnastics.\n          <\/jats:p>","DOI":"10.1145\/2185520.2185523","type":"journal-article","created":{"date-parts":[[2012,8,6]],"date-time":"2012-08-06T18:11:37Z","timestamp":1344276697000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Video-based 3D motion capture through biped control"],"prefix":"10.1145","volume":"31","author":[{"given":"Marek","family":"Vondrak","sequence":"first","affiliation":[{"name":"Brown University"}]},{"given":"Leonid","family":"Sigal","sequence":"additional","affiliation":[{"name":"Disney Research Pittsburgh"}]},{"given":"Jessica","family":"Hodgins","sequence":"additional","affiliation":[{"name":"Disney Research Pittsburgh"}]},{"given":"Odest","family":"Jenkins","sequence":"additional","affiliation":[{"name":"Brown University"}]}],"member":"320","published-online":{"date-parts":[[2012,7]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237226"},{"key":"e_1_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Bhat K. S. Seitz S. M. Popovic J. and Khosla P. 2002. Computing the physical parameters of rigid-body motion from video. In ECCV 551--566.   Bhat K. S. Seitz S. M. Popovic J. and Khosla P. 2002. Computing the physical parameters of rigid-body motion from video. In ECCV 551--566.","DOI":"10.1007\/3-540-47969-4_37"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0204-y"},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Brubaker M. A. and Fleet D. J. 2008. The Kneed Walker for human pose tracking. In IEEE CVPR.  Brubaker M. A. and Fleet D. J. 2008. The Kneed Walker for human pose tracking. In IEEE CVPR .","DOI":"10.1109\/CVPR.2008.4587546"},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Brubaker M. A. Fleet D. J. and Hertzmann A. 2007. Physics-based person tracking using simplified lower body dynamics. In IEEE CVPR.  Brubaker M. A. Fleet D. J. and Hertzmann A. 2007. Physics-based person tracking using simplified lower body dynamics. In IEEE CVPR .","DOI":"10.1109\/CVPR.2007.383342"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Brubaker M. A. Sigal L. and Fleet D. J. 2009. Estimating contact dynamics. In ICCV.  Brubaker M. A. Sigal L. and Fleet D. J. 2009. Estimating contact dynamics. In ICCV .","DOI":"10.1109\/ICCV.2009.5459407"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1274940.1274945"},{"key":"e_1_2_2_8_1","volume-title":"Rigid Body Simulation with Contact and Constraints. Master's thesis","author":"Cline M.","unstructured":"Cline , M. 2002. Rigid Body Simulation with Contact and Constraints. Master's thesis , The University of British Columbia . Cline, M. 2002. Rigid Body Simulation with Contact and Constraints. Master's thesis, The University of British Columbia."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618516"},{"key":"e_1_2_2_10_1","unstructured":"Crisis. 2006. http:\/\/crisis.sourceforge.net\/.  Crisis. 2006. http:\/\/crisis.sourceforge.net\/."},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Dempster W. T. 1955. Space requirements of the seated operator: Geometrical kinematic and mechanical aspects of the body with special reference to the limbs. Tech. rep. Wright-Patterson Air Force Base 55--159.  Dempster W. T. 1955. Space requirements of the seated operator: Geometrical kinematic and mechanical aspects of the body with special reference to the limbs. Tech. rep. Wright-Patterson Air Force Base 55--159.","DOI":"10.21236\/AD0087892"},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Elgammal A. Harwood D. and Davis L. 2000. Non-parametric model for background subtraction. In ECCV.   Elgammal A. Harwood D. and Davis L. 2000. Non-parametric model for background subtraction. In ECCV .","DOI":"10.1007\/3-540-45053-X_48"},{"key":"e_1_2_2_13_1","volume-title":"-P","author":"Gall J.","year":"2009","unstructured":"Gall , J. , Stoll , C. , de Aguiar , E. , Theobalt , C. , Rosenhahn , B. , and Seidel , H . -P . 2009 . Motion capture using joint skeleton tracking and surface estimation. In IEEE CVPR , 1746--1753. Gall, J., Stoll, C., de Aguiar, E., Theobalt, C., Rosenhahn, B., and Seidel, H.-P. 2009. Motion capture using joint skeleton tracking and surface estimation. In IEEE CVPR, 1746--1753."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Hansen N. 2006. The CMA evolution strategy: A comparing review. Towards a New Evolutionary Computation. Advances on Estimation of Distribution Algorithms. 75--102.  Hansen N. 2006. The CMA evolution strategy: A comparing review. Towards a New Evolutionary Computation. Advances on Estimation of Distribution Algorithms . 75--102.","DOI":"10.1007\/3-540-32494-1_4"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218414"},{"key":"e_1_2_2_16_1","volume-title":"ACM SIGGRAPH\/Eurographics Symposium on Computer Animation.","author":"Kwon T.","unstructured":"Kwon , T. , and Hodgins , J . 2010. Control systems for human running using an inverted pendulum model and a reference motion capture sequence . In ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. Kwon, T., and Hodgins, J. 2010. Control systems for human running using an inverted pendulum model and a reference motion capture sequence. In ACM SIGGRAPH\/Eurographics Symposium on Computer Animation."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1781155"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073314"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778865"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.216727"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531387"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/166117.166160"},{"key":"e_1_2_2_23_1","unstructured":"ODE. 2006. http:\/\/www.ode.org\/.  ODE. 2006. http:\/\/www.ode.org\/."},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Pang J. S. and Facchinei F. 2003. Finite-dimensional variational inequalities and complementarity problems (i). Springer.  Pang J. S. and Facchinei F. 2003. Finite-dimensional variational inequalities and complementarity problems (i). Springer.","DOI":"10.1007\/b97544"},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Schaal S. and Schweighofer N. 2005. Computational motor control in humans and robots. Cur. Op. in Neurobio. 6.  Schaal S. and Schweighofer N. 2005. Computational motor control in humans and robots. Cur. Op. in Neurobio . 6.","DOI":"10.1016\/j.conb.2005.10.009"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-009-0273-6"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360681"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1111"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2009.76"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.15"},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Vondrak M. Sigal L. and Jenkins O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE CVPR.  Vondrak M. Sigal L. and Jenkins O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE CVPR .","DOI":"10.1109\/CVPR.2008.4587580"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618514"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778810"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778779"},{"key":"e_1_2_2_35_1","unstructured":"Wren C. R. and Pentland A. 1998. Dynamic models of human motion. In Automatic Face and Gesture Recognition.   Wren C. R. and Pentland A. 1998. Dynamic models of human motion. In Automatic Face and Gesture Recognition ."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276509"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360680"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2185520.2185523","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2185520.2185523","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T10:06:47Z","timestamp":1750241207000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2185520.2185523"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,7]]},"references-count":37,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2012,8,5]]}},"alternative-id":["10.1145\/2185520.2185523"],"URL":"https:\/\/doi.org\/10.1145\/2185520.2185523","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,7]]},"assertion":[{"value":"2012-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}