{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T05:50:08Z","timestamp":1750830608424,"version":"3.41.0"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2010,7,26]],"date-time":"2010-07-26T00:00:00Z","timestamp":1280102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2010,7,26]]},"abstract":"<jats:p>This paper presents a video-based motion modeling technique for capturing physically realistic human motion from monocular video sequences. We formulate the video-based motion modeling process in an image-based keyframe animation framework. The system first computes camera parameters, human skeletal size, and a small number of 3D key poses from video and then uses 2D image measurements at intermediate frames to automatically calculate the \"in between\" poses. During reconstruction, we leverage Newtonian physics, contact constraints, and 2D image measurements to simultaneously reconstruct full-body poses, joint torques, and contact forces. We have demonstrated the power and effectiveness of our system by generating a wide variety of physically realistic human actions from uncalibrated monocular video sequences such as sports video footage.<\/jats:p>","DOI":"10.1145\/1778765.1778779","type":"journal-article","created":{"date-parts":[[2010,7,15]],"date-time":"2010-07-15T12:48:46Z","timestamp":1279198126000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":35,"title":["VideoMocap"],"prefix":"10.1145","volume":"29","author":[{"given":"Xiaolin","family":"Wei","sequence":"first","affiliation":[{"name":"Texas A&amp;M University"}]},{"given":"Jinxiang","family":"Chai","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University"}]}],"member":"320","published-online":{"date-parts":[[2010,7,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.21"},{"key":"e_1_2_2_2_1","volume-title":"Nonlinear Programming: Theory and Algorithms","author":"Bazaraa M. S.","year":"1993","unstructured":"Bazaraa , M. S. , Sherali , H. D. , and Shetty , C. M . 1993 . Nonlinear Programming: Theory and Algorithms . John Wiley and Sons Ltd . 2 nd Edition. Bazaraa, M. S., Sherali, H. D., and Shetty, C. M. 1993. Nonlinear Programming: Theory and Algorithms. John Wiley and Sons Ltd. 2nd Edition.","edition":"2"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000011203.00237.9b"},{"volume-title":"Proceedings of IEEE CVPR. 1--8.","author":"Brubaker M. A.","key":"e_1_2_2_4_1","unstructured":"Brubaker , M. A. , and Fleet , D. J . 2008. The Kneed Walker for human pose tracking . In Proceedings of IEEE CVPR. 1--8. Brubaker, M. A., and Fleet, D. J. 2008. The Kneed Walker for human pose tracking. In Proceedings of IEEE CVPR. 1--8."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073248"},{"volume-title":"Proceedings of The Ninth Asian Conference on Computer Vision.","author":"Chen Y.-L.","key":"e_1_2_2_6_1","unstructured":"Chen , Y.-L. , and Chai , J . 2009. Simultaneous Reconstruction of 3D Human Skeleton and Motion from Monocular Video Sequences . Proceedings of The Ninth Asian Conference on Computer Vision. Chen, Y.-L., and Chai, J. 2009. Simultaneous Reconstruction of 3D Human Skeleton and Motion from Monocular Video Sequences. Proceedings of The Ninth Asian Conference on Computer Vision."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/133994.134083"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.1000236"},{"key":"e_1_2_2_9_1","volume-title":"Videomocap: A video based motion capture system","author":"Cowley A.","year":"2001","unstructured":"Cowley , A. , and Taylor , C. J. , 2001 . Videomocap: A video based motion capture system . http:\/\/www.cis.upenn.edu\/cjtaylor\/RESEARCH\/projects\/Johansson\/VideoMoCap.html. Cowley, A., and Taylor, C. J., 2001. Videomocap: A video based motion capture system. http:\/\/www.cis.upenn.edu\/cjtaylor\/RESEARCH\/projects\/Johansson\/VideoMoCap.html."},{"key":"e_1_2_2_10_1","first-page":"307","article-title":"Reconstruction of 3D figure motion from 2D correspondences","volume":"1","author":"DiFranco D. E.","year":"2001","unstructured":"DiFranco , D. E. , Cham , T.-J. , and Rehg , J. M. 2001 . Reconstruction of 3D figure motion from 2D correspondences . Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1 : 307 -- 314 . DiFranco, D. E., Cham, T.-J., and Rehg, J. M. 2001. Reconstruction of 3D figure motion from 2D correspondences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1:307--314.","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_2_11_1","first-page":"681","article-title":"Inferring 3D body pose from silhouettes using activity manifold learning","volume":"2","author":"Elgammal A.","year":"2004","unstructured":"Elgammal , A. , and Lee , C. 2004 . Inferring 3D body pose from silhouettes using activity manifold learning . In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2 : 681 -- 688 . Elgammal, A., and Lee, C. 2004. Inferring 3D body pose from silhouettes using activity manifold learning. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2: 681--688.","journal-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_2_12_1","volume-title":"Robust Statistics: The Approach Based on Influence Functions","author":"Hampel F. R.","year":"1986","unstructured":"Hampel , F. R. , Ronchetti , E. M. , Rousseeuw , P. J. , and Stahel , W. A . 1986 . Robust Statistics: The Approach Based on Influence Functions . Wiley . Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J., and Stahel, W. A. 1986. Robust Statistics: The Approach Based on Influence Functions. Wiley."},{"key":"e_1_2_2_13_1","unstructured":"Howe N. Leventon M. and Freeman W. 1999. Bayesian Reconstruction of 3D Human Motion from Single-camera Video. In Advances in Neural Information Processing Systems 12. 820--826.  Howe N. Leventon M. and Freeman W. 1999. Bayesian Reconstruction of 3D Human Motion from Single-camera Video. In Advances in Neural Information Processing Systems 12 . 820--826."},{"volume-title":"Robust Statistics","author":"Huber P. J.","key":"e_1_2_2_14_1","unstructured":"Huber , P. J. 1981. Robust Statistics . Wiley . Huber, P. J. 1981. Robust Statistics. Wiley."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1111"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073314"},{"key":"e_1_2_2_17_1","unstructured":"Lourakis M. I. A. 2009. levmar: Levenberg marquardt nonlinear least squares algorithms in c\/c++. In http:\/\/www.ics.forth.gr\/lourakis\/levmar\/.  Lourakis M. I. A. 2009. levmar: Levenberg marquardt nonlinear least squares algorithms in c\/c++. In http:\/\/www.ics.forth.gr\/lourakis\/levmar\/ ."},{"volume-title":"European Conference on Computer Vision. 442--455","author":"Loy G.","key":"e_1_2_2_18_1","unstructured":"Loy , G. , Eriksson , M. , Sullivan , J. , and Carlsson , S . 2004. Monocular 3D Reconstruction of Human motion in Long Action Sequences . In European Conference on Computer Vision. 442--455 . Loy, G., Eriksson, M., Sullivan, J., and Carlsson, S. 2004. Monocular 3D Reconstruction of Human motion in Long Action Sequences. In European Conference on Computer Vision. 442--455."},{"key":"e_1_2_2_19_1","unstructured":"MatchMover 2008. http:\/\/www.realviz.com\/.  MatchMover 2008. http:\/\/www.realviz.com\/."},{"key":"e_1_2_2_20_1","first-page":"981","article-title":"Learning Switching Linear Models of Human Motion","volume":"13","author":"Pavlovi\u0107 V.","year":"2000","unstructured":"Pavlovi\u0107 , V. , Rehg , J. M. , and MacCormick , J. 2000 . Learning Switching Linear Models of Human Motion . In Advances in Neural Information Processing Systems 13 , 981 -- 987 . Pavlovi\u0107, V., Rehg, J. M., and MacCormick, J. 2000. Learning Switching Linear Models of Human Motion. In Advances in Neural Information Processing Systems 13, 981--987.","journal-title":"Advances in Neural Information Processing Systems"},{"volume-title":"Animation of Human-like Characters: Dynamic Motion Filtering with A Physically Plausible Contact Model. In In Yale Workshop on Adaptive and Learning Systems.","author":"Pollard N.","key":"e_1_2_2_21_1","unstructured":"Pollard , N. , and Reitsma , P . 2001 . Animation of Human-like Characters: Dynamic Motion Filtering with A Physically Plausible Contact Model. In In Yale Workshop on Adaptive and Learning Systems. Pollard, N., and Reitsma, P. 2001. Animation of Human-like Characters: Dynamic Motion Filtering with A Physically Plausible Contact Model. In In Yale Workshop on Adaptive and Learning Systems."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311536"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/822088.823438"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015754"},{"volume-title":"Implicit Probabilistic Models of Human Motion for Synthesis and Tracking. In European Conference on Computer Vision. 784--800","author":"Sidenbladh H.","key":"e_1_2_2_25_1","unstructured":"Sidenbladh , H. , Black , M. J. , and Sigal , L . 2002 . Implicit Probabilistic Models of Human Motion for Synthesis and Tracking. In European Conference on Computer Vision. 784--800 . Sidenbladh, H., Black, M. J., and Sigal, L. 2002. Implicit Probabilistic Models of Human Motion for Synthesis and Tracking. In European Conference on Computer Vision. 784--800."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015371"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1037957.1037966"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.2000.0878"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.193"},{"key":"e_1_2_2_30_1","unstructured":"Vicon Systems 2009. http:\/\/www.vicon.com.  Vicon Systems 2009. http:\/\/www.vicon.com."},{"volume-title":"IEEE Conference on Computer Vision and Pattern Recognition, 1--8.","author":"Vondrak M.","key":"e_1_2_2_31_1","unstructured":"Vondrak , M. , Sigal , L. , and Jenkins , O. C . 2008. Physical simulation for probabilistic motion tracking . In IEEE Conference on Computer Vision and Pattern Recognition, 1--8. Vondrak, M., Sigal, L., and Jenkins, O. C. 2008. Physical simulation for probabilistic motion tracking. In IEEE Conference on Computer Vision and Pattern Recognition, 1--8."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88682-2_50"},{"volume-title":"Proceedings of IEEE Conference on Computer Vision.","author":"Wei X.","key":"e_1_2_2_33_1","unstructured":"Wei , X. , and Chai , J . 2009. Modeling 3D Human Poses from Uncalibrated Monocular Images . Proceedings of IEEE Conference on Computer Vision. Wei, X., and Chai, J. 2009. Modeling 3D Human Poses from Uncalibrated Monocular Images. Proceedings of IEEE Conference on Computer Vision."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/54852.378507"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1778765.1778779","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1778765.1778779","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:25:53Z","timestamp":1750278353000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1778765.1778779"}},"subtitle":["modeling physically realistic human motion from monocular video sequences"],"short-title":[],"issued":{"date-parts":[[2010,7,26]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2010,7,26]]}},"alternative-id":["10.1145\/1778765.1778779"],"URL":"https:\/\/doi.org\/10.1145\/1778765.1778779","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2010,7,26]]},"assertion":[{"value":"2010-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}