{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T13:37:37Z","timestamp":1791207457593,"version":"4.1.0"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2005,7]]},"abstract":"<jats:p>This paper introduces an approach to performance animation that employs video cameras and a small set of retro-reflective markers to create a low-cost, easy-to-use system that might someday be practical for home use. The low-dimensional control signals from the user's performance are supplemented by a database of pre-recorded human motion. At run time, the system automatically learns a series of local models from a set of motion capture examples that are a close match to the marker locations captured by the cameras. These local models are then used to reconstruct the motion of the user as a full-body animation. We demonstrate the power of this approach with real-time control of six different behaviors using two video cameras and a small set of retro-reflective markers. We compare the resulting animation to animation from commercial motion capture equipment with a full set of markers.<\/jats:p>","DOI":"10.1145\/1073204.1073248","type":"journal-article","created":{"date-parts":[[2005,11,7]],"date-time":"2005-11-07T16:00:45Z","timestamp":1131379245000},"page":"686-696","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":213,"title":["Performance animation from low-dimensional control signals"],"prefix":"10.1145","volume":"24","author":[{"given":"Jinxiang","family":"Chai","sequence":"first","affiliation":[{"name":"Carnegie Mellon University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica K.","family":"Hodgins","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2005,7]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1006538427943"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566606"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882284"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1006559212014"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1006511328852"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1162\/pres.1993.2.1.82"},{"key":"e_1_2_2_7_1","volume-title":"Nonlinear Programming: Theory and Algorithms","author":"Bazaraa M. S.","year":"1993","unstructured":"Bazaraa , M. S. , Sherali , H. D. , and Shetty , C . 1993 . Nonlinear Programming: Theory and Algorithms . John Wiley and Sons Ltd . 2 nd Edition. Bazaraa, M. S., Sherali, H. D., and Shetty, C. 1993. Nonlinear Programming: Theory and Algorithms. John Wiley and Sons Ltd. 2nd Edition.","edition":"2"},{"key":"e_1_2_2_8_1","volume-title":"Neural Network for Pattern Recognition","author":"Bishop C.","unstructured":"Bishop , C. 1996. Neural Network for Pattern Recognition . Cambridge University Press . Bishop, C. 1996. Neural Network for Pattern Recognition. Cambridge University Press."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344865"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/850924.851583"},{"key":"e_1_2_2_11_1","unstructured":"Bregler C. and Omohundro S. 1995. Nonlinear image interpolation using manifold learning. In Advances in Neural Information Processing Systems 7. 973--980. Bregler C. and Omohundro S. 1995. Nonlinear image interpolation using manifold learning. In Advances in Neural Information Processing Systems 7. 973--980."},{"key":"e_1_2_2_12_1","volume-title":"Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 77--84","author":"Cheung G.","unstructured":"Cheung , G. , Baker , S. , and Kanade , T . 2003. Shape-from-silhouette of articulated object and its use for human body kinematics estimation and motion capture . In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 77--84 . Cheung, G., Baker, S., and Kanade, T. 2003. Shape-from-silhouette of articulated object and its use for human body kinematics estimation and motion capture. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 77--84."},{"key":"e_1_2_2_13_1","volume-title":"Treetalk: Memory-based word phonemisation. In Data-Driven Techniques in Speech Synthesis","author":"Daelemans W.","year":"2001","unstructured":"Daelemans , W. , and Van De Bosch . A. 2001 . Treetalk: Memory-based word phonemisation. In Data-Driven Techniques in Speech Synthesis , Kluwer . 149--172. Daelemans, W., and Van De Bosch. A. 2001. Treetalk: Memory-based word phonemisation. In Data-Driven Techniques in Speech Synthesis, Kluwer. 149--172."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882285"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.674971"},{"key":"e_1_2_2_16_1","volume-title":"An algorithm for finding intrinsic dimensionality of data","author":"Fukunaga K.","unstructured":"Fukunaga , K. , and Olsen . D. 1971. An algorithm for finding intrinsic dimensionality of data . In IEEE Transactions on Computers. C- 20:176--183. Fukunaga, K., and Olsen. D. 1971. An algorithm for finding intrinsic dimensionality of data. In IEEE Transactions on Computers. C-20:176--183."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015755"},{"key":"e_1_2_2_18_1","volume-title":"Eurographics Workshop on Computer Animation and Simulation '96","author":"Guo S.","unstructured":"Guo . S. , and Roberge , J . 1996. A high level control mechanism for human locomotion based on parametric frame space interpolation . In Eurographics Workshop on Computer Animation and Simulation '96 . 95--107. Guo. S., and Roberge, J. 1996. A high level control mechanism for human locomotion based on parametric frame space interpolation. In Eurographics Workshop on Computer Animation and Simulation '96. 95--107."},{"key":"e_1_2_2_19_1","unstructured":"Hinton. G. Revow M. and Dayan P. 1995. Recognizing handwritten digits using mixtures of linear models. In Advances in Neural Information Processing Systems 7. 1015--1022. Hinton. G. Revow M. and Dayan P. 1995. Recognizing handwritten digits using mixtures of linear models. In Advances in Neural Information Processing Systems 7. 1015--1022."},{"key":"e_1_2_2_20_1","unstructured":"Howe. N. Leventon M. and Freeman W. 1999. Bayesian reconstruction of 3d human motion from single-camera video. In Advances in Neural Information Processing Systems 12. 820--826. Howe. N. Leventon M. and Freeman W. 1999. Bayesian reconstruction of 3d human motion from single-camera video. In Advances in Neural Information Processing Systems 12. 820--826."},{"key":"e_1_2_2_21_1","unstructured":"Konami Boxing and Police 911 GAME 2001. http:\/\/www.konami.com. Konami Boxing and Police 911 GAME 2001. http:\/\/www.konami.com."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015760"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566605"},{"key":"e_1_2_2_24_1","unstructured":"Lawrence N. D. 2004. Gaussian process latent variable models for visualization of high dimensional data. In Advances in Neural Information Processing Systems 16. 329--336. Lawrence N. D. 2004. Gaussian process latent variable models for visualization of high dimensional data. In Advances in Neural Information Processing Systems 16. 329--336."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566607"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566604"},{"key":"e_1_2_2_27_1","unstructured":"Mardia K. Kent J. and Bibby M. 1979. Multivariate Analysis. Academy Press. Mardia K. Kent J. and Bibby M. 1979. Multivariate Analysis. Academy Press."},{"key":"e_1_2_2_28_1","unstructured":"MicroStrain 3DM-G 2004. http:\/\/www.microstrain.com. MicroStrain 3DM-G 2004. http:\/\/www.microstrain.com."},{"key":"e_1_2_2_29_1","volume-title":"Proceedings of Graphics Interface","author":"Oore S.","year":"2002","unstructured":"Oore , S. , Terzopoulos , D. , and Hinton , G . 2002. A desktop input device and interface for interactive 3d character . In Proceedings of Graphics Interface 2002 . 133--140. Oore, S., Terzopoulos, D., and Hinton, G. 2002. A desktop input device and interface for interactive 3d character. In Proceedings of Graphics Interface 2002. 133--140."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566608"},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Ren L. Shakhnarovich G. Hodgins J. K. Pfister H. and Viola P. A. 2004. Learning silhouette features for control of human motion. In Computer Science Technical Reports 2004 Carnegie Mellon University. CMU-CS-04-165. Ren L. Shakhnarovich G. Hodgins J. K. Pfister H. and Viola P. A. 2004. Learning silhouette features for control of human motion. In Computer Science Technical Reports 2004 Carnegie Mellon University. CMU-CS-04-165.","DOI":"10.1145\/1186223.1186384"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.708559"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2323"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015754"},{"key":"e_1_2_2_35_1","volume-title":"-R","author":"Scholkopf B.","year":"1999","unstructured":"Scholkopf , B. , Smola , A. , and Muller , K . -R . 1999 . Kernel principal component analysis. In Advances in Kernel Methods-SV Learning, MIT Press . 327--352. Scholkopf, B., Smola, A., and Muller, K.-R. 1999. Kernel principal component analysis. In Advances in Kernel Methods-SV Learning, MIT Press. 327--352."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1162\/105474698565497"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/502122.502123"},{"key":"e_1_2_2_38_1","volume-title":"European Conference on Computer Vision. 784--800","author":"Sidenbladh H.","unstructured":"Sidenbladh , H. , Black , M. J. , and Sigal , L . 2002. Implicit probabilistic models of human motion for synthesis and tracking . In European Conference on Computer Vision. 784--800 . Sidenbladh, H., Black, M. J., and Sigal, L. 2002. Implicit probabilistic models of human motion for synthesis and tracking. In European Conference on Computer Vision. 784--800."},{"key":"e_1_2_2_39_1","unstructured":"Sony Eye Toy Systems 2003. http:\/\/www.eyetoy.com. Sony Eye Toy Systems 2003. http:\/\/www.eyetoy.com."},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1111\/j.2517-6161.1974.tb00994.x","article-title":"Cross-validatory choice and assessment of statistical predictions","volume":"36","author":"Stone M.","year":"1974","unstructured":"Stone , M. 1974 . Cross-validatory choice and assessment of statistical predictions . In Journal of the Royal Statistical Society. 36 : 111 -- 147 . Stone, M. 1974. Cross-validatory choice and assessment of statistical predictions. In Journal of the Royal Statistical Society. 36:111--147.","journal-title":"Journal of the Royal Statistical Society."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"key":"e_1_2_2_42_1","unstructured":"Vicon Systems 2004. http:\/\/www.vicon.com. Vicon Systems 2004. http:\/\/www.vicon.com."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.626968"},{"key":"e_1_2_2_44_1","unstructured":"Xsens Mt-9 2004. http:\/\/www.xsens.com. Xsens Mt-9 2004. http:\/\/www.xsens.com."},{"key":"e_1_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Xu G. and Zhang Z. 1996. Epipolar Geometry in Stereo Motion and Object Recognition: A Unified Approach. Kluwer. Xu G. and Zhang Z. 1996. Epipolar Geometry in Stereo Motion and Object Recognition: A Unified Approach. Kluwer.","DOI":"10.1007\/978-94-015-8668-9"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2003.1207443"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015756"},{"key":"e_1_2_2_48_1","volume-title":"Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 329--338","author":"Yin K.","unstructured":"Yin , K. , and Pai , D. K . 2003. Footsee: An interactive animation system . In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 329--338 . Yin, K., and Pai, D. K. 2003. Footsee: An interactive animation system. In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 329--338."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1999.791289"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1073204.1073248","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,5]],"date-time":"2025-01-05T10:33:14Z","timestamp":1736073194000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1073204.1073248"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,7]]},"references-count":49,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2005,7]]}},"alternative-id":["10.1145\/1073204.1073248"],"URL":"https:\/\/doi.org\/10.1145\/1073204.1073248","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,7]]},"assertion":[{"value":"2005-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}