{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T07:12:50Z","timestamp":1791011570251,"version":"4.1.0"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2005,10,1]],"date-time":"2005-10-01T00:00:00Z","timestamp":1128124800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2005,10]]},"abstract":"<jats:p>We present a vision-based performance interface for controlling animated human characters. The system interactively combines information about the user's motion contained in silhouettes from three viewpoints with domain knowledge contained in a motion capture database to produce an animation of high quality. Such an interactive system might be useful for authoring, for teleconferencing, or as a control interface for a character in a game. In our implementation, the user performs in front of three video cameras; the resulting silhouettes are used to estimate his orientation and body configuration based on a set of discriminative local features. Those features are selected by a machine-learning algorithm during a preprocessing step. Sequences of motions that approximate the user's actions are extracted from the motion database and scaled in time to match the speed of the user's motion. We use swing dancing, a complex human motion, to demonstrate the effectiveness of our approach. We compare our results to those obtained with a set of global features, Hu moments, and ground truth measurements from a motion capture system.<\/jats:p>","DOI":"10.1145\/1095878.1095882","type":"journal-article","created":{"date-parts":[[2005,11,7]],"date-time":"2005-11-07T16:00:45Z","timestamp":1131379245000},"page":"1303-1331","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":76,"title":["Learning silhouette features for control of human motion"],"prefix":"10.1145","volume":"24","author":[{"given":"Liu","family":"Ren","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gregory","family":"Shakhnarovich","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jessica K.","family":"Hodgins","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hanspeter","family":"Pfister","sequence":"additional","affiliation":[{"name":"Mitsubishi Electric Research Laboratories, Cambridge, MA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Viola","sequence":"additional","affiliation":[{"name":"Microsoft Research, Redmond, WA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2005,10]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566606"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882284"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the International Conference on Computer Vision. 1237--1244","author":"Brand M.","year":"1999","unstructured":"Brand , M. 1999 . Shadow puppetry . In Proceedings of the International Conference on Computer Vision. 1237--1244 . Brand, M. 1999. Shadow puppetry. In Proceedings of the International Conference on Computer Vision. 1237--1244."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of SIGGRAPH","author":"Brand M.","year":"2000","unstructured":"Brand , M. and Hertzmann , A . 2000. Style machines . In Proceedings of SIGGRAPH 2000 . 183--192. 10.1145\/344779.344865 Brand, M. and Hertzmann, A. 2000. Style machines. In Proceedings of SIGGRAPH 2000. 183--192. 10.1145\/344779.344865"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8--15","author":"Bregler C.","unstructured":"Bregler , C. and Malik , J . 1998. Tracking people with twists and exponential maps . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8--15 . Bregler, C. and Malik, J. 1998. Tracking people with twists and exponential maps. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8--15."},{"key":"e_1_2_1_6_1","unstructured":"California Institute of Technology. 2002. Camera calibration toolbox for matlab. Available online at http:\/\/www.vision.caltech.edu\/bouguetj\/calib_doc\/.  California Institute of Technology. 2002. Camera calibration toolbox for matlab. Available online at http:\/\/www.vision.caltech.edu\/bouguetj\/calib_doc\/."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882309"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073248"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 714--720","author":"Cheung K. M.","unstructured":"Cheung , K. M. , Kanade , T. , Bouguet , J.-Y. , and Holler , M . 2000. A real time system for robust 3D voxel reconstruction of human motions . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 714--720 . Cheung, K. M., Kanade, T., Bouguet, J.-Y., and Holler, M. 2000. A real time system for robust 3D voxel reconstruction of human motions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 714--720."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of Computational Learning Theory. 158--169","author":"Collins M.","unstructured":"Collins , M. , Schapire , R. , and Singer , Y . 2000. Logistic regression, AdaBoost and Bregman distances . In Proceedings of Computational Learning Theory. 158--169 . Collins, M., Schapire, R., and Singer, Y. 2000. Logistic regression, AdaBoost and Bregman distances. In Proceedings of Computational Learning Theory. 158--169."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of SIGGRAPH","author":"Crow F. C.","year":"1984","unstructured":"Crow , F. C. 1984 . Summed-area tables for texture mapping . In Proceedings of SIGGRAPH 1984. 207--212. 10.1145\/800031.808600 Crow, F. C. 1984. Summed-area tables for texture mapping. In Proceedings of SIGGRAPH 1984. 207--212. 10.1145\/800031.808600"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 928--934","author":"Davis J. W.","unstructured":"Davis , J. W. and Bobick , A. F . 1997. The representation and recognition of human movement using temporal templates . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 928--934 . Davis, J. W. and Bobick, A. F. 1997. The representation and recognition of human movement using temporal templates. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 928--934."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the International Conference on Computer Vision. 716--721","author":"Delamarre Q.","unstructured":"Delamarre , Q. and Faugeras , O. D . 1999. 3D articulated models and multi-view tracking with silhouettes . In Proceedings of the International Conference on Computer Vision. 716--721 . Delamarre, Q. and Faugeras, O. D. 1999. 3D articulated models and multi-view tracking with silhouettes. In Proceedings of the International Conference on Computer Vision. 716--721."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 126--133","author":"Deutscher J.","unstructured":"Deutscher , J. , Blake , A. , and Reid , I . 2000. Articulated body motion capture by annealed particle filtering . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 126--133 . Deutscher, J., Blake, A., and Reid, I. 2000. Articulated body motion capture by annealed particle filtering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 126--133."},{"key":"e_1_2_1_15_1","unstructured":"Duda R. Hart P. E. and Stork D. G. 2000. Pattern Classification. John Wiley & Sons Inc. New York NY.   Duda R. Hart P. E. and Stork D. G. 2000. Pattern Classification. John Wiley & Sons Inc. New York NY."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 726--733","author":"Efros A.","unstructured":"Efros , A. , Berg , A. C. , Mori , G. , and Malik , J . 2003. Recognizing action at a distance . In Proceedings of the IEEE International Conference on Computer Vision. 726--733 . Efros, A., Berg, A. C., Mori, G., and Malik, J. 2003. Recognizing action at a distance. In Proceedings of the IEEE International Conference on Computer Vision. 726--733."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1006\/cviu.1998.0716"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 25th International Conference on Very Large Data Bases. 518--529","author":"Gionis A.","unstructured":"Gionis , A. , Indyk , P. , and Motwani , R . 1999. Similarity search in high dimensions via hashing . In Proceedings of the 25th International Conference on Very Large Data Bases. 518--529 . Gionis, A., Indyk, P., and Motwani, R. 1999. Similarity search in high dimensions via hashing. In Proceedings of the 25th International Conference on Very Large Data Bases. 518--529."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/217853.217856"},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1109\/TIT.1962.1057692","article-title":"Visual pattern recognition by moment invariants","volume":"8","author":"Hu M. K.","year":"1962","unstructured":"Hu , M. K. 1962 . Visual pattern recognition by moment invariants . IEEE Trans. Inform. Theor. 8 , 179 -- 187 . Hu, M. K. 1962. Visual pattern recognition by moment invariants. IEEE Trans. Inform. Theor. 8, 179--187.","journal-title":"IEEE Trans. Inform. Theor."},{"key":"e_1_2_1_21_1","volume-title":"TR2003-25","author":"Jones M.","unstructured":"Jones , M. and Viola , P . 2003. Face recognition using boosted local features. MERL Tech. rep . TR2003-25 . Mitsubishi Electric Research Laboratories, Cambridge, MA. Jones, M. and Viola, P. 2003. Face recognition using boosted local features. MERL Tech. rep. TR2003-25. Mitsubishi Electric Research Laboratories, Cambridge, MA."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882283"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566605"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566607"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of SIGGRAPH 1999. Computer Graphics Proceedings, Annual Conference Series. ACM Press","author":"Lee J.","unstructured":"Lee , J. and Shin , S. Y . 1999. A hierachical approach to interactive motion editing . In Proceedings of SIGGRAPH 1999. Computer Graphics Proceedings, Annual Conference Series. ACM Press , New York, NY, 39--48. 10.1145\/311535.311539 Lee, J. and Shin, S. Y. 1999. A hierachical approach to interactive motion editing. In Proceedings of SIGGRAPH 1999. Computer Graphics Proceedings, Annual Conference Series. ACM Press, New York, NY, 39--48. 10.1145\/311535.311539"},{"key":"e_1_2_1_26_1","volume-title":"TR1998-06","author":"Leventon M. E.","unstructured":"Leventon , M. E. and Freeman , W. T . 1998. Bayesian estimation of a 3D human motion from an image sequence. MERL Tech. rep . TR1998-06 . Mitsubishi Electric Research Laboratories, Cambridge, MA. Leventon, M. E. and Freeman, W. T. 1998. Bayesian estimation of a 3D human motion from an image sequence. MERL Tech. rep. TR1998-06. Mitsubishi Electric Research Laboratories, Cambridge, MA."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag","author":"Matusik W.","year":"2001","unstructured":"Matusik , W. , Buehler , C. , and McMillan , L. 2001 . Polyhedral visual hulls for real-time rendering . In Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag , Berlin, Germany, 115--126. Matusik, W., Buehler, C., and McMillan, L. 2001. Polyhedral visual hulls for real-time rendering. In Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag, Berlin, Germany, 115--126."},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 455--461","author":"Mikic I.","unstructured":"Mikic , I. , Triverdi , M. , Hunter , E. , and Cosman , P . 2001. Articulated body posture estimation from multicamera voxel data . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 455--461 . Mikic, I., Triverdi, M., Hunter, E., and Cosman, P. 2001. Articulated body posture estimation from multicamera voxel data. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 455--461."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the European Conference on Computer Vision.","volume":"3","author":"Mori G.","unstructured":"Mori , G. and Malik , J . 2002. Estimating human body configurations using shape context matching . In Proceedings of the European Conference on Computer Vision. Vol. 3 . 666--680. Mori, G. and Malik, J. 2002. Estimating human body configurations using shape context matching. In Proceedings of the European Conference on Computer Vision. Vol. 3. 666--680."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the 1997 Conference on Computer Graphics International. 189","author":"Noser H.","unstructured":"Noser , H. and Thalmann , D . 1997. Sensor based synthetic actors in a tennis game simulation . In Proceedings of the 1997 Conference on Computer Graphics International. 189 . Noser, H. and Thalmann, D. 1997. Sensor based synthetic actors in a tennis game simulation. In Proceedings of the 1997 Conference on Computer Graphics International. 189."},{"key":"e_1_2_1_31_1","unstructured":"Point Grey Corporation. 2001. Dragonfly cameras. Available at http:\/\/www.ptgrey.com.  Point Grey Corporation. 2001. Dragonfly cameras. Available at http:\/\/www.ptgrey.com."},{"key":"e_1_2_1_32_1","unstructured":"Ramanan D. and Forsyth D. A. 2004. Automatic annotation of everyday movements. In Advances in Neural Information Processing Systems 16. MIT Press Cambridge MA 1547--1554.  Ramanan D. and Forsyth D. A. 2004. Automatic annotation of everyday movements. In Advances in Neural Information Processing Systems 16. MIT Press Cambridge MA 1547--1554."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the IEEE Human Motion Workshop. 19--24","author":"Rosales R.","unstructured":"Rosales , R. and Sclaroff , S . 2000. Specialized mappings and the estimation of body pose from a single image . In Proceedings of the IEEE Human Motion Workshop. 19--24 . Rosales, R. and Sclaroff, S. 2000. Specialized mappings and the estimation of body pose from a single image. In Proceedings of the IEEE Human Motion Workshop. 19--24."},{"key":"e_1_2_1_34_1","unstructured":"Rosales R. Siddiqui M. Alon J. and Sclaroff S. 2001. Estimating 3D body pose using uncalibrated cameras. In Boston University Computer Science Department Tech. rep. 2001-008. Boston University Boston MA.   Rosales R. Siddiqui M. Alon J. and Sclaroff S. 2001. Estimating 3D body pose using uncalibrated cameras. In Boston University Computer Science Department Tech. rep. 2001-008. Boston University Boston MA."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007614523901"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 750--757","author":"Shakhnarovich G.","unstructured":"Shakhnarovich , G. , Viola , P. , and Darrell , T . 2003. Fast pose estimation with parameter-sensitive hashing . In Proceedings of the IEEE International Conference on Computer Vision. 750--757 . Shakhnarovich, G., Viola, P., and Darrell, T. 2003. Fast pose estimation with parameter-sensitive hashing. In Proceedings of the IEEE International Conference on Computer Vision. 750--757."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/502122.502123"},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems. 203--208","author":"Shipp C. A.","unstructured":"Shipp , C. A. and Kuncheva , L. I . 2002. An investigation into how Adaboost affects classifier diversity . In Proceedings of 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems. 203--208 . Shipp, C. A. and Kuncheva, L. I. 2002. An investigation into how Adaboost affects classifier diversity. In Proceedings of 9th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems. 203--208."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the European Conference on Computer Vision. 784--800","author":"Sidenbladh H.","unstructured":"Sidenbladh , H. , Black , M. J. , and Signal , L . 2002. Implicit probabilistic models of human motion for synthesis and tracking . In Proceedings of the European Conference on Computer Vision. 784--800 . Sidenbladh, H., Black, M. J., and Signal, L. 2002. Implicit probabilistic models of human motion for synthesis and tracking. In Proceedings of the European Conference on Computer Vision. 784--800."},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1177\/0278364903022006003","article-title":"Estimating articulated human motion with covariance scaled sampling","volume":"22","author":"Sminchisescu C.","year":"2003","unstructured":"Sminchisescu , C. and Triggs , B. 2003 . Estimating articulated human motion with covariance scaled sampling . In Int. J. Robotics Res. 22 , 6, 371 -- 393 . Sminchisescu, C. and Triggs, B. 2003. Estimating articulated human motion with covariance scaled sampling. In Int. J. Robotics Res. 22, 6, 371--393.","journal-title":"Int. J. Robotics Res."},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the International Conference on Computer Vision. 1063--1070","author":"Stenger B.","unstructured":"Stenger , B. , Thayananthan , A. , Torr , P. , and Cipolla , R . 2003. Filtering using a tree-based estimator . In Proceedings of the International Conference on Computer Vision. 1063--1070 . Stenger, B., Thayananthan, A., Torr, P., and Cipolla, R. 2003. Filtering using a tree-based estimator. In Proceedings of the International Conference on Computer Vision. 1063--1070."},{"key":"e_1_2_1_42_1","unstructured":"Vicon Motion Systems. 2002. Available at http:\/\/www.vicon.com\/.  Vicon Motion Systems. 2002. Available at http:\/\/www.vicon.com\/."},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 511--518","author":"Viola P.","unstructured":"Viola , P. and Jones , M . 2001. Rapid object detection using a boosted cascade of simple features . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 511--518 . Viola, P. and Jones, M. 2001. Rapid object detection using a boosted cascade of simple features. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 511--518."},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 734--741","author":"Viola P.","unstructured":"Viola , P. , Jones , M. J. , and Snow , D . 2003. Detecting pedestrians using patterns of motion and appearance . In Proceedings of the IEEE International Conference on Computer Vision. 734--741 . Viola, P., Jones, M. J., and Snow, D. 2003. Detecting pedestrians using patterns of motion and appearance. In Proceedings of the IEEE International Conference on Computer Vision. 734--741."},{"key":"e_1_2_1_45_1","unstructured":"Wu J. Rehg J. M. and Mullin M. D. 2004. Learning a rare event detection cascade by direct feature selection. In Advances in Neural Information Processing Systems 16. MIT Press Cambridge MA. 1523--1530.  Wu J. Rehg J. M. and Mullin M. D. 2004. Learning a rare event detection cascade by direct feature selection. In Advances in Neural Information Processing Systems 16. MIT Press Cambridge MA. 1523--1530."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 2--7.","author":"Yamamoto M.","unstructured":"Yamamoto , M. , Sato , A. , Kawada , S. , Kondo , T. , and Osaki , Y . 1998. Incremental tracking of human actions from multiple views . In Proceedings of the IEEE International Conference on Computer Vision. 2--7. Yamamoto, M., Sato, A., Kawada, S., Kondo, T., and Osaki, Y. 1998. Incremental tracking of human actions from multiple views. In Proceedings of the IEEE International Conference on Computer Vision. 2--7."},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 329--338","author":"Yin K.","unstructured":"Yin , K. and Pai , D. K . 2003. Footsee: An interactive animation system . In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 329--338 . Yin, K. and Pai, D. K. 2003. Footsee: An interactive animation system. In Proceedings of the 2003 ACM SIGGRAPH\/Eurographics Symposium on Computer Animation. 329--338."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1095878.1095882","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1095878.1095882","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:08:28Z","timestamp":1750262908000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1095878.1095882"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,10]]},"references-count":47,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2005,10]]}},"alternative-id":["10.1145\/1095878.1095882"],"URL":"https:\/\/doi.org\/10.1145\/1095878.1095882","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,10]]},"assertion":[{"value":"2005-10-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}