{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T17:02:21Z","timestamp":1777568541883,"version":"3.51.4"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2010,7,26]],"date-time":"2010-07-26T00:00:00Z","timestamp":1280102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000077","name":"Division of Social and Economic Sciences","doi-asserted-by":"publisher","award":["SES-0835601CCF-0641402"],"award-info":[{"award-number":["SES-0835601CCF-0641402"]}],"id":[{"id":"10.13039\/100000077","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000143","name":"Division of Computing and Communication Foundations","doi-asserted-by":"publisher","award":["SES-0835601CCF-0641402"],"award-info":[{"award-number":["SES-0835601CCF-0641402"]}],"id":[{"id":"10.13039\/100000143","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2010,7,26]]},"abstract":"<jats:p>\n            We introduce\n            <jats:italic>gesture controllers<\/jats:italic>\n            , a method for animating the body language of avatars engaged in live spoken conversation. A gesture controller is an optimal-policy controller that schedules gesture animations in real time based on acoustic features in the user's speech. The controller consists of an inference layer, which infers a distribution over a set of hidden states from the speech signal, and a control layer, which selects the optimal motion based on the inferred state distribution. The inference layer, consisting of a specialized conditional random field, learns the hidden structure in body language style and associates it with acoustic features in speech. The control layer uses reinforcement learning to construct an optimal policy for selecting motion clips from a distribution over the learned hidden states. The modularity of the proposed method allows customization of a character's gesture repertoire, animation of non-human characters, and the use of additional inputs such as speech recognition or direct user control.\n          <\/jats:p>","DOI":"10.1145\/1778765.1778861","type":"journal-article","created":{"date-parts":[[2010,7,15]],"date-time":"2010-07-15T12:48:46Z","timestamp":1279198126000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":88,"title":["Gesture controllers"],"prefix":"10.1145","volume":"29","author":[{"given":"Sergey","family":"Levine","sequence":"first","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philipp","family":"Kr\u00e4henb\u00fchl","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sebastian","family":"Thrun","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vladlen","family":"Koltun","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2010,7,26]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"crossref","unstructured":"Albrecht I. Haber J. and peter Seidel H. 2002. Automatic generation of non-verbal facial expressions from speech. In Computer Graphics International 283--293.  Albrecht I. Haber J. and peter Seidel H. 2002. Automatic generation of non-verbal facial expressions from speech. In Computer Graphics International 283--293.","DOI":"10.1007\/978-1-4471-0103-1_18"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1162\/1054746041944803"},{"key":"e_1_2_2_3_1","unstructured":"Bertsekas D. 2007. Dynamic Programming and Optimal Control third ed. Athena Scientific.   Bertsekas D. 2007. Dynamic Programming and Optimal Control third ed. Athena Scientific."},{"key":"e_1_2_2_4_1","unstructured":"Birdwhistell R. 1952. Introduction to Kinesics. Department of State Foreign Service Institute Washington DC.  Birdwhistell R. 1952. Introduction to Kinesics. Department of State Foreign Service Institute Washington DC."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311537"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258880"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192272"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383315"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1061347.1061355"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00990296"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Deng Z. and Neumann U. 2007. Data-Driven 3D Facial Animation. Springer-Verlag Press.   Deng Z. and Neumann U. 2007. Data-Driven 3D Facial Animation. Springer-Verlag Press.","DOI":"10.1007\/978-1-84628-907-1"},{"key":"e_1_2_2_12_1","unstructured":"Dobrogaev S. M. 1931. Ucenie o reflekse v problemakh jazykovedenija. {Observations on reflex in aspects of language study.}. Jazykovedenie i Materializm 2 105--173.  Dobrogaev S. M. 1931. Ucenie o reflekse v problemakh jazykovedenija. {Observations on reflex in aspects of language study.}. Jazykovedenie i Materializm 2 105--173."},{"key":"e_1_2_2_13_1","unstructured":"Efron D. 1972. Gesture Race and Culture. The Hague: Mouton.  Efron D. 1972. Gesture Race and Culture. The Hague: Mouton."},{"key":"e_1_2_2_14_1","unstructured":"Englebienne G. Cootes T. and Rattray M. 2007. A probabilistic model for generating realistic lip movements from speech. In Neural Information Processing Systems (NIPS) 19 MIT Press.  Englebienne G. Cootes T. and Rattray M. 2007. A probabilistic model for generating realistic lip movements from speech. In Neural Information Processing Systems (NIPS) 19 MIT Press."},{"key":"e_1_2_2_15_1","unstructured":"Feyereisen P. and de Lannoy J.-D. 1991. Gestures and Speech: Psychological Investigations. Cambridge University Press.  Feyereisen P. and de Lannoy J.-D. 1991. Gestures and Speech: Psychological Investigations. Cambridge University Press."},{"key":"e_1_2_2_16_1","volume-title":"Proceedings on Computer Animation, IEEE Computer Society","author":"Hartmann B."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/11678816_22"},{"key":"e_1_2_2_18_1","doi-asserted-by":"crossref","unstructured":"Kendon A. 2004. Gesture -- Visible Action as Utterance. Cambridge University Press New York NY USA.  Kendon A. 2004. Gesture -- Visible Action as Utterance. Cambridge University Press New York NY USA.","DOI":"10.1017\/CBO9780511807572"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-007-9053-5"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.v15:1"},{"key":"e_1_2_2_21_1","volume-title":"Proc. of the 18th International Conference on Machine Learning, Morgan Kaufmann Inc., 282--289","author":"Lafferty J. D."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1661412.1618518"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2006.870732"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1075\/gest.7.2.04loe"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276385"},{"key":"e_1_2_2_26_1","unstructured":"McNeill D. 1992. Hand and Mind: What Gestures Reveal About Thought. University Of Chicago Press.  McNeill D. 1992. Hand and Mind: What Gestures Reveal About Thought. University Of Chicago Press."},{"key":"e_1_2_2_27_1","volume-title":"Proc. of IEEE Computer Vision and Pattern Recognition, 1--8.","author":"Morency L.-P."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1330511.1330516"},{"key":"e_1_2_2_29_1","unstructured":"Newlove J. 1993. Laban for Actors and Dancers. Routledge Nick Hern Books New York NY USA.  Newlove J. 1993. Laban for Actors and Dancers. Routledge Nick Hern Books New York NY USA."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237258"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.18626"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70797"},{"key":"e_1_2_2_33_1","doi-asserted-by":"crossref","unstructured":"Shr\u00f6der M. 2009. Expressive speech synthesis: Past present and possible futures. Affective Information Processing 111--126.  Shr\u00f6der M. 2009. Expressive speech synthesis: Past present and possible futures. Affective Information Processing 111--126.","DOI":"10.1007\/978-1-84800-306-4_7"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015753"},{"key":"e_1_2_2_35_1","unstructured":"The CMU Sphinx Group 2007. Open source speech recognition engines.  The CMU Sphinx Group 2007. Open source speech recognition engines."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276386"},{"key":"e_1_2_2_37_1","volume-title":"EUSIPCO '02","volume":"1","author":"Valbonesi L."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.132"},{"key":"e_1_2_2_39_1","volume-title":"IEEE International Conference on Multimedia and Expo, 1165--1168","author":"Xue J."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2004.08.002"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1778765.1778861","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1778765.1778861","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:39:47Z","timestamp":1750246787000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1778765.1778861"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,7,26]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2010,7,26]]}},"alternative-id":["10.1145\/1778765.1778861"],"URL":"https:\/\/doi.org\/10.1145\/1778765.1778861","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,7,26]]},"assertion":[{"value":"2010-07-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}