{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T08:29:50Z","timestamp":1765355390280,"version":"3.41.0"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2008,3,1]],"date-time":"2008-03-01T00:00:00Z","timestamp":1204329600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01 IMB 01A"],"award-info":[{"award-number":["01 IMB 01A"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2008,3]]},"abstract":"<jats:p>Animated characters that move and gesticulate appropriately with spoken text are useful in a wide range of applications. Unfortunately, this class of movement is very difficult to generate, even more so when a unique, individual movement style is required. We present a system that, with a focus on arm gestures, is capable of producing full-body gesture animation for given input text in the style of a particular performer. Our process starts with video of a person whose gesturing style we wish to animate. A tool-assisted annotation process is performed on the video, from which a statistical model of the person's particular gesturing style is built. Using this model and input text tagged with theme, rheme and focus, our generation algorithm creates a gesture script. As opposed to isolated singleton gestures, our gesture script specifies a stream of continuous gestures coordinated with speech. This script is passed to an animation system, which enhances the gesture description with additional detail. It then generates either kinematic or physically simulated motion based on this description. The system is capable of generating gesture animations for novel text that are consistent with a given performer's style, as was successfully validated in an empirical user study.<\/jats:p>","DOI":"10.1145\/1330511.1330516","type":"journal-article","created":{"date-parts":[[2008,3,25]],"date-time":"2008-03-25T14:01:40Z","timestamp":1206453700000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":177,"title":["Gesture modeling and animation based on a probabilistic re-creation of speaker style"],"prefix":"10.1145","volume":"27","author":[{"given":"Michael","family":"Neff","sequence":"first","affiliation":[{"name":"University of California, Davis"}]},{"given":"Michael","family":"Kipp","sequence":"additional","affiliation":[{"name":"DFKI\u2014German Research Center for Artificial Intelligence"}]},{"given":"Irene","family":"Albrecht","sequence":"additional","affiliation":[{"name":"MPI Informatik"}]},{"given":"Hans-Peter","family":"Seidel","sequence":"additional","affiliation":[{"name":"MPI Informatik"}]}],"member":"320","published-online":{"date-parts":[[2008,3,20]]},"reference":[{"volume-title":"Proceedings of the Computer Graphics International. 283--293","author":"Albrecht I.","key":"e_1_2_1_1_1"},{"key":"e_1_2_1_2_1","unstructured":"Axtell R. E. 1998. Gestures---The Do's and Taboo's of Body Language Around the World. John Wiley & Sons Inc. New York.  Axtell R. E. 1998. Gestures---The Do's and Taboo's of Body Language Around the World. John Wiley & Sons Inc. New York."},{"volume-title":"Simulating Humans: Computer Graphics, Animation and Control","year":"1992","author":"Badler N. I.","key":"e_1_2_1_3_1"},{"volume-title":"Praat: Doing phonetics by computer (version 4.3.14)","year":"2005","author":"Boersma P.","key":"e_1_2_1_4_1"},{"key":"e_1_2_1_5_1","unstructured":"Calbris G. 1990. Semiotics of French Gesture. Indiana University Press Bloomington IN.  Calbris G. 1990. Semiotics of French Gesture. Indiana University Press Bloomington IN."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073012.1073028"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192272"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383315"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.352172"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Cohen M. and Massaro D. 1993. Modeling coarticulation in synthetic visual speech. In Models and Techniques in Computer Animation N. Magnenat-Thalmann and D. Thalmann Eds. Springer. 139--156.  Cohen M. and Massaro D. 1993. Modeling coarticulation in synthetic visual speech. In Models and Techniques in Computer Animation N. Magnenat-Thalmann and D. Thalmann Eds. Springer. 139--156.","DOI":"10.1007\/978-4-431-66911-1_13"},{"volume-title":"Language and Gesture: Window into Thought and Action","author":"de Ruiter J.","key":"e_1_2_1_11_1"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0097-8493(01)00171-6"},{"volume-title":"Proceedings 4. \u00d6sterreichische Artificial-Intelligence-Tagung. Wiener Workshop---Wissensbasierte Sprachverarbeitung. H. Trost, Ed. Springer. 11--19","author":"Finkler W.","key":"e_1_2_1_13_1"},{"key":"e_1_2_1_14_1","unstructured":"Frey S. 1999. Die Macht des Bildes: der Einflu\u03b2 der nonverbalen Kommunikation auf Kultur und Politik. Verlag Hans Huber Bern.  Frey S. 1999. Die Macht des Bildes: der Einflu\u03b2 der nonverbalen Kommunikation auf Kultur und Politik. Verlag Hans Huber Bern."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1082473.1082640"},{"volume-title":"Proceedings of Computer Animation. 111--119","author":"Hartmann B.","key":"e_1_2_1_16_1"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/11678816_22"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218414"},{"key":"e_1_2_1_19_1","unstructured":"Hollars M. G. Rosenthal D. E. and Sherman M. A. 1994. SD\/FAST User's Manual. Symbolic Dynamics Inc.  Hollars M. G. Rosenthal D. E. and Sherman M. A. 1994. SD\/FAST User's Manual. Symbolic Dynamics Inc."},{"volume-title":"Proceedings of the Workshop on Embodied Language Processing. Association for Computational Linguistics. 51--58","author":"Huenerfauth M.","key":"e_1_2_1_20_1"},{"key":"e_1_2_1_21_1","unstructured":"Jurafsky D. and Martin J. H. 2003. Speech and Language Processing. Prentice Hall.   Jurafsky D. and Martin J. H. 2003. Speech and Language Processing. Prentice Hall."},{"volume-title":"The Relationship of Verbal and Nonverbal Communication","author":"Kendon A.","key":"e_1_2_1_22_1"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Kendon A. 2004. Gesture---Visible Action as Utterance. Cambridge University Press Cambridge.  Kendon A. 2004. Gesture---Visible Action as Utterance. Cambridge University Press Cambridge.","DOI":"10.1017\/CBO9780511807572"},{"volume-title":"Proceedings of the 7th European Conference on Speech Communication and Technology (Eurospeech)","year":"2001","author":"Kipp M.","key":"e_1_2_1_24_1"},{"key":"e_1_2_1_25_1","unstructured":"Kipp M. 2004. Gesture generation by imitation: From human behavior to computer character animation. Dissertation.com Boca Raton FL.  Kipp M. 2004. Gesture generation by imitation: From human behavior to computer character animation. Dissertation.com Boca Raton FL."},{"volume-title":"Proceedings of the Workshop on Multimodal Corpora (LREC'06)","author":"Kipp M.","key":"e_1_2_1_26_1"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74997-4_2"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Kita S. van Gijn I. and van der Hulst H. 1998. Movement phases in signs and co-speech gestures and their transcription by human coders. In Gesture and Sign Language in Human-Computer Interaction I. Wachsmuth and M. Fr\u00f6hlich Eds. Springer 23--35.   Kita S. van Gijn I. and van der Hulst H. 1998. Movement phases in signs and co-speech gestures and their transcription by human coders. In Gesture and Sign Language in Human-Computer Interaction I. Wachsmuth and M. Fr\u00f6hlich Eds. Springer 23--35.","DOI":"10.1007\/BFb0052986"},{"volume":"2915","volume-title":"Proceedings of the Gesture Workshop. Lecture Notes in Artificial Intelligence","author":"Kopp S.","key":"e_1_2_1_29_1"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027933.1027952"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.v15:1"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1515\/text.1.1988.8.3.243"},{"volume-title":"Form: An extensible, kinematically based gesture annotation scheme. In Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems","year":"2004","author":"Martell C. H.","key":"e_1_2_1_33_1"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0219843606000825"},{"key":"e_1_2_1_35_1","unstructured":"McNeill D. 1992. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press Chicago IL.  McNeill D. 1992. Hand and Mind: What Gestures Reveal about Thought. University of Chicago Press Chicago IL."},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"McNeill D. 2005. Gesture and Thought. University of Chicago Press Chicago IL.  McNeill D. 2005. Gesture and Thought. University of Chicago Press Chicago IL.","DOI":"10.7208\/chicago\/9780226514642.001.0001"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1093\/ijl\/3.4.235"},{"key":"e_1_2_1_38_1","unstructured":"Neff M. 2005. Aesthetic exploration and refinement: A computational framework for expressive character animation. Ph.D. Dissertation. Department of Computer Science University of Toronto.   Neff M. 2005. Aesthetic exploration and refinement: A computational framework for expressive character animation. Ph.D. Dissertation. Department of Computer Science University of Toronto."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545275"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073391"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2005.03.003"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/11789239_27"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.851755"},{"volume":"2915","volume-title":"Proceedings of Gesture Workshop. Lecture Notes in Artificial Intelligence","author":"Noot H.","key":"e_1_2_1_44_1"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073368.1073413"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311536"},{"key":"e_1_2_1_47_1","volume-title":"C: The Art of Scientific Computing","author":"Press W. H.","year":"1992","edition":"2"},{"key":"e_1_2_1_48_1","doi-asserted-by":"crossref","unstructured":"Saitz R. L. and Cervenka E. J. 1972. Handbook of Gestures: Colombia and the United States second ed. Mouton The Hague The Netherlands.  Saitz R. L. and Cervenka E. J. 1972. Handbook of Gestures: Colombia and the United States second ed. Mouton The Hague The Netherlands.","DOI":"10.1515\/9783110810325"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1080\/00332747.1964.11023403"},{"volume-title":"Structures of Social Action","author":"Schegloff E. A.","key":"e_1_2_1_50_1"},{"key":"e_1_2_1_51_1","unstructured":"Shapiro A. Faloutsos P. and Ng-Thow-Hing V. 2005. Dynamic animation and control environment. Graphics Interface 61--70.   Shapiro A. Faloutsos P. and Ng-Thow-Hing V. 2005. Dynamic animation and control environment. Graphics Interface 61--70."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1162\/002438900554505"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186562.1015753"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2004.02.008"},{"key":"e_1_2_1_55_1","unstructured":"Webb R. 1997. Linguistic Properties of Metaphoric Gestures. UMI New York NY.  Webb R. 1997. Linguistic Properties of Metaphoric Gestures. UMI New York NY."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/54852.378507"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218422"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545276"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1330511.1330516","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1330511.1330516","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:39:12Z","timestamp":1750253952000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1330511.1330516"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,3]]},"references-count":58,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2008,3]]}},"alternative-id":["10.1145\/1330511.1330516"],"URL":"https:\/\/doi.org\/10.1145\/1330511.1330516","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2008,3]]},"assertion":[{"value":"2006-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2007-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2008-03-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}