{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T12:16:43Z","timestamp":1763641003941,"version":"3.41.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2005,7,1]],"date-time":"2005-07-01T00:00:00Z","timestamp":1120176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2005,7]]},"abstract":"<jats:p>Communication plays a central role in everday life. During an average conversation, information is exchanged in a variety of ways, including through facial motion. Here, we employ a custom, model-based image manipulation technique to selectively \u201cfreez \u201d portions of a face in video recordings in order to determine the areas that are sufficient for proper recognition of nine conversational expressions. The results show that most expressions rely primarily on a single facial area to convey meaning with different expressions using different areas. The results also show that the combination of rigid head, eye, eyebrow, and mouth motions is sufficient to produce expressions that are as easy to recognize as the original, unmanipulated recordings. Finally, the results show that the manipulation technique introduced few perceptible artifacts into the altered video sequences. This fusion of psychophysics and computer graphics techniques provides not only fundamental insights into human perception and cognition, but also yields the basis for a systematic description of what needs to move in order to produce realistic, recognizable conversational facial animations.<\/jats:p>","DOI":"10.1145\/1077399.1077404","type":"journal-article","created":{"date-parts":[[2005,11,7]],"date-time":"2005-11-07T16:00:45Z","timestamp":1131379245000},"page":"251-269","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":34,"title":["Manipulating Video Sequences to Determine the Components of Conversational Facial Expressions"],"prefix":"10.1145","volume":"2","author":[{"given":"Douglas W.","family":"Cunningham","sequence":"first","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics, T\u00fcbingen, Germany"}]},{"given":"Mario","family":"Kleiner","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics, T\u00fcbingen, Germany"}]},{"given":"Christian","family":"Wallraven","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics, T\u00fcbingen, Germany"}]},{"given":"Heinrich H.","family":"B\u00fclthoff","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Biological Cybernetics, T\u00fcbingen, Germany"}]}],"member":"320","published-online":{"date-parts":[[2005,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0733-8619(02)00106-8"},{"key":"e_1_2_1_2_1","first-page":"373","article-title":"Facial motion in the perception of faces and of emotional expression","volume":"4","author":"Bassili J.","year":"1978","unstructured":"Bassili , J. 1978 . Facial motion in the perception of faces and of emotional expression . Journal of Experimental Psychology 4 , 373 -- 379 . Bassili, J. 1978. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology 4, 373--379.","journal-title":"Journal of Experimental Psychology"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.37.11.2049"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.50.2.322"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X00019002001"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.79.6.941"},{"volume-title":"SIGGRAPH'99 Conference Proceedings. 187--194","author":"Blanz V.","key":"e_1_2_1_7_1","unstructured":"Blanz , V. and Vetter , T . 1999. A morphable model for the synthesis of 3d faces . In SIGGRAPH'99 Conference Proceedings. 187--194 . 10.1145\/311535.311556 Blanz, V. and Vetter, T. 1999. A morphable model for the synthesis of 3d faces. In SIGGRAPH'99 Conference Proceedings. 187--194. 10.1145\/311535.311556"},{"volume-title":"Lawrence Erlbaum Associates","author":"Bruce V.","key":"e_1_2_1_8_1","unstructured":"Bruce , V. 1988. Recognising Faces . Lawrence Erlbaum Associates , Mahwah, NJ . Bruce, V. 1988. Recognising Faces. Lawrence Erlbaum Associates, Mahwah, NJ."},{"key":"e_1_2_1_9_1","first-page":"644","article-title":"State of the art: Nonverbal communication","volume":"14","author":"Bull P.","year":"2001","unstructured":"Bull , P. 2001 . State of the art: Nonverbal communication . The Psychologist 14 , 644 -- 647 . Bull, P. 2001. State of the art: Nonverbal communication. The Psychologist 14, 644--647.","journal-title":"The Psychologist"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01000738"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0950-7051(00)00102-7"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/088395199117360"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005053-196610000-00005"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Cunningham D. W. Breidt M. Kleiner M. Wallraven C. and B\u00fclthoff H. H. 2003a. How believable are real faces?: Towards a perceptual basis for conversational animation. In Computer Animation and Social Agents 2003. 23--29. Cunningham D. W. Breidt M. Kleiner M. Wallraven C. and B\u00fclthoff H. H. 2003a. How believable are real faces?: Towards a perceptual basis for conversational animation. In Computer Animation and Social Agents 2003. 23--29.","DOI":"10.1109\/CASA.2003.1199300"},{"key":"e_1_2_1_15_1","first-page":"7","article-title":"The inaccuracy and insincerity of real faces","volume":"2003","author":"Cunningham D. W.","year":"2003","unstructured":"Cunningham , D. W. , Breidt , M. , Kleiner , M. , Wallraven , C. , and B\u00fclthoff , H. H. 2003 b. The inaccuracy and insincerity of real faces . In Proceedings of Visualization, Imaging, and Image Processing 2003. 7 -- 12 . Cunningham, D. W., Breidt, M., Kleiner, M., Wallraven, C., and B\u00fclthoff, H. H. 2003b. The inaccuracy and insincerity of real faces. In Proceedings of Visualization, Imaging, and Image Processing 2003. 7--12.","journal-title":"Proceedings of Visualization, Imaging, and Image Processing"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/cav.v15:3\/4"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the Computer Animation","author":"DeCarlo D.","year":"2002","unstructured":"DeCarlo , D. , Revilla , C. , and Stone , M . 2002. Making discourse visible: Coding and animating conversational facial displays . In Proceedings of the Computer Animation 2002 . 11--16. DeCarlo, D., Revilla, C., and Stone, M. 2002. Making discourse visible: Coding and animating conversational facial displays. In Proceedings of the Computer Animation 2002. 11--16."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.799905"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9280.00054"},{"key":"e_1_2_1_20_1","volume-title":"Nebraska Symposium on Motivation","author":"Ekman P.","year":"1972","unstructured":"Ekman , P. 1972 . Universal and cultural differences in facial expressions of emotion . In Nebraska Symposium on Motivation 1971, J. R. Cole, Ed. University of Nebraska Press, Lincoln, NE, 207--283. Ekman, P. 1972. Universal and cultural differences in facial expressions of emotion. In Nebraska Symposium on Motivation 1971, J. R. Cole, Ed. University of Nebraska Press, Lincoln, NE, 207--283."},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Ekman P. and Friesen W. 1978. Facial Action Coding System. Consulting Psychologists Press Inc. Palo Alto California. Ekman P. and Friesen W. 1978. Facial Action Coding System. Consulting Psychologists Press Inc. Palo Alto California.","DOI":"10.1037\/t27734-000"},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Essa I. and Pentland A. 1994. A vision system for observing and extracting facial action parameters. In CVPR94. 76--83. Essa I. and Pentland A. 1994. A vision system for observing and extracting facial action parameters. In CVPR94. 76--83.","DOI":"10.1109\/CVPR.1994.323813"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.80.1.75"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Gooch B. and Gooch A. 2001. Non-Photorealistic Rendering. A.K. Peters. Natick Massachusetts USA. Gooch B. and Gooch A. 2001. Non-Photorealistic Rendering. A.K. Peters. Natick Massachusetts USA.","DOI":"10.1201\/9781439864173"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/0028-3932(93)90045-2"},{"key":"e_1_2_1_26_1","unstructured":"Isaacs E. and Tang J. 1993. What video can and can't do for collaboration: a case study. In \u2018CM Multimedia \u201993 \u201c. ACM New York 496--503. 10.1145\/166266.166289 Isaacs E. and Tang J. 1993. What video can and can't do for collaboration: a case study. In \u2018CM Multimedia \u201993 \u201c. ACM New York 496--503. 10.1145\/166266.166289"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1068\/p3131"},{"key":"e_1_2_1_28_1","volume-title":"Tech. Rep. 123","author":"Kleiner M.","year":"2004","unstructured":"Kleiner , M. , Wallraven , C. , and B\u00fclthoff , H. H . 2004 . The MPI Videolab---a system for high quality synchronous recording of video and audio from multiple viewpoints. Tech. Rep. 123 , Max Planck Institute for Biological Cybernetics , T\u00fcbingen, Germany . Kleiner, M., Wallraven, C., and B\u00fclthoff, H. H. 2004. The MPI Videolab---a system for high quality synchronous recording of video and audio from multiple viewpoints. Tech. Rep. 123, Max Planck Institute for Biological Cybernetics, T\u00fcbingen, Germany."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-2958.1993.tb00314.x"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.895976"},{"key":"e_1_2_1_31_1","first-page":"19104","article-title":"Final report to the NSF of the standards for facial animation workshop. Tech. rep., University of Pennsylvania, School of Engineering and Applied Science, Computer and Information Science Department, Philadelphia","author":"Pelachaud C.","year":"1994","unstructured":"Pelachaud , C. , Badler , N. , and Viaud , M. 1994 . Final report to the NSF of the standards for facial animation workshop. Tech. rep., University of Pennsylvania, School of Engineering and Applied Science, Computer and Information Science Department, Philadelphia , PA 19104 - 16389 . Pelachaud, C., Badler, N., and Viaud, M. 1994. Final report to the NSF of the standards for facial animation workshop. Tech. rep., University of Pennsylvania, School of Engineering and Applied Science, Computer and Information Science Department, Philadelphia, PA 19104-6389.","journal-title":"PA"},{"key":"e_1_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Poggio I. and Pelachaud C. 2000. Perfomative facial expressions in animated faces. In Embodied Conversational Agents J. Cassell J. Sullivan S. Prevost and E. Churchill Eds. MIT Press Cambridge MA 115--188. Poggio I. and Pelachaud C. 2000. Perfomative facial expressions in animated faces. In Embodied Conversational Agents J. Cassell J. Sullivan S. Prevost and E. Churchill Eds. MIT Press Cambridge MA 115--188.","DOI":"10.7551\/mitpress\/2697.003.0008"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010671109788"},{"key":"e_1_2_1_34_1","unstructured":"Strothotte T. and Schlechtweg S. 2002. Non-Photorealistic Computer Graphics: Modeling Rendering and Animation. Morgan Kaufmann San Francisco CA. Strothotte T. and Schlechtweg S. 2002. Non-Photorealistic Computer Graphics: Modeling Rendering and Animation. Morgan Kaufmann San Francisco CA."},{"key":"e_1_2_1_35_1","volume-title":"Toonface: A system for creating and animating cartoon faces. Tech. Rep. 96-01, M.I.T. Media Laboratory, Learning & Common Sense Section.","author":"Thorisson K. R.","year":"1996","unstructured":"Thorisson , K. R. 1996 . Toonface: A system for creating and animating cartoon faces. Tech. Rep. 96-01, M.I.T. Media Laboratory, Learning & Common Sense Section. Thorisson, K. R. 1996. Toonface: A system for creating and animating cartoon faces. Tech. Rep. 96-01, M.I.T. Media Laboratory, Learning & Common Sense Section."},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Vertegaal R. 1997. Conversational awareness in multiparty vmc. In \u2018xtended Abstracts of CHI\u201997 \u201d. ACM Atlanta 496--503. 10.1145\/1120212.1120217 Vertegaal R. 1997. Conversational awareness in multiparty vmc. In \u2018xtended Abstracts of CHI\u201997 \u201d. ACM Atlanta 496--503. 10.1145\/1120212.1120217","DOI":"10.1145\/1120212.1120217"},{"volume-title":"Papers from the Sixth Regional Meeting of the Chicago Linguistic Society","author":"Yngve V. H.","key":"e_1_2_1_37_1","unstructured":"Yngve , V. H. 1970. On getting a word in edgewise . In Papers from the Sixth Regional Meeting of the Chicago Linguistic Society . Chicago Linguistic Society , Chicago, Illinois . 567--578. Yngve, V. H. 1970. On getting a word in edgewise. In Papers from the Sixth Regional Meeting of the Chicago Linguistic Society. Chicago Linguistic Society, Chicago, Illinois. 567--578."}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1077399.1077404","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1077399.1077404","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:23:51Z","timestamp":1750267431000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1077399.1077404"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,7]]},"references-count":37,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2005,7]]}},"alternative-id":["10.1145\/1077399.1077404"],"URL":"https:\/\/doi.org\/10.1145\/1077399.1077404","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"type":"print","value":"1544-3558"},{"type":"electronic","value":"1544-3965"}],"subject":[],"published":{"date-parts":[[2005,7]]},"assertion":[{"value":"2005-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}