{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,1,11]],"date-time":"2025-01-11T17:19:02Z","timestamp":1736615942674,"version":"3.32.0"},"reference-count":38,"publisher":"World Scientific Pub Co Pte Ltd","issue":"03","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Human. Robot."],"published-print":{"date-parts":[[2006,9]]},"abstract":"<jats:p>One of the challenges of designing virtual humans is the definition of appropriate models of the relation between realistic emotions and the coordination of behaviors in several modalities. In this paper, we present the annotation, representation and modeling of multimodal visual behaviors occurring during complex emotions. We illustrate our work using a corpus of TV interviews. This corpus has been annotated at several levels of information: communicative acts, emotion labels, and multimodal signs. We have defined a copy-synthesis approach to drive an Embodied Conversational Agent from these different levels of information. The second part of our paper focuses on a model of complex (superposition and masking of) emotions in facial expressions of the agent. We explain how the complementary aspects of our work on corpus and computational model is used to specify complex emotional behaviors.<\/jats:p>","DOI":"10.1142\/s0219843606000825","type":"journal-article","created":{"date-parts":[[2006,10,19]],"date-time":"2006-10-19T10:24:43Z","timestamp":1161253483000},"page":"269-291","source":"Crossref","is-referenced-by-count":45,"title":["MULTIMODAL COMPLEX EMOTIONS: GESTURE EXPRESSIVITY AND BLENDED FACIAL EXPRESSIONS"],"prefix":"10.1142","volume":"03","author":[{"given":"JEAN-CLAUDE","family":"MARTIN","sequence":"first","affiliation":[{"name":"LIMSI-CNRS, BP 133, Orsay, 91403, France"}]},{"given":"RADOSLAW","family":"NIEWIADOMSKI","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, University of Perugia, Italy"}]},{"given":"LAURENCE","family":"DEVILLERS","sequence":"additional","affiliation":[{"name":"LIMSI-CNRS, BP 133, Orsay, 91403, France"}]},{"given":"STEPHANIE","family":"BUISINE","sequence":"additional","affiliation":[{"name":"LCPI-ENSAM, 151 boulevard de l'H\u00f4pital, Paris, 75013, France"}]},{"given":"CATHERINE","family":"PELACHAUD","sequence":"additional","affiliation":[{"name":"LINC, IUT of Montreuil, Universit\u00e9 Paris VIII, 140 rue Nouvelle France, Montreuil, 93100, France"}]}],"member":"219","published-online":{"date-parts":[[2011,11,20]]},"reference":[{"volume-title":"Unmasking the Face. A Guide to Recognizing Emotions from Facial Clues","year":"1975","author":"Ekman P.","key":"rf1"},{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(02)00078-X"},{"key":"rf4","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.70.3.614"},{"key":"rf5","doi-asserted-by":"publisher","DOI":"10.1007\/BF00990296"},{"volume-title":"Laban for Actors and Dancers","year":"1993","author":"Newlove J.","key":"rf6"},{"key":"rf7","doi-asserted-by":"publisher","DOI":"10.1037\/0012-1649.34.5.1007"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-0992(1998110)28:6<879::AID-EJSP901>3.0.CO;2-W"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.03.007"},{"volume-title":"NonVerbal Behavior in Interpersonal Relations","year":"1999","author":"Richmond V. P.","key":"rf12"},{"key":"rf13","doi-asserted-by":"publisher","DOI":"10.1007\/BF00987191"},{"key":"rf14","doi-asserted-by":"publisher","DOI":"10.1007\/BF00986872"},{"key":"rf15","doi-asserted-by":"publisher","DOI":"10.1002\/0470854626"},{"key":"rf17","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.37.11.2049"},{"key":"rf18","doi-asserted-by":"publisher","DOI":"10.4992\/jjpsy.71.211"},{"key":"rf20","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.50.2.260"},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-005-0153-5"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1002\/0470854626.ch9"},{"key":"rf24","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.t01-1-00645"},{"key":"rf30","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(02)00070-5"},{"key":"rf33","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2003.07.002"},{"volume-title":"Gesture Generation by Imitation. From Human Behavior to Computer Character Animation","author":"Kipp M.","key":"rf34"},{"volume-title":"Hand and Mind \u2014 What Gestures Reveal about Thoughts","year":"1992","author":"McNeill D.","key":"rf41"},{"key":"rf42","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511807572"},{"key":"rf43","unstructured":"I.\u00a0Poggi, Gestures. Meaning and Use, eds. M.\u00a0Rector, I.\u00a0Poggi and N.\u00a0Trigo (Edicoes Universidade Fernando Pessoa, Oporto, 2003)\u00a0pp. 119\u2013132."},{"key":"rf44","unstructured":"S.\u00a0Kaiser and T.\u00a0Wehrle, Appraisal Theories of Emotions: Theories, Methods, Research, eds. K. R.\u00a0Scherer, A.\u00a0Schorr and T.\u00a0Johnstone (Oxford University Press, New York, 2001)\u00a0pp. 285\u2013300."},{"key":"rf45","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.51.4.690"},{"key":"rf46","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.63.1.133"},{"key":"rf47","doi-asserted-by":"publisher","DOI":"10.1002\/cav.6"},{"key":"rf51","doi-asserted-by":"crossref","unstructured":"C.\u00a0Pelachaud, ACM Multimedia, Brave New Topics Session (ACM, Singapore, 2005)\u00a0pp. 683\u2013689.","DOI":"10.1145\/1101149.1101301"},{"volume-title":"The Face Revealed","year":"2003","author":"Ekman P.","key":"rf52"},{"key":"rf53","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.68.3.441"},{"key":"rf54","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992972"},{"key":"rf55","doi-asserted-by":"publisher","DOI":"10.1016\/0165-0114(96)00067-X"},{"volume-title":"Fuzzy Sets and Systems","year":"1980","author":"Dubois D.","key":"rf56"},{"key":"rf57","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1515\/semi.1969.1.1.49","volume":"1","author":"Ekman P.","journal-title":"Semiotica"},{"key":"rf58","doi-asserted-by":"publisher","DOI":"10.1196\/annals.1280.010"},{"volume-title":"Manual for the Facial Action Coding System","year":"1978","author":"Ekman P.","key":"rf60"},{"key":"rf62","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-08373-4_4"}],"container-title":["International Journal of Humanoid Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219843606000825","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,11]],"date-time":"2025-01-11T16:37:12Z","timestamp":1736613432000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219843606000825"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,9]]},"references-count":38,"journal-issue":{"issue":"03","published-online":{"date-parts":[[2011,11,20]]},"published-print":{"date-parts":[[2006,9]]}},"alternative-id":["10.1142\/S0219843606000825"],"URL":"https:\/\/doi.org\/10.1142\/s0219843606000825","relation":{},"ISSN":["0219-8436","1793-6942"],"issn-type":[{"type":"print","value":"0219-8436"},{"type":"electronic","value":"1793-6942"}],"subject":[],"published":{"date-parts":[[2006,9]]}}}