{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,19]],"date-time":"2025-11-19T06:57:52Z","timestamp":1763535472651,"version":"3.41.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,9,14]],"date-time":"2017-09-14T00:00:00Z","timestamp":1505347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001602","name":"Science Foundation Ireland","doi-asserted-by":"publisher","award":["S.F.10\/IN.1\/13003"],"award-info":[{"award-number":["S.F.10\/IN.1\/13003"]}],"id":[{"id":"10.13039\/501100001602","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004270","name":"Kungliga Tekniska H\u00f6gskolan","doi-asserted-by":"publisher","award":["SRA ICT The Next Generation"],"award-info":[{"award-number":["SRA ICT The Next Generation"]}],"id":[{"id":"10.13039\/501100004270","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Appl. Percept."],"published-print":{"date-parts":[[2017,10,31]]},"abstract":"<jats:p>Unlike their human counterparts, artificial agents such as robots and game characters may be deployed with a large variety of face and body configurations. Some have articulated bodies but lack facial features, and others may be talking heads ending at the neck. Generally, they have many fewer degrees of freedom than humans through which they must express themselves, and there will inevitably be a filtering effect when mapping human motion onto the agent. In this article, we investigate filtering effects on three types of embodiments: (a) an agent with a body but no facial features, (b) an agent with a head only, and (c) an agent with a body and a face. We performed a full performance capture of a mime actor enacting short interactions varying the non-verbal expression along five dimensions (e.g., level of frustration and level of certainty) for each of the three embodiments. We performed a crowd-sourced evaluation experiment comparing the video of the actor to the video of an animated robot for the different embodiments and dimensions. Our findings suggest that the face is especially important to pinpoint emotional reactions but is also most volatile to filtering effects. The body motion, on the other hand, had more diverse interpretations but tended to preserve the interpretation after mapping and thus proved to be more resilient to filtering.<\/jats:p>","DOI":"10.1145\/3127590","type":"journal-article","created":{"date-parts":[[2017,9,15]],"date-time":"2017-09-15T12:20:54Z","timestamp":1505478054000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Mimebot\u2014Investigating the Expressibility of Non-Verbal Communication Across Agent Embodiments"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7801-7617","authenticated-orcid":false,"given":"Simon","family":"Alexanderson","sequence":"first","affiliation":[{"name":"KTH - Speech, Music and Hearing, Stockholm, Sweden"}]},{"given":"Carol","family":"O\u2019sullivan","sequence":"additional","affiliation":[{"name":"Trinity College Dublin, Dublin, Ireland"}]},{"given":"Michael","family":"Neff","sequence":"additional","affiliation":[{"name":"University of California, Davis"}]},{"given":"Jonas","family":"Beskow","sequence":"additional","affiliation":[{"name":"KTH - Speech, Music and Hearing, Stockholm, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2017,9,14]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994258.2994264"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1068\/p5096"},{"volume-title":"A Dictionary of Theatre Anthropology: The Secret Art of The Performer","author":"Barba Eugenio","key":"e_1_2_2_3_1","unstructured":"Eugenio Barba . 1991. Theatre anthropolgoy . In A Dictionary of Theatre Anthropology: The Secret Art of The Performer , Eugenio Barba and Nicola Savarese (Eds.). Routledge , London . Eugenio Barba. 1991. Theatre anthropolgoy. In A Dictionary of Theatre Anthropology: The Secret Art of The Performer, Eugenio Barba and Nicola Savarese (Eds.). Routledge, London."},{"key":"e_1_2_2_4_1","volume-title":"Proceedings of the Workshop on Virtual Reality Interaction and Physical Simulation is a Computer Science (VRIPHYS\u201911)","author":"Baumann Jan","year":"2011","unstructured":"Jan Baumann , Bj\u00f6rn Kr\u00fcger , Arno Zinke , and Andreas Weber . 2011 . Data-driven completion of motion capture data . In Proceedings of the Workshop on Virtual Reality Interaction and Physical Simulation is a Computer Science (VRIPHYS\u201911) . 111--118. Jan Baumann, Bj\u00f6rn Kr\u00fcger, Arno Zinke, and Andreas Weber. 2011. Data-driven completion of motion capture data. In Proceedings of the Workshop on Virtual Reality Interaction and Physical Simulation is a Computer Science (VRIPHYS\u201911). 111--118."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2133366.2133368"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1067860.1067867"},{"key":"e_1_2_2_7_1","volume-title":"Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems--Volume 3. International Foundation for Autonomous Agents and Multiagent Systems, 937--944","author":"de Melo Celso M.","year":"2011","unstructured":"Celso M. de Melo , Peter Carnevale , and Jonathan Gratch . 2011 . The effect of expression of anger and happiness in computer agents on negotiations with humans . In Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems--Volume 3. International Foundation for Autonomous Agents and Multiagent Systems, 937--944 . Celso M. de Melo, Peter Carnevale, and Jonathan Gratch. 2011. The effect of expression of anger and happiness in computer agents on negotiations with humans. In Proceedings of the 10th International Conference on Autonomous Agents and Multiagent Systems--Volume 3. International Foundation for Autonomous Agents and Multiagent Systems, 937--944."},{"volume-title":"The Mime. Robert Speller and Sons","author":"Dorcy Jean","key":"e_1_2_2_8_1","unstructured":"Jean Dorcy . 1961. The Mime. Robert Speller and Sons , Publishers, Inc. ( Translated by Robert Speeler, Jr. and Pierre de Fontnouvelle.) Jean Dorcy. 1961. The Mime. Robert Speller and Sons, Publishers, Inc. (Translated by Robert Speeler, Jr. and Pierre de Fontnouvelle.)"},{"key":"e_1_2_2_9_1","volume-title":"An argument for basic emotions. Cognition 8 Emotion 6, 3--4","author":"Ekman Paul","year":"1992","unstructured":"Paul Ekman . 1992. An argument for basic emotions. Cognition 8 Emotion 6, 3--4 ( 1992 ), 169--200. Paul Ekman. 1992. An argument for basic emotions. Cognition 8 Emotion 6, 3--4 (1992), 169--200."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360690"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157813"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2011.6005263"},{"volume-title":"Proceedings of the 2013 10th IEEE International Conference and Workshops onAutomatic Face and Gesture Recognition (FG\u201913)","author":"Hyde Jennifer","key":"e_1_2_2_13_1","unstructured":"Jennifer Hyde , Elizabeth J. Carter , Sara Kiesler , and Jessica K. Hodgins . 2013. Perceptual effects of damped and exaggerated facial motion in animated characters . In Proceedings of the 2013 10th IEEE International Conference and Workshops onAutomatic Face and Gesture Recognition (FG\u201913) . IEEE, 1--6. Jennifer Hyde, Elizabeth J. Carter, Sara Kiesler, and Jessica K. Hodgins. 2013. Perceptual effects of damped and exaggerated facial motion in animated characters. In Proceedings of the 2013 10th IEEE International Conference and Workshops onAutomatic Face and Gesture Recognition (FG\u201913). IEEE, 1--6."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03212378"},{"key":"e_1_2_2_15_1","volume-title":"Mime: The Theory and Practice of Expressive Gesture with a Description of Its Historical Development","author":"Lawson Joan","year":"1957","unstructured":"Joan Lawson . 1957 . Mime: The Theory and Practice of Expressive Gesture with a Description of Its Historical Development . Sir Isaac Pitma and Sons Ltd ., London. Joan Lawson. 1957. Mime: The Theory and Practice of Expressive Gesture with a Description of Its Historical Development. Sir Isaac Pitma and Sons Ltd., London."},{"key":"e_1_2_2_16_1","unstructured":"Jacques Lecoq. 2009. The Moving Body (Le Corps Poetique): Teaching Creative Theatre. A8C Black.  Jacques Lecoq. 2009. The Moving Body (Le Corps Poetique): Teaching Creative Theatre. A8C Black."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2008.12.026"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2015.09.008"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394281.1394294"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1577755.1577757"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0507650102"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993188"},{"key":"e_1_2_2_23_1","volume-title":"Stop Staring: Facial Modeling and Animation Done Right","author":"Osipa Jason","year":"2010","unstructured":"Jason Osipa . 2010 . Stop Staring: Facial Modeling and Animation Done Right . John Wiley 8 Sons. Jason Osipa. 2010. Stop Staring: Facial Modeling and Animation Done Right. John Wiley 8 Sons."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0954579405050340"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157689.2157814"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020239"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jml.2005.02.003"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1957656.1957674"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_2_2_30_1","unstructured":"Frank Thomas Ollie Johnston and Frank. Thomas. 1995. The Illusion of Life: Disney Animation. Hyperion New York.  Frank Thomas Ollie Johnston and Frank. Thomas. 1995. The Illusion of Life: Disney Animation. Hyperion New York."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1080\/15534510.2015.1081856"}],"container-title":["ACM Transactions on Applied Perception"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3127590","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3127590","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:00Z","timestamp":1750212660000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3127590"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,14]]},"references-count":31,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,10,31]]}},"alternative-id":["10.1145\/3127590"],"URL":"https:\/\/doi.org\/10.1145\/3127590","relation":{},"ISSN":["1544-3558","1544-3965"],"issn-type":[{"type":"print","value":"1544-3558"},{"type":"electronic","value":"1544-3965"}],"subject":[],"published":{"date-parts":[[2017,9,14]]},"assertion":[{"value":"2017-07-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}