{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T10:29:31Z","timestamp":1782296971340,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445708","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T02:46:03Z","timestamp":1620441963000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":39,"title":["Understanding Conversational and Expressive Style in a Multimodal Embodied Conversational Agent"],"prefix":"10.1145","author":[{"given":"Deepali","family":"Aneja","sequence":"first","affiliation":[{"name":"Adobe Research, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rens","family":"Hoegen","sequence":"additional","affiliation":[{"name":"University of Southern California, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"McDuff","sequence":"additional","affiliation":[{"name":"Microsoft Research, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mary","family":"Czerwinski","sequence":"additional","affiliation":[{"name":"Microsoft Research, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340555.3353744"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-008-0001-3"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12559-014-9261-4"},{"key":"e_1_3_2_2_4_1","volume-title":"Proc. AAAI Fall Symposium on Socially Intelligent Agents.","author":"Bickmore Timothy","year":"2000","unstructured":"Timothy Bickmore and Justine Cassell . 2000 . how about this weather? social dialogue with embodied conversational agents . In Proc. AAAI Fall Symposium on Socially Intelligent Agents. Timothy Bickmore and Justine Cassell. 2000. how about this weather? social dialogue with embodied conversational agents. In Proc. AAAI Fall Symposium on Socially Intelligent Agents."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365304"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3136755.3143021"},{"key":"e_1_3_2_2_7_1","unstructured":"Daniel\u00a0C Burnett Mark\u00a0R Walker and Andrew Hunt. 2004. Speech synthesis markup language (ssml) version 1.0. W3C recommendation 7(2004).  Daniel\u00a0C Burnett Mark\u00a0R Walker and Andrew Hunt. 2004. Speech synthesis markup language (ssml) version 1.0. W3C recommendation 7(2004)."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/332051.332075"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"crossref","unstructured":"Justine Cauell Tim Bickmore Lee Campbell and Hannes Vilhj\u00e1lmsson. 2000. Designing embodied conversational agents. Embodied conversational agents(2000) 29\u201363.  Justine Cauell Tim Bickmore Lee Campbell and Hannes Vilhj\u00e1lmsson. 2000. Designing embodied conversational agents. Embodied conversational agents(2000) 29\u201363.","DOI":"10.7551\/mitpress\/2697.003.0004"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2332471"},{"key":"e_1_3_2_2_11_1","volume-title":"Handbook of the International Phonetic Association: A guide to the use of the International Phonetic Alphabet","author":"M Decker","unstructured":"Donald\u00a0 M Decker 1999. Handbook of the International Phonetic Association: A guide to the use of the International Phonetic Alphabet . Cambridge University Press . Donald\u00a0M Decker 1999. Handbook of the International Phonetic Association: A guide to the use of the International Phonetic Alphabet. Cambridge University Press."},{"key":"e_1_3_2_2_12_1","volume-title":"Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061\u20131068","author":"DeVault David","year":"2014","unstructured":"David DeVault , Ron Artstein , Grace Benn , Teresa Dey , Ed Fast , Alesia Gainer , Kallirroi Georgila , Jon Gratch , Arno Hartholt , Margaux Lhommet , 2014 . SimSensei Kiosk: A virtual human interviewer for healthcare decision support . In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061\u20131068 . David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, 2014. SimSensei Kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061\u20131068."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925984"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Kathleen\u00a0Kara Fitzpatrick Alison Darcy and Molly Vierhile. 2017. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR mental health 4 2 (2017).  Kathleen\u00a0Kara Fitzpatrick Alison Darcy and Molly Vierhile. 2017. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR mental health 4 2 (2017).","DOI":"10.2196\/mental.7785"},{"key":"e_1_3_2_2_15_1","volume-title":"EMFACS-7: Emotional facial action coding system. Unpublished manuscript","author":"Friesen V","year":"1983","unstructured":"Wallace\u00a0 V Friesen , Paul Ekman , 1983. EMFACS-7: Emotional facial action coding system. Unpublished manuscript , University of California at San Francisco 2, 36( 1983 ), 1. Wallace\u00a0V Friesen, Paul Ekman, 1983. EMFACS-7: Emotional facial action coding system. Unpublished manuscript, University of California at San Francisco 2, 36(1983), 1."},{"key":"e_1_3_2_2_16_1","unstructured":"Epic Games. 2007. Unreal engine. Online: https:\/\/www. unrealengine. com(2007).  Epic Games. 2007. Unreal engine. Online: https:\/\/www. unrealengine. com(2007)."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2008.79"},{"key":"e_1_3_2_2_18_1","volume-title":"Advances in psychology. Vol.\u00a052","author":"Hart G","unstructured":"Sandra\u00a0 G Hart and Lowell\u00a0 E Staveland . 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research . In Advances in psychology. Vol.\u00a052 . Elsevier , 139\u2013183. Sandra\u00a0G Hart and Lowell\u00a0E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol.\u00a052. Elsevier, 139\u2013183."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8760(00)00161-6"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308532.3329473"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493502"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2006.1659988"},{"key":"e_1_3_2_2_23_1","volume-title":"Hello Harlie: Enabling Speech Monitoring Through Chat-Bot Conversations.Studies in health technology and informatics 227","author":"Ireland David","year":"2016","unstructured":"David Ireland , Christina Atay , Jacki Liddle , Dana Bradford , Helen Lee , Olivia Rushin , Thomas Mullins , Dan Angus , Janet Wiles , Simon McBride , 2016 . Hello Harlie: Enabling Speech Monitoring Through Chat-Bot Conversations.Studies in health technology and informatics 227 (2016), 55\u201360. David Ireland, Christina Atay, Jacki Liddle, Dana Bradford, Helen Lee, Olivia Rushin, Thomas Mullins, Dan Angus, Janet Wiles, Simon McBride, 2016. Hello Harlie: Enabling Speech Monitoring Through Chat-Bot Conversations.Studies in health technology and informatics 227 (2016), 55\u201360."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocy072"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Rivka Levitan Stefan Benus Ramiro\u00a0H G\u00e1lvez Agust\u00edn Gravano Florencia Savoretti Marian Trnka Andreas Weise and Julia Hirschberg. 2016. Implementing Acoustic-Prosodic Entrainment in a Conversational Avatar.. In INTERSPEECH Vol.\u00a016. 1166\u20131170.  Rivka Levitan Stefan Benus Ramiro\u00a0H G\u00e1lvez Agust\u00edn Gravano Florencia Savoretti Marian Trnka Andreas Weise and Julia Hirschberg. 2016. Implementing Acoustic-Prosodic Entrainment in a Conversational Avatar.. In INTERSPEECH Vol.\u00a016. 1166\u20131170.","DOI":"10.21437\/Interspeech.2016-985"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3628"},{"key":"e_1_3_2_2_27_1","volume-title":"Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA internal medicine 176, 5","author":"Miner S","year":"2016","unstructured":"Adam\u00a0 S Miner , Arnold Milstein , Stephen Schueller , Roshini Hegde , Christina Mangurian , and Eleni Linos . 2016. Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA internal medicine 176, 5 ( 2016 ), 619\u2013625. Adam\u00a0S Miner, Arnold Milstein, Stephen Schueller, Roshini Hegde, Christina Mangurian, and Eleni Linos. 2016. Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA internal medicine 176, 5 (2016), 619\u2013625."},{"key":"e_1_3_2_2_28_1","volume-title":"Proceedings of the Annual Meeting of the Cognitive Science Society, Vol.\u00a023","author":"Ono Tetsuo","year":"2001","unstructured":"Tetsuo Ono , Michita Imai , and Hiroshi Ishiguro . 2001 . A model of embodied communications with gestures between human and robots . In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol.\u00a023 . Tetsuo Ono, Michita Imai, and Hiroshi Ishiguro. 2001. A model of embodied communications with gestures between human and robots. In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol.\u00a023."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1038\/srep42656"},{"key":"e_1_3_2_2_30_1","volume-title":"Multimodal intelligent information presentation","author":"Poggi Isabella","unstructured":"Isabella Poggi , Catherine Pelachaud , Fiorella de Rosis , Valeria Carofiglio , and Berardina De\u00a0Carolis . 2005. Greta. a believable embodied conversational agent . In Multimodal intelligent information presentation . Springer , 3\u201325. Isabella Poggi, Catherine Pelachaud, Fiorella de Rosis, Valeria Carofiglio, and Berardina De\u00a0Carolis. 2005. Greta. a believable embodied conversational agent. In Multimodal intelligent information presentation. Springer, 3\u201325."},{"key":"e_1_3_2_2_31_1","volume-title":"Workshop on Affective Interaction in Natural Environments (AFFINE) at the International ACM Conference on Multimodal Interfaces (ICMI 08)","author":"Riek D","year":"2008","unstructured":"Laurel\u00a0 D Riek and Peter Robinson . 2008 . Real-time empathy: Facial mimicry on a robot . In Workshop on Affective Interaction in Natural Environments (AFFINE) at the International ACM Conference on Multimodal Interfaces (ICMI 08) . ACM. Citeseer. Laurel\u00a0D Riek and Peter Robinson. 2008. Real-time empathy: Facial mimicry on a robot. In Workshop on Affective Interaction in Natural Environments (AFFINE) at the International ACM Conference on Multimodal Interfaces (ICMI 08). ACM. Citeseer."},{"key":"e_1_3_2_2_32_1","volume-title":"The contribution of kinesic illustrators toward the comprehension of verbal behavior within utterances. Human communication research 5, 1","author":"Rogers T","year":"1978","unstructured":"William\u00a0 T Rogers . 1978. The contribution of kinesic illustrators toward the comprehension of verbal behavior within utterances. Human communication research 5, 1 ( 1978 ), 54\u201362. William\u00a0T Rogers. 1978. The contribution of kinesic illustrators toward the comprehension of verbal behavior within utterances. Human communication research 5, 1 (1978), 54\u201362."},{"key":"e_1_3_2_2_33_1","volume-title":"The Social Nature of Emotion Expression","author":"Rychlowska Magdalena","unstructured":"Magdalena Rychlowska , Antony\u00a0 SR Manstead , and Job van\u00a0der Schalk . 2019. The Many Faces of Smiles . In The Social Nature of Emotion Expression . Springer , 227\u2013245. Magdalena Rychlowska, Antony\u00a0SR Manstead, and Job van\u00a0der Schalk. 2019. The Many Faces of Smiles. In The Social Nature of Emotion Expression. Springer, 227\u2013245."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518783"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460608"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21669-5_22"},{"key":"e_1_3_2_2_37_1","volume-title":"Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In Field and service robotics","author":"Shah Shital","year":"2018","unstructured":"Shital Shah , Debadeepta Dey , Chris Lovett , and Ashish Kapoor . 2018 . Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In Field and service robotics . Springer , 621\u2013635. Shital Shah, Debadeepta Dey, Chris Lovett, and Ashish Kapoor. 2018. Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In Field and service robotics. Springer, 621\u2013635."},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47665-0_4"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-47665-0_4"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1020"},{"key":"e_1_3_2_2_41_1","volume-title":"Interactive Session at the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN","author":"Strupka Eszter","year":"2016","unstructured":"Eszter Strupka , Oliver Niebuhr , and Kerstin Fischer . 2016. Influence of robot gender and speaker gender on prosodic entrainment in HRI . In Interactive Session at the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016 ), New York City . Eszter Strupka, Oliver Niebuhr, and Kerstin Fischer. 2016. Influence of robot gender and speaker gender on prosodic entrainment in HRI. In Interactive Session at the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016), New York City."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/JTEHM.2017.2752152"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0182151"},{"key":"e_1_3_2_2_44_1","volume-title":"Psycholinguistic models of production, Hans\u00a0W Dechert and Manfred Raupach (Eds.)","author":"Tannen Deborah","unstructured":"Deborah Tannen . 1987. Conversational style . In Psycholinguistic models of production, Hans\u00a0W Dechert and Manfred Raupach (Eds.) . Ablex , Norwood, NJ . Deborah Tannen. 1987. Conversational style. In Psycholinguistic models of production, Hans\u00a0W Dechert and Manfred Raupach (Eds.). Ablex, Norwood, NJ."},{"key":"e_1_3_2_2_45_1","volume-title":"Conversational style: Analyzing talk among friends (new ed.)","author":"Tannen Deborah","unstructured":"Deborah Tannen . 2005. Conversational style: Analyzing talk among friends (new ed.) . Oxford University Press , New York . Deborah Tannen. 2005. Conversational style: Analyzing talk among friends (new ed.). Oxford University Press, New York."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3176349.3176388"}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445708","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445708","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:47Z","timestamp":1750195487000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445708"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":46,"alternative-id":["10.1145\/3411764.3445708","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445708","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}