{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:20:07Z","timestamp":1750220407983,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100019125","name":"Sorbonne Universit\u00e9","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100019125","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3481275","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T15:01:58Z","timestamp":1634310118000},"page":"822-826","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Development of an Interactive Human\/Agent Loop using Multimodal Recurrent Neural Networks"],"prefix":"10.1145","author":[{"given":"Jieyeon","family":"Woo","sequence":"first","affiliation":[{"name":"Sorbonne Universit\u00e9, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340555.3353725"},{"key":"e_1_3_2_1_2_1","volume-title":"Style\u2010Controllable Speech\u2010Driven Gesture Synthesis Using Normalising Flows. Computer Graphics Forum 39 (05","author":"Alexanderson Simon","year":"2020","unstructured":"Simon Alexanderson , Gustav Henter , Taras Kucherenko , and Jonas Beskow . 2020. Style\u2010Controllable Speech\u2010Driven Gesture Synthesis Using Normalising Flows. Computer Graphics Forum 39 (05 2020 ), 487\u2013496. https:\/\/doi.org\/10.1111\/cgf.13946 Simon Alexanderson, Gustav Henter, Taras Kucherenko, and Jonas Beskow. 2020. Style\u2010Controllable Speech\u2010Driven Gesture Synthesis Using Normalising Flows. Computer Graphics Forum 39 (05 2020), 487\u2013496. https:\/\/doi.org\/10.1111\/cgf.13946"},{"volume-title":"Bodily communication","author":"Argyle Michael","key":"e_1_3_2_1_3_1","unstructured":"Michael Argyle . 2013. Bodily communication . Routledge . Michael Argyle. 2013. Bodily communication. Routledge."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2016.7477553"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/45.329294"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2019.00073"},{"key":"e_1_3_2_1_7_1","volume-title":"Nonverbal signals. The SAGE handbook of interpersonal communication","author":"Burgoon K","year":"2011","unstructured":"Judee\u00a0 K Burgoon , Laura\u00a0 K Guerrero , and Valerie Manusov . 2011. Nonverbal signals. The SAGE handbook of interpersonal communication ( 2011 ), 239\u2013280. Judee\u00a0K Burgoon, Laura\u00a0K Guerrero, and Valerie Manusov. 2011. Nonverbal signals. The SAGE handbook of interpersonal communication (2011), 239\u2013280."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Angelo Cafaro Johannes Wagner Tobias Baur Soumia Dermouche Mercedes Torres\u00a0Torres Catherine Pelachaud Elisabeth Andre and Michel Valstar. 2017. The NoXi database: multimodal recordings of mediated novice-expert interactions. 350\u2013359. https:\/\/doi.org\/10.1145\/3136755.3136780  Angelo Cafaro Johannes Wagner Tobias Baur Soumia Dermouche Mercedes Torres\u00a0Torres Catherine Pelachaud Elisabeth Andre and Michel Valstar. 2017. The NoXi database: multimodal recordings of mediated novice-expert interactions. 350\u2013359. https:\/\/doi.org\/10.1145\/3136755.3136780","DOI":"10.1145\/3136755.3136780"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00743"},{"key":"e_1_3_2_1_10_1","volume-title":"Finite State Automata and Simple Recurrent Networks. Neural Computation - NECO 1 (09","author":"Cleeremans Axel","year":"1989","unstructured":"Axel Cleeremans , David Servan-Schreiber , and James Mcclelland . 1989. Finite State Automata and Simple Recurrent Networks. Neural Computation - NECO 1 (09 1989 ), 372\u2013381. https:\/\/doi.org\/10.1162\/neco.1989.1.3.372 Axel Cleeremans, David Servan-Schreiber, and James Mcclelland. 1989. Finite State Automata and Simple Recurrent Networks. Neural Computation - NECO 1 (09 1989), 372\u2013381. https:\/\/doi.org\/10.1162\/neco.1989.1.3.372"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2012.12"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"crossref","unstructured":"Soumia Dermouche and Catherine Pelachaud. 2019. Engagement Modeling in Dyadic Interaction. 440\u2013445. https:\/\/doi.org\/10.1145\/3340555.3353765  Soumia Dermouche and Catherine Pelachaud. 2019. Engagement Modeling in Dyadic Interaction. 440\u2013445. https:\/\/doi.org\/10.1145\/3340555.3353765","DOI":"10.1145\/3340555.3353765"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340555.3353758"},{"key":"e_1_3_2_1_14_1","volume-title":"Head motion synthesis from speech using deep neural networks. Multimedia Tools and Applications 74 (07","author":"Ding Chuang","year":"2014","unstructured":"Chuang Ding , Lei Xie , and Pengcheng Zhu . 2014. Head motion synthesis from speech using deep neural networks. Multimedia Tools and Applications 74 (07 2014 ). https:\/\/doi.org\/10.1007\/s11042-014-2156-2 Chuang Ding, Lei Xie, and Pengcheng Zhu. 2014. Head motion synthesis from speech using deep neural networks. Multimedia Tools and Applications 74 (07 2014). https:\/\/doi.org\/10.1007\/s11042-014-2156-2"},{"key":"e_1_3_2_1_15_1","volume-title":"Proceedings of the Annual Meeting of the Cognitive Science Society, Vol.\u00a029","author":"D\u2019Mello S","year":"2007","unstructured":"Sidney\u00a0 S D\u2019Mello , Patrick Chipman , and Art Graesser . 2007 . Posture as a predictor of learner\u2019s affective engagement . In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol.\u00a029 . Sidney\u00a0S D\u2019Mello, Patrick Chipman, and Art Graesser. 2007. Posture as a predictor of learner\u2019s affective engagement. In Proceedings of the Annual Meeting of the Cognitive Science Society, Vol.\u00a029."},{"key":"e_1_3_2_1_16_1","volume-title":"Measuring facial movement. Environmental psychology and nonverbal behavior 1, 1","author":"Ekman Paul","year":"1976","unstructured":"Paul Ekman and Wallace\u00a0 V Friesen . 1976. Measuring facial movement. Environmental psychology and nonverbal behavior 1, 1 ( 1976 ), 56\u201375. Paul Ekman and Wallace\u00a0V Friesen. 1976. Measuring facial movement. Environmental psychology and nonverbal behavior 1, 1 (1976), 56\u201375."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874246"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2017.8206272"},{"key":"e_1_3_2_1_19_1","volume-title":"A survey of socially interactive robots. Robotics and autonomous systems 42, 3-4","author":"Fong Terrence","year":"2003","unstructured":"Terrence Fong , Illah Nourbakhsh , and Kerstin Dautenhahn . 2003. A survey of socially interactive robots. Robotics and autonomous systems 42, 3-4 ( 2003 ), 143\u2013166. Terrence Fong, Illah Nourbakhsh, and Kerstin Dautenhahn. 2003. A survey of socially interactive robots. Robotics and autonomous systems 42, 3-4 (2003), 143\u2013166."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00361"},{"key":"e_1_3_2_1_21_1","volume-title":"Proceedings of the 27th International Conference on Neural Information Processing Systems -","volume":"2","author":"Goodfellow J.","year":"2014","unstructured":"Ian\u00a0 J. Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative Adversarial Nets . In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2 (Montreal, Canada) (NIPS\u201914). MIT Press, Cambridge, MA, USA, 2672\u20132680. Ian\u00a0J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Proceedings of the 27th International Conference on Neural Information Processing Systems - Volume 2 (Montreal, Canada) (NIPS\u201914). MIT Press, Cambridge, MA, USA, 2672\u20132680."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.042"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267851.3267878"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417836"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383652.3423911"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073658"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10458-009-9092-y"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719990"},{"key":"e_1_3_2_1_29_1","volume-title":"Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 2 2, 1399\u20131400","author":"Niewiadomski Radoslaw","year":"2009","unstructured":"Radoslaw Niewiadomski , Elisabetta Bevacqua , Maurizio Mancini , and Catherine Pelachaud . 2009 . Greta: An interactive expressive ECA system . Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 2 2, 1399\u20131400 . https:\/\/doi.org\/10.1145\/1558109.1558314 Radoslaw Niewiadomski, Elisabetta Bevacqua, Maurizio Mancini, and Catherine Pelachaud. 2009. Greta: An interactive expressive ECA system. Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems-Volume 2 2, 1399\u20131400. https:\/\/doi.org\/10.1145\/1558109.1558314"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"crossref","unstructured":"Ryota Nishimura Norihide Kitaoka and Seiji Nakagawa. 2007. A Spoken Dialog System for Chat-Like Conversations Considering Response Timing Vol.\u00a04629. 599\u2013606. https:\/\/doi.org\/10.1007\/978-3-540-74628-7_77  Ryota Nishimura Norihide Kitaoka and Seiji Nakagawa. 2007. A Spoken Dialog System for Chat-Like Conversations Considering Response Timing Vol.\u00a04629. 599\u2013606. https:\/\/doi.org\/10.1007\/978-3-540-74628-7_77","DOI":"10.1007\/978-3-540-74628-7_77"},{"key":"e_1_3_2_1_31_1","volume-title":"Toward a Mechanistic Psychology of Dialogue. The Behavioral and brain sciences 27 (05","author":"Pickering Martin","year":"2004","unstructured":"Martin Pickering and Simon Garrod . 2004. Toward a Mechanistic Psychology of Dialogue. The Behavioral and brain sciences 27 (05 2004 ), 169\u201390; discussion 190. https:\/\/doi.org\/10.1017\/S0140525X04000056 Martin Pickering and Simon Garrod. 2004. Toward a Mechanistic Psychology of Dialogue. The Behavioral and brain sciences 27 (05 2004), 169\u201390; discussion 190. https:\/\/doi.org\/10.1017\/S0140525X04000056"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Shyam\u00a0Sundar Rajagopalan Louis-Philippe Morency Tadas Baltrus\u0306aitis and Roland Goecke. 2016. Extending Long Short-Term Memory for Multi-View Structured Learning Vol.\u00a09911. 338\u2013353. https:\/\/doi.org\/10.1007\/978-3-319-46478-7_21  Shyam\u00a0Sundar Rajagopalan Louis-Philippe Morency Tadas Baltrus\u0306aitis and Roland Goecke. 2016. Extending Long Short-Term Memory for Multi-View Structured Learning Vol.\u00a09911. 338\u2013353. https:\/\/doi.org\/10.1007\/978-3-319-46478-7_21","DOI":"10.1007\/978-3-319-46478-7_21"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40415-3_23"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2018.8461967"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2010-59"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2316163"},{"key":"e_1_3_2_1_37_1","volume-title":"Robust and Adaptive Online Time Series Prediction with Long Short-Term Memory. Computational Intelligence and Neuroscience 2017 (12","author":"Yang Haimin","year":"2017","unstructured":"Haimin Yang , Zhisong Pan , and Qing Tao . 2017. Robust and Adaptive Online Time Series Prediction with Long Short-Term Memory. Computational Intelligence and Neuroscience 2017 (12 2017 ), 1\u20139. https:\/\/doi.org\/10.1155\/2017\/9478952 Haimin Yang, Zhisong Pan, and Qing Tao. 2017. Robust and Adaptive Online Time Series Prediction with Long Short-Term Memory. Computational Intelligence and Neuroscience 2017 (12 2017), 1\u20139. https:\/\/doi.org\/10.1155\/2017\/9478952"},{"key":"e_1_3_2_1_38_1","volume-title":"Memory Fusion Network for Multi-view Sequential Learning. (02","author":"Zadeh Amir","year":"2018","unstructured":"Amir Zadeh , Paul Liang , Navonil Mazumder , Soujanya Poria , Erik Cambria , and Louis-Philippe Morency . 2018. Memory Fusion Network for Multi-view Sequential Learning. (02 2018 ). Amir Zadeh, Paul Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2018. Memory Fusion Network for Multi-view Sequential Learning. (02 2018)."}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Montr\u00e9al QC Canada","acronym":"ICMI '21"},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481275","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3481275","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:19:01Z","timestamp":1750191541000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481275"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":38,"alternative-id":["10.1145\/3462244.3481275","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3481275","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}