{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T02:34:25Z","timestamp":1768012465797,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T00:00:00Z","timestamp":1603065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,20]]},"DOI":"10.1145\/3383652.3423877","type":"proceedings-article","created":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T22:10:31Z","timestamp":1603145431000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["A framework to co-optimize task and social dialogue policies using Reinforcement Learning"],"prefix":"10.1145","author":[{"given":"Florian","family":"Pecune","sequence":"first","affiliation":[{"name":"University of Glasgow"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stacy","family":"Marsella","sequence":"additional","affiliation":[{"name":"University of Glasgow"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alankar","family":"Jain","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,19]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2010.11.006"},{"key":"e_1_3_2_2_2_1","volume-title":"Laura M Pfeifer Vardoulakis, and Daniel Schulman","author":"Bickmore Timothy W","year":"2013","unstructured":"Timothy W Bickmore , Laura M Pfeifer Vardoulakis, and Daniel Schulman . 2013 . Tinker: a relational agent museum guide. Autonomous agents and multi-agent systems 27, 2 (2013), 254--276. Timothy W Bickmore, Laura M Pfeifer Vardoulakis, and Daniel Schulman. 2013. Tinker: a relational agent museum guide. Autonomous agents and multi-agent systems 27, 2 (2013), 254--276."},{"key":"e_1_3_2_2_3_1","volume-title":"Negotiated collusion: Modeling social language and its relationship effects in intelligent agents. User modeling and user-adapted interaction 13, 1-2","author":"Cassell Justine","year":"2003","unstructured":"Justine Cassell and Timothy Bickmore . 2003. Negotiated collusion: Modeling social language and its relationship effects in intelligent agents. User modeling and user-adapted interaction 13, 1-2 ( 2003 ), 89--132. Justine Cassell and Timothy Bickmore. 2003. Negotiated collusion: Modeling social language and its relationship effects in intelligent agents. User modeling and user-adapted interaction 13, 1-2 (2003), 89--132."},{"key":"e_1_3_2_2_4_1","volume-title":"Contributing to discourse. Cognitive science 13, 2","author":"Clark Herbert H","year":"1989","unstructured":"Herbert H Clark and Edward F Schaefer . 1989. Contributing to discourse. Cognitive science 13, 2 ( 1989 ), 259--294. Herbert H Clark and Edward F Schaefer. 1989. Contributing to discourse. Cognitive science 13, 2 (1989), 259--294."},{"key":"e_1_3_2_2_5_1","volume-title":"International conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061--1068","author":"DeVault David","year":"2014","unstructured":"David DeVault , Ron Artstein , Grace Benn , Teresa Dey , Ed Fast , Alesia Gainer , Kallirroi Georgila , Jon Gratch , Arno Hartholt , Margaux Lhommet , 2014 . SimSensei Kiosk: A virtual human interviewer for healthcare decision support . In International conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061--1068 . David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, et al. 2014. SimSensei Kiosk: A virtual human interviewer for healthcare decision support. In International conference on Autonomous agents and multi-agent systems. International Foundation for Autonomous Agents and Multiagent Systems, 1061--1068."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1006\/jesp.1999.1395"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/2794083.2794125"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.5555\/1944506.1944527"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/3016387.3016461"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2008.07-028-R2-05-82"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267851.3267916"},{"key":"e_1_3_2_2_12_1","article-title":"A Survey of Statistical User Simulation Techniques for Reinforcement-Learning of Dialogue Management Strategies","volume":"1","author":"Steve Young Jost Schatzmann Matt Stuttle","year":"2006","unstructured":"Matt Stuttle Steve Young Jost Schatzmann , Karl Weilhammer . 2006 . A Survey of Statistical User Simulation Techniques for Reinforcement-Learning of Dialogue Management Strategies . The Knowledge Engineering Review 1 , 24 (2006). Matt Stuttle Steve Young Jost Schatzmann, Karl Weilhammer. 2006. A Survey of Statistical User Simulation Techniques for Reinforcement-Learning of Dialogue Management Strategies. The Knowledge Engineering Review 1, 24 (2006).","journal-title":"The Knowledge Engineering Review"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3001837"},{"key":"e_1_3_2_2_14_1","unstructured":"Tejas D Kulkarni Karthik Narasimhan Ardavan Saeedi and Josh Tenenbaum. 2016. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. In Advances in neural information processing systems.  Tejas D Kulkarni Karthik Narasimhan Ardavan Saeedi and Josh Tenenbaum. 2016. Hierarchical deep reinforcement learning: Integrating temporal abstraction and intrinsic motivation. In Advances in neural information processing systems."},{"key":"e_1_3_2_2_15_1","volume-title":"Modelling Empathy in Social Robotic Companions. In International Conference on User Modeling, Adaptation, and Personalization.","author":"Leite Iolanda","year":"2011","unstructured":"Iolanda Leite , Andr\u00e9 Pereira , Ginevra Castellano , Samuel Mascarenhas , Carlos Martinho , and Ana Paiva . 2011 . Modelling Empathy in Social Robotic Companions. In International Conference on User Modeling, Adaptation, and Personalization. Iolanda Leite, Andr\u00e9 Pereira, Ginevra Castellano, Samuel Mascarenhas, Carlos Martinho, and Ana Paiva. 2011. Modelling Empathy in Social Robotic Companions. In International Conference on User Modeling, Adaptation, and Personalization."},{"key":"e_1_3_2_2_16_1","volume-title":"Investigation of language understanding impact for reinforcement learning based dialogue systems. arXiv preprint arXiv: 1703.07055","author":"Li Xiujun","year":"2017","unstructured":"Xiujun Li , Yun-Nung Chen , Lihong Li , Jianfeng Gao , and Asli Celikyilmaz . 2017. Investigation of language understanding impact for reinforcement learning based dialogue systems. arXiv preprint arXiv: 1703.07055 ( 2017 ). Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, and Asli Celikyilmaz. 2017. Investigation of language understanding impact for reinforcement learning based dialogue systems. arXiv preprint arXiv: 1703.07055 (2017)."},{"key":"e_1_3_2_2_17_1","volume-title":"Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 1241--1249","author":"Pecune Florian","year":"2018","unstructured":"Florian Pecune , Jingya Chen , Yoichi Matsuyama , and Justine Cassell . 2018 . Field Trial Analysis of Socially Aware Robot Assistant . In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 1241--1249 . Florian Pecune, Jingya Chen, Yoichi Matsuyama, and Justine Cassell. 2018. Field Trial Analysis of Socially Aware Robot Assistant. In Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems. International Foundation for Autonomous Agents and Multiagent Systems, 1241--1249."},{"key":"e_1_3_2_2_18_1","volume-title":"European Conference on Multi-Agent Systems.","author":"Pecune Florian","year":"2013","unstructured":"Florian Pecune , Magalie Ochs , and Catherine Pelachaud . 2013 . A formal model of social relations for artificial companions . In European Conference on Multi-Agent Systems. Florian Pecune, Magalie Ochs, and Catherine Pelachaud. 2013. A formal model of social relations for artificial companions. In European Conference on Multi-Agent Systems."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33197-8_34"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Hannes Ritschel Tobias Baur and Elisabeth Andre: 2017. Adapting a Robot's Linguistic Style Based on Socially-Aware Reinforcement Learning.  Hannes Ritschel Tobias Baur and Elisabeth Andre: 2017. Adapting a Robot's Linguistic Style Based on Socially-Aware Reinforcement Learning.","DOI":"10.1109\/ROMAN.2017.8172330"},{"key":"e_1_3_2_2_21_1","volume-title":"NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American","author":"Schatzmann Jost","unstructured":"Jost Schatzmann , Blaise Thomson , Karl Weilhammer , Hui Ye , and Steve Young . 2007. Agenda-based user simulation for bootstrapping a POMDP dialogue system . In NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers. Association for Computational Linguistics . Jost Schatzmann, Blaise Thomson, Karl Weilhammer, Hui Ye, and Steve Young. 2007. Agenda-based user simulation for bootstrapping a POMDP dialogue system. In NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers. Association for Computational Linguistics."},{"key":"e_1_3_2_2_22_1","volume-title":"Building a Conversational Agent Overnight with Dialogue Self-Play. arXiv preprint arXiv:1801.04871","author":"Shah Pararth","year":"2018","unstructured":"Pararth Shah , Dilek Hakkani-T\u00fcr , Gokhan T\u00fcr , Abhinav Rastogi , Ankur Bapna , Neha Nayak , and Larry Heck . 2018. Building a Conversational Agent Overnight with Dialogue Self-Play. arXiv preprint arXiv:1801.04871 ( 2018 ). Pararth Shah, Dilek Hakkani-T\u00fcr, Gokhan T\u00fcr, Abhinav Rastogi, Ankur Bapna, Neha Nayak, and Larry Heck. 2018. Building a Conversational Agent Overnight with Dialogue Self-Play. arXiv preprint arXiv:1801.04871 (2018)."},{"key":"e_1_3_2_2_23_1","volume-title":"Sentiment Adaptive End-to-End Dialog Systems. arXiv preprint arXiv","author":"Shi Weiyan","year":"1804","unstructured":"Weiyan Shi and Zhou Yu. 2018. Sentiment Adaptive End-to-End Dialog Systems. arXiv preprint arXiv : 1804 .10731 (2018). Weiyan Shi and Zhou Yu. 2018. Sentiment Adaptive End-to-End Dialog Systems. arXiv preprint arXiv: 1804.10731 (2018)."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.1700826"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2823513.2823516"},{"key":"e_1_3_2_2_26_1","volume-title":"AAAI Spring Symposium on Applying Machine Learning to Discourse Processing. 98--105","author":"Stolcke Andreas","year":"1998","unstructured":"Andreas Stolcke , Elizabeth Shriberg , Rebecca Bates , Noah Coccaro , Daniel Juraf-sky, Rachel Martin , Marie Meteer , Klaus Ries , Paul Taylor , Carol Van Ess-Dykema , 1998 . Dialog act modeling for conversational speech . In AAAI Spring Symposium on Applying Machine Learning to Discourse Processing. 98--105 . Andreas Stolcke, Elizabeth Shriberg, Rebecca Bates, Noah Coccaro, Daniel Juraf-sky, Rachel Martin, Marie Meteer, Klaus Ries, Paul Taylor, Carol Van Ess-Dykema, et al. 1998. Dialog act modeling for conversational speech. In AAAI Spring Symposium on Applying Machine Learning to Discourse Processing. 98--105."},{"key":"e_1_3_2_2_27_1","volume-title":"The nature of rapport and its nonverbal correlates. Psychological inquiry 1, 4","author":"Tickle-Degnen Linda","year":"1990","unstructured":"Linda Tickle-Degnen and Robert Rosenthal . 1990. The nature of rapport and its nonverbal correlates. Psychological inquiry 1, 4 ( 1990 ), 285---293. Linda Tickle-Degnen and Robert Rosenthal. 1990. The nature of rapport and its nonverbal correlates. Psychological inquiry 1, 4 (1990), 285---293."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X9091001"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2010-1"},{"key":"e_1_3_2_2_30_1","volume-title":"International Joint Conference on Artificial Intelligence. arXiv:1703","author":"Yu Zhou","unstructured":"Zhou Yu , Alan W Black , and Alexander I. Rudnicky . 2017. Learning Conversational Systems that Interleave Task and Non-Task Content . In International Joint Conference on Artificial Intelligence. arXiv:1703 .00099. Zhou Yu, Alan W Black, and Alexander I. Rudnicky. 2017. Learning Conversational Systems that Interleave Task and Non-Task Content. In International Joint Conference on Artificial Intelligence. arXiv:1703.00099."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-09767-1_62"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-3647"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3237383.3238143"}],"event":{"name":"IVA '20: ACM International Conference on Intelligent Virtual Agents","location":"Virtual Event Scotland UK","acronym":"IVA '20","sponsor":["SIGAI ACM Special Interest Group on Artificial Intelligence"]},"container-title":["Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3383652.3423877","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3383652.3423877","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:57Z","timestamp":1750195917000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3383652.3423877"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,19]]},"references-count":33,"alternative-id":["10.1145\/3383652.3423877","10.1145\/3383652"],"URL":"https:\/\/doi.org\/10.1145\/3383652.3423877","relation":{},"subject":[],"published":{"date-parts":[[2020,10,19]]},"assertion":[{"value":"2020-10-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}