{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T06:35:43Z","timestamp":1775975743919,"version":"3.50.1"},"reference-count":43,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,10,25]],"date-time":"2022-10-25T00:00:00Z","timestamp":1666656000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>In this work, we focus on human-agent interaction where the role of the socially interactive agent is to optimize the amount of information to give to a user. In particular, we developed a dialog manager able to adapt the agent's conversational strategies to the preferences of the user it is interacting with to maximize the user's engagement during the interaction. For this purpose, we train an agent in interaction with a user using the reinforcement learning approach. The engagement of the user is measured using their non-verbal behaviors and turn-taking status. This measured engagement is used in the reward function, which balances the task of the agent (giving information) and its social goal (maintaining the user highly engaged). Agent's dialog acts may have different impact on the user's engagement depending on several factors, such as their personality, interest in the discussion topic, and attitude toward the agent. A subjective study was conducted with 120 participants to measure how third-party observers can perceive the adaptation of our dialog model. The results show that adapting the agent's conversational strategies has an influence on the participants' perception.<\/jats:p>","DOI":"10.3389\/frai.2022.1029340","type":"journal-article","created":{"date-parts":[[2022,10,25]],"date-time":"2022-10-25T08:02:55Z","timestamp":1666684975000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Adapting conversational strategies in information-giving human-agent interaction"],"prefix":"10.3389","volume":"5","author":[{"given":"Lucie","family":"Galland","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Catherine","family":"Pelachaud","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florian","family":"Pecune","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2022,10,25]]},"reference":[{"key":"B1","first-page":"7","article-title":"A study of gestural feedback expressions,","volume-title":"First Nordic Symposium on Multimodal Communication","author":"Allwood","year":"2003"},{"key":"B2","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1080\/02134748.2015.1065084","article-title":"Measuring warmth and competence at inter-group, interpersonal and individual levels\/medici\u00f3n de la cordialidad y la competencia en los niveles intergrupal, interindividual e individual","volume":"30","author":"Aragon\u00e9s","year":"2015","journal-title":"Rev. Psicol. Soc"},{"key":"B3","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1145\/3136755.3136779","article-title":"Analyzing first impressions of warmth and competence from observable nonverbal cues in expert-novice interactions,","volume-title":"Proceedings of the 19th ACM International Conference on Multimodal Interaction","author":"Biancardi","year":"2017"},{"key":"B4","doi-asserted-by":"publisher","first-page":"93","DOI":"10.3389\/frobt.2019.00093","article-title":"Managing an agent's self-presentational strategies during an interaction","volume":"6","author":"Biancardi","year":"","journal-title":"Front. Robot. AI"},{"key":"B5","first-page":"1","article-title":"A computational model for managing impressions of an embodied conversational agent in real-time,","volume-title":"2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)","author":"Biancardi","year":""},{"key":"B6","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1145\/3136755.3136780","article-title":"The Noxi database: multimodal recordings of mediated novice-expert interactions,","volume-title":"Proceedings of the 19th ACM International Conference on Multimodal Interaction","author":"Cafaro","year":"2017"},{"key":"B7","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1609\/aimag.v22i4.1593","article-title":"Embodied conversational agents: representation and intelligence in user interfaces","volume":"22","author":"Cassell","year":"2001","journal-title":"AI Mag"},{"key":"B8","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1145\/1647314.1647336","article-title":"Detecting user engagement with a robot companion using task and social interaction-based features,","volume-title":"Proceedings of the 2009 International Conference on Multimodal Interfaces","author":"Castellano","year":"2009"},{"key":"B9","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1145\/3340555.3353765","article-title":"Engagement modeling in dyadic interaction,","volume-title":"2019 International Conference on Multimodal Interaction","author":"Dermouche","year":"2019"},{"key":"B10","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.tics.2006.11.005","article-title":"Universal dimensions of social cognition: Warmth and competence","volume":"11","author":"Fiske","year":"2007","journal-title":"Trends Cogn. Sci"},{"key":"B11","first-page":"103","article-title":"Learning dialogue strategies from older and younger simulated users,","volume-title":"Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue","author":"Georgila","year":"2010"},{"key":"B12","first-page":"33","article-title":"User engagement and preferences in information-giving chat with virtual agents,","volume-title":"Workshop on Engagement in Social Intelligent Virtual Agents (ESIVA)","author":"Glas","year":"2015"},{"key":"B13","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1016\/j.ijhcs.2018.07.007","article-title":"Topic management for an engaging conversational agent","volume":"120","author":"Glas","year":"2018","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B14","doi-asserted-by":"crossref","DOI":"10.1609\/aaai.v30i1.9914","article-title":"Affective personalization of a social robot tutor for children's second language skills,","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 30","author":"Gordon","year":"2016"},{"key":"B15","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1145\/3472306.3478368","article-title":"Generation of multimodal behaviors in the Greta platform,","volume-title":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents","author":"Grimaldi","year":"2021"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"B17","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1145\/3267851.3267916","article-title":"A user simulator architecture for socially-aware conversational agents,","volume-title":"Proceedings of the 18th International Conference on Intelligent Virtual Agents","author":"Jain","year":"2018"},{"key":"B18","first-page":"135","article-title":"Modelling empathy in social robotic companions,","volume-title":"International Conference on User Modeling, Adaptation, and Personalization","author":"Leite","year":"2011"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1127","article-title":"Deep reinforcement learning for dialogue generation","author":"Li","year":"2016","journal-title":"arXiv preprint arXiv:1606.01541"},{"key":"B20","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1145\/3477322.3477336","article-title":"Culture for socially interactive agents,","volume-title":"The Handbook on Socially Interactive Agents: 20 years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics Volume 1: Methods, Behavior, Cognition","author":"Lugrin","year":"2021"},{"key":"B21","unstructured":"MalikB.\n          DialogTah - PyPi2022"},{"key":"B22","first-page":"1","article-title":"The structure of emotions: a nonlinear dynamic systems approach,","volume-title":"Emotions: Currrent Issues and Future Directions","author":"Mayne","year":"2001"},{"key":"B23","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1007\/s10618-012-0295-5","article-title":"Training and assessing classification rules with imbalanced data","volume":"28","author":"Menardi","year":"2014","journal-title":"Data Mining Knowl. Discov"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1312.5602","article-title":"Playing atari with deep reinforcement learning","author":"Mnih","year":"2013","journal-title":"arXiv preprint arXiv:1312.5602"},{"key":"B25","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/1719970.1719990","article-title":"Estimating user's engagement from eye-gaze behaviors in human-agent conversations,","volume-title":"Proceedings of the 15th International Conference on Intelligent User Interfaces","author":"Nakano","year":"2010"},{"key":"B26","doi-asserted-by":"publisher","first-page":"938","DOI":"10.1002\/asi.20801","article-title":"What is user engagement? A conceptual framework for defining user engagement with technology","volume":"59","author":"O'Brien","year":"2008","journal-title":"J. Assoc. Inf. Sci. Technol"},{"key":"B27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3383652.3423877","article-title":"A framework to co-optimize task and social dialogue policies using reinforcement learning,","volume-title":"Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents","author":"Pecune","year":"2020"},{"key":"B28","volume-title":"Mind, Hands, Face and Body: A Goal and Belief View of Multimodal Communication","author":"Poggi","year":"2007"},{"key":"B29","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1007\/978-3-642-33197-8_34","article-title":"Using collaborative discourse theory to partially automate dialogue tree authoring,","volume-title":"International Conference on Intelligent Virtual Agents","author":"Rich","year":"2012"},{"key":"B30","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1145\/1957656.1957781","article-title":"Automatic analysis of affective postures and body motion to detect engagement with a game companion,","volume-title":"Proceedings of the 6th International Conference on Human-Robot Interaction","author":"Sanghvi","year":"2011"},{"key":"B31","first-page":"149","article-title":"Agenda-based user simulation for bootstrapping a pomdp dialogue system,","volume-title":"Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers","author":"Schatzmann","year":"2007"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1140","article-title":"Sentiment adaptive end-to-end dialog systems","author":"Shi","year":"2018","journal-title":"arXiv preprint arXiv:1804.10731"},{"key":"B33","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1109\/ICMI.2002.1166980","article-title":"Human-robot interaction: engagement between humans and robots for hosting activities,","author":"Sidner","year":"2002","journal-title":"Proceedings Fourth IEEE International Conference on Multimodal Interfaces"},{"key":"B34","doi-asserted-by":"publisher","first-page":"1929","DOI":"10.5555\/2627435.2670313","article-title":"Dropout: a simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res"},{"key":"B35","first-page":"98","article-title":"Dialog act modeling for conversational speech,","author":"Stolcke","year":"1998","journal-title":"AAAI Spring Symposium on Applying Machine Learning to Discourse Processing"},{"key":"B36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/0261927X9091001","article-title":"Multiple goals in discourse: an overview of issues","volume":"9","author":"Tracy","year":"1990","journal-title":"J. Lang. Soc. Psychol"},{"key":"B37","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/978-3-642-33197-8_25","article-title":"ADA and grace: direct interaction with museum visitors,","author":"Traum","year":"2012","journal-title":"International Conference on Intelligent Virtual Agents"},{"key":"B38","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1613\/jair.713","article-title":"An application of reinforcement learning to dialogue strategy selection in a spoken dialogue system for email","volume":"12","author":"Walker","year":"2000","journal-title":"J. Artif. Intell. Res"},{"key":"B39","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1145\/3242969.3242976","article-title":"How to shape the humor of a robot-social behavior adaptation based on reinforcement learning,","author":"Weber","year":"2018","journal-title":"Proceedings of the 20th ACM International Conference on Multimodal Interaction"},{"key":"B40","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1037\/0022-0663.91.1.76","article-title":"Social-motivational processes and interpersonal relationships: implications for understanding motivation at school","volume":"91","author":"Wentzel","year":"1999","journal-title":"J. Educ. Psychol"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1505.00853","article-title":"Empirical evaluation of rectified activations in convolutional network","author":"Xu","year":"2015","journal-title":"arXiv preprint arXiv:1505.00853"},{"key":"B42","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1109\/TAFFC.2018.2879512","article-title":"The ordinal nature of emotions: an emerging approach","volume":"12","author":"Yannakakis","year":"2018","journal-title":"IEEE Trans. Affect. Comput"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/589","article-title":"Learning conversational systems that interleave task and non-task content","author":"Yu","year":"2017","journal-title":"arXiv preprint arXiv:1703.00099"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2022.1029340\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,25]],"date-time":"2022-10-25T08:03:43Z","timestamp":1666685023000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2022.1029340\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,25]]},"references-count":43,"alternative-id":["10.3389\/frai.2022.1029340"],"URL":"https:\/\/doi.org\/10.3389\/frai.2022.1029340","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,25]]},"article-number":"1029340"}}