{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T02:05:35Z","timestamp":1774404335301,"version":"3.50.1"},"reference-count":107,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,1,26]],"date-time":"2026-01-26T00:00:00Z","timestamp":1769385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Conversational agents are transforming digital interactions across various domains, including healthcare, education, and customer service, thanks to advances in large language models (LLMs). As these systems become more autonomous and ubiquitous, understanding what constitutes high-quality interaction from a user perspective is increasingly critical. Despite growing empirical research, the field lacks a unified framework for defining, measuring, and designing user-perceived interaction quality in human\u2013artificial intelligence (AI) dialogue. Here, we present an integrative review of 125 empirical studies published between 2017 and 2025, spanning text-, voice-, and LLM-powered systems. Our synthesis identifies three consistent layers of user judgment: a pragmatic core (usability, task effectiveness, and conversational competence), a social\u2013affective layer (social presence, warmth, and synchronicity), and an accountability and inclusion layer (transparency, accessibility, and fairness). These insights are formalised into a four-layer interpretive framework\u2014Capacity, Alignment, Levers, and Outcomes\u2014operationalised via a Capacity \u00d7 Alignment matrix that maps distinct success and failure regimes. It also identifies design levers such as anthropomorphism, role framing, and onboarding strategies. The framework consolidates constructs, positions inclusion and accountability as central to quality, and offers actionable guidance for evaluation and design. This research redefines interaction quality as a dialogic construct, shifting the focus from system performance to co-orchestrated, user-centred dialogue quality.<\/jats:p>","DOI":"10.3390\/make8020028","type":"journal-article","created":{"date-parts":[[2026,1,26]],"date-time":"2026-01-26T12:41:16Z","timestamp":1769431276000},"page":"28","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Assessing Interaction Quality in Human\u2013AI Dialogue: An Integrative Review and Multi-Layer Framework for Conversational Agents"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0236-6159","authenticated-orcid":false,"given":"Luca","family":"Marconi","sequence":"first","affiliation":[{"name":"Department of Informatics, Systems and Communication, University of Milano-Bicocca, Via Sarca 336, 20126 Milan, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2718-5426","authenticated-orcid":false,"given":"Luca","family":"Longo","sequence":"additional","affiliation":[{"name":"The Artificial Intelligence and Cognitive Load Research Lab, University College Cork, College Rd, T12 YN60 Cork, Ireland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4065-3415","authenticated-orcid":false,"given":"Federico","family":"Cabitza","sequence":"additional","affiliation":[{"name":"Department of Informatics, Systems and Communication, University of Milano-Bicocca, Via Sarca 336, 20126 Milan, Italy"},{"name":"IRCCS Ospedale Galeazzi-Sant\u2019Ambrogio, Via Cristina Belgioioso 173, 20157 Milan, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e20346","DOI":"10.2196\/20346","article-title":"The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review","volume":"22","author":"Cock","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"104395","DOI":"10.1016\/j.compedu.2021.104395","article-title":"FAQ chatbot and inclusive learning in massive open online courses","volume":"179","author":"Han","year":"2022","journal-title":"Comput. Educ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102788","DOI":"10.1016\/j.ijhcs.2022.102788","article-title":"Understanding the user experience of customer service chatbots: An experimental study of chatbot interaction design","volume":"161","author":"Haugeland","year":"2022","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e43135","DOI":"10.2196\/43135","article-title":"Evaluating User Experience With a Chatbot Designed as a Public Health Response to the COVID-19 Pandemic in Brazil: Mixed Methods Study","volume":"10","author":"Chagas","year":"2023","journal-title":"JMIR Hum. Factors"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Huang, S.H., Lin, Y.F., He, Z., Huang, C.Y., and Huang, T.H.K. (2024). How Does Conversation Length Impact User\u2019s Satisfaction? A Case Study of Length-Controlled Conversations with LLM-Powered Chatbots. CHI EA \u201924: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 11\u201316 May 2024, Association for Computing Machinery.","DOI":"10.1145\/3613905.3650823"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1906","DOI":"10.1038\/s41562-024-01953-1","article-title":"An empirical investigation of the impact of ChatGPT on creativity","volume":"8","author":"Lee","year":"2024","journal-title":"Nat. Hum. Behav."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.1080\/10447318.2024.2314358","article-title":"Exploring User Adoption of ChatGPT: A Technology Acceptance Model Perspective","volume":"41","author":"Ma","year":"2025","journal-title":"Int. J. Hum.\u2013Comput. Interact."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Porcheron, M., Fischer, J.E., Reeves, S., and Sharples, S. (2018). Voice Interfaces in Everyday Life. CHI \u201918: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Montreal, QC, Canada, 21\u201326 April 2018, Association for Computing Machinery.","DOI":"10.1145\/3173574.3174214"},{"key":"ref_9","unstructured":"Vtyurina, A., Fourney, A., Morris, M.R., Findlater, L., and White, R.W. (2019). VERSE: Bridging Screen Readers and Voice Assistants for Enhanced Eyes-Free Web Search. ASSETS \u201919: Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility, Pittsburgh, PA, USA, 28\u201330 October 2019, Association for Computing Machinery."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s41233-020-00033-2","article-title":"Users\u2019 experiences with chatbots: Findings from a questionnaire study","volume":"5","author":"Brandtzaeg","year":"2020","journal-title":"Qual. User Exp."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1007\/s41233-021-00046-5","article-title":"Investigating the user experience of customer service chatbot interaction: A framework for qualitative analysis of chatbot dialogues","volume":"6","author":"Taylor","year":"2021","journal-title":"Qual. User Exp."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"102240","DOI":"10.1016\/j.tele.2025.102240","article-title":"Trust in AI chatbots: A systematic review","volume":"97","author":"Ng","year":"2025","journal-title":"Telemat. Inform."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"16246","DOI":"10.1038\/s41598-023-41692-3","article-title":"The reputational and ethical consequences of deceptive chatbot use","volume":"13","author":"McGuire","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1007\/s10462-020-09866-x","article-title":"Survey on evaluation methods for dialogue systems","volume":"54","author":"Deriu","year":"2021","journal-title":"Artif. Intell. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2365","DOI":"10.1007\/s10462-022-10229-x","article-title":"Evaluating conversational recommender systems","volume":"56","author":"Jannach","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s00779-021-01582-9","article-title":"The Chatbot Usability Scale: The Design and Pilot of a Usability Scale for Interaction with AI-Based Conversational Agents","volume":"26","author":"Borsci","year":"2022","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_17","first-page":"219","article-title":"Measurement of Perceived Quality in Conversational Systems (Chatbots)","volume":"Volume 1195","author":"Pupo","year":"2025","journal-title":"Computational Intelligence Applied to Decision-Making in Uncertain Environments"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1007\/s12369-020-00680-7","article-title":"The Effect of Design Features on Relationship Quality with Embodied Conversational Agents: A Systematic Review","volume":"12","author":"Loveys","year":"2020","journal-title":"Int. J. Soc. Robot."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s10115-024-02287-0","article-title":"A review on polyadic chatbots: Trends, challenges, and future research directions","volume":"67","author":"Kuhail","year":"2025","journal-title":"Knowl. Inf. Syst."},{"key":"ref_20","first-page":"343","article-title":"Preliminary Results of a Systematic Review: Quality Assessment of Conversational Agents (Chatbots) for People with Disabilities or Special Needs","volume":"Volume 12376","author":"Miesenberger","year":"2020","journal-title":"Computers Helping People with Special Needs. ICCHP 2020"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Namvarpour, M.M., and Razi, A. (2025). The Art of Talking Machines: A Comprehensive Literature Review of Conversational User Interfaces. CUI \u201925: Proceedings of the 7th ACM Conference on Conversational User Interfaces, Waterloo, ON, Canada, 8\u201310 July 2025, Association for Computing Machinery.","DOI":"10.1145\/3719160.3736621"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.jbusres.2019.07.039","article-title":"Literature review as a research methodology: An overview and guidelines","volume":"104","author":"Snyder","year":"2019","journal-title":"J. Bus. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1111\/j.1471-1842.2009.00848.x","article-title":"A typology of reviews: An analysis of 14 review types and associated methodologies","volume":"26","author":"Grant","year":"2009","journal-title":"Health Inf. Libr. J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1177\/1534484305278283","article-title":"Writing Integrative Literature Reviews: Guidelines and Examples","volume":"4","author":"Torraco","year":"2005","journal-title":"Hum. Resour. Dev. Rev."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e16794","DOI":"10.2196\/16794","article-title":"Usability, Acceptability, and Effectiveness of Web-Based Conversational Agents to Facilitate Problem Solving in Older Adults: Controlled Study","volume":"22","author":"Bennion","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jain, M., Kumar, P., Kota, R., and Patel, S.N. (2018). Evaluating and Informing the Design of Chatbots. DIS \u201918: Proceedings of the 2018 Designing Interactive Systems Conference, Hong Kong, China, 17\u201319 August 2018, Association for Computing Machinery.","DOI":"10.1145\/3196709.3196735"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Haas, G., Rietzler, M., Jones, M., and Rukzio, E. (2022). Keep it Short: A Comparison of Voice Assistants\u2019 Response Behavior. CHI \u201922: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April\u20135 May 2022, Association for Computing Machinery.","DOI":"10.1145\/3491102.3517684"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e74032","DOI":"10.2196\/74032","article-title":"DigiBete, a Novel Chatbot to Support Transition to Adult Care of Young People\/Young Adults With Type 1 Diabetes Mellitus: Outcomes From a Prospective, Multimethod, Nonrandomized Feasibility and Acceptability Study","volume":"10","author":"Swallow","year":"2025","journal-title":"JMIR Diabetes"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bruijnes, M., Kesteloo, M., and Brinkman, W.P. (2023). Reducing social diabetes distress with a conversational agent support system: A three-week technology feasibility evaluation. Front. Digit. Health, 5.","DOI":"10.3389\/fdgth.2023.1149374"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1177\/02692155231216615","article-title":"Mixed methods, single case design, feasibility trial of a motivational conversational agent for rehabilitation for adults with traumatic brain injury","volume":"38","author":"Hocking","year":"2024","journal-title":"Clin. Rehabil."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Holmes, S., Moorhead, A., Bond, R., Zheng, H., Coates, V., and McTear, M. (2019). Usability testing of a healthcare chatbot: Can we use conventional methods to assess conversational user interfaces?. ECCE \u201919: Proceedings of the 31st European Conference on Cognitive Ergonomics, Belfast, UK, 10\u201313 September 2019, ACM, Association for Computing Machinery.","DOI":"10.1145\/3335082.3335094"},{"key":"ref_32","first-page":"482","article-title":"A Virtual Assistant in Vaccine Pharmacovigilance: Content and Usability Validation","volume":"41","year":"2023","journal-title":"CIN Comput. Inform. Nurs."},{"key":"ref_33","unstructured":"Toeppe, K., Yan, H., and Chu, S.K.W. (2021). Engagement and Usability of Conversational Search\u2014A Study of a Medical Resource Center Chatbot. Diversity, Divergence, Dialogue, 16th International Conference, iConference 2021, Beijing, China, 17\u201331 March 2021, Springer International Publishing."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1287\/mnsc.46.2.186.11926","article-title":"A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies","volume":"46","author":"Venkatesh","year":"2000","journal-title":"Manag. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1057\/s41599-024-02621-5","article-title":"Not with the bot! The relevance of trust to explain the acceptance of chatbots by insurance customers","volume":"11","year":"2024","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Walker, M., Litman, D., Kamm, C.A., and Abella, A. (1997, January 7\u201312). PARADISE: A framework for evaluating spoken dialogue agents. Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics, Madrid, Spain.","DOI":"10.3115\/976909.979652"},{"key":"ref_37","first-page":"102699","article-title":"Perceived conversational ability of task-based chatbots\u2014Which conversational elements influence the success of text-based dialogues?","volume":"74","author":"Rese","year":"2024","journal-title":"Int. J. Inf. Manag."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ashktorab, Z., Jain, M., Liao, Q.V., and Weisz, J.D. (2019). Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns. CHI \u201919: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Scotland, UK, 4\u20139 May 2019, Association for Computing Machinery.","DOI":"10.1145\/3290605.3300484"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"F\u00f8lstad, A., Araujo, T., Papadopoulos, S., Law, E.L.C., Luger, E., Goodwin, M., Hobert, S., and Brandtzaeg, P.B. (2024). Conversational Repair Strategies to Cope with Errors and Breakdowns in Customer Service Chatbot Conversations. Chatbot Research and Design, 7th International Workshop, CONVERSATIONS 2023, Oslo, Norway, 22\u201323 November 2024, Springer Nature Switzerland.","DOI":"10.1007\/978-3-031-54975-5"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1007\/s12599-022-00755-x","article-title":"Opposing Effects of Response Time in Human\u2013Chatbot Interaction","volume":"64","author":"Gnewuch","year":"2022","journal-title":"Bus. Inf. Syst. Eng."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2862","DOI":"10.1080\/10447318.2023.2175158","article-title":"When Do We Accept Mistakes from Chatbots? The Impact of Human-Like Communication on User Experience in Chatbots That Make Mistakes","volume":"40","author":"Bosse","year":"2024","journal-title":"Int. J. Hum.\u2013Comput. Interact."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"806","DOI":"10.1080\/02642069.2023.2208522","article-title":"How should voice assistants be heard? The mitigating effect of verbal and vocal warmth in voice assistant service failure","volume":"43","author":"Huang","year":"2023","journal-title":"Serv. Ind. J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"e41017","DOI":"10.2196\/41017","article-title":"The Effects of a Health Care Chatbot\u2019s Complexity and Persona on User Trust, Perceived Usability, and Effectiveness: Mixed Methods Study","volume":"10","author":"Biro","year":"2023","journal-title":"JMIR Hum. Factors"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"e55164","DOI":"10.2196\/55164","article-title":"Usability, Engagement, and Report Usefulness of Chatbot-Based Family Health History Data Collection: Mixed Methods Analysis","volume":"26","author":"Nguyen","year":"2024","journal-title":"J. Med. Internet Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"22559","DOI":"10.1038\/s41598-025-06490-z","article-title":"Exploring the varying effects of chatbot service quality dimensions on customer intentions to switch service agents","volume":"15","author":"Chen","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wieland, B., de Wit, J., and de Rooij, A. (2022). Electronic Brainstorming With a Chatbot Partner: A Good Idea Due to Increased Productivity and Idea Diversity. Front. Artif. Intell., 5.","DOI":"10.3389\/frai.2022.880673"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Hwang, A.H.C., and Won, A.S. (2021). IdeaBot: Investigating Social Facilitation in Human-Machine Team Creativity. CHI \u201921: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 8\u201313 May 2021, Association for Computing Machinery.","DOI":"10.1145\/3411764.3445270"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Shaer, O., Cooper, A., Mokryn, O., Kun, A.L., and Ben Shoshan, H. (2024). AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation. CHI \u201924: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 11\u201316 May 2024, Association for Computing Machinery.","DOI":"10.1145\/3613904.3642414"},{"key":"ref_49","unstructured":"Muller, M., Houde, S., Gonzalez, G., Brimijoin, K., Ross, S.I., Moran, D.A.S., and Weisz, J.D. (2024). Group Brainstorming with an AI Agent: Creating and Selecting Ideas. Proceedings of the International Conference on Computational Creativity (ICCC 2024), J\u00f6nk\u00f6ping, Sweden, 17\u201321 June 2024, Association for Computational Creativity."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"13601","DOI":"10.1038\/s41598-023-40858-3","article-title":"Best humans still outperform artificial intelligence in a creative divergent thinking task","volume":"13","author":"Koivisto","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_51","unstructured":"F\u00f8lstad, A., Araujo, T., Papadopoulos, S., Law, E.L.C., Luger, E., Goodwin, M., and Brandtzaeg, P.B. (2021). Understanding the User Experience of Customer Service Chatbots: What Can We Learn from Customer Satisfaction Surveys?. Proceedings of the Chatbot Research and Design, Virtual, 23\u201324 November 2021, Springer International Publishing."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"103059","DOI":"10.1016\/j.jretconser.2022.103059","article-title":"When do AI chatbots lead to higher customer satisfaction than human frontline employees in online shopping assistance? Considering product attribute type","volume":"68","author":"Ruan","year":"2022","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1057\/s41599-024-03212-0","article-title":"How the communication style of chatbots influences consumers\u2019 satisfaction, trust, and engagement in the context of service failure","volume":"11","author":"Cai","year":"2024","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Xu, Y., Zhang, J., and Deng, G. (2022). Enhancing customer satisfaction with chatbots: The influence of communication styles and consumer attachment anxiety. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.902782"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/s41239-022-00362-6","article-title":"The impact of a virtual teaching assistant (chatbot) on students\u2019 learning in Ghanaian higher education","volume":"19","author":"Essel","year":"2022","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"103211","DOI":"10.1016\/j.jretconser.2022.103211","article-title":"Understanding the user satisfaction and loyalty of customer service chatbots","volume":"71","author":"Hsu","year":"2023","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Cristea, A.I., Walker, E., Lu, Y., Santos, O.C., and Isotani, S. (2025). Tutor or Mentor. A Comparative Usability Study of AI Roles in Higher Education. Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium, Blue Sky, and WideAIED, Palermo, Italy, 22\u201326 July 2025, Springer Nature Switzerland.","DOI":"10.1007\/978-3-031-99261-2"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Wenzel, K., Devireddy, N., Davison, C., and Kaufman, G. (2023). Can Voice Assistants Be Microaggressors? Cross-Race Psychological Responses to Failures of Automatic Speech Recognition. CHI \u201923: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany, 23\u201328 April 2023, Association for Computing Machinery.","DOI":"10.1145\/3544548.3581357"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3392846","article-title":"Do Multilingual Users Prefer Chat-bots that Code-mix? Let\u2019s Nudge and Find Out!","volume":"4","author":"Bawa","year":"2020","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"e18431","DOI":"10.2196\/18431","article-title":"Investigating the Accessibility of Voice Assistants With Impaired Users: Mixed Methods Study","volume":"22","author":"Masina","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"e57114","DOI":"10.2196\/57114","article-title":"Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study","volume":"11","author":"Sezgin","year":"2024","journal-title":"JMIR Hum. Factors"},{"key":"ref_62","unstructured":"Degen, H., and Ntoa, S. (2024). Exploring the Impact of Explainability on Trust and Acceptance of Conversational Agents\u2014A Wizard of Oz Study. Proceedings of the Artificial Intelligence in HCI, Washington, DC, USA, 29 June\u20134 July 2024, Springer Nature Switzerland."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1002\/mar.21765","article-title":"Effects of voice assistant recommendations on consumer behavior","volume":"40","author":"Akdim","year":"2023","journal-title":"Psychol. Mark."},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Pycha, A., and Zellou, G. (2024). The influence of accent and device usage on perceived credibility during interactions with voice-AI assistants. Front. Comput. Sci., 6.","DOI":"10.3389\/fcomp.2024.1411414"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"102848","DOI":"10.1016\/j.ijhcs.2022.102848","article-title":"Can we trust a chatbot like a physician? A qualitative study on understanding the emergence of trust toward diagnostic chatbots","volume":"165","author":"Seitz","year":"2022","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"e29386","DOI":"10.2196\/29386","article-title":"The Impact of Explanations on Layperson Trust in Artificial Intelligence\u2013Driven Symptom Checker Apps: Experimental Study","volume":"23","author":"Woodcock","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"107122","DOI":"10.1016\/j.chb.2021.107122","article-title":"Understanding the impact of control levels over emotion-aware chatbots","volume":"129","author":"Benke","year":"2022","journal-title":"Comput. Hum. Behav."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Degachi, C., Tielman, M.L., and Al Owayyed, M. (2023). Trust and Perceived Control in Burnout Support Chatbots. CHI EA \u201923: Proceedings of the Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany, 23\u201328 April 2023, Association for Computing Machinery.","DOI":"10.1145\/3544549.3585780"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1108\/JOSM-10-2020-0380","article-title":"Trust me, I\u2019m a bot\u2013repercussions of chatbot disclosure in different service frontline settings","volume":"33","author":"Mozafari","year":"2021","journal-title":"J. Serv. Manag."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"936","DOI":"10.1287\/isre.2022.0152","article-title":"More Than a Bot? The Impact of Disclosing Human Involvement on Customer Interactions with Hybrid Service Agents","volume":"35","author":"Gnewuch","year":"2024","journal-title":"Inf. Syst. Res."},{"key":"ref_71","first-page":"2007","article-title":"The hedonic\/pragmatic model of user experience","volume":"10","author":"Hassenzahl","year":"2007","journal-title":"Towards UX Manif."},{"key":"ref_72","unstructured":"Blythe, M., and Monk, A. (2018). The Thing and I: Understanding the Relationship Between User and Product. Funology 2: From Usability to Enjoyment, Springer International Publishing."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"103782","DOI":"10.1016\/j.ijhm.2024.103782","article-title":"Enhancing service recovery satisfaction with chatbots: The role of humor and informal language","volume":"120","author":"Shams","year":"2024","journal-title":"Int. J. Hosp. Manag."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1111\/0022-4537.00153","article-title":"Machines and Mindlessness: Social Responses to Computers","volume":"56","author":"Nass","year":"2000","journal-title":"J. Soc. Issues"},{"key":"ref_75","unstructured":"Bodrunova, S.S. (2018). What Makes Users Trust a Chatbot for Customer Service? An Exploratory Interview Study. Proceedings of the Internet Science, St. Petersburg, Russia, 24\u201326 October 2018, Springer International Publishing."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"107343","DOI":"10.1016\/j.chb.2022.107343","article-title":"Anthropomorphism and social presence in Human\u2013Virtual service assistant interactions: The role of dialog length and attitudes","volume":"135","author":"Munnukka","year":"2022","journal-title":"Comput. Hum. Behav."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"107513","DOI":"10.1016\/j.chb.2022.107513","article-title":"Someone out there? A study on the social presence of anthropomorphized chatbots","volume":"139","author":"Biller","year":"2023","journal-title":"Comput. Hum. Behav."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1016\/j.chb.2019.01.020","article-title":"Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions","volume":"97","author":"Go","year":"2019","journal-title":"Comput. Hum. Behav."},{"key":"ref_79","first-page":"24","article-title":"How Effective Are Anthropomorphic Chatbots? A Study of Consumer-Chatbot Communication in Taiwan","volume":"18","author":"Tsai","year":"2024","journal-title":"Int. J. Commun."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1080\/03075079.2024.2333937","article-title":"ChatGPT adoption and anxiety: A cross-country analysis utilising the unified theory of acceptance and use of technology (UTAUT)","volume":"49","author":"Budhathoki","year":"2024","journal-title":"Stud. High. Educ."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"e57132","DOI":"10.2196\/57132","article-title":"Utilization of, Perceptions on, and Intention to Use AI Chatbots Among Medical Students in China: National Cross-Sectional Study","volume":"10","author":"Tao","year":"2024","journal-title":"JMIR Med. Educ."},{"key":"ref_82","first-page":"102767","article-title":"The effect of the anthropomorphic design of chatbots on customer switching intention when the chatbot service fails: An expectation perspective","volume":"76","author":"Lu","year":"2024","journal-title":"Int. J. Inf. Manag."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"e40681","DOI":"10.2196\/40681","article-title":"Investigating Patients\u2019 Continuance Intention Toward Conversational Agents in Outpatient Departments: Cross-sectional Field Survey","volume":"24","author":"Li","year":"2022","journal-title":"J. Med. Internet Res."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"101473","DOI":"10.1016\/j.tele.2020.101473","article-title":"I, Chatbot: Modeling the determinants of users\u2019 satisfaction and continuance intention of AI-powered service agents","volume":"54","author":"Ashfaq","year":"2020","journal-title":"Telemat. Inform."},{"key":"ref_85","first-page":"20552076221090031","article-title":"\u201cI am chatbot, your virtual mental health adviser.\u201c What drives citizens\u2019 satisfaction and continuance intention toward mental health chatbots during the COVID-19 pandemic? An empirical study in China","volume":"8","author":"Zhu","year":"2022","journal-title":"Digit. Health"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Pecune, F., Murali, S., Tsai, V., Matsuyama, Y., and Cassell, J. (2019). A Model of Social Explanations for a Conversational Movie Recommendation System. HAI \u201919: Proceedings of the 7th International Conference on Human-Agent Interaction, Kyoto, Japan, 6\u201310 October 2019, Association for Computing Machinery.","DOI":"10.1145\/3349537.3351899"},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Hernandez-Bocanegra, D.C., and Ziegler, J. (2021). Conversational review-based explanations for recommender systems: Exploring users\u2019 query behavior. Proceedings of the 3rd Conference on Conversational User Interfaces, Virtual Event, 27\u201329 July 2021, Association for Computing Machinery.","DOI":"10.1145\/3469595.3469596"},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Natatsuka, A., Iijima, R., Watanabe, T., Akiyama, M., Sakai, T., and Mori, T. (2022). Understanding the Behavior Transparency of Voice Assistant Applications Using the ChatterBox Framework. Proceedings of the 25th International Symposium on Research in Attacks, Intrusions and Defenses (RAID \u201922), Limassol, Cyprus, 26\u201328 October 2022, Association for Computing Machinery.","DOI":"10.1145\/3545948.3545970"},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Tsiakas, K., and Schneegass, C. (2024). Explaining the Wait: How Justifying Chatbot Response Delays Impact User Trust. CUI \u201924: Proceedings of the 6th ACM Conference on Conversational User Interfaces, Luxembourg, 8\u201310 July 2024, Association for Computing Machinery.","DOI":"10.1145\/3640794.3665550"},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Abdulrahman, A., Richards, D., and Bilgin, A.A. (2021, January 3\u20137). Reason Explanation for Encouraging Behaviour Change Intention. Proceedings of the AAMAS, Virtual.","DOI":"10.65109\/UGAQ3270"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Eiband, M., Buschek, D., Kremer, A., and Hussmann, H. (2019). The Impact of Placebic Explanations on Trust in Intelligent Systems. CHI EA \u201919: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK, 4\u20139 May 2019, Association for Computing Machinery.","DOI":"10.1145\/3290607.3312787"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Yeh, S.F., Wu, M.H., Chen, T.Y., Lin, Y.C., Chang, X., Chiang, Y.H., and Chang, Y.J. (2022). How to Guide Task-oriented Chatbot Users, and When: A Mixed-methods Study of Combinations of Chatbot Guidance Types and Timings. CHI \u201922: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April\u20135 May 2022, Association for Computing Machinery.","DOI":"10.1145\/3491102.3501941"},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3449101","article-title":"My Bad! Repairing Intelligent Voice Assistant Errors Improves Interaction","volume":"5","author":"Cuadra","year":"2021","journal-title":"Proc. ACM Hum.-Comput. Interact."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"103599","DOI":"10.1016\/j.jretconser.2023.103599","article-title":"Exploring the influence mechanism of chatbot-expressed humor on service satisfaction in online customer service","volume":"76","author":"Xie","year":"2024","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"103600","DOI":"10.1016\/j.jretconser.2023.103600","article-title":"Can chatbot customer service match human service agents on customer satisfaction? An investigation in the role of trust","volume":"76","author":"Huang","year":"2024","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"103325","DOI":"10.1016\/j.jretconser.2023.103325","article-title":"Whether to trust chatbots: Applying the event-related approach to understand consumers\u2019 emotional experiences in interactions with chatbots in e-commerce","volume":"73","author":"Wang","year":"2023","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_97","doi-asserted-by":"crossref","unstructured":"Metzger, L., Miller, L., Baumann, M., and Kraus, J. (2024). Empowering Calibrated (Dis-)Trust in Conversational Agents: A User Study on the Persuasive Power of Limitation Disclaimers vs. Authoritative Style. CHI \u201924: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 11\u201316 May 2024, Association for Computing Machinery.","DOI":"10.1145\/3613904.3642122"},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1007\/s11616-022-00763-7","article-title":"Trustworthiness of voice-based assistants: Integrating interlocutor and intermediary predictors","volume":"67","author":"Etzrodt","year":"2022","journal-title":"Publizistik"},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Tejwani, R., Moreno, F., Jeong, S., Won Park, H., and Breazeal, C. (September, January 31). Migratable AI: Effect of identity and information migration on users\u2019 perception of conversational AI agents. Proceedings of the 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), Naples, Italy.","DOI":"10.1109\/RO-MAN47096.2020.9223436"},{"key":"ref_100","doi-asserted-by":"crossref","unstructured":"Bleakley, A., Rough, D., Roper, A., Lindsay, S., Porcheron, M., Lee, M., Nicholson, S.A., Cowan, B.R., and Clark, L. (2022). Exploring Smart Speaker User Experience for People Who Stammer. ASSETS \u201922: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility, Athens, Greece, 23\u201326 October 2022, Association for Computing Machinery.","DOI":"10.1145\/3517428.3544823"},{"key":"ref_101","doi-asserted-by":"crossref","first-page":"107954","DOI":"10.1016\/j.chb.2023.107954","article-title":"How to leverage anthropomorphism for chatbot service interfaces: The interplay of communication style and personification","volume":"149","author":"Janson","year":"2023","journal-title":"Comput. Hum. Behav."},{"key":"ref_102","doi-asserted-by":"crossref","unstructured":"He, G., Aishwarya, N., and Gadiraju, U. (2025). Is Conversational XAI All You Need? Human-AI Decision Making With a Conversational XAI Assistant. IUI \u201925: Proceedings of the 30th International Conference on Intelligent User Interfaces, Cagliari, Italy, 24\u201327 March 2025, Association for Computing Machinery.","DOI":"10.1145\/3708359.3712133"},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"105970","DOI":"10.1016\/j.ijmedinf.2025.105970","article-title":"Show and tell: A critical review on robustness and uncertainty for a more responsible medical AI","volume":"202","author":"Marconi","year":"2025","journal-title":"Int. J. Med. Inform."},{"key":"ref_104","doi-asserted-by":"crossref","unstructured":"Fitrianie, S., Bruijnes, M., Li, F., Abdulrahman, A., and Brinkman, W.P. (2022). The artificial-social-agent questionnaire: Establishing the long and short questionnaire versions. IVA \u201922: Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents, Faro, Portugal, 6\u20139 September 2022, Association for Computing Machinery.","DOI":"10.1145\/3514197.3549612"},{"key":"ref_105","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1007\/s10462-025-11352-1","article-title":"AI-induced Deskilling in Medicine: A Mixed-Method Review and Research Agenda for Healthcare and Beyond","volume":"58","author":"Natali","year":"2025","journal-title":"Artif. Intell. Rev."},{"key":"ref_106","unstructured":"Baghaei, N., Ali, R., Win, K., and Oyibo, K. (2024). An Embodied Conversational Agent to Support Wellbeing After Injury: Insights from a Stakeholder Inclusive Design Approach. Proceedings of the Persuasive Technology, Wollongong, Australia, 10\u201312 April 2024, Springer Nature Switzerland."},{"key":"ref_107","doi-asserted-by":"crossref","unstructured":"Richards, D., Miranda Maciel, P.S., and Janssen, H. (2023). The Co-Design of an Embodied Conversational Agent to Help Stroke Survivors Manage Their Recovery. Robotics, 12.","DOI":"10.3390\/robotics12050120"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/8\/2\/28\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,26]],"date-time":"2026-01-26T13:16:24Z","timestamp":1769433384000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/8\/2\/28"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,26]]},"references-count":107,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,2]]}},"alternative-id":["make8020028"],"URL":"https:\/\/doi.org\/10.3390\/make8020028","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,26]]}}}