{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T20:42:57Z","timestamp":1791232977645,"version":"4.1.0"},"reference-count":61,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>The HIV epidemic in the United States disproportionately impacts gay, bisexual, and other men who have sex with men (MSM). Despite the effectiveness of HIV preexposure prophylaxis (PrEP) in preventing HIV acquisition, uptake among MSM remains suboptimal. Motivational interviewing (MI) has demonstrated efficacy at increasing PrEP uptake among MSM but is resource-intensive, limiting scalability. The use of artificial intelligence, particularly large language models with conversational agents (ie, \u201cchatbots\u201d) such as ChatGPT, may offer a scalable approach to delivering MI-based counseling for PrEP and HIV prevention.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This internal usability testing aimed to evaluate the development of an artificial intelligence\u2013based chatbot, including its ability to provide MI-aligned education about PrEP and HIV prevention and potential to support PrEP uptake.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The Chatbot for HIV Prevention and Action (CHIA) was built on a GPT-4o base model embedded with a validated knowledge database on HIV and PrEP in English and Spanish. The CHIA was fine-tuned through training on a large MI dataset and prompt engineering. The use of the AutoGen multiagent framework enabled the CHIA to integrate 2 agents, the PrEP Counselor Agent and the Assistant Agent, which specialized in providing MI-based counseling and handling function calls (eg, assessment of HIV risk), respectively. During internal testing from March 10-April 28, 2025, we systematically evaluated the CHIA\u2019s performance in English and Spanish using a set of 5-point Likert scales to measure accuracy, conciseness, up-to-dateness, trustworthiness, and alignment with aspects of the MI spirit (eg, collaboration, autonomy support) and MI-consistent behaviors (eg, affirmation, open-ended questions). Descriptive statistics and mixed linear regression were used to analyze the data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A total of 296 responses, including 145 English responses and 151 Spanish responses, were collected during the internal testing period. Overall, the CHIA demonstrated strong performance across both languages, receiving the highest combined scores in the general response quality metrics including up-to-dateness (mean 4.6, SD 0.8), trustworthiness (mean 4.5, SD 0.9), accuracy (mean 4.4, SD 0.9), and conciseness (mean 4.2, SD 1.1). The CHIA generally received higher combined scores for metrics that assessed alignment with the MI spirit (ie, empathy, evocation, autonomy support, and collaboration) and lower combined scores for MI-consistent behaviors (ie, affirmation, open-ended questions, and reflections). Spanish responses had significantly lower mean scores than English responses across nearly all MI-based metrics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Our internal usability testing highlights the potential of the CHIA as a viable tool for delivering MI-aligned counseling in English and Spanish to promote HIV prevention and support PrEP uptake, though its Spanish language performance requires further improvement.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/79671","type":"journal-article","created":{"date-parts":[[2025,10,2]],"date-time":"2025-10-02T10:20:06Z","timestamp":1759400406000},"page":"e79671-e79671","source":"Crossref","is-referenced-by-count":8,"title":["Evaluation of an Artificial Intelligence Conversational Chatbot to Enhance HIV Preexposure Prophylaxis Uptake: Development and Usability Internal Testing"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1940-8634","authenticated-orcid":false,"given":"Jun","family":"Tao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7155-5420","authenticated-orcid":false,"given":"Ellie","family":"Pavlick","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-6378-3408","authenticated-orcid":false,"given":"Amaris","family":"Grondin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8508-0359","authenticated-orcid":false,"given":"Josue D","family":"Bustamante","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5222-0908","authenticated-orcid":false,"given":"Harrison","family":"Martin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4054-5676","authenticated-orcid":false,"given":"Hannah","family":"Parent","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7926-1953","authenticated-orcid":false,"given":"Natalie","family":"Fenn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7510-9956","authenticated-orcid":false,"given":"Alexi","family":"Almonte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-7653-3069","authenticated-orcid":false,"given":"Amanda","family":"Maguire-Wilkerson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9050-7531","authenticated-orcid":false,"given":"Mofan","family":"Gu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1626-2289","authenticated-orcid":false,"given":"Jack","family":"Rusley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1362-2522","authenticated-orcid":false,"given":"Bryce K","family":"Perler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4545-9141","authenticated-orcid":false,"given":"Tyler","family":"Wray","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8115-0390","authenticated-orcid":false,"given":"Amy S","family":"Nunn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0964-5895","authenticated-orcid":false,"given":"Philip A","family":"Chan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,2,3]]},"reference":[{"key":"R1","unstructured":"HIV surveillance supplemental report: estimated HIV incidence and prevalence in the United States, 2018\u20132022. Centers for Disease Control and Prevention; 2024. URL: https:\/\/stacks.cdc.gov\/view\/cdc\/156513\/cdc_156513_DS1.pdf [Accessed 10-01-2026]"},{"issue":"27","key":"R2","doi-asserted-by":"publisher","first-page":"2587","DOI":"10.1056\/NEJMoa1011205","article-title":"Preexposure chemoprophylaxis for HIV prevention in men who have sex with men","volume":"363","author":"Grant","journal-title":"N Engl J Med"},{"issue":"10246","key":"R3","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1016\/S0140-6736(20)31065-5","article-title":"Emtricitabine and tenofovir alafenamide vs emtricitabine and tenofovir disoproxil fumarate for HIV pre-exposure prophylaxis (DISCOVER): primary results from a randomised, double-blind, multicentre, active-controlled, phase 3, non-inferiority trial","volume":"396","author":"Mayer","journal-title":"Lancet"},{"issue":"7","key":"R4","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1056\/NEJMoa2101016","article-title":"Cabotegravir for HIV prevention in cisgender men and transgender women","volume":"385","author":"Landovitz","journal-title":"N Engl J Med"},{"issue":"37","key":"R5","doi-asserted-by":"publisher","first-page":"801","DOI":"10.15585\/mmwr.mm6837a2","article-title":"Racial\/ethnic disparities in HIV preexposure prophylaxis among men who have sex with men - 23 urban areas, 2017","volume":"68","author":"Kanny","journal-title":"MMWR Morb Mortal Wkly Rep"},{"issue":"5","key":"R6","doi-asserted-by":"publisher","first-page":"1778","DOI":"10.1007\/s12325-020-01295-0","article-title":"Barriers to the wider use of pre-exposure prophylaxis in the United States: a narrative review","volume":"37","author":"Mayer","journal-title":"Adv Ther"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1016\/j.lana.2024.100738","article-title":"Equity of PrEP uptake by race, ethnicity, sex and region in the United States in the first decade of PrEP: a population-based analysis","volume":"33","author":"Sullivan","journal-title":"Lancet Reg Health Am"},{"issue":"3","key":"R8","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1097\/QAI.0000000000002671","article-title":"A randomized trial of a brief behavioral intervention for PrEP uptake among men who have sex with men at increased risk for HIV infection","volume":"87","author":"Chan","journal-title":"J Acquir Immune Defic Syndr"},{"issue":"3","key":"R9","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1080\/09540121.2019.1622644","article-title":"Open pilot trial of a brief motivational interviewing-based HIV pre-exposure prophylaxis intervention for men who have sex with men: preliminary effects, and evidence of feasibility and acceptability","volume":"32","author":"Moitra","journal-title":"AIDS Care"},{"key":"R10","unstructured":"Miller WR Rollnick S . Motivational Interviewing: Helping People Change. 3rd ed. Guilford Press; 2013. URL: https:\/\/www.biblio.com\/book\/motivational-interviewing-helping-people-change-miller\/d\/1659959579 [Accessed 10-01-2026]"},{"issue":"513","key":"R11","first-page":"305","volume":"55","author":"Rubak","journal-title":"Br J Gen Pract"},{"issue":"2","key":"R12","doi-asserted-by":"publisher","first-page":"107","DOI":"10.2337\/diaspect.23.2.107","article-title":"Effectiveness of motivational interviewing for improving self-care among northern plains Indians with type 2 diabetes","volume":"23","author":"Calhoun","journal-title":"Diabetes Spectr"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.15766\/mep_2374-8265.11104","article-title":"Motivational interviewing training: a case-based curriculum for preclinical medical students","volume":"17","author":"Jacobs","journal-title":"MedEdPORTAL"},{"key":"R14","doi-asserted-by":"crossref","unstructured":"Rollnick S Miller WR Butler CC . Motivational Interviewing in Health Care: Helping Patients Change Behavior. Guilford Press; 2008. URL: https:\/\/www.guilford.com\/books\/Motivational-Interviewing-in-Health-Care\/Rollnick-Miller-Butler\/9781462550371 [Accessed 10-01-2026] [doi: 10.1080\/15412550802093108]","DOI":"10.1080\/15412550802093108"},{"issue":"2","key":"R15","doi-asserted-by":"publisher","DOI":"10.1016\/j.metrad.2023.100022","article-title":"A comprehensive survey of ChatGPT: advancements, applications, prospects, and challenges","volume":"1","author":"Nazir","journal-title":"Meta Radiol"},{"issue":"8","key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/17158","article-title":"Conversational agents in health care: scoping review and conceptual analysis","volume":"22","author":"Tudor Car","journal-title":"J Med Internet Res"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.2196\/40789","article-title":"Artificial intelligence-based chatbots for promoting health behavioral changes: systematic review","volume":"25","author":"Aggarwal","journal-title":"J Med Internet Res"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/49132","article-title":"A motivational interviewing chatbot with generative reflections for increasing readiness to quit smoking: iterative development study","volume":"10","author":"Brown","journal-title":"JMIR Ment Health"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","DOI":"10.1186\/s12889-022-13115-x","article-title":"Can chatbots help to motivate smoking cessation? A study on the effectiveness of motivational interviewing on engagement and therapeutic alliance","volume":"22","author":"He","journal-title":"BMC Public Health"},{"issue":"3","key":"R20","doi-asserted-by":"publisher","DOI":"10.2196\/24850","article-title":"A therapeutic relational agent for reducing problematic substance use (Woebot): development and usability study","volume":"23","author":"Prochaska","journal-title":"J Med Internet Res"},{"issue":"7","key":"R21","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1097\/IJG.0000000000002382","article-title":"Breaking barriers in behavioral change: the potential of artificial intelligence-driven motivational interviewing","volume":"33","author":"Abid","journal-title":"J Glaucoma"},{"issue":"6","key":"R22","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1007\/s11904-023-00681-x","article-title":"Chatbots for HIV prevention and care: a narrative review","volume":"20","author":"van Heerden","journal-title":"Curr HIV\/AIDS Rep"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/52055","article-title":"Testing the feasibility and acceptability of using an artificial intelligence chatbot to promote HIV testing and pre-exposure prophylaxis in Malaysia: mixed methods study","volume":"11","author":"Cheah","journal-title":"JMIR Hum Factors"},{"issue":"10","key":"R24","doi-asserted-by":"publisher","first-page":"1560","DOI":"10.1097\/QAD.0000000000003935","article-title":"Improving HIV preexposure prophylaxis uptake with artificial intelligence and automation: a systematic review","volume":"38","author":"Kamitani","journal-title":"AIDS"},{"issue":"12","key":"R25","doi-asserted-by":"publisher","DOI":"10.2196\/39816","article-title":"The feasibility and acceptability of an mHealth conversational agent designed to support HIV self-testing in South Africa: cross-sectional study","volume":"24","author":"Ntinga","journal-title":"J Med Internet Res"},{"key":"R26","unstructured":"Fujimoto M Hunter L McCoy S Outran S Packel L . Evaluating AI chatbots for HIV prevention: an assessment of response quality and user tailoring. California HIV \/ AIDS Policy Research Center; 2024. URL: https:\/\/chprc.org\/wp-content\/uploads\/2022\/06\/AI_Policy_Brief_Oct2024.pdf [Accessed 10-01-2026]"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","DOI":"10.2196\/48168","article-title":"Attrition in conversational agent-delivered mental health interventions: systematic review and meta-analysis","volume":"26","author":"Jabir","journal-title":"J Med Internet Res"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.2196\/59908","article-title":"A new research model for artificial intelligence-based well-being chatbot engagement: survey study","volume":"11","author":"Yang","journal-title":"JMIR Hum Factors"},{"issue":"1","key":"R29","doi-asserted-by":"publisher","first-page":"38","DOI":"10.4278\/0890-1171-12.1.38","article-title":"The transtheoretical model of health behavior change","volume":"12","author":"Prochaska","journal-title":"Am J Health Promot"},{"key":"R30","unstructured":"Raihan N Cogburn M . Stages of change theory. In: StatPearls. StatPearls Publishing; 2025. [Medline: 32310465]"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1016\/j.iotcps.2023.04.003","article-title":"ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope","volume":"3","author":"Ray","journal-title":"Internet Things Cyber Phys Syst"},{"issue":"9","key":"R32","doi-asserted-by":"publisher","first-page":"6018","DOI":"10.1097\/JS9.0000000000001754","article-title":"The latest version ChatGPT powered by GPT-4o: what will it bring to the medical field?","volume":"110","author":"Zhang","journal-title":"Int J Surg"},{"key":"R33","unstructured":"Welivita A Pu P . Curating a large-scale motivational interviewing dataset using peer support forums. Presented at: Proceedings of the 29th International Conference on Computational Linguistics; Oct 12-17, 2022:3315-3330; Gyeongju, Republic of Korea. 2022.URL: https:\/\/aclanthology.org\/2022.coling-1.293.pdf [Accessed 10-01-2026]"},{"key":"R34","unstructured":"Welivita A Pu P . Curating a large-scale motivational interviewing dataset using peer support forums. in the 29th international conference on computational linguistics (COLING). GitHub. 2022. URL: https:\/\/github.com\/anuradha1992\/Motivational-Interviewing-Dataset [Accessed 10-01-2026]"},{"key":"R35","unstructured":"Wu Q Bansal G Zhang J et al. AutoGen: enabling next-gen LLM applications via multi-agent conversation. arXiv. Preprint posted online on Aug 16, 2023. [doi: 10.48550\/arXiv.2308.08155]"},{"key":"R36","doi-asserted-by":"crossref","unstructured":"Marvin G Hellen N Jjingo D Nakatumba-Nabende J . Data intelligence and cognitive informatics. In: Prompt Engineering in Large Language Models. Springer Nature; 2024:387-402. [doi: 10.1007\/978-981-99-7962-2_30]","DOI":"10.1007\/978-981-99-7962-2_30"},{"key":"R37","doi-asserted-by":"crossref","unstructured":"Sai Varshitha G Rupa R Divya D . Remix-based real time blood bank communication integrating access control using XGBoost and Supabase. Presented at: 2024 IEEE Students Conference on Engineering and Systems (SCES); Jun 21-23, 2024:1-6; Prayagraj, India. 2024.[doi: 10.1109\/SCES61914.2024.10652474]","DOI":"10.1109\/ICDSIS61070.2024.10594708"},{"key":"R38","doi-asserted-by":"crossref","unstructured":"Narula S Jain A . Cloud computing security: amazon web service. Presented at: 2015 Fifth International Conference on Advanced Computing & Communication Technologies (ACCT); Feb 21-22, 2015:501-505; Haryana, India. 2015.[doi: 10.1109\/ACCT.2015.20] [Medline: 39304265]","DOI":"10.1109\/ACCT.2015.20"},{"key":"R39","doi-asserted-by":"crossref","unstructured":"Ayala O Bechard P . Reducing hallucination in structured outputs via retrieval-augmented generation. Presented at: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track); Jun 16-21, 2024; Mexico City, Mexico. 2024.[doi: 10.18653\/v1\/2024.naacl-industry.19]","DOI":"10.18653\/v1\/2024.naacl-industry.19"},{"key":"R40","doi-asserted-by":"crossref","unstructured":"Saad-Falcon J Khattab O Potts C Zaharia M . ARES: an automated evaluation framework for retrieval-augmented generation systems. Presented at: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies; Jun 16-21, 2024; Mexico City, Mexico. 2024.[doi: 10.18653\/v1\/2024.naacl-long.20]","DOI":"10.18653\/v1\/2024.naacl-long.20"},{"key":"R41","unstructured":"Papadimitriou I Gialampoukidis I Vrochidis S Ioannis K . RAG playground: a framework for systematic evaluation of retrieval strategies and prompt engineering in RAG systems. arXiv. Preprint posted online on Dec 16, 2024. [doi: 10.48550\/arXiv.2412.12322]"},{"key":"R42","doi-asserted-by":"crossref","unstructured":"Es S James J Espinosa Anke L Schockaert S . RAGAS: automated evaluation of retrieval augmented generation. Presented at: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics; Mar 17-22, 2024:150-158; St Julians, Malta. 2024.[doi: 10.18653\/v1\/2024.eacl-demo.16]","DOI":"10.18653\/v1\/2024.eacl-demo.16"},{"key":"R43","unstructured":"Rafailov R Sharma A Mitchell E Manning CD Ermon S Finn C . Direct preference optimization: your language model is secretly a reward model. Presented at: NIPS \u201923: Proceedings of the 37th International Conference on Neural Information Processing Systems; Dec 10-16, 2023; New Orleans, Louisiana, USA. 2023.[doi: 10.5555\/3666122.3668460]"},{"key":"R44","unstructured":"Moyers TB Manuel JK Ernst D . Motivational interviewing treatment integrity coding manual 4.2.1. 2014. URL: https:\/\/motivationalinterviewing.org\/sites\/default\/files\/miti4_2.pdf [Accessed 10-01-2026]"},{"key":"R45","unstructured":"Moyers TB Martin T Manuel JK Miller WR . The motivational interviewing treatment integrity (MITI) code: version 2.0. University of New Mexico Center on Alcoholism, Substance Abuse, and Addictions (CASAA); 2003. URL: https:\/\/casaa.unm.edu\/assets\/docs\/miti1.pdf [Accessed 10-01-2026]"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsat.2016.01.001","article-title":"The Motivational Interviewing Treatment Integrity Code (MITI 4): rationale, preliminary reliability and validity","volume":"65","author":"Moyers","journal-title":"J Subst Abuse Treat"},{"key":"R47","doi-asserted-by":"crossref","unstructured":"Grefenstette G . Tokenization. In: van Halteren H , editor. Syntactic Wordclass Tagging. Springer; 1999:117-133. [doi: 10.1007\/978-94-015-9273-4_9] ISBN: 978\u20110\u20117923\u20115896\u20111","DOI":"10.1007\/978-94-015-9273-4_9"},{"issue":"4","key":"R48","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1097\/QAI.0b013e318256b2f6","article-title":"Development of a clinical screening index predictive of incident HIV infection among men who have sex with men in the United States","volume":"60","author":"Smith","journal-title":"J Acquir Immune Defic Syndr"},{"key":"R49","unstructured":"Preexposure prophylaxis for the prevention of HIV infection in the United States\u20142021 update: a clinical practice guideline. Centers for Disease Control and Prevention; 2021. URL: https:\/\/stacks.cdc.gov\/view\/cdc\/112360\/cdc_112360_DS1.pdf [Accessed 10-01-2026]"},{"issue":"5","key":"R50","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1037\/\/0278-6133.10.5.360","article-title":"The Contemplation Ladder: validation of a measure of readiness to consider smoking cessation","volume":"10","author":"Biener","journal-title":"Health Psychol"},{"key":"R51","unstructured":"Emory University NPIN. PrEP Locator. URL: https:\/\/preplocator.org [Accessed 10-1-2026]"},{"key":"R52","unstructured":"Ngo NT Van Nguyen C Dernoncourt F Nguyen TH . Comprehensive and practical evaluation of retrieval-augmented generation systems for medical question answering. arXiv. Preprint posted online on Nov 14, 2024. [doi: 10.48550\/arXiv.2411.09213]"},{"issue":"1","key":"R53","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01074-z","article-title":"Foundation metrics for evaluating effectiveness of healthcare conversations powered by generative AI","volume":"7","author":"Abbasian","journal-title":"NPJ Digit Med"},{"key":"R54","doi-asserted-by":"crossref","unstructured":"Adamopoulou E Moussiades L . An overview of chatbot technology. Presented at: Artificial Intelligence Applications and Innovations (AIAI) 2020; Jun 5-7, 2020; Porto Carras Grand Resort, Halkidiki, Greece. 2020.[doi: 10.1007\/978-3-030-49186-4_31]","DOI":"10.1007\/978-3-030-49186-4_31"},{"key":"R55","doi-asserted-by":"crossref","unstructured":"Li J Monroe W Ritter A Jurafsky D Galley M Gao J . Deep reinforcement learning for dialogue generation. In: Gao J , editor. Presented at: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing; Nov 1-5, 2016; Austin, Texas. 2016.[doi: 10.18653\/v1\/D16-1127]","DOI":"10.18653\/v1\/D16-1127"},{"key":"R56","doi-asserted-by":"crossref","unstructured":"McIntosh TR Susnjak T Liu T Watters P Halgamuge MN . From Google Gemini to OpenAI Q* (Q-star): a survey of reshaping the generative artificial intelligence (AI) research landscape. arXiv. Preprint posted online on Dec 18, 2023. [doi: 10.3390\/technologies13020051]","DOI":"10.3390\/technologies13020051"},{"issue":"3-4","key":"R57","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","journal-title":"Mach Learn"},{"key":"R58","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2941229","article-title":"Q-learning algorithms: a comprehensive classification and applications","volume":"7","author":"Jang","journal-title":"IEEE Access"},{"key":"R59","doi-asserted-by":"publisher","DOI":"10.2196\/44838","article-title":"An overview of chatbot-based mobile mental health apps: insights from app description and user reviews","volume":"11","author":"Haque","journal-title":"JMIR Mhealth Uhealth"},{"key":"R60","unstructured":"Irvine R Boubert D Raina V et al. Rewarding chatbots for real-world engagement with millions of users. arXiv. Preprint posted online on Mar 10, 2023. [doi: 10.48550\/arXiv.2303.06135]"},{"issue":"1","key":"R61","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1007\/s11628-023-00527-x","article-title":"Perceived value of AI-based recommendations service: the case of voice assistants","volume":"17","author":"Akdim","journal-title":"Serv Bus"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2026\/1\/e79671","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:12:50Z","timestamp":1782843170000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e79671"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,3]]},"references-count":61,"URL":"https:\/\/doi.org\/10.2196\/79671","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,3]]},"article-number":"v28i27e79671"}}