{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:48:11Z","timestamp":1782841691052,"version":"3.54.5"},"reference-count":54,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Artificial intelligence\u2013powered conversational agents (ie, chatbots) are increasingly popular outlets for users seeking psychological support, yet little is known about how users experience early-stage prototypes or which therapeutic processes contribute to clinical improvement. A transparent evaluation of emerging chatbot prototypes is needed to clarify if, how, and why artificial intelligence companions work and to guide their continued development.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This mixed methods pilot study evaluated user experience, acceptability, and preliminary clinical signals for an early-stage mental wellness chatbot. We also examined whether baseline symptom severity moderated clinical improvement.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Three sequential cohorts (n=125) completed a 2-week, incentivized chatbot exposure (approximately 60 min per week). Participants provided first-impression ratings, qualitative feedback, and pre\u2013post assessments of depressive symptoms (PHQ-8 [Patient Health Questionnaire-8]), anxiety symptoms (GAD-7 [Generalized Anxiety Disorder-7]), psychological distress, well-being, and loneliness. Statistical models estimated symptom change and tested interactions with baseline symptom severity. Mixed methods analysis integrated quantitative outcomes with large language model\u2013assisted qualitative content analysis of open-ended responses.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Participants described the chatbot as accessible, easy to use, and emotionally validating, while citing limitations in personalization and conversational depth. Qualitative responses consistently highlighted early therapeutic processes such as emotional validation, goal setting, and perceived attunement. Regression models showed significant pre\u2013post reductions in depressive (Hedges\n g<\/jats:italic>\n =\u20130.32) and anxiety (\n g<\/jats:italic>\n =\u20130.32) symptoms, alongside modest improvements in distress and well-being. Baseline severity moderated improvement, with marginal effects indicating larger predicted reductions at higher PHQ-8 and GAD-7 baseline scores (eg, PHQ-8=15:\n g<\/jats:italic>\n =\u20130.84; GAD-7=15:\n g<\/jats:italic>\n =\u20130.62).\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This pilot provides a comprehensive view of early chatbot development and suggests promising user experiences and preliminary symptom improvements under structured pilot conditions. By integrating experiential and exploratory clinical data, the study identifies candidate process targets to inform ongoing refinement. Findings support continued development and demonstrate procedural feasibility for progression to larger, longer-term trials evaluating engagement and clinical outcomes under more naturalistic conditions.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/90644","type":"journal-article","created":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T19:40:05Z","timestamp":1772221205000},"page":"e90644-e90644","source":"Crossref","is-referenced-by-count":0,"title":["User Experience and Early Clinical Outcomes of a Mental Wellness Chatbot for Depression and Anxiety: Pilot Evaluation Mixed Methods Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8655-1190","authenticated-orcid":false,"given":"Scott","family":"Graupensperger","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2789-2753","authenticated-orcid":false,"given":"Emily J","family":"Ward","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5123-5535","authenticated-orcid":false,"given":"Graham","family":"Baum","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6875-6440","authenticated-orcid":false,"given":"Kate H","family":"Bentley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3704-5339","authenticated-orcid":false,"given":"Emily R","family":"Dworkin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2225-9243","authenticated-orcid":false,"given":"Millard","family":"Brown","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0497-596X","authenticated-orcid":false,"given":"Adam","family":"Chekroud","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9556-4391","authenticated-orcid":false,"given":"Matt","family":"Hawrilenko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,4,14]]},"reference":[{"key":"R1","unstructured":"World mental health today: latest data. World Health Organization. 2025. URL: https:\/\/www.who.int\/publications\/i\/item\/9789240113817 [Accessed 19-11-2025]"},{"issue":"2","key":"R2","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/S2215-0366(23)00370-X","article-title":"The WHO Mental Health Gap Action Programme for mental, neurological, and substance use conditions: the new and updated guideline recommendations","volume":"11","author":"Brohan","journal-title":"Lancet Psychiatry"},{"issue":"10361","key":"R3","doi-asserted-by":"publisher","first-page":"1438","DOI":"10.1016\/S0140-6736(22)01470-2","article-title":"The Lancet Commission on ending stigma and discrimination in mental health","volume":"400","author":"Thornicroft","journal-title":"Lancet"},{"key":"R4","doi-asserted-by":"crossref","unstructured":"Balcombe L . AI chatbots in mental health care: integrative review of challenges and solutions. Public Health Healthcare. Preprint posted online on 2025. [doi: 10.20944\/preprints202509.1893.v1]","DOI":"10.20944\/preprints202509.1893.v1"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1097\/YCO.0000000000001048","article-title":"Efficacy and risks of artificial intelligence chatbots for anxiety and depression: a narrative review of recent clinical studies","volume":"39","author":"Bodner","journal-title":"Curr Opin Psychiatry"},{"issue":"3","key":"R6","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1002\/wps.21352","article-title":"Charting the evolution of artificial intelligence mental health chatbots from rule-based systems to large language models: a systematic review","volume":"24","author":"Hua","journal-title":"World Psychiatry"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.2196\/65785","article-title":"Comparison of an AI chatbot with a nurse hotline in reducing anxiety and depression levels in the general population: pilot randomized controlled trial","volume":"12","author":"Chen","journal-title":"JMIR Hum Factors"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/60435","article-title":"Generative AI-enabled therapy support tool for improved clinical outcomes and patient engagement in group therapy: real-world observational study","volume":"27","author":"Habicht","journal-title":"J Med Internet Res"},{"issue":"4","key":"R9","doi-asserted-by":"publisher","DOI":"10.1056\/AIoa2400802","article-title":"Randomized trial of a generative AI chatbot for mental health treatment","volume":"2","author":"Heinz","journal-title":"NEJM AI"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","DOI":"10.2196\/65589","article-title":"Therapeutic potential of social chatbots in alleviating loneliness and social anxiety: quasi-experimental mixed methods study","volume":"27","author":"Kim","journal-title":"J Med Internet Res"},{"issue":"12","key":"R11","doi-asserted-by":"publisher","first-page":"768","DOI":"10.3390\/info15120768","article-title":"Harnessing AI in anxiety management: a chatbot-based intervention for personalized mental health support","volume":"15","author":"Manole","journal-title":"Information"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2025.119760","article-title":"Depression intervention using AI chatbots with social cues: a randomized trial of effectiveness","volume":"389","author":"Xu","journal-title":"J Affect Disord"},{"issue":"9","key":"R13","doi-asserted-by":"publisher","first-page":"8133","DOI":"10.1007\/s12144-025-07359-0","article-title":"Does the AI-driven chatbot work? effectiveness of the Woebot app in reducing anxiety and depression in group counseling courses and student acceptance of technological aids","volume":"44","author":"Yeh","journal-title":"Curr Psychol"},{"issue":"9","key":"R14","doi-asserted-by":"publisher","DOI":"10.1056\/AIp2500453","article-title":"A generative AI chatbot for mental health treatment: a step in the right direction?","volume":"2","author":"Heckman","journal-title":"NEJM AI"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbah.2025.100182","article-title":"A critical discussion of strategies and ramifications of implementing conversational agents in mental healthcare","volume":"5","author":"Herbener","journal-title":"Comput Hum Behav Artif Hum"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbr.2024.100401","article-title":"A narrative review of the active ingredients in psychotherapy delivered by conversational agents","volume":"14","author":"Herbener","journal-title":"Comput Hum Behav Artif Hum"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","DOI":"10.1093\/tbm\/ibaf010","article-title":"Understanding and overcoming barriers to digital health adoption: a patient and public involvement study","volume":"15","author":"Mair","journal-title":"Transl Behav Med"},{"issue":"1","key":"R18","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1001\/jamapsychiatry.2025.3439","article-title":"Uptake, adherence, and attrition in clinical trials of depression and anxiety apps: a systematic review and meta-analysis","volume":"83","author":"Liu","journal-title":"JAMA Psychiatry"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1007\/s41347-025-00522-1","article-title":"Patient and provider insights on the design and engagement of digital health recommendation systems","author":"Wagner","journal-title":"J Technol Behav Sci"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.2196\/69294","article-title":"Does the digital therapeutic alliance exist? integrative review","volume":"12","author":"Malouin-Lachance","journal-title":"JMIR Ment Health"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.1080\/29974100.2025.2590495","article-title":"A theoretical framework of the processes of change in mental health interventions delivered by artificial therapists","volume":"1","author":"Herbener","journal-title":"J Psychol AI"},{"issue":"6","key":"R22","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.17517","article-title":"Evaluating artificial intelligence responses to public health questions","volume":"6","author":"Ayers","journal-title":"JAMA Netw Open"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.2196\/66040","article-title":"Human-centered design and digital transformation of mental health services","volume":"12","author":"Fleming","journal-title":"JMIR Hum Factors"},{"issue":"10504","key":"R24","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(25)01237-1","article-title":"Assessing generative artificial intelligence for mental health","volume":"406","author":"Torous","journal-title":"Lancet"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1146\/annurev-clinpsy-050718-095424","article-title":"The role of common factors in psychotherapy outcomes","volume":"15","author":"Cuijpers","journal-title":"Annu Rev Clin Psychol"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2018.12.098","article-title":"Comparative validity and responsiveness of PHQ-ADS and other composite anxiety-depression measures","volume":"246","author":"Kroenke","journal-title":"J Affect Disord"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1177\/2633489520987828","article-title":"Assessing the usability of complex psychosocial interventions: the intervention usability scale","volume":"2","author":"Lyon","journal-title":"Implement Res Pract"},{"issue":"12","key":"R28","doi-asserted-by":"publisher","first-page":"1266","DOI":"10.1176\/appi.ajp.2011.10111704","article-title":"The Columbia-suicide severity rating scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults","volume":"168","author":"Posner","journal-title":"Am J Psychiatry"},{"issue":"6","key":"R29","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1176\/appi.psy.50.6.613","article-title":"An ultra-brief screening scale for anxiety and depression: the PHQ-4","volume":"50","author":"Kroenke","journal-title":"Psychosomatics"},{"issue":"9","key":"R30","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1046\/j.1525-1497.2001.016009606.x","article-title":"The PHQ-9: validity of a brief depression severity measure","volume":"16","author":"Kroenke","journal-title":"J Gen Intern Med"},{"issue":"8","key":"R31","doi-asserted-by":"publisher","first-page":"1368","DOI":"10.1017\/S0033291719001314","article-title":"Equivalency of the diagnostic accuracy of the PHQ-8 and PHQ-9: a systematic review and individual participant data meta-analysis","volume":"50","author":"Wu","journal-title":"Psychol Med"},{"issue":"10","key":"R32","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1001\/archinte.166.10.1092","article-title":"A brief measure for assessing generalized anxiety disorder: the GAD-7","volume":"166","author":"Spitzer","journal-title":"Arch Intern Med"},{"issue":"4","key":"R33","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1159\/000289073","article-title":"The WHO (Ten) Weil-Being Index: validation in diabetes","volume":"65","author":"Bech","journal-title":"Psychother Psychosom"},{"issue":"6","key":"R34","doi-asserted-by":"publisher","first-page":"959","DOI":"10.1017\/s0033291702006074","article-title":"Short screening scales to monitor population prevalences and trends in non-specific psychological distress","volume":"32","author":"Kessler","journal-title":"Psychol Med"},{"issue":"6","key":"R35","doi-asserted-by":"publisher","first-page":"655","DOI":"10.1177\/0164027504268574","article-title":"A short scale for measuring loneliness in large surveys: results from two population-based studies","volume":"26","author":"Hughes","journal-title":"Res Aging"},{"key":"R36","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2015.08.044","article-title":"Development of a questionnaire measuring attitudes towards psychological online interventions\u2013the APOI","volume":"187","author":"Schr\u00f6der","journal-title":"J Affect Disord"},{"issue":"1","key":"R37","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-017-2031-8","article-title":"Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework","volume":"17","author":"Sekhon","journal-title":"BMC Health Serv Res"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1177\/16094069251322346","article-title":"\u201cConversing\u201d with qualitative data: enhancing qualitative research through large language models (LLMs)","volume":"24","author":"Hayes","journal-title":"Int J Qual Methods"},{"key":"R39","unstructured":"Miles MB Huberman MA Salda\u00f1a J . Qualitative Data Analysis: A Methods Sourcebook. Sage Publications; 2020."},{"key":"R40","unstructured":"Guba EG Lincoln YS . Fourth Generation Evaluation. SAGE; 1989."},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.2196\/69031","article-title":"Effectiveness of a self-guided digital intervention for mental health and psychological well-being in university students: pre- and postintervention study","volume":"27","author":"Nos\u00e8","journal-title":"J Med Internet Res"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.2196\/77532","article-title":"Evaluating and optimizing just-in-time adaptive interventions in a digital mental health intervention (Wysa for chronic pain) for middle-aged and older adults with chronic pain: protocol for a series of randomized trials","volume":"14","author":"Cheng","journal-title":"JMIR Res Protoc"},{"issue":"6","key":"R43","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the system usability scale","volume":"24","author":"Bangor","journal-title":"Int J Hum Comput Interact"},{"key":"R44","unstructured":"Hull TD Zhang L Arean PA Malgaroli M . Generative AI purpose-built for social and mental health: a real-world pilot. arXiv. Preprint posted online on Nov 12, 2025. [doi: 10.48550\/arXiv.2511.11689]"},{"key":"R45","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2025.121106","article-title":"Does baseline severity interact with the effects of psychotherapy for depression? a meta-analytic review","volume":"399","author":"Cuijpers","journal-title":"J Affect Disord"},{"issue":"1","key":"R46","first-page":"664","volume":"3","author":"Asim","journal-title":"Dialogue Soc Sci Rev DSSR"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2022.819623","article-title":"Digital therapeutic alliance with fully automated mental health smartphone apps: a narrative review","volume":"13","author":"Tong","journal-title":"Front Psychiatry"},{"issue":"8","key":"R48","doi-asserted-by":"publisher","DOI":"10.2196\/17204","article-title":"The therapeutic alliance in digital mental health interventions for serious mental illnesses: narrative review","volume":"7","author":"Tremain","journal-title":"JMIR Ment Health"},{"key":"R49","doi-asserted-by":"publisher","DOI":"10.1186\/1471-244X-14-109","article-title":"Understanding the acceptability of e-mental health--attitudes and expectations towards computerised self-help treatments for mental health problems","volume":"14","author":"Musiat","journal-title":"BMC Psychiatry"},{"issue":"3","key":"R50","doi-asserted-by":"publisher","first-page":"297","DOI":"10.34172\/hpp.43077","article-title":"Preferences and expectations of end-users from a mental health educational portal: a qualitative study","volume":"14","author":"Pourrazavi","journal-title":"Health Promot Perspect"},{"issue":"3","key":"R51","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1037\/pst0000476","article-title":"Psychotherapist advice, suggestions, recommendations: a research review","volume":"60","author":"Hill","journal-title":"Psychotherapy (Chic)"},{"key":"R52","doi-asserted-by":"crossref","unstructured":"Graupensperger S Brown M Chekroud A et al. AI-enabled continuous care features in real-world psychotherapy: treatment engagement and clinical outcomes. medRxiv. Preprint posted online on Feb 25, 2026. [doi: 10.64898\/2026.01.30.26345238]","DOI":"10.64898\/2026.01.30.26345238"},{"key":"R53","doi-asserted-by":"publisher","DOI":"10.1016\/j.janxdis.2022.102590","article-title":"Understanding the untreated course of anxiety disorders in treatment-seeking samples: a systematic review and meta-analysis","volume":"89","author":"Scott","journal-title":"J Anxiety Disord"},{"issue":"1","key":"R54","doi-asserted-by":"publisher","DOI":"10.2196\/39029","article-title":"Time-dependent changes in depressive symptoms among control participants in digital-based psychological intervention studies: meta-analysis of randomized controlled trials","volume":"25","author":"Tong","journal-title":"J Med Internet Res"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e90644","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:15:39Z","timestamp":1782839739000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e90644"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,14]]},"references-count":54,"URL":"https:\/\/doi.org\/10.2196\/90644","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,14]]},"article-number":"v10i2e90644"}}