{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T09:32:38Z","timestamp":1789551158825,"version":"build-2803163510"},"reference-count":57,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Form Res"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n University students experience elevated psychological distress, with limited access to mental health services. While cognitive behavioral therapy (CBT) demonstrates efficacy for anxiety and depression, treatment gaps persist due to access barriers and insufficient between-session support. Large language model (LLM) chatbots could improve and scale CBT delivery. However, the scientific evaluation of chatbot-enhanced protocols is just emerging.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This pilot study aimed to assess the feasibility, acceptability, and preliminary efficacy of an LLM-based ChatBot as an adjunct to group Unified Protocol (UP) therapy for between-session support in university students with subclinical anxiety and depression symptoms.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n A single-arm feasibility trial recruited university students aged 18 years and older with moderate subclinical symptoms (Social Phobia Inventory: 21\u201040, Patient Health Questionnaire-9: 5\u201014, or Generalized Anxiety Disorder-7: 5\u201014), excluding those with current psychiatric disorders, suicidal ideation, or psychotropic medication use. The intervention comprised 4 weekly group UP counseling sessions complemented by an adjunctive Claude 3.7-Sonnet LLM ChatBot programmed with UP-based therapeutic prompts for between-session support rather than a stand-alone therapeutic agent. Primary feasibility outcomes included treatment adherence, chatbot engagement metrics, and system usability (System Usability Scale). Secondary outcomes assessed changes in generalized anxiety (Generalized Anxiety Disorder-7 Scale), social anxiety (Social Phobia Inventory), depression (Patient Health Questionnaire-9), and well-being (Short Warwick-Edinburgh Mental Wellbeing Scale) using paired\n t<\/jats:italic>\n tests. Qualitative feedback was collected through focus group interviews and analyzed using thematic analysis.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Of 72 screened participants, 37 met eligibility criteria and 19 initiated treatment (mean age 22.06, SD 1.78 years; 70.6% female). Retention was high with 17 completers (10.5% dropout rate). Among completers, 94.1% (16\/17) attended \u22653 group sessions. The engagement with the CBT ChatBot was substantial: participants were active on a median of 23 days during the 34-day study period and exchanged a median of 15 messages in total. System usability was rated as excellent (mean 84.94, SD 10.98 out of 100). Pre-to-post comparisons revealed significant improvements in generalized anxiety (mean change \u22123.00, SD 3.46;\n t<\/jats:italic>\n 16<\/jats:sub>\n =3.01,\n P<\/jats:italic>\n =.004; Cohen\n d<\/jats:italic>\n =0.71) and mental well-being (mean change +2.29, SD 3.65;\n t<\/jats:italic>\n 16<\/jats:sub>\n =\u22122.17,\n P<\/jats:italic>\n =.02; Cohen\n d<\/jats:italic>\n =0.69). Social anxiety and depression showed nonsignificant trends toward improvement. Qualitative feedback highlighted the CBT ChatBot\u2019s accessibility and nonjudgmental support while noting limitations in personalization. No adverse events or inappropriate chatbot interactions occurred.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Augmenting a group UP therapy with an LLM ChatBot demonstrated high feasibility, acceptability, and preliminary efficacy signals for university students with subclinical symptoms. The hybrid intervention package achieved strong retention and engagement while maintaining safety. These findings support progression to a randomized controlled trial to definitively evaluate this technology-enhanced approach for expanding access to evidence-based mental health interventions.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/84296","type":"journal-article","created":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T17:45:10Z","timestamp":1774374310000},"page":"e84296-e84296","source":"Crossref","is-referenced-by-count":1,"title":["Breaking Barriers in Student Mental Health Care With AI-Enhanced Group Cognitive Behavioral Therapy: Pilot Feasibility Study"],"prefix":"10.2196","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8101-1753","authenticated-orcid":false,"given":"Bogdan Tudor","family":"Tulbure","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4039-385X","authenticated-orcid":false,"given":"Bianca","family":"Sp\u0103taru","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0036-4149","authenticated-orcid":false,"given":"Andrei","family":"Rusu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7086-9444","authenticated-orcid":false,"given":"Darian","family":"Faur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6995-9932","authenticated-orcid":false,"given":"Daniel","family":"Precupa\u0219","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4560-0571","authenticated-orcid":false,"given":"Loredana Marcela","family":"Tranc\u0103","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-4816-3372","authenticated-orcid":false,"given":"\u0218erban Gabriel","family":"Popa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0702-6276","authenticated-orcid":false,"given":"Adrian","family":"Sp\u0103taru","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,6,12]]},"reference":[{"issue":"10312","key":"R1","doi-asserted-by":"publisher","first-page":"1700","DOI":"10.1016\/S0140-6736(21)02143-7","article-title":"Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic","volume":"398","author":"Santomauro","journal-title":"Lancet"},{"key":"R2","unstructured":"World mental health report: transforming mental health for all. World Health Organization. 2022. URL: https:\/\/www.who.int\/publications\/i\/item\/9789240049338 [Accessed 26-07-2025]"},{"issue":"5","key":"R3","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2022.11393","article-title":"Examination of young US adults\u2019 reasons for not seeking mental health care for depression, 2011-2019","volume":"5","author":"Lu","journal-title":"JAMA Netw Open"},{"issue":"7","key":"R4","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1001\/jamapsychiatry.2020.0164","article-title":"Psychotherapy for depression across different age groups: a systematic review and meta-analysis","volume":"77","author":"Cuijpers","journal-title":"JAMA Psychiatry"},{"key":"R5","unstructured":"Depression in adults: treatment and management. National Institute for Health and Care Excellence (NICE). 2022. URL: https:\/\/www.nice.org.uk\/guidance\/ng222 [Accessed 26-07-2025]"},{"issue":"2","key":"R6","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1111\/j.1468-2850.2010.01204.x","article-title":"Meta-analysis of homework effects in cognitive and behavioral therapy: a replication and extension","volume":"17","author":"Kazantzis","journal-title":"Clin Psychol Sci Pract"},{"issue":"6","key":"R7","doi-asserted-by":"publisher","first-page":"1535","DOI":"10.1002\/cpp.2594","article-title":"Live psychotherapy by video versus in\u2010person: a meta\u2010analysis of efficacy and its relationship to types and targets of treatment","volume":"28","author":"Fernandez","journal-title":"Clin Psychology Psychoth"},{"issue":"1","key":"R8","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1002\/wps.21069","article-title":"Cognitive behavior therapy vs. control conditions, other psychotherapies, pharmacotherapies and combined treatment for depression: a comprehensive meta-analysis including 409 trials with 52,702 patients","volume":"22","author":"Cuijpers","journal-title":"World Psychiatry"},{"issue":"4","key":"R9","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1037\/a0033403","article-title":"Who gets the most out of cognitive behavioral therapy for anxiety disorders? The role of treatment dose and patient engagement","volume":"81","author":"Glenn","journal-title":"J Consult Clin Psychol"},{"issue":"5","key":"R10","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1007\/s10608-010-9297-z","article-title":"The relationship between homework compliance and therapy outcomes: an updated meta-analysis","volume":"34","author":"Mausbach","journal-title":"Cognit Ther Res"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1017\/S1754470X20000045","article-title":"What are the recovery and attrition outcomes for group CBT and individual CBT for generalised anxiety disorder in an IAPT service? An exploratory study","volume":"13","author":"Fanous","journal-title":"CBT"},{"issue":"11","key":"R12","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1038\/s44159-023-00241-5","article-title":"Using large language models in psychology","volume":"2","author":"Demszky","journal-title":"Nat Rev Psychol"},{"issue":"2","key":"R13","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1016\/j.beth.2021.09.007","article-title":"Chatbot-delivered psychotherapy for adults with depressive and anxiety symptoms: a systematic review and meta-regression","volume":"53","author":"Lim","journal-title":"Behav Ther"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1038\/s41746-023-00979-5","article-title":"Systematic review and meta-analysis of AI-based conversational agents for promoting mental health and well-being","volume":"6","author":"Li","journal-title":"NPJ Digit Med"},{"issue":"459-69","key":"R15","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1016\/j.jad.2024.04.057","article-title":"The therapeutic effectiveness of artificial intelligence-based chatbots in alleviation of depressive and anxiety symptoms in short-course treatments: a systematic review and meta-analysis","volume":"356","author":"Zhong","journal-title":"J Affect Disord"},{"issue":"2","key":"R16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmen.0000145","article-title":"When ELIZA meets therapists: a Turing test for the heart and mind","volume":"2","author":"Hatch","journal-title":"PLoS Ment Health"},{"key":"R17","doi-asserted-by":"crossref","unstructured":"McFadyen J Habicht J Dina LM Harper R Hauser TU Rollwage M . AI-enabled conversational agent increases engagement with cognitive-behavioral therapy: a randomized controlled trial. medRxiv. Preprint posted online on Nov 2, 2024. [doi: 10.1101\/2024.11.01.24316565]","DOI":"10.1101\/2024.11.01.24316565"},{"issue":"7","key":"R18","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1177\/0706743719828977","article-title":"Chatbots and conversational agents in mental health: a review of the psychiatric landscape","volume":"64","author":"Vaidyam","journal-title":"Can J Psychiatry"},{"key":"R19","unstructured":"Radziwill NM Benton MC . Evaluating quality of chatbots and intelligent conversational agents. arXiv. Preprint posted online on Apr 15, 2017. [doi: 10.48550\/arXiv.1704.04579]"},{"issue":"11","key":"R20","doi-asserted-by":"publisher","first-page":"6841","DOI":"10.1080\/10447318.2024.2385001","article-title":"Human-Human vs human-AI therapy: an empirical study","volume":"41","author":"Kuhail","journal-title":"International Journal of Human\u2013Computer Interaction"},{"issue":"7","key":"R21","doi-asserted-by":"publisher","DOI":"10.2196\/16021","article-title":"Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis","volume":"22","author":"Abd-Alrazaq","journal-title":"J Med Internet Res"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2023.1278186","article-title":"Your robot therapist is not your therapist: understanding the role of AI-powered mental health chatbots","volume":"5","author":"Khawaja","journal-title":"Front Digit Health"},{"key":"R23","volume":"2023","author":"Ma","journal-title":"AMIA Annu Symp Proc"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2025.1581779","article-title":"Digital wellness or digital dependency? A critical examination of mental health apps and their implications","volume":"16","author":"Babu","journal-title":"Front Psychiatry"},{"issue":"11","key":"R25","doi-asserted-by":"publisher","first-page":"416","DOI":"10.3390\/socsci10110416","article-title":"21-Day Stress Detox: open trial of a universal well-being chatbot for young adults","volume":"10","author":"Williams","journal-title":"Soc Sci (Basel)"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"Ghandeharioun A McDuff D Czerwinski M Rowan K . EMMA: an emotion-aware wellbeing chatbot. Presented at: 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII); Sep 3-6, 2019; Cambridge, United Kingdom. 2019.[doi: 10.1109\/ACII.2019.8925455]","DOI":"10.1109\/ACII.2019.8925455"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2023.1133987","article-title":"A chatbot for mental health support: exploring the impact of Emohaa on reducing mental distress in China","volume":"5","author":"Sabour","journal-title":"Front Digit Health"},{"issue":"2","key":"R28","doi-asserted-by":"publisher","DOI":"10.55922\/001c.92367","article-title":"ChatGPT: a pilot study on a promising tool for mental health support in psychiatric inpatient care","volume":"2","author":"Melo","journal-title":"International Journal of Psychiatric Trainees"},{"issue":"2","key":"R29","doi-asserted-by":"publisher","DOI":"10.2196\/mental.7785","article-title":"Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial","volume":"4","author":"Fitzpatrick","journal-title":"JMIR Ment Health"},{"issue":"8","key":"R30","doi-asserted-by":"publisher","DOI":"10.2196\/20678","article-title":"Artificial intelligence-based chatbot for anxiety and depression in university students: pilot randomized controlled trial","volume":"5","author":"Klos","journal-title":"JMIR Form Res"},{"issue":"3","key":"R31","doi-asserted-by":"publisher","first-page":"100165","DOI":"10.1016\/j.xagr.2023.100165","article-title":"Feasibility and impact of a mental health chatbot on postpartum mental health: a randomized controlled trial","volume":"3","author":"Suharwardy","journal-title":"AJOG Glob Rep"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.2196\/50025","article-title":"Effectiveness of a mental health chatbot for people with chronic diseases: randomized controlled trial","volume":"8","author":"MacNeill","journal-title":"JMIR Form Res"},{"issue":"11","key":"R33","doi-asserted-by":"publisher","DOI":"10.2196\/40719","article-title":"Mental health chatbot for young adults with depressive symptoms during the COVID-19 pandemic: single-blind, three-arm randomized controlled trial","volume":"24","author":"He","journal-title":"J Med Internet Res"},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2025.1494355","article-title":"Unleashing the potential of chatbots in mental health: bibliometric analysis","volume":"16","author":"Han","journal-title":"Front Psychiatry"},{"issue":"9","key":"R35","doi-asserted-by":"publisher","first-page":"875","DOI":"10.1001\/jamapsychiatry.2017.2164","article-title":"The Unified Protocol for transdiagnostic treatment of emotional disorders compared with diagnosis-specific protocols for anxiety disorders","volume":"74","author":"Barlow","journal-title":"JAMA Psychiatry"},{"issue":"3","key":"R36","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1016\/j.beth.2012.01.001","article-title":"Unified Protocol for transdiagnostic treatment of emotional disorders: a randomized controlled trial","volume":"43","author":"Farchione","journal-title":"Behav Ther"},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.a1655","article-title":"Developing and evaluating complex interventions: the new Medical Research Council guidance","volume":"337","author":"Craig","journal-title":"BMJ"},{"key":"R38","doi-asserted-by":"crossref","unstructured":"Brooke J . SUS-a quick and dirty usability scale. In: Usability Evaluation in Industry. Vol 189. 1996:4-7. [doi: 10.1201\/9781498710411-35]","DOI":"10.1201\/9781498710411-35"},{"issue":"6","key":"R39","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the System Usability Scale","volume":"24","author":"Bangor","journal-title":"Int J Hum Comput Interact"},{"issue":"4","key":"R40","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1192\/bjp.176.4.379","article-title":"Psychometric properties of the Social Phobia Inventory (SPIN)","volume":"176","author":"Connor","journal-title":"Br J Psychiatry"},{"issue":"1","key":"R41","doi-asserted-by":"publisher","DOI":"10.1186\/1477-7525-7-15","article-title":"Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a Rasch analysis using data from the Scottish Health Education Population Survey","volume":"7","author":"Stewart-Brown","journal-title":"Health Qual Life Outcomes"},{"issue":"10","key":"R42","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1001\/archinte.166.10.1092","article-title":"A brief measure for assessing Generalized Anxiety Disorder: the GAD-7","volume":"166","author":"Spitzer","journal-title":"Arch Intern Med"},{"issue":"9","key":"R43","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1046\/j.1525-1497.2001.016009606.x","article-title":"The PHQ-9: validity of a brief depression severity measure","volume":"16","author":"Kroenke","journal-title":"J Gen Intern Med"},{"issue":"5","key":"R44","doi-asserted-by":"publisher","first-page":"1129","DOI":"10.1007\/s11136-016-1454-8","article-title":"Evaluating and establishing national norms for mental wellbeing using the short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS): findings from the Health Survey for England","volume":"26","author":"Ng Fat","journal-title":"Qual Life Res"},{"issue":"2","key":"R45","doi-asserted-by":"publisher","DOI":"10.2196\/mental.8901","article-title":"A web-based transdiagnostic intervention for affective and mood disorders: randomized controlled trial","volume":"5","author":"Tulbure","journal-title":"JMIR Ment Health"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.752249","article-title":"Can we boost treatment adherence to an online transdiagnostic intervention by adding self-enhancement strategies? Results from a randomized controlled non-inferiority trial","volume":"12","author":"Isb\u0103\u015foiu","journal-title":"Front Psychol"},{"issue":"3","key":"R47","doi-asserted-by":"publisher","first-page":"1057","DOI":"10.1177\/0962280215588241","article-title":"Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable","volume":"25","author":"Whitehead","journal-title":"Stat Methods Med Res"},{"issue":"2","key":"R48","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","journal-title":"Qual Res Psychol"},{"issue":"1","key":"R49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/26895269.2022.2129597","article-title":"Toward good practice in thematic analysis: avoiding common problems and be(com)ing a knowing researcher","volume":"24","author":"Braun","journal-title":"Int J Transgend Health"},{"issue":"4","key":"R50","doi-asserted-by":"publisher","DOI":"10.1056\/AIoa2400802","article-title":"Randomized trial of a generative AI chatbot for mental health treatment","volume":"2","author":"Heinz","journal-title":"NEJM AI"},{"key":"R51","doi-asserted-by":"publisher","DOI":"10.2196\/63538","article-title":"Development and evaluation of a mental health chatbot using ChatGPT 4.0: mixed methods user experience study with Korean users","volume":"13","author":"Kang","journal-title":"JMIR Med Inform"},{"key":"R52","doi-asserted-by":"crossref","unstructured":"Moore J Grabb D Agnew W et al. Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providers. Presented at: Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency; Jun 23-26, 2025; Athens, Greece. 2025.[doi: 10.1145\/3715275.3732039]","DOI":"10.1145\/3715275.3732039"},{"key":"R53","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbr.2025.100770","article-title":"A unified protocol chatbot reduces anxiety by encouraging university students\u2019 negative emotional expressions: a randomized controlled trial","volume":"19","author":"Yokotani","journal-title":"Comput Hum Behav Rep"},{"key":"R54","doi-asserted-by":"publisher","DOI":"10.2196\/65785","article-title":"Comparison of an AI chatbot with a nurse hotline in reducing anxiety and depression levels in the general population: pilot randomized controlled trial","volume":"12","author":"Chen","journal-title":"JMIR Hum Factors"},{"issue":"3","key":"R55","doi-asserted-by":"publisher","first-page":"1111","DOI":"10.1177\/02601060241281906","article-title":"ChatGPT as a psychotherapist for anxiety disorders: an empirical study with anxiety patients","volume":"31","author":"Alanzi","journal-title":"Nutr Health"},{"key":"R56","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssmph.2021.100847","article-title":"Barriers to healthcare access among U.S. adults with mental health challenges: a population-based study","volume":"15","author":"Coombs","journal-title":"SSM Popul Health"},{"issue":"2","key":"R57","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1111\/jcal.12385","article-title":"Overcoming the novelty effect in online gamified learning systems: an empirical evaluation of student engagement and performance","volume":"36","author":"Tsay","journal-title":"Comput Assist Learn"}],"container-title":["JMIR Formative Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e84296","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T22:26:02Z","timestamp":1785536762000},"score":1,"resource":{"primary":{"URL":"https:\/\/formative.jmir.org\/2026\/1\/e84296"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,12]]},"references-count":57,"URL":"https:\/\/doi.org\/10.2196\/84296","relation":{},"ISSN":["2561-326X"],"issn-type":[{"value":"2561-326X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,12]]},"article-number":"v10i10312e84296"}}