{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T19:43:50Z","timestamp":1790970230259,"version":"4.1.0"},"reference-count":78,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"\n Background<\/jats:title>\n Escalating mental health demand exceeds existing clinical capacity, necessitating scalable digital solutions. However, engagement remains challenging. Conversational agents can enhance engagement by making digital programs more interactive and personalized, but they have not been widely adopted. This study evaluated a digital program for anxiety in comparison to external comparators. The program used an artificial intelligence (AI)\u2013driven conversational agent to deliver clinician-written content via machine learning, with clinician oversight and user support.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aims to evaluate the engagement, effectiveness, and safety of this structured, evidence-based digital program with human support for mild, moderate, and severe generalized anxiety. Statistical analyses sought to determine whether the program reduced anxiety more than a propensity-matched waiting control and was statistically noninferior to real-world, propensity-matched face-to-face and typed cognitive behavioral therapy (CBT).<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Prospective participants (N=299) were recruited from the National Health Service (NHS) or social media in the United Kingdom and given access to the digital program for up to 9 weeks (study conducted from October 2023 to May 2024). End points were collected before, during, and after the digital program, as well as at a 1-month follow-up. External comparator groups were created through propensity matching of the digital program sample with NHS Talking Therapies (NHS TT) data from ieso Digital Health (typed CBT) and Dorset HealthCare (DHC) University NHS Foundation Trust (face-to-face CBT). Superiority and noninferiority analyses were conducted to compare anxiety symptom reduction (change on the 7-item Generalized Anxiety Disorder Scale [GAD-7]) between the digital program group and the external comparator groups. The program included human support, and clinician time spent per participant was calculated.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Participants used the program for a median of 6 hours over 53 days, with 232 of the 299 (77.6%) engaged (ie, completing a median of 2 hours over 14 days). There was a large, clinically meaningful reduction in anxiety symptoms for the digital program group (per-protocol [PP; n=169]: mean GAD-7 change \u20137.4, d=1.6; intention-to-treat [ITT; n= 99]: mean GAD-7 change \u20135.4, d=1.1). The PP effect was statistically superior to the waiting control (d=1.3) and noninferior to the face-to-face CBT group (P<.001) and the typed CBT group (P<.001). Similarly, for the ITT sample, the digital program showed superiority to waiting control (d=0.8) and noninferiority to face-to-face CBT (P=.002), with noninferiority to typed CBT approaching significance (P=.06). Effects were sustained at the 1-month follow-up. Clinicians overseeing the digital program spent a mean of 1.6 hours (range 31-200 minutes) of clinician time in sessions per participant.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n By combining AI and human support, the digital program achieved clinical outcomes comparable to human-delivered care, while significantly reducing the required clinician time by up to 8 times compared with global care estimates. These findings highlight the potential of technology to scale evidence-based mental health care, address unmet needs, and ultimately impact quality of life and reduce the economic burden globally.<\/jats:p>\n <\/jats:sec>\n \n Trial Registration<\/jats:title>\n ISRCTN Registry ISRCTN52546704; http:\/\/www.isrctn.com\/ISRCTN52546704<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/69351","type":"journal-article","created":{"date-parts":[[2025,3,28]],"date-time":"2025-03-28T05:45:17Z","timestamp":1743140717000},"page":"e69351","source":"Crossref","is-referenced-by-count":26,"title":["Combining Artificial Intelligence and Human Support in Mental Health: Digital Intervention With Comparable Effectiveness to Human-Delivered Care"],"prefix":"10.2196","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8079-4071","authenticated-orcid":false,"given":"Clare E","family":"Palmer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9957-5097","authenticated-orcid":false,"given":"Emily","family":"Marshall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5424-8261","authenticated-orcid":false,"given":"Edward","family":"Millgate","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0211-563X","authenticated-orcid":false,"given":"Graham","family":"Warren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0097-5057","authenticated-orcid":false,"given":"Michael","family":"Ewbank","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3259-4408","authenticated-orcid":false,"given":"Elisa","family":"Cooper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9666-3444","authenticated-orcid":false,"given":"Samantha","family":"Lawes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8381-8055","authenticated-orcid":false,"given":"Alastair","family":"Smith","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-4274-8846","authenticated-orcid":false,"given":"Chris","family":"Hutchins-Joss","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4694-6158","authenticated-orcid":false,"given":"Jessica","family":"Young","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8732-206X","authenticated-orcid":false,"given":"Malika","family":"Bouazzaoui","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5250-1443","authenticated-orcid":false,"given":"Morad","family":"Margoum","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7908-0663","authenticated-orcid":false,"given":"Sandra","family":"Healey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7885-591X","authenticated-orcid":false,"given":"Louise","family":"Marshall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-2945-4169","authenticated-orcid":false,"given":"Shaun","family":"Mehew","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9404-4220","authenticated-orcid":false,"given":"Ronan","family":"Cummins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6370-0141","authenticated-orcid":false,"given":"Valentin","family":"Tablan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5154-5225","authenticated-orcid":false,"given":"Ana","family":"Catarino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7559-3299","authenticated-orcid":false,"given":"Andrew E","family":"Welchman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7752-4987","authenticated-orcid":false,"given":"Andrew D","family":"Blackwell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,5,13]]},"reference":[{"key":"ref1","unstructured":"World Health Organization (WHO)Mental Health | Key factsWHO20222024-06-24https:\/\/tinyurl.com\/3by7wbu5"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1002\/da.22711"},{"key":"ref3","unstructured":"Data page: psychiatrists per 100,000 peopleOur World in Data20232024-07-03https:\/\/ourworldindata.org\/grapher\/psychiatrists-working-in-the-mental-health-sector"},{"key":"ref4","unstructured":"Health Professional Shortage Areas2024272004-07-03https:\/\/data.hrsa.gov\/topics\/health-workforce\/shortage-areas"},{"key":"ref5","author":"Roland, J","year":"2020","journal-title":"The Digital Mental Health Revolution: Transforming Care Through Innovation and Scale-Up"},{"key":"ref6","unstructured":"ClayRMental health apps are gaining tractionAmerican Psychological Association202101012024-07-03https:\/\/www.apa.org\/monitor\/2021\/01\/trends-mental-health-apps"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2017.0262"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.1038\/s44159-021-00003-1"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.2196\/24387"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ps.201800519"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.7126"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1136\/eb-2018-102891"},{"key":"ref13","unstructured":"TafradzhiyskiNMobile App RetentionBusiness of Apps202503182025-04-15https:\/\/www.businessofapps.com\/guide\/mobile-app-retention\/"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1080\/17434440.2021.2013200"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1002\/wps.21183"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.2196\/48168"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.2196\/mental.7785"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.2196\/12106"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2018.00004"},{"key":"ref20","unstructured":"NHS Talking Therapies for anxiety and depression manualNHS England20192024-07-03https:\/\/www.england.nhs.uk\/publication\/the-improving-access-to-psychological-therapies-manual\/"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1080\/10503307.2020.1788740"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2019.2664"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0166-1"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1038\/s44220-023-00106-z"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1001\/jamahealthforum.2023.3535"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1177\/1755738012471029"},{"key":"ref27","author":"Hayes, C","year":"2011","journal-title":"Acceptance and Commitment Therapy: The Process and Practice of Mindful Change, Second Edition"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.bp.116.192435"},{"key":"ref29","unstructured":"ieso Digital Health2025-04-08https:\/\/www.iesogroup.com"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/g3dhy_v1"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.c332"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.166.10.1092"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.3928\/0048-5713-20020901-06"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.180.5.461"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1177\/1073191116645905"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.01.004"},{"key":"ref37","first-page":"1","author":"Brooke, J","year":"1996","journal-title":"Usability Evaluation in Industry (1st Edition)"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1177\/1357633X16649531"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.1016\/j.xjmad.2023.100004"},{"key":"ref40","author":"Hayes, SC","year":"2004","journal-title":"Mindfulness and Acceptance: Expanding the Cognitive-Behavioral Tradition"},{"key":"ref41","unstructured":"Medical devices \u2014 quality management systems \u2014 requirements for regulatory purposes (ISO 13485:2016)International Organization for Standardization (ISO)20162025-04-14https:\/\/www.iso.org\/standard\/59752.html"},{"key":"ref42","unstructured":"NIHR BioResourceNIHR2025-04-08https:\/\/bioresource.nihr.ac.uk\/"},{"key":"ref43","unstructured":"International Statistical Classification of Diseases and Related Health Problems 10th RevisionWorld Health Organization (WHO)2019https:\/\/icd.who.int\/browse10\/2019\/en"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2022.847991"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.2196\/39851"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.2196\/11324"},{"key":"ref47","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0010942"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0062873"},{"key":"ref49","doi-asserted-by":"publisher","DOI":"10.1080\/00048670903179269"},{"key":"ref50","doi-asserted-by":"crossref","DOI":"10.1201\/b11039","author":"Rothmann, M","year":"2016","journal-title":"Design and Analysis of Non-Inferiority Trials"},{"key":"ref51","doi-asserted-by":"publisher","DOI":"10.1192\/bjo.2018.57"},{"key":"ref52","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v042.i08"},{"key":"ref53","unstructured":"R Core TeamR: a language and environment for statistical computingR Foundation for Statistical Computing20232024-06-06https:\/\/www.R-project.org\/"},{"key":"ref54","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2020.01.032"},{"key":"ref55","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-clinpsy-050817-084833"},{"key":"ref56","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2017.04.006"},{"key":"ref57","doi-asserted-by":"publisher","DOI":"10.1159\/000485386"},{"key":"ref58","doi-asserted-by":"publisher","DOI":"10.1016\/j.beth.2018.02.001"},{"key":"ref59","unstructured":"NHS DigitalNHS Talking Therapies, for anxiety and depression, annual reports, 2022-23NHS UK202401162024-05-24https:\/\/digital.nhs.uk\/data-and-information\/publications\/statistical\/nhs-talking-therapies-for-anxiety-and-depression-annual-reports\/2022-23#resources"},{"key":"ref60","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0293-8"},{"key":"ref61","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.bp.112.113134"},{"key":"ref62","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2010.10040570"},{"key":"ref63","unstructured":"Considerations for the design and conduct of externally controlled trials for drug and biological products guidance for industry (draft guidance)Food and Drug Administration (FDA)20232024-07-03https:\/\/www.fda.gov\/regulatory-information\/search-fda-guidance-documents\/considerations-design-and-conduct-externally-controlled-trials-drug-and-biological-products"},{"key":"ref64","unstructured":"National Institute for Healthcare Excellence (NICE)NICE real-world evidence frameworkNICE202206232024-07-03https:\/\/www.nice.org.uk\/corporate\/ecd9\/chapter\/overview"},{"key":"ref65","doi-asserted-by":"publisher","DOI":"10.2147\/CLEP.S242097"},{"key":"ref66","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2018.10136"},{"key":"ref67","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2016.08.015"},{"key":"ref68","unstructured":"Diagnosis: mixed anxiety conditions | Treatment: acceptance and commitment therapy for mixed anxiety disordersSociety of Clinical Psychology20152024-06-24https:\/\/div12.org\/treatment\/acceptance-and-commitment-therapy-for-mixed-anxiety-disorders\/"},{"key":"ref69","doi-asserted-by":"publisher","DOI":"10.2196\/39727"},{"key":"ref70","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2023.3971"},{"key":"ref71","doi-asserted-by":"publisher","DOI":"10.2196\/12530"},{"key":"ref72","doi-asserted-by":"publisher","DOI":"10.2196\/21737"},{"key":"ref73","doi-asserted-by":"publisher","DOI":"10.1177\/20552076231183542"},{"key":"ref74","doi-asserted-by":"publisher","DOI":"10.1016\/j.jretconser.2022.103044"},{"key":"ref75","unstructured":"The role of technology in mental healthcareNuffield Council on Bioethics20222024-06-24https:\/\/www.nuffieldbioethics.org\/assets\/pdfs\/The-role-of-technology-in-mental-health"},{"key":"ref76","doi-asserted-by":"publisher","DOI":"10.1038\/s44184-024-00056-z"},{"key":"ref77","doi-asserted-by":"publisher","DOI":"10.1159\/000507793"},{"key":"ref78","unstructured":"TerlizziEVillarroelMSymptoms of generalized anxiety disorder among adults: United States, 2019Centers for Disease Control and Prevention2020092024-07-04https:\/\/www.cdc.gov\/nchs\/products\/databriefs\/db378.htm"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2025\/1\/e69351","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:56:59Z","timestamp":1782842219000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2025\/1\/e69351"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,13]]},"references-count":78,"URL":"https:\/\/doi.org\/10.2196\/69351","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.69351","asserted-by":"object"},{"id-type":"doi","id":"10.1101\/2024.07.17.24310551","asserted-by":"object"}]},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,13]]}}}