{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T11:42:26Z","timestamp":1788522146644,"version":"build-2803163510"},"reference-count":50,"publisher":"Wiley","issue":"6","license":[{"start":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T00:00:00Z","timestamp":1733184000000},"content-version":"vor","delay-in-days":32,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/100000133","name":"Agency for Healthcare Research and Quality","doi-asserted-by":"publisher","award":["R18HS024047"],"award-info":[{"award-number":["R18HS024047"]}],"id":[{"id":"10.13039\/100000133","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R42MH128101"],"award-info":[{"award-number":["R42MH128101"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Clin Psychology and Psychoth"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:title>ABSTRACT<\/jats:title><jats:p>Although clinician\u2010supported computer\u2010assisted cognitive\u2010behaviour therapy (CCBT) is well established as an effective treatment for depression and anxiety, less is known about the specific interventions used during coaching sessions that contribute to outcomes. The current study used artificial intelligence (AI) to identify specific components of clinician\u2010supported CCBT and correlated those scores with therapy outcomes. Data from a randomized clinical trial comparing clinician\u2010supported CCBT with treatment as usual in a primary care setting were utilized. Participants (<jats:italic>n<\/jats:italic>\u2009=\u200995) engaged in CCBT with coaching sessions. The primary outcome was the Patient Health Questionnaire (PHQ\u20109), with Generalized Anxiety Disorder (GAD\u20107), Satisfaction with Life Scale (SWLS) and Automatic Thoughts Questionnaire (ATQ) ratings as secondary outcomes, which were assessed at 12\u2009weeks (post), 3\u2010 and 6\u2010month follow\u2010up. The Lyssn system utilized AI technology to code CBT techniques and common general psychotherapeutic techniques. After controlling for initial ratings, 13 Lyssn\u2010variables were observed to be significantly associated with reducing anxiety on the GAD\u20107 after 12\u2009weeks of treatment. Among the most effective CBT interventions for anxiety included the use of guided discovery, understanding, interpersonal effectiveness and agenda setting. The most beneficial intervention was the proportion of open questions across all variables. Lyssn did not identify any CBT\u2010specific interventions significantly associated with PHQ\u20109, SWLS or ATQ. Therapist use of CBT\u2010specific techniques was significantly associated with reduction of anxiety symptoms after 12\u2009weeks, but such gains were not observed at follow up. Therapist use of open questions was observed to be the most impactful technique contributing to treatment outcomes.<\/jats:p>","DOI":"10.1002\/cpp.70023","type":"journal-article","created":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T07:29:04Z","timestamp":1733210944000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Using Artificial Intelligence to Identify Effective Components of Computer\u2010Assisted Cognitive Behavioural Therapy"],"prefix":"10.1002","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8026-2101","authenticated-orcid":false,"given":"Jeremy\u00a0J.","family":"Coleman","sequence":"first","affiliation":[{"name":"Educational Psychology Department, Counseling\/Counseling Psychology Program The University of Utah  Salt Lake City Utah USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jesse","family":"Owen","sequence":"additional","affiliation":[{"name":"Department of Counseling Psychology, Morgridge College of Education University of Denver  Denver Colorado USA"},{"name":"SonderMind, Inc  Denver Colorado USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jesse\u00a0H.","family":"Wright","sequence":"additional","affiliation":[{"name":"Outpatient Psychiatry University of Louisville Depression Center  Louisville Kentucky USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tracy\u00a0D.","family":"Eells","sequence":"additional","affiliation":[{"name":"Department of Psychiatry University of Louisville  Louisville Kentucky USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Becky","family":"Antle","sequence":"additional","affiliation":[{"name":"Kent School of Social Work and Family Science University of Louisville  Louisville Kentucky USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Markessa","family":"McCoy","sequence":"additional","affiliation":[{"name":"Department of Psychological Sciences Augusta University  Augusta Georgia USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christina\u00a0Signe","family":"Soma","sequence":"additional","affiliation":[{"name":"Lyssn.io  Seattle Washington USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,12,3]]},"reference":[{"key":"e_1_2_10_2_1","first-page":"749","volume-title":"Bergin and Garfield's Handbook of Psychotherapy and Behavior Change","author":"Andersson G.","year":"2021"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cct.2018.11.001"},{"key":"e_1_2_10_4_1","volume-title":"Cognitive Therapy: Basics and Beyond","author":"Beck J. S.","year":"1995"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-45528-0"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471\u20102296\u201012\u201010"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12913\u2010022\u201008519\u20109"},{"key":"e_1_2_10_8_1","first-page":"263","volume-title":"Bergin and Garfield's Handbook of Psychotherapy and Behavior Change","author":"Crits\u2010Christoph P.","year":"2021"},{"key":"e_1_2_10_9_1","unstructured":"Devlin J. M. W.Chang K.Lee andK.Toutanova.2018. \u201cBert: Pre\u2010Training of Deep Bidirectional Transformers for Language Understanding.\u201darXiv preprint arXiv:1810.04805."},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327752jpa4901_13"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033\u20103204.38.2.160"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-021-01623-4"},{"key":"e_1_2_10_13_1","first-page":"1908","article-title":"Language Features for Automated Evaluation of Cognitive Behavior Psychotherapy Sessions","author":"Flemotomos N.","year":"2018","journal-title":"Interspeech"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1037\/pst0000172"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2215\u20100366(21)00077\u20108"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1037\/cou0000382"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1037\/14345-000"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01178214"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M1733"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1037\/pst0000221"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0036841"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1525\u20101497.2001.016009606.x"},{"key":"e_1_2_10_23_1","unstructured":"Liu Y. M.Ott N.Goyal et\u00a0al.2019. \u201cRoBERTa: A Robustly Optimized BERT Pretraining Approach.\u201d Inhttps:\/\/openreview.net\/pdf?id=SyxS0T4tvS."},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598\u2010018\u201025953\u20100"},{"key":"e_1_2_10_25_1","unstructured":"LYSSN.2022. \u201cThe Science.\u201d Retrieved fromhttps:\/\/www.lyssn.io:https:\/\/www.lyssn.io\/the\u2010science\/."},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1093\/med-psych\/9780197635803.001.0001"},{"key":"e_1_2_10_27_1","volume-title":"Motivational Interviewing: Helping People Change","author":"Miller W. R.","year":"2012"},{"key":"e_1_2_10_28_1","volume-title":"Manual for the Motivational Interviewing Skill Code (MISC)","author":"Miller W. R.","year":"2003"},{"key":"e_1_2_10_29_1","unstructured":"Mindstreet.2023. \u201cGood Days Ahead.\u201dhttps:\/\/www.mindstreet.com."},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10942\u2010007\u20100076\u2010z"},{"key":"e_1_2_10_31_1","first-page":"103","volume-title":"Standardized Evaluation in Clinical Practice","author":"Posner K.","year":"2003"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.1037\/ccp0000736"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471\u2010244X\u201011\u2010189"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2015.07.003"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291719000151"},{"issue":"20","key":"e_1_2_10_36_1","first-page":"22","article-title":"The Mini\u2010International Neuropsychiatric Interview (M.I.N.I.): The Development and Validation of a Structured Diagnostic Psychiatric Interview for DSM\u2010IV and ICD\u201010","volume":"59","author":"Sheehan D. V.","year":"1989","journal-title":"The Journal of Clinical Psychiatry"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.1001\/archinte.166.10.1092"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsat.2016.01.006"},{"key":"e_1_2_10_39_1","first-page":"2020","volume-title":"Mental Health Treatment Among Adults: United States, NCHS Data Brief, no 380","author":"Terlizzi E. P.","year":"2019"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.2017.17010089"},{"key":"e_1_2_10_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022\u2010006X.54.3.381"},{"key":"e_1_2_10_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2022.104035"},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/wps.20238"},{"key":"e_1_2_10_44_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0018912"},{"key":"e_1_2_10_45_1","doi-asserted-by":"publisher","DOI":"10.4088\/PCC.17r02196"},{"key":"e_1_2_10_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11920\u2010019\u20101031\u20102"},{"key":"e_1_2_10_47_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.46716"},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.162.6.1158"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.59"},{"key":"e_1_2_10_50_1","volume-title":"Cognitive Therapy Scale: Rating Manual","author":"Young J.","year":"1980"},{"key":"e_1_2_10_51_1","volume-title":"Manual of the Cognitive Therapy Rating Scale","author":"Young J.","year":"1988"}],"container-title":["Clinical Psychology &amp; Psychotherapy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/cpp.70023","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:56:11Z","timestamp":1760108171000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/cpp.70023"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11]]},"references-count":50,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["10.1002\/cpp.70023"],"URL":"https:\/\/doi.org\/10.1002\/cpp.70023","archive":["Portico"],"relation":{},"ISSN":["1063-3995","1099-0879"],"issn-type":[{"value":"1063-3995","type":"print"},{"value":"1099-0879","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11]]},"assertion":[{"value":"2024-07-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-11-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e70023"}}