{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T13:41:31Z","timestamp":1790602891429,"version":"4.1.0"},"reference-count":50,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Educ"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Cognitive behavioral therapy (CBT) training faces significant challenges, including supervised practice with diverse cases, inconsistent feedback, resource-intensive supervision, and difficulties standardizing competence assessment.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study evaluated the acceptability and feasibility of CBT Trainer (TTZ), the first virtual patient platform to provide real-time feedback aligned with established competence frameworks. The mobile app trains psychological practitioners using standardized artificial intelligence patient interactions and the evaluation of therapist responses against competence frameworks to enable structured skill development in a controlled, repeatable environment that complements traditional training methods.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This mixed methods pilot study used a 2-stage approach. Stage 1 involved usability testing with 4 participants. Stage 2 included 59 participants from psychological practitioner training programs (a Low Intensity CBT Interventions Program and a Doctorate in Clinical Psychology) who engaged with the CBT Trainer voluntarily for over 1 month. Measures of impact included the System Usability Scale (SUS), platform naturalistic engagement, poststudy questionnaire on perceived competency development, comparative evaluation against traditional role-play, and qualitative feedback.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Participants engaged voluntarily with the platform for an average of 95.24 (SD 134.58; median 45.34, IQR 11.57\u2013105.15) minutes of active role-play. Platform usability was rated as excellent (mean SUS 82.20, SD 12.93). Self-reported competence improvement improved most in assessment skills (96.7%) and information gathering (66.7%). When compared to traditional peer role-play exercises, participants rated CBT Trainer moderately favorably (mean 5.90\/10, SD 1.94). Qualitative feedback highlighted strengths in competency-aligned feedback, on-demand accessibility, and a psychologically safe practice space.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This pilot study provides evidence that an artificial intelligence\u2013based patient simulation shows promise as a supplementary training tool for psychological therapists who use CBT in their practice, particularly regarding accessibility and immediate feedback. Future research should use randomized controlled designs with objective competence assessments.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/84091","type":"journal-article","created":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T17:00:09Z","timestamp":1769792409000},"page":"e84091-e84091","source":"Crossref","is-referenced-by-count":8,"title":["An AI-Driven Virtual Patient Platform (CBT Trainer) for Training Cognitive Behavioral Therapy Practitioners Against Competencies: Mixed Methods Pilot Study"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-9064-396X","authenticated-orcid":false,"given":"Tianyu Terry","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7077-8729","authenticated-orcid":false,"given":"Rob","family":"Saunders","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7361-8202","authenticated-orcid":false,"given":"Stephen","family":"Pilling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7316-3041","authenticated-orcid":false,"given":"Ciar\u00e1n","family":"O'Driscoll","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,3,6]]},"reference":[{"key":"R1","unstructured":"NHS long term workforce plan. NHS England. 2023. URL: https:\/\/www.england.nhs.uk\/long-read\/nhs-long-term-workforce-plan-2\/ [Accessed 23-05-2025]"},{"issue":"2","key":"R2","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1017\/S1352465808004141","article-title":"Using an evidence-based methodology to identify the competences required to deliver effective cognitive and behavioural therapy for depression and anxiety disorders","volume":"36","author":"Roth","journal-title":"Behav Cogn Psychother"},{"issue":"5","key":"R3","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1017\/S1352465816000011","article-title":"A new scale for the assessment of competences in cognitive and behavioural therapy","volume":"44","author":"Roth","journal-title":"Behav Cogn Psychother"},{"key":"R4","doi-asserted-by":"crossref","unstructured":"Blackburn IM James IA Milne DL et al. Revised cognitive therapy scale (CTS-r). APA PsycTests. 2001. URL: https:\/\/doi.org\/10.1037\/t65807-000 [Accessed 25-02-2026]","DOI":"10.1037\/t65807-000"},{"key":"R5","doi-asserted-by":"crossref","unstructured":"Young J Beck A . Cognitive Therapy Scale (CTS). APA PsycTests. 1980. URL: https:\/\/doi.org\/10.1037\/t00834-000 [Accessed 25-02-2026]","DOI":"10.1037\/t00834-000"},{"issue":"2","key":"R6","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/s0005-7916(03)00022-3","article-title":"Impact of training on rating competence in cognitive therapy","volume":"34","author":"Reichelt","journal-title":"J Behav Ther Exp Psychiatry"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1017\/S1352465805002420","article-title":"Therapist skills: a cognitive model of their acquisition and refinement","volume":"34","author":"Bennett-Levy","journal-title":"Behav Cogn Psychother"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1017\/S1754470X22000502","article-title":"The why, what, when, who and how of assessing CBT competence to support lifelong learning","volume":"15","author":"Muse","journal-title":"tCBT"},{"issue":"3","key":"R9","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1016\/j.cpr.2013.01.010","article-title":"A systematic review of methods for assessing competence in cognitive-behavioural therapy","volume":"33","author":"Muse","journal-title":"Clin Psychol Rev"},{"issue":"6","key":"R10","doi-asserted-by":"publisher","first-page":"959","DOI":"10.1007\/s10608-019-10024-z","article-title":"Evaluating CBT clinical competence with standardised role plays and patient therapy sessions","volume":"43","author":"Liness","journal-title":"Cogn Ther Res"},{"issue":"4","key":"R11","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1037\/a0013983","article-title":"The Examination for Professional Practice in Psychology (EPPP) in the era of evidence-based practice","volume":"40","author":"Sharpless","journal-title":"Prof Psychol Res Pr"},{"issue":"3","key":"R12","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1007\/s10488-021-01169-9","article-title":"Role-play assessment of therapist adherence and skill in implementation of trauma-focused cognitive-behavioral therapy","volume":"49","author":"Marriott","journal-title":"Adm Policy Ment Health"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1017\/S1754470X15000288","article-title":"The challenge of training supervisors to use direct assessments of clinical competence in CBT consistently: a systematic review and exploratory training study","volume":"9","author":"Loades","journal-title":"Cogn Behav Ther"},{"issue":"3","key":"R14","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1111\/cp.12206","article-title":"Burnout in psychological therapists: a cross\u2010sectional study investigating the role of supervisory relationship quality","volume":"24","author":"Johnson","journal-title":"Clin Psychol (Aust Psychol Soc)"},{"key":"R15","doi-asserted-by":"crossref","unstructured":"The British Psychological Society. Code of Ethics and Conduct. The British Psychological Society; 2021. [doi: 10.53841\/bpsrep.2021.inf94] ISBN: 978-1-85433-804-4","DOI":"10.53841\/bpsrep.2021.inf94"},{"key":"R16","doi-asserted-by":"crossref","unstructured":"The British Psychological Society. Supervision Guidance for Psychologists. The British Psychological Society; 2024. [doi: 10.53841\/bpsrep.2024.rep178] ISBN: 978-1-85433-904-1","DOI":"10.53841\/bpsrep.2024.rep178"},{"key":"R17","unstructured":"Caltabiano M Errington E Sorin R Nickson A et al. The potential of role-play in undergraduate psychology training \/ marie caltabiano. Asian J Univ Educ. Preprint posted online on Jun 30, 2018. URL: https:\/\/files.eric.ed.gov\/fulltext\/EJ1207768.pdf [Accessed 21-02-2026]"},{"issue":"2","key":"R18","doi-asserted-by":"publisher","first-page":"104","DOI":"10.2304\/plat.2007.6.2.104","article-title":"An evaluation of the use of simulated patient role-plays in the teaching and assessment of clinical consultation skills in clinical psychologists\u2019 training","volume":"6","author":"Melluish","journal-title":"Psychol Learn Teach"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1515\/ijnes-2013-0075","article-title":"An evaluation of mental health simulation with standardized patients","volume":"11","author":"Doolen","journal-title":"Int J Nurs Educ Scholarsh"},{"issue":"1","key":"R20","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-018-1184-4","article-title":"Standardized patients in psychiatry - the best way to learn clinical skills?","volume":"18","author":"Himmelbauer","journal-title":"BMC Med Educ"},{"issue":"1-2","key":"R21","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1300\/J067v16n01_13","article-title":"Rationale for utilizing standardized clients in the training and evaluation of social work students","volume":"16","author":"Badger","journal-title":"J Teach Soc Work"},{"issue":"2","key":"R22","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1177\/0193392202027002002","article-title":"Using actors in experiential group counseling leadership training","volume":"27","author":"Fall","journal-title":"J Spec Group Work"},{"issue":"1","key":"R23","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-018-1381-1","article-title":"Using conversation analysis to inform role play and simulated interaction in communications skills training for healthcare professionals: identifying avenues for further development through a scoping review","volume":"18","author":"Pilnick","journal-title":"BMC Med Educ"},{"issue":"1","key":"R24","doi-asserted-by":"publisher","first-page":"21","DOI":"10.7334\/psicothema2016.286","article-title":"Peer counselling versus role-playing: two training methods of therapeutic skills in clinical psychology","volume":"30","author":"Ruiz Rodr\u00edguez","journal-title":"Psicothema"},{"issue":"4","key":"R25","doi-asserted-by":"publisher","first-page":"489","DOI":"10.3138\/jvme.0817-111r1","article-title":"Using a standardized client encounter to practice death notification after the unexpected death of a feline patient following routine ovariohysterectomy","volume":"46","author":"Englar","journal-title":"J Vet Med Educ"},{"issue":"2","key":"R26","doi-asserted-by":"publisher","first-page":"524","DOI":"10.1002\/capr.12685","article-title":"Student therapists\u2019 experiences of learning using a machine client: a proof\u2010of\u2010concept exploration of an emotionally responsive interactive client (ERIC)","volume":"24","author":"Prescott","journal-title":"Couns and Psychother Res"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","first-page":"455","DOI":"10.5334\/pme.493","article-title":"Developing simulated and virtual patients in psychological assessment - method, insights and recommendations","volume":"12","author":"Zalewski","journal-title":"Perspect Med Educ"},{"issue":"7","key":"R28","doi-asserted-by":"publisher","DOI":"10.2196\/12529","article-title":"Development and evaluation of ClientBot: patient-like conversational agent to train basic counseling skills","volume":"21","author":"Tanana","journal-title":"J Med Internet Res"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecns.2024.101536","article-title":"Are Artificial Intelligence Virtual Simulated Patients (AI-VSP) a valid teaching modality for health professional students?","volume":"92","author":"De Mattei","journal-title":"Clin Simul Nurs"},{"key":"R30","doi-asserted-by":"crossref","unstructured":"Maurya RK . A qualitative content analysis of chatgpt\u2019s client simulation role play for practicing counseling skills. PsyArXiv. Preprint posted online on Jun 2023. [doi: 10.31234\/osf.io\/vwuxh]","DOI":"10.31234\/osf.io\/vwuxh"},{"issue":"1","key":"R31","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-022-08519-9","article-title":"Enhancing the quality of cognitive behavioral therapy in community mental health through artificial intelligence generated fidelity feedback (Project AFFECT): a study protocol","volume":"22","author":"Creed","journal-title":"BMC Health Serv Res"},{"issue":"10","key":"R32","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0258639","article-title":"Automated quality assessment of cognitive behavioral therapy sessions through highly contextualized language representations","volume":"16","author":"Flemotomos","journal-title":"PLoS One"},{"key":"R33","unstructured":"Kolb D . Experiential Learning: Experience As The Source Of Learning And Development. Prentice Hall; 1984. ISBN: 978-0-13-295261-3"},{"issue":"3","key":"R34","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1037\/0033-295X.100.3.363","article-title":"The role of deliberate practice in the acquisition of expert performance","volume":"100","author":"Ericsson","journal-title":"Psychol Rev"},{"issue":"5","key":"R35","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1016\/j.cpr.2010.03.004","article-title":"Establishing evidence-based training in cognitive behavioral therapy: a review of current empirical findings and theoretical guidance","volume":"30","author":"Rakovshik","journal-title":"Clin Psychol Rev"},{"key":"R36","unstructured":"AI-powered psychotherapy training | virtual patient roleplay simulation. CBT Trainer. 2025. URL: https:\/\/www.soymh.com [Accessed 21-02-2026]"},{"key":"R37","unstructured":"National Curriculum for Psychological Wellbeing Practitioner (PWP) programmes. NHS England. 2022. URL: https:\/\/www.hee.nhs.uk\/sites\/default\/files\/2026-01\/PWP%20Curriculum%204th%20Edition%202022%20%28updated%20May%202025%29%20v4.4.docx [Accessed 21-02-2026]"},{"key":"R38","unstructured":"Brooke J . SUS- a quick and dirty usability scale. In: Usability Evaluation in Industry. Taylor & Francis; 1996:189-194."},{"issue":"6","key":"R39","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","article-title":"An empirical evaluation of the System Usability Scale","volume":"24","author":"Bangor","journal-title":"Int J Hum Comput Int"},{"issue":"9","key":"R40","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1177\/1049732305276687","article-title":"Three approaches to qualitative content analysis","volume":"15","author":"Hsieh","journal-title":"Qual Health Res"},{"issue":"2","key":"R41","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.nedt.2003.10.001","article-title":"Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness","volume":"24","author":"Graneheim","journal-title":"Nurse Educ Today"},{"key":"R42","doi-asserted-by":"crossref","unstructured":"Krippendorff K . Content Analysis: An Introduction to Its Methodology. SAGE Publications, Inc; 2019. [doi: 10.4135\/9781071878781] ISBN: 978-1-0718-7878-1","DOI":"10.4135\/9781071878781"},{"issue":"1","key":"R43","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1111\/j.1365-2648.2007.04569.x","article-title":"The qualitative content analysis process","volume":"62","author":"Elo","journal-title":"J Adv Nurs"},{"key":"R44","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.i6795","article-title":"Standards for Reporting Implementation Studies (StaRI) Statement","volume":"356","author":"Pinnock","journal-title":"BMJ"},{"key":"R45","unstructured":"AI role-plays for improving trainee competence in CBT: an feasibility and assessment study. OSF. URL: https:\/\/osf.io\/mskb7 [Accessed 14-02-2026]"},{"key":"R46","doi-asserted-by":"crossref","unstructured":"Wang R Milani S Chiu JC et al. PATIENT-\u03c8: using large language models to simulate patients for training mental health professionals. arXiv. Preprint posted online on Oct 3, 2024. [doi: 10.48550\/arXiv.2405.19660]","DOI":"10.18653\/v1\/2024.emnlp-main.711"},{"issue":"4","key":"R47","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1007\/s10447-011-9139-z","article-title":"Master\u2019s students\u2019 experiences in a multicultural counseling role-play","volume":"33","author":"Rapisarda","journal-title":"Int J Adv Counselling"},{"issue":"3","key":"R48","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1037\/pst0000015","article-title":"The role of deliberate practice in the development of highly effective psychotherapists","volume":"52","author":"Chow","journal-title":"Psychotherapy (Chic)"},{"key":"R49","doi-asserted-by":"crossref","unstructured":"Laurillard D . Rethinking University Teaching. 2nd ed. London: Routledge; [doi: 10.4324\/9781315012940] ISBN: 978-1-315-01294-0","DOI":"10.4324\/9781315012940"},{"key":"R50","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2025.104945","article-title":"From innovation to implementation: artificial intelligence in cognitive behaviour therapy training and supervision","volume":"197","author":"Shafran","journal-title":"Behav Res Ther"}],"container-title":["JMIR Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/mededu.jmir.org\/2026\/1\/e84091","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:18:14Z","timestamp":1782843494000},"score":1,"resource":{"primary":{"URL":"https:\/\/mededu.jmir.org\/2026\/1\/e84091"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,6]]},"references-count":50,"URL":"https:\/\/doi.org\/10.2196\/84091","relation":{},"ISSN":["2369-3762"],"issn-type":[{"value":"2369-3762","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,6]]},"article-number":"v12i2e84091"}}