{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T15:25:35Z","timestamp":1787066735310,"version":"build-2736575974"},"reference-count":60,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Educ"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Psychotherapy training is difficult to scale because manual rating of motivational interviewing (MI) and cognitive behavioral therapy (CBT) sessions is time-intensive, requires trained raters, and is subject to rater variability. Large language models (LLMs) may support simulation-based training and rubric-guided scoring, but early-stage evidence is needed before such systems can be applied to real learners.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to conduct a simulation-based evaluation of a multiagent LLM framework for generating and scoring stylized MI and CBT training encounters.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n We conducted a cross-sectional evaluation of a multiagent framework comprising Student, Patient, Evaluator, and Feedback agents. The Student agent conducted synthetic MI or CBT encounters with Patient agents derived from structured profiles. The Evaluator agent scored transcripts using study-specific MI and CBT scoring forms. Internal discrimination was tested across prompt-engineered novice, intermediate, and expert Student agent profiles using 133 MI and 102 CBT Patient profiles. Preliminary external grounding was assessed using 133 annotated motivational interviewing (AnnoMI) transcripts with coarse, metadata-derived, high\/low session-level quality labels. Agreement with a pragmatic human-rater benchmark was evaluated using 16 independent human raters per modality. Criterion-level comparisons used paired Wilcoxon signed-rank tests with Benjamini-Hochberg false discovery rate correction at\n q<\/jats:italic>\n <0.05. Agreement analyses used intraclass correlation coefficients (ICCs) with bootstrap 95% CIs. A secondary prompt-augmentation sensitivity analysis tested whether appending criterion-referenced feedback text to the novice Student-agent prompt shifted subsequent Evaluator-assigned scores.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Evaluator scores increased across prompt-defined Student-agent competence levels. For MI, overall mean scores increased from 1.18 (95% CI 1.16\u20101.20) for novice profiles to 1.75 (95% CI 1.69\u20101.81) for intermediate profiles and to 3.57 (95% CI 3.48\u20103.66) for expert profiles. For CBT, overall mean scores increased from 0.83 (95% CI 0.78\u20100.88) to 2.18 (95% CI 2.10\u20102.26) and 4.38 (95% CI 4.28\u20104.48), respectively. Criterion-level planned contrasts were significant after false discovery rate correction. On AnnoMI transcripts, Evaluator scores aligned with metadata-derived high\/low session labels, with 91.7% classification accuracy at the prespecified threshold. Human interrater reliability was an ICC(2,1) of 0.866 for MI and 0.769 for CBT. Evaluator-vs-human-consensus agreement was an ICC(2,1) of 0.959 for MI and 0.934 for CBT. In the secondary prompt-augmentation analysis, overall MI scores shifted from 1.18 to 1.44, and CBT scores shifted from 0.83 to 1.01.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This proof-of-concept study suggests that a rubric-guided multiagent LLM framework can score stylized synthetic MI and CBT transcripts along expected prompt-defined competence gradients and align with preliminary external and human-rater benchmarks. The study is innovative in separating synthetic learner, patient, scoring, and feedback-generation roles within a single simulation workflow, extending prior LLM work from plausible dialogue generation toward rubric-linked scoring. The findings support further development of scalable simulation tools for psychotherapy training research. Prospective studies with human trainees, standardized or real patients, and formal psychometric testing are required.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/92964","type":"journal-article","created":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T14:53:31Z","timestamp":1787064811000},"page":"e92964-e92964","source":"Crossref","is-referenced-by-count":0,"title":["Multiagent Large Language Model Framework for Psychotherapy Fidelity Assessment in Motivational Interviewing and Cognitive Behavioral Therapy Training: Cross-Sectional, Simulation-Based Evaluation Study"],"prefix":"10.2196","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1856-503X","authenticated-orcid":false,"given":"Mohammad Amin","family":"Kamaleddin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4070-590X","authenticated-orcid":false,"given":"Mina","family":"Mirjalili","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2831-4143","authenticated-orcid":false,"given":"Reza","family":"Barzegar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9143-8302","authenticated-orcid":false,"given":"Nghia","family":"Trung Le","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7634-5290","authenticated-orcid":false,"given":"Zachary","family":"Cote","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7297-1250","authenticated-orcid":false,"given":"Olga","family":"Winkler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9591-4355","authenticated-orcid":false,"given":"Lisa","family":"Burback","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2421-157X","authenticated-orcid":false,"given":"Yanbo","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0060-5988","authenticated-orcid":false,"given":"Osmar R","family":"Zaiane","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6179-0788","authenticated-orcid":false,"given":"Candice","family":"Monson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5022-697X","authenticated-orcid":false,"given":"Divya","family":"Sharma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4659-564X","authenticated-orcid":false,"given":"Sri","family":"Krishnan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9097-900X","authenticated-orcid":false,"given":"Andrew J","family":"Greenshaw","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3478-4483","authenticated-orcid":false,"given":"Richard","family":"Zeifman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5401-2996","authenticated-orcid":false,"given":"Peter","family":"Selby","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8768-1173","authenticated-orcid":false,"given":"Venkat","family":"Bhat","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,8,18]]},"reference":[{"issue":"3","key":"R1","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1080\/10503307.2024.2308159","article-title":"The influence of deliberate practice on skill performance in therapeutic practice: a systematic review of early studies","volume":"35","author":"Nurse","journal-title":"Psychother Res"},{"issue":"27","key":"R2","doi-asserted-by":"publisher","DOI":"10.1097\/MD.0000000000038813","article-title":"The impact of simulation-based training in medical education: a review","volume":"103","author":"Elendu","journal-title":"Medicine (Baltimore)"},{"issue":"2","key":"R3","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1097\/SIH.0000000000000189","article-title":"The effectiveness of medical simulation in teaching medical students critical care medicine: a systematic review and meta-analysis","volume":"12","author":"Beal","journal-title":"Simul Healthc"},{"issue":"12","key":"R4","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1111\/medu.13387","article-title":"Understanding the impact of simulated patients on health care learners\u2019 communication skills: a systematic review","volume":"51","author":"Kaplonyi","journal-title":"Med Educ"},{"issue":"3","key":"R5","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1080\/01421590600711252","article-title":"Teaching medical students using role play: twelve tips for successful role plays","volume":"28","author":"Joyner","journal-title":"Med Teach"},{"issue":"7","key":"R6","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1080\/10503307.2020.1722862","article-title":"The impact of alliance-focused and facilitative interpersonal relationship training on therapist skills: an RCT of brief training","volume":"30","author":"Perlman","journal-title":"Psychother Res"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.2196\/63082","article-title":"Virtual simulation tools for communication skills training in health care professionals: literature review","volume":"11","author":"Fern\u00e1ndez-Alc\u00e1ntara","journal-title":"JMIR Med Educ"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/79091","article-title":"Embracing the future of medical education with large language model-based virtual patients: scoping review","volume":"27","author":"Zeng","journal-title":"J Med Internet Res"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/69709","article-title":"A comparison of responses from human therapists and large language model-based chatbots to assess therapeutic communication: mixed methods study","volume":"12","author":"Scholich","journal-title":"JMIR Ment Health"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.clinpsy.1.102803.143833","article-title":"Motivational interviewing","volume":"1","author":"Hettema","journal-title":"Annu Rev Clin Psychol"},{"key":"R11","unstructured":"Beck JS . Cognitive Behavior Therapy: Basics and Beyond. 3rd ed. Guilford Publications; 2020. ISBN: 9781462544196"},{"key":"R12","unstructured":"Moyers TB Manuel JK Ernst D . Motivational Interviewing Treatment Integrity Coding Manual 4.2.1. University of New Mexico, Center on Alcoholism, Substance Abuse, and Addictions (CASAA); 2015. URL: https:\/\/casaa.unm.edu\/assets\/docs\/miti4_21.pdf [Accessed 28-07-2026]"},{"key":"R13","unstructured":"Miller WR Moyers TB Ernst D Amrhein P . Manual for the Motivational Interviewing Skill Code (MISC), Version 2.0. Center on Alcoholism, Substance Abuse and Addictions (CASAA), The University of New Mexico; 2003. URL: https:\/\/digitalcommons.montclair.edu\/cgi\/viewcontent.cgi?article=1026&context=psychology-facpubs [Accessed 28-07-2026]"},{"key":"R14","unstructured":"Young J Beck AT . Cognitive therapy scale rating manual. University of Pennsylvania; 1980. URL: https:\/\/static1.squarespace.com\/static\/60f6fb2c51d9421daf31868c\/t\/6103d250c8ffd964aa4fe413\/1627640400759\/CTRS_Manual.pdf [Accessed 28-07-2026]"},{"issue":"1","key":"R15","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1146\/annurev-clinpsy-061724-075336","article-title":"Artificial intelligence to support human-provided mental health treatment","volume":"22","author":"Soma","journal-title":"Annu Rev Clin Psychol"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.2196\/53562","article-title":"Automated behavioral coding to enhance the effectiveness of motivational interviewing in a chat-based suicide prevention helpline: secondary analysis of a clinical trial","volume":"26","author":"Pellemans","journal-title":"J Med Internet Res"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-025-07391-1","article-title":"Evaluating motivational interview quality using large language models and hidden Markov models","volume":"25","author":"Lim","journal-title":"BMC Psychiatry"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.2196\/57896","article-title":"Current status of ChatGPT use in medical education: potentials, challenges, and strategies","volume":"26","author":"Xu","journal-title":"J Med Internet Res"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.2196\/48291","article-title":"Large language models in medical education: opportunities, challenges, and future directions","volume":"9","author":"Abd-Alrazaq","journal-title":"JMIR Med Educ"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.2196\/59213","article-title":"A language model-powered simulated patient with automated feedback for history taking: prospective study","volume":"10","author":"Holderried","journal-title":"JMIR Med Educ"},{"issue":"6","key":"R21","doi-asserted-by":"publisher","DOI":"10.3390\/healthcare13060603","article-title":"A review of large language models in medical education, clinical decision support, and healthcare administration","volume":"13","author":"Vrdoljak","journal-title":"Healthcare (Basel)"},{"issue":"1","key":"R22","doi-asserted-by":"publisher","DOI":"10.1186\/s41077-025-00357-z","article-title":"From prompt to platform: an agentic AI workflow for healthcare simulation scenario design","volume":"10","author":"Barra","journal-title":"Adv Simul (Lond)"},{"key":"R23","doi-asserted-by":"crossref","unstructured":"Wei H Qiu J Yu H Yuan W . MEDCO: medical education copilots based on a multi-agent framework. In: Del Bue A Canton C Pont-Tuset J Tommasi T , editors. Computer Vision \u2013 ECCV 2024 Workshops Milan, Italy, September 29\u2013October 4, 2024, Proceedings, Part VIII. Springer; 2024:119-135. [doi: 10.1007\/978-3-031-91813-1_8]","DOI":"10.1007\/978-3-031-91813-1_8"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2025.103599","article-title":"AI Agents vs. Agentic AI: a conceptual taxonomy, applications and challenges","volume":"126","author":"Sapkota","journal-title":"Inf Fusion"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","DOI":"10.1038\/s43856-025-01283-x","article-title":"Simulated patient systems powered by large language model-based AI agents offer potential for transforming medical education","volume":"6","author":"Yu","journal-title":"Commun Med (Lond)"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1111\/bjet.13370","article-title":"Practical and ethical challenges of large language models in education: a systematic scoping review","volume":"55","author":"Yan","journal-title":"Brit J Educational Tech"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-01786-w","article-title":"Framework for bias evaluation in large language models in healthcare settings","volume":"8","author":"Templin","journal-title":"NPJ Digit Med"},{"issue":"1","key":"R28","doi-asserted-by":"publisher","DOI":"10.1038\/s44184-024-00056-z","article-title":"Large language models could change the future of behavioral healthcare: a proposal for responsible development and evaluation","volume":"3","author":"Stade","journal-title":"Npj Ment Health Res"},{"key":"R29","doi-asserted-by":"crossref","unstructured":"Yosef S Zisquit M Cohen B Klomek Brunstein A Bar K Friedman D . Assessing motivational interviewing sessions with AI-generated patient simulations. In: Ophir Y Desmet B Prud\u2019hommeaux E Zirikly A Bedrick S MacAvaney S Bar K Ireland M Ophir Y , editors. Proceedings of the 9th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2024). Association for Computational Linguistics; 2024:1-11. [doi: 10.18653\/v1\/2024.clpsych-1.1]","DOI":"10.18653\/v1\/2024.clpsych-1.1"},{"key":"R30","unstructured":"Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. American Psychiatric Association; 2013. URL: https:\/\/psychiatryonline.org\/doi\/book\/10.1176\/appi.books.9780890425596 [Accessed 31-07-2026]"},{"key":"R31","doi-asserted-by":"crossref","unstructured":"Wu Z Balloccu S Kumar V et al. Anno-MI: a dataset of expert-annotated counselling dialogues. In: ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE; 2022:6177-6181. [doi: 10.1109\/ICASSP43922.2022.9746035]","DOI":"10.1109\/ICASSP43922.2022.9746035"},{"issue":"5","key":"R32","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1038\/s41591-022-01772-9","article-title":"Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI","volume":"28","author":"Vasey","journal-title":"Nat Med"},{"key":"R33","unstructured":"Canadian Institutes of Health Research; Natural Sciences and Engineering Research Council of Canada; Social Sciences and Humanities Research Council of Canada (Tri-Council agencies). Tri-council policy statement: ethical conduct for research involving humans. Interagency Secretariat on Research Ethics; 2022. URL: https:\/\/ethics.gc.ca\/eng\/documents\/tcps2-2022-en.pdf [Accessed 28-07-2026]"},{"issue":"3","key":"R34","doi-asserted-by":"publisher","first-page":"110","DOI":"10.3390\/fi15030110","article-title":"Creation, analysis and evaluation of AnnoMI, a dataset of expert-annotated counselling dialogues","volume":"15","author":"Wu","journal-title":"Future Internet"},{"issue":"3","key":"R35","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1016\/j.anai.2021.12.010","article-title":"Assessment and feedback methods in competency-based medical education","volume":"128","author":"Lee","journal-title":"Ann Allergy Asthma Immunol"},{"issue":"6","key":"R36","doi-asserted-by":"publisher","DOI":"10.1016\/j.xinn.2025.101253","article-title":"A survey on LLM-as-a-judge","volume":"7","author":"Gu","journal-title":"Innovation (Camb)"},{"issue":"1","key":"R37","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01258-7","article-title":"A framework for human evaluation of large language models in healthcare derived from literature review","volume":"7","author":"Tam","journal-title":"NPJ Digit Med"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1186\/s41077-016-0033-y","article-title":"Validation of educational assessments: a primer for simulation and beyond","volume":"1","author":"Cook","journal-title":"Adv Simul (Lond)"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.1145\/3711896.3737393","article-title":"MentalChat16K: a benchmark dataset for conversational mental health assistance","volume":"2025","author":"Xu","journal-title":"KDD"},{"key":"R40","doi-asserted-by":"crossref","unstructured":"Zheng L Chiang WL Sheng Y et al. Judging LLM-as-a-judge with MT-bench and chatbot arena. In: Oh A Naumann T Globerson A Saenko K Hardt M Levine S , editors. NIPS \u201923: Proceedings of the 37th International Conference on Neural Information Processing Systems. Curran Associates Inc; 2023:46595-46623. URL: https:\/\/dl.acm.org\/doi\/10.5555\/3666122.3668142 [Accessed 28-07-2026]","DOI":"10.52202\/075280-2020"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.2196\/52597","article-title":"Large language models and empathy: systematic review","volume":"26","author":"Sorin","journal-title":"J Med Internet Res"},{"issue":"9","key":"R42","doi-asserted-by":"publisher","first-page":"978","DOI":"10.1001\/jama.2011.1234","article-title":"Technology-enhanced simulation for health professions education: a systematic review and meta-analysis","volume":"306","author":"Cook","journal-title":"JAMA"},{"issue":"2","key":"R43","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1037\/a0035753","article-title":"Treatment adherence: the importance of therapist flexibility in relation to therapy outcomes","volume":"61","author":"Owen","journal-title":"J Couns Psychol"},{"issue":"11","key":"R44","doi-asserted-by":"publisher","first-page":"946","DOI":"10.1016\/j.brat.2009.07.005","article-title":"Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: the promise of transdiagnostic interventions","volume":"47","author":"McHugh","journal-title":"Behav Res Ther"},{"issue":"4","key":"R45","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1037\/pst0000172","article-title":"The alliance in adult psychotherapy: a meta-analytic synthesis","volume":"55","author":"Fl\u00fcckiger","journal-title":"Psychotherapy (Chic)"},{"issue":"4","key":"R46","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1037\/pst0000185","article-title":"Alliance rupture repair: a meta-analysis","volume":"55","author":"Eubanks","journal-title":"Psychotherapy (Chic)"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.2196\/81271","article-title":"Large language model-based patient simulation to foster communication skills in health care professionals: user-centered development and usability study","volume":"11","author":"Elhilali","journal-title":"JMIR Med Educ"},{"key":"R48","doi-asserted-by":"crossref","unstructured":"Deng C Zhao Y Heng Y et al. Unveiling the spectrum of data contamination in language model: a survey from detection to remediation. In: Ku LW Martins A Srikumar V , editors. Findings of the Association for Computational Linguistics: ACL 2024. Association for Computational Linguistics; 2024:16078-16092. [doi: 10.18653\/v1\/2024.findings-acl.951]","DOI":"10.18653\/v1\/2024.findings-acl.951"},{"key":"R49","doi-asserted-by":"publisher","DOI":"10.2196\/57400","article-title":"Large language models for mental health applications: systematic review","volume":"11","author":"Guo","journal-title":"JMIR Ment Health"},{"issue":"1","key":"R50","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-01611-4","article-title":"A scoping review of large language models for generative tasks in mental health care","volume":"8","author":"Hua","journal-title":"NPJ Digit Med"},{"key":"R51","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2025.104849","article-title":"The effect of behavioral rehearsal in the training of clinical psychology students in cognitive therapy for social anxiety disorder: a randomized controlled trial","volume":"193","author":"Bjaastad","journal-title":"Behav Res Ther"},{"issue":"6","key":"R52","doi-asserted-by":"publisher","first-page":"1050","DOI":"10.1037\/0022-006X.72.6.1050","article-title":"A randomized trial of methods to help clinicians learn motivational interviewing","volume":"72","author":"Miller","journal-title":"J Consult Clin Psychol"},{"issue":"3","key":"R53","doi-asserted-by":"publisher","first-page":"472","DOI":"10.1037\/a0036158","article-title":"Evaluating therapist adherence in motivational interviewing by comparing performance with standardized and real patients","volume":"82","author":"Imel","journal-title":"J Consult Clin Psychol"},{"issue":"13","key":"R54","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1056\/NEJMsr2214184","article-title":"Benefits, limits, and risks of GPT-4 as an AI chatbot for medicine","volume":"388","author":"Lee","journal-title":"N Engl J Med"},{"key":"R55","doi-asserted-by":"publisher","DOI":"10.2196\/53164","article-title":"Hallucination rates and reference accuracy of ChatGPT and Bard for systematic reviews: comparative analysis","volume":"26","author":"Chelli","journal-title":"J Med Internet Res"},{"issue":"8067","key":"R56","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1038\/s41586-025-08866-7","article-title":"Towards conversational diagnostic artificial intelligence","volume":"642","author":"Tu","journal-title":"Nature"},{"key":"R57","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.00234","article-title":"The action of verbal and non-verbal communication in the therapeutic alliance construction: a mixed methods approach to assess the initial interactions with depressed patients","volume":"11","author":"Del Giacco","journal-title":"Front Psychol"},{"key":"R58","unstructured":"Spiliopoulou E et al. Play favorites: a statistical method to measure self-bias in LLM-as-a-judge. arXiv. Preprint posted online on Aug 8, 2025. [doi: 10.48550\/arXiv.2508.06709]"},{"key":"R59","unstructured":"Xu C Guan S Greene D Kechadi MT . Benchmark data contamination of large language models: a survey. arXiv. Preprint posted online on Jun 6, 2024. [doi: 10.48550\/arXiv.2406.04244]"},{"key":"R60","unstructured":"amin-kamaleddin\/MI-and-CBT-agent. GitHub. URL: https:\/\/github.com\/amin-kamaleddin\/MI-and-CBT-Agent [Accessed 28-07-2026]"}],"container-title":["JMIR Medical Education"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T14:53:38Z","timestamp":1787064818000},"score":1,"resource":{"primary":{"URL":"https:\/\/mededu.jmir.org\/2026\/1\/e92964"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,18]]},"references-count":60,"URL":"https:\/\/doi.org\/10.2196\/92964","relation":{},"ISSN":["2369-3762"],"issn-type":[{"value":"2369-3762","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,18]]},"article-number":"v12i3e92964"}}