{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T16:36:50Z","timestamp":1791391010163,"version":"4.3.3"},"publisher-location":"New York, NY, USA","reference-count":119,"publisher":"ACM","license":[{"start":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T00:00:00Z","timestamp":1776038400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/legalcode"}],"funder":[{"name":"Stanford Impact Labs","award":["Stage 1 Award"],"award-info":[{"award-number":["Stage 1 Award"]}]},{"name":"Stanford HAI","award":["Seed Grant"],"award-info":[{"award-number":["Seed Grant"]}]},{"name":"Stanford Psychiatry and Behavioral Sciences","award":["Department Innovator Award"],"award-info":[{"award-number":["Department Innovator Award"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,4,13]]},"DOI":"10.1145\/3772318.3791821","type":"proceedings-article","created":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T05:33:35Z","timestamp":1776058415000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Can LLM-Simulated Practice and Feedback Upskill Human Counselors? A Randomized Study with 90+ Novice Counselors"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7266-3688","authenticated-orcid":false,"given":"Ryan","family":"Louie","sequence":"first","affiliation":[{"name":"Computer Science Department, Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0847-8426","authenticated-orcid":false,"given":"Raj Sanjay","family":"Shah","sequence":"additional","affiliation":[{"name":"College of Computing, Georgia Institute of Technology, Atlanta, Georgia, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7402-3335","authenticated-orcid":false,"given":"Ifdita Hasan","family":"Orney","sequence":"additional","affiliation":[{"name":"Computer Science Department, Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9949-9174","authenticated-orcid":false,"given":"Juan Pablo","family":"Pacheco","sequence":"additional","affiliation":[{"name":"Computer Science Department, Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3971-7127","authenticated-orcid":false,"given":"Emma","family":"Brunskill","sequence":"additional","affiliation":[{"name":"Computer Science Department, Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1220-3983","authenticated-orcid":false,"given":"Diyi","family":"Yang","sequence":"additional","affiliation":[{"name":"Computer Science Department, Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,4,13]]},"reference":[{"key":"e_1_3_3_3_2_2","doi-asserted-by":"publisher","unstructured":"Muhammad Abbas Farooq\u00a0Ahmed Jam and Tariq\u00a0Iqbal Khan. 2024. Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students. International Journal of Educational Technology in Higher Education 21 1 (2024) 10. 10.1186\/s41239-024-00444-7","DOI":"10.1186\/s41239-024-00444-7"},{"key":"e_1_3_3_3_3_2","doi-asserted-by":"publisher","unstructured":"Glenn Albright Cyrille Adam Deborah Serri Seth Bleeker and Ron Goldman. 2016. Harnessing the power of conversations with virtual humans to change health behaviors. Mhealth 2 (2016) 44. 10.21037\/mhealth.2016.11.02","DOI":"10.21037\/mhealth.2016.11.02"},{"key":"e_1_3_3_3_4_2","doi-asserted-by":"publisher","unstructured":"Guillaume Alinier and Denis Oriot. 2022. Simulation-based education: deceiving learners with good intent. Advances in Simulation 7 1 (March 2022) 8. 10.1186\/s41077-022-00206-3","DOI":"10.1186\/s41077-022-00206-3"},{"key":"e_1_3_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_3_3_3_6_2","doi-asserted-by":"publisher","unstructured":"Ivon Arroyo Beverly\u00a0Park Woolf Winslow Burelson Kasia Muldner Dovan Rai and Minghui Tai. 2014. A multimedia adaptive tutoring system for mathematics that addresses cognition metacognition and affect. International Journal of Artificial Intelligence in Education 24 4 (2014) 387\u2013426. 10.1007\/s40593-014-0023-y","DOI":"10.1007\/s40593-014-0023-y"},{"key":"e_1_3_3_3_7_2","doi-asserted-by":"publisher","unstructured":"David\u00a0C Atkins Mark Steyvers Zac\u00a0E Imel and Padhraic Smyth. 2014. Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification. Implementation Science 9 1 (2014) 1\u201311. 10.1186\/1748-5908-9-49","DOI":"10.1186\/1748-5908-9-49"},{"key":"e_1_3_3_3_8_2","doi-asserted-by":"publisher","unstructured":"Destina\u00a0Sevde Ay-Bryson Florian Weck and Franziska K\u00fchne. 2023. Can students in simulation portray a psychotherapy patient authentically with a detailed role-script? Results of a randomized-controlled study. Training and Education in Professional Psychology 17 1 (2023) 89. 10.1037\/tep0000388","DOI":"10.1037\/tep0000388"},{"key":"e_1_3_3_3_9_2","doi-asserted-by":"publisher","unstructured":"Ebrahim Babaei Tilman Dingler Benjamin Tag and Eduardo Velloso. 2025. Should we use the NASA-TLX in HCI? A review of theoretical and methodological issues around Mental Workload Measurement. International Journal of Human-Computer Studies (2025) 103515. 10.2139\/ssrn.4869368","DOI":"10.2139\/ssrn.4869368"},{"key":"e_1_3_3_3_10_2","doi-asserted-by":"publisher","unstructured":"Hamsa Bastani Osbert Bastani Alp Sungu Haosen Ge \u00d6zge Kabakc\u0131 and Rei Mariman. 2025. Generative AI without guardrails can harm learning: Evidence from high school mathematics. Proceedings of the National Academy of Sciences 122 26 (2025) e2422633122. arXiv:https:\/\/www.pnas.org\/doi\/pdf\/10.1073\/pnas.242263312210.1073\/pnas.2422633122","DOI":"10.1073\/pnas.2422633122"},{"key":"e_1_3_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641998"},{"key":"e_1_3_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Yoav Benjamini and Yosef Hochberg. 1995. Controlling the False Discovery Rate: a Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society: Series B (Methodological) 57 1 (1995) 289\u2013300.","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_3_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3715336.3735810"},{"key":"e_1_3_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-tutorials.6"},{"key":"e_1_3_3_3_15_2","doi-asserted-by":"publisher","unstructured":"Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3 2 (2006) 77\u2013101. arXiv:https:\/\/www.tandfonline.com\/doi\/pdf\/10.1191\/1478088706qp063oa10.1191\/1478088706qp063oa","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_3_3_16_2","doi-asserted-by":"publisher","unstructured":"Zana Bu\u00e7inca Maja\u00a0Barbara Malaya and Krzysztof\u00a0Z. Gajos. 2021. To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making. Proc. ACM Hum.-Comput. Interact. 5 CSCW1 Article 188 (April 2021) 21\u00a0pages. 10.1145\/3449287","DOI":"10.1145\/3449287"},{"key":"e_1_3_3_3_17_2","doi-asserted-by":"publisher","unstructured":"Katie\u00a0A Burmester Jai\u00a0P Ahluwalia Robert\u00a0J Ploutz-Snyder and Stephen Strobbe. 2019. Interactive computer simulation for adolescent screening brief intervention and referral to treatment (SBIRT) for substance use in an undergraduate nursing program. Journal of pediatric nursing 49 (2019) 31\u201336. 10.1016\/j.pedn.2019.08.012","DOI":"10.1016\/j.pedn.2019.08.012"},{"key":"e_1_3_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.21437\/interspeech.2012-134"},{"key":"e_1_3_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.227"},{"key":"e_1_3_3_3_20_2","doi-asserted-by":"publisher","unstructured":"Siyuan Chen Mengyue Wu Kenny\u00a0Q Zhu Kunyao Lan Zhiling Zhang and Lyuchun Cui. 2023. LLM-empowered chatbots for psychiatrist and patient simulation: application and evaluation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2305.13614 (2023). 10.48550\/arXiv.2305.13614","DOI":"10.48550\/arXiv.2305.13614"},{"key":"e_1_3_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.669"},{"key":"e_1_3_3_3_22_2","doi-asserted-by":"publisher","unstructured":"Yu\u00a0Ying Chiu Ashish Sharma Inna\u00a0Wanyin Lin and Tim Althoff. 2024. A Computational Framework for Behavioral Assessment of LLM Therapists. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2401.00820 (2024). 10.48550\/arXiv.2401.00820","DOI":"10.48550\/arXiv.2401.00820"},{"key":"e_1_3_3_3_23_2","doi-asserted-by":"publisher","unstructured":"Sarah\u00a0C Cook Ann\u00a0C Schwartz and Nadine\u00a0J Kaslow. 2017. Evidence-based psychotherapy: Advantages and challenges. Neurotherapeutics 14 (2017) 537\u2013545. 10.1007\/s13311-017-0549-4","DOI":"10.1007\/s13311-017-0549-4"},{"key":"e_1_3_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642134"},{"key":"e_1_3_3_3_25_2","doi-asserted-by":"publisher","unstructured":"Sidney D\u2019mello and Art Graesser. 2013. AutoTutor and affective autotutor: Learning by talking with cognitively and emotionally intelligent computers that talk back. ACM Trans. Interact. Intell. Syst. 2 4 Article 23 (Jan. 2013) 39\u00a0pages. 10.1145\/2395123.2395128","DOI":"10.1145\/2395123.2395128"},{"key":"e_1_3_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.63"},{"key":"e_1_3_3_3_27_2","doi-asserted-by":"publisher","unstructured":"Robert Elliott Arthur\u00a0C Bohart Jeanne\u00a0C Watson and David Murphy. 2018. Therapist empathy and client outcome: An updated meta-analysis. Psychotherapy 55 4 (2018) 399. 10.1037\/pst0000175.supp","DOI":"10.1037\/pst0000175.supp"},{"key":"e_1_3_3_3_28_2","doi-asserted-by":"publisher","unstructured":"K\u00a0Anders Ericsson et\u00a0al. 2006. The influence of experience and deliberate practice on the development of superior expert performance. The Cambridge handbook of expertise and expert performance 38 685-705 (2006) 2\u20132. 10.1017\/cbo9780511816796.038","DOI":"10.1017\/cbo9780511816796.038"},{"key":"e_1_3_3_3_29_2","doi-asserted-by":"publisher","unstructured":"Kevin\u00a0W Eva and Glenn Regehr. 2005. Self-assessment in the health professions: a reformulation and research agenda. Academic medicine 80 10 (2005) S46\u2013S54. 10.1097\/00001888-200510001-00015","DOI":"10.1097\/00001888-200510001-00015"},{"key":"e_1_3_3_3_30_2","doi-asserted-by":"publisher","unstructured":"Nikolaos Flemotomos Victor\u00a0R Martinez Zhuohao Chen Torrey\u00a0A Creed David\u00a0C Atkins and Shrikanth Narayanan. 2021. Automated quality assessment of cognitive behavioral therapy sessions through highly contextualized language representations. PloS one 16 10 (2021) e0258639. 10.1371\/journal.pone.0258639","DOI":"10.1371\/journal.pone.0258639"},{"key":"e_1_3_3_3_31_2","doi-asserted-by":"publisher","unstructured":"Hannah\u00a0E Frank Emily\u00a0M Becker-Haimes and Philip\u00a0C Kendall. 2020. Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes. Clinical psychology: Science and practice 27 3 (2020) 20. 10.1111\/cpsp.12330","DOI":"10.1111\/cpsp.12330"},{"key":"e_1_3_3_3_32_2","doi-asserted-by":"publisher","unstructured":"Ella Glikson and Anita\u00a0Williams Woolley. 2020. Human trust in artificial intelligence: Review of empirical research. Academy of management annals 14 2 (2020) 627\u2013660. 10.5465\/annals.2018.0057","DOI":"10.5465\/annals.2018.0057"},{"key":"e_1_3_3_3_33_2","doi-asserted-by":"publisher","unstructured":"Simon\u00a0B Goldberg Michael Tanana Shaakira\u00a0Haywood Stewart Camille\u00a0Y Williams Christina\u00a0S Soma David\u00a0C Atkins Zac\u00a0E Imel and Jesse Owen. 2024. Automating the assessment of multicultural orientation through machine learning and natural language processing. Psychotherapy (2024). 10.1037\/pst0000519.supp","DOI":"10.1037\/pst0000519.supp"},{"key":"e_1_3_3_3_34_2","doi-asserted-by":"publisher","unstructured":"Daniela Hahn Florian Weck Michael Witth\u00f6ft and Franziska K\u00fchne. 2021. Assessment of counseling self-efficacy: validation of the German Counselor Activity Self-Efficacy scales-revised. Frontiers in psychology 12 (2021) 780088. 10.3389\/fpsyg.2021.780088","DOI":"10.3389\/fpsyg.2021.780088"},{"key":"e_1_3_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/w15-4616"},{"key":"e_1_3_3_3_36_2","doi-asserted-by":"publisher","unstructured":"Michael\u00a0V. Heinz Daniel\u00a0M. Mackin Brianna\u00a0M. Trudeau Sukanya Bhattacharya Yinzhou Wang Haley\u00a0A. Banta Abi\u00a0D. Jewett Abigail\u00a0J. Salzhauer Tess\u00a0Z. Griffin and Nicholas\u00a0C. Jacobson. 2025. Randomized Trial of a Generative AI Chatbot for Mental Health Treatment. NEJM AI 2 4 (2025) AIoa2400802. 10.1056\/AIoa2400802","DOI":"10.1056\/AIoa2400802"},{"key":"e_1_3_3_3_37_2","doi-asserted-by":"publisher","unstructured":"Peter\u00a0Eric Heinze Florian Weck Ulrike Maa\u00df and Franziska K\u00fchne. 2024. The relation between knowledge and skills assessments in psychotherapy training: Secondary analysis of a randomized controlled trial. Training and Education in Professional Psychology 18 2 (2024) 162. 10.1037\/tep0000463","DOI":"10.1037\/tep0000463"},{"key":"e_1_3_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1037\/14345-000"},{"key":"e_1_3_3_3_39_2","doi-asserted-by":"publisher","unstructured":"Clara\u00a0E Hill and Ian\u00a0S Kellems. 2002. Development and use of the helping skills measure to assess client perceptions of the effects of training and of helping skills in sessions. Journal of Counseling Psychology 49 2 (2002) 264. 10.1037\/0022-0167.49.2.264","DOI":"10.1037\/0022-0167.49.2.264"},{"key":"e_1_3_3_3_40_2","doi-asserted-by":"crossref","unstructured":"Clara\u00a0E Hill and Emilie\u00a0Y Nakayama. 2000. Client-centered therapy: where has it been and where is it going? A comment on Hathaway (1948). Journal of Clinical Psychology 56 7 (2000) 861\u2013875.","DOI":"10.1002\/1097-4679(200007)56:7<861::AID-JCLP5>3.0.CO;2-J"},{"key":"e_1_3_3_3_41_2","doi-asserted-by":"publisher","unstructured":"Shang-Ling Hsu Raj\u00a0Sanjay Shah Prathik Senthil Zahra Ashktorab Casey Dugan Werner Geyer and Diyi Yang. 2025. Helping the Helper: Supporting Peer Counselors via AI-Empowered Practice and Feedback. Proc. ACM Hum.-Comput. Interact. 9 2 Article CSCW095 (May 2025) 45\u00a0pages. 10.1145\/3710993","DOI":"10.1145\/3710993"},{"key":"e_1_3_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/d18-1074"},{"key":"e_1_3_3_3_43_2","doi-asserted-by":"publisher","unstructured":"Juan\u00a0Enrique Huerta-Wong and Richard Schoech. 2010. EXPERIENTIAL LEARNING AND LEARNING ENVIRONMENTS: THE CASE OF ACTIVE LISTENING SKILLS. Journal of Social Work Education 46 1 (2010) 85\u2013101. 10.5175\/JSWE.2010.200800105","DOI":"10.5175\/JSWE.2010.200800105"},{"key":"e_1_3_3_3_44_2","doi-asserted-by":"publisher","unstructured":"Joanna\u00a0Joy Hunsmann Destina\u00a0Sevde Ay-Bryson Scarlett Kobs Nicole Behrend Florian Weck Michel Knigge and Franziska K\u00fchne. 2024. Basic counseling skills in psychology and teaching: validation of a short version of the counselor activity self-efficacy scales. BMC psychology 12 1 (2024) 32. 10.1186\/s40359-023-01506-7","DOI":"10.1186\/s40359-023-01506-7"},{"key":"e_1_3_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642773"},{"key":"e_1_3_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3713278"},{"key":"e_1_3_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.findings-acl.1332"},{"key":"e_1_3_3_3_48_2","doi-asserted-by":"publisher","unstructured":"Predrag Klasnja Eric\u00a0B Hekler Saul Shiffman Audrey Boruvka Daniel Almirall Ambuj Tewari and Susan\u00a0A Murphy. 2015. Microrandomized trials: An experimental design for developing just-in-time adaptive interventions. Health Psychology 34 S (2015) 1220. 10.1037\/hea0000305","DOI":"10.1037\/hea0000305"},{"key":"e_1_3_3_3_49_2","doi-asserted-by":"publisher","unstructured":"Justin Kruger and David Dunning. 1999. Unskilled and unaware of it: how difficulties in recognizing one\u2019s own incompetence lead to inflated self-assessments. Journal of personality and social psychology 77 6 (1999) 1121. 10.1037\/0022-3514.77.6.1121","DOI":"10.1037\/0022-3514.77.6.1121"},{"key":"e_1_3_3_3_50_2","doi-asserted-by":"publisher","unstructured":"Franziska Kuehne Destina\u00a0Sevde Ay Mara\u00a0Jasmin Otterbeck and Florian Weck. 2018. Standardized patients in clinical psychology and psychotherapy: A scoping review of barriers and facilitators for implementation. Academic Psychiatry 42 6 (2018) 773\u2013781. 10.1007\/s40596-018-0886-6","DOI":"10.1007\/s40596-018-0886-6"},{"key":"e_1_3_3_3_51_2","doi-asserted-by":"publisher","unstructured":"Franziska K\u00fchne Peter\u00a0Eric Heinze and Florian Weck. 2020. Standardized patients in psychotherapy training and clinical supervision: study protocol for a randomized controlled trial. Trials 21 1 (2020) 276. 10.1186\/s13063-020-4172-z","DOI":"10.1186\/s13063-020-4172-z"},{"key":"e_1_3_3_3_52_2","volume-title":"Supply and Distribution of the Behavioral Health Workforce in Rural America","author":"Larson Eric\u00a0H.","year":"2017","unstructured":"Eric\u00a0H. Larson, Davis\u00a0G. Patterson, Lisa\u00a0A. Garberson, and C.\u00a0Holly\u00a0A. Andrilla. 2017. Supply and Distribution of the Behavioral Health Workforce in Rural America. Data Brief. Rural Health Research Center, WWAMI Rural Health Research Center. https:\/\/academyhealth.confex.com\/academyhealth\/2017arm\/meetingapp.cgi\/Paper\/17105"},{"key":"e_1_3_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.findings-acl.118"},{"key":"e_1_3_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642697"},{"key":"e_1_3_3_3_55_2","unstructured":"Mina Lee Megha Srivastava Amelia Hardy John Thickstun Esin Durmus Ashwin Paranjape Ines Gerard-Ursin Xiang\u00a0Lisa Li Faisal Ladhak Frieda Rong et\u00a0al. [n. d.]. Evaluating Human-Language Model Interaction. Transactions on Machine Learning Research ([n. d.]). https:\/\/openreview.net\/pdf?id=hjDYJUn9l1"},{"key":"e_1_3_3_3_56_2","doi-asserted-by":"publisher","unstructured":"Robert\u00a0W Lent Clara\u00a0E Hill and Mary\u00a0Ann Hoffman. 2003. Development and validation of the counselor activity self-efficacy scales. Journal of counseling Psychology 50 1 (2003) 97. 10.1037\/0022-0167.50.1.97","DOI":"10.1037\/0022-0167.50.1.97"},{"key":"e_1_3_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-emnlp.69"},{"key":"e_1_3_3_3_58_2","doi-asserted-by":"publisher","unstructured":"Q\u00a0Vera Liao and Ziang Xiao. 2023. Rethinking model evaluation as narrowing the socio-technical gap. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2306.03100 (2023). 10.48550\/arXiv.2306.03100","DOI":"10.48550\/arXiv.2306.03100"},{"key":"e_1_3_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.47"},{"key":"e_1_3_3_3_60_2","doi-asserted-by":"publisher","unstructured":"Chunfeng Liu Karen\u00a0M. Scott Renee\u00a0L. Lim Silas Taylor and Rafael\u00a0A. Calvo. 2016. EQClinic: a platform for learning communication skills in clinical consultations. Medical Education Online 21 1 (2016) 31801. 10.3402\/meo.v21.31801PMID: 28166006.","DOI":"10.3402\/meo.v21.31801"},{"key":"e_1_3_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-main.591"},{"key":"e_1_3_3_3_62_2","doi-asserted-by":"publisher","unstructured":"Ulrike Maa\u00df Klara Eisert Jasmin Ghalib Franziska K\u00fchne and Florian Weck. 2025. Live versus delayed supervision: A randomized controlled trial with psychology students. Psychotherapy (2025). 10.1037\/pst0000572","DOI":"10.1037\/pst0000572"},{"key":"e_1_3_3_3_63_2","doi-asserted-by":"publisher","unstructured":"Ulrike Maa\u00df Franziska K\u00fchne Destina\u00a0Sevde Ay-Bryson Peter\u00a0Eric Heinze and Florian Weck. 2024. Efficacy of live-supervision regarding skills anxiety and self-efficacy: a randomized controlled trial. The Clinical Supervisor 43 1 (2024) 1\u201321. 10.1080\/07325223.2023.2267528","DOI":"10.1080\/07325223.2023.2267528"},{"key":"e_1_3_3_3_64_2","doi-asserted-by":"publisher","unstructured":"Brooke\u00a0N Macnamara Ibrahim Berber M\u00a0Cenk \u00c7avu\u015fo\u011flu Elizabeth\u00a0A Krupinski Naren Nallapareddy Noelle\u00a0E Nelson Philip\u00a0J Smith Amy\u00a0L Wilson-Delfosse and Soumya Ray. 2024. Does using artificial intelligence assistance accelerate skill decay and hinder skill development without performers\u2019 awareness? Cognitive Research: Principles and Implications 9 1 (2024) 46. 10.1186\/s41235-024-00572-8","DOI":"10.1186\/s41235-024-00572-8"},{"key":"e_1_3_3_3_65_2","doi-asserted-by":"publisher","unstructured":"Sruti Mallik and Ahana Gangopadhyay. 2023. Proactive and reactive engagement of artificial intelligence methods for education: a review. Frontiers in artificial intelligence 6 (2023) 1151391. 10.3389\/frai.2023.1151391","DOI":"10.3389\/frai.2023.1151391"},{"key":"e_1_3_3_3_66_2","volume-title":"Counseling and therapy skills","author":"Martin David\u00a0G","year":"2024","unstructured":"David\u00a0G Martin and Edward\u00a0A Johnson. 2024. Counseling and therapy skills. Waveland Press."},{"key":"e_1_3_3_3_67_2","doi-asserted-by":"publisher","unstructured":"Timothy\u00a0R. McIntosh Teo Susnjak Nalin Arachchilage Tong Liu Dan Xu Paul Watters and Malka\u00a0N. Halgamuge. 2026. Inadequacies of Large Language Model Benchmarks in the Era of Generative Artificial Intelligence. IEEE Transactions on Artificial Intelligence 7 1 (2026) 22\u201339. 10.1109\/TAI.2025.3569516","DOI":"10.1109\/TAI.2025.3569516"},{"key":"e_1_3_3_3_68_2","volume-title":"Manual for the motivational interviewing skill code (misc). Unpublished manuscript","author":"Miller William\u00a0R","year":"2003","unstructured":"William\u00a0R Miller, Theresa\u00a0B Moyers, Denise Ernst, and Paul Amrhein. 2003. Manual for the motivational interviewing skill code (misc). Unpublished manuscript. Albuquerque: Center on Alcoholism, Substance Abuse and Addictions, University of New Mexico."},{"key":"e_1_3_3_3_69_2","volume-title":"Motivational interviewing: Helping people change","author":"Miller William\u00a0R","year":"2012","unstructured":"William\u00a0R Miller and Stephen Rollnick. 2012. Motivational interviewing: Helping people change. Guilford press."},{"key":"e_1_3_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.11"},{"key":"e_1_3_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.690"},{"key":"e_1_3_3_3_72_2","doi-asserted-by":"publisher","unstructured":"Hemangi Modi K Orgera and A Grover. 2022. Exploring barriers to mental health care in the US. Research and Action Institute 10 (2022). 10.15766\/rai_a3ewcf9p","DOI":"10.15766\/rai_a3ewcf9p"},{"key":"e_1_3_3_3_73_2","doi-asserted-by":"publisher","unstructured":"Lauren\u00a0H Moran Sadie\u00a0C Kee Christopher\u00a0W Wiese Rosa\u00a0I Arriaga Saeed Abdullah and Andrew\u00a0M Sherrill. 2025. Artificial Intelligence as a Feedback Teammate for Treatment Delivery: Cognitive Behavioral Therapists\u2019 Hopes and Fears. Cognitive and Behavioral Practice (2025). 10.1016\/j.cbpra.2025.06.007","DOI":"10.1016\/j.cbpra.2025.06.007"},{"key":"e_1_3_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3514197.3549679"},{"key":"e_1_3_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.1016\/s0005-7967(97)84644-x"},{"key":"e_1_3_3_3_76_2","unstructured":"Hanh\u00a0T. Nguyen. 2003. The development of communication skills in the practice of patient consultation among pharmacy students. Ph.\u00a0D. Dissertation. https:\/\/www.proquest.com\/dissertations-theses\/development-communication-skills-practice-patient\/docview\/305282457\/se-2 Copyright - Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works; Last updated - 2023-03-03."},{"key":"e_1_3_3_3_77_2","doi-asserted-by":"publisher","unstructured":"John\u00a0C Norcross and Michael\u00a0J Lambert. 2018. Psychotherapy relationships that work III. Psychotherapy 55 4 (2018) 303. 10.1037\/pst0000193","DOI":"10.1037\/pst0000193"},{"key":"e_1_3_3_3_78_2","doi-asserted-by":"publisher","unstructured":"Julia Othlinghaus-Wulhorst and H.\u00a0Ulrich Hoppe. 2020. A Technical and Conceptual Framework for Serious Role-Playing Games in the Area of Social Skill Training. Frontiers in Computer Science 2 (2020). 10.3389\/fcomp.2020.00028","DOI":"10.3389\/fcomp.2020.00028"},{"key":"e_1_3_3_3_79_2","doi-asserted-by":"publisher","unstructured":"Lawrence\u00a0A Palinkas Sarah\u00a0M Horwitz Carla\u00a0A Green Jennifer\u00a0P Wisdom Naihua Duan and Kimberly Hoagwood. 2015. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and policy in mental health and mental health services research 42 5 (2015) 533\u2013544. 10.1007\/s10488-013-0528-y","DOI":"10.1007\/s10488-013-0528-y"},{"key":"e_1_3_3_3_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445410"},{"key":"e_1_3_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/e17-1106"},{"key":"e_1_3_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/p19-1088"},{"key":"e_1_3_3_3_83_2","unstructured":"Nathaniel\u00a0J Raskin and Carl\u00a0R Rogers. 2005. Person-centered therapy. (2005)."},{"key":"e_1_3_3_3_84_2","doi-asserted-by":"crossref","unstructured":"Benjamin\u00a0A Rein Daniel\u00a0W McNeil Allison\u00a0R Hayes T\u00a0Anne Hawkins H\u00a0Mei Ng and Catherine\u00a0A Yura. 2018. Evaluation of an avatar-based training program to promote suicide prevention awareness in a college setting. Journal of American college health 66 5 (2018) 401\u2013411.","DOI":"10.1080\/07448481.2018.1432626"},{"key":"e_1_3_3_3_85_2","doi-asserted-by":"publisher","DOI":"10.15439\/2024f1649"},{"key":"e_1_3_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531912"},{"key":"e_1_3_3_3_87_2","doi-asserted-by":"publisher","unstructured":"Antoinette Schoenthaler Glenn Albright Judith Hibbard and Ron Goldman. 2017. Simulated conversations with virtual humans to improve patient-provider communication and reduce unnecessary prescriptions for antibiotics: a repeated measure pilot study. JMIR medical education 3 1 (2017) e6305. 10.2196\/mededu.6305","DOI":"10.2196\/mededu.6305"},{"key":"e_1_3_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.4324\/9781315237473"},{"key":"e_1_3_3_3_89_2","doi-asserted-by":"publisher","unstructured":"Craig\u00a0S Schwalbe Hans\u00a0Y Oh and Allen Zweben. 2014. Sustaining motivational interviewing: A meta-analysis of training studies. Addiction 109 8 (2014) 1287\u20131294. 10.1111\/add.12558","DOI":"10.1111\/add.12558"},{"key":"e_1_3_3_3_90_2","doi-asserted-by":"publisher","unstructured":"Raj\u00a0Sanjay Shah Faye Holt Shirley\u00a0Anugrah Hayati Aastha Agarwal Yi-Chia Wang Robert\u00a0E Kraut and Diyi Yang. 2022. Modeling Motivational Interviewing Strategies On An Online Peer-to-Peer Counseling Platform. Proceedings of the ACM on Human-Computer Interaction 6 CSCW2 (2022) 1\u201324. 10.1145\/3555640","DOI":"10.1145\/3555640"},{"key":"e_1_3_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642159"},{"key":"e_1_3_3_3_92_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3450097"},{"key":"e_1_3_3_3_93_2","doi-asserted-by":"publisher","unstructured":"Ashish Sharma Inna\u00a0W Lin Adam\u00a0S Miner David\u00a0C Atkins and Tim Althoff. 2023. Human\u2013AI collaboration enables more empathic conversations in text-based peer-to-peer mental health support. Nature Machine Intelligence 5 1 (2023) 46\u201357. 10.1038\/s42256-022-00593-2","DOI":"10.1038\/s42256-022-00593-2"},{"key":"e_1_3_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.425"},{"key":"e_1_3_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.221"},{"key":"e_1_3_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.sigdial-1.2"},{"key":"e_1_3_3_3_97_2","doi-asserted-by":"publisher","unstructured":"Sujin Shin Jin-Hwa Park and Jung-Hee Kim. 2015. Effectiveness of patient simulation in nursing education: meta-analysis. Nurse education today 35 1 (2015) 176\u2013182. 10.1016\/j.nedt.2014.09.009","DOI":"10.1016\/j.nedt.2014.09.009"},{"key":"e_1_3_3_3_98_2","unstructured":"Skillsetter. 2024. How it works. https:\/\/www.skillsetter.com\/how-it-works. Accessed: 29 March 2024."},{"key":"e_1_3_3_3_99_2","doi-asserted-by":"publisher","unstructured":"Logan Stapleton Jordan Taylor Sarah Fox Tongshuang Wu and Haiyi Zhu. 2023. Seeing Seeds Beyond Weeds: Green Teaming Generative AI for Beneficial Uses. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2306.03097 (2023). 10.48550\/arXiv.2306.03097","DOI":"10.48550\/arXiv.2306.03097"},{"key":"e_1_3_3_3_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3714014"},{"key":"e_1_3_3_3_101_2","volume-title":"Key substance use and mental health indicators in the United States: Results from the 2023 National Survey on Drug Use and Health","author":"Administration Substance Abuse and Mental Health Services","year":"2024","unstructured":"Substance Abuse and Mental Health Services Administration. 2024. Key substance use and mental health indicators in the United States: Results from the 2023 National Survey on Drug Use and Health. Technical Report HHS Publication No. PEP24-07-021, NSDUH Series H-59. Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration. https:\/\/www.samhsa.gov\/data\/report\/2023-nsduh-annual-national-report"},{"key":"e_1_3_3_3_102_2","doi-asserted-by":"publisher","unstructured":"Gail\u00a0M Sullivan. 2011. Getting off the \u201cgold standard\u201d: Randomized controlled trials and education research. Journal of graduate medical education 3 3 (2011) 285\u2013289. 10.4300\/jgme-d-11-00147.1","DOI":"10.4300\/jgme-d-11-00147.1"},{"key":"e_1_3_3_3_103_2","doi-asserted-by":"publisher","unstructured":"Michael Tanana Kevin\u00a0A Hallgren Zac\u00a0E Imel David\u00a0C Atkins and Vivek Srikumar. 2016. A comparison of natural language processing methods for automated coding of motivational interviewing. Journal of substance abuse treatment 65 (2016) 43\u201350. 10.1016\/j.jsat.2016.01.006","DOI":"10.1016\/j.jsat.2016.01.006"},{"key":"e_1_3_3_3_104_2","doi-asserted-by":"publisher","unstructured":"Michael\u00a0J Tanana Christina\u00a0S Soma Vivek Srikumar David\u00a0C Atkins and Zac\u00a0E Imel. 2019. Development and evaluation of ClientBot: Patient-like conversational agent to train basic counseling skills. Journal of medical Internet research 21 7 (2019) e12529. 10.2196\/12529","DOI":"10.2196\/12529"},{"key":"e_1_3_3_3_105_2","doi-asserted-by":"publisher","unstructured":"Mohsen Tavakol and Reg Dennick. 2011. Making sense of Cronbach\u2019s alpha. International journal of medical education 2 (2011) 53. 10.5116\/ijme.4dfb.8dfd","DOI":"10.5116\/ijme.4dfb.8dfd"},{"key":"e_1_3_3_3_106_2","doi-asserted-by":"publisher","unstructured":"Bruce\u00a0E Wampold. 2015. How important are the common factors in psychotherapy? An update. World psychiatry 14 3 (2015) 270\u2013277. 10.1002\/wps.20238","DOI":"10.1002\/wps.20238"},{"key":"e_1_3_3_3_107_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-main.711"},{"key":"e_1_3_3_3_108_2","doi-asserted-by":"publisher","unstructured":"Tony Wang Amy\u00a0S Bruckman and Diyi Yang. 2025. The Practice of Online Peer Counseling and the Potential for AI-Powered Support Tools. Proceedings of the ACM on Human-Computer Interaction 9 2 (2025) 1\u201333. 10.1145\/3711089","DOI":"10.1145\/3711089"},{"key":"e_1_3_3_3_109_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581372"},{"key":"e_1_3_3_3_110_2","doi-asserted-by":"publisher","DOI":"10.1002\/9781118846360"},{"key":"e_1_3_3_3_111_2","unstructured":"Laura Weidinger Maribeth Rauh Nahema Marchal Arianna Manzini Lisa\u00a0Anne Hendricks Juan Mateos-Garcia Stevie Bergman Jackie Kay Conor Griffin Ben Bariach et\u00a0al. 2023. Sociotechnical safety evaluation of generative ai systems. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2310.11986 (2023). https:\/\/arxiv.org\/abs\/2310.11986"},{"key":"e_1_3_3_3_112_2","doi-asserted-by":"publisher","unstructured":"Sue Wheeler and Kaye Richards. 2007. The impact of clinical supervision on counsellors and therapists their practice and their clients. A systematic review of the literature. Counselling and Psychotherapy Research 7 1 (mar 2007) 54\u201365. 10.1080\/14733140601185274","DOI":"10.1080\/14733140601185274"},{"key":"e_1_3_3_3_113_2","unstructured":"Austin\u00a0P Wright Zijie\u00a0J Wang Haekyu Park Grace Guo Fabian Sperrle Mennatallah El-Assady Alex Endert Daniel Keim and Duen\u00a0Horng Chau. 2020. A comparative analysis of industry human-AI interaction guidelines. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2010.11761 (2020). https:\/\/arxiv.org\/abs\/2010.11761"},{"key":"e_1_3_3_3_114_2","doi-asserted-by":"publisher","unstructured":"Bo Xiao Zac\u00a0E Imel Panayiotis\u00a0G Georgiou David\u00a0C Atkins and Shrikanth\u00a0S Narayanan. 2015. \" Rate my therapist\": automated detection of empathy in drug and alcohol counseling via speech and language processing. PloS one 10 12 (2015) e0143055. 10.1371\/journal.pone.0143055","DOI":"10.1371\/journal.pone.0143055"},{"key":"e_1_3_3_3_115_2","doi-asserted-by":"publisher","unstructured":"Wenjie Yang Anna Fang Raj\u00a0Sanjay Shah Yash Mathur Diyi Yang Haiyi Zhu and Robert\u00a0E. Kraut. 2024. What Makes Digital Support Effective? How Therapeutic Skills Affect Clinical Well-Being. Proc. ACM Hum.-Comput. Interact. 8 CSCW1 Article 190 (April 2024) 29\u00a0pages. 10.1145\/3641029","DOI":"10.1145\/3641029"},{"key":"e_1_3_3_3_116_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.acl-long.1021"},{"key":"e_1_3_3_3_117_2","doi-asserted-by":"publisher","unstructured":"Zheng Yao Haiyi Zhu and Robert\u00a0E Kraut. 2022. Learning to Become a Volunteer Counselor: Lessons from a Peer-to-Peer Mental Health Community. Proceedings of the ACM on Human-Computer Interaction 6 CSCW2 Article 309 (nov 2022) 24\u00a0pages. 10.1145\/3555200","DOI":"10.1145\/3555200"},{"key":"e_1_3_3_3_118_2","doi-asserted-by":"publisher","unstructured":"Natasha Yates Suzanne Gough and Victoria Brazil. 2022. Self-assessment: With all its limitations why are we still measuring and teaching it? Lessons from a scoping review. Medical Teacher 44 11 (2022) 1296\u20131302. 10.1080\/0142159X.2022.2093704","DOI":"10.1080\/0142159X.2022.2093704"},{"key":"e_1_3_3_3_119_2","doi-asserted-by":"publisher","unstructured":"J.D. Zamfirescu-Pereira Richmond\u00a0Y. Wong Bjoern Hartmann and Qian Yang. 2023. Why Johnny Can\u2019t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts(CHI \u201923). Association for Computing Machinery New York NY USA Article 437 21\u00a0pages. 10.1145\/3544548.3581388","DOI":"10.1145\/3544548.3581388"},{"key":"e_1_3_3_3_120_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2025.findings-acl.70"}],"event":{"name":"CHI 2026: CHI Conference on Human Factors in Computing Systems","location":"Barcelona Spain","acronym":"CHI '26","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3772318.3791821","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T11:39:51Z","timestamp":1781005191000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3772318.3791821"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,13]]},"references-count":119,"alternative-id":["10.1145\/3772318.3791821","10.1145\/3772318"],"URL":"https:\/\/doi.org\/10.1145\/3772318.3791821","relation":{},"subject":[],"published":{"date-parts":[[2026,4,13]]},"assertion":[{"value":"2026-04-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}