{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T01:22:35Z","timestamp":1793841755653,"version":"4.6.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T00:00:00Z","timestamp":1777075200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T00:00:00Z","timestamp":1777075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Universit\u00e4tsklinikum Hamburg-Eppendorf (UKE)"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The growing burden of mental illness and limited access to evidence-based psychotherapy have increased interest in artificial intelligence (AI)\u2013driven conversational agents as potential supports for mental health care. In this exploratory pilot study, we examined the safety and feasibility of an intelligent virtual agent (IVA) designed to simulate psychotherapeutic interactions, with a focus on high-risk situations involving suicidality and substance use. Two licensed psychotherapists engaged in scripted interactions with the IVA across 12 predefined scenarios addressing suicidality and substance abuse. The IVA was powered by GPT-4omni and embedded in a Unity-based avatar. After each interaction, testers evaluated acceptance, usability, and human\u2013robot interaction. Two independent psychotherapists rated the IVA\u2019s responses using a structured scale assessing guideline adherence, risk recognition, help provision, de-escalation, and empathy. No real patients were involved; all interactions were simulated for safety testing purposes. The IVA showed preliminary indications of good usability and generally empathic responses. However, problematic responses occurred in 29% of conversations, with 12.5% rated as highly critical. Responses rated as \u201ccritical\u201d or \u201chighly critical\u201d referred to outputs that failed to provide adequate support, showed insufficient risk recognition, or included ethically problematic suggestions. Key concerns included inadequate recognition of risk, normalization of substance use, and insufficient referral to crisis resources, particularly in scenarios involving underage alcohol access and suicide-related inquiries. In this small, expert-based pilot safety evaluation, the findings suggest that although AI-based agents may improve access to mental health support, rigorous safety evaluation, clinical oversight, and robust safeguards are essential prior to clinical deployment. No clinical conclusions can be drawn from this simulated study.<\/jats:p>","DOI":"10.1038\/s41598-026-49764-w","type":"journal-article","created":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T15:48:15Z","timestamp":1777132095000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Intelligent virtual agents in psychotherapy: a safety evaluation across high-risk mental health scenarios"],"prefix":"10.1038","volume":"16","author":[{"given":"Lara","family":"Rolvien","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucie","family":"Kruse","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Rings","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Zimmer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gesche","family":"Schauenburg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Friederike","family":"Thams","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Br\u00e4hler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Catharina","family":"Rudschies","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ingrid","family":"Schneider","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steffen","family":"Moritz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frank","family":"Steinicke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J\u00fcrgen","family":"Gallinat","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,4,25]]},"reference":[{"key":"49764_CR1","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1007\/s12553-023-00803-w","volume":"14","author":"MM Kakale","year":"2024","unstructured":"Kakale, M. M. Of digital transformation in the healthcare (systematic review of the current state of the literature). Health Technol. (Berl.) 14, 35\u201350. https:\/\/doi.org\/10.1007\/s12553-023-00803-w (2024).","journal-title":"Health Technol. (Berl.)"},{"key":"49764_CR2","doi-asserted-by":"publisher","DOI":"10.1136\/gpsych-2020-100424","volume":"34","author":"R Vadivel","year":"2021","unstructured":"Vadivel, R. et al. Mental health in the post-COVID-19 era: Challenges and the way forward. Gen. Psychiatry 34, e100424. https:\/\/doi.org\/10.1136\/gpsych-2020-100424 (2021).","journal-title":"Gen. Psychiatry"},{"key":"49764_CR3","doi-asserted-by":"publisher","first-page":"1303","DOI":"10.1017\/S0033291713001943","volume":"44","author":"LH Andrade","year":"2014","unstructured":"Andrade, L. H. et al. Barriers to mental health treatment: Results from the WHO World Mental Health surveys. Psychol. Med. 44, 1303\u20131317. https:\/\/doi.org\/10.1017\/S0033291713001943 (2014).","journal-title":"Psychol. Med."},{"key":"49764_CR4","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1111\/jcpp.12937","volume":"60","author":"AE Kazdin","year":"2019","unstructured":"Kazdin, A. E. Annual research review: Expanding mental health services through novel models of intervention delivery. J. Child Psychol. Psychiatry 60, 455\u2013472. https:\/\/doi.org\/10.1111\/jcpp.12937 (2019).","journal-title":"J. Child Psychol. Psychiatry"},{"key":"49764_CR5","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2019.00746","author":"AS Miner","year":"2019","unstructured":"Miner, A. S. et al. Key considerations for incorporating conversational AI in psychotherapy. Front. Psychiatry. https:\/\/doi.org\/10.3389\/fpsyt.2019.00746 (2019).","journal-title":"Front. Psychiatry."},{"key":"49764_CR6","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/365153.365168","volume":"9","author":"J Weizenbaum","year":"1966","unstructured":"Weizenbaum, J. ELIZA\u2014A computer program for the study of natural language communication between man and machine. Commun. ACM. 9, 36\u201345. https:\/\/doi.org\/10.1145\/365153.365168 (1966).","journal-title":"Commun. ACM."},{"key":"49764_CR7","doi-asserted-by":"publisher","DOI":"10.1016\/j.mlwa.2020.100006","volume":"2","author":"E Adamopoulou","year":"2020","unstructured":"Adamopoulou, E. & Moussiades, L. Chatbots: History, technology, and applications. Mach. Learn. Appl. 2, 100006. https:\/\/doi.org\/10.1016\/j.mlwa.2020.100006 (2020).","journal-title":"Mach. Learn. Appl."},{"key":"49764_CR8","doi-asserted-by":"publisher","unstructured":"Sch\u00f6bel, S., Karatas, J., Tingelhoff, F. & Leimeister, J. Not everything is a metaverse?! A practitioners perspective on characterizing metaverse platforms. In: 56th Hawaii International Conference on System Sciences (2023) https:\/\/doi.org\/10.24251\/HICSS.2023.070.","DOI":"10.24251\/HICSS.2023.070"},{"key":"49764_CR9","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2016.00186","author":"IC Rehm","year":"2016","unstructured":"Rehm, I. C. et al. What role can avatars play in e-mental health interventions? Exploring new models of client\u2013therapist interaction. Front. Psychiatry https:\/\/doi.org\/10.3389\/fpsyt.2016.00186 (2016).","journal-title":"Front. Psychiatry"},{"key":"49764_CR10","doi-asserted-by":"publisher","DOI":"10.1177\/02537176241300569","author":"MJ Beg","year":"2024","unstructured":"Beg, M. J. & Verma, M. K. Exploring the potential and challenges of digital and AI-driven psychotherapy for ADHD, OCD, schizophrenia, and substance use disorders: A comprehensive narrative review. Indian J. Psychol. Med. https:\/\/doi.org\/10.1177\/02537176241300569 (2024).","journal-title":"Indian J. Psychol. Med."},{"key":"49764_CR11","doi-asserted-by":"publisher","first-page":"314","DOI":"10.1177\/02537176241260819","volume":"47","author":"MJ Beg","year":"2025","unstructured":"Beg, M. J., Verma, M., Vckm, M. & Verma, M. K. Artificial intelligence for psychotherapy: A review of the current state and future directions. Indian J. Psychol. Med. 47, 314\u2013325. https:\/\/doi.org\/10.1177\/02537176241260819 (2025).","journal-title":"Indian J. Psychol. Med."},{"key":"49764_CR12","doi-asserted-by":"publisher","DOI":"10.2196\/43862","volume":"25","author":"Y He","year":"2023","unstructured":"He, Y. et al. Conversational agent interventions for mental health problems: Systematic review and meta-analysis of randomized controlled trials. J. Med. Internet Res. 25, e43862. https:\/\/doi.org\/10.2196\/43862 (2023).","journal-title":"J. Med. Internet Res."},{"key":"49764_CR13","doi-asserted-by":"publisher","DOI":"10.1016\/j.invent.2022.100495","volume":"27","author":"H Liu","year":"2022","unstructured":"Liu, H., Peng, H., Song, X., Xu, C. & Zhang, M. Using AI chatbots to provide self-help depression interventions for university students: A randomized trial of effectiveness. Internet Interv. 27, 100495. https:\/\/doi.org\/10.1016\/j.invent.2022.100495 (2022).","journal-title":"Internet Interv."},{"key":"49764_CR14","doi-asserted-by":"publisher","DOI":"10.2196\/mental.7785","volume":"4","author":"KK Fitzpatrick","year":"2017","unstructured":"Fitzpatrick, K. K., Darcy, A. & Vierhile, M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): A randomized controlled trial. JMIR. Ment. Health 4, e19. https:\/\/doi.org\/10.2196\/mental.7785 (2017).","journal-title":"JMIR. Ment. Health"},{"key":"49764_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.chbr.2024.100401","volume":"14","author":"AB Herbener","year":"2024","unstructured":"Herbener, A. B., Klincewicz, M. & Damholdt, M. F. A narrative review of the active ingredients in psychotherapy delivered by conversational agents. Comput. Hum. Behav. Rep. 14, 100401. https:\/\/doi.org\/10.1016\/j.chbr.2024.100401 (2024).","journal-title":"Comput. Hum. Behav. Rep."},{"key":"49764_CR16","doi-asserted-by":"publisher","DOI":"10.1177\/02537176251357477","author":"MJ Beg","year":"2025","unstructured":"Beg, M. J. & Verma, M. K. Artificial intelligence-based psychotherapy: A qualitative exploration of usability, personalization, and the perception of therapeutic progress. Indian J. Psychol. Med. https:\/\/doi.org\/10.1177\/02537176251357477 (2025).","journal-title":"Indian J. Psychol. Med."},{"key":"49764_CR17","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1016\/j.amjmed.2019.01.017","volume":"132","author":"N Noorbakhsh-Sabet","year":"2019","unstructured":"Noorbakhsh-Sabet, N., Zand, R., Zhang, Y. & Abedi, V. Artificial intelligence transforms the future of health care. Am. J. Med. 132, 795\u2013801. https:\/\/doi.org\/10.1016\/j.amjmed.2019.01.017 (2019).","journal-title":"Am. J. Med."},{"key":"49764_CR18","first-page":"21","volume-title":"Chatbots and mental healthcare in psychology and psychiatry","author":"MJK Beg","year":"2025","unstructured":"Beg, M. J. K. & Verma, M. K. Revolutionizing mental healthcare through artificial intelligence. In Chatbots and mental healthcare in psychology and psychiatry (eds Uludag, K. & Ahmad, N.) 21\u201354 (IGI Global Scientific Publishing, 2025)."},{"key":"49764_CR19","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1111\/joim.12822","volume":"284","author":"GS Handelman","year":"2018","unstructured":"Handelman, G. S. et al. eDoctor: Machine learning and the future of medicine. J. Intern. Med. 284, 603\u2013619. https:\/\/doi.org\/10.1111\/joim.12822 (2018).","journal-title":"J. Intern. Med."},{"key":"49764_CR20","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1093\/jamia\/ocaf031","volume":"32","author":"P Nong","year":"2025","unstructured":"Nong, P. & Ji, M. Expectations of healthcare AI and the role of trust: Understanding patient views on how AI will impact cost, access, and patient-provider relationships. J. Am. Med. Inform. Assoc. 32, 795\u2013799. https:\/\/doi.org\/10.1093\/jamia\/ocaf031 (2025).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"49764_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2022.107600","volume":"140","author":"I Pentina","year":"2023","unstructured":"Pentina, I., Hancock, T. & Xie, T. Exploring relationship development with social chatbots: A mixed-method study of Replika. Comput. Hum. Behav. 140, 107600. https:\/\/doi.org\/10.1016\/j.chb.2022.107600 (2023).","journal-title":"Comput. Hum. Behav."},{"key":"49764_CR22","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2022.258","author":"T Xie","year":"2022","unstructured":"Xie, T. & Pentina, I. Attachment theory as a framework to understand relationships with social chatbots: A case study of Replika. Hawaii Int. Conf. Syst. Sci. https:\/\/doi.org\/10.24251\/HICSS.2022.258 (2022).","journal-title":"Hawaii Int. Conf. Syst. Sci."},{"key":"49764_CR23","doi-asserted-by":"publisher","first-page":"1593","DOI":"10.1002\/mar.21853","volume":"40","author":"I Pentina","year":"2023","unstructured":"Pentina, I., Xie, T., Hancock, T. & Bailey, A. Consumer\u2013machine relationships in the age of artificial intelligence: Systematic literature review and research directions. Psychol. Mark. 40, 1593\u20131614. https:\/\/doi.org\/10.1002\/mar.21853 (2023).","journal-title":"Psychol. Mark."},{"key":"49764_CR24","doi-asserted-by":"publisher","DOI":"10.2196\/70610","volume":"12","author":"X Wang","year":"2025","unstructured":"Wang, X., Zhou, Y. & Zhou, G. The application and ethical implication of generative AI in mental health: Systematic review. JMIR Ment. Health 12, e70610. https:\/\/doi.org\/10.2196\/70610 (2025).","journal-title":"JMIR Ment. Health"},{"key":"49764_CR25","doi-asserted-by":"publisher","DOI":"10.2196\/53672","volume":"13","author":"X Xian","year":"2024","unstructured":"Xian, X., Chang, A., Xiang, Y.-T. & Liu, M. T. Debate and dilemmas regarding generative AI in mental health care: Scoping review. Interact. J. Med. Res. 13, e53672. https:\/\/doi.org\/10.2196\/53672 (2024).","journal-title":"Interact. J. Med. Res."},{"key":"49764_CR26","unstructured":"Walter, L. Belgian man dies by suicide following exchanges with chatbot (The Brussels Times, 2023)."},{"key":"49764_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2025.104239","volume":"62","author":"MS Jabbar","year":"2025","unstructured":"Jabbar, M. S., Al-Azani, S., Alotaibi, A. & Ahmed, M. Red teaming large language models: A comprehensive review and critical analysis. Inf. Process. Manag. 62, 104239. https:\/\/doi.org\/10.1016\/j.ipm.2025.104239 (2025).","journal-title":"Inf. Process. Manag."},{"key":"49764_CR28","first-page":"4","volume":"189","author":"J Brooke","year":"1996","unstructured":"Brooke, J. SUS-A quick and dirty usability scale. Usability Eval. Ind. 189, 4\u20137 (1996).","journal-title":"Usability Eval. Ind."},{"key":"49764_CR29","doi-asserted-by":"crossref","unstructured":"Zimmer, C., Kruse, L., Rolvien, L., Gallinat, J. & Geiger, C. Transformation of MetaHumans for a generic XR workflow. In: XR Salento 2025 (International Conference on Extended Reality) (2025).","DOI":"10.1007\/978-3-031-97778-7_5"},{"key":"49764_CR30","doi-asserted-by":"publisher","unstructured":"Mostajeran, F., Li, K., Rings, S., Kruse, L., Wolf, E., Schmidt, S., et al. A toolkit for creating intelligent virtual humans in extended reality. In: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) p. 736\u2013741 (IEEE, 2025) https:\/\/doi.org\/10.1109\/VRW66409.2025.00149.","DOI":"10.1109\/VRW66409.2025.00149"},{"key":"49764_CR31","doi-asserted-by":"publisher","unstructured":"Li, K., Mostajeran, F., Rings, S., Kruse, L., Schmidt, S., Arz, M., et al. I hear, see, speak & do: Bringing multimodal information processing to intelligent virtual agents for natural human-AI communication. In: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) p. 1648\u20131649 (IEEE, 2025) https:\/\/doi.org\/10.1109\/VRW66409.2025.00469.","DOI":"10.1109\/VRW66409.2025.00469"},{"key":"49764_CR32","unstructured":"Park, J. I., Abbasian, M., Azimi, I., Bounds, D. T., Jun, A., Han, J., et al. Building trust in mental health chatbots: Safety metrics and LLM-based evaluation tools. ArXiv Preprint 2024:2408.04650."},{"key":"49764_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-3-030-89738-3_24-1","volume-title":"International handbook of behavioral health assessment","author":"C Bartneck","year":"2023","unstructured":"Bartneck, C. Godspeed questionnaire series: Translations and usage. In International handbook of behavioral health assessment 1\u201335 (Springer International Publishing, 2023). https:\/\/doi.org\/10.1007\/978-3-030-89738-3_24-1."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-49764-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-49764-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-49764-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T16:01:47Z","timestamp":1777132907000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-026-49764-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,25]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["49764"],"URL":"https:\/\/doi.org\/10.1038\/s41598-026-49764-w","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,25]]},"assertion":[{"value":"6 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 April 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"FT is employed by Sympatient GmbH, a digital mental health clinic active in the field of medical devices. The authors declare no other competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"13411"}}