{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T10:58:10Z","timestamp":1790938690726,"version":"4.1.0"},"reference-count":55,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T00:00:00Z","timestamp":1790899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Mind Med. Sci.","JMMS"],"abstract":"<jats:p>Conversational artificial intelligence is increasingly encountered by people seeking support during distress, social isolation, or delays in accessing mental-health care. In these settings, the central ethical concern extends beyond factual inaccuracy. Large language models (LLMs) may produce responses that appear empathic while failing to detect suicidal intent, exceeding the limits of a non-clinician support role, undermining patient autonomy, or weakening the clinician\u2013patient relationship. This narrative review reframes ethical boundaries for LLMs in mental-health care around three clinically important contexts: crisis support, psychiatric triage, and therapy augmentation. A narrative approach was adopted to support conceptual synthesis rather than pooled effect estimation. The literature on digital psychiatry, conversational agents, LLMs, artificial intelligence ethics, suicide-safety responses, patient perspectives, and clinical reporting guidance was reviewed from major medical and interdisciplinary sources. The primary search covered publications from 1 January 2021 to 30 June 2026, with earlier foundational chatbot studies retained selectively and interpreted separately from contemporary LLM evidence. Four interrelated priorities are proposed for evaluation: governance centred on psychological safety, autonomy, trust and the clinician\u2013patient relationship; crisis-response safeguards combining supportive recognition with human escalation; bounded lower-acuity support with transparent uncertainty; and co-designed evaluation of patient-experienced and relational outcomes. These are candidate design priorities, not demonstrated mechanisms of risk reduction. The proposed framework integrates existing ethical principles with mental-health scenarios, external control functions, verified human handoffs, and staged evaluation. Study-level findings are distinguished from technical background and author-derived proposals. The framework is exploratory and has not been empirically or clinically validated; it is intended to generate research questions, not guide routine clinical care. Future studies would need to assess clinically meaningful outcomes: whether the system recognises acute risk, maintains a bounded support role, preserves patient autonomy and trust, and enables timely human escalation when vulnerability, ambiguity, or risk is disclosed.<\/jats:p>","DOI":"10.3390\/jmms13040024","type":"journal-article","created":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T10:14:56Z","timestamp":1790936096000},"page":"24","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Ethical Boundaries for Large Language Models in Mental-Health Care: A Review of Psychological Safety, Relational Governance and Human Escalation"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-6349-4531","authenticated-orcid":false,"given":"Enoch Chi Ngai","family":"Lim","sequence":"first","affiliation":[{"name":"Translational Research Department, Specialist Medical Services Group, Earlwood, NSW 2206, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fang","family":"Chen","sequence":"additional","affiliation":[{"name":"Data Science Institute, School of Computer Science, Faculty of Engineering and IT, University of Technology Sydney, Ultimo, NSW 2007, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4448-8154","authenticated-orcid":false,"given":"Chi Eung Danforn","family":"Lim","sequence":"additional","affiliation":[{"name":"Translational Research Department, Specialist Medical Services Group, Earlwood, NSW 2206, Australia"},{"name":"Data Science Institute, School of Computer Science, Faculty of Engineering and IT, University of Technology Sydney, Ultimo, NSW 2007, Australia"},{"name":"National Institute of Complementary Medicine Health Research Institute, Western Sydney University, Westmead, NSW 2145, Australia"},{"name":"School of Biological Sciences, Nanyang Technological University, Singapore 639798, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,10,2]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2026, July 07). Mental Disorders. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/mental-disorders."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/S2215-0366(15)00505-2","article-title":"Estimating the true global burden of mental illness","volume":"3","author":"Vigo","year":"2016","journal-title":"Lancet Psychiatry"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1016\/S0140-6736(18)31612-X","article-title":"The Lancet Commission on global mental health and sustainable development","volume":"392","author":"Patel","year":"2018","journal-title":"Lancet"},{"key":"ref_4","unstructured":"World Health Organization (2026, July 07). Suicide. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/suicide."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1002\/wps.20883","article-title":"The growing field of digital psychiatry: Current evidence and the future of apps, social media, chatbots, and virtual reality","volume":"20","author":"Torous","year":"2021","journal-title":"World Psychiatry"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e59479","DOI":"10.2196\/59479","article-title":"The opportunities and risks of large language models in mental health","volume":"11","author":"Lawrence","year":"2024","journal-title":"JMIR Ment. Health"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e57400","DOI":"10.2196\/57400","article-title":"Large language models for mental health applications: Systematic review","volume":"11","author":"Guo","year":"2024","journal-title":"JMIR Ment. Health"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1038\/s41746-025-01611-4","article-title":"A scoping review of large language models for generative tasks in mental health care","volume":"8","author":"Hua","year":"2025","journal-title":"npj Digit. Med."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Triantafyllidis, A., Segkouli, S., Kokkas, S., Alexiadis, A., Lithoxoidou, E.E., Manias, G., Antoniades, A., Votis, K., and Tzovaras, D. (2026). Large Language Models for Cardiovascular Disease, Cancer, and Mental Disorders: A Review of Systematic Reviews. Healthcare, 14.","DOI":"10.20944\/preprints202510.2480.v1"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e16021","DOI":"10.2196\/16021","article-title":"Effectiveness and safety of using chatbots to improve mental health: Systematic review and meta-analysis","volume":"22","author":"Rababeh","year":"2020","journal-title":"J. Med. Internet Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e14166","DOI":"10.2196\/14166","article-title":"Conversational agents in the treatment of mental health problems: Mixed-method systematic review","volume":"6","author":"Gaffney","year":"2019","journal-title":"JMIR Ment. Health"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e151","DOI":"10.2196\/jmir.6553","article-title":"Embodied conversational agents in clinical psychology: A scoping review","volume":"19","author":"Provoost","year":"2017","journal-title":"J. Med. Internet Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1177\/0706743719828977","article-title":"Chatbots and conversational agents in mental health: A review of the psychiatric landscape","volume":"64","author":"Vaidyam","year":"2019","journal-title":"Can. J. Psychiatry"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1016\/j.chb.2014.04.043","article-title":"It\u2019s only a computer: Virtual humans increase willingness to disclose","volume":"37","author":"Lucas","year":"2014","journal-title":"Comput. Hum. Behav."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s44184-024-00097-4","article-title":"\u201cIt happened to be the perfect thing\u201d: Experiences of generative AI chatbots for mental health","volume":"3","author":"Siddals","year":"2024","journal-title":"npj Ment. Health Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.pec.2004.09.008","article-title":"Establishing the computer-patient working alliance in automated health behavior change interventions","volume":"59","author":"Bickmore","year":"2005","journal-title":"Patient Educ. Couns."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lee, H.S., Wright, C., Ferranto, J., Buttimer, J., Palmer, C.E., Welchman, A., Mazor, K.M., Fisher, K.A., Smelson, D., and O\u2019Connor, L. (2025). Artificial intelligence conversational agents in mental health: Patients see potential, but prefer humans in the loop. Front. Psychiatry, 15.","DOI":"10.3389\/fpsyt.2024.1505024"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1037\/pst0000172","article-title":"The alliance in adult psychotherapy: A meta-analytic synthesis","volume":"55","author":"Wampold","year":"2018","journal-title":"Psychotherapy"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Khawaja, Z., and B\u00e9lisle-Pipon, J.C. (2023). Your robot therapist is not your therapist: Understanding the role of AI-powered mental health chatbots. Front. Digit. Health, 5.","DOI":"10.3389\/fdgth.2023.1278186"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1001\/jamainternmed.2016.0400","article-title":"Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health","volume":"176","author":"Miner","year":"2016","journal-title":"JAMA Intern. Med."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-025-17242-4","article-title":"Performance of mental health chatbot agents in detecting and managing suicidal ideation","volume":"15","author":"Pichowicz","year":"2025","journal-title":"Sci. Rep."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e67891","DOI":"10.2196\/67891","article-title":"Competency of large language models in evaluating appropriate responses to suicidal ideation: Comparative study","volume":"27","author":"McBain","year":"2025","journal-title":"J. Med. Internet Res."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Heinz, M.V., Mackin, D.M., Trudeau, B.M., Bhattacharya, S., Wang, Y., Banta, H.A., Jewett, A.D., Salzhauer, A.J., Griffin, T.Z., and Jacobson, N.C. (2025). Randomized Trial of a Generative AI Chatbot for Mental Health Treatment. NEJM AI, 2.","DOI":"10.1056\/AIoa2400802"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Moore, J., Grabb, D., Agnew, W., Klyman, K., Chancellor, S., Ong, D.C., and Haber, N. (2025). Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providers. Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency (FAccT \u201925), Association for Computing Machinery.","DOI":"10.1145\/3715275.3732039"},{"key":"ref_25","unstructured":"World Health Organization (2026, July 07). Ethics and Governance of Artificial Intelligence for Health, Available online: https:\/\/www.who.int\/publications\/i\/item\/9789240029200."},{"key":"ref_26","unstructured":"World Health Organization (2026, July 07). Ethics and Governance of Artificial Intelligence for Health: Guidance on Large Multi-Modal Models, Available online: https:\/\/www.who.int\/publications\/i\/item\/9789240084759."},{"key":"ref_27","first-page":"1","article-title":"The imperative for regulatory oversight of large language models (or generative AI) in healthcare","volume":"6","author":"Topol","year":"2023","journal-title":"npj Digit. Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e428","DOI":"10.1016\/S2589-7500(24)00061-X","article-title":"Ethical and regulatory challenges of large language models in medicine","volume":"6","author":"Ong","year":"2024","journal-title":"Lancet Digit. Health"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1007\/s43681-025-00892-5","article-title":"Responsible use of AI in healthcare: An Australian perspective on promise, perils, and professional duties","volume":"6","author":"Lim","year":"2026","journal-title":"AI Ethics"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1038\/s41746-024-01258-7","article-title":"A framework for human evaluation of large language models in healthcare derived from literature review","volume":"7","author":"Tam","year":"2024","journal-title":"npj Digit. Med."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tabassi, E. (2023). Artificial Intelligence Risk Management Framework (AI RMF 1.0), National Institute of Standards and Technology.","DOI":"10.6028\/NIST.AI.100-1"},{"key":"ref_32","first-page":"9459","article-title":"Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks","volume":"33","author":"Lewis","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1186\/s41073-019-0064-8","article-title":"SANRA: A scale for the quality assessment of narrative review articles","volume":"4","author":"Baethge","year":"2019","journal-title":"Res. Integr. Peer Rev."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Suresh, H., and Guttag, J. (2021). A framework for understanding sources of harm throughout the machine learning life cycle. Proceedings of the 2021 ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO \u201921), Association for Computing Machinery. Article 17.","DOI":"10.1145\/3465416.3483305"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1351","DOI":"10.1038\/s41591-020-1037-7","article-title":"Guidelines for clinical trial protocols for interventions involving artificial intelligence: The SPIRIT-AI extension","volume":"26","author":"Rivera","year":"2020","journal-title":"Nat. Med."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"e537","DOI":"10.1016\/S2589-7500(20)30218-1","article-title":"Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: The CONSORT-AI extension","volume":"2","author":"Liu","year":"2020","journal-title":"Lancet Digit. Health"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1038\/s41591-022-01772-9","article-title":"Reporting guideline for the early-stage clinical evaluation of decision support systems driven by artificial intelligence: DECIDE-AI","volume":"28","author":"Vasey","year":"2022","journal-title":"Nat. Med."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ohu, F.C., Burrell, D.N., and Jones, L.A. (2025). Public Health Risk Management, Policy, and Ethical Imperatives in the Use of AI Tools for Mental Health Therapy. Healthcare, 13.","DOI":"10.3390\/healthcare13212721"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Pillay, Y. (2025). Ethical Decision-Making Guidelines for Mental Health Clinicians in the Artificial Intelligence (AI) Era. Healthcare, 13.","DOI":"10.20944\/preprints202509.1023.v1"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Levkovich, I. (2025). Evaluating Diagnostic Accuracy and Treatment Efficacy in Mental Health: A Comparative Analysis of Large Language Model Tools and Mental Health Professionals. Eur. J. Investig. Health Psychol. Educ., 15.","DOI":"10.3390\/ejihpe15010009"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.cbpra.2011.01.001","article-title":"Safety planning intervention: A brief intervention to mitigate suicide risk","volume":"19","author":"Stanley","year":"2012","journal-title":"Cogn. Behav. Pract."},{"key":"ref_44","unstructured":"European Parliament and Council of the European Union (2026, September 15). Regulation (EU) 2024\/1689 Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act). Off. J. Eur. Union 2024, L, 2024\/1689. Available online: https:\/\/eur-lex.europa.eu\/eli\/reg\/2024\/1689\/oj\/eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1038\/s44220-026-00595-8","article-title":"Technological folie \u00e0 deux: Feedback loops between AI chatbots and mental health","volume":"4","author":"Spens","year":"2026","journal-title":"Nat. Ment. Health"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Kung, T.H., Cheatham, M., Medenilla, A., Sillos, C., De Leon, L., Elepa\u00f1o, C., Madriaga, M., Aggabao, R., Diaz-Candido, G., and Maningo, J. (2023). Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS Digit. Health, 2.","DOI":"10.1371\/journal.pdig.0000198"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Lee, S., Rheu, M.M., and Zhuang, J. (2025). The ChatGPT Effect: Investigating Shifting Discourse Patterns, Sentiment, and Benefit\u2013Challenge Framing in AI Mental Health Support. Behav. Sci., 15.","DOI":"10.3390\/bs15091172"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2055207619871808","DOI":"10.1177\/2055207619871808","article-title":"Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study","volume":"5","author":"Nadarzynski","year":"2019","journal-title":"Digit. Health"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1093\/jcr\/ucz013","article-title":"Resistance to Medical Artificial Intelligence","volume":"46","author":"Longoni","year":"2019","journal-title":"J. Consum. Res."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"e19","DOI":"10.2196\/mental.7785","article-title":"Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial","volume":"4","author":"Fitzpatrick","year":"2017","journal-title":"JMIR Ment. Health"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"e64","DOI":"10.2196\/mental.9782","article-title":"Using psychological artificial intelligence (Tess) to relieve symptoms of depression and anxiety: Randomized controlled trial","volume":"5","author":"Fulmer","year":"2018","journal-title":"JMIR Ment. Health"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"e12106","DOI":"10.2196\/12106","article-title":"An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: Real-world data evaluation mixed-methods study","volume":"6","author":"Inkster","year":"2018","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref_54","unstructured":"Autio, C., Schwartz, R., Dunietz, J., Jain, S., Stanley, M., Tabassi, E., Hall, P., and Roberts, K. (2024). Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile (Standard No. NIST AI 600-1)."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Greshake, K., Abdelnabi, S., Mishra, S., Endres, C., Holz, T., and Fritz, M. (2023). Not what you\u2019ve signed up for: Compromising real-world LLM-integrated applications with indirect prompt injection. Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security (AISec \u201923), Association for Computing Machinery.","DOI":"10.1145\/3605764.3623985"}],"container-title":["Journal of Mind and Medical Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2392-7674\/13\/4\/24\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T10:29:46Z","timestamp":1790936986000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2392-7674\/13\/4\/24"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,2]]},"references-count":55,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["jmms13040024"],"URL":"https:\/\/doi.org\/10.3390\/jmms13040024","relation":{},"ISSN":["2392-7674"],"issn-type":[{"value":"2392-7674","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,2]]}}}