{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T19:52:20Z","timestamp":1791316340198,"version":"4.3.1"},"reference-count":49,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Ment Health"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Mental health disorders affect 970 million people globally; yet, over 50% do not access timely evaluation due to structural barriers and professional shortages. Chatbots and AI-based conversational agents have emerged as promising tools for mental health screening and assessment.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study systematically evaluated the effectiveness, accuracy, reliability, and acceptability of chatbots and AI-based conversational agents for mental health screening and assessment in adults.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Systematic search conducted in May 2025 across PubMed\/MEDLINE, PsycINFO, Scopus, and Web of Science (2019\u20102025), following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines. Eligible studies evaluated chatbots or AI for mental health screening\/assessment in adults (\u226518 y). Risk of bias was assessed using appropriate tools (Risk of Bias 2, Quality Assessment of Diagnostic Accuracy Studies-2, Joanna Briggs Institute checklists, and Mixed Methods Appraisal Tool). This systematic review was registered with PROSPERO (International Prospective Register of Systematic Reviews; CRD420251072392).<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n Eighteen studies (2021\u20102025) were included, with samples ranging from 20 to 3902 participants. Rule-based chatbots demonstrated high reliability (Cronbach \u03b1 >0.85) and good acceptability (Acceptability of Intervention Measure >19\/25). Generative models (large language models) achieved sensitivities of 0.84 to 0.93 and specificities of 0.80 to 0.96 for depression and anxiety, with correlations up to\n r<\/jats:italic>\n =0.96 with expert clinicians in suicide risk assessment. Hybrid approaches combining large language models with machine learning achieved exceptional performance for cognitive impairment (\n F<\/jats:italic>\n 1<\/jats:sub>\n -score of 92.1%, specificity of 99.6%). Most studies reported high user satisfaction (\u226570%), although barriers existed among older populations. Methodological quality was heterogeneous with a moderate risk of bias in critical dimensions.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Chatbots and AI conversational agents demonstrate clinically relevant performance in mental health screening and assessment. However, safe implementation requires clear clinical protocols, professional supervision, integration with electronic health records, and active mitigation of algorithmic bias. These technologies should complement rather than replace clinical judgment.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/93672","type":"journal-article","created":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T10:50:09Z","timestamp":1785235809000},"page":"e93672-e93672","source":"Crossref","is-referenced-by-count":0,"title":["Effectiveness of Chatbots in Mental Health Screening and Assessment: Systematic Review"],"prefix":"10.2196","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-5308-7698","authenticated-orcid":false,"given":"Isabel","family":"Morales Gil","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9749-8349","authenticated-orcid":false,"given":"In\u00e9s","family":"Marti-Estevez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1681-9016","authenticated-orcid":false,"given":"Sandra","family":"Doval","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4177-7766","authenticated-orcid":false,"given":"Jos\u00e9 Miguel","family":"Guti\u00e9rrez-Carrillo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0309-3391","authenticated-orcid":false,"given":"Roc\u00edo","family":"Fausor","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2747-5271","authenticated-orcid":false,"given":"Silvia","family":"Arribas-Garc\u00eda","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1987-0394","authenticated-orcid":false,"given":"Miguel \u00c1ngel","family":"\u00c1lvarez-Mon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2491-8647","authenticated-orcid":false,"given":"Javier","family":"Quintero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,10,6]]},"reference":[{"key":"R1","unstructured":"World mental health report: transforming mental health for all. World Health Organization; 2022. URL: https:\/\/iris.who.int\/server\/api\/core\/bitstreams\/40e5a13a-fe50-4efa-b56d-6e8cf00d5bfa\/content [Accessed 30-01-2026]"},{"issue":"2","key":"R2","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/S2215-0366(21)00395-3","article-title":"Global, regional, and national burden of 12 mental disorders in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019","volume":"9","author":"GBD 2019 Mental Disorders Collaborators","journal-title":"Lancet Psychiatry"},{"key":"R3","unstructured":"A new benchmark for mental health systems: tackling the social and economic costs of mental ill-health. OECD Publishing; 2021. URL: https:\/\/www.oecd.org\/content\/dam\/oecd\/en\/publications\/reports\/2021\/06\/a-new-benchmark-for-mental-health-systems_c0cce868\/4ed890f6-en.pdf [Accessed 12-08-2026]"},{"key":"R4","unstructured":"Communication from the Commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the Regions on a comprehensive approach to mental health. European Commission; 2023. URL: https:\/\/health.ec.europa.eu\/document\/download\/cef45b6d-a871-44d5-9d62-3cecc47eda89_en?filename=com_2023_298_1_act_en.pdf [Accessed 12-08-2026]"},{"issue":"10361","key":"R5","doi-asserted-by":"publisher","first-page":"1438","DOI":"10.1016\/S0140-6736(22)01470-2","article-title":"The Lancet Commission on ending stigma and discrimination in mental health","volume":"400","author":"Thornicroft","journal-title":"Lancet"},{"issue":"10402","key":"R6","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1016\/S0140-6736(23)00918-2","article-title":"Transforming mental health systems globally: principles and policy recommendations","volume":"402","author":"Patel","journal-title":"Lancet"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","DOI":"10.2196\/69284","article-title":"The applications of large language models in mental health: scoping review","volume":"27","author":"Jin","journal-title":"J Med Internet Res"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.2196\/56500","article-title":"Comparing GPT-4 and human researchers in health care data analysis: qualitative description study","volume":"26","author":"Li","journal-title":"J Med Internet Res"},{"issue":"10","key":"R9","doi-asserted-by":"publisher","DOI":"10.2196\/14166","article-title":"Conversational agents in the treatment of mental health problems: mixed-method systematic review","volume":"6","author":"Gaffney","journal-title":"JMIR Ment Health"},{"issue":"7","key":"R10","doi-asserted-by":"publisher","DOI":"10.2196\/16021","article-title":"Effectiveness and safety of using chatbots to improve mental health: systematic review and meta-analysis","volume":"22","author":"Abd-Alrazaq","journal-title":"J Med Internet Res"},{"issue":"1","key":"R11","doi-asserted-by":"publisher","DOI":"10.3390\/ejihpe15010009","article-title":"Evaluating diagnostic accuracy and treatment efficacy in mental health: a comparative analysis of large language model tools and mental health professionals","volume":"15","author":"Levkovich","journal-title":"Eur J Investig Health Psychol Educ"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1016\/j.ebiom.2024.105401","article-title":"Enhancing early detection of cognitive decline in the elderly: a comparative study utilizing large language models in clinical notes","volume":"109","author":"Du","journal-title":"EBioMedicine"},{"issue":"sup1","key":"R13","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1080\/17434440.2021.2013200","article-title":"Artificially intelligent chatbots in digital mental health interventions: a review","volume":"18","author":"Boucher","journal-title":"Expert Rev Med Devices"},{"issue":"15","key":"R14","doi-asserted-by":"publisher","first-page":"13619","DOI":"10.1007\/s12144-025-08094-2","article-title":"Chatbots and mental health: a scoping review of reviews","volume":"44","author":"Mayor","journal-title":"Curr Psychol"},{"issue":"3","key":"R15","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1002\/wps.21352","article-title":"Charting the evolution of artificial intelligence mental health chatbots from rule-based systems to large language models: a systematic review","volume":"24","author":"Hua","journal-title":"World Psychiatry"},{"issue":"11","key":"R16","doi-asserted-by":"publisher","first-page":"592","DOI":"10.1111\/pcn.13588","article-title":"The now and future of ChatGPT and GPT in psychiatry","volume":"77","author":"Cheng","journal-title":"Psychiatry Clin Neurosci"},{"issue":"1","key":"R17","doi-asserted-by":"publisher","DOI":"10.2196\/69910","article-title":"Assessing the accuracy and reliability of large language models in psychiatry using standardized multiple-choice questions: cross-sectional study","volume":"27","author":"Hanss","journal-title":"J Med Internet Res"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2025.1646974","article-title":"Evaluation of large language models on mental health: from knowledge test to illness diagnosis","volume":"16","author":"Xu","journal-title":"Front Psychiatry"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","DOI":"10.2196\/79850","article-title":"The effectiveness of AI chatbots in alleviating mental distress and promoting health behaviors among adolescents and young adults: systematic review and meta-analysis","volume":"27","author":"Feng","journal-title":"J Med Internet Res"},{"issue":"24","key":"R20","doi-asserted-by":"publisher","first-page":"12613","DOI":"10.1007\/s10489-024-05808-0","article-title":"Explainable cognitive decline detection in free dialogues with a Machine Learning approach based on pre-trained large language models","volume":"54","author":"de Arriba-P\u00e9rez","journal-title":"Appl Intell"},{"issue":"1","key":"R21","doi-asserted-by":"publisher","DOI":"10.2196\/67891","article-title":"Competency of large language models in evaluating appropriate responses to suicidal ideation: comparative study","volume":"27","author":"McBain","journal-title":"J Med Internet Res"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.17468","article-title":"The impact of history of depression and access to weapons on suicide risk assessment: a comparison of ChatGPT-3.5 and ChatGPT-4","volume":"12","author":"Shinan-Altman","journal-title":"PeerJ"},{"key":"R23","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2021.114130","article-title":"Quantified language connectedness in schizophrenia-spectrum disorders","volume":"304","author":"Voppel","journal-title":"Psychiatry Res"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2024.116119","article-title":"Assessing dimensions of thought disorder with large language models: the tradeoff of accuracy and consistency","volume":"341","author":"Pugh","journal-title":"Psychiatry Res"},{"issue":"1","key":"R25","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-54242-2","article-title":"AI and narrative embeddings detect PTSD following childbirth via birth stories","volume":"14","author":"Bartal","journal-title":"Sci Rep"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2023.1213141","article-title":"Beyond human expertise: the promise and limitations of ChatGPT in suicide risk assessment","volume":"14","author":"Elyoseph","journal-title":"Front Psychiatry"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.2196\/58129","article-title":"Large language models versus expert clinicians in crisis prediction among telemental health patients: comparative study","volume":"11","author":"Lee","journal-title":"JMIR Ment Health"},{"issue":"5","key":"R28","doi-asserted-by":"publisher","first-page":"1062","DOI":"10.1177\/17456916221134490","article-title":"A call to action on assessing and mitigating bias in artificial intelligence applications for mental health","volume":"18","author":"Timmons","journal-title":"Perspect Psychol Sci"},{"key":"R29","doi-asserted-by":"publisher","DOI":"10.2196\/58493","article-title":"Regulating AI in mental health: ethics of care perspective","volume":"11","author":"Tavory","journal-title":"JMIR Ment Health"},{"issue":"1","key":"R30","doi-asserted-by":"publisher","DOI":"10.1038\/s44184-024-00057-y","article-title":"Measuring algorithmic bias to analyze the reliability of AI tools that predict depression risk using smartphone sensed-behavioral data","volume":"3","author":"Adler","journal-title":"Npj Ment Health Res"},{"issue":"12","key":"R31","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0240376","article-title":"Artificial Intelligence in mental health and the biases of language based models","volume":"15","author":"Straw","journal-title":"PLoS One"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2024.1351637","article-title":"Deconstructing demographic bias in speech-based machine learning models for digital health","volume":"6","author":"Yang","journal-title":"Front Digit Health"},{"key":"R33","doi-asserted-by":"publisher","DOI":"10.2147\/NDT.S128584","article-title":"Racial and ethnic differences in depression: current perspectives","volume":"15","author":"Bailey","journal-title":"Neuropsychiatr Dis Treat"},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.2196\/43293","article-title":"Vickybot, a chatbot for anxiety-depressive symptoms and work-related burnout in primary care and health care professionals: development, feasibility, and potential effectiveness studies","volume":"25","author":"Anmella","journal-title":"J Med Internet Res"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2021.645805","article-title":"Psychometric properties of a chatbot version of the PHQ-9 with adults and older adults","volume":"3","author":"Dosovitsky","journal-title":"Front Digit Health"},{"issue":"1","key":"R36","doi-asserted-by":"publisher","DOI":"10.2196\/54706","article-title":"Physician versus large language model chatbot responses to web-based questions from autistic patients in Chinese: cross-sectional comparative analysis","volume":"26","author":"He","journal-title":"J Med Internet Res"},{"issue":"39","key":"R37","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2321321121","article-title":"Language sentiment predicts changes in depressive symptoms","volume":"121","author":"Hur","journal-title":"Proc Natl Acad Sci U S A"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.2196\/63538","article-title":"Development and evaluation of a mental health chatbot using ChatGPT 4.0: mixed methods user experience study with Korean users","volume":"13","author":"Kang","journal-title":"JMIR Med Inform"},{"issue":"2","key":"R39","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0279743","article-title":"Early detection of depression using a conversational AI bot: a non-clinical trial","volume":"18","author":"Kaywan","journal-title":"PLoS One"},{"issue":"1","key":"R40","doi-asserted-by":"publisher","DOI":"10.2196\/45959","article-title":"Mental distress, label avoidance, and use of a mental health chatbot: results from a US survey","volume":"8","author":"Kosyluk","journal-title":"JMIR Form Res"},{"issue":"5","key":"R41","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2025.11922","article-title":"Large language models and text embeddings for detecting depression and suicide in patient narratives","volume":"8","author":"Lho","journal-title":"JAMA Netw Open"},{"issue":"1","key":"R42","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-025-06798-0","article-title":"Evaluating the agreement between ChatGPT-4 and validated questionnaires in screening for anxiety and depression in college students: a cross-sectional study","volume":"25","author":"Liu","journal-title":"BMC Psychiatry"},{"issue":"1","key":"R43","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-024-82192-2","article-title":"GPT-4 shows potential for identifying social anxiety from clinical interview data","volume":"14","author":"Ohse","journal-title":"Sci Rep"},{"issue":"1","key":"R44","doi-asserted-by":"publisher","DOI":"10.2196\/54617","article-title":"Using large language models to detect depression from user-generated diary text data as a novel approach in digital mental health screening: instrument validation study","volume":"26","author":"Shin","journal-title":"J Med Internet Res"},{"issue":"4","key":"R45","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1080\/10503307.2015.1013161","article-title":"The effect of perceived burdensomeness and thwarted belongingness on therapists\u2019 assessment of patients\u2019 suicide risk","volume":"26","author":"Levi-Belz","journal-title":"Psychother Res"},{"key":"R46","doi-asserted-by":"publisher","DOI":"10.2196\/58418","article-title":"Aligning large language models for enhancing psychiatric interviews through symptom delineation and summarization: pilot study","volume":"8","author":"So","journal-title":"JMIR Form Res"},{"issue":"1","key":"R47","doi-asserted-by":"publisher","DOI":"10.1186\/s12888-025-06586-w","article-title":"Integrative diagnosis of psychiatric conditions using ChatGPT and fMRI data","volume":"25","author":"Li","journal-title":"BMC Psychiatry"},{"key":"R48","doi-asserted-by":"publisher","DOI":"10.1177\/20552076241293935","article-title":"Assessing the acceptability of a sleep-targeted digital intervention among geriatric inpatients: a preliminary study","volume":"11","author":"Chanteclair","journal-title":"Digit Health"},{"issue":"4","key":"R49","doi-asserted-by":"publisher","first-page":"1607","DOI":"10.1007\/s13347-021-00477-0","article-title":"Transparency and the black box problem: why we do not trust AI","volume":"34","author":"von Eschenbach","journal-title":"Philos Technol"}],"container-title":["JMIR Mental Health"],"original-title":[],"language":"en","deposited":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T19:13:47Z","timestamp":1791314027000},"score":1,"resource":{"primary":{"URL":"https:\/\/mental.jmir.org\/2026\/1\/e93672"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,6]]},"references-count":49,"URL":"https:\/\/doi.org\/10.2196\/93672","relation":{},"ISSN":["2368-7959"],"issn-type":[{"value":"2368-7959","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,6]]},"article-number":"v13i2e93672"}}