{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T04:51:54Z","timestamp":1791435114276,"version":"4.3.3"},"reference-count":8,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T00:00:00Z","timestamp":1787184000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,8,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Chen et\u00a0al. provide proof-of-concept evidence that a general-purpose LLM, using zero-shot training, can derive clinical ratings from transcripts of semi-structured interviews in the AMP-SCZ. In this commentary, we complement this line of research with three considerations. First, the psychometric evaluation strategy would benefit from explicit \u201cuse case\u201d specifications, since acceptable performance thresholds differ substantially across various uses. In the Chen et\u00a0al., data, there is relatively compressed symptom-severity distribution in the data that may obscure its reliability and validity for some, but not all, use cases. Second, defining benchmarks requires consideration. The reliability benchmark used in this study are defensible but may not be ideal for CHR populations and may not fully account for information asymmetries (e.g., evaluating nonverbal behavior from transcripts) between human and LLM raters. Involving consensus or multi-rater benchmarks might better establish ground truth and help evaluate the scientific value of these technologies. Third, involves reproducibility, as single-prompt and single-system validation leaves open how results may be idiosyncratically tied to a specific prompt wording of a specific LLM model. This is a particular issue given the rapid deprecation and change associated with LLM models. To advance the authors ambitious and important research agenda, we recommend fixed annotated validation sets with consensus benchmarks tied to pre-specified use-cases and validation protocols. Additionally, multi-model and ensemble approaches may be important for generalizing results beyond specific LLM technologies. Addressing these issues would strengthen confidence in deploying LLM-derived ratings as a scalable, multilingual tool for schizophrenia research and clinical practice.<\/jats:p>","DOI":"10.1093\/schbul\/sbag174","type":"journal-article","created":{"date-parts":[[2026,8,8]],"date-time":"2026-08-08T11:54:53Z","timestamp":1786190093000},"source":"Crossref","is-referenced-by-count":0,"title":["Advancing Generative Artificial Intelligence for Clinical Assessment: Commentary on Chen, Horga, and Escola 2026"],"prefix":"10.1093","volume":"52","author":[{"given":"George","family":"Chatzisofroniou","sequence":"first","affiliation":[{"name":"Department of Psychology, Louisiana State University , Baton Rouge, LA 70803 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4014-6904","authenticated-orcid":false,"given":"Alex S","family":"Cohen","sequence":"additional","affiliation":[{"name":"Department of Psychology, Louisiana State University , Baton Rouge, LA 70803 ,","place":["United States"]},{"name":"Center for Computation and Technology, Louisiana State University , Baton Rouge, LA 70803 ,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,9,11]]},"reference":[{"key":"2026100800442308700_ref1","article-title":"Using large language models to measure symptom severity scores in patients at-risk for schizophrenia","author":"Chen","year":"2025"},{"key":"2026100800442308700_ref2","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1111\/j.1600-0447.1993.tb03464.x","article-title":"Reliability of a standardized and expanded brief psychiatric rating scale: a replication study","volume":"88","author":"Hafkenscheid","year":"1993","journal-title":"Acta Psychiatr Scand"},{"key":"2026100800442308700_ref3","doi-asserted-by":"publisher","first-page":"3846","DOI":"10.1038\/s41380-025-03070-5","article-title":"Precision psychiatry roadmap: towards a biology-informed framework for mental disorders","volume":"30","author":"Kas","year":"2025","journal-title":"Mol Psychiatry"},{"key":"2026100800442308700_ref4","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1093\/schbul\/sbac051","article-title":"Natural language processing and psychosis: on the need for comprehensive psychometric evaluation","volume":"48","author":"Cohen","year":"2022","journal-title":"Schizophr Bull"},{"key":"2026100800442308700_ref5","volume-title":"Applying Human Factors and Usability Engineering to Medical Devices. Guidance for Industry and FDA Staff","author":"Food","year":"2016"},{"key":"2026100800442308700_ref6","volume-title":"Software as a Medical Device (SaMD): Clinical Evaluation","author":"International Medical Device Regulators Forum","year":"2017"},{"key":"2026100800442308700_ref7","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1002\/wps.20250","article-title":"At risk or not at risk? A meta-analysis of the prognostic accuracy of psychometric interviews for psychosis prediction","volume":"14","author":"Fusar-Poli","year":"2015","journal-title":"World Psychiatry"},{"key":"2026100800442308700_ref8","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2025.1689069","article-title":"Evaluation of large language models on mental health: from knowledge test to illness diagnosis","volume":"16","author":"Xu","year":"2025","journal-title":"Front Psychiatry"}],"container-title":["Schizophrenia Bulletin"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/schizophreniabulletin\/article-pdf\/52\/5\/sbag174\/71031947\/sbag174.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/schizophreniabulletin\/article-pdf\/52\/5\/sbag174\/71031947\/sbag174.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T04:45:14Z","timestamp":1791434714000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/schizophreniabulletin\/article\/doi\/10.1093\/schbul\/sbag174\/8790511"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,20]]},"references-count":8,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,8,20]]}},"URL":"https:\/\/doi.org\/10.1093\/schbul\/sbag174","relation":{},"ISSN":["0586-7614","1745-1701"],"issn-type":[{"value":"0586-7614","type":"print"},{"value":"1745-1701","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,9]]},"published":{"date-parts":[[2026,8,20]]},"article-number":"sbag174"}}