{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T17:06:19Z","timestamp":1761930379811,"version":"3.44.0"},"reference-count":30,"publisher":"BMJ","issue":"1","license":[{"start":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T00:00:00Z","timestamp":1750896000000},"content-version":"unspecified","delay-in-days":25,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["project ID 63631 0011"],"award-info":[{"award-number":["project ID 63631 0011"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Alliance TU\/eWUR-UU-UMCU","award":["Grant from the working group AI for Health"],"award-info":[{"award-number":["Grant from the working group AI for Health"]}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Ment Health"],"accepted":{"date-parts":[[2025,5,16]]},"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>Predicting outcomes in schizophrenia spectrum disorders is challenging due to the variability of individual trajectories. While machine learning (ML) shows promise in outcome prediction, it has not yet been integrated into clinical practice. Understanding how ML models (MLMs) can complement psychiatrists\u2019 predictions and bridge the gap between MLM capabilities and practical use is key.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>This vignette study aims to compare the performance of psychiatrists and MLMs in predicting short-term symptomatic and functional remission in patients with first-episode psychosis and explore whether MLMs can improve psychiatrists\u2019 prognostic accuracy.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Method<\/jats:title>\n                  <jats:p>24 psychiatrists predicted symptomatic and functional remission probabilities at 10\u2009weeks based on written baseline information from 66 patients in the OPtimization of Treatment and Management of Schizophrenia in Europe (OPTiMiSE) trial. ML-generated predictions based on these vignettes were then shared with psychiatrists, allowing them to adjust their estimates.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Findings<\/jats:title>\n                  <jats:p>The predictive accuracy of the MLM was low but comparable to that of psychiatrists for symptomatic remission (MLM: 0.50, psychiatrists: 0.52) and comparable to that of psychiatrists for functional remission (MLM: 0.72, psychiatrists: 0.79). Inter-rater agreement was low but comparable for psychiatrists and the MLM. Although the MLM did not improve overall predictive accuracy, it showed potential in aiding psychiatrists with difficult-to-predict cases. However, psychiatrists struggled to recognise when to rely on the model\u2019s output, and we were unable to determine a clear pattern in these cases based on their characteristics.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>MLMs may have the potential to support psychiatric decision-making, particularly in difficult-to-predict cases, but at present, their effectiveness remains limited due to constraints in predictive accuracy and the ability to identify when to rely on the model\u2019s output. Addressing these issues is crucial to improve the utility of MLMs and foster their integration into clinical practice.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Clinical implications<\/jats:title>\n                  <jats:p>MLMs are best suited as supplementary tools, providing a second opinion while psychiatrists retain decision-making autonomy. Integrating predictions from both sources may help reduce individual biases and improve accuracy. This approach leverages the strengths of MLMs without compromising clinical responsibility.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/bmjment-2025-301594","type":"journal-article","created":{"date-parts":[[2025,6,26]],"date-time":"2025-06-26T14:30:19Z","timestamp":1750948219000},"page":"e301594","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":1,"title":["Prognostic predictions in psychosis: exploring the complementary role of machine learning models"],"prefix":"10.1136","volume":"28","clinical-trial-number":[{"clinical-trial-number":"nct01248195","registry":"10.18810\/clinical-trials-gov"}],"author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7194-7021","authenticated-orcid":false,"given":"Violet van","family":"Dee","sequence":"first","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"},{"name":"Psychiatry, St Antonius Hospital, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7128-814X","authenticated-orcid":false,"given":"Seyed M","family":"Kia","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"},{"name":"Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-7626-8131","authenticated-orcid":false,"given":"Caterina","family":"Fregosi","sequence":"additional","affiliation":[{"name":"Department of Informatics, System and Communication, University of Milan-Bicocca, Milan, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3910-8767","authenticated-orcid":false,"given":"Wilma E","family":"Swildens","sequence":"additional","affiliation":[{"name":"Altrecht Mental Health Care Institute, Utrecht, The Netherlands"},{"name":"Inholland University of Applied Sciences, Amsterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6907-2892","authenticated-orcid":false,"given":"Anne","family":"Alkema","sequence":"additional","affiliation":[{"name":"University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Albert","family":"Batalla","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Coen","family":"van den Berg","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danko","family":"Coric","sequence":"additional","affiliation":[{"name":"GGZ Delfland, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edwin","family":"van Dellen","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"},{"name":"Neurology, UZ Brussel, Brussels, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lotte G","family":"Dijkstra","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arthur","family":"van den Doel","sequence":"additional","affiliation":[{"name":"Altrecht Mental Health Care Institute, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Livia S","family":"Dominicus","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Enterman","sequence":"additional","affiliation":[{"name":"Parnassia Group, The Hague, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5825-050X","authenticated-orcid":false,"given":"Frank L","family":"Gerritse","sequence":"additional","affiliation":[{"name":"Psychiatry, Tergooi MC, Hilversum, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marte Z","family":"van der Horst","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5726-8540","authenticated-orcid":false,"given":"Fedor","family":"van Houwelingen","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Charlotte S","family":"Koch","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1159-2972","authenticated-orcid":false,"given":"Lisanne E M","family":"Koomen","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marjan","family":"Kromkamp","sequence":"additional","affiliation":[{"name":"Mediant Mental Health Care, Enschede, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0553-6042","authenticated-orcid":false,"given":"Michelle","family":"Lancee","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9579-6563","authenticated-orcid":false,"given":"Brian E","family":"Mouthaan","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diane F","family":"van Rappard","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eline J","family":"Regeer","sequence":"additional","affiliation":[{"name":"Altrecht Mental Health Care Institute, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8130-7000","authenticated-orcid":false,"given":"Raymond W J","family":"Salet","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Metten","family":"Somers","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jorgen","family":"Straalman","sequence":"additional","affiliation":[{"name":"Altrecht Mental Health Care Institute, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marjolein H T","family":"de Vette","sequence":"additional","affiliation":[{"name":"BuurtzorgT Mental Health Care, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Judith","family":"Voogt","sequence":"additional","affiliation":[{"name":"Altrecht Mental Health Care Institute, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Inge","family":"Winter-van Rossum","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"},{"name":"Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rene S","family":"Kahn","sequence":"additional","affiliation":[{"name":"Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wiepke","family":"Cahn","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"},{"name":"Altrecht Mental Health Care Institute, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hugo G","family":"Schnack","sequence":"additional","affiliation":[{"name":"Psychiatry, University Medical Centre Utrecht Brain Centre, Utrecht, The Netherlands"},{"name":"Institute for Language Sciences, Utrecht University, Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"239","published-online":{"date-parts":[[2025,6,26]]},"reference":[{"key":"2025082703181067000_28.1.e301594.1","doi-asserted-by":"crossref","DOI":"10.1192\/j.eurpsy.2021.2246","article-title":"Proportion and predictors of remission and recovery in first-episode psychosis: Systematic review and meta-analysis","volume":"64","author":"Catalan","year":"2021","journal-title":"Eur Psychiatry"},{"key":"2025082703181067000_28.1.e301594.2","doi-asserted-by":"crossref","unstructured":"Percie du Sert O , Unrau J , Dama M , et al . Latent Trajectories of Positive, Negative Symptoms and Functioning in Early Intervention Services for First-Episode Psychosis: A 2-Year Follow-Up Study. Schizophr Bull 2025:sbaf045. doi:10.1093\/schbul\/sbaf045","DOI":"10.1093\/schbul\/sbaf045"},{"key":"2025082703181067000_28.1.e301594.3","doi-asserted-by":"crossref","first-page":"148","DOI":"10.3109\/13651501.2012.704384","article-title":"Predictors of symptomatic remission in first-episode psychosis outpatients treated with quetiapine: a naturalistic study","volume":"17","author":"Gade","year":"2013","journal-title":"Int J Psychiatry Clin Pract"},{"key":"2025082703181067000_28.1.e301594.4","doi-asserted-by":"crossref","DOI":"10.1038\/s41398-023-02371-z","article-title":"Machine learning methods to predict outcomes of pharmacological treatment in psychosis","volume":"13","author":"Del Fabro","year":"2023","journal-title":"Transl Psychiatry"},{"key":"2025082703181067000_28.1.e301594.5","doi-asserted-by":"publisher","DOI":"10.1016\/s2589-7500(19)30121-9"},{"key":"2025082703181067000_28.1.e301594.6","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1146\/annurev-clinpsy-032816-045037","article-title":"Machine Learning Approaches for Clinical Psychology and Psychiatry","volume":"14","author":"Dwyer","year":"2018","journal-title":"Annu Rev Clin Psychol"},{"key":"2025082703181067000_28.1.e301594.7","doi-asserted-by":"crossref","first-page":"2700","DOI":"10.1038\/s41380-022-01528-4","article-title":"Clinical prediction models in psychiatry: a systematic review of two decades of progress and challenges","volume":"27","author":"Meehan","year":"2022","journal-title":"Mol Psychiatry"},{"key":"2025082703181067000_28.1.e301594.8","doi-asserted-by":"publisher","DOI":"10.31887\/DCNS.2004.6.1\/pschulz"},{"key":"2025082703181067000_28.1.e301594.9","doi-asserted-by":"crossref","first-page":"1316","DOI":"10.1177\/00048674231158267","article-title":"Machine learning prediction will be part of future treatment of depression","volume":"57","author":"Lennon","year":"2023","journal-title":"Aust N Z J Psychiatry"},{"key":"2025082703181067000_28.1.e301594.10","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2018-022724","article-title":"Role of intuitive knowledge in the diagnostic reasoning of hospital specialists: a focus group study","volume":"9","author":"Van den Brink","year":"2019","journal-title":"BMJ Open"},{"key":"2025082703181067000_28.1.e301594.11","doi-asserted-by":"publisher","DOI":"10.1093\/schbul\/sbad154"},{"key":"2025082703181067000_28.1.e301594.12","doi-asserted-by":"publisher","DOI":"10.1007\/bf00381214"},{"key":"2025082703181067000_28.1.e301594.13","doi-asserted-by":"publisher","DOI":"10.1007\/bf00782738"},{"key":"2025082703181067000_28.1.e301594.14","doi-asserted-by":"publisher","DOI":"10.1016\/s2215-0366(18)30252-9"},{"key":"2025082703181067000_28.1.e301594.15","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.162.3.441"},{"key":"2025082703181067000_28.1.e301594.16","doi-asserted-by":"publisher","DOI":"10.1034\/j.1600-0447.2000.101004323.x"},{"key":"2025082703181067000_28.1.e301594.17","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1111\/acps.13754","article-title":"Psychosis Prognosis Predictor: A continuous and uncertainty-aware prediction of treatment outcome in first-episode psychosis","volume":"151","author":"van Opstal","year":"2025","journal-title":"Acta Psychiatr Scand"},{"key":"2025082703181067000_28.1.e301594.18","unstructured":"Castor EDC . Castor electronic data capture 2019. 2019. Available: https:\/\/castoredc.com [Accessed 28 Aug 2019]."},{"key":"2025082703181067000_28.1.e301594.19","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"2025082703181067000_28.1.e301594.20","doi-asserted-by":"publisher","DOI":"10.1037\/cou0000065"},{"key":"2025082703181067000_28.1.e301594.21","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1093\/schbul\/sbab145","article-title":"Long-Term Outcomes of First-Admission Psychosis: A Naturalistic 21-Year Follow-Up Study of Symptomatic, Functional and Personal Recovery and Their Baseline Predictors","volume":"48","author":"Peralta","year":"2022","journal-title":"Schizophr Bull"},{"key":"2025082703181067000_28.1.e301594.22","doi-asserted-by":"publisher","DOI":"10.1016\/j.schres.2020.11.047"},{"key":"2025082703181067000_28.1.e301594.23","doi-asserted-by":"publisher","DOI":"10.1016\/j.schres.2024.02.037"},{"key":"2025082703181067000_28.1.e301594.24","doi-asserted-by":"publisher","DOI":"10.1080\/14740338.2021.1983540"},{"key":"2025082703181067000_28.1.e301594.25","doi-asserted-by":"publisher","DOI":"10.1016\/j.schres.2023.02.024"},{"key":"2025082703181067000_28.1.e301594.26","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpr.2017.09.007"},{"key":"2025082703181067000_28.1.e301594.27","doi-asserted-by":"crossref","DOI":"10.1126\/science.adp7977","article-title":"Medical forecasting","volume":"384","author":"Topol","year":"2024","journal-title":"Science"},{"key":"2025082703181067000_28.1.e301594.28","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1007\/s10597-024-01399-9","article-title":"In Pursuit of Recovery: A Comparative Study of Stakeholder Perspectives on Outcomes of People with Psychosis","volume":"61","author":"van Dee","year":"2025","journal-title":"Community Ment Health J"},{"key":"2025082703181067000_28.1.e301594.29","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X15581615"},{"key":"2025082703181067000_28.1.e301594.30","doi-asserted-by":"crossref","DOI":"10.3389\/fpsyt.2023.1237490","article-title":"Revealing the impact of psychiatric comorbidities on treatment outcome in early psychosis using counterfactual model explanation","volume":"14","author":"van Dee","year":"2023","journal-title":"Front Psychiatry"}],"container-title":["BMJ Mental Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjment-2025-301594","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,27]],"date-time":"2025-08-27T10:18:18Z","timestamp":1756289898000},"score":1,"resource":{"primary":{"URL":"https:\/\/mentalhealth.bmj.com\/lookup\/doi\/10.1136\/bmjment-2025-301594"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,6,26]]},"published-print":{"date-parts":[[2025,6]]}},"alternative-id":["10.1136\/bmjment-2025-301594"],"URL":"https:\/\/doi.org\/10.1136\/bmjment-2025-301594","relation":{},"ISSN":["2755-9734"],"issn-type":[{"type":"electronic","value":"2755-9734"}],"subject":[],"published":{"date-parts":[[2025,6]]}}}