{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T20:19:33Z","timestamp":1778876373642,"version":"3.51.4"},"reference-count":70,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,6,7]],"date-time":"2023-06-07T00:00:00Z","timestamp":1686096000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003331","name":"Provincial Health Services Authority","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003331","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:p>Antipsychotics are the only therapeutic class indicated in the symptomatic management of psychotic disorders. However, individuals diagnosed with schizophrenia or schizoaffective disorder may not always benefit from these first-line agents. This refractoriness to conventional treatment can be difficult to address in most clinical settings. Therefore, a referral to a tertiary-care program that is better able to deliver specialized care in excess of the needs of most individuals may be necessary. The average outcome following a period of treatment at these programs tends to be one of improvement. Nonetheless, accurate prognostication of individual-level responses may be useful in identifying those who are unlikely to improve despite receiving specialized care. Thus, the main objective of this study was to predict symptom severity around the time of discharge from the Refractory Psychosis Program in British Columbia, Canada using only clinicodemographic information and prescription drug data available at the time of admission. To this end, a different boosted beta regression model was trained to predict the total score on each of the five factors of the Positive and Negative Syndrome Scale (PANSS) using a data set composed of 320 hospital admissions. Internal validation of these prediction models was then accomplished by nested cross-validation. Insofar as it is possible to make comparisons of model performance across different outcomes, the correlation between predictions and observations tended to be higher for the negative and disorganized factors than the positive, excited, and depressed factors on internal validation. Past scores had the greatest effect on the prediction of future scores across all 5 factors. The results of this study serve as a proof of concept for the prediction of symptom severity using this specific approach.<\/jats:p>","DOI":"10.3389\/fpsyt.2023.1181740","type":"journal-article","created":{"date-parts":[[2023,6,7]],"date-time":"2023-06-07T06:39:13Z","timestamp":1686119953000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Developing prediction models for symptom severity around the time of discharge from a tertiary-care program for treatment-resistant psychosis"],"prefix":"10.3389","volume":"14","author":[{"given":"Lik Hang N.","family":"Lee","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ric M.","family":"Procyshyn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Randall F.","family":"White","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kristina M.","family":"Gicas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William G.","family":"Honer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alasdair M.","family":"Barr","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,6,7]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"741","DOI":"10.1016\/j.biopsych.2015.08.035","article-title":"Spines, synapses, and schizophrenia","volume":"78","author":"Ramos-Miguel","year":"2015","journal-title":"Biol Psychiatry"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1016\/j.biopsych.2014.12.012","article-title":"Increased SNARE protein\u2013protein interactions in orbitofrontal and anterior cingulate cortices in schizophrenia","volume":"78","author":"Ramos-Miguel","year":"2015","journal-title":"Biol Psychiatry"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"706017","DOI":"10.3389\/fpsyt.2021.706017","article-title":"Bridging the gap? Altered thalamocortical connectivity in psychotic and psychedelic states","volume":"12","author":"Avram","year":"2021","journal-title":"Front Psych"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1093\/schbul\/sbz060","article-title":"Synapse pathology in schizophrenia: a meta-analysis of postsynaptic elements in postmortem brain studies","volume":"46","author":"Berdenis van Berlekom","year":"2020","journal-title":"Schizophr Bull"},{"key":"ref5","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.schres.2014.05.020","article-title":"A selective review of structural connectivity abnormalities of schizophrenic patients at different stages of the disease","volume":"161","author":"Canu","year":"2015","journal-title":"Schizophr Res"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1192\/bjp.2021.61","article-title":"Rates of treatment-resistant schizophrenia from first-episode cohorts: systematic review and meta-analysis","volume":"220","author":"Siskind","year":"2022","journal-title":"Br J Psychiatry"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"e0267808","DOI":"10.1371\/journal.pone.0267808","article-title":"Long-acting injectable antipsychotics for early psychosis: a comprehensive systematic review","volume":"17","author":"Lian","year":"2022","journal-title":"PLoS One"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1111\/eip.13202","article-title":"Efficacy of long-acting injectable versus oral antipsychotic drugs in early psychosis: a systematic review and meta-analysis","volume":"16","author":"Lian","year":"2021","journal-title":"Early Interv Psychiatry"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1002\/hup.2469","article-title":"Rate and predictors of non-response to first-line antipsychotic treatment in first-episode schizophrenia","volume":"30","author":"Chiliza","year":"2015","journal-title":"Hum Psychopharmacol"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1017\/s0033291719002083","article-title":"Predictors of treatment resistant schizophrenia: a systematic review of prospective observational studies","volume":"51","author":"Smart","year":"2021","journal-title":"Psychol Med"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1176\/appi.ajp.2016.16050503","article-title":"Treatment-resistant schizophrenia: treatment response and resistance in psychosis (TRRIP) working group consensus guidelines on diagnosis and terminology","volume":"174","author":"Howes","year":"2017","journal-title":"Am J Psychiatry"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1192\/bjp.bp.115.177261","article-title":"Clozapine v. first-and second-generation antipsychotics in treatment-refractory schizophrenia: systematic review and meta-analysis","volume":"209","author":"Siskind","year":"2016","journal-title":"Br J Psychiatry"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1192\/pb.bp.112.042598","article-title":"Unheard voices: outcomes of tertiary care for treatment-refractory psychosis","volume":"38","author":"Sarkar","year":"2014","journal-title":"Psychiatr Bull"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"797427","DOI":"10.3389\/fpsyt.2022.797427","article-title":"Acceptability of peer support for people with schizophrenia in Chennai, India: a cross sectional study amongst people with lived experience, caregivers, and mental health professionals","volume":"13","author":"Sims","year":"2022","journal-title":"Front Psychiatry"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.4088\/JCP.08m04740yel","article-title":"Outcome evaluation of a structured educational wellness program in patients with severe mental illness","volume":"70","author":"Lindenmayer","year":"2009","journal-title":"J Clin Psychiatry"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1111\/eip.13152","article-title":"Bridging the gap: a new integrated early intervention service for young people with complex mental health issues","volume":"16","author":"White","year":"2022","journal-title":"Early Interv Psychiatry"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"e0199758","DOI":"10.1371\/journal.pone.0199758","article-title":"Antipsychotic prescribing patterns on admission to and at discharge from a tertiary care program for treatment-resistant psychosis","volume":"13","author":"Lee","year":"2018","journal-title":"PLoS One"},{"key":"ref18","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1093\/schbul\/13.2.261","article-title":"The positive and negative syndrome scale (PANSS) for schizophrenia","volume":"13","author":"Kay","year":"1987","journal-title":"Schizophr Bull"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1007\/s00406-013-0460-x","article-title":"Symptom changes in five dimensions of the positive and negative syndrome scale in refractory psychosis","volume":"264","author":"Woodward","year":"2014","journal-title":"Eur Arch Psychiatry Clin Neurosci"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"1472","DOI":"10.1053\/j.jvca.2015.06.018","article-title":"Incidence of and risk factors for delirium after cardiac surgery at a quaternary care center: a retrospective cohort study","volume":"29","author":"Tse","year":"2015","journal-title":"J Cardiothorac Vasc Anesth"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1007\/s12630-014-0254-2","article-title":"Postoperative delirium following transcatheter aortic valve implantation: a historical cohort study","volume":"62","author":"Tse","year":"2015","journal-title":"Can J Anaesth"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"1686","DOI":"10.21105\/joss.01686","article-title":"Welcome to the Tidyverse","volume":"4","author":"Wickham","year":"2019","journal-title":"J Open Source Softw"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1111\/j.1467-9876.2005.00510.x","article-title":"Generalized additive models for location, scale and shape","volume":"54","author":"Rigby","year":"2005","journal-title":"J R Stat Soc C"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s00180-012-0382-5","article-title":"Model-based boosting in R: a hands-on tutorial using the R package mboost","volume":"29","author":"Hofner","year":"2014","journal-title":"Comput Stat"},{"key":"ref25","volume-title":"Rsample: general resampling infrastructure. R package version 0.0.4","author":"Kuhn","year":"2019"},{"key":"ref26","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-24277-4","volume-title":"Ggplot 2: elegant graphics for data analysis","author":"Wickham","year":"2016"},{"key":"ref27","volume-title":"Viridis: default color maps from \u2018matplotlib\u2019. R package version","author":"Garnier","year":"2018"},{"key":"ref28","volume-title":"Cowplot: streamlined plot theme and plot annotations for \u201cggplot2\u201d. R package version","author":"Wilke","year":"2019"},{"key":"ref29","author":"Chang","year":"2014"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"e61623","DOI":"10.1371\/journal.pone.0061623","article-title":"Boosted Beta regression","volume":"8","author":"Schmid","year":"2013","journal-title":"PLoS One"},{"key":"ref31","author":"Hofner","year":"2020"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1016\/j.schres.2012.01.031","article-title":"Searching for a consensus five-factor model of the positive and negative syndrome scale for schizophrenia","volume":"137","author":"Wallwork","year":"2012","journal-title":"Schizophr Res"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1191\/1471082X03st053oa","article-title":"Regression analysis of variates observed on (0,1): percentages, proportions and fractions","volume":"3","author":"Kieschnick","year":"2003","journal-title":"Stat Model"},{"key":"ref34","doi-asserted-by":"publisher","first-page":"799","DOI":"10.1080\/0266476042000214501","article-title":"Beta regression for modelling rates and proportions","volume":"31","author":"Ferrari","year":"2004","journal-title":"J Appl Stat"},{"key":"ref35","article-title":"Inflated discrete beta regression models for Likert and discrete rating scale outcomes","author":"Taverne","year":"2014"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1016\/j.csda.2008.09.009","article-title":"Boosting additive models using component-wise P-splines","volume":"53","author":"Schmid","year":"2008","journal-title":"Comput Stat Data Anal"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1007\/s11222-017-9754-6","article-title":"Gradient boosting for distributional regression: faster tuning and improved variable selection via noncyclical updates","volume":"28","author":"Thomas","year":"2018","journal-title":"Stat Comput"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1146\/annurev-clinpsy-032816-045037","article-title":"Machine learning approaches for clinical psychology and psychiatry","volume":"14","author":"Dwyer","year":"2018","journal-title":"Annu Rev Clin Psychol"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1186\/1471-2105-7-91","article-title":"Bias in error estimation when using cross-validation for model selection","volume":"7","author":"Varma","year":"2006","journal-title":"BMC Bioinf"},{"key":"ref40","year":"2020"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1097\/jcp.0000000000001342","article-title":"High-dose fluvoxamine augmentation to clozapine in treatment-resistant psychosis","volume":"41","author":"Leising","year":"2021","journal-title":"J Clin Psychopharmacol"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"956","DOI":"10.1198\/jcgs.2011.09220","article-title":"A framework for unbiased model selection based on boosting","volume":"20","author":"Hofner","year":"2011","journal-title":"J Comput Graph Stat"},{"key":"ref43","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.1093\/ije\/dyy093","article-title":"The betaboost package\u2014a software tool for modelling bounded outcome variables in potentially high-dimensional epidemiological data","volume":"47","author":"Mayr","year":"2018","journal-title":"Int J Epidemiol"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1111\/j.1467-9868.2007.00587.x","article-title":"Probabilistic forecasts, calibration, and sharpness","volume":"69","author":"Gneiting","year":"2007","journal-title":"J R Stat Soc B"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1146\/annurev-statistics-062713-085831","article-title":"Probabilistic forecasting","volume":"1","author":"Gneiting","year":"2014","journal-title":"Ann Rev Stat Appl"},{"key":"ref46","doi-asserted-by":"publisher","first-page":"421","DOI":"10.32614\/RJ-2017-016","article-title":"PDP: an R package for constructing partial dependence plots","volume":"9","author":"Greenwell","year":"2017","journal-title":"R J"},{"key":"ref47","doi-asserted-by":"publisher","first-page":"1330","DOI":"10.1016\/j.pnpbp.2007.06.002","article-title":"Clinical predictors of therapeutic response to clozapine in a sample of Turkish patients with treatment-resistant schizophrenia","volume":"31","author":"Semiz","year":"2007","journal-title":"Prog Neuro-Psychopharmacol Biol Psychiatry"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1002\/bjs.9736","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement","volume":"102","author":"Collins","year":"2015","journal-title":"Br J Surg"},{"key":"ref49","volume-title":"Cross-validation: what does it estimate and how well does it do it?","author":"Bates","year":"2021"},{"key":"ref50","first-page":"772","volume-title":"Clozapine response rates among people with treatment-resistant schizophrenia: data from a systematic review and meta-analysis","author":"Siskind","year":"2017"},{"key":"ref51","doi-asserted-by":"publisher","first-page":"1069432","DOI":"10.3389\/fpsyt.2022.1069432","article-title":"Third-generation antipsychotics in patients with schizophrenia and non-responsivity or intolerance to clozapine regimen: what is the evidence?","volume":"13","author":"Vasiliu","year":"2022","journal-title":"Front Psych"},{"key":"ref52","doi-asserted-by":"publisher","first-page":"MY20096AH1C","DOI":"10.4088\/jcp.my20096ah1c","article-title":"Treatment-resistant schizophrenia: definition, predictors, and therapy options","volume":"82","author":"Correll","year":"2021","journal-title":"J Clin Psychiatry"},{"key":"ref53","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.schres.2021.08.005","article-title":"Predictors of response to pharmacological treatments in treatment-resistant schizophrenia \u2013 a systematic review and meta-analysis","volume":"236","author":"Sepp\u00e4l\u00e4","year":"2021","journal-title":"Schizophr Res"},{"key":"ref54","doi-asserted-by":"publisher","first-page":"609240","DOI":"10.3389\/fendo.2021.609240","article-title":"A focused review of the metabolic side-effects of clozapine","volume":"12","author":"Yuen","year":"2021","journal-title":"Front Endocrinol"},{"key":"ref55","doi-asserted-by":"publisher","first-page":"203","DOI":"10.3389\/fnins.2018.00203","article-title":"Clozapine-induced cardiovascular side effects and autonomic dysfunction: a systematic review","volume":"12","author":"Yuen","year":"2018","journal-title":"Front Neurosci"},{"key":"ref56","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1097\/YIC.0000000000000014","article-title":"Pharmacological treatment of antipsychotic-induced dyslipidemia and hypertension","volume":"29","author":"Tse","year":"2014","journal-title":"Int Clin Psychopharmacol"},{"key":"ref57","doi-asserted-by":"publisher","first-page":"20451253221092931","DOI":"10.1177\/20451253221092931","article-title":"Treatment strategies for clozapine-induced hypotension: a systematic review","volume":"12","author":"Tanzer","year":"2022","journal-title":"Therapeut Adv Psychopharmacol"},{"key":"ref58","doi-asserted-by":"publisher","first-page":"327","DOI":"10.3389\/fpsyt.2018.00327","article-title":"Biological predictors of clozapine response: a systematic review","volume":"9","author":"Samanaite","year":"2018","journal-title":"Front Psych"},{"key":"ref59","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1007\/s00406-019-01053-6","article-title":"Clozapine response trajectories and predictors of non-response in treatment-resistant schizophrenia: a chart review study","volume":"270","author":"Shah","year":"2020","journal-title":"Eur Arch Psychiatry Clin Neurosci"},{"key":"ref60","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1016\/j.psychres.2018.06.070","article-title":"The impact of delay in clozapine initiation on treatment outcomes in patients with treatment-resistant schizophrenia: a systematic review","volume":"268","author":"Shah","year":"2018","journal-title":"Psychiatry Res"},{"key":"ref61","doi-asserted-by":"publisher","first-page":"1459","DOI":"10.1093\/schbul\/sbaa060","article-title":"Clozapine combination and augmentation strategies in patients with schizophrenia\u2014recommendations from an international expert survey among the treatment response and resistance in psychosis (TRRIP) working group","volume":"46","author":"Wagner","year":"2020","journal-title":"Schizophr Bull"},{"key":"ref62","doi-asserted-by":"publisher","first-page":"1279","DOI":"10.1016\/j.euroneuro.2014.04.001","article-title":"How antipsychotics impact the different dimensions of schizophrenia: a test of competing hypotheses","volume":"24","author":"Marques","year":"2014","journal-title":"Eur Neuropsychopharmacol"},{"key":"ref63","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1016\/j.neubiorev.2020.01.017","article-title":"Demographic and clinical features as predictors of clozapine response in patients with schizophrenia spectrum disorders: a systematic review and meta-analysis","volume":"111","author":"Okhuijsen-Pfeifer","year":"2020","journal-title":"Neurosci Biobehav Rev"},{"key":"ref64","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1016\/j.schres.2005.04.008","article-title":"What does the PANSS mean?","volume":"79","author":"Leucht","year":"2005","journal-title":"Schizophr Res"},{"key":"ref65","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.eswa.2018.05.005","article-title":"A network-based classification framework for predicting treatment response of schizophrenia patients","volume":"109","author":"Esfahlani","year":"2018","journal-title":"Expert Syst Appl"},{"key":"ref66","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1214\/ss\/1009213726","article-title":"Statistical modeling: the two cultures (with comments and a rejoinder by the author)","volume":"16","author":"Breiman","year":"2001","journal-title":"Stat Sci"},{"key":"ref67","volume-title":"The prediction-explanation fallacy: a pervasive problem in scientific applications of machine learning Psy ArXiv","author":"Del Giudice","year":"2021"},{"key":"ref68","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1038\/s41398-023-02371-z","article-title":"Machine learning methods to predict outcomes of pharmacological treatment in psychosis","volume":"13","author":"Del Fabro","year":"2023","journal-title":"Transl Psychiatry"},{"key":"ref69","first-page":"77","article-title":"Positive and negative syndrome scale (PANSS) training: challenges, solutions, and future directions","volume":"14","author":"Opler","year":"2017","journal-title":"Innovat Clin Neurosci"},{"key":"ref70","first-page":"68","article-title":"Bridging the measurement gap between research and clinical Care in Schizophrenia: positive and negative syndrome Scale-6 (PANSS-6) and other assessments based on the simplified negative and positive symptoms interview (SNAPSI)","volume":"14","author":"\u00d8stergaard","year":"2017","journal-title":"Innovat Clin Neurosci."}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2023.1181740\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,7]],"date-time":"2023-06-07T06:39:24Z","timestamp":1686119964000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2023.1181740\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,7]]},"references-count":70,"alternative-id":["10.3389\/fpsyt.2023.1181740"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2023.1181740","relation":{},"ISSN":["1664-0640"],"issn-type":[{"value":"1664-0640","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,7]]},"article-number":"1181740"}}