{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,9]],"date-time":"2026-09-09T05:04:19Z","timestamp":1788930259294,"version":"build-2803163510"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T00:00:00Z","timestamp":1752105600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T00:00:00Z","timestamp":1752105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Council on Criminal Justice"},{"name":"VA Health Services Research & Development","award":["SDR 19-345"],"award-info":[{"award-number":["SDR 19-345"]}]},{"name":"VA Health Services Research & Development Services","award":["RCS 14-232 - Harris"],"award-info":[{"award-number":["RCS 14-232 - Harris"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Mental Health Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Although patients with criminal legal system involvement have among the highest rates of suicide, the model that identifies patients at high risk of suicide at the United States Veterans Health Administration (VHA) does not include predictors specific to criminal legal system involvement. We explored whether the model\u2019s predictive ability would be improved (1) by retraining the model for legal-involved veterans and (2) by adding additional predictors associated with legal-involvement. For a combined outcome of suicide attempt or suicide death, the retrained models showed a positive predictive value (PPV) of 0.124 and false negative rate (FNR) of 0.527. Adding additional predictors associated with being legal-involved did not improve predictive accuracy. Retraining the VHA suicide risk prediction model for legal-involved patients improves the model\u2019s predictive ability for this group of high-risk patients, more so than adding predictors associated with being legal-involved. A similar approach for other high-risk patients is worth exploring.<\/jats:p>","DOI":"10.1038\/s44184-025-00143-9","type":"journal-article","created":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T08:57:19Z","timestamp":1752137839000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Retraining the veterans health administration\u2019s REACH VET suicide risk prediction model for patients involved in the legal system"],"prefix":"10.1038","volume":"4","author":[{"given":"Esther L.","family":"Meerwijk","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea K.","family":"Finlay","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex H. S.","family":"Harris","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,10]]},"reference":[{"key":"143_CR1","unstructured":"VA Suicide Prevention Office of Mental Health and Suicide Prevention. 2023 National Veteran Suicide Prevention Annual Report. https:\/\/www.mentalhealth.va.gov\/docs\/data-sheets\/2023\/2023-National-Veteran-Suicide-Prevention-Annual-Report-FINAL-508.pdf (2023)."},{"key":"143_CR2","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1111\/sltb.12631","volume":"50","author":"KM Palframan","year":"2020","unstructured":"Palframan, K. M., Blue-Howells, J., Clark, S. C. & McCarthy, J. F. Veterans Justice Programs: Assessing Population Risks for Suicide Deaths and Attempts. Suicide Life Threat. Behav. 50, 792\u2013804 (2020).","journal-title":"Suicide Life Threat. Behav."},{"key":"143_CR3","unstructured":"U. S. Department of Veterans Affairs. Department of Veterans Affairs FY 2018 \u2212 2024 Strategic Plan. (2018)."},{"key":"143_CR4","unstructured":"The White House. Reducing Military and Veteran Suicide: Advancing a Comprehensive Cross-Sector, Evidence-Informed Public Health Strategy. (2021)."},{"key":"143_CR5","doi-asserted-by":"publisher","first-page":"1935","DOI":"10.2105\/AJPH.2015.302737","volume":"105","author":"JF McCarthy","year":"2015","unstructured":"McCarthy, J. F. et al. Predictive Modeling and Concentration of the Risk of Suicide: Implications for Preventive Interventions in the US Department of Veterans Affairs. Am J Public Health 105, 1935\u20131942 (2015).","journal-title":"Am J Public Health"},{"key":"143_CR6","doi-asserted-by":"crossref","unstructured":"Kessler, R. C. et al. Developing a practical suicide risk prediction model for targeting high-risk patients in the Veterans health Administration. Int. J. Methods Psychiatr. Res. 26, (2017).","DOI":"10.1002\/mpr.1575"},{"key":"143_CR7","unstructured":"U.S. Departments of Veterans Affairs & Defense. VA\/DoD Clinical Practice Guideline for the Assessment and Management of Patients at Risk for Suicide. https:\/\/www.healthquality.va.gov\/guidelines\/MH\/srb\/VADoD-CPG-Suicide-Risk-Full-CPG-2024_Final_508.pdf (2024)."},{"key":"143_CR8","doi-asserted-by":"publisher","first-page":"e2129900","DOI":"10.1001\/jamanetworkopen.2021.29900","volume":"4","author":"JF McCarthy","year":"2021","unstructured":"McCarthy, J. F. et al. Evaluation of the Recovery Engagement and Coordination for Health\u2013Veterans Enhanced Treatment Suicide Risk Modeling Clinical Program in the Veterans Health Administration. JAMA Netw Open 4, e2129900 (2021).","journal-title":"JAMA Netw Open"},{"key":"143_CR9","doi-asserted-by":"publisher","first-page":"1227","DOI":"10.1016\/S0140-6736(15)00234-2","volume":"387","author":"G Turecki","year":"2016","unstructured":"Turecki, G. & Brent, D. A. Suicide and suicidal behaviour. Lancet 387, 1227\u20131239 (2016).","journal-title":"Lancet"},{"key":"143_CR10","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1111\/acps.13629","volume":"148","author":"SD Nielsen","year":"2023","unstructured":"Nielsen, S. D. et al. Prediction models of suicide and non-fatal suicide attempt after discharge from a psychiatric inpatient stay: A machine learning approach on nationwide Danish registers. Acta Psychiatr. Scand. 148, 525\u2013537 (2023).","journal-title":"Acta Psychiatr. Scand."},{"key":"143_CR11","doi-asserted-by":"publisher","first-page":"102395","DOI":"10.1016\/j.artmed.2022.102395","volume":"132","author":"N Nordin","year":"2022","unstructured":"Nordin, N., Zainol, Z., Mohd Noor, M. H. & Chan, L. F. Suicidal behaviour prediction models using machine learning techniques: A systematic review. Artif. Intell. Med. 132, 102395 (2022).","journal-title":"Artif. Intell. Med."},{"key":"143_CR12","unstructured":"Harris, A. H. S., Finlay, A. K. & Meerwijk, E. L. Evaluating the Accuracy of the Veterans Health Administration\u2019s REACH VET Suicide Prediction Model for Legal Involved Veterans. (Submitted for publication)."},{"key":"143_CR13","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1146\/annurev-clinpsy-021815-093204","volume":"12","author":"ED Klonsky","year":"2016","unstructured":"Klonsky, E. D., May, A. M. & Saffer, B. Y. Suicide, Suicide Attempts, and Suicidal Ideation. Annu. Rev. Clin. Psychol. 12, 307\u2013330 (2016).","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"143_CR14","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1037\/bul0000084","volume":"143","author":"JC Franklin","year":"2017","unstructured":"Franklin, J. C. et al. Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychol. Bull. 143, 187\u2013232 (2017).","journal-title":"Psychol. Bull."},{"key":"143_CR15","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1176\/appi.ajp.2016.15070854","volume":"173","author":"JM Bostwick","year":"2016","unstructured":"Bostwick, J. M., Pabbati, C., Geske, J. R. & McKean, A. J. Suicide Attempt as a Risk Factor for Completed Suicide: Even More Lethal Than We Knew. Am J Psychiatry 173, 1094\u20131100 (2016).","journal-title":"Am J Psychiatry"},{"key":"143_CR16","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1038\/s41572-019-0121-0","volume":"5","author":"G Turecki","year":"2019","unstructured":"Turecki, G. et al. Suicide and suicide risk. Nat Rev Dis Primers 5, 74 (2019).","journal-title":"Nat Rev Dis Primers"},{"key":"143_CR17","doi-asserted-by":"publisher","first-page":"1266","DOI":"10.1176\/appi.ajp.2011.10111704","volume":"168","author":"K Posner","year":"2011","unstructured":"Posner, K. et al. The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry 168, 1266\u20131277 (2011).","journal-title":"Am J Psychiatry"},{"key":"143_CR18","doi-asserted-by":"publisher","first-page":"1466","DOI":"10.3389\/fpsyg.2016.01466","volume":"7","author":"AM Boonstra","year":"2016","unstructured":"Boonstra, A. M. et al. Cut-Off Points for Mild, Moderate, and Severe Pain on the Numeric Rating Scale for Pain in Patients with Chronic Musculoskeletal Pain: Variability and Influence of Sex and Catastrophizing. Front Psychol 7, 1466 (2016).","journal-title":"Front Psychol"},{"key":"143_CR19","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1177\/0033354916670133","volume":"131","author":"C Hoffmire","year":"2016","unstructured":"Hoffmire, C. et al. VA Suicide Prevention Applications Network: A National Health Care System-Based Suicide Event Tracking System. Public Health Rep 131, 816\u2013821 (2016).","journal-title":"Public Health Rep"},{"key":"143_CR20","unstructured":"Center of Excellence for Suicide Prevention. Joint Department of Veterans Affairs (VA) and Department of Defense (DoD) Mortality Data Repository \u2013 National Death Index (NDI). https:\/\/www.mirecc.va.gov\/suicideprevention\/documents\/VA_DoD-MDR_Flyer.pdf."},{"key":"143_CR21","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","volume":"21","author":"EW Steyerberg","year":"2010","unstructured":"Steyerberg, E. W. et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 21, 128\u2013138 (2010).","journal-title":"Epidemiology"},{"key":"143_CR22","unstructured":"Python Software Foundation. Python. https:\/\/www.python.org\/."},{"key":"143_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v036.i03","volume":"36","author":"W Viechtbauer","year":"2010","unstructured":"Viechtbauer, W. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software 36, 1\u201348 (2010).","journal-title":"Journal of Statistical Software"},{"key":"143_CR24","doi-asserted-by":"publisher","first-page":"706","DOI":"10.1111\/sltb.12617","volume":"50","author":"L Mayer","year":"2020","unstructured":"Mayer, L. et al. Anticipated Suicide Stigma, Secrecy, and Suicidality among Suicide Attempt Survivors. Suicide Life Threat Behav 50, 706\u2013713 (2020).","journal-title":"Suicide Life Threat Behav"},{"key":"143_CR25","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1111\/sltb.13063","volume":"54","author":"HL Brown","year":"2024","unstructured":"Brown, H. L. et al. The impact of relationship type and closeness on mental health following suicide loss. Suicide Life Threat Behav 54, 479\u2013488 (2024).","journal-title":"Suicide Life Threat Behav"},{"key":"143_CR26","doi-asserted-by":"publisher","first-page":"1244","DOI":"10.3389\/fpsyg.2020.01244","volume":"11","author":"I Berardelli","year":"2020","unstructured":"Berardelli, I. et al. Making Sense of the Unique Pain of Survivors: A Psychoeducational Approach for Suicide Bereavement. Front Psychol 11, 1244 (2020).","journal-title":"Front Psychol"},{"key":"143_CR27","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1177\/00302228211026513","volume":"87","author":"DM Goulah-Pabst","year":"2023","unstructured":"Goulah-Pabst, D. M. Suicide Loss Survivors: Navigating Social Stigma and Threats to Social Bonds. Omega ((Westport)) 87, 769\u2013792 (2023).","journal-title":"Omega ((Westport))"},{"key":"143_CR28","doi-asserted-by":"publisher","first-page":"2182820","DOI":"10.1080\/20008066.2023.2182820","volume":"14","author":"Y Levi-Belz","year":"2023","unstructured":"Levi-Belz, Y. & Hamdan, S. Shame, depression, and complicated grief among suicide loss-survivors: the moderating role of self-disclosure. Eur J Psychotraumatol 14, 2182820 (2023).","journal-title":"Eur J Psychotraumatol"},{"key":"143_CR29","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1186\/s12888-024-05632-3","volume":"24","author":"LB Segar","year":"2024","unstructured":"Segar, L. B. et al. The cost of illness and burden of suicide and suicide attempts in France. BMC Psychiatry 24, 215 (2024).","journal-title":"BMC Psychiatry"},{"key":"143_CR30","doi-asserted-by":"publisher","first-page":"950","DOI":"10.1186\/s12889-021-11010-5","volume":"21","author":"B \u0141yszczarz","year":"2021","unstructured":"\u0141yszczarz, B. Production losses attributable to suicide deaths in European Union. BMC Public Health 21, 950 (2021).","journal-title":"BMC Public Health"},{"key":"143_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/ijerph14040347","volume":"14","author":"I Kinchin","year":"2017","unstructured":"Kinchin, I. & Doran, C. M. The Economic Cost of Suicide and Non-Fatal Suicide Behavior in the Australian Workforce and the Potential Impact of a Workplace Suicide Prevention Strategy. Int J Environ Res Public Health 14, 1\u201314 (2017).","journal-title":"Int J Environ Res Public Health"},{"key":"143_CR32","doi-asserted-by":"publisher","first-page":"S356","DOI":"10.1080\/13811118.2019.1612802","volume":"24","author":"JL Alfonso-S\u00e1nchez","year":"2020","unstructured":"Alfonso-S\u00e1nchez, J. L., Martin-Moreno, J. M., Martinez, I. M. & Martinez, A. A. Epidemiological Study and Cost Analysis of Suicide in Spain: Over 100 Years of Evolution. Arch Suicide Res 24, S356\u2013S369 (2020).","journal-title":"Arch Suicide Res"},{"key":"143_CR33","unstructured":"U.S. Department of Health and Human Services (HHS). National Strategy for Suicide Prevention. https:\/\/www.hhs.gov\/sites\/default\/files\/national-strategy-suicide-prevention.pdf (2024)."}],"container-title":["npj Mental Health Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00143-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00143-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00143-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,7]],"date-time":"2025-09-07T04:13:58Z","timestamp":1757218438000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00143-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,10]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["143"],"URL":"https:\/\/doi.org\/10.1038\/s44184-025-00143-9","relation":{},"ISSN":["2731-4251"],"issn-type":[{"value":"2731-4251","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,10]]},"assertion":[{"value":"10 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Dr. Finlay serves on the Council on Criminal Justice Veterans Justice Commission. Otherwise, none of the authors have relevant conflicts of interest.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"29"}}