{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T21:58:19Z","timestamp":1787003899904,"version":"build-2736575974"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T00:00:00Z","timestamp":1760745600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T00:00:00Z","timestamp":1760745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100032766","name":"Council on Criminal Justice","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100032766","id-type":"DOI","asserted-by":"crossref"}]},{"name":"VA Health Services Research & Development","award":["SDR 19-345"],"award-info":[{"award-number":["SDR 19-345"]}]},{"name":"VA Health Services Research & Development Service","award":["RCS 14-232 - Harris"],"award-info":[{"award-number":["RCS 14-232 - Harris"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Mental Health Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The Veterans Health Administration\u2019s (VA) Recovery Engagement and Coordination for Health\u2013Veterans Enhanced Treatment (REACH VET) suicide prevention program uses a model that estimates every patient\u2019s suicide risk. We evaluated predictive accuracy of that model for death by suicide, and separately for the combined outcome of suicide attempt or death, for all VA patients and for patients with criminal legal system involvement who have one of the highest suicide rates among VA users. We found that the model has low accuracy for the prediction of death by suicide (positive predictive value\u2009=\u20090.05% overall, 0.10% for legal-involved; false negative rate\u2009=\u200998.1% overall, 82.4% for legal-involved). For the combined outcome, model accuracy was better and more so for legal-involved veterans, but overall still low. While the REACH VET program has been shown to have benefits, the underlying model that identifies patients at high risk of suicide needs improvement.<\/jats:p>","DOI":"10.1038\/s44184-025-00167-1","type":"journal-article","created":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T13:28:24Z","timestamp":1760794104000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Evaluating the accuracy of the Veterans Health Administration\u2019s REACH VET suicide prediction model for legal involved veterans"],"prefix":"10.1038","volume":"4","author":[{"given":"Alex H. S.","family":"Harris","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea K.","family":"Finlay","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Esther L.","family":"Meerwijk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,10,18]]},"reference":[{"key":"167_CR1","unstructured":"VA Suicide Prevention Office of Mental Health and Suicide Prevention. 2023 National Veteran Suicide Prevention Annual Report. https:\/\/www.mentalhealth.va.gov\/docs\/data-sheets\/2023\/2023-National-Veteran-Suicide-Prevention-Annual-Report-FINAL-508.pdf (2023)."},{"key":"167_CR2","doi-asserted-by":"publisher","unstructured":"National Academies of Sciences, Engineering, and Medicine. The Landscape of Veteran Health Care and Suicide Risk in Identifying and Managing Veteran Suicide Risk: Proceedings of a Workshop. Ch. 4 (Washington, DC: The National Academies Press, 2023). https:\/\/doi.org\/10.17226\/27195.","DOI":"10.17226\/27195"},{"key":"167_CR3","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1001\/jamaneurol.2023.2893","volume":"80","author":"JT Howard","year":"2023","unstructured":"Howard, J. T. et al. Trends in suicide rates among post-9\/11 US military veterans with and without traumatic brain injury from 2006-2020. JAMA Neurol. 80, 1117\u20131119 (2023).","journal-title":"JAMA Neurol."},{"key":"167_CR4","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.jpsychires.2015.06.013","volume":"68","author":"S Maguen","year":"2015","unstructured":"Maguen, S. et al. Suicide risk in Iraq and Afghanistan veterans with mental health problems in VA care. J. Psychiatr. Res. 68, 120\u2013124 (2015).","journal-title":"J. Psychiatr. Res."},{"key":"167_CR5","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1037\/ser0000208","volume":"16","author":"RD Shura","year":"2019","unstructured":"Shura, R. D. et al. Relationship between traumatic brain injury history and recent suicidal ideation in Iraq\/Afghanistan-era veterans. Psychol. Serv. 16, 312\u2013320 (2019).","journal-title":"Psychol. Serv."},{"key":"167_CR6","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1037\/a0029652","volume":"10","author":"JH Blue-Howells","year":"2013","unstructured":"Blue-Howells, J. H., Clark, S. C., Van Den Berk-Clark, C. & McGuire, J. F. The U.S. Department of Veterans Affairs Veterans Justice Programs and the sequential intercept model: case examples in national dissemination of intervention for justice-involved veterans. Psychol. Serv. 10, 48\u201353 (2013).","journal-title":"Psychol. Serv."},{"key":"167_CR7","doi-asserted-by":"publisher","first-page":"1165","DOI":"10.1016\/j.jagp.2018.07.004","volume":"26","author":"LC Barry","year":"2018","unstructured":"Barry, L. C. et al. Increased risk of suicide attempts and unintended death among those transitioning from prison to community in later life. Am. J. Geriatr. Psychiatry 26, 1165\u20131174 (2018).","journal-title":"Am. J. Geriatr. Psychiatry"},{"key":"167_CR8","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1111\/sltb.12631","volume":"50","author":"KM Palframan","year":"2020","unstructured":"Palframan, K. M., Blue-Howells, J., Clark, S. C. & McCarthy, J. F. Veterans justice programs: assessing population risks for suicide deaths and attempts. Suicide Life Threat Behav. 50, 792\u2013804 (2020).","journal-title":"Suicide Life Threat Behav."},{"key":"167_CR9","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1016\/j.amepre.2021.11.013","volume":"62","author":"PC Britton","year":"2022","unstructured":"Britton, P. C. et al. Veterans crisis line call outcomes: distress, suicidal ideation, and suicidal urgency. Am. J. Prev. Med. 62, 745\u2013751 (2022).","journal-title":"Am. J. Prev. Med."},{"key":"167_CR10","doi-asserted-by":"publisher","first-page":"e2129900","DOI":"10.1001\/jamanetworkopen.2021.29900","volume":"4","author":"JF McCarthy","year":"2021","unstructured":"McCarthy, J. F. et al. Evaluation of the recovery engagement and coordination for health\u2013veterans enhanced treatment suicide risk modeling clinical program in the Veterans Health Administration. JAMA Netw. Open 4, e2129900 (2021).","journal-title":"JAMA Netw. Open"},{"key":"167_CR11","unstructured":"VA.gov | Veterans Affairs - Staff Sergeant Fox Suicide Prevention Grant Program. https:\/\/www.mentalhealth.va.gov\/ssgfox-grants\/."},{"key":"167_CR12","doi-asserted-by":"publisher","first-page":"1935","DOI":"10.2105\/AJPH.2015.302737","volume":"105","author":"JF McCarthy","year":"2015","unstructured":"McCarthy, J. F. et al. Predictive modeling and concentration of the risk of suicide: implications for preventive interventions in the US Department of Veterans Affairs. Am. J. Public Health 105, 1935\u20131942 (2015).","journal-title":"Am. J. Public Health"},{"key":"167_CR13","doi-asserted-by":"crossref","unstructured":"Kessler, R. C. et al. Developing a practical suicide risk prediction model for targeting high-risk patients in the Veterans Health Administration. Int. J. Methods Psychiatr. Res. 26, e1575 (2017).","DOI":"10.1002\/mpr.1575"},{"key":"167_CR14","unstructured":"Center of Excellence for Suicide Prevention. Joint Department of Veterans Affairs (VA) and Department of Defense (DoD) Mortality Data Repository \u2013 National Death Index (NDI). https:\/\/www.mirecc.va.gov\/suicideprevention\/documents\/VA_DoD-MDR_Flyer.pdf."},{"key":"167_CR15","doi-asserted-by":"publisher","first-page":"816","DOI":"10.1177\/0033354916670133","volume":"131","author":"C Hoffmire","year":"2016","unstructured":"Hoffmire, C. et al. VA suicide prevention applications network: a National Health Care System-based suicide event tracking system. Public Health Rep. 131, 816\u2013821 (2016).","journal-title":"Public Health Rep."},{"key":"167_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v036.i03","volume":"36","author":"W Viechtbauer","year":"2010","unstructured":"Viechtbauer, W. Conducting meta-analyses in R with the metafor package. J. Stat. Softw. 36, 1\u201348 (2010).","journal-title":"J. Stat. Softw."},{"key":"167_CR17","unstructured":"Python Software Foundation. Python. https:\/\/www.python.org\/."},{"key":"167_CR18","doi-asserted-by":"publisher","first-page":"642","DOI":"10.1001\/jamapsychiatry.2019.0174","volume":"76","author":"BE Belsher","year":"2019","unstructured":"Belsher, B. E. et al. Prediction models for suicide attempts and deaths: a systematic review and simulation. JAMA Psychiatry 76, 642 (2019).","journal-title":"JAMA Psychiatry"},{"key":"167_CR19","unstructured":"Oak Ridge National Laboratory. ORNL-VA collaboration targets veteran suicide epidemic. https:\/\/www.ornl.gov\/news\/ornl-va-collaboration-targets-veteran-suicide-epidemic (2019)."},{"key":"167_CR20","first-page":"18878","volume":"2409","author":"Z Li","year":"2024","unstructured":"Li, Z. et al. Suicide phenotyping from clinical notes in safety-net psychiatric hospital using multi-label classification with pre-trained language models. arXiv 2409, 18878 (2024).","journal-title":"arXiv"},{"key":"167_CR21","doi-asserted-by":"publisher","first-page":"104582","DOI":"10.1016\/j.jbi.2023.104582","volume":"150","author":"EL Meerwijk","year":"2024","unstructured":"Meerwijk, E. L. et al. Development of a 3-Step theory of suicide ontology to facilitate 3ST factor extraction from clinical progress notes. J. Biomed. Inform. 150, 104582 (2024).","journal-title":"J. Biomed. Inform."},{"key":"167_CR22","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1016\/j.jpsychires.2024.09.031","volume":"179","author":"M Levis","year":"2024","unstructured":"Levis, M., Dimambro, M., Levy, J. & Shiner, B. Using Natural Language Processing to develop risk-tier specific suicide prediction models for Veterans Affairs patients. J. Psychiatr. Res. 179, 322\u2013329 (2024).","journal-title":"J. Psychiatr. Res."}],"container-title":["npj Mental Health Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00167-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00167-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00167-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T13:28:26Z","timestamp":1760794106000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s44184-025-00167-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,18]]},"references-count":22,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["167"],"URL":"https:\/\/doi.org\/10.1038\/s44184-025-00167-1","relation":{},"ISSN":["2731-4251"],"issn-type":[{"value":"2731-4251","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,18]]},"assertion":[{"value":"10 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 October 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 October 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Dr. Finlay serves on the Council on Criminal Justice Veterans Justice Commission. Otherwise, none of the authors have relevant conflicts of interest.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"53"}}