{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T11:01:06Z","timestamp":1791198066999,"version":"4.1.0"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T00:00:00Z","timestamp":1791158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100009601","name":"Beijing Municipal Administration of Hospitals","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100009601","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Suicidal behavior (SB) is a major concern in mood disorders. Models developed from retrospective records are vulnerable to ambiguous targets, data leakage, and inappropriate handling of class imbalance. We developed and internally validated a model to identify the risk of suicidal behavior in patients with mood disorders upon admission.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The dataset included 1, 099 inpatients with ICD-10 mood disorders admitted to Beijing Anding Hospital in 2022. Exclusion of 20 records with more than 20% row-level missingness and one record without an outcome left 1, 078 patients, including 126 with SB. Current SB comprised documented suicidal ideation, planning, or attempt within the three months before index admission, including the admission assessment. Previous SB and previous suicide attempt (SA) referred to events more than three months before admission. Elastic Net selected 14 predictors from 65 candidates in the development set. We compared 13 classifiers from six model families. All preprocessing and resampling were confined to training folds, and evaluation used only observed patients. Assessment included repeated fivefold cross-validation, probability calibration, bootstrap confidence intervals, precision-recall and decision-curve analyses, clinical baselines, and sensitivity analyses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The analytic cohort comprised 952 SB-negative and 126 SB-positive patients (11.69%). The development set contained 864 patients (97 SB-positive), and the observed test set contained 214 patients (29 SB-positive). Calibrated linear discriminant analysis (LDA) provided the most consistent balance of discrimination and calibration. In repeated cross-validation, mean AUC was 0.721\u00a0\u00b1\u00a00.052, mean AUPRC was 0.268\u00a0\u00b1\u00a00.060, and mean Brier score was 0.095. In the observed test set, AUC was 0.704 (0.597\u20130.803), AUPRC was 0.283 (0.198\u20130.453), and Brier score was 0.111. At the training-derived threshold of 0.111, sensitivity was 0.552 and specificity was 0.659. The leading SHAP contributions were onset-polarity category, previous SA, age, and previous SB, but all attributions were associational.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Model performance was acceptable. These internally validated findings are exploratory and require prospective assessment, standardized outcome measurement, and external validation before clinical use.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpsyt.2026.1950186","type":"journal-article","created":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T10:25:31Z","timestamp":1791195931000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Development and internal validation of machine learning models for identifying suicidal behavior in inpatients with mood disorders"],"prefix":"10.3389","volume":"17","author":[{"given":"Sixiang","family":"Liang","sequence":"first","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qitong","family":"Jiang","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinhe","family":"Zhang","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yannan","family":"Deng","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuxuan","family":"Xu","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guangwei","family":"Zhao","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyu","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Clinical Psychology, Shandong Provincial Hospital Affiliated to Shandong First Medical University","place":["Shandong, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yujie","family":"Xing","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongye","family":"Yu","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Hu","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sha","family":"Sha","sequence":"additional","affiliation":[{"name":"The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders, Beijing Anding Hospital, Capital Medical University & the Advanced Innovation Center for Human Brain Protection, Capital Medical University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,10,5]]},"reference":[{"key":"B1","unstructured":"Suicide: Key Facts\n          \n          \n          \n          2025"},{"key":"B2","doi-asserted-by":"publisher","first-page":"2028","DOI":"10.3390\/ijerph15092028","article-title":"Suicide risk and mental disorders","volume":"15","author":"Br\u00e5dvik","year":"2018","journal-title":"Int J Environ Res Public Health"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcna.2022.03.008","article-title":"Suicide: an overview for clinicians","volume":"107","author":"Sher","year":"2023","journal-title":"Med Clinics North America"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.177.4.360","article-title":"Psychosocial and psychiatric risk factors for suicide. Case-control psychological autopsy study","volume":"177","author":"Cheng","year":"2000","journal-title":"Br J Psychiatry: J Ment Sci"},{"key":"B5","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1038\/mp.2013.153","article-title":"Suicide and suicide risk","volume":"5","author":"Turecki","year":"2019","journal-title":"Nat Rev Dis Primers"},{"key":"B6","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1186\/s12888-022-03766-w","article-title":"Comparing gender-specific suicide mortality rate trends in the United States and Lithuania, 1990-2019: putting one of the \"deaths of despair\" into perspective","volume":"22","author":"Lange","year":"2022","journal-title":"BMC Psychiatry"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1016\/bs.irn.2019.11.006","article-title":"Stress, cortisol and suicide risk","volume":"152","author":"O'Connor","year":"2020","journal-title":"Int Rev Neurobiol"},{"key":"B8","doi-asserted-by":"publisher","first-page":"514","DOI":"10.3390\/ijerph18020514","article-title":"Mental health status of adults with cardiovascular or metabolic diseases by gender","volume":"18","author":"Kwak","year":"2021","journal-title":"Int J Environ Res Public Health"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1111\/bdi.12397","article-title":"Acute risk factors for suicide attempts and death: prospective findings from the STEP-BD study","volume":"18","author":"Ballard","year":"2016","journal-title":"Bipolar Disord"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1027\/0227-5910\/a000045","article-title":"The suicidal process and self-esteem","volume":"31","author":"Thompson","year":"2010","journal-title":"Crisis"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1111\/j.1600-0447.1997.tb00378.x","article-title":"A repetition-prediction study of European parasuicide populations: a summary of the first report from part II of the WHO\/EURO Multicentre Study on Parasuicide in co-operation with the EC concerted action on attempted suicide","volume":"95","author":"Bille-Brahe","year":"1997","journal-title":"Acta Psychiatrica Scandinavica"},{"key":"B12","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1111\/j.1530-0277.2006.00114.x","article-title":"Suicide attempts among substance use disorder patients: an initial step toward a decision tree for suicide management","volume":"30","author":"Tiet","year":"2006","journal-title":"Alcoholism Clin Exp Res"},{"key":"B13","doi-asserted-by":"publisher","first-page":"22m14411","DOI":"10.4088\/jcp.22m14411","article-title":"Six-month clinical and ecological momentary assessment follow-up of patients at high risk of suicide: a survival analysis","volume":"84","author":"Porras-Segovia","year":"2023","journal-title":"J Clin Psychiatry"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1016\/s2468-2667(23)00207-4","article-title":"Individual-level risk factors for suicide mortality in the general population: an umbrella review","volume":"8","author":"Favril","year":"2023","journal-title":"Lancet Public Health"},{"key":"B15","article-title":"Evaluating the high risk groups for suicide: a comparison of logistic regression, support vector machine, decision tree and artificial neural network","volume":"45","author":"Amini","year":"2016","journal-title":"Iranian J Public Health"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2023.115446","article-title":"Machine learning-based prediction for self-harm and suicide attempts in adolescents","volume":"328","author":"Su","year":"2023","journal-title":"Psychiatry Res"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2020.113515","article-title":"Using machine learning to predict suicide attempts in military personnel","volume":"294","author":"Rozek","year":"2020","journal-title":"Psychiatry Res"},{"key":"B18","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1001\/jamapsychiatry.2019.2905","article-title":"Prediction of sex-specific suicide risk using machine learning and single-payer health care registry data from Denmark","volume":"77","author":"Gradus","year":"2020","journal-title":"JAMA Psychiatry"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1155\/2024\/5538257","article-title":"Predictive models for suicide attempts in major depressive disorder and the contribution of EPHX2: a pilot integrative machine learning study","volume":"2024","author":"Zheng","year":"2024","journal-title":"Depression Anxiety"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1097\/yco.0000000000000609","article-title":"Can machine-learning methods really help predict suicide","volume":"33","author":"McHugh","year":"2020","journal-title":"Curr Opin Psychiatry"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2019.0174","article-title":"Prediction models for suicide attempts and deaths: a systematic review and simulation","volume":"76","author":"Belsher","year":"2019","journal-title":"JAMA Psychiatry"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocac093","article-title":"The harm of class imbalance corrections for risk prediction models: illustration and simulation using logistic regression","volume":"29","author":"van den Goorbergh","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"B23","doi-asserted-by":"publisher","first-page":"e10320","DOI":"10.1002\/sim.10320","article-title":"The harms of class imbalance corrections for machine learning based prediction models: a simulation study","volume":"44","author":"Carriero","year":"2025","journal-title":"Stat Med"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/s0895-4356(01)00341-9","article-title":"Internal validation of predictive models: efficiency of some procedures for logistic regression analysis","volume":"54","author":"Steyerberg","year":"2001","journal-title":"J Clin Epidemiol"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2015.04.005","article-title":"Prediction models need appropriate internal, internal-external, and external validation","volume":"69","author":"Steyerberg","year":"2016","journal-title":"J Clin Epidemiol"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods","volume":"385","author":"Collins","year":"2024","journal-title":"BMJ"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1038\/s41551-018-0304-0","article-title":"Explainable machine-learning predictions for the prevention of hypoxaemia during surgery","volume":"2","author":"Lundberg","year":"2018","journal-title":"Nat BioMed Eng"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2025.116607","article-title":"Interpretable machine learning approach for predicting clinically significant suicide risk: a case study of patients with major depressive disorder in Greece","volume":"351","author":"Ntakolia","year":"2025","journal-title":"Psychiatry Res"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2021.104614","article-title":"Identification of most important features based on a fuzzy ensemble technique","volume":"156","author":"Ntakolia","year":"2021","journal-title":"Int J Med Inform"},{"key":"B30","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jad.2014.03.035","article-title":"Predominant polarity as a course specifier for bipolar disorder: a systematic review","volume":"163","author":"Carvalho","year":"2014","journal-title":"J Affect Disord"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2007.02.022","article-title":"Does first episode polarity predict risk for suicide attempt in bipolar disorder","volume":"104","author":"Chaudhury","year":"2007","journal-title":"J Affect Disord"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1016\/j.jad.2016.11.043","article-title":"Onset polarity in bipolar disorder: a strong association between first depressive episode and suicide attempts","volume":"209","author":"Cremaschi","year":"2017","journal-title":"J Affect Disord"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.2021.102","article-title":"Characterisation of age and polarity at onset in bipolar disorder","volume":"219","author":"Kalman","year":"2021","journal-title":"Br J Psychiatry: J Ment Sci"},{"key":"B34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/j.1600-0447.1985.tb10510.x","article-title":"The longitudinal course of recurrent affective illness: life chart data from research patients at the NIMH","volume":"317","author":"Roy-Byrne","year":"1985","journal-title":"Acta Psychiatrica Scandinavica Supplementum"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1016\/s0010-440x(00)90125-1","article-title":"Polarity of the first episode, clinical characteristics, and course of manic depressive illness: a systematic retrospective investigation of 320 bipolar I patients","volume":"41","author":"Perugi","year":"2000","journal-title":"Compr Psychiatry"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1192\/bjp.2019.167","article-title":"Suicidal risk factors in major affective disorders","volume":"215","author":"Baldessarini","year":"2019","journal-title":"Br J Psychiatry"},{"key":"B37","doi-asserted-by":"publisher","first-page":"62","DOI":"10.24869\/psyd.2023.62","article-title":"Interpretable estimation of suicide risk and severity from complete blood count parameters with explainable artificial intelligence methods","volume":"35","author":"Cansel","year":"2023","journal-title":"Psychiatria Danubina"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.5498\/wjp.v11.i12.1191","article-title":"Nuclear receptors modulate inflammasomes in the pathophysiology and treatment of major depressive disorder","volume":"11","author":"Wang","year":"2021","journal-title":"World J Psychiatry"},{"key":"B39","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.jad.2018.12.100","article-title":"An inflammatory profile linked to increased suicide risk","volume":"247","author":"Keaton","year":"2019","journal-title":"J Affect Disord"}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2026.1950186\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T10:25:32Z","timestamp":1791195932000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2026.1950186\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,5]]},"references-count":39,"alternative-id":["10.3389\/fpsyt.2026.1950186"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2026.1950186","relation":{},"ISSN":["1664-0640"],"issn-type":[{"value":"1664-0640","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,5]]},"article-number":"1950186"}}