{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T17:13:29Z","timestamp":1788542009697,"version":"build-2803163510"},"reference-count":34,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T00:00:00Z","timestamp":1788480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Behav. Sci.","Behavioral Sciences"],"abstract":"<jats:p>University-wide suicide risk screening is essential but difficult to implement at scale because professional counselling resources are limited and conventional tools often show low predictive value in low-prevalence populations. To support transparent and clinically interpretable campus mental health workflows, this study introduces and validates the Composite Key Conditions (CKC) method, an interpretable, computationally efficient screening approach for identifying students who match counsellor-defined suicide risk categories. A multi-phase, multi-site study involving 8819 students from two universities in the development and cross-site validation phases was conducted, followed by independent external validation at a third university. In the initial wave, students completed self-report questionnaires in November 2023, after which approximately 20% were selected and invited for centralized counsellor evaluation; the assessments were conducted in December 2023. From January to June 2024, 320 students who subsequently attended psychological services (103 at University A and 217 at University B) were assessed through the cohort pathway. CKC was further evaluated in October 2025 using an independent sample of 22,205 students from a third university. The CKC method, developed from the initial phase, correctly classified all students assigned to the suicide risk category during centralized assessment (sensitivity = 1.000, specificity = 0.901). When applied across both centralized and cohort assessments (yielding 89 counsellor-defined suicide risk cases), the method maintained high performance (sensitivity = 0.888, specificity = 0.904, PPV = 0.086). In the independent validation sample, the method correctly classified 17 of the 22 students identified by the internal reporting system as meeting its high-risk criteria, with a specificity of 0.923. CKC provides an interpretable and efficient approach to suicide risk screening that is suitable for large-scale implementation in university settings. By producing transparent, auditable risk rules rather than opaque predictions, CKC is positioned to complement (not replace) counsellor judgement and to support timely triage and referral within campus mental health service systems.<\/jats:p>","DOI":"10.3390\/bs16091576","type":"journal-article","created":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T16:07:32Z","timestamp":1788538052000},"page":"1576","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Suicide Risk Screening: A New Method to Identify At-Risk Students from General College Populations"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2109-3524","authenticated-orcid":false,"given":"Qingshan","family":"Liu","sequence":"first","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-4220-1446","authenticated-orcid":false,"given":"Heyang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5533-9277","authenticated-orcid":false,"given":"Yueqin","family":"Hu","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6538-2770","authenticated-orcid":false,"given":"Jie","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Sociology, SUNY Buffalo State University, Buffalo, NY 14222, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3281-9574","authenticated-orcid":false,"given":"Fang","family":"Luo","sequence":"additional","affiliation":[{"name":"Faculty of Psychology, Beijing Normal University, Beijing 100875, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1111\/bdi.12656","article-title":"Preventing suicide: A multicausal model requires multimodal research and intervention","volume":"20","author":"Ballard","year":"2018","journal-title":"Bipolar Disorders"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/S0145-2134(02)00541-0","article-title":"Development and validation of a brief screening version of the childhood trauma questionnaire","volume":"27","author":"Bernstein","year":"2003","journal-title":"Child Abuse & Neglect"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1080\/08995605.2021.1897498","article-title":"Psychometric evaluation of the Suicide Cognitions Scale-Revised (SCS-R)","volume":"34","author":"Bryan","year":"2022","journal-title":"Military Psychology"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Choi, Y.-H., Yook, V., Yang, K., Cho, Y., Lee, D. H., Lee, H. J., Jeon, H. J., and Lee, D. H. (2022). Development and validation study of the Suicide Screening Questionnaire-Observer Rating (SSQ-OR). Frontiers in Psychiatry, 13.","DOI":"10.3389\/fpsyt.2022.945051"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"S181","DOI":"10.1016\/j.amepre.2014.06.003","article-title":"Prognostic models to detect and monitor the near-term risk of suicide: State of the science","volume":"47","author":"Claassen","year":"2014","journal-title":"American Journal of Preventive Medicine"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1177\/0146167297235001","article-title":"An item response theory analysis of the rosenberg self-esteem scale","volume":"23","author":"Williams","year":"1997","journal-title":"Personality and Social Psychology Bulletin"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1182","DOI":"10.1037\/pas0000110","article-title":"The development of the Short Defeat and Entrapment Scale (SDES)","volume":"27","author":"Griffiths","year":"2015","journal-title":"Psychological Assessment"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1192\/bjp.170.3.205","article-title":"Suicide as an outcome for mental disorders: A meta-analysis","volume":"170","author":"Harris","year":"1997","journal-title":"British Journal of Psychiatry"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1001\/archpediatrics.2012.1276","article-title":"Ask Suicide-Screening Questions (ASQ): A brief instrument for the pediatric emergency department","volume":"166","author":"Horowitz","year":"2012","journal-title":"Archives of Pediatrics & Adolescent Medicine"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1097\/YCO.0000000000000609","article-title":"Can machine-learning methods really help predict suicide?","volume":"33","author":"McHugh","year":"2020","journal-title":"Current Opinion in Psychiatry"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1504","DOI":"10.1016\/j.jpsychires.2011.06.011","article-title":"Assessment of psychological pain in major depressive episodes","volume":"45","author":"Mee","year":"2011","journal-title":"Journal of Psychiatric Research"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.psychres.2018.02.005","article-title":"Tolerance for psychological pain and capability for suicide: Contributions to suicidal ideation and behavior","volume":"262","author":"Meerwijk","year":"2018","journal-title":"Psychiatry Research"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1023\/A:1021882717784","article-title":"The hopelessness depression symptom questionnaire","volume":"21","author":"Metalsky","year":"1997","journal-title":"Cognitive Therapy and Research"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.jad.2018.02.045","article-title":"The PHQ-9 Item 9 based screening for suicide risk: A validation study of the Patient Health Questionnaire (PHQ)-9 Item 9 with the Columbia Suicide Severity Rating Scale (C-SSRS)","volume":"232","author":"Na","year":"2018","journal-title":"Journal of Affective Disorders"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"O\u2019Connor, R. C., and Kirtley, O. J. (2018). The integrated motivational\u2013volitional model of suicidal behaviour. Philosophical Transactions of the Royal Society B: Biological Sciences, 373, (1754).","DOI":"10.1098\/rstb.2017.0268"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"106353","DOI":"10.1016\/j.ypmed.2020.106353","article-title":"Can we predict or prevent suicide?: An update","volume":"152","author":"Paris","year":"2021","journal-title":"Preventive Medicine"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1453","DOI":"10.1017\/S0033291709991905","article-title":"Predictors of suicidality across the life span: The isle of wight study","volume":"40","author":"Pickles","year":"2010","journal-title":"Psychological Medicine"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.1176\/appi.ajp.2011.10111704","article-title":"The Columbia\u2013Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults","volume":"168","author":"Posner","year":"2011","journal-title":"American Journal of Psychiatry"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"e038794","DOI":"10.1136\/bmjopen-2020-038794","article-title":"Long-term risk factors for suicide in suicide attempters examined at a medical emergency in patient unit: Results from a 32-year follow-up study","volume":"10","author":"Berge","year":"2020","journal-title":"BMJ Open"},{"key":"ref_20","first-page":"183","article-title":"Predictive accuracy of risk scales following self-harm: Multicentre, prospective cohort study","volume":"211","author":"Quinlivan","year":"2018","journal-title":"British Journal of Psychiatry"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1027\/0227-5910\/a000886","article-title":"Childhood trauma and suicide","volume":"44","author":"Rogerson","year":"2022","journal-title":"Crisis"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rosenberg, M. (1965). Society and the adolescent self-image, Princeton University Press.","DOI":"10.1515\/9781400876136"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Runeson, B., Odeberg, J., Petterson, A., Edbom, T., Jildevik Adamsson, I., and Waern, M. (2017). Instruments for the assessment of suicide risk: A systematic review evaluating the certainty of the evidence. PLoS ONE, 12, (7).","DOI":"10.1371\/journal.pone.0180292"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1645","DOI":"10.1080\/13811118.2021.1938321","article-title":"Suicide and self-harm risk assessment: A systematic review of prospective research","volume":"26","author":"Saab","year":"2022","journal-title":"Archives of Suicide Research"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1097\/00005053-199303000-00001","article-title":"Suicide as psychache","volume":"181","author":"Shneidman","year":"1993","journal-title":"The Journal of Nervous and Mental Disease"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/j.ins.2019.11.004","article-title":"Data imbalance in classification: Experimental evaluation","volume":"513","author":"Thabtah","year":"2020","journal-title":"Information Sciences"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4793","DOI":"10.1109\/TNNLS.2020.3027314","article-title":"A survey on explainable artificial intelligence (XAI): Toward medical XAI","volume":"32","author":"Tjoa","year":"2020","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1016\/j.paid.2010.06.006","article-title":"Comparing psychache, depression, and hopelessness in their associations with suicidality: A test of Shneidman\u2019s theory of suicide","volume":"49","author":"Troister","year":"2010","journal-title":"Personality and Individual Differences"},{"key":"ref_29","unstructured":"US Preventive Services Task Force (2022, October 11). Depression and suicide risk in children and adolescents: Screening, Available online: https:\/\/www.uspreventiveservicestaskforce.org\/uspstf\/recommendation\/screening-depression-suicide-risk-children-adolescents."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.jad.2010.04.017","article-title":"Prevalence and predictors of persistent suicide ideation, plans, and attempts during college","volume":"127","author":"Wilcox","year":"2010","journal-title":"Journal of Affective Disorders"},{"key":"ref_31","unstructured":"World Health Organization (2025, September 01). Mental health of adolescents, Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/adolescent-mental-health."},{"key":"ref_32","unstructured":"World Health Organization (2025, March 25). Suicide, Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/suicide."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/1097-0142(1950)3:1<32::AID-CNCR2820030106>3.0.CO;2-3","article-title":"Index for rating diagnostic tests","volume":"3","author":"Youden","year":"1950","journal-title":"Cancer"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"559","DOI":"10.46234\/ccdcw2023.109","article-title":"Suicide mortality by place, gender, and age group\u2014China, 2010\u20132021","volume":"5","author":"Zhao","year":"2023","journal-title":"China CDC Weekly"}],"container-title":["Behavioral Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-328X\/16\/9\/1576\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,4]],"date-time":"2026-09-04T16:20:07Z","timestamp":1788538807000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-328X\/16\/9\/1576"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,4]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["bs16091576"],"URL":"https:\/\/doi.org\/10.3390\/bs16091576","relation":{},"ISSN":["2076-328X"],"issn-type":[{"value":"2076-328X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,4]]}}}