{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T06:21:48Z","timestamp":1764829308520,"version":"build-2065373602"},"reference-count":64,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T00:00:00Z","timestamp":1750982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>Understanding the mindset of people who die by suicide remains a key research challenge. We map conceptual and emotional word\u2013word co-occurrences in 139 genuine suicide notes and in reference word lists, an Emotional Recall Task, from 200 individuals grouped by high\/low depression, anxiety, and stress levels on DASS-21. Positive words cover most of the suicide notes\u2019 vocabulary; however, co-occurrences in suicide notes overlap mostly with those produced by individuals with low anxiety (Jaccard index of 0.42 for valence and 0.38 for arousal). We introduce a \u201cwords not said\u201d method: It removes every word that corpus A shares with a comparison corpus B and then checks the emotions of \u201cresidual\u201d words in A\u2212B. With no leftover emotions, A and B are similar in expressing the same emotions. Simulations indicate this method can classify high\/low levels of depression, anxiety and stress with 80% accuracy in a balanced task. After subtracting suicide note words, only the high-anxiety corpus displays no significant residual emotions. Our findings thus pin anxiety as a key latent feature of suicidal psychology and offer an interpretable language-based marker for suicide risk detection.<\/jats:p>","DOI":"10.3390\/bdcc9070171","type":"journal-article","created":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T03:33:25Z","timestamp":1750995205000},"page":"171","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Cognitive Networks and Text Analysis Identify Anxiety as a Key Dimension of Distress in Genuine Suicide Notes"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1810-9699","authenticated-orcid":false,"given":"Massimo","family":"Stella","sequence":"first","affiliation":[{"name":"CogNosco Lab, Department of Psychology and Cognitive Science, University of Trento, 38121 Trento, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7357-8514","authenticated-orcid":false,"given":"Trevor James","family":"Swanson","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Kansas, Lawrence, KS 66045, USA"}]},{"given":"Andreia Sofia","family":"Teixeira","sequence":"additional","affiliation":[{"name":"LASIGE, Departamento de Inform\u00e1tica, Faculdade de Ci\u00eancias, Universidade de Lisboa, 1749-016 Lisboa, Portugal"},{"name":"Network Science Institute, Northeastern University London, London E1W 1LP, UK"}]},{"given":"Brianne N.","family":"Richson","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Kansas, Lawrence, KS 66045, USA"}]},{"given":"Ying","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China"}]},{"given":"Thomas T.","family":"Hills","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Warwick, Coventry CV4 7AL, UK"}]},{"given":"Kelsie T.","family":"Forbush","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Kansas, Lawrence, KS 66045, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9605-0576","authenticated-orcid":false,"given":"David","family":"Watson","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Notre Dame, Notre Dame, IN 46556, USA"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,27]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2014). Preventing Suicide: A Global Imperative, World Health Organization."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5079","DOI":"10.1038\/s41380-020-0819-0","article-title":"Highly variable suicidal ideation: A phenotypic marker for stress induced suicide risk","volume":"26","author":"Oquendo","year":"2021","journal-title":"Mol. Psychiatry"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1080\/00332747.2019.1600219","article-title":"Variability in suicidal ideation is associated with affective instability in suicide attempters with borderline personality disorder","volume":"82","author":"Rizk","year":"2019","journal-title":"Psychiatry"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1037\/1089-2680.5.2.100","article-title":"The psychology of life stories","volume":"5","author":"McAdams","year":"2001","journal-title":"Rev. Gen. Psychol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1080\/10478400701366985","article-title":"Death and black diamonds: Meaning, mortality, and the meaning maintenance model","volume":"17","author":"Proulx","year":"2006","journal-title":"Psychol. Inq."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1111\/j.1943-278X.1981.tb01007.x","article-title":"Suicide notes and tragic lives","volume":"11","author":"Schneidman","year":"1981","journal-title":"Suicide Life Threat. Behav."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Pestian, J.P., Matykiewicz, P., Linn-Gust, M., South, B., Uzuner, O., Wiebe, J., Cohen, K.B., Hurdle, J., and Brew, C. (2012). Sentiment analysis of suicide notes: A shared task. Biomed. Inform. Insights, 5.","DOI":"10.4137\/BII.S10213"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1027\/0227-5910.28.2.102","article-title":"The content of suicide notes from attempters and completers","volume":"28","author":"Handelman","year":"2007","journal-title":"Crisis"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1177\/2167702617747074","article-title":"In an absolute state: Elevated use of absolutist words is a marker specific to anxiety, depression, and suicidal ideation","volume":"6","author":"Johnstone","year":"2018","journal-title":"Clin. Psychol. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pestian, J., Nasrallah, H., Matykiewicz, P., Bennett, A., and Leenaars, A. (2010). Suicide note classification using natural language processing: A content analysis. Biomed. Inform. Insights, 3.","DOI":"10.4137\/BII.S4706"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Schoene, A.M., and Dethlefs, N. (2016, January 11). Automatic identification of suicide notes from linguistic and sentiment features. Proceedings of the 10th SIGHUM Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, Berlin, Germany.","DOI":"10.18653\/v1\/W16-2116"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"20190825","DOI":"10.1098\/rspa.2019.0825","article-title":"Contributions of modern network science to the cognitive sciences: Revisiting research spirals of representation and process","volume":"476","author":"Castro","year":"2020","journal-title":"Proc. R. Soc. A"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-021-98147-w","article-title":"Revealing semantic and emotional structure of suicide notes with cognitive network science","volume":"11","author":"Teixeira","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Stella, M., Swanson, T.J., Li, Y., Hills, T.T., and Teixeira, A.S. (2022). Cognitive networks detect structural patterns and emotional complexity in suicide notes. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.917630"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1036","DOI":"10.1037\/0022-3514.62.6.1036","article-title":"Compartmentalization of positive and negative self-knowledge: Keeping bad apples out of the bunch","volume":"62","author":"Showers","year":"1992","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1111\/tops.12551","article-title":"Cognitive network science for understanding online social cognitions: A brief review","volume":"14","author":"Stella","year":"2022","journal-title":"Top. Cogn. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1016\/0005-7967(94)00075-U","article-title":"The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories","volume":"33","author":"Lovibond","year":"1995","journal-title":"Behav. Res. Ther."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fatima, A., Li, Y., Hills, T.T., and Stella, M. (2021). Dasentimental: Detecting depression, anxiety, and stress in texts via emotional recall, cognitive networks, and machine learning. Big Data Cogn. Comput., 5.","DOI":"10.3390\/bdcc5040077"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1109\/TAFFC.2021.3057105","article-title":"Hierarchical multiscale recurrent neural networks for detecting suicide notes","volume":"14","author":"Schoene","year":"2021","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1006\/jado.1998.0172","article-title":"Negative life events and adolescent suicidal behavior: A critical analysis from the stress process perspective","volume":"21","author":"Sandin","year":"1998","journal-title":"J. Adolesc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.jad.2013.01.004","article-title":"Risk factors for suicide in individuals with depression: A systematic review","volume":"147","author":"Hawton","year":"2013","journal-title":"J. Affect. Disord."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1249","DOI":"10.1001\/archpsyc.62.11.1249","article-title":"Anxiety disorders and risk for suicidal ideation and suicide attempts: A population-based longitudinal study of adults","volume":"62","author":"Sareen","year":"2005","journal-title":"Arch. Gen. Psychiatry"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1017\/S0033291710002096","article-title":"The anxiety disorders and suicidal ideation: Accounting for co-morbidity via underlying personality traits","volume":"41","author":"Watson","year":"2011","journal-title":"Psychol. Med."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1002\/da.20674","article-title":"The relationship between anxiety disorders and suicide attempts: Findings from the National Epidemiologic Survey on Alcohol and Related Conditions","volume":"27","author":"Nepon","year":"2010","journal-title":"Depress. Anxiety"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"72","DOI":"10.11622\/smedj.2017006","article-title":"Depression in primary care: Assessing suicide risk","volume":"58","author":"Ng","year":"2017","journal-title":"Singap. Med J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1782","DOI":"10.1037\/xlm0000841","article-title":"The Emotional Recall Task: Juxtaposing recall and recognition-based affect scales","volume":"46","author":"Li","year":"2020","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Boyd, R.L. (2017). Psychological text analysis in the digital humanities. Data Analytics in Digital Humanities, Springer.","DOI":"10.1007\/978-3-319-54499-1_7"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/s10339-010-0372-x","article-title":"The semantic organization of the animal category: Evidence from semantic verbal fluency and network theory","volume":"12","author":"Arrondo","year":"2011","journal-title":"Cogn. Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mohammad, S. (2018, January 15\u201320). Obtaining reliable human ratings of valence, arousal, and dominance for 20,000 english words. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1017"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1111\/j.1467-8640.2012.00460.x","article-title":"Crowdsourcing a word\u2013emotion association lexicon","volume":"29","author":"Mohammad","year":"2013","journal-title":"Comput. Intell."},{"key":"ref_31","unstructured":"Poli, R., Healy, M., and Kameas, A. (2012). WordNet. Theory and Applications of Ontology: Computer Applications, Springer."},{"key":"ref_32","unstructured":"Plutchik, R. (1980). Emotion. A Psychoevolutionary Synthesis, Academic Press."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Golino, H.F., and Epskamp, S. (2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0174035"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1521\/pedi.2007.21.1.72","article-title":"Affective instability and suicidal ideation and behavior in patients with borderline personality disorder","volume":"21","author":"Links","year":"2007","journal-title":"J. Personal. Disord."},{"key":"ref_35","first-page":"5","article-title":"What distinguishes suicide attempters from suicide ideators? A meta-analysis of potential factors","volume":"23","author":"May","year":"2016","journal-title":"Clin. Psychol. Sci. Pract."},{"key":"ref_36","unstructured":"Cannon, W.B. (1925). Bodily Changes in Pain, Hunger, Fear and Rage: An Account of Recent Researches into the Function of Emotional Excitement, D. Appleton & Co."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"177","DOI":"10.3109\/09540269209066315","article-title":"Hopelessness and suicide","volume":"4","author":"Weishaar","year":"1992","journal-title":"Int. Rev. Psychiatry"},{"key":"ref_38","unstructured":"Joiner, T.E. (2005). Why People Die by Suicide, Harvard University Press."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1177\/0004867420951256","article-title":"Suicide ideation versus suicide attempt: Examining overlapping and differential determinants in a large cohort of patients with depression and\/or anxiety","volume":"55","author":"Wiebenga","year":"2021","journal-title":"Aust. N. Z. J. Psychiatry"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.jad.2015.07.037","article-title":"Capability for suicide interacts with states of heightened arousal to predict death by suicide beyond the effects of depression and hopelessness","volume":"188","author":"Ribeiro","year":"2015","journal-title":"J. Affect. Disord."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1037\/ccp0000342","article-title":"Anxiety sensitivity and suicidal ideation\/suicide risk: A meta-analysis","volume":"86","author":"Stanley","year":"2018","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.paid.2009.01.049","article-title":"Clarifying the relation between neuroticism and positive emotions","volume":"47","author":"Ng","year":"2009","journal-title":"Personal. Individ. Differ."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1037\/a0018697","article-title":"The interpersonal theory of suicide","volume":"117","author":"Witte","year":"2010","journal-title":"Psychol. Rev."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1521\/ijct.2015.8.2.114","article-title":"The three-step theory (3ST): A new theory of suicide rooted in the \u201cideation-to-action\u201d framework","volume":"8","author":"Klonsky","year":"2015","journal-title":"Int. J. Cogn. Ther."},{"key":"ref_45","first-page":"181","article-title":"Towards an integrated motivational\u2013volitional model of suicidal behaviour","volume":"1","year":"2011","journal-title":"Int. Handb. Suicide Prev. Res. Policy Pract."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Bayliss, L.T., Christensen, S., Lamont-Mills, A., and du Plessis, C. (2022). Suicide capability within the ideation-to-action framework: A systematic scoping review. PLoS ONE, 17.","DOI":"10.1371\/journal.pone.0276070"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1037\/vio0000090","article-title":"Measuring acquired capability for suicide within an ideation-to-action framework","volume":"8","author":"Burke","year":"2018","journal-title":"Psychol. Violence"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1002\/da.20701","article-title":"The acquired capability for suicide: A comparison of suicide attempters, suicide ideators, and non-suicidal controls","volume":"27","author":"Smith","year":"2010","journal-title":"Depress. Anxiety"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1080\/17437199.2010.543385","article-title":"Narrative analysis in health psychology research: Personal, dialogical and social stories of health","volume":"5","author":"Stephens","year":"2011","journal-title":"Health Psychol. Rev."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1111\/j.1467-9280.1997.tb00403.x","article-title":"Writing about emotional experiences as a therapeutic process","volume":"8","author":"Pennebaker","year":"1997","journal-title":"Psychol. Sci."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"2053168015604648","DOI":"10.1177\/2053168015604648","article-title":"\u201cWho are these people?\u201d Evaluating the demographic characteristics and political preferences of MTurk survey respondents","volume":"2","author":"Huff","year":"2015","journal-title":"Res. Politics"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Pestian, J.P., Matykiewicz, P., and Linn-Gust, M. (2012). What\u2019s in a note: Construction of a suicide note corpus. Biomed. Inform. Insights, 5.","DOI":"10.4137\/BII.S10213"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"Rudin","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1186\/s12916-021-01971-0","article-title":"The importance of transdiagnostic symptom level assessment to understanding prognosis for depressed adults: Analysis of data from six randomised control trials","volume":"19","author":"Buckman","year":"2021","journal-title":"BMC Med."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1002\/wps.20128","article-title":"Risks of all-cause and suicide mortality in mental disorders: A meta-review","volume":"13","author":"Chesney","year":"2014","journal-title":"World Psychiatry"},{"key":"ref_56","first-page":"351","article-title":"Suicide rates among people with serious mental illness: A systematic review and meta-analysis","volume":"53","author":"Fu","year":"2023","journal-title":"Psychol. Med."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Xue, C., Ge, Y., Tang, B., Liu, Y., Kang, P., Wang, M., and Zhang, L. (2015). A meta-analysis of risk factors for combat-related PTSD among military personnel and veterans. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0120270"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s11920-015-0575-z","article-title":"Prevalence of, risk factors for, and consequences of posttraumatic stress disorder and other mental health problems in military populations deployed to Iraq and Afghanistan","volume":"17","author":"Ramchand","year":"2015","journal-title":"Curr. Psychiatry Rep."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1271","DOI":"10.1038\/s41562-019-0750-z","article-title":"Historical analysis of national subjective wellbeing using millions of digitized books","volume":"3","author":"Hills","year":"2019","journal-title":"Nat. Hum. Behav."},{"key":"ref_60","unstructured":"Armed Forces Health Surveillance Center (2012). Deaths by suicide while on active duty, active and reserve components, US Armed Forces, 1998\u20132011. Msmr, 19, 7\u201310."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"101","DOI":"10.17744\/mehc.31.2.a6338384r2770383","article-title":"A comparative review of US military and civilian suicide behavior: Implications for OEF\/OIF suicide prevention efforts","volume":"31","author":"Martin","year":"2009","journal-title":"J. Ment. Health Couns."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"e295","DOI":"10.7717\/peerj-cs.295","article-title":"Text-mining forma mentis networks reconstruct public perception of the STEM gender gap in social media","volume":"6","author":"Stella","year":"2020","journal-title":"Peerj Comput. Sci."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Newman, M. (2018). Networks, Oxford University Press.","DOI":"10.1093\/oso\/9780198805090.001.0001"},{"key":"ref_64","unstructured":"Mohammad, S., and Turney, P. (2010, January 5). Emotions evoked by common words and phrases: Using mechanical turk to create an emotion lexicon. Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, Los Angeles, CA, USA."}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/7\/171\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:59:45Z","timestamp":1760032785000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/9\/7\/171"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,27]]},"references-count":64,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["bdcc9070171"],"URL":"https:\/\/doi.org\/10.3390\/bdcc9070171","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2025,6,27]]}}}