{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T01:29:26Z","timestamp":1775006966007,"version":"3.50.1"},"reference-count":49,"publisher":"Oxford University Press (OUP)","issue":"7","license":[{"start":{"date-parts":[[2021,3,29]],"date-time":"2021-03-29T00:00:00Z","timestamp":1616976000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,7,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The prevalence of social media for sharing personal thoughts makes it a viable platform for the assessment of suicide risk. However, deep learning models are not able to capture the diverse nature of linguistic choices and temporal patterns that can be exhibited by a suicidal user on social media and end up overfitting on specific cues that are not generally applicable. We propose Adversarial Suicide assessment Hierarchical Attention (ASHA), a hierarchical attention model that employs adversarial learning for improving the generalization ability of the model.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Material and Methods<\/jats:title>\n                  <jats:p>We assess the suicide risk of a social media user across 5 levels of increasing severity of risk. ASHA leverages a transformer-based architecture to learn the semantic nature of social media posts and a temporal attention-based long short-term memory architecture for the sequential modeling of a user\u2019s historical posts. We dynamically generate adversarial examples by adding perturbations to actual examples that can simulate the stochasticity in historical posts, thereby making the model robust.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Through extensive experiments, we establish the face-value of ASHA and show that it significantly outperforms existing baselines, with the F1 score of 64%. This is a 2% and a 4% increase over the ContextBERT and ContextCNN baselines, respectively. Finally, we discuss the practical applicability and ethical aspects of our work pertaining to ASHA, as a human-in-the-loop framework.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion and Conclusions<\/jats:title>\n                  <jats:p>Adversarial samples can be helpful in capturing the diverse nature of suicidal ideation. Through ASHA, we hope to form a component in a larger human-in-the-loop infrastructure for suicide risk assessment on social media.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocab031","type":"journal-article","created":{"date-parts":[[2021,3,22]],"date-time":"2021-03-22T20:12:55Z","timestamp":1616443975000},"page":"1497-1506","source":"Crossref","is-referenced-by-count":18,"title":["Robust suicide risk assessment on social media via deep adversarial learning"],"prefix":"10.1093","volume":"28","author":[{"given":"Ramit","family":"Sawhney","sequence":"first","affiliation":[{"name":"MIDAS, IIIT Delhi, New Delhi, India"}]},{"given":"Harshit","family":"Joshi","sequence":"additional","affiliation":[{"name":"Cluster Innovation Centre, University of Delhi, New Delhi, India"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1941-103X","authenticated-orcid":false,"given":"Saumya","family":"Gandhi","sequence":"additional","affiliation":[{"name":"Computer Science, Visvesvaraya National Institute of Technology, Nagpur, India"}]},{"given":"Di","family":"Jin","sequence":"additional","affiliation":[{"name":"Computer Science and Artificial Intelligence Lab, Massachussetts Institute of Technology, Cambridge, Massachussetts USA"}]},{"given":"Rajiv Ratn","family":"Shah","sequence":"additional","affiliation":[{"name":"MIDAS, IIIT Delhi, New Delhi, India"}]}],"member":"286","published-online":{"date-parts":[[2021,3,29]]},"reference":[{"key":"2021071421215705700_ocab031-B1","year":"2014"},{"issue":"2","key":"2021071421215705700_ocab031-B2","doi-asserted-by":"crossref","first-page":"637","DOI":"10.2466\/pr0.1998.83.2.637","article-title":"The suicide probability scale: Norms and factor structure","volume":"83","author":"Bagge","year":"1998","journal-title":"Psychol Rep"},{"issue":"4","key":"2021071421215705700_ocab031-B3","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1037\/1040-3590.19.4.422","article-title":"Predictive validity of the chinese version of the adult suicidal ideation questionnaire: psychometric properties and its short version","volume":"19","author":"Fu","year":"2007","journal-title":"Psychol Assess"},{"issue":"8","key":"2021071421215705700_ocab031-B4","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1016\/S2215-0366(16)30070-0","article-title":"Psychosocial interventions following self-harm in adults: a systematic review and meta-analysis","volume":"3","author":"Hawton","year":"2016","journal-title":"Lancet Psychiatry"},{"key":"2021071421215705700_ocab031-B5","first-page":"1","author":"Hedegaard"},{"issue":"1","key":"2021071421215705700_ocab031-B6","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1111\/sltb.12312","article-title":"A machine learning approach to identifying the thought markers of suicidal subjects: a prospective multicenter trial","volume":"47","author":"Pestian","year":"2017","journal-title":"Suicide Life Threat Behav"},{"issue":"2","key":"2021071421215705700_ocab031-B7","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1111\/inm.12223","article-title":"Is suicide assessment harmful to participants? Findings from a randomized controlled trial","volume":"26","author":"Harris","year":"2017","journal-title":"Int J Mental Health Nurs"},{"issue":"2","key":"2021071421215705700_ocab031-B8","doi-asserted-by":"crossref","first-page":"e18","DOI":"10.1192\/bjo.2018.88","article-title":"Association between suicidal ideation and suicide: meta-analyses of odds ratios, sensitivity, specificity, and positive predictive value [published correction appears in BJPsych Open]","volume":"5","author":"McHugh","year":"2019","journal-title":"BJPsych Open"},{"key":"2021071421215705700_ocab031-B9","doi-asserted-by":"crossref","first-page":"117822261879286","DOI":"10.1177\/1178222618792860","article-title":"Natural language processing of social media as screening for suicide risk","volume":"10","author":"Coppersmith","year":"2018","journal-title":"Biomed Inform Insights"},{"key":"2021071421215705700_ocab031-B10","volume-title":"The Truth About Illness and Disease","author":"Golden","year":"2009"},{"key":"2021071421215705700_ocab031-B11","author":"Sawhney","year":": 91\u20138"},{"key":"2021071421215705700_ocab031-B12","first-page":"1","article-title":"Predicting depression via social media","volume":"13","author":"De Choudhury","journal-title":"In: Proceedings of the International AAAI Conference on Web and Social Media; July 2013"},{"key":"2021071421215705700_ocab031-B13","first-page":"2098","author":"De Choudhury"},{"key":"2021071421215705700_ocab031-B14","first-page":"167","author":"Sawhney"},{"key":"2021071421215705700_ocab031-B15","first-page":"1718","author":"Cao"},{"key":"2021071421215705700_ocab031-B16","first-page":"1","author":"Chikersal"},{"key":"2021071421215705700_ocab031-B17","author":"Losada"},{"issue":"2","key":"2021071421215705700_ocab031-B18","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1002\/jclp.20222","article-title":"Advances in the assessment of suicide risk","volume":"62","author":"Bryan","year":"2006","journal-title":"J Clin Psychol"},{"key":"2021071421215705700_ocab031-B19","first-page":"24","author":"Zirikly"},{"key":"2021071421215705700_ocab031-B20","first-page":"8124","author":"Shing"},{"key":"2021071421215705700_ocab031-B21","first-page":"514","author":"Gaur"},{"key":"2021071421215705700_ocab031-B22","author":"Rohan","year":"2019:\u00a0147\u201356"},{"key":"2021071421215705700_ocab031-B23","author":"Zhou","year":"2020"},{"key":"2021071421215705700_ocab031-B24","doi-asserted-by":"crossref","first-page":"6867","DOI":"10.1609\/aaai.v33i01.33016867","article-title":"Analyzing compositionality-sensitivity of NLI models","volume":"33","author":"Nie","year":"2019","journal-title":"AAAI"},{"key":"2021071421215705700_ocab031-B25","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1162\/tacl_a_00279","article-title":"Trick me if you can: human-in-the-loop generation of adversarial examples for question answering","volume":"7","author":"Wallace","year":"2019","journal-title":"Trans AssociationComput Linguist"},{"key":"2021071421215705700_ocab031-B26","author":"Goodfellow","year":"2014"},{"key":"2021071421215705700_ocab031-B27","author":"Kurakin","year":"2016"},{"key":"2021071421215705700_ocab031-B28","author":"Jia","year":"2017"},{"key":"2021071421215705700_ocab031-B29","author":"Caswell","year":"2020"},{"issue":"12","key":"2021071421215705700_ocab031-B30","doi-asserted-by":"crossref","first-page":"1266","DOI":"10.1176\/appi.ajp.2011.10111704","article-title":"The Columbia\u2013Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults","volume":"168","author":"Posner","year":"2011","journal-title":"Ajp"},{"key":"2021071421215705700_ocab031-B31","author":"Devlin","year":"2018"},{"key":"2021071421215705700_ocab031-B32","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/B978-012657951-2\/50004-2","volume-title":"Evaluating and Treating Adolescent Suicide Attempters","author":"Overholser","year":"2003"},{"issue":"8","key":"2021071421215705700_ocab031-B33","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput"},{"key":"2021071421215705700_ocab031-B34","author":"Nobles"},{"issue":"4","key":"2021071421215705700_ocab031-B35","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1177\/2167702620906146","article-title":"Can text messages identify suicide risk in real time? a within-subjects pilot examination of temporally sensitive markers of suicide risk","volume":"8","author":"Glenn","year":"2020","journal-title":"Clin Psychol Sci"},{"key":"2021071421215705700_ocab031-B36","author":"Diaz","year":"2019; , ."},{"issue":"1","key":"2021071421215705700_ocab031-B37","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1080\/15374416.2013.836454","article-title":"Longitudinal trajectories of suicidal ideation and subsequent suicide attempts among adolescent inpatients","volume":"44","author":"Czyz","year":"2015","journal-title":"J Clin Child Adolescent Psychol"},{"issue":"9","key":"2021071421215705700_ocab031-B38","doi-asserted-by":"crossref","first-page":"1796","DOI":"10.1007\/s10964-019-01074-3","article-title":"Trajectories of suicide ideation and attempts from early adolescence to mid-adulthood: associations with race\/ethnicity","volume":"48","author":"Erausquin","year":"2019","journal-title":"J Youth Adolescence"},{"key":"2021071421215705700_ocab031-B39","author":"Tram\u00e8r","year":"2017"},{"key":"2021071421215705700_ocab031-B40","author":"Feng"},{"key":"2021071421215705700_ocab031-B41","author":"Matero"},{"issue":"5","key":"2021071421215705700_ocab031-B42","first-page":"546","article-title":"Ordinal logistic regression in medical research","volume":"31","author":"Ralf","year":"1997;"},{"key":"2021071421215705700_ocab031-B43","author":"Gutman","year":"2018"},{"issue":"3","key":"2021071421215705700_ocab031-B44","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1023\/A:1021316409277","article-title":"Studying the amateur artist: a perspective on disguising data collected in human subjects research on the Internet","volume":"4","author":"Bruckman","year":"2002","journal-title":"Ethics Inform Technol"},{"issue":"2","key":"2021071421215705700_ocab031-B45","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1001\/jamapsychiatry.2015.2839","article-title":"An adjuvant role for mobile health in psychiatry","volume":"73","author":"Hsin","year":"2016","journal-title":"JAMA Psychiatry"},{"key":"2021071421215705700_ocab031-B46","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jad.2014.08.047","article-title":"The association of suicide-related Twitter use with suicidal behaviour: a cross-sectional study of young internet users in Japan","volume":"170","author":"Sueki","year":"2015","journal-title":"J Affective Disord"},{"issue":"2","key":"2021071421215705700_ocab031-B47","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/s11126-017-9535-6","article-title":"Social media use and mental health among young adults","volume":"89","author":"Berryman","year":"2018","journal-title":"Psychiatr Q"},{"issue":"5","key":"2021071421215705700_ocab031-B48","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1080\/1369118X.2018.1555610","article-title":"Generalizing from social media data: a formal theory approach","volume":"22","author":"Davis","year":"2019","journal-title":"Inform Commun Soc"},{"issue":"1","key":"2021071421215705700_ocab031-B49","doi-asserted-by":"crossref","first-page":"205630511876336","DOI":"10.1177\/2056305118763366","article-title":"Participant perceptions of Twitter research ethics","volume":"4","author":"Fiesler","year":"2018","journal-title":"Social Media+ Society"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/7\/1497\/38983084\/ocab031.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/7\/1497\/38983084\/ocab031.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,14]],"date-time":"2021-07-14T21:23:03Z","timestamp":1626297783000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/7\/1497\/6199396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,29]]},"references-count":49,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,3,29]]},"published-print":{"date-parts":[[2021,7,14]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab031","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,7,1]]},"published":{"date-parts":[[2021,3,29]]}}}