{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T00:40:07Z","timestamp":1783644007505,"version":"3.55.0"},"reference-count":59,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,30]],"date-time":"2025-01-30T00:00:00Z","timestamp":1738195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000738","name":"U.S. Department of Veterans Affairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000738","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:sec><jats:title>Background<\/jats:title><jats:p>Learning from feedback \u2013 adapting behavior based on reinforcing and punishing outcomes \u2013 has been implicated in numerous psychiatric disorders, including substance misuse, post-traumatic stress disorder, and depression; an emerging literature suggests it may also play a role in suicidality. This study examined whether a feedback-based learning task with rewarding, punishing and ambiguous outcomes, followed by computational modeling, could improve near-term prospective prediction of suicide attempt in a high-risk sample.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>Veterans (N=60) at high-risk for suicide were tested on a task of reward- and punishment-based learning, at multiple sessions across a one-year period. Each session was coded according to whether the participant had (1) an actual suicide attempt (ASA); (2) another suicide-related event (OtherSE) such as suicidal behavior or suicidal ideation-related hospital admission (but not an ASA); or (3) neither (noSE) in the next 90 days. Computational modeling was used to estimate latent cognitive variables including learning rates from positive and negative outcomes, and the subjective value of ambiguous feedback.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Optimal responding on the reward-based trials was positively associated with upcoming ASA, and remained predictive even after controlling for other standard clinical variables such as current suicidal ideation severity and prior suicide attempts. Computational modeling revealed that patients with upcoming ASA tended to view ambiguous outcomes as similar to weak punishment, while OtherSE and noSE both tended to view the ambiguous outcome as similar to weak reward. Differences in the reinforcement value of the neutral outcome remained predictive for ASA even after controlling for current suicidal ideation and prior suicide attempts.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>A reinforcement learning task with ambiguous neutral outcomes may provide a useful tool to help predict near-term risk of ASA in at-risk patients. While most individuals interpret ambiguous feedback as mildly reinforcing (a \u201cglass half full\u201d interpretation), those with upcoming ASA tend to view it as mildly punishing (a \u201cglass half empty\u201d interpretation). While the current results are based on a very small sample with relatively few ASA events, and require replication in a larger sample, they provide support for the role of negative biases in feedback-based learning in the cognitive profile of suicide risk.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fpsyt.2024.1492332","type":"journal-article","created":{"date-parts":[[2025,1,30]],"date-time":"2025-01-30T06:22:02Z","timestamp":1738218122000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Negative valuation of ambiguous feedback may predict near-term risk for suicide attempt in Veterans at high risk for suicide"],"prefix":"10.3389","volume":"15","author":[{"given":"Catherine E.","family":"Myers","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rokas","family":"Perskaudas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vibha","family":"Reddy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chintan V.","family":"Dave","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John G.","family":"Keilp","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arlene","family":"King","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kailyn","family":"Rodriguez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren St.","family":"Hill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachael","family":"Miller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alejandro","family":"Interian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,1,30]]},"reference":[{"key":"B1","volume-title":"Suicide Mortality in the United States, 2001-2021","author":"Garnett","year":"2023"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1037\/bul0000305","article-title":"Interventions for suicide and self-injury: A meta-analysis of randomized controlled trials across nearly 50 years of research","volume":"146","author":"Fox","year":"2020","journal-title":"Psychol Bull"},{"key":"B3","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1037\/bul0000084","article-title":"Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research","volume":"143","author":"Franklin","year":"2017","journal-title":"Psychol Bull"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2014.06.004","article-title":"Improving the short-term prediction of suicidal behavior","volume":"47","author":"Glenn","year":"2014","journal-title":"Am J Prev Med"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291721004712","article-title":"A controlled examination of acute warning signs for suicide attempts among hospitalized patients","volume":"53","author":"Bagge","year":"2023","journal-title":"Psychol Med"},{"key":"B6","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1001\/jamapsychiatry.2020.1042","article-title":"Suicide prevention research priorities in health care","volume":"77","author":"Gordon","year":"2020","journal-title":"JAMA Psychiatry"},{"key":"B7","volume-title":"Reinforcement Learning An Introduction second edition","author":"Sutton","year":"2018"},{"key":"B8","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1111\/nyas.13327","article-title":"The roles of valuation and reward processing in cognitive function and psychiatric disorders","volume":"1395","author":"H\u00e9lie","year":"2017","journal-title":"Ann N Y Acad Sci"},{"key":"B9","doi-asserted-by":"publisher","first-page":"594","DOI":"10.1016\/j.ijpsycho.2014.11.006","article-title":"Learning models of PTSD: Theoretical accounts and psychobiological evidence","volume":"98","author":"Lissek","year":"2015","journal-title":"Int J Psychophysiol"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2022.0051","article-title":"Reinforcement learning in patients with mood and anxiety disorders vs control individuals: A systematic review and meta-analysis","volume":"79","author":"Pike","year":"2022","journal-title":"JAMA Psychiatry"},{"key":"B11","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1176\/appi.ajp.2009.09030407","article-title":"Reward\/Punishment reversal learning in older suicide attempters","volume":"167","author":"Dombrovski","year":"2010","journal-title":"Am J Psychiatry"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2022.10.033","article-title":"Self-injurious thoughts and behaviors and alterations in positive valence systems: A systematic review of the literature","volume":"156","author":"Bettis","year":"2022","journal-title":"J Psychiatr Res"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2020.06.007","article-title":"Advancing the understanding of suicide: the need for formal theory and rigorous descriptive research","volume":"24","author":"Millner","year":"2020","journal-title":"Trends Cognit Sci"},{"key":"B14","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1016\/j.tics.2011.11.018","article-title":"Computational psychiatry","volume":"16","author":"Montague","year":"2012","journal-title":"Trends Cognit Sci"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1055\/s-0028-1124107","article-title":"Dopamine, reinforcement learning, and addiction","volume":"42","author":"Dayan","year":"2009","journal-title":"Pharmacopsychiatry"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1038\/s41386-021-01108-0","article-title":"Reinforcement-learning in fronto-striatal circuits","volume":"47","author":"Averbeck","year":"2022","journal-title":"Neuropsychopharmacology"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1001\/jamapsychiatry.2013.75","article-title":"Reward signals, attempted suicide, and impulsivity in late-life depression","volume":"70","author":"Dombrovski","year":"2013","journal-title":"JAMA Psychiatry"},{"key":"B18","first-page":"1","article-title":"Trial-by-trial data analysis using computational models","volume-title":"Decision making, affect, and learning: Attention and performance","author":"Daw","year":"2009"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4238","article-title":"Computational psychiatry as a bridge from neuroscience to clinical applications","volume":"19","author":"Huys","year":"2016","journal-title":"Nat Neurosci"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2021.12.016","article-title":"Learning from gain and loss: Links to suicide risk","volume":"147","author":"Dixon-Gordon","year":"2022","journal-title":"J Psychiatr Res"},{"key":"B21","doi-asserted-by":"publisher","first-page":"e72508","DOI":"10.1371\/journal.pone.0072508","article-title":"Learning to obtain reward, but not avoid punishment, is affected by presence of PTSD symptoms in male veterans: empirical data and computational model","volume":"8","author":"Myers","year":"2013","journal-title":"PloS One"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2015.09.018","article-title":"Probabilistic reward- and punishment-based learning in opioid addiction: Experimental and computational data","volume":"296","author":"Myers","year":"2016","journal-title":"Behav Brain Res"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1006068107","article-title":"{alpha}-Synuclein gene duplication impairs reward learning","volume":"107","author":"K\u00e9ri","year":"2010","journal-title":"Proc Natl Acad Sci U.S.A"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/awp094","article-title":"Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson\u2019s patients","volume":"132","author":"B\u00f3di","year":"2009","journal-title":"Brain"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.3389\/fnint.2013.00067","article-title":"Learning from negative feedback in patients with major depressive disorder is attenuated by SSRI antidepressants","volume":"7","author":"Herzallah","year":"2013","journal-title":"Front Integr Neurosci"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2017.00084","article-title":"Depression reduces accuracy while parkinsonism slows response time for processing positive feedback in patients with Parkinson\u2019s disease with comorbid major depressive disorder tested on a probabilistic category-learning task","volume":"8","author":"Herzallah","year":"2017","journal-title":"Front Psychiatry"},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.1176\/appi.ajp.2011.10111704","article-title":"The Columbia-Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults","volume":"168","author":"Posner","year":"2011","journal-title":"Am J Psychiatry"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1037\/\/0022-006x.47.2.343","article-title":"Assessment of suicidal intention: the Scale for Suicide Ideation","volume":"47","author":"Beck","year":"1979","journal-title":"J Consult Clin Psychol"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1111\/j.1532-5415.2005.53221.x","article-title":"The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment","volume":"53","author":"Nasreddine","year":"2005","journal-title":"J Am Geriatr Soc"},{"key":"B30","article-title":"The Mini-International Neuropsychiatric Interview (M.I.N.I): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10","volume":"59","author":"Sheehan","year":"1998","journal-title":"J Clin Psychiatry"},{"key":"B31","first-page":"A235","article-title":"The Brief Traumatic Brain Injury Screen (BTBIS): Investigating the validity of a self-report instrument for detecting traumatic brain injury in troops returning from deployment in Afghanistan and Iraq","volume":"66","author":"Schwab","year":"2006","journal-title":"Neurology"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1037\/1040-3590.1.1.53","article-title":"Clinical evaluation of a measure to assess combat exposure","volume":"1","author":"Keane","year":"1989","journal-title":"psychol Assess"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1207\/s15327752jpa6703_13","article-title":"Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients","volume":"67","author":"Beck","year":"1996","journal-title":"J Pers Assess"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1037\/h0037562","article-title":"The measurement of pessimism: the hopelessness scale","volume":"42","author":"Beck","year":"1974","journal-title":"J Consult Clin Psychol"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.11.010.2008","article-title":"Generating stimuli for neuroscience using PsychoPy","volume":"2","author":"Peirce","year":"2009","journal-title":"Front Neuroinform"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-015-0647-3","article-title":"The Novel Object and Unusual Name (NOUN) Database: A collection of novel images for use in experimental research","volume":"48","author":"Horst","year":"2016","journal-title":"Behav Res Methods"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.3389\/fnbeh.2015.00153","article-title":"The influence of trial order on learning from reward vs. punishment in a probabilistic categorization task: Experimental and computational analyses","volume":"9","author":"Moustafa","year":"2015","journal-title":"Front Behav Neurosci"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach Learn"},{"key":"B39","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.0706111104","article-title":"Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning","volume":"104","author":"Frank","year":"2007","journal-title":"Proc Natl Acad Sci (USA)"},{"key":"B40","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/j.jad.2024.01.018","article-title":"Impairment in recognition memory may be associated with near-term risk for suicide attempt in a high-risk sample","volume":"350","author":"Myers","year":"2024","journal-title":"J Affect Disord"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1017\/S0033291722001003","article-title":"Improving the prospective prediction of a near-term suicide attempt in veterans at risk for suicide, using a go\/no-go task","volume":"53","author":"Myers","year":"2023","journal-title":"Psychol Med"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1080\/13811118.2017.1334610","article-title":"Use of the Columbia-suicide severity rating scale (C-SSRS) to classify suicidal behaviors","volume":"22","author":"Interian","year":"2018","journal-title":"Arch Suicide Res"},{"key":"B43","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1093\/biomet\/73.1.13","article-title":"Longitudinal analysis using generalized linear models","volume":"73","author":"Liang","year":"1986","journal-title":"Biometrika"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.2307\/2531734","article-title":"Models for longitudinal data: A generalized estimating equation approach","volume":"44","author":"Zeger","year":"1988","journal-title":"Biometrics"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1093\/ntr\/ntt195","article-title":"Conceptualizing analyses of ecological momentary assessment data","volume":"16","author":"Shiffman","year":"2014","journal-title":"Nicotine Tobacco Res"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1177\/1094428104263672","article-title":"Using generalized estimating equations for longitudinal data analysis","volume":"7","author":"Ballinger","year":"2004","journal-title":"Organ Res Methods"},{"key":"B47","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1097\/AAP.0b013e31823ebc74","article-title":"Beyond repeated-measures analysis of variance: Advanced statistical methods for the analysis of longitudinal data in anesthesia research","volume":"37","author":"Ma","year":"2012","journal-title":"Reg Anesth Pain Med"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1213\/ANE.0000000000003511","article-title":"Repeated measures designs and analysis of longitudinal data: If at first you do not succeed-try, try again","volume":"127","author":"Schober","year":"2018","journal-title":"Anesth Analg"},{"key":"B49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v064.i08","article-title":"R package multgee: A generalized estimating equations solver for multinomial responses","volume":"64","author":"Touloumis","year":"2015","journal-title":"J Stat Softw"},{"key":"B50","article-title":"R: A language and environment for statistical computing","volume-title":"R Foundation for Statistical Computing","year":"2023"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1037\/a0019710","article-title":"Attentional bias toward suicide-related stimuli predicts suicidal behavior","volume":"119","author":"Cha","year":"2010","journal-title":"J Abnorm Psychol"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1177\/0956797610364762","article-title":"Measuring the suicidal mind: implicit cognition predicts suicidal behavior","volume":"21","author":"Nock","year":"2010","journal-title":"Psychol Sci"},{"key":"B53","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1097\/YCO.0000000000000297","article-title":"The decision neuroscience perspective on suicidal behavior: Evidence and hypotheses","volume":"30","author":"Dombrovski","year":"2017","journal-title":"Curr Opin Psychiatry"},{"key":"B54","doi-asserted-by":"publisher","first-page":"e0144083","DOI":"10.1371\/journal.pone.0144083","article-title":"The role of informative and ambiguous feedback in avoidance behavior: Empirical and computational findings","volume":"10","author":"Moustafa","year":"2015","journal-title":"PloS One"},{"key":"B55","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.cpr.2017.09.005","article-title":"A comprehensive meta-analysis of interpretation biases in depression","volume":"58","author":"Everaert","year":"2017","journal-title":"Clin Psychol Rev"},{"key":"B56","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/j.cpr.2014.01.007","article-title":"Interpersonal functioning in borderline personality disorder: a systematic review of behavioral and laboratory-based assessments","volume":"34","author":"Lazarus","year":"2014","journal-title":"Clin Psychol Rev"},{"key":"B57","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.euroneuro.2021.08.002","article-title":"Differential reinforcement learning responses to positive and negative information in unmedicated individuals with depression","volume":"53","author":"Reinen","year":"2021","journal-title":"Eur Neuropsychopharmacol"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1126\/science.1102941","article-title":"By carrot or by stick: cognitive reinforcement learning in parkinsonism","volume":"306","author":"Frank","year":"2004","journal-title":"Science"},{"key":"B59","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-24277-4","volume-title":"ggplot2: Elegant graphics for data analysis","author":"Wickham","year":"2016"}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2024.1492332\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,30]],"date-time":"2025-01-30T06:22:09Z","timestamp":1738218129000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2024.1492332\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,30]]},"references-count":59,"alternative-id":["10.3389\/fpsyt.2024.1492332"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2024.1492332","relation":{},"ISSN":["1664-0640"],"issn-type":[{"value":"1664-0640","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,30]]},"article-number":"1492332"}}