{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T13:35:03Z","timestamp":1792589703353,"version":"4.5.0"},"reference-count":52,"publisher":"American Medical Association (AMA)","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Psychiatry"],"published-print":{"date-parts":[[2024,10,1]]},"abstract":"\n Importance<\/jats:title>\n Clinical theory and behavioral studies suggest that people experiencing suicidal crisis are often unable to find constructive solutions or incorporate useful information into their decisions, resulting in premature convergence on suicide and neglect of better alternatives. However, prior studies of suicidal behavior have not formally examined how individuals resolve the tradeoffs between exploiting familiar options and exploring potentially superior alternatives.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n To investigate exploration and exploitation in suicidal behavior from the formal perspective of reinforcement learning.<\/jats:p>\n <\/jats:sec>\n \n Design, Setting, and Participants<\/jats:title>\n Two case-control behavioral studies of exploration-exploitation of a large 1-dimensional continuous space and a 21-day prospective ambulatory study of suicidal ideation were conducted between April 2016 and March 2022. Participants were recruited from inpatient psychiatric units, outpatient clinics, and the community in Pittsburgh, Pennsylvania, and underwent laboratory and ambulatory assessments. Adults diagnosed with borderline personality disorder (BPD) and midlife and late-life major depressive disorder (MDD) were included, with each sample including demographically equated groups with a history of high-lethality suicide attempts, low-lethality suicide attempts, individuals with BPD or MDD but no suicide attempts, and control individuals without psychiatric disorders. The MDD sample also included a subgroup with serious suicidal ideation.<\/jats:p>\n <\/jats:sec>\n \n Main Outcomes and Measures<\/jats:title>\n Behavioral (model-free and model-derived) indices of exploration and exploitation, suicide attempt lethality (Beck Lethality Scale), and prospectively assessed suicidal ideation.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n The BPD group included 171 adults (mean [SD] age, 30.55 [9.13] years; 135 [79%] female). The MDD group included 143 adults (mean [SD] age, 62.03 [6.82] years; 81 [57%] female). Across the BPD (\u03c7\n 2<\/jats:sup>\n 3<\/jats:sub>\n \u2009=\u200950.68;\n P<\/jats:italic>\n \u2009&amp;lt;\u2009.001) and MDD (\u03c7\n 2<\/jats:sup>\n 4<\/jats:sub>\n \u2009=\u200936.34;\n P<\/jats:italic>\n \u2009&amp;lt;\u2009.001) samples, individuals with high-lethality suicide attempts discovered fewer options than other groups as they were unable to shift away from unrewarded options. In contrast, those with low-lethality attempts were prone to excessive behavioral shifts after rewarded and unrewarded actions. No differences were seen in strategic early exploration or in exploitation. Among 84 participants with BPD in the ambulatory study, 56 reported suicidal ideation. Underexploration also predicted incident suicidal ideation (\u03c7\n 2<\/jats:sup>\n 1<\/jats:sub>\n \u2009=\u200930.16;\n P<\/jats:italic>\n \u2009&amp;lt;\u2009.001), validating the case-control results prospectively. The findings were robust to confounds, including medication exposure, affective state, and behavioral heterogeneity.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions and Relevance<\/jats:title>\n The findings suggest that narrow exploration and inability to abandon inferior options are associated with serious suicidal behavior and chronic suicidal thoughts. By contrast, individuals in this study who engaged in low-lethality suicidal behavior displayed a low threshold for taking potentially disadvantageous actions.<\/jats:p>\n <\/jats:sec>","DOI":"10.1001\/jamapsychiatry.2024.1796","type":"journal-article","created":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T11:01:13Z","timestamp":1720609273000},"page":"1010","source":"Crossref","is-referenced-by-count":19,"title":["Exploration-Exploitation and Suicidal Behavior in Borderline Personality Disorder and Depression"],"prefix":"10.1001","volume":"81","author":[{"given":"Aliona","family":"Tsypes","sequence":"first","affiliation":[{"name":"Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael N.","family":"Hallquist","sequence":"additional","affiliation":[{"name":"Department of Psychology and Neuroscience, University of North Carolina, Chapel Hill"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angela","family":"Ianni","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aleksandra","family":"Kaurin","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Wuppertal, Wuppertal, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aidan G. C.","family":"Wright","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Michigan, Ann Arbor"},{"name":"Eisenberg Family Depression Center, University of Michigan, Ann Arbor"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandre Y.","family":"Dombrovski","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","reference":[{"issue":"11","key":"yoi240038r1","doi-asserted-by":"publisher","first-page":"2180","DOI":"10.1176\/appi.ajp.162.11.2180","article-title":"Suicide attempters\u2019 reaction to survival as a risk factor for eventual suicide.","volume":"162","author":"Henriques","year":"2005","journal-title":"Am J Psychiatry"},{"issue":"6","key":"yoi240038r2","doi-asserted-by":"publisher","DOI":"10.4088\/PCC.09m00932blu","article-title":"Gambling and completed suicide in hong kong: a review of coroner court files.","volume":"12","author":"Wong","year":"2010","journal-title":"Prim Care Companion J Clin Psychiatry"},{"issue":"3","key":"yoi240038r3","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1097\/YCO.0b013e3283459242","article-title":"Substance use and suicide.","volume":"24","author":"Vijayakumar","year":"2011","journal-title":"Curr Opin Psychiatry"},{"issue":"6","key":"yoi240038r4","doi-asserted-by":"publisher","first-page":"1034","DOI":"10.1038\/s41386-020-0632-0","article-title":"Ventromedial prefrontal value signals and functional connectivity during decision-making in suicidal behavior and impulsivity.","volume":"45","author":"Brown","year":"2020","journal-title":"Neuropsychopharmacology"},{"issue":"2","key":"yoi240038r5","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1037\/a0021646","article-title":"Impairment in risk-sensitive decision-making in older suicide attempters with depression.","volume":"26","author":"Clark","year":"2011","journal-title":"Psychol Aging"},{"issue":"6","key":"yoi240038r6","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1176\/appi.ajp.2009.09030407","article-title":"Reward\/punishment reversal learning in older suicide attempters.","volume":"167","year":"2010","journal-title":"Am J Psychiatry"},{"issue":"10","key":"yoi240038r7","doi-asserted-by":"publisher","first-page":"1020","DOI":"10.1001\/jamapsychiatry.2013.75","article-title":"Reward signals, attempted suicide, and impulsivity in late-life depression.","volume":"70","author":"Dombrovski","year":"2013","journal-title":"JAMA Psychiatry"},{"issue":"6","key":"yoi240038r8","doi-asserted-by":"publisher","first-page":"506","DOI":"10.1016\/j.biopsych.2018.10.006","article-title":"Value-based choice, contingency learning, and suicidal behavior in mid- and late-life depression.","volume":"85","author":"Dombrovski","year":"2019","journal-title":"Biol Psychiatry"},{"issue":"8","key":"yoi240038r9","doi-asserted-by":"publisher","first-page":"1663","DOI":"10.1017\/S0033291713002304","article-title":"A meta-analysis of neuropsychological markers of vulnerability to suicidal behavior in mood disorders.","volume":"44","author":"Richard-Devantoy","year":"2014","journal-title":"Psychol Med"},{"issue":"1","key":"yoi240038r10","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/j.bpsc.2020.04.003","article-title":"Reward responsiveness in suicide attempters: an electroencephalography\/event-related potential study.","volume":"6","author":"Tsypes","year":"2021","journal-title":"Biol Psychiatry Cogn Neurosci Neuroimaging"},{"issue":"1","key":"yoi240038r11","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1037\/abn0000717","article-title":"Delay discounting in suicidal behavior: myopic preference or inconsistent valuation?","volume":"131","author":"Tsypes","year":"2022","journal-title":"J Psychopathol Clin Sci"},{"issue":"2","key":"yoi240038r12","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1017\/S0033291715001890","article-title":"Paralimbic and lateral prefrontal encoding of reward value during intertemporal choice in attempted suicide.","volume":"46","author":"Vanyukov","year":"2016","journal-title":"Psychol Med"},{"issue":"1","key":"yoi240038r13","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1037\/0033-295X.97.1.90","article-title":"Suicide as escape from self.","volume":"97","author":"Baumeister","year":"1990","journal-title":"Psychol Rev"},{"issue":"1","key":"yoi240038r14","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1017\/S0033291703008092","article-title":"Problem-solving in suicide attempters.","volume":"34","author":"Pollock","year":"2004","journal-title":"Psychol Med"},{"issue":"2","key":"yoi240038r15","first-page":"88","article-title":"Ten commonalities of suicide and their implications for response.","volume":"7","author":"Shneidman","year":"1986","journal-title":"Crisis"},{"issue":"1","key":"yoi240038r16","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.1561","article-title":"Search for solutions, learning, simulation, and choice processes in suicidal behavior.","volume":"13","author":"Dombrovski","year":"2022","journal-title":"Wiley Interdiscip Rev Cogn Sci"},{"issue":"9","key":"yoi240038r17","doi-asserted-by":"publisher","first-page":"704","DOI":"10.1016\/j.tics.2020.06.007","article-title":"Advancing the understanding of suicide: the need for formal theory and rigorous descriptive research.","volume":"24","author":"Millner","year":"2020","journal-title":"Trends Cogn Sci"},{"issue":"3","key":"yoi240038r19","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1038\/s44159-022-00031-5","article-title":"Psychological models and their distractors.","volume":"1","author":"van Rooij","year":"2022","journal-title":"Nat Rev Psychol"},{"issue":"1485","key":"yoi240038r21","doi-asserted-by":"publisher","first-page":"1585","DOI":"10.1098\/rstb.2007.2054","article-title":"Cortical mechanisms of action selection: the affordance competition hypothesis.","volume":"362","author":"Cisek","year":"2007","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"1","key":"yoi240038r22","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1146\/annurev.neuro.051508.135409","article-title":"Neural mechanisms for interacting with a world full of action choices.","volume":"33","author":"Cisek","year":"2010","journal-title":"Annu Rev Neurosci"},{"issue":"1","key":"yoi240038r23","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1016\/j.tics.2014.10.004","article-title":"Exploration versus exploitation in space, mind, and society.","volume":"19","author":"Hills","year":"2015","journal-title":"Trends Cogn Sci"},{"issue":"47","key":"yoi240038r25","doi-asserted-by":"publisher","first-page":"12294","DOI":"10.1523\/JNEUROSCI.3116-08.2008","article-title":"A role for dopamine in temporal decision making and reward maximization in parkinsonism.","volume":"28","author":"Moustafa","year":"2008","journal-title":"J Neurosci"},{"key":"yoi240038r26","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/j.cognition.2018.11.004","article-title":"Selective maintenance of value information helps resolve the exploration\/exploitation dilemma.","volume":"183","author":"Hallquist","year":"2019","journal-title":"Cognition"},{"issue":"1","key":"yoi240038r27","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1016\/j.bbr.2011.10.032","article-title":"Differences in BTBR T+ tf\/J and C57BL\/6J mice on probabilistic reversal learning and stereotyped behaviors.","volume":"227","author":"Amodeo","year":"2012","journal-title":"Behav Brain Res"},{"issue":"1","key":"yoi240038r28","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.cogbrainres.2004.07.007","article-title":"Reinforcement learning and decision making in monkeys during a competitive game.","volume":"22","author":"Lee","year":"2004","journal-title":"Brain Res Cogn Brain Res"},{"issue":"10","key":"yoi240038r29","doi-asserted-by":"publisher","first-page":"1655","DOI":"10.1111\/ejn.12518","article-title":"Lesions of dorsal striatum eliminate lose-switch responding but not mixed-response strategies in rats.","volume":"39","author":"Skelin","year":"2014","journal-title":"Eur J Neurosci"},{"issue":"41","key":"yoi240038r30","doi-asserted-by":"publisher","first-page":"16311","DOI":"10.1073\/pnas.0706111104","article-title":"Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning.","volume":"104","author":"Frank","year":"2007","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"3","key":"yoi240038r32","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1521\/pedi.18.3.226.35445","article-title":"Suicidal behavior in borderline personality disorder: prevalence, risk factors, prediction, and prevention.","volume":"18","author":"Black","year":"2004","journal-title":"J Pers Disord"},{"issue":"2","key":"yoi240038r33","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1097\/00019442-199805000-00005","article-title":"Age differences in behaviors leading to completed suicide.","volume":"6","author":"Conwell","year":"1998","journal-title":"Am J Geriatr Psychiatry"},{"issue":"3","key":"yoi240038r34","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1002\/gps.337","article-title":"Attempted and completed suicide in older subjects: results from the WHO\/EURO Multicentre Study of Suicidal Behaviour.","volume":"16","author":"De Leo","year":"2001","journal-title":"Int J Geriatr Psychiatry"},{"issue":"11","key":"yoi240038r35","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1097\/JGP.0b013e3181860034","article-title":"Sex differences in correlates of suicide attempt lethality in late life.","volume":"16","author":"Dombrovski","year":"2008","journal-title":"Am J Geriatr Psychiatry"},{"key":"yoi240038r36","doi-asserted-by":"publisher","first-page":"581","DOI":"10.1016\/j.jad.2023.02.034","article-title":"Suicidal urges and attempted suicide at multiple time scales in borderline personality disorder.","volume":"329","author":"Kaurin","year":"2023","journal-title":"J Affect Disord"},{"key":"yoi240038r37","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1016\/j.jpsychires.2022.01.060","article-title":"Protective effects of reasons for living against suicidal ideation in daily life.","volume":"148","author":"Tsypes","year":"2022","journal-title":"J Psychiatr Res"},{"issue":"12","key":"yoi240038r38","doi-asserted-by":"publisher","first-page":"1266","DOI":"10.1176\/appi.ajp.2011.10111704","article-title":"The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults.","volume":"168","author":"Posner","year":"2011","journal-title":"Am J Psychiatry"},{"issue":"1","key":"yoi240038r39","doi-asserted-by":"publisher","first-page":"5407","DOI":"10.1038\/s41467-020-18864-0","article-title":"Differential reinforcement encoding along the hippocampal long axis helps resolve the explore-exploit dilemma.","volume":"11","author":"Dombrovski","year":"2020","journal-title":"Nat Commun"},{"issue":"8","key":"yoi240038r40","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.adj2219","article-title":"Reward-based option competition in human dorsal stream and transition from stochastic exploration to exploitation in continuous space.","volume":"10","author":"Hallquist","year":"2024","journal-title":"Sci Adv"},{"issue":"1","key":"yoi240038r41","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003441","article-title":"VBA: a probabilistic treatment of nonlinear models for neurobiological and behavioural data.","volume":"10","author":"Daunizeau","year":"2014","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"yoi240038r42","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1017\/S0033291707001419","article-title":"Impulsive-aggressive behaviours and completed suicide across the life cycle: a predisposition for younger age of suicide.","volume":"38","author":"McGirr","year":"2008","journal-title":"Psychol Med"},{"issue":"5","key":"yoi240038r43","doi-asserted-by":"publisher","first-page":"424","DOI":"10.1016\/j.biopsych.2010.10.015","article-title":"Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia.","volume":"69","author":"Strauss","year":"2011","journal-title":"Biol Psychiatry"},{"issue":"6","key":"yoi240038r44","doi-asserted-by":"publisher","first-page":"ENEURO.0437","DOI":"10.1523\/ENEURO.0437-17.2017","article-title":"Feeder approach between trials is increased by uncertainty and affects subsequent choices.","volume":"4","author":"Gruber","year":"2017","journal-title":"eNeuro"},{"key":"yoi240038r45","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.neulet.2018.10.056","article-title":"Lesions of lateral habenula attenuate win-stay but not lose-shift responses in a competitive choice task.","volume":"692","author":"Thapa","year":"2019","journal-title":"Neurosci Lett"},{"key":"yoi240038r46","doi-asserted-by":"publisher","first-page":"9","DOI":"10.3389\/fnint.2018.00009","article-title":"Lose-shift responding in humans is promoted by increased cognitive load.","volume":"12","author":"Ivan","year":"2018","journal-title":"Front Integr Neurosci"},{"issue":"6","key":"yoi240038r47","doi-asserted-by":"publisher","first-page":"1429","DOI":"10.1016\/j.neuron.2014.01.020","article-title":"Adaptive gain control during human perceptual choice.","volume":"81","author":"Cheadle","year":"2014","journal-title":"Neuron"},{"issue":"1","key":"yoi240038r48","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1097\/YCO.0000000000000297","article-title":"The decision neuroscience perspective on suicidal behavior: evidence and hypotheses.","volume":"30","author":"Dombrovski","year":"2017","journal-title":"Curr Opin Psychiatry"},{"issue":"2","key":"yoi240038r49","doi-asserted-by":"publisher","first-page":"73","DOI":"10.4081\/mi.2012.e15","article-title":"The hypothesis of a continuum in suicidality: a discussion on its validity and practical implications.","volume":"4","author":"Sveticic","year":"2012","journal-title":"Ment Illn"},{"issue":"Pt A","key":"yoi240038r51","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/j.jad.2020.11.052","article-title":"Risky decision-making in suicide attempters, and the choice of a violent suicidal means: an updated meta-analysis.","volume":"280","author":"Perrain","year":"2021","journal-title":"J Affect Disord"},{"issue":"6","key":"yoi240038r52","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1016\/j.biopsych.2017.07.003","article-title":"A formal valuation framework for emotions and their control.","volume":"82","author":"Huys","year":"2017","journal-title":"Biol Psychiatry"},{"key":"yoi240038r18","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/12258.001.0001","volume-title":"Language vs. Reality: Why Language Is Good for Lawyers and Bad for Scientists","author":"Enfield","year":"2022"},{"key":"yoi240038r20","volume-title":"The Ecological Approach to Visual Perception","author":"Gibson","year":"1979"},{"key":"yoi240038r24","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton","year":"2018","edition":"2nd ed"},{"key":"yoi240038r31","first-page":"237","volume-title":"Neurobiology of Personality Disorders","author":"Soloff","year":"2018"},{"key":"yoi240038r50","volume-title":"Pathways to Suicide: A Survey of Self-Destructive Behaviors","author":"Maris","year":"1981"}],"container-title":["JAMA Psychiatry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamapsychiatry\/articlepdf\/2821075\/jamapsychiatry_tsypes_2024_oi_240038_1739288611.04263.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,12]],"date-time":"2025-02-12T11:02:05Z","timestamp":1739358125000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamapsychiatry\/fullarticle\/2821075"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,1]]},"references-count":52,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2024,10,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamapsychiatry.2024.1796","relation":{},"ISSN":["2168-622X"],"issn-type":[{"value":"2168-622X","type":"print"}],"subject":[],"published":{"date-parts":[[2024,10,1]]}}}