{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T19:12:04Z","timestamp":1785525124962,"version":"3.56.0"},"update-to":[{"DOI":"10.1371\/journal.pbio.3003922","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T00:00:00Z","timestamp":1785456000000}}],"reference-count":105,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T00:00:00Z","timestamp":1784851200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology of Taiwan","doi-asserted-by":"crossref","award":["MOST 107-2314-B-002-073 and MOST 108-2410-H-002-110-MY2"],"award-info":[{"award-number":["MOST 107-2314-B-002-073 and MOST 108-2410-H-002-110-MY2"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100020595","name":"National Science and Technology Council","doi-asserted-by":"publisher","award":["NSTC 113-2314-B-002-273-MY3"],"award-info":[{"award-number":["NSTC 113-2314-B-002-273-MY3"]}],"id":[{"id":"10.13039\/100020595","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosbiology.org"],"crossmark-restriction":false},"short-container-title":["PLoS Biol"],"abstract":"<jats:p>\n                    Effective reinforcement learning requires balancing exploration of uncertain options with exploitation of known outcomes. In real-world contexts, the same action may yield rewards in some situations and punishments in others, yet how these learning processes influence each other remains unclear. Here, we examine the neural mechanisms underlying how reward and punishment learning interact to guide adaptive behavior. We conducted four experiments (\n                    <jats:italic>N<\/jats:italic>\n                    \u2009=\u2009159) using an instrumental learning task with binary choices, some of which were exclusive to reward or punishment learning trials, while others appeared in both, allowing assessment of their interaction. When choices were tied to a single learning type, reward learning engages less exploration (i.e., fewer choices of lower-value options) than punishment learning. Critically, when both learning processes were concurrently engaged, reward learning was selectively impaired, accompanied by enhanced exploration and greater activation in exploration-related prefrontal regions revealed by fMRI. Computational modeling showed that impaired reward learning was best explained by sensitivity to prior punishment history associated with reward-learning options, while individual differences in loss aversion predicted the degree of increased exploration. Finally, pharmacological attenuation of dopaminergic signaling via the D2\/3 receptor antagonist amisulpride abolished both the increased exploration and the interference with reward learning. These findings suggest that punishment-history interference during reward learning is dopamine-modulated and associated with increased exploration, with individual differences in this exploration linked to loss aversion, providing a mechanistic account of how the brain resolves competing value signals and informing dopamine-related learning disturbances in neuropsychiatric conditions.\n                  <\/jats:p>","DOI":"10.1371\/journal.pbio.3003922","type":"journal-article","created":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T17:45:08Z","timestamp":1784915108000},"page":"e3003922","update-policy":"https:\/\/doi.org\/10.1371\/journal.pbio.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Competing value signals impair reward-learning via dopaminergic mechanisms and increase exploration"],"prefix":"10.1371","volume":"24","author":[{"given":"Wen-Wei","family":"Lin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pei-Yu","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hsin-Yun","family":"Tsai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi-Hsuan","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min-Min","family":"Lin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheng-Liang","family":"Lu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mei-Yu","family":"Yeh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3763-9548","authenticated-orcid":true,"given":"Ming-Tsung","family":"Tseng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,7,24]]},"reference":[{"issue":"25","key":"pbio.3003922.ref001","doi-asserted-by":"crossref","first-page":"4945","DOI":"10.1523\/JNEUROSCI.2480-18.2019","article-title":"Paraventricular thalamus controls behavior during motivational conflict","volume":"39","author":"EA Choi","year":"2019","journal-title":"J Neurosci"},{"issue":"11","key":"pbio.3003922.ref002","doi-asserted-by":"crossref","first-page":"3018","DOI":"10.1523\/JNEUROSCI.3320-16.2017","article-title":"Paraventricular thalamus balances danger and reward","volume":"37","author":"EA Choi","year":"2017","journal-title":"J Neurosci"},{"issue":"8","key":"pbio.3003922.ref003","article-title":"Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain","volume":"4","author":"H Kim","year":"2006","journal-title":"PLoS Biol"},{"issue":"21","key":"pbio.3003922.ref004","doi-asserted-by":"crossref","first-page":"7931","DOI":"10.1523\/JNEUROSCI.23-21-07931.2003","article-title":"Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices","volume":"23","author":"J O\u2019Doherty","year":"2003","journal-title":"J Neurosci"},{"key":"pbio.3003922.ref005","doi-asserted-by":"crossref","first-page":"8096","DOI":"10.1038\/ncomms9096","article-title":"Contextual modulation of value signals in reward and punishment learning","volume":"6","author":"S Palminteri","year":"2015","journal-title":"Nat Commun"},{"issue":"7106","key":"pbio.3003922.ref006","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1038\/nature05051","article-title":"Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans","volume":"442","author":"M Pessiglione","year":"2006","journal-title":"Nature"},{"issue":"31","key":"pbio.3003922.ref007","doi-asserted-by":"crossref","first-page":"10460","DOI":"10.1523\/JNEUROSCI.2377-10.2010","article-title":"Negative valence widens generalization of learning","volume":"30","author":"E Schechtman","year":"2010","journal-title":"J Neurosci"},{"issue":"47","key":"pbio.3003922.ref008","doi-asserted-by":"crossref","first-page":"15621","DOI":"10.1523\/JNEUROSCI.1350-14.2014","article-title":"Learning to minimize efforts versus maximizing rewards: computational principles and neural correlates","volume":"34","author":"V Skvortsova","year":"2014","journal-title":"J Neurosci"},{"issue":"10","key":"pbio.3003922.ref009","doi-asserted-by":"crossref","first-page":"1952","DOI":"10.1162\/jocn_a_01885","article-title":"Gains and losses affect learning differentially at low and high attentional load","volume":"34","author":"KB Boroujeni","year":"2022","journal-title":"J Cogn Neurosci"},{"issue":"0067","key":"pbio.3003922.ref010","article-title":"Behavioural and neural characterization of optimistic reinforcement learning","volume":"1","author":"G Lefebvre","year":"2017","journal-title":"Nat Hum Behav"},{"issue":"18","key":"pbio.3003922.ref011","doi-asserted-by":"crossref","first-page":"4826","DOI":"10.1523\/JNEUROSCI.0400-07.2007","article-title":"Differential encoding of losses and gains in the human striatum","volume":"27","author":"B Seymour","year":"2007","journal-title":"J Neurosci"},{"key":"pbio.3003922.ref012","volume-title":"Negativity in evaluations","author":"DE Kanouse","year":"1972"},{"issue":"1","key":"pbio.3003922.ref013","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1080\/14792779108401856","article-title":"Positive-negative asymmetry in evaluations: the distinction between affective and informational negativity effects","volume":"1","author":"G Peeters","year":"1990","journal-title":"Eur Rev Soc Psychol"},{"issue":"1","key":"pbio.3003922.ref014","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.tics.2015.11.002","article-title":"Forming beliefs: why valence matters","volume":"20","author":"T Sharot","year":"2016","journal-title":"Trends Cogn Sci"},{"issue":"6","key":"pbio.3003922.ref015","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1037\/0022-3514.62.6.893","article-title":"The generality of the automatic attitude activation effect","volume":"62","author":"JA Bargh","year":"1992","journal-title":"J Pers Soc Psychol"},{"issue":"1","key":"pbio.3003922.ref016","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1037\/0022-3514.95.1.36","article-title":"Why positive information is processed faster: the density hypothesis","volume":"95","author":"C Unkelbach","year":"2008","journal-title":"J Pers Soc Psychol"},{"issue":"4","key":"pbio.3003922.ref017","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1521\/soco.2010.28.4.538","article-title":"Good things come easy: subjective exposure frequency and the faster processing of positive information","volume":"28","author":"C Unkelbach","year":"2010","journal-title":"Social Cognition"},{"issue":"2","key":"pbio.3003922.ref018","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.neuron.2012.09.034","article-title":"Attention, learning, and the value of information","volume":"76","author":"J Gottlieb","year":"2012","journal-title":"Neuron"},{"issue":"1","key":"pbio.3003922.ref019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/cercor\/bhu160","article-title":"Cortical brain activity reflecting attentional biasing toward reward-predicting cues covaries with economic decision-making performance","volume":"26","author":"R San Mart\u00edn","year":"2016","journal-title":"Cereb Cortex"},{"issue":"3","key":"pbio.3003922.ref020","doi-asserted-by":"crossref","first-page":"0058","DOI":"10.1038\/s41562-017-0058","article-title":"Five factors that guide attention in visual search","volume":"1","author":"JM Wolfe","year":"2017","journal-title":"Nat Hum Behav"},{"key":"pbio.3003922.ref021","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1037\/1089-2680.5.4.323","article-title":"Bad is stronger than good","volume":"5","author":"RF Baumeister","year":"2001","journal-title":"Rev Gen Psychol"},{"issue":"4","key":"pbio.3003922.ref022","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1207\/S15327957PSPR0504_2","article-title":"Negativity bias, negativity dominance, and contagion","volume":"5","author":"P Rozin","year":"2001","journal-title":"Pers Soc Psychol Rev"},{"key":"pbio.3003922.ref023","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/bs.aesp.2020.04.005","article-title":"Negativity bias, positivity bias, and valence asymmetries: explaining the differential processing of positive and negative information","volume":"62","author":"C Unkelbach","year":"2020","journal-title":"Adv Exp Soc Psychol"},{"issue":"2","key":"pbio.3003922.ref024","doi-asserted-by":"crossref","first-page":"263","DOI":"10.2307\/1914185","article-title":"Prospect theory: an analysis of decision under risk","volume":"47","author":"D Kahneman","year":"1979","journal-title":"Econometrica"},{"issue":"1","key":"pbio.3003922.ref025","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1177\/0963721418806510","article-title":"The psychological and neural basis of loss aversion","volume":"28","author":"P Sokol-Hessner","year":"2019","journal-title":"Curr Direct Psychol Sci"},{"issue":"5811","key":"pbio.3003922.ref026","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1126\/science.1134239","article-title":"The neural basis of loss aversion in decision-making under risk","volume":"315","author":"SM Tom","year":"2007","journal-title":"Science"},{"issue":"3","key":"pbio.3003922.ref027","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1016\/j.neuron.2012.02.038","article-title":"Neural mechanisms underlying paradoxical performance for monetary incentives are driven by loss aversion","volume":"74","author":"VS Chib","year":"2012","journal-title":"Neuron"},{"issue":"1481","key":"pbio.3003922.ref028","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1098\/rstb.2007.2098","article-title":"Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration","volume":"362","author":"JD Cohen","year":"2007","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"2","key":"pbio.3003922.ref029","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1017\/S1930297500005659","article-title":"Strategies for exploration in the domain of losses","volume":"12","author":"PM Krueger","year":"2017","journal-title":"Judgm Decis Mak"},{"issue":"5","key":"pbio.3003922.ref030","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1177\/09637214221105051","article-title":"Chasing unknown bandits: uncertainty guidance in learning and decision making","volume":"31","author":"M Speekenbrink","year":"2022","journal-title":"Curr Dir Psychol Sci"},{"key":"pbio.3003922.ref031","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.51260","article-title":"Dopaminergic modulation of the exploration\/exploitation trade-off in human decision-making","volume":"9","author":"K Chakroun","year":"2020","journal-title":"Elife"},{"issue":"8","key":"pbio.3003922.ref032","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1038\/nn.2342","article-title":"Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation","volume":"12","author":"MJ Frank","year":"2009","journal-title":"Nat Neurosci"},{"issue":"2","key":"pbio.3003922.ref033","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1038\/npp.2014.193","article-title":"Dopamine, locus of control, and the exploration-exploitation tradeoff","volume":"40","author":"AS Kayser","year":"2015","journal-title":"Neuropsychopharmacology"},{"issue":"5","key":"pbio.3003922.ref034","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1016\/j.biopsych.2010.10.015","article-title":"Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia","volume":"69","author":"GP Strauss","year":"2011","journal-title":"Biol Psychiatry"},{"issue":"3","key":"pbio.3003922.ref035","doi-asserted-by":"crossref","DOI":"10.1002\/bdm.2309","article-title":"Fear and promise of the unknown: how losses discourage and promote exploration","volume":"36","author":"A Chin","year":"2022","journal-title":"Behavioral Decision Making"},{"issue":"3","key":"pbio.3003922.ref036","doi-asserted-by":"crossref","first-page":"708","DOI":"10.3758\/s13423-016-1158-7","article-title":"How the threat of losses makes people explore more than the promise of gains","volume":"24","author":"T Lejarraga","year":"2017","journal-title":"Psychon Bull Rev"},{"issue":"4","key":"pbio.3003922.ref037","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.3758\/s13423-014-0749-4","article-title":"Loss restlessness and gain calmness: durable effects of losses and gains on choice switching","volume":"22","author":"E Yechiam","year":"2015","journal-title":"Psychon Bull Rev"},{"issue":"7095","key":"pbio.3003922.ref038","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1038\/nature04766","article-title":"Cortical substrates for exploratory decisions in humans","volume":"441","author":"ND Daw","year":"2006","journal-title":"Nature"},{"key":"pbio.3003922.ref039","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.59907","article-title":"Human complex exploration strategies are enriched by noradrenaline-modulated heuristics","volume":"10","author":"M Dubois","year":"2021","journal-title":"Elife"},{"issue":"1","key":"pbio.3003922.ref040","doi-asserted-by":"crossref","first-page":"4542","DOI":"10.1038\/s41467-022-31918-9","article-title":"Value-free random exploration is linked to impulsivity","volume":"13","author":"M Dubois","year":"2022","journal-title":"Nat Commun"},{"issue":"43","key":"pbio.3003922.ref041","doi-asserted-by":"crossref","first-page":"14544","DOI":"10.1523\/JNEUROSCI.2322-15.2015","article-title":"Transcranial stimulation over frontopolar cortex elucidates the choice attributes and neural mechanisms used to resolve exploration-exploitation trade-offs","volume":"35","author":"A Raja Beharelle","year":"2015","journal-title":"J Neurosci"},{"issue":"11","key":"pbio.3003922.ref042","doi-asserted-by":"crossref","first-page":"2512","DOI":"10.1523\/JNEUROSCI.1607-20.2021","article-title":"Attenuated directed exploration during reinforcement learning in gambling disorder","volume":"41","author":"A Wiehler","year":"2021","journal-title":"J Neurosci"},{"issue":"6","key":"pbio.3003922.ref043","doi-asserted-by":"crossref","first-page":"2074","DOI":"10.1037\/a0038199","article-title":"Humans use directed and random exploration to solve the explore-exploit dilemma","volume":"143","author":"RC Wilson","year":"2014","journal-title":"J Exp Psychol Gen"},{"issue":"4","key":"pbio.3003922.ref044","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0095693","article-title":"The exploration-exploitation dilemma: a multidisciplinary framework","volume":"9","author":"O Berger-Tal","year":"2014","journal-title":"PLoS One"},{"issue":"1","key":"pbio.3003922.ref045","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1287\/orsc.2.1.71","article-title":"Exploration and exploitation in organizational learning","volume":"2","author":"JG March","year":"1991","journal-title":"Organ Sci"},{"issue":"2","key":"pbio.3003922.ref046","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/S0896-6273(03)00169-7","article-title":"Temporal difference models and reward-related learning in the human brain","volume":"38","author":"JP O\u2019Doherty","year":"2003","journal-title":"Neuron"},{"issue":"9","key":"pbio.3003922.ref047","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1038\/nn1527","article-title":"Opponent appetitive-aversive neural processes underlie predictive learning of pain relief","volume":"8","author":"B Seymour","year":"2005","journal-title":"Nat Neurosci"},{"issue":"43","key":"pbio.3003922.ref048","doi-asserted-by":"crossref","first-page":"13465","DOI":"10.1523\/JNEUROSCI.1500-09.2009","article-title":"Brain hemispheres selectively track the expected value of contralateral options","volume":"29","author":"S Palminteri","year":"2009","journal-title":"J Neurosci"},{"issue":"3","key":"pbio.3003922.ref049","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.pain.2012.11.018","article-title":"The importance of context: when relative relief renders pain pleasant","volume":"154","author":"S Leknes","year":"2013","journal-title":"Pain"},{"issue":"3","key":"pbio.3003922.ref050","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1016\/j.neuron.2011.12.025","article-title":"Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration","volume":"73","author":"D Badre","year":"2012","journal-title":"Neuron"},{"issue":"2","key":"pbio.3003922.ref051","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1037\/rev0000120","article-title":"Habits without values","volume":"126","author":"KJ Miller","year":"2019","journal-title":"Psychol Rev"},{"issue":"1","key":"pbio.3003922.ref052","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1037\/bne0000541","article-title":"Choice-confirmation bias and gradual perseveration in human reinforcement learning","volume":"137","author":"S Palminteri","year":"2023","journal-title":"Behav Neurosci"},{"key":"pbio.3003922.ref053","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.cobeha.2021.06.006","article-title":"Context-dependent outcome encoding in human reinforcement learning","volume":"41","author":"S Palminteri","year":"2021","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"pbio.3003922.ref054","volume-title":"Bayesian cognitive modeling: a practical course","author":"MD Lee","year":"2014"},{"issue":"5","key":"pbio.3003922.ref055","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","article-title":"Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC","volume":"27","author":"A Vehtari","year":"2017","journal-title":"Stat Comput"},{"key":"pbio.3003922.ref056","first-page":"3571","article-title":"Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory","volume":"11","author":"S Watanabe","year":"2010","journal-title":"J Mach Learn Res"},{"key":"pbio.3003922.ref057","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.49547","article-title":"Ten simple rules for the computational modeling of behavioral data","volume":"8","author":"RC Wilson","year":"2019","journal-title":"Elife"},{"issue":"7","key":"pbio.3003922.ref058","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1038\/s41386-021-01264-3","article-title":"Meta-analysis of human prediction error for incentives, perception, cognition, and action","volume":"47","author":"PR Corlett","year":"2022","journal-title":"Neuropsychopharmacology"},{"issue":"1511","key":"pbio.3003922.ref059","doi-asserted-by":"crossref","first-page":"3787","DOI":"10.1098\/rstb.2008.0161","article-title":"The role of the striatum in aversive learning and aversive prediction errors","volume":"363","author":"MR Delgado","year":"2008","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"40","key":"pbio.3003922.ref060","doi-asserted-by":"crossref","first-page":"9715","DOI":"10.1523\/JNEUROSCI.1101-17.2017","article-title":"Suppression of Striatal Prediction Errors by the Prefrontal Cortex in Placebo Hypoalgesia","volume":"37","author":"LA Schenk","year":"2017","journal-title":"J Neurosci"},{"issue":"6992","key":"pbio.3003922.ref061","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1038\/nature02581","article-title":"Temporal difference models describe higher-order learning in humans","volume":"429","author":"B Seymour","year":"2004","journal-title":"Nature"},{"key":"pbio.3003922.ref062","doi-asserted-by":"crossref","first-page":"108740","DOI":"10.1016\/j.neuropsychologia.2023.108740","article-title":"Exploration versus exploitation decisions in the human brain: a systematic review of functional neuroimaging and neuropsychological studies","volume":"192","author":"LE Wyatt","year":"2024","journal-title":"Neuropsychologia"},{"issue":"1","key":"pbio.3003922.ref063","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/s00429-021-02389-3","article-title":"To learn or to gain: neural signatures of exploration in human decision-making","volume":"227","author":"S Zhen","year":"2022","journal-title":"Brain Struct Funct"},{"issue":"12","key":"pbio.3003922.ref064","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.1111\/j.1467-9280.2007.02031.x","article-title":"When gains loom larger than losses: reversed loss aversion for small amounts of money","volume":"18","author":"F Harinck","year":"2007","journal-title":"Psychol Sci"},{"issue":"1","key":"pbio.3003922.ref065","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1017\/S1930297500005258","article-title":"Is loss-aversion magnitude-dependent? Measuring prospective affective judgments regarding gains and losses","volume":"12","author":"S Mukherjee","year":"2017","journal-title":"Judgm Decis Mak"},{"issue":"4","key":"pbio.3003922.ref066","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF00122574","article-title":"Advances in prospect theory: cumulative representation of uncertainty","volume":"5","author":"A Tversky","year":"1992","journal-title":"J Risk Uncertainty"},{"key":"pbio.3003922.ref067","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1177\/0269216307087148","article-title":"Prolactin and dopamine: what is the connection? A review article","volume":"22","author":"P Fitzgerald","year":"2008","journal-title":"J Psychopharmacol"},{"issue":"7","key":"pbio.3003922.ref068","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/j.tics.2022.04.005","article-title":"The computational roots of positivity and confirmation biases in reinforcement learning","volume":"26","author":"S Palminteri","year":"2022","journal-title":"Trends Cogn Sci"},{"issue":"41","key":"pbio.3003922.ref069","doi-asserted-by":"crossref","first-page":"16311","DOI":"10.1073\/pnas.0706111104","article-title":"Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning","volume":"104","author":"MJ Frank","year":"2007","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"1","key":"pbio.3003922.ref070","doi-asserted-by":"crossref","first-page":"3417","DOI":"10.1038\/s41467-020-16964-5","article-title":"Biased belief updating and suboptimal choice in foraging decisions","volume":"11","author":"N Garrett","year":"2020","journal-title":"Nat Commun"},{"issue":"6507","key":"pbio.3003922.ref071","doi-asserted-by":"crossref","DOI":"10.1126\/science.abb0184","article-title":"Neural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex","volume":"369","author":"P Domenech","year":"2020","journal-title":"Science"},{"issue":"11","key":"pbio.3003922.ref072","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1038\/nrn.2017.111","article-title":"Managing competing goals - a key role for the frontopolar cortex","volume":"18","author":"FA Mansouri","year":"2017","journal-title":"Nat Rev Neurosci"},{"issue":"6077","key":"pbio.3003922.ref073","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1126\/science.1216930","article-title":"Neural mechanisms of foraging","volume":"336","author":"N Kolling","year":"2012","journal-title":"Science"},{"issue":"6","key":"pbio.3003922.ref074","doi-asserted-by":"crossref","first-page":"3291","DOI":"10.1073\/pnas.1911348117","article-title":"Uncertainty in learning, choice, and visual fixation","volume":"117","author":"H Stoji\u0107","year":"2020","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"12","key":"pbio.3003922.ref075","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1038\/s41562-018-0467-4","article-title":"Generalization guides human exploration in vast decision spaces","volume":"2","author":"CM Wu","year":"2018","journal-title":"Nat Hum Behav"},{"issue":"2","key":"pbio.3003922.ref076","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1162\/003355397555226","article-title":"The effect of myopia and loss aversion on risk taking: An experimental test","volume":"112","author":"RH Thaler","year":"1997","journal-title":"Q J Econ"},{"issue":"7","key":"pbio.3003922.ref077","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1038\/s41386-022-01517-9","article-title":"Disentangling the roles of dopamine and noradrenaline in the exploration-exploitation tradeoff during human decision-making","volume":"48","author":"A Cremer","year":"2023","journal-title":"Neuropsychopharmacology"},{"issue":"3","key":"pbio.3003922.ref078","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1038\/35044563","article-title":"Multiple reward signals in the brain","volume":"1","author":"W Schultz","year":"2000","journal-title":"Nat Rev Neurosci"},{"issue":"4","key":"pbio.3003922.ref079","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1038\/npp.2015.208","article-title":"Biases in the explore-exploit tradeoff in addictions: the role of avoidance of uncertainty","volume":"41","author":"LS Morris","year":"2016","journal-title":"Neuropsychopharmacology"},{"issue":"47","key":"pbio.3003922.ref080","doi-asserted-by":"crossref","first-page":"12294","DOI":"10.1523\/JNEUROSCI.3116-08.2008","article-title":"A role for dopamine in temporal decision making and reward maximization in parkinsonism","volume":"28","author":"AA Moustafa","year":"2008","journal-title":"J Neurosci"},{"issue":"2","key":"pbio.3003922.ref081","doi-asserted-by":"crossref","first-page":"175","DOI":"10.3758\/BF03193146","article-title":"G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences","volume":"39","author":"F Faul","year":"2007","journal-title":"Behav Res Methods"},{"issue":"7","key":"pbio.3003922.ref082","doi-asserted-by":"crossref","first-page":"2465","DOI":"10.1073\/pnas.0605569104","article-title":"Menstrual cycle phase modulates reward-related neural function in women","volume":"104","author":"J-C Dreher","year":"2007","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"39","key":"pbio.3003922.ref083","doi-asserted-by":"crossref","first-page":"13151","DOI":"10.1523\/JNEUROSCI.0757-14.2014","article-title":"Differential modulation of reinforcement learning by D2 dopamine and NMDA glutamate receptor antagonism","volume":"34","author":"G Jocham","year":"2014","journal-title":"J Neurosci"},{"issue":"5703","key":"pbio.3003922.ref084","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1126\/science.1102941","article-title":"By carrot or by stick: cognitive reinforcement learning in parkinsonism","volume":"306","author":"MJ Frank","year":"2004","journal-title":"Science"},{"issue":"4","key":"pbio.3003922.ref085","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.3758\/s13423-014-0762-7","article-title":"The influence of perceptual information on control processes involved in self-regulated learning: evidence from item selection","volume":"22","author":"F Li","year":"2015","journal-title":"Psychon Bull Rev"},{"key":"pbio.3003922.ref086","doi-asserted-by":"crossref","DOI":"10.1016\/B978-0-12-170150-5.50009-3","article-title":"Chronometric studies of the rotation of mental images.","author":"LA Cooper","year":"1973"},{"issue":"1","key":"pbio.3003922.ref087","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.coph.2008.12.014","article-title":"Dissecting components of reward: \u201cliking\u201d, \u201cwanting\u201d, and learning","volume":"9","author":"KC Berridge","year":"2009","journal-title":"Curr Opin Pharmacol"},{"issue":"17","key":"pbio.3003922.ref088","article-title":"Integration of prior expectations and suppression of prediction errors during expectancy-induced pain modulation: the influence of anxiety and pleasantness","volume":"44","author":"H-Y Tsai","year":"2024","journal-title":"J Neurosci"},{"issue":"10","key":"pbio.3003922.ref089","doi-asserted-by":"crossref","first-page":"1861","DOI":"10.1177\/0956797614543022","article-title":"Learned helplessness and learned prevalence: exploring the causal relations among perceived controllability, reward prevalence, and exploration","volume":"25","author":"K Teodorescu","year":"2014","journal-title":"Psychol Sci"},{"issue":"1","key":"pbio.3003922.ref090","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/hup.320","article-title":"A review of the pharmacokinetics, tolerability and pharmacodynamics of amisulpride in healthy volunteers","volume":"17","author":"P Rosenzweig","year":"2002","journal-title":"Hum Psychopharmacol"},{"issue":"3","key":"pbio.3003922.ref091","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1097\/00004714-199906000-00003","article-title":"Psychomotor, cognitive, extrapyramidal, and affective functions of healthy volunteers during treatment with an atypical (amisulpride) and a classic (haloperidol) antipsychotic","volume":"19","author":"JG Ramaekers","year":"1999","journal-title":"J Clin Psychopharmacol"},{"issue":"3","key":"pbio.3003922.ref092","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1207\/s15327752jpa4703_14","article-title":"A shortened version of the Profile of Mood States","volume":"47","author":"S Shacham","year":"1983","journal-title":"J Pers Assess"},{"key":"pbio.3003922.ref093","first-page":"64","article-title":"A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement.","volume-title":"Classical conditioning II: current research and theory","author":"RA Rescorla","year":"1972"},{"key":"pbio.3003922.ref094","doi-asserted-by":"crossref","first-page":"16033","DOI":"10.1038\/ncomms16033","article-title":"Learning relative values in the striatum induces violations of normative decision making","volume":"8","author":"TA Klein","year":"2017","journal-title":"Nat Commun"},{"key":"pbio.3003922.ref095","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.conb.2018.11.003","article-title":"The algorithmic architecture of exploration in the human brain","volume":"55","author":"E Schulz","year":"2019","journal-title":"Curr Opin Neurobiol"},{"key":"pbio.3003922.ref096","volume-title":"Reinforcement learning: An introduction","author":"RS Sutton","year":"1998"},{"key":"pbio.3003922.ref097","author":"Stan Development Team","year":"2017"},{"key":"pbio.3003922.ref098","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1214\/ss\/1177011136","article-title":"Inference from iterative simulation using multiple sequences","volume":"7","author":"A Gelman","year":"1992","journal-title":"Stat Sci"},{"issue":"1","key":"pbio.3003922.ref099","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1006\/nimg.2001.1054","article-title":"Image distortion correction in fMRI: a quantitative evaluation","volume":"16","author":"C Hutton","year":"2002","journal-title":"Neuroimage"},{"issue":"5306","key":"pbio.3003922.ref100","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A neural substrate of prediction and reward","volume":"275","author":"W Schultz","year":"1997","journal-title":"Science"},{"issue":"3","key":"pbio.3003922.ref101","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1006\/nimg.1997.0291","article-title":"Psychophysiological and modulatory interactions in neuroimaging","volume":"6","author":"KJ Friston","year":"1997","journal-title":"Neuroimage"},{"issue":"4","key":"pbio.3003922.ref102","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1002\/hbm.460020402","article-title":"Statistical parametric maps in functional imaging: a general linear approach","volume":"2","author":"KJ Friston","year":"1994","journal-title":"Human Brain Mapping"},{"issue":"4","key":"pbio.3003922.ref103","doi-asserted-by":"crossref","DOI":"10.1016\/S1053-8119(18)31587-8","article-title":"Generalisability, random effects & population inference","volume":"7","author":"AP Holmes","year":"1998","journal-title":"NeuroImage"},{"issue":"28","key":"pbio.3003922.ref104","doi-asserted-by":"crossref","first-page":"7900","DOI":"10.1073\/pnas.1602413113","article-title":"Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates","volume":"113","author":"A Eklund","year":"2016","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"1","key":"pbio.3003922.ref105","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/hbm.1058","article-title":"Nonparametric permutation tests for functional neuroimaging: a primer with examples","volume":"15","author":"TE Nichols","year":"2002","journal-title":"Hum Brain Mapp"}],"updated-by":[{"DOI":"10.1371\/journal.pbio.3003922","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T00:00:00Z","timestamp":1785456000000}}],"container-title":["PLOS Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pbio.3003922","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T17:42:55Z","timestamp":1785519775000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pbio.3003922"}},"subtitle":[],"editor":[{"given":"Matthew F. S.","family":"Rushworth","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,7,24]]},"references-count":105,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2026,7,24]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pbio.3003922","relation":{},"ISSN":["1545-7885"],"issn-type":[{"value":"1545-7885","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,24]]}}}