{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T17:29:14Z","timestamp":1772904554439,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010805","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T00:00:00Z","timestamp":1672704000000}}],"reference-count":49,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T00:00:00Z","timestamp":1671408000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["2P50MH094258"],"award-info":[{"award-number":["2P50MH094258"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000925","name":"John Templeton Foundation","doi-asserted-by":"publisher","award":["TWCF0366"],"award-info":[{"award-number":["TWCF0366"]}],"id":[{"id":"10.13039\/100000925","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Professor Anthony Mellows Fellowship"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Protection often involves the capacity to prospectively plan the actions needed to mitigate harm. The computational architecture of decisions involving protection remains unclear, as well as whether these decisions differ from other beneficial prospective actions such as reward acquisition. Here we compare protection acquisition to reward acquisition and punishment avoidance to examine overlapping and distinct features across the three action types. Protection acquisition is positively valenced similar to reward. For both protection and reward, the more the actor gains, the more benefit. However, reward and protection occur in different contexts, with protection existing in aversive contexts. Punishment avoidance also occurs in aversive contexts, but differs from protection because punishment is negatively valenced and motivates avoidance. Across three independent studies (Total <jats:italic>N<\/jats:italic> = 600) we applied computational modeling to examine model-based reinforcement learning for protection, reward, and punishment in humans. Decisions motivated by acquiring protection evoked a higher degree of model-based control than acquiring reward or avoiding punishment, with no significant differences in learning rate. The context-valence asymmetry characteristic of protection increased deployment of flexible decision strategies, suggesting model-based control depends on the context in which outcomes are encountered as well as the valence of the outcome.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010805","type":"journal-article","created":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T18:34:53Z","timestamp":1671474893000},"page":"e1010805","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["Model-based prioritization for acquiring protection"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0946-6662","authenticated-orcid":true,"given":"Sarah M.","family":"Tashjian","sequence":"first","affiliation":[]},{"given":"Toby","family":"Wise","sequence":"additional","affiliation":[]},{"given":"Dean","family":"Mobbs","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,12,19]]},"reference":[{"key":"pcbi.1010805.ref001","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/j.tics.2021.01.013","article-title":"A Decision Architecture for Safety Computations.","volume":"25","author":"SM Tashjian","year":"2021","journal-title":"Trends in Cognitive Sciences."},{"key":"pcbi.1010805.ref002","doi-asserted-by":"crossref","first-page":"429","DOI":"10.3758\/CABN.8.4.429","article-title":"Decision theory, reinforcement learning, and the brain.","volume":"8","author":"P Dayan","year":"2008","journal-title":"Cognitive, Affective, & Behavioral Neuroscience."},{"key":"pcbi.1010805.ref003","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.neuron.2013.09.007","article-title":"Goals and Habits in the Brain","volume":"80","author":"RJ Dolan","year":"2013","journal-title":"Neuron"},{"key":"pcbi.1010805.ref004","doi-asserted-by":"crossref","first-page":"R860","DOI":"10.1016\/j.cub.2020.06.051","article-title":"Model-based decision making and model-free learning","volume":"30","author":"N Drummond","year":"2020","journal-title":"Current Biology"},{"key":"pcbi.1010805.ref005","doi-asserted-by":"crossref","first-page":"5738","DOI":"10.1038\/s41467-019-13632-1","article-title":"Task complexity interacts with state-space uncertainty in the arbitration between model-based and model-free learning.","volume":"10","author":"D Kim","year":"2019","journal-title":"Nat Commun."},{"key":"pcbi.1010805.ref006","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1177\/0956797616639301","article-title":"From Creatures of Habit to Goal-Directed Learners.","volume":"27","author":"JH Decker","year":"2016","journal-title":"Psychol Sci."},{"key":"pcbi.1010805.ref007","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1038\/mp.2014.44","article-title":"Disorders of compulsivity: a common bias towards learning habits","volume":"20","author":"V Voon","year":"2015","journal-title":"Mol Psychiatry"},{"key":"pcbi.1010805.ref008","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.tics.2019.12.016","article-title":"Space, Time, and Fear: Survival Computations along Defensive Circuits.","volume":"24","author":"D Mobbs","year":"2020","journal-title":"Trends in Cognitive Sciences."},{"key":"pcbi.1010805.ref009","doi-asserted-by":"crossref","first-page":"1384","DOI":"10.1002\/cpp.2099","article-title":"An exploration of the relationship between use of safety-seeking behaviours and psychosis: A systematic review and meta-analysis.","volume":"24","author":"S Tully","year":"2017","journal-title":"Clinical Psychology & Psychotherapy."},{"key":"pcbi.1010805.ref010","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.tics.2011.11.018","article-title":"Computational psychiatry.","volume":"16","author":"PR Montague","year":"2012","journal-title":"Trends in Cognitive Sciences"},{"key":"pcbi.1010805.ref011","doi-asserted-by":"crossref","first-page":"239821281877296","DOI":"10.1177\/2398212818772964","article-title":"Model-based and model-free pain avoidance learning","volume":"2","author":"O Wang","year":"2018","journal-title":"Brain and Neuroscience Advances"},{"key":"pcbi.1010805.ref012","doi-asserted-by":"crossref","first-page":"4179","DOI":"10.1038\/s41467-020-17977-w","article-title":"Associations between aversive learning processes and transdiagnostic psychiatric symptoms in a general population sample","volume":"11","author":"T Wise","year":"2020","journal-title":"Nature Communications"},{"key":"pcbi.1010805.ref013","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.neuroimage.2012.04.024","article-title":"Go and no-go learning in reward and punishment: interactions between affect and effect.","volume":"62","author":"M Guitart-Masip","year":"2012","journal-title":"Neuroimage"},{"key":"pcbi.1010805.ref014","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.tics.2014.01.003","article-title":"Action versus valence in decision making.","volume":"18","author":"M Guitart-Masip","year":"2014","journal-title":"Trends in Cognitive Sciences"},{"key":"pcbi.1010805.ref015","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s11031-006-9028-7","article-title":"The Hierarchical Model of Approach-Avoidance Motivation.","volume":"30","author":"AJ Elliot","year":"2006","journal-title":"Motiv Emot."},{"key":"pcbi.1010805.ref016","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1038\/mp.2015.46","article-title":"Valence-dependent influence of serotonin depletion on model-based choice strategy","volume":"21","author":"Y Worbe","year":"2016","journal-title":"Mol Psychiatry"},{"key":"pcbi.1010805.ref017","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.tics.2016.12.006","article-title":"Why Good Is More Alike Than Bad: Processing Implications.","volume":"21","author":"H Alves","year":"2017","journal-title":"Trends in Cognitive Sciences."},{"key":"pcbi.1010805.ref018","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1016\/j.neunet.2006.03.002","article-title":"The misbehavior of value and the discipline of the will.","volume":"19","author":"P Dayan","year":"2006","journal-title":"Neural Networks."},{"key":"pcbi.1010805.ref019","doi-asserted-by":"crossref","first-page":"1321","DOI":"10.1177\/0956797617708288","article-title":"Cost-Benefit Arbitration Between Multiple Reinforcement-Learning Systems.","volume":"28","author":"W Kool","year":"2017","journal-title":"Psychol Sci."},{"key":"pcbi.1010805.ref020","doi-asserted-by":"crossref","first-page":"2437","DOI":"10.1007\/s00213-019-05299-9","article-title":"Reward and avoidance learning in the context of aversive environments and possible implications for depressive symptoms","volume":"236","author":"M Sebold","year":"2019","journal-title":"Psychopharmacology"},{"key":"pcbi.1010805.ref021","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.biopsych.2018.06.018","article-title":"Incentives Boost Model-Based Control Across a Range of Severity on Several Psychiatric Constructs","volume":"85","author":"EH Patzelt","year":"2019","journal-title":"Biological Psychiatry"},{"key":"pcbi.1010805.ref022","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1007\/s11222-013-9416-2","article-title":"Understanding predictive information criteria for Bayesian models.","volume":"24","author":"A Gelman","year":"2014","journal-title":"Stat Comput"},{"key":"pcbi.1010805.ref023","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1005090","article-title":"When Does Model-Based Control Pay Off?","volume":"12","author":"W Kool","year":"2016","journal-title":"PLoS Comput Biol."},{"key":"pcbi.1010805.ref024","doi-asserted-by":"crossref","first-page":"6035","DOI":"10.1073\/pnas.1820238116","article-title":"Model-free and model-based learning processes in the updating of explicit and implicit evaluations.","volume":"116","author":"B Kurdi","year":"2019","journal-title":"PNAS"},{"key":"pcbi.1010805.ref025","volume-title":"Manual for the State-Trait Inventory STAI (Form Y).","author":"CD Spielberger","year":"1983"},{"key":"pcbi.1010805.ref026","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1177\/1754073913477507","article-title":"Approach and Avoidance Behaviour: Multiple Systems and their Interactions","volume":"5","author":"PJ Corr","year":"2013","journal-title":"Emotion Review"},{"key":"pcbi.1010805.ref027","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1006\/nimg.2000.0593","article-title":"FMRI visualization of brain activity during a monetary incentive delay task","volume":"12","author":"B Knutson","year":"2000","journal-title":"Neuroimage"},{"key":"pcbi.1010805.ref028","doi-asserted-by":"crossref","first-page":"10799","DOI":"10.1523\/JNEUROSCI.0788-10.2010","article-title":"Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making","volume":"30","author":"H Plassmann","year":"2010","journal-title":"J Neurosci"},{"key":"pcbi.1010805.ref029","doi-asserted-by":"crossref","first-page":"e1006973","DOI":"10.1371\/journal.pcbi.1006973","article-title":"Contextual influence on confidence judgments in human reinforcement learning.","volume":"15","author":"M Lebreton","year":"2019","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1010805.ref030","first-page":"650556","article-title":"Higher Meta-cognitive Ability Predicts Less Reliance on Over Confident Habitual Learning System.","author":"S Ershadmanesh","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1010805.ref031","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1002\/da.22353","article-title":"Updated meta-analysis of classical fear conditioning in the anxiety disorders.","volume":"32","author":"P Duits","year":"2015","journal-title":"Depress Anxiety."},{"key":"pcbi.1010805.ref032","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.cpr.2015.08.004","article-title":"Response rates for CBT for anxiety disorders: Need for standardized criteria.","volume":"42","author":"AG Loerinc","year":"2015","journal-title":"Clin Psychol Rev"},{"key":"pcbi.1010805.ref033","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.cpr.2006.07.005","article-title":"A functional analysis of danger and safety signals in anxiety disorders.","volume":"27","author":"JM Lohr","year":"2007","journal-title":"Clinical Psychology Review"},{"key":"pcbi.1010805.ref034","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.neubiorev.2019.11.006","article-title":"Know safety, no fear.","volume":"108","author":"S Sangha","year":"2020","journal-title":"Neuroscience & Biobehavioral Reviews."},{"key":"pcbi.1010805.ref035","first-page":"218","article-title":"Tolerate or Eliminate? A Systematic Review on the Effects of Safety Behavior Across Anxiety Disorders.","volume":"17","author":"S Helbig-Lang","year":"2010","journal-title":"Clinical Psychology: Science and Practice."},{"key":"pcbi.1010805.ref036","article-title":"Learning About Safety: Conditioned Inhibition as a Novel Approach to Fear Reduction Targeting the Developing Brain.","author":"P Odriozola","year":"2020","journal-title":"AJP"},{"key":"pcbi.1010805.ref037","doi-asserted-by":"crossref","first-page":"26970","DOI":"10.1073\/pnas.1910481116","article-title":"Ventral hippocampus interacts with prelimbic cortex during inhibition of threat response via learned safety in both mice and humans.","volume":"116","author":"HC Meyer","year":"2019","journal-title":"PNAS"},{"key":"pcbi.1010805.ref038","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1017\/S1352465804001985","article-title":"Safety-Seeking Behaviours: Fact or Function? How Can We Clinically Differentiate Between Safety Behaviours and Adaptive Coping Strategies Across Anxiety Disorders?","volume":"33","author":"R Thwaites","year":"2005","journal-title":"Behavioural and Cognitive Psychotherapy."},{"key":"pcbi.1010805.ref039","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jmp.2016.01.006","article-title":"Empirical priors for reinforcement learning models","volume":"71","author":"SJ Gershman","year":"2016","journal-title":"Journal of Mathematical Psychology"},{"key":"pcbi.1010805.ref040","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1038\/s41583-020-0355-6","article-title":"Beyond dichotomies in reinforcement learning.","volume":"21","author":"AGE Collins","year":"2020","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1010805.ref041","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.ijpsycho.2021.05.011","article-title":"The role of intolerance of uncertainty in classical threat conditioning: Recent developments and directions for future research","volume":"166","author":"J Morriss","year":"2021","journal-title":"International Journal of Psychophysiology"},{"key":"pcbi.1010805.ref042","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.bpsgos.2021.05.011","article-title":"I Doubt It Is Safe: A Meta-analysis of Self-reported Intolerance of Uncertainty and Threat Extinction Training","volume":"1","author":"J Morriss","year":"2021","journal-title":"Biological Psychiatry Global Open Science"},{"key":"pcbi.1010805.ref043","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.cpr.2018.01.001","article-title":"Intolerance of uncertainty: Neural and psychophysiological correlates of the perception of uncertainty as threatening.","volume":"60","author":"E Tanovic","year":"2018","journal-title":"Clin Psychol Rev"},{"key":"pcbi.1010805.ref044","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.jesp.2017.01.006","article-title":"Beyond the Turk: Alternative platforms for crowdsourcing behavioral research","volume":"70","author":"E Peer","year":"2017","journal-title":"Journal of Experimental Social Psychology"},{"key":"pcbi.1010805.ref045","volume":"30","author":"ALS Filipowicz","journal-title":"The complexity of model-free and model-based learning strategies."},{"key":"pcbi.1010805.ref046","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v076.i01","article-title":"Stan: A Probabilistic Programming Language","volume":"76","author":"B Carpenter","year":"2017","journal-title":"Journal of Statistical Software"},{"key":"pcbi.1010805.ref047","first-page":"3571","article-title":"Asymptotic Equivalence of Bayes Cross Validation and Widely Applicable Information Criterion in Singular Learning Theory","volume":"11","author":"S. Watanabe","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"pcbi.1010805.ref048","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting Linear Mixed-Effects Models Using lme4","volume":"67","author":"D Bates","year":"2015","journal-title":"Journal of Statistical Software"},{"key":"pcbi.1010805.ref049","doi-asserted-by":"crossref","first-page":"20170213","DOI":"10.1098\/rsif.2017.0213","article-title":"The coefficient of determination R2 and intra-class correlation coefficient from generalized linear mixed-effects models revisited and expanded","volume":"14","author":"S Nakagawa","year":"2017","journal-title":"Journal of The Royal Society Interface"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010805","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T00:00:00Z","timestamp":1672704000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010805","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T19:55:01Z","timestamp":1672775701000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010805"}},"subtitle":[],"editor":[{"given":"Ming Bo","family":"Cai","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,12,19]]},"references-count":49,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12,19]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010805","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1010805","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,19]]}}}