{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:58:34Z","timestamp":1777661914828,"version":"3.51.4"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009452","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T00:00:00Z","timestamp":1634169600000}}],"reference-count":72,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2021,10,4]],"date-time":"2021-10-04T00:00:00Z","timestamp":1633305600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003554","name":"Lundbeckfonden","doi-asserted-by":"publisher","award":["DANDRITE-R248-2016-2518"],"award-info":[{"award-number":["DANDRITE-R248-2016-2518"]}],"id":[{"id":"10.13039\/501100003554","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003554","name":"Lundbeckfonden","doi-asserted-by":"publisher","award":["R191-2015-1506"],"award-info":[{"award-number":["R191-2015-1506"]}],"id":[{"id":"10.13039\/501100003554","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003554","name":"lundbeckfonden","doi-asserted-by":"publisher","award":["DANDRITE-R248-2016-2518"],"award-info":[{"award-number":["DANDRITE-R248-2016-2518"]}],"id":[{"id":"10.13039\/501100003554","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Choice history effects describe how future choices depend on the history of past choices. In experimental tasks this is typically framed as a bias because it often diminishes the experienced reward rates. However, in natural habitats, choices made in the past constrain choices that can be made in the future. For foraging animals, the probability of earning a reward in a given patch depends on the degree to which the animals have exploited the patch in the past. One problem with many experimental tasks that show choice history effects is that such tasks artificially decouple choice history from its consequences on reward availability over time. To circumvent this, we use a variable interval (VI) reward schedule that reinstates a more natural contingency between past choices and future reward availability. By examining the behavior of optimal agents in the VI task we discover that choice history effects observed in animals serve to maximize reward harvesting efficiency. We further distil the function of choice history effects by manipulating first- and second-order statistics of the environment. We find that choice history effects primarily reflect the growth rate of the reward probability of the unchosen option, whereas reward history effects primarily reflect environmental volatility. Based on observed choice history effects in animals, we develop a reinforcement learning model that explicitly incorporates choice history over multiple time scales into the decision process, and we assess its predictive adequacy in accounting for the associated behavior. We show that this new variant, known as the double trace model, has a higher performance in predicting choice data, and shows near optimal reward harvesting efficiency in simulated environments. These results suggests that choice history effects may be adaptive for natural contingencies between consumption and reward availability. This concept lends credence to a normative account of choice history effects that extends beyond its description as a bias.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009452","type":"journal-article","created":{"date-parts":[[2021,10,4]],"date-time":"2021-10-04T21:44:46Z","timestamp":1633383886000},"page":"e1009452","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":8,"title":["Choice history effects in mice and humans improve reward harvesting efficiency"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4619-8329","authenticated-orcid":true,"given":"Junior Samuel","family":"L\u00f3pez-Y\u00e9pez","sequence":"first","affiliation":[]},{"given":"Juliane","family":"Martin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3139-4324","authenticated-orcid":true,"given":"Oliver","family":"Hulme","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3175-1774","authenticated-orcid":true,"given":"Duda","family":"Kvitsiani","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2021,10,4]]},"reference":[{"issue":"7692","key":"pcbi.1009452.ref001","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1038\/nature25510","article-title":"Posterior parietal cortex represents sensory history and mediates its effects on behaviour","volume":"554","author":"A Akrami","year":"2018","journal-title":"Nature"},{"issue":"5","key":"pcbi.1009452.ref002","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1016\/j.neuron.2019.06.001","article-title":"Stable representations of decision variables for flexible behavior","volume":"103","author":"BA Bari","year":"2019","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1009452.ref003","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-017-01356-z","article-title":"History-based action selection bias in posterior parietal cortex","volume":"8","author":"EJ Hwang","year":"2017","journal-title":"Nature communications"},{"issue":"6","key":"pcbi.1009452.ref004","doi-asserted-by":"crossref","first-page":"1126","DOI":"10.1016\/j.neuron.2019.09.028","article-title":"Corticostriatal flow of action selection bias","volume":"104","author":"EJ Hwang","year":"2019","journal-title":"Neuron"},{"issue":"2","key":"pcbi.1009452.ref005","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1037\/h0065212","article-title":"Interdependence of judgments within the series for the method of constant stimuli","volume":"3","author":"SW Fernberger","year":"1920","journal-title":"Journal of Experimental Psychology"},{"issue":"4","key":"pcbi.1009452.ref006","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1016\/j.cub.2017.01.006","article-title":"Opposite effects of recent history on perception and decision","volume":"27","author":"M Fritsche","year":"2017","journal-title":"Current Biology"},{"issue":"31","key":"pcbi.1009452.ref007","doi-asserted-by":"crossref","first-page":"11351","DOI":"10.1523\/JNEUROSCI.6689-10.2011","article-title":"The detection of visual contrast in the behaving mouse","volume":"31","author":"L Busse","year":"2011","journal-title":"Journal of Neuroscience"},{"issue":"7","key":"pcbi.1009452.ref008","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1167\/14.7.9","article-title":"Quantifying the effect of intertrial dependence on perceptual decisions","volume":"14","author":"I Fr\u00fcnd","year":"2014","journal-title":"Journal of vision"},{"issue":"3","key":"pcbi.1009452.ref009","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1901\/jeab.1970.13-369","article-title":"A comparision of variable-ratio and variable-interval schedules of reinforcement 1","volume":"13","author":"GE Zuriff","year":"1970","journal-title":"Journal of the Experimental Analysis of Behavior"},{"key":"pcbi.1009452.ref010","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1196\/annals.1390.009","article-title":"Calculating the cost of acting in frontal cortex","volume":"1104","author":"ME Walton","year":"2007","journal-title":"Annals of the New York Academy of Sciences"},{"issue":"7","key":"pcbi.1009452.ref011","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1038\/nn.2856","article-title":"Neuronal basis of sequential foraging decisions in a patchy environment","volume":"14","author":"BY Hayden","year":"2011","journal-title":"Nature neuroscience"},{"key":"pcbi.1009452.ref012","doi-asserted-by":"crossref","unstructured":"Geana A, Niv Y. Causal model comparison shows that human representation learning is not Bayesian. In Cold Spring Harbor symposia on quantitative biology 2014 Jan 1 (Vol. 79, pp. 161-168). Cold Spring Harbor Laboratory Press.","DOI":"10.1101\/sqb.2014.79.024851"},{"issue":"3","key":"pcbi.1009452.ref013","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1901\/jeab.2005.110-04","article-title":"Dynamic response by response models of matching behavior in rhesus monkeys","volume":"84","author":"B Lau","year":"2005","journal-title":"Journal of the experimental analysis of behavior"},{"key":"pcbi.1009452.ref014","article-title":"The elements of statistical learning","volume-title":"Springer series in statistics","author":"T Hastie","year":"2009"},{"issue":"2","key":"pcbi.1009452.ref015","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"H Zou","year":"2005","journal-title":"Journal of the royal statistical society: series B (statistical methodology)"},{"issue":"1","key":"pcbi.1009452.ref016","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1214\/ss\/1177011077","article-title":"Simulated annealing","volume":"8","author":"D Bertsimas","year":"1993","journal-title":"Statistical science"},{"issue":"48","key":"pcbi.1009452.ref017","doi-asserted-by":"crossref","first-page":"15104","DOI":"10.1523\/JNEUROSCI.3524-09.2009","article-title":"Dopaminergic drugs modulate learning rates and perseveration in Parkinson\u2019s patients in a dynamic foraging task","volume":"29","author":"RB Rutledge","year":"2009","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1009452.ref018","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.jmp.2015.03.006","article-title":"The relation between reinforcement learning parameters and the influence of reinforcement history on choice behavior","volume":"66","author":"K Katahira","year":"2015","journal-title":"Journal of Mathematical Psychology"},{"key":"pcbi.1009452.ref019","doi-asserted-by":"crossref","unstructured":"Schwartz A. A reinforcement learning method for maximizing undiscounted rewards. In Proceedings of the tenth international conference on machine learning 1993 (Vol. 298, pp. 298-305).","DOI":"10.1016\/B978-1-55860-307-3.50045-9"},{"issue":"1","key":"pcbi.1009452.ref020","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1162\/neco.2008.20.1.227","article-title":"The actor-critic learning is behind the matching law: matching versus optimal behaviors","volume":"20","author":"Y Sakai","year":"2008","journal-title":"Neural computation"},{"key":"pcbi.1009452.ref021","article-title":"Theoretical neuroscience: computational and mathematical modeling of neural systems","volume-title":"Computational Neuroscience Series","author":"P Dayan","year":"2001"},{"issue":"1","key":"pcbi.1009452.ref022","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.neuron.2013.10.018","article-title":"Autonomous mechanism of internal choice estimate underlies decision inertia","volume":"81","author":"R Akaishi","year":"2014","journal-title":"Neuron"},{"issue":"31","key":"pcbi.1009452.ref023","doi-asserted-by":"crossref","first-page":"9861","DOI":"10.1523\/JNEUROSCI.6157-08.2009","article-title":"Validation of decision-making models and analysis of decision variables in the rat basal ganglia","volume":"29","author":"M Ito","year":"2009","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"pcbi.1009452.ref024","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1901\/jeab.2005.23-05","article-title":"Linear-nonlinear-Poisson models of primate choice dynamics","volume":"84","author":"GS Corrado","year":"2005","journal-title":"Journal of the experimental analysis of behavior"},{"key":"pcbi.1009452.ref025","volume-title":"Signal detection theory and psychophysics","author":"DM Green","year":"1966"},{"key":"pcbi.1009452.ref026","first-page":"125","article-title":"Mapping spikes to sensations","volume":"5","author":"MC St\u00fcttgen","journal-title":"Front Neurosci"},{"key":"pcbi.1009452.ref027","doi-asserted-by":"crossref","DOI":"10.4324\/9781410611147","volume-title":"Detection theory: A user\u2019s guide","author":"NA Macmillan","year":"2004"},{"issue":"1","key":"pcbi.1009452.ref028","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42113-018-0011-7","article-title":"Limitations of Bayesian leave-one-out cross-validation for model selection","volume":"2","author":"QF Gronau","year":"2019","journal-title":"Computational brain and behavior"},{"issue":"4","key":"pcbi.1009452.ref029","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1016\/j.neuroimage.2009.03.025","article-title":"Bayesian model selection for group studies","volume":"46","author":"KE Stephan","year":"2009","journal-title":"Neuroimage"},{"issue":"6896","key":"pcbi.1009452.ref030","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1038\/nature00892","article-title":"A neural correlate of response bias in monkey caudate nucleus","volume":"418","author":"J Lauwereyns","year":"2002","journal-title":"Nature"},{"issue":"2","key":"pcbi.1009452.ref031","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/j.neuron.2013.02.010","article-title":"The limits of deliberation in a perceptual decision task","volume":"78","author":"HA Zariwala","year":"2013","journal-title":"Neuron"},{"issue":"9","key":"pcbi.1009452.ref032","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1038\/nn1954","article-title":"Learning the value of information in an uncertain world","volume":"10","author":"TE Behrens","year":"2007","journal-title":"Nature neuroscience"},{"key":"pcbi.1009452.ref033","doi-asserted-by":"crossref","unstructured":"Vermorel J, Mohri M. Multi-armed bandit algorithms and empirical evaluation. In European conference on machine learning 2005 Oct 3 (pp. 437-448). Springer, Berlin, Heidelberg.","DOI":"10.1007\/11564096_42"},{"issue":"47","key":"pcbi.1009452.ref034","doi-asserted-by":"crossref","first-page":"14701","DOI":"10.1523\/JNEUROSCI.2728-09.2009","article-title":"Role of striatum in updating values of chosen actions","volume":"29","author":"H Kim","year":"2009","journal-title":"Journal of neuroscience"},{"issue":"30","key":"pcbi.1009452.ref035","doi-asserted-by":"crossref","first-page":"8402","DOI":"10.1073\/pnas.1602217113","article-title":"Utility functions predict variance and skewness risk preferences in monkeys","volume":"113","author":"W Genest","year":"2016","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"pcbi.1009452.ref036","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1002\/jeab.261","article-title":"Theoretical implications of quantitative properties of interval timing and probability estimation in mouse and rat","volume":"108","author":"A Kheifets","year":"2017","journal-title":"Journal of the experimental analysis of behavior"},{"key":"pcbi.1009452.ref037","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1196\/annals.1390.009","article-title":"Calculating the cost of acting in frontal cortex","volume":"1104","author":"ME Walton","year":"2007","journal-title":"Annals of the New York Academy of Sciences"},{"issue":"20","key":"pcbi.1009452.ref038","doi-asserted-by":"crossref","first-page":"8308","DOI":"10.1073\/pnas.1220738110","article-title":"Subjective costs drive overly patient foraging strategies in rats on an intertemporal foraging task","volume":"110","author":"AM Wikenheiser","year":"2013","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"7","key":"pcbi.1009452.ref039","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1038\/nn.2856","article-title":"Neuronal basis of sequential foraging decisions in a patchy environment","volume":"14","author":"BY Hayden","year":"2011","journal-title":"Nature neuroscience"},{"issue":"2","key":"pcbi.1009452.ref040","doi-asserted-by":"crossref","first-page":"225","DOI":"10.3758\/s13415-018-00682-z","article-title":"Revisiting foraging approaches in neuroscience","volume":"19","author":"S Hall-McMaster","year":"2019","journal-title":"Cognitive, Affective, and Behavioral Neuroscience"},{"key":"pcbi.1009452.ref041","volume-title":"Foraging theory","author":"DW Stephens","year":"1986"},{"issue":"1","key":"pcbi.1009452.ref042","first-page":"30","article-title":"Black-capped chickadees (Poecile atricapillus) anticipate future outcomes of foraging choices","volume":"37","author":"MC Feeney","year":"2011","journal-title":"Journal of Experimental Psychology: Animal Behavior Processes"},{"issue":"6","key":"pcbi.1009452.ref043","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1006\/anbe.2003.2003","article-title":"Rationality in risk-sensitive foraging choices by starlings","volume":"64","author":"C Schuck-Paim","year":"2002","journal-title":"Animal Behaviour"},{"issue":"3","key":"pcbi.1009452.ref044","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1093\/beheco\/7.3.341","article-title":"Rate currencies and the foraging starling: the fallacy of the averages revisited","volume":"7","author":"M Bateson","year":"1996","journal-title":"Behavioral Ecology"},{"issue":"5678","key":"pcbi.1009452.ref045","doi-asserted-by":"crossref","first-page":"1782","DOI":"10.1126\/science.1094765","article-title":"Matching behavior and the representation of value in the parietal cortex","volume":"304","author":"LP Sugrue","year":"2004","journal-title":"Science"},{"issue":"6","key":"pcbi.1009452.ref046","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1016\/j.cub.2021.01.068","article-title":"Prefrontal cortex represents heuristics that shape choice bias and its integration into future behavior","volume":"31","author":"G Mochol","year":"2021","journal-title":"Current Biology"},{"key":"pcbi.1009452.ref047","doi-asserted-by":"crossref","first-page":"e55490","DOI":"10.7554\/eLife.55490","article-title":"Lapses in perceptual decisions reflect exploration","volume":"10","author":"S Pisupati","year":"2021","journal-title":"Elife"},{"issue":"1","key":"pcbi.1009452.ref048","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-020-16196-7","article-title":"The impact of learning on perceptual decisions and its implication for speed-accuracy tradeoffs","volume":"11","author":"AG Mendon\u00e7a","year":"2020","journal-title":"Nature communications"},{"issue":"10","key":"pcbi.1009452.ref049","doi-asserted-by":"crossref","first-page":"2418","DOI":"10.1523\/JNEUROSCI.2189-17.2017","article-title":"Adaptive history biases result from confidence-weighted accumulation of past choices","volume":"38","author":"A Braun","year":"2018","journal-title":"Journal of Neuroscience"},{"issue":"17","key":"pcbi.1009452.ref050","doi-asserted-by":"crossref","first-page":"6339","DOI":"10.1523\/JNEUROSCI.5613-10.2011","article-title":"Elapsed decision time affects the weighting of prior probability in a perceptual decision task","volume":"31","author":"TD Hanks","year":"2011","journal-title":"Journal of Neuroscience"},{"issue":"25","key":"pcbi.1009452.ref051","doi-asserted-by":"crossref","first-page":"E3548","DOI":"10.1073\/pnas.1518786113","article-title":"Adaptable history biases in human perceptual decisions","volume":"113","author":"A Abrahamyan","year":"2016","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"3","key":"pcbi.1009452.ref052","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/S0022-5193(05)80114-6","article-title":"Optimal patch use by a territorial forager","volume":"145","author":"HP Possingham","year":"1990","journal-title":"Journal of Theoretical Biology"},{"key":"pcbi.1009452.ref053","author":"S Hall-McMaster","year":"2021","journal-title":"Control over patch encounters changes foraging behaviour"},{"issue":"23","key":"pcbi.1009452.ref054","doi-asserted-by":"crossref","first-page":"6186","DOI":"10.1523\/JNEUROSCI.4390-15.2016","article-title":"Serial dependence in perceptual decisions is reflected in activity patterns in primary visual cortex","volume":"36","author":"ES John-Saaltink","year":"2016","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1009452.ref055","first-page":"1","article-title":"Motor cortex activity predicts response alternation during sensorimotor decisions","volume":"7","author":"AA Pape","year":"2016","journal-title":"Nature communications"},{"issue":"7451","key":"pcbi.1009452.ref056","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1038\/nature12160","article-title":"The importance of mixed selectivity in complex cognitive tasks","volume":"497","author":"M Rigotti","year":"2013","journal-title":"Nature"},{"issue":"1","key":"pcbi.1009452.ref057","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.neuron.2018.10.050","article-title":"Activity of prefrontal neurons predict future choices during gambling","volume":"101","author":"J Passecker","year":"2019","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1009452.ref058","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1152\/jn.00035.2008","article-title":"Neuronal correlates of post-error slowing in the rat dorsomedial prefrontal cortex","volume":"100","author":"NS Narayanan","year":"2008","journal-title":"Journal of neurophysiology"},{"issue":"7","key":"pcbi.1009452.ref059","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1016\/j.neuron.2021.02.001","article-title":"Post-error recruitment of frontal sensory cortical projections promotes attention in mice","volume":"109","author":"KJ Norman","year":"2021","journal-title":"Neuron"},{"issue":"4","key":"pcbi.1009452.ref060","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1038\/nn1209","article-title":"Prefrontal cortex and decision making in a mixed-strategy game","volume":"7","author":"DJ Barraclough","year":"2004","journal-title":"Nature neuroscience"},{"issue":"4","key":"pcbi.1009452.ref061","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1037\/0033-295X.113.4.700","article-title":"The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks","volume":"113","author":"R Bogacz","year":"2006","journal-title":"Psychological review"},{"key":"pcbi.1009452.ref062","doi-asserted-by":"crossref","first-page":"e08825","DOI":"10.7554\/eLife.08825","article-title":"Normative evidence accumulation in unpredictable environments","volume":"4","author":"CM Glaze","year":"2015","journal-title":"Elife"},{"issue":"1","key":"pcbi.1009452.ref063","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-019-09388-3","article-title":"Deviation from the matching law reflects an optimal strategy involving learning over multiple timescales","volume":"10","author":"K Iigaya","year":"2019","journal-title":"Nature communications"},{"issue":"1","key":"pcbi.1009452.ref064","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1523\/JNEUROSCI.1313-14.2015","article-title":"Spatial and temporal characteristics of error-related activity in the human brain","volume":"35","author":"M Neta","year":"2015","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1009452.ref065","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-017-02169-w","article-title":"Simultaneous representation of a spectrum of dynamically changing value estimates during decision making","volume":"8","author":"D Meder","year":"2017","journal-title":"Nature communications"},{"issue":"1","key":"pcbi.1009452.ref066","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms12327","article-title":"Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex","volume":"7","author":"MK Wittmann","year":"2016","journal-title":"Nature communications"},{"issue":"1","key":"pcbi.1009452.ref067","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-020-17343-w","article-title":"Global reward state affects learning and activity in raphe nucleus and anterior insula in monkeys","volume":"11","author":"MK Wittmann","year":"2020","journal-title":"Nature communications"},{"issue":"2","key":"pcbi.1009452.ref068","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/0040-5809(76)90040-X","article-title":"Optimal foraging, the marginal value theorem","volume":"9","author":"EL Charnov","year":"1976","journal-title":"Theoretical population biology"},{"key":"pcbi.1009452.ref069","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.jaa.2016.03.002","article-title":"Marginal value theorem, patch choice, and human foraging response in varying environments","volume":"42","author":"RL Bettinger","year":"2016","journal-title":"Journal of Anthropological Archaeology"},{"issue":"5","key":"pcbi.1009452.ref070","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.1007\/s00285-013-0734-y","article-title":"How optimal foragers should respond to habitat changes: a reanalysis of the Marginal Value Theorem","volume":"69","author":"V Calcagno","year":"2014","journal-title":"Journal of mathematical biology"},{"issue":"6077","key":"pcbi.1009452.ref071","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1126\/science.1216930","article-title":"Neural mechanisms of foraging","volume":"336","author":"N Kolling","year":"2012","journal-title":"Science"},{"issue":"5","key":"pcbi.1009452.ref072","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1016\/j.neuron.2014.01.033","article-title":"Multiple neural mechanisms of decision making and their competition under changing risk pressure","volume":"81","author":"N Kolling","year":"2014","journal-title":"Neuron"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009452","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T00:00:00Z","timestamp":1634169600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009452","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,14]],"date-time":"2021-10-14T21:14:21Z","timestamp":1634246061000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009452"}},"subtitle":[],"editor":[{"given":"Stefano","family":"Palminteri","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,10,4]]},"references-count":72,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10,4]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009452","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1009452","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,4]]}}}