{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T23:01:37Z","timestamp":1791932497330,"version":"4.3.4"},"update-to":[{"DOI":"10.1371\/journal.pbio.3001985","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T00:00:00Z","timestamp":1675900800000}}],"reference-count":88,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005413","name":"Universit\u00e9 Paris Descartes","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100005413","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MR\/K501256\/1"],"award-info":[{"award-number":["MR\/K501256\/1"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MR\/N013468\/1"],"award-info":[{"award-number":["MR\/N013468\/1"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000719","name":"St. John's College, University of Oxford","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000719","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["096587\/Z\/11\/Z"],"award-info":[{"award-number":["096587\/Z\/11\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["090051\/Z\/09\/Z"],"award-info":[{"award-number":["090051\/Z\/09\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["202831\/Z\/16\/Z"],"award-info":[{"award-number":["202831\/Z\/16\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["WT1005651MA"],"award-info":[{"award-number":["WT1005651MA"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["203139\/Z\/16\/Z"],"award-info":[{"award-number":["203139\/Z\/16\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000268","name":"Biotechnology and Biological Sciences Research Council","doi-asserted-by":"publisher","award":["BB\/R01803\/1"],"award-info":[{"award-number":["BB\/R01803\/1"]}],"id":[{"id":"10.13039\/501100000268","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011074","name":"Universit\u00e9 de Lyon","doi-asserted-by":"publisher","award":["ANR-11-LABX-0042"],"award-info":[{"award-number":["ANR-11-LABX-0042"]}],"id":[{"id":"10.13039\/501100011074","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosbiology.org"],"crossmark-restriction":false},"short-container-title":["PLoS Biol"],"abstract":"<jats:p>Humans have been shown to strategically explore. They can identify situations in which gathering information about distant and uncertain options is beneficial for the future. Because primates rely on scarce resources when they forage, they are also thought to strategically explore, but whether they use the same strategies as humans and the neural bases of strategic exploration in monkeys are largely unknown. We designed a sequential choice task to investigate whether monkeys mobilize strategic exploration based on whether information can improve subsequent choice, but also to ask the novel question about whether monkeys adjust their exploratory choices based on the contingency between choice and information, by sometimes providing the counterfactual feedback about the unchosen option. We show that monkeys decreased their reliance on expected value when exploration could be beneficial, but this was not mediated by changes in the effect of uncertainty on choices. We found strategic exploratory signals in anterior and mid-cingulate cortex (ACC\/MCC) and dorsolateral prefrontal cortex (dlPFC). This network was most active when a low value option was chosen, which suggests a role in counteracting expected value signals, when exploration away from value should to be considered. Such strategic exploration was abolished when the counterfactual feedback was available. Learning from counterfactual outcome was associated with the recruitment of a different circuit centered on the medial orbitofrontal cortex (OFC), where we showed that monkeys represent chosen and unchosen reward prediction errors. Overall, our study shows how ACC\/MCC-dlPFC and OFC circuits together could support exploitation of available information to the fullest and drive behavior towards finding more information through exploration when it is beneficial.<\/jats:p>","DOI":"10.1371\/journal.pbio.3001985","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T14:56:31Z","timestamp":1675090591000},"page":"e3001985","update-policy":"https:\/\/doi.org\/10.1371\/journal.pbio.corrections_policy","source":"Crossref","is-referenced-by-count":30,"title":["Neural responses in macaque prefrontal cortex are linked to strategic exploration"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9894-9668","authenticated-orcid":true,"given":"Caroline I.","family":"Jahn","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Grohn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"Cuell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Emberton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastien","family":"Bouret","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark E.","family":"Walton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nils","family":"Kolling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J\u00e9r\u00f4me","family":"Sallet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2023,1,30]]},"reference":[{"issue":"7095","key":"pbio.3001985.ref001","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1038\/nature04766","article-title":"Cortical substrates for exploratory decisions in humans","volume":"441","author":"ND Daw","year":"2006","journal-title":"Nature"},{"issue":"2","key":"pbio.3001985.ref002","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1016\/j.neuron.2017.12.007","article-title":"Exploration Disrupts Choice-Predictive Signals and Alters Dynamics in Prefrontal Cortex","volume":"97","author":"RB Ebitz","year":"2018","journal-title":"Neuron"},{"key":"pbio.3001985.ref003","author":"CJCH Watkins","year":"1989","journal-title":"Learning from delayed rewards"},{"issue":"3\/4","key":"pbio.3001985.ref004","doi-asserted-by":"crossref","first-page":"285","DOI":"10.2307\/2332286","article-title":"On the Likelihood that One Unknown Probability Exceeds Another in View of the Evidence of Two Samples","volume":"25","author":"WR Thompson","year":"1933","journal-title":"Biometrika"},{"key":"pbio.3001985.ref005","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/978-3-642-76153-9_28","volume-title":"Neurocomputing","author":"JS Bridle","year":"1990"},{"issue":"1","key":"pbio.3001985.ref006","doi-asserted-by":"crossref","first-page":"e1001048","DOI":"10.1371\/journal.pcbi.1001048","article-title":"Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings","volume":"7","author":"E Payzan-LeNestour","year":"2011","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"pbio.3001985.ref007","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/j.neuron.2019.05.017","article-title":"Subcortical Substrates of Explore-Exploit Decisions in Primates","volume":"103","author":"VD Costa","year":"2019","journal-title":"Neuron"},{"issue":"12","key":"pbio.3001985.ref008","doi-asserted-by":"crossref","first-page":"2553","DOI":"10.1523\/JNEUROSCI.2355-19.2020","article-title":"Primate Orbitofrontal Cortex Codes Information Relevant for Managing Explore\u2013Exploit Tradeoffs","volume":"40","author":"VD Costa","year":"2020","journal-title":"J Neurosci"},{"issue":"11","key":"pbio.3001985.ref009","doi-asserted-by":"crossref","first-page":"1869","DOI":"10.1016\/j.neuron.2022.03.014","article-title":"The neurocomputational bases of explore-exploit decision-making","volume":"110","author":"J Hogeveen","year":"2022","journal-title":"Neuron"},{"issue":"3","key":"pbio.3001985.ref010","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1016\/j.neuron.2011.12.025","article-title":"Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven Exploration","volume":"73","author":"D Badre","year":"2012","journal-title":"Neuron"},{"issue":"11","key":"pbio.3001985.ref011","doi-asserted-by":"crossref","first-page":"2575","DOI":"10.1093\/cercor\/bhr332","article-title":"Frontal Theta Reflects Uncertainty and Unexpectedness during Exploration and Exploitation","volume":"22","author":"JF Cavanagh","year":"2012","journal-title":"Cereb Cortex"},{"issue":"6","key":"pbio.3001985.ref012","doi-asserted-by":"crossref","first-page":"2074","DOI":"10.1037\/a0038199","article-title":"Humans Use Directed and Random Exploration to Solve the Explore\u2013Exploit Dilemma","volume":"143","author":"RC Wilson","year":"2014","journal-title":"J Exp Psychol Gen"},{"issue":"4","key":"pbio.3001985.ref013","doi-asserted-by":"crossref","first-page":"e0176034","DOI":"10.1371\/journal.pone.0176034","article-title":"The effect of atomoxetine on random and directed exploration in humans","volume":"12","author":"CM Warren","year":"2017","journal-title":"PLoS ONE"},{"key":"pbio.3001985.ref014","article-title":"A causal role for right frontopolar cortex in directed, but not random, exploration","volume":"6","author":"WK Zajkowski","year":"2018","journal-title":"Elife"},{"key":"pbio.3001985.ref015","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.cobeha.2020.10.001","article-title":"Balancing exploration and exploitation with information and randomization","volume":"38","author":"RC Wilson","year":"2021","journal-title":"Curr Opin Behav Sci"},{"key":"pbio.3001985.ref016","doi-asserted-by":"crossref","first-page":"117685","DOI":"10.1016\/j.neuroimage.2020.117685","article-title":"Imaging evolution of the primate brain: the next frontier?","volume":"228","author":"P Friedrich","year":"2021","journal-title":"Neuroimage"},{"issue":"20","key":"pbio.3001985.ref017","doi-asserted-by":"crossref","first-page":"E2695","DOI":"10.1073\/pnas.1410767112","article-title":"Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex","volume":"112","author":"FX Neubert","year":"2015","journal-title":"PNAS"},{"issue":"30","key":"pbio.3001985.ref018","doi-asserted-by":"crossref","first-page":"12255","DOI":"10.1523\/JNEUROSCI.5108-12.2013","article-title":"The Organization of Dorsal Frontal Cortex in Humans and Macaques","volume":"33","author":"J Sallet","year":"2013","journal-title":"J Neurosci"},{"issue":"12","key":"pbio.3001985.ref019","doi-asserted-by":"crossref","first-page":"2066","DOI":"10.1038\/s41593-019-0518-9","article-title":"Computational noise in reward-guided learning drives behavioral variability in volatile environments","volume":"22","author":"C Findling","year":"2019","journal-title":"Nat Neurosci"},{"issue":"1","key":"pbio.3001985.ref020","doi-asserted-by":"crossref","first-page":"8096","DOI":"10.1038\/ncomms9096","article-title":"Contextual modulation of value signals in reward and punishment learning","volume":"6","author":"S Palminteri","year":"2015","journal-title":"Nat Commun"},{"issue":"8","key":"pbio.3001985.ref021","doi-asserted-by":"crossref","first-page":"e1005684","DOI":"10.1371\/journal.pcbi.1005684","article-title":"Confirmation bias in human reinforcement learning: Evidence from counterfactual feedback processing","volume":"13","author":"S Palminteri","year":"2017","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pbio.3001985.ref022","doi-asserted-by":"crossref","first-page":"4503","DOI":"10.1038\/s41467-018-06781-2","article-title":"Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences","volume":"9","author":"S Bavard","year":"2018","journal-title":"Nat Commun"},{"issue":"16","key":"pbio.3001985.ref023","doi-asserted-by":"crossref","first-page":"3268","DOI":"10.1523\/JNEUROSCI.1712-19.2020","article-title":"The Effect of Counterfactual Information on Outcome Value Coding in Medial Prefrontal and Cingulate Cortex: From an Absolute to a Relative Neural Code","volume":"40","author":"D Pischedda","year":"2020","journal-title":"J Neurosci"},{"issue":"50","key":"pbio.3001985.ref024","doi-asserted-by":"crossref","first-page":"10619","DOI":"10.1523\/JNEUROSCI.1539-18.2018","article-title":"Functional MRI in Macaque Monkeys during Task Switching","volume":"38","author":"E Premereur","year":"2018","journal-title":"J Neurosci"},{"issue":"5559","key":"pbio.3001985.ref025","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1126\/science.1067653","article-title":"Functional MRI of Macaque Monkeys Performing a Cognitive Set-Shifting Task","volume":"295","author":"K Nakahara","year":"2002","journal-title":"Science"},{"issue":"2","key":"pbio.3001985.ref026","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1016\/j.neuroimage.2008.12.009","article-title":"BOLD fMRI activation for anti-saccades in nonhuman primates","volume":"45","author":"KA Ford","year":"2009","journal-title":"Neuroimage"},{"issue":"5","key":"pbio.3001985.ref027","doi-asserted-by":"crossref","first-page":"2739","DOI":"10.1093\/cercor\/bhw113","article-title":"Learned Value Shapes Responses to Objects in Frontal and Ventral Stream Networks in Macaque Monkeys","volume":"27","author":"PM Kaskan","year":"2017","journal-title":"Cereb Cortex"},{"issue":"5","key":"pbio.3001985.ref028","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1038\/s41593-019-0375-6","article-title":"The macaque anterior cingulate cortex translates counterfactual choice value into actual behavioral change","volume":"22","author":"EF Fouragnan","year":"2019","journal-title":"Nat Neurosci"},{"issue":"10","key":"pbio.3001985.ref029","doi-asserted-by":"crossref","first-page":"e3000899","DOI":"10.1371\/journal.pbio.3000899","article-title":"Multiple systems in macaques for tracking prediction errors and other types of surprise","volume":"18","author":"J Grohn","year":"2020","journal-title":"PLoS Biol"},{"issue":"4","key":"pbio.3001985.ref030","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1016\/j.neuron.2011.03.026","article-title":"Distributed Coding of Actual and Hypothetical Outcomes in the Orbital and Dorsolateral Prefrontal Cortex","volume":"70","author":"H Abe","year":"2011","journal-title":"Neuron"},{"issue":"5929","key":"pbio.3001985.ref031","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1126\/science.1168488","article-title":"Fictive Reward Signals in the Anterior Cingulate Cortex","volume":"324","author":"BY Hayden","year":"2009","journal-title":"Science"},{"issue":"45","key":"pbio.3001985.ref032","doi-asserted-by":"crossref","first-page":"28452","DOI":"10.1073\/pnas.2000759117","article-title":"Differential functional connectivity underlying asymmetric reward-related activity in human and nonhuman primates","volume":"117","author":"A Lopez-Persem","year":"2020","journal-title":"Proc Natl Acad Sci"},{"issue":"3","key":"pbio.3001985.ref033","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/j.neuron.2008.02.021","article-title":"Value Representations in the Primate Striatum during Matching Behavior","volume":"58","author":"B Lau","year":"2008","journal-title":"Neuron"},{"issue":"10","key":"pbio.3001985.ref034","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1038\/s41593-018-0239-5","article-title":"Triple dissociation of attention and decision computations across prefrontal cortex","volume":"21","author":"LT Hunt","year":"2018","journal-title":"Nat Neurosci"},{"issue":"22","key":"pbio.3001985.ref035","doi-asserted-by":"crossref","first-page":"3814","DOI":"10.1016\/j.cub.2019.09.027","article-title":"Economic Decisions through Circuit Inhibition","volume":"29","author":"S Ballesta","year":"2019","journal-title":"Curr Biol"},{"issue":"9","key":"pbio.3001985.ref036","first-page":"4463","article-title":"Three-Dimensional Digital Template Atlas of the Macaque Brain","volume":"27","author":"C Reveley","year":"2017","journal-title":"Cereb Cortex"},{"issue":"11","key":"pbio.3001985.ref037","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1111\/j.1460-9568.2010.07465.x","article-title":"Quantitative demonstration of comparable architectonic areas within the ventromedial and lateral orbital frontal cortex in the human and the macaque monkey brains","volume":"32","author":"S Mackey","year":"2010","journal-title":"Eur J Neurosci"},{"issue":"4","key":"pbio.3001985.ref038","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s10071-004-0215-1","article-title":"Rhesus monkeys (Macaca mulatta) discriminate between knowing and not knowing and collect information as needed before acting","volume":"7","author":"RR Hampton","year":"2004","journal-title":"Anim Cogn"},{"issue":"4","key":"pbio.3001985.ref039","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1037\/a0039595","article-title":"Rhesus monkeys (Macaca mulatta) adaptively adjust information seeking in response to information accumulated","volume":"129","author":"HW Tu","year":"2015","journal-title":"J Comp Psychol"},{"issue":"1","key":"pbio.3001985.ref040","doi-asserted-by":"crossref","first-page":"45267","DOI":"10.1038\/srep45267","article-title":"Checking behavior in rhesus monkeys is related to anxiety and frontal activity","volume":"7","author":"M Bosc","year":"2017","journal-title":"Sci Rep"},{"issue":"5","key":"pbio.3001985.ref041","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.1016\/j.neuron.2018.08.018","article-title":"Prospection, Perseverance, and Insight in Sequential Behavior","volume":"99","author":"N Kolling","year":"2018","journal-title":"Neuron"},{"issue":"5","key":"pbio.3001985.ref042","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1038\/74880","article-title":"Anterior cingulate activity during routine and non-routine sequential behaviors in macaques","volume":"3","author":"E Procyk","year":"2000","journal-title":"Nat Neurosci"},{"key":"pbio.3001985.ref043","doi-asserted-by":"crossref","first-page":"eaaz1002","DOI":"10.1126\/sciadv.aaz1002","article-title":"Recursive sequence generation in monkeys, children, U.S. adults, and native Amazonians","volume":"6","author":"S Ferrigno","year":"2020","journal-title":"Sci Adv"},{"issue":"38","key":"pbio.3001985.ref044","doi-asserted-by":"crossref","first-page":"eabh2392","DOI":"10.1126\/sciadv.abh2392","article-title":"Social prediction modulates activity of macaque superior temporal cortex","volume":"7","author":"L Roumazeilles","year":"2021","journal-title":"Sci Adv"},{"key":"pbio.3001985.ref045","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cognition.2019.03.009","article-title":"Monkeys are curious about counterfactual outcomes","volume":"189","author":"MZ Wang","year":"2019","journal-title":"Cognition"},{"issue":"7","key":"pbio.3001985.ref046","doi-asserted-by":"crossref","first-page":"995","DOI":"10.1038\/nn.3740","article-title":"Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task","volume":"17","author":"AP Steiner","year":"2014","journal-title":"Nat Neurosci"},{"issue":"7","key":"pbio.3001985.ref047","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1038\/nn.2856","article-title":"Neuronal basis of sequential foraging decisions in a patchy environment","volume":"14","author":"BY Hayden","year":"2011","journal-title":"Nat Neurosci"},{"issue":"6077","key":"pbio.3001985.ref048","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1126\/science.1216930","article-title":"Neural Mechanisms of Foraging","volume":"336","author":"N Kolling","year":"2012","journal-title":"Science"},{"key":"pbio.3001985.ref049","article-title":"Increased locus coeruleus tonic activity causes disengagement from a patch-foraging task","author":"GA Kane","year":"2017","journal-title":"Cogn Affect Behav Neurosci"},{"issue":"5392","key":"pbio.3001985.ref050","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1126\/science.282.5392.1335","article-title":"Role for Cingulate Motor Area Cells in Voluntary Movement Selection Based on Reward","volume":"282","author":"K Shima","year":"1998","journal-title":"Science"},{"issue":"7","key":"pbio.3001985.ref051","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1038\/nn1724","article-title":"Optimal decision making and the anterior cingulate cortex","volume":"9","author":"SW Kennerley","year":"2006","journal-title":"Nat Neurosci"},{"issue":"2","key":"pbio.3001985.ref052","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.neuron.2007.11.031","article-title":"Behavioral shifts and action valuation in the anterior cingulate cortex","volume":"57","author":"R Quilodran","year":"2008","journal-title":"Neuron"},{"issue":"3","key":"pbio.3001985.ref053","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1016\/j.neuroimage.2012.06.023","article-title":"Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration","volume":"63","author":"C Amiez","year":"2012","journal-title":"Neuroimage"},{"issue":"2","key":"pbio.3001985.ref054","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1523\/JNEUROSCI.1338-21.2021","article-title":"A One-Shot Shift from Explore to Exploit in Monkey Prefrontal Cortex","volume":"42","author":"J Achterberg","year":"2022","journal-title":"J Neurosci"},{"key":"pbio.3001985.ref055","doi-asserted-by":"crossref","first-page":"11990","DOI":"10.1038\/ncomms11990","article-title":"Specific frontal neural dynamics contribute to decisions to check","volume":"7","author":"FM Stoll","year":"2016","journal-title":"Nat Commun"},{"issue":"2","key":"pbio.3001985.ref056","first-page":"467","article-title":"Midcingulate Motor Map and Feedback Detection: Converging Data from Humans and Monkeys","volume":"26","author":"E Procyk","year":"2016","journal-title":"Cereb Cortex"},{"issue":"10","key":"pbio.3001985.ref057","doi-asserted-by":"crossref","first-page":"2061","DOI":"10.1111\/j.1460-9568.2009.06743.x","article-title":"Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables","volume":"29","author":"SW Kennerley","year":"2009","journal-title":"Eur J Neurosci"},{"issue":"5","key":"pbio.3001985.ref058","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1523\/JNEUROSCI.4920-12.2013","article-title":"Choice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making","volume":"33","author":"CH Luk","year":"2013","journal-title":"J Neurosci"},{"issue":"50","key":"pbio.3001985.ref059","doi-asserted-by":"crossref","first-page":"21767","DOI":"10.1073\/pnas.0908104107","article-title":"How the brain integrates costs and benefits during decision making","volume":"107","author":"U Basten","year":"2010","journal-title":"PNAS"},{"issue":"20","key":"pbio.3001985.ref060","doi-asserted-by":"crossref","first-page":"9430","DOI":"10.1073\/pnas.1001732107","article-title":"A mechanistic account of value computation in the human brain","volume":"107","author":"MG Philiastides","year":"2010","journal-title":"PNAS"},{"issue":"6507","key":"pbio.3001985.ref061","doi-asserted-by":"crossref","first-page":"eabb0184","DOI":"10.1126\/science.abb0184","article-title":"Neural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex","volume":"369","author":"P Domenech","year":"2020","journal-title":"Science"},{"issue":"9","key":"pbio.3001985.ref062","doi-asserted-by":"crossref","first-page":"3197","DOI":"10.1093\/cercor\/bhu114","article-title":"Behavioral Regulation and the Modulation of Information Coding in the Lateral Prefrontal and Cingulate Cortex","volume":"25","author":"M Khamassi","year":"2015","journal-title":"Cereb Cortex"},{"key":"pbio.3001985.ref063","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1146\/annurev.neuro.28.061604.135709","article-title":"An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance","volume":"28","author":"G Aston-Jones","year":"2005","journal-title":"Annu Rev Neurosci"},{"issue":"9","key":"pbio.3001985.ref064","doi-asserted-by":"crossref","first-page":"2687","DOI":"10.1007\/s00213-018-4963-z","article-title":"Dual contributions of noradrenaline to behavioural flexibility and motivation","volume":"235","author":"CI Jahn","year":"2018","journal-title":"Psychopharmacology (Berl)"},{"issue":"1","key":"pbio.3001985.ref065","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.cell.2014.08.037","article-title":"Behavioral variability through stochastic choice and its gating by anterior cingulate cortex","volume":"159","author":"DGR Tervo","year":"2014","journal-title":"Cell"},{"issue":"5306","key":"pbio.3001985.ref066","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A Neural Substrate of Prediction and Reward","volume":"275","author":"W Schultz","year":"1997","journal-title":"Science"},{"issue":"5","key":"pbio.3001985.ref067","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1038\/nn1890","article-title":"Medial prefrontal cell activity signaling prediction errors of action values","volume":"10","author":"M Matsumoto","year":"2007","journal-title":"Nat Neurosci"},{"issue":"5936","key":"pbio.3001985.ref068","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1126\/science.1172377","article-title":"Dissociable Components of Rule-Guided Behavior Depend on Distinct Medial and Prefrontal Regions","volume":"325","author":"MJ Buckley","year":"2009","journal-title":"Science"},{"issue":"12","key":"pbio.3001985.ref069","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1038\/nn.2961","article-title":"Double dissociation of value computations in orbitofrontal and anterior cingulate neurons","volume":"14","author":"SW Kennerley","year":"2011","journal-title":"Nat Neurosci"},{"issue":"6","key":"pbio.3001985.ref070","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1016\/j.neuron.2014.10.049","article-title":"The Orbitofrontal Oracle: Cortical Mechanisms for the Prediction and Evaluation of Specific Behavioral Outcomes","volume":"84","author":"PH Rudebeck","year":"2014","journal-title":"Neuron"},{"issue":"34","key":"pbio.3001985.ref071","doi-asserted-by":"crossref","first-page":"7540","DOI":"10.1523\/JNEUROSCI.1921-04.2004","article-title":"Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency","volume":"24","author":"A Izquierdo","year":"2004","journal-title":"J Neurosci"},{"issue":"47","key":"pbio.3001985.ref072","doi-asserted-by":"crossref","first-page":"20547","DOI":"10.1073\/pnas.1012246107","article-title":"Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex","volume":"107","author":"MP Noonan","year":"2010","journal-title":"Proc Natl Acad Sci"},{"issue":"6","key":"pbio.3001985.ref073","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1016\/j.neuron.2010.02.027","article-title":"Separable Learning Systems in the Macaque Brain and the Role of Orbitofrontal Cortex in Contingent Learning","volume":"65","author":"ME Walton","year":"2010","journal-title":"Neuron"},{"issue":"51","key":"pbio.3001985.ref074","doi-asserted-by":"crossref","first-page":"eabg7700","DOI":"10.1126\/sciadv.abg7700","article-title":"Ultrasound modulation of macaque prefrontal cortex selectively alters credit assignment\u2013related activity and behavior","volume":"7","author":"D Folloni","journal-title":"Sci Adv"},{"issue":"9","key":"pbio.3001985.ref075","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1038\/nn1514","article-title":"Regret and its avoidance: a neuroimaging study of choice behavior","volume":"8","author":"G Coricelli","year":"2005","journal-title":"Nat Neurosci"},{"key":"pbio.3001985.ref076","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.neuroimage.2013.11.051","article-title":"Neural systems for choice and valuation with counterfactual learning signals","volume":"89","author":"MJ Tobia","year":"2014","journal-title":"Neuroimage"},{"issue":"5674","key":"pbio.3001985.ref077","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1126\/science.1094550","article-title":"The Involvement of the Orbitofrontal Cortex in the Experience of Regret","volume":"304","author":"N Camille","year":"2004","journal-title":"Science"},{"issue":"39","key":"pbio.3001985.ref078","doi-asserted-by":"crossref","first-page":"12315","DOI":"10.1523\/JNEUROSCI.2575-09.2009","article-title":"Evidence for a Common Representation of Decision Values for Dissimilar Goods in Human Ventromedial Prefrontal Cortex","volume":"29","author":"VS Chib","year":"2009","journal-title":"J Neurosci"},{"issue":"6","key":"pbio.3001985.ref079","doi-asserted-by":"crossref","first-page":"2242","DOI":"10.1523\/JNEUROSCI.3022-12.2013","article-title":"Ventromedial Prefrontal and Anterior Cingulate Cortex Adopt Choice and Default Reference Frames during Sequential Multi-Alternative Choice","volume":"33","author":"ED Boorman","year":"2013","journal-title":"J Neurosci"},{"key":"pbio.3001985.ref080","doi-asserted-by":"crossref","first-page":"e20317","DOI":"10.7554\/eLife.20317","article-title":"How prior preferences determine decision-making frames and biases in the human brain","volume":"5","author":"A Lopez-Persem","year":"2016","journal-title":"Elife"},{"key":"pbio.3001985.ref081","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v080.i01","article-title":"brms: An R Package for Bayesian Multilevel Models Using Stan","volume":"80","author":"PC B\u00fcrkner","year":"2017","journal-title":"J Stat Softw"},{"key":"pbio.3001985.ref082","author":"Stan Development Team","year":"2021","journal-title":"Stan Modeling Language Users Guide and Reference Manual"},{"issue":"7849","key":"pbio.3001985.ref083","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1038\/s41586-020-03115-5","article-title":"Activation and disruption of a neural mechanism for novel choice in monkeys","volume":"591","author":"A Bongioanni","year":"2021","journal-title":"Nature"},{"issue":"2","key":"pbio.3001985.ref084","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.neuron.2019.10.030","article-title":"A Basal Forebrain-Cingulate Circuit in Macaques Decides It Is Time to Act","volume":"105","author":"N Khalighinejad","year":"2020","journal-title":"Neuron"},{"issue":"18","key":"pbio.3001985.ref085","doi-asserted-by":"crossref","first-page":"6240","DOI":"10.1523\/JNEUROSCI.0257-12.2012","article-title":"Connectivity-Based Parcellation of the Human Orbitofrontal Cortex","volume":"32","author":"T Kahnt","year":"2012","journal-title":"J Neurosci"},{"key":"pbio.3001985.ref086","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.jchemneu.2019.01.002","article-title":"Distinct regional patterns in noradrenergic innervation of the rat prefrontal cortex","volume":"96","author":"JC Cerpa","year":"2019","journal-title":"J Chem Neuroanat"},{"issue":"8","key":"pbio.3001985.ref087","doi-asserted-by":"crossref","first-page":"2336","DOI":"10.1002\/hbm.20667","article-title":"Receptor architecture of human cingulate cortex: evaluation of the four-region neurobiological model","volume":"30","author":"N Palomero-Gallagher","year":"2009","journal-title":"Hum Brain Mapp"},{"issue":"5","key":"pbio.3001985.ref088","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/j.tins.2020.03.007","article-title":"Where is Cingulate Cortex? A Cross-Species View","volume":"43","author":"S van Heukelum","year":"2020","journal-title":"Trends Neurosci"}],"updated-by":[{"DOI":"10.1371\/journal.pbio.3001985","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T00:00:00Z","timestamp":1675900800000}}],"container-title":["PLOS Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pbio.3001985","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T13:58:57Z","timestamp":1675951137000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pbio.3001985"}},"subtitle":[],"editor":[{"given":"Thorsten","family":"Kahnt","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,1,30]]},"references-count":88,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1,30]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pbio.3001985","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.05.11.491468","asserted-by":"object"}]},"ISSN":["1545-7885"],"issn-type":[{"value":"1545-7885","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,30]]}}}