{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T05:45:11Z","timestamp":1772516711231,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1013025","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000}}],"reference-count":70,"publisher":"Public Library of Science (PLoS)","issue":"4","license":[{"start":{"date-parts":[[2025,4,22]],"date-time":"2025-04-22T00:00:00Z","timestamp":1745280000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004462","name":"Consiglio Nazionale delle Ricerche","doi-asserted-by":"publisher","award":["DUS.AD016.135"],"award-info":[{"award-number":["DUS.AD016.135"]}],"id":[{"id":"10.13039\/501100004462","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell\u2019Istruzione, dell\u2019Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["PRIN 2022, grant N\u00b0 20227MPSEH"],"award-info":[{"award-number":["PRIN 2022, grant N\u00b0 20227MPSEH"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell\u2019Istruzione, dell\u2019Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["PRIN 2022, grant N\u00b0 20227MPSEH"],"award-info":[{"award-number":["PRIN 2022, grant N\u00b0 20227MPSEH"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["NWO 406.XS.04.129"],"award-info":[{"award-number":["NWO 406.XS.04.129"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"name":"European Research Council","award":["820213"],"award-info":[{"award-number":["820213"]}]},{"name":"Italian National Recovery and Resilience Plan \/European Union \u2013 NextGenerationEU","award":["Project IR0000011, CUP B51E22000150006, \u201cEBRAINS-Italy\u201d; Project PE0000013, \u201cFAIR\u201d; Project PE0000006, \u201cMNESYS\u201d"],"award-info":[{"award-number":["Project IR0000011, CUP B51E22000150006, \u201cEBRAINS-Italy\u201d; Project PE0000013, \u201cFAIR\u201d; Project PE0000006, \u201cMNESYS\u201d"]}]},{"name":"Ministry of University and Research","award":["PRIN PNRR P20224FESY and PRIN 20229Z7M8N"],"award-info":[{"award-number":["PRIN PNRR P20224FESY and PRIN 20229Z7M8N"]}]},{"name":"European Union - NextGenerationEU - PNRR","award":["MUR code IR0000011, CUP B51E22000150006, project \u2018EBRAINS-Italy - European Brain ReseArch INfrastructureS Italy"],"award-info":[{"award-number":["MUR code IR0000011, CUP B51E22000150006, project \u2018EBRAINS-Italy - European Brain ReseArch INfrastructureS Italy"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>The role of the dorsal anterior cingulate cortex (dACC) in cognition is a frequently studied yet highly debated topic in neuroscience. Most authors agree that the dACC is involved in either cognitive control (e.g., voluntary inhibition of automatic responses) or monitoring (e.g., comparing expectations with outcomes, detecting errors, tracking surprise). A consensus on which theoretical perspective best explains dACC contribution to behaviour is still lacking, as two distinct sets of studies report dACC activation in tasks requiring surprise tracking for performance monitoring and cognitive control without involving surprise monitoring, respectively. This creates a theoretical impasse, as no single current account can reconcile these findings. Here we propose a novel hypothesis on dACC function that integrates both the monitoring and the cognitive control perspectives in a unifying, meta-Reinforcement Learning framework, in which cognitive control is optimized by meta-learning based on tracking Bayesian surprise. We tested the quantitative predictions from our theory in three different functional neuroimaging experiments at the basis of the current theory crisis. We show that the meta-Reinforcement Learning perspective successfully captures all the neuroimaging results by predicting both cognitive control and monitoring functions, proposing a solution to the theory crisis about dACC function within an integrative framework. In sum, our results suggest that dACC function can be framed as a meta-learning optimisation of cognitive control, providing an integrative perspective on its roles in cognitive control, surprise tracking, and performance monitoring.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1013025","type":"journal-article","created":{"date-parts":[[2025,4,22]],"date-time":"2025-04-22T13:35:38Z","timestamp":1745328938000},"page":"e1013025","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":8,"title":["Meta-Reinforcement Learning reconciles surprise, value, and control in the anterior cingulate cortex"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-8419-8938","authenticated-orcid":true,"given":"Tim","family":"Vriens","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5761-6813","authenticated-orcid":true,"given":"Eliana","family":"Vassena","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Pezzulo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gianluca","family":"Baldassarre","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2925-0615","authenticated-orcid":true,"given":"Massimo","family":"Silvetti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2025,4,22]]},"reference":[{"issue":"4","key":"pcbi.1013025.ref001","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1037\/a0020198","article-title":"Decision making and the avoidance of cognitive demand","volume":"139","author":"W Kool","year":"2010","journal-title":"J Exp Psychol Gen"},{"issue":"1","key":"pcbi.1013025.ref002","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.coph.2004.09.004","article-title":"Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine","volume":"5","author":"JD Salamone","year":"2005","journal-title":"Curr Opin Pharmacol"},{"issue":"3","key":"pcbi.1013025.ref003","doi-asserted-by":"crossref","first-page":"e91008","DOI":"10.1371\/journal.pone.0091008","article-title":"Overlapping neural systems represent cognitive effort and reward anticipation","volume":"9","author":"E Vassena","year":"2014","journal-title":"PLoS One"},{"issue":"3","key":"pcbi.1013025.ref004","doi-asserted-by":"crossref","first-page":"619","DOI":"10.3758\/s13415-018-00685-w","article-title":"Task-specific prioritization of reward and effort information: Novel insights from behavior and computational modeling","volume":"19","author":"E Vassena","year":"2019","journal-title":"Cogn Affect Behav Neurosci"},{"key":"pcbi.1013025.ref005","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1196\/annals.1390.009","article-title":"Calculating the cost of acting in frontal cortex","author":"ME Walton","year":"2007","journal-title":"Ann N Y Acad Sci"},{"key":"pcbi.1013025.ref006","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1146\/annurev-neuro-070815-013952","article-title":"Dorsal anterior cingulate cortex: a bottom-up view","volume":"39","author":"SR Heilbronner","year":"2016","journal-title":"Annu Rev Neurosci"},{"issue":"4","key":"pcbi.1013025.ref007","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/nn2066","article-title":"Choice, uncertainty and value in prefrontal and cingulate cortex","volume":"11","author":"MFS Rushworth","year":"2008","journal-title":"Nat Neurosci"},{"issue":"10","key":"pcbi.1013025.ref008","doi-asserted-by":"crossref","first-page":"1338","DOI":"10.1038\/nn.2921","article-title":"Medial prefrontal cortex as an action-outcome predictor","volume":"14","author":"WH Alexander","year":"2011","journal-title":"Nat Neurosci"},{"issue":"3","key":"pcbi.1013025.ref009","first-page":"473","article-title":"Selection, integration, and conflict monitoring; assessing the nature and generality of prefrontal cognitive control mechanisms","volume":"41","author":"D Badre","year":"2004","journal-title":"Neuron"},{"issue":"9","key":"pcbi.1013025.ref010","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1038\/nn1954","article-title":"Learning the value of information in an uncertain world","volume":"10","author":"TEJ Behrens","year":"2007","journal-title":"Nat Neurosci"},{"issue":"3","key":"pcbi.1013025.ref011","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1037\/0033-295X.108.3.624","article-title":"Conflict monitoring and cognitive control","volume":"108","author":"MM Botvinick","year":"2001","journal-title":"Psychol Rev"},{"issue":"4","key":"pcbi.1013025.ref012","doi-asserted-by":"crossref","first-page":"356","DOI":"10.3758\/CABN.7.4.356","article-title":"Conflict monitoring and decision making: reconciling two perspectives on anterior cingulate function","volume":"7","author":"MM Botvinick","year":"2007","journal-title":"Cogn Affect Behav Neurosci"},{"issue":"10","key":"pcbi.1013025.ref013","doi-asserted-by":"crossref","first-page":"1280","DOI":"10.1038\/nn.4382","article-title":"Value, search, persistence and model updating in anterior cingulate cortex","volume":"19","author":"N Kolling","year":"2016","journal-title":"Nat Neurosci"},{"issue":"9","key":"pcbi.1013025.ref014","doi-asserted-by":"crossref","first-page":"R37-47","DOI":"10.1097\/00001756-199806220-00001","article-title":"Regional differences in the effects of task difficulty and motor output on blood flow response in the human anterior cingulate cortex: a review of 107 PET activation studies","volume":"9","author":"T Paus","year":"1998","journal-title":"Neuroreport"},{"issue":"6","key":"pcbi.1013025.ref015","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1016\/j.neuron.2011.05.014","article-title":"Frontal cortex and reward-guided learning and decision-making","volume":"70","author":"MFS Rushworth","year":"2011","journal-title":"Neuron"},{"issue":"3","key":"pcbi.1013025.ref016","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1038\/nrn2994","article-title":"The integration of negative affect, pain and cognitive control in the cingulate cortex","volume":"12","author":"AJ Shackman","year":"2011","journal-title":"Nat Rev Neurosci"},{"issue":"9","key":"pcbi.1013025.ref017","doi-asserted-by":"crossref","first-page":"1249","DOI":"10.1038\/nn.3771","article-title":"Anterior cingulate engagement in a foraging context reflects choice difficulty, not foraging value","volume":"17","author":"A Shenhav","year":"2014","journal-title":"Nat Neurosci"},{"key":"pcbi.1013025.ref018","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.neuropsychologia.2014.04.019","article-title":"Dissociating contributions of ACC and vmPFC in reward prediction, outcome, and choice","volume":"59","author":"E Vassena","year":"2014","journal-title":"Neuropsychologia"},{"key":"pcbi.1013025.ref019","doi-asserted-by":"crossref","first-page":"316","DOI":"10.3389\/fnins.2017.00316","article-title":"Computational models of anterior cingulate cortex: at the crossroads between prediction and effort","volume":"11","author":"E Vassena","year":"2017","journal-title":"Front Neurosci"},{"issue":"10","key":"pcbi.1013025.ref020","doi-asserted-by":"crossref","first-page":"1278","DOI":"10.1038\/nn.4387","article-title":"Dorsal anterior cingulate: a Rorschach test for cognitive neuroscience","volume":"19","author":"RB Ebitz","year":"2016","journal-title":"Nat Neurosci"},{"issue":"2","key":"pcbi.1013025.ref021","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.neuron.2013.07.007","article-title":"The expected value of control: an integrative theory of anterior cingulate cortex function","volume":"79","author":"A Shenhav","year":"2013","journal-title":"Neuron"},{"key":"pcbi.1013025.ref022","doi-asserted-by":"crossref","first-page":"75","DOI":"10.3389\/fnhum.2011.00075","article-title":"Value and prediction error in medial frontal cortex: integrating the single-unit and systems levels of analysis","volume":"5","author":"M Silvetti","year":"2011","journal-title":"Front Hum Neurosci"},{"key":"pcbi.1013025.ref023","doi-asserted-by":"crossref","first-page":"57","DOI":"10.3389\/fnbeh.2015.00057","article-title":"Adaptive effort investment in cognitive and physical tasks: a neurocomputational model","volume":"9","author":"T Verguts","year":"2015","journal-title":"Front Behav Neurosci"},{"issue":"2","key":"pcbi.1013025.ref024","doi-asserted-by":"crossref","first-page":"e1002598","DOI":"10.1371\/journal.pbio.1002598","article-title":"Neurocomputational mechanisms underlying subjective valuation of effort costs","volume":"15","author":"TT-J Chong","year":"2017","journal-title":"PLoS Biol"},{"issue":"4","key":"pcbi.1013025.ref025","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1037\/rev0000372","article-title":"An integrative effort: Bridging motivational intensity theory and recent neurocomputational and neuronal models of effort and control allocation","volume":"130","author":"N Silvestrini","year":"2023","journal-title":"Psychol Rev"},{"key":"pcbi.1013025.ref026","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.neubiorev.2013.11.003","article-title":"From conflict management to reward-based decision making: actors and critics in primate medial frontal cortex","volume":"46 Pt 1","author":"M Silvetti","year":"2014","journal-title":"Neurosci Biobehav Rev"},{"issue":"1","key":"pcbi.1013025.ref027","doi-asserted-by":"crossref","first-page":"2485","DOI":"10.1038\/s41467-018-04841-1","article-title":"Dissociable neural mechanisms track evidence accumulation for selection of attention versus action","volume":"9","author":"A Shenhav","year":"2018","journal-title":"Nat Commun"},{"issue":"4","key":"pcbi.1013025.ref028","doi-asserted-by":"crossref","first-page":"e1006043","DOI":"10.1371\/journal.pcbi.1006043","article-title":"Rational metareasoning and the plasticity of cognitive control","volume":"14","author":"F Lieder","year":"2018","journal-title":"PLoS Comput Biol"},{"issue":"14","key":"pcbi.1013025.ref029","doi-asserted-by":"crossref","first-page":"4531","DOI":"10.1523\/JNEUROSCI.4515-08.2009","article-title":"Effort-based cost-benefit valuation and the human brain","volume":"29","author":"PL Croxson","year":"2009","journal-title":"J Neurosci"},{"key":"pcbi.1013025.ref030","doi-asserted-by":"crossref","first-page":"140","DOI":"10.3389\/fnhum.2013.00140","article-title":"Brain and effort: brain activation and effort-related working memory in healthy participants and patients with working memory deficits","volume":"7","author":"M Engstr\u00f6m","year":"2013","journal-title":"Front Hum Neurosci"},{"key":"pcbi.1013025.ref031","first-page":"1071","article-title":"Evidence of conjoint activation of the anterior insular and cingulate cortices during effortful tasks","volume":"8","author":"M Engstr\u00f6m","year":"2015","journal-title":"Front Hum Neurosci"},{"issue":"4","key":"pcbi.1013025.ref032","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1038\/s41562-019-0801-5","article-title":"Surprise, value and control in anterior cingulate cortex during speeded decision-making","volume":"4","author":"E Vassena","year":"2020","journal-title":"Nat Hum Behav"},{"issue":"10","key":"pcbi.1013025.ref033","doi-asserted-by":"crossref","first-page":"1633","DOI":"10.1162\/jocn_a_01160","article-title":"Predicting motivation: computational models of PFC can explain neural coding of motivation and effort-based decision-making in health and disease","volume":"29","author":"E Vassena","year":"2017","journal-title":"J Cogn Neurosci"},{"issue":"12","key":"pcbi.1013025.ref034","doi-asserted-by":"crossref","first-page":"4826","DOI":"10.1093\/brain\/awad263","article-title":"Debates on the dorsomedial prefrontal\/dorsal anterior cingulate cortex: insights for future research","volume":"146","author":"N Clairis","year":"2023","journal-title":"Brain"},{"issue":"6077","key":"pcbi.1013025.ref035","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1126\/science.1216930","article-title":"Neural mechanisms of foraging","volume":"336","author":"N Kolling","year":"2012","journal-title":"Science"},{"issue":"10","key":"pcbi.1013025.ref036","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.1162\/jocn_a_01140","article-title":"Foraging value, risk avoidance, and multiple control signals: how the anterior cingulate cortex controls value-based decision-making","volume":"29","author":"JW Brown","year":"2017","journal-title":"J Cogn Neurosci"},{"issue":"8","key":"pcbi.1013025.ref037","doi-asserted-by":"crossref","first-page":"e1006370","DOI":"10.1371\/journal.pcbi.1006370","article-title":"Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner","volume":"14","author":"M Silvetti","year":"2018","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1013025.ref038","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.neunet.2022.10.004","article-title":"A Reinforcement Meta-Learning framework of executive function and information demand","volume":"157","author":"M Silvetti","year":"2023","journal-title":"Neural Networks"},{"key":"pcbi.1013025.ref039","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1016\/B978-0-444-62604-2.00022-8","article-title":"Medial prefrontal cortex and the adaptive regulation of reinforcement learning parameters","volume":"202","author":"M Khamassi","year":"2013","journal-title":"Prog Brain Res"},{"issue":"4\u20136","key":"pcbi.1013025.ref040","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/S0893-6080(02)00044-8","article-title":"Metalearning and neuromodulation","volume":"15","author":"K Doya","year":"2002","journal-title":"Neural Netw"},{"issue":"1","key":"pcbi.1013025.ref041","doi-asserted-by":"crossref","first-page":"275","DOI":"10.3233\/JAD-200276","article-title":"Computational modeling of catecholamines dysfunction in Alzheimer\u2019s disease at pre-plaque stage","volume":"77","author":"D Caligiore","year":"2020","journal-title":"J Alzheimers Dis"},{"issue":"2","key":"pcbi.1013025.ref042","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1177\/1362361320962237","article-title":"Autistic traits are related to worse performance in a volatile reward learning task despite adaptive learning rates","volume":"25","author":"J Goris","year":"2021","journal-title":"Autism"},{"key":"pcbi.1013025.ref043","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/978-3-030-18830-6_12","article-title":"A computational hypothesis on how serotonin regulates catecholamines in the pathogenesis of depressive apathy.","volume-title":"Multiscale models of brain disorders","author":"M Silvetti","year":"2019"},{"issue":"5","key":"pcbi.1013025.ref044","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1093\/sleep\/32.5.681","article-title":"Working memory in 8 Kleine-Levin syndrome patients: an fMRI study","volume":"32","author":"M Engstr\u00f6m","year":"2009","journal-title":"Sleep"},{"key":"pcbi.1013025.ref045","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.cortex.2023.10.004","article-title":"Temperament and probabilistic predictive coding in visual-spatial attention","volume":"171","author":"S Lasaponara","year":"2024","journal-title":"Cortex"},{"issue":"6","key":"pcbi.1013025.ref046","doi-asserted-by":"crossref","first-page":"2305","DOI":"10.1002\/hbm.23173","article-title":"Differential involvement of brainstem noradrenergic and midbrain dopaminergic nuclei in cognitive control","volume":"37","author":"S K\u00f6hler","year":"2016","journal-title":"Hum Brain Mapp"},{"issue":"2","key":"pcbi.1013025.ref047","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.tins.2015.12.009","article-title":"Computational psychiatry of ADHD: neural gain impairments across marrian levels of analysis","volume":"39","author":"TU Hauser","year":"2016","journal-title":"Trends Neurosci"},{"key":"pcbi.1013025.ref048","doi-asserted-by":"crossref","first-page":"e59907","DOI":"10.7554\/eLife.59907","article-title":"Human complex exploration strategies are enriched by noradrenaline-modulated heuristics","volume":"10","author":"M Dubois","year":"2021","journal-title":"Elife"},{"issue":"32","key":"pcbi.1013025.ref049","doi-asserted-by":"crossref","first-page":"7170","DOI":"10.1523\/JNEUROSCI.0192-18.2018","article-title":"Beta-blocker propranolol modulates decision urgency during sequential information gathering","volume":"38","author":"TU Hauser","year":"2018","journal-title":"J Neurosci"},{"issue":"1","key":"pcbi.1013025.ref050","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"RE Kalman","year":"1960","journal-title":"Journal of Basic Engineering"},{"issue":"2","key":"pcbi.1013025.ref051","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1037\/0033-295X.85.2.59","article-title":"A theory of memory retrieval.","volume":"85","author":"R Ratcliff","year":"1978","journal-title":"Psychological Review"},{"issue":"3","key":"pcbi.1013025.ref052","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1037\/0033-295X.108.3.550","article-title":"The time course of perceptual choice: the leaky, competing accumulator model","volume":"108","author":"M Usher","year":"2001","journal-title":"Psychol Rev"},{"issue":"11","key":"pcbi.1013025.ref053","doi-asserted-by":"crossref","first-page":"1728","DOI":"10.1162\/089892905774589271","article-title":"FROST: a distributed neurocomputational model of working memory maintenance","volume":"17","author":"FG Ashby","year":"2005","journal-title":"J Cogn Neurosci"},{"issue":"1","key":"pcbi.1013025.ref054","doi-asserted-by":"crossref","first-page":"192","DOI":"10.3758\/BF03206482","article-title":"AIC model selection using Akaike weights","volume":"11","author":"E-J Wagenmakers","year":"2004","journal-title":"Psychon Bull Rev"},{"issue":"44","key":"pcbi.1013025.ref055","doi-asserted-by":"crossref","first-page":"11379","DOI":"10.1523\/JNEUROSCI.1640-06.2006","article-title":"Choosing the lesser of two evils, the better of two goods: specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice","volume":"26","author":"K Blair","year":"2006","journal-title":"J Neurosci"},{"key":"pcbi.1013025.ref056","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.neuroimage.2013.02.063","article-title":"The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value","volume":"76","author":"O Bartra","year":"2013","journal-title":"Neuroimage"},{"issue":"28","key":"pcbi.1013025.ref057","doi-asserted-by":"crossref","first-page":"5580","DOI":"10.1523\/JNEUROSCI.1795-21.2022","article-title":"Value, confidence, deliberation: a functional partition of the medial prefrontal cortex demonstrated across rating and choice tasks","volume":"42","author":"N Clairis","year":"2022","journal-title":"J Neurosci"},{"issue":"17","key":"pcbi.1013025.ref058","doi-asserted-by":"crossref","first-page":"e1176232024","DOI":"10.1523\/JNEUROSCI.1176-23.2024","article-title":"Value estimation versus effort mobilization: a general dissociation between ventromedial and dorsomedial prefrontal cortex","volume":"44","author":"N Clairis","year":"2024","journal-title":"J Neurosci"},{"issue":"12","key":"pcbi.1013025.ref059","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1038\/nn.2961","article-title":"Double dissociation of value computations in orbitofrontal and anterior cingulate neurons","volume":"14","author":"SW Kennerley","year":"2011","journal-title":"Nat Neurosci"},{"issue":"6593","key":"pcbi.1013025.ref060","doi-asserted-by":"crossref","first-page":"eabm9922","DOI":"10.1126\/science.abm9922","article-title":"The geometry of domain-general performance monitoring in the human medial frontal cortex","volume":"376","author":"Z Fu","year":"2022","journal-title":"Science"},{"issue":"4","key":"pcbi.1013025.ref061","doi-asserted-by":"crossref","first-page":"625","DOI":"10.3758\/BF03196322","article-title":"Six views of embodied cognition","volume":"9","author":"M Wilson","year":"2002","journal-title":"Psychon Bull Rev"},{"key":"pcbi.1013025.ref062","volume-title":"Behavioral and cognitive robotics: an adaptive perspective","author":"S Nolfi","year":"2021"},{"key":"pcbi.1013025.ref063","doi-asserted-by":"crossref","first-page":"985","DOI":"10.3389\/fpsyg.2014.00985","article-title":"Intrinsic motivations and open-ended development in animals, humans, and robots: an overview","volume":"5","author":"G Baldassarre","year":"2014","journal-title":"Front Psychol"},{"key":"pcbi.1013025.ref064","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-32375-1","volume-title":"Intrinsically motivated learning in natural and artificial systems","author":"G Baldassarre","year":"2013"},{"key":"pcbi.1013025.ref065","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"2014"},{"key":"pcbi.1013025.ref066","volume-title":"Misdirected vigor: differentiating the control of value from the value of control","author":"A Shenhav","year":"2020"},{"key":"pcbi.1013025.ref067","volume-title":"Selective application of theory does not replace formal model tests: a reply to Shenhav et al","author":"W Alexander","year":"2020"},{"issue":"4","key":"pcbi.1013025.ref068","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/17588928.2015.1020053","article-title":"Active inference and epistemic value","volume":"6","author":"K Friston","year":"2015","journal-title":"Cogn Neurosci"},{"key":"pcbi.1013025.ref069","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.pneurobio.2015.09.001","article-title":"Active Inference, homeostatic regulation and adaptive behavioural control","volume":"134","author":"G Pezzulo","year":"2015","journal-title":"Prog Neurobiol"},{"key":"pcbi.1013025.ref070","doi-asserted-by":"crossref","first-page":"108562","DOI":"10.1016\/j.neuropsychologia.2023.108562","article-title":"Cognitive effort and active inference","volume":"184","author":"T Parr","year":"2023","journal-title":"Neuropsychologia"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1013025","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013025","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T13:48:39Z","timestamp":1746193719000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013025"}},"subtitle":[],"editor":[{"given":"Tobias U","family":"Hauser","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2025,4,22]]},"references-count":70,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,4,22]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1013025","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.05.15.592711","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,22]]}}}