{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T06:16:45Z","timestamp":1772605005357,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012228","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T00:00:00Z","timestamp":1722384000000}}],"reference-count":82,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T00:00:00Z","timestamp":1720137600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["178833530"],"award-info":[{"award-number":["178833530"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["178833530"],"award-info":[{"award-number":["178833530"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["402170461"],"award-info":[{"award-number":["402170461"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["402170461"],"award-info":[{"award-number":["402170461"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["402170461"],"award-info":[{"award-number":["402170461"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006114","name":"S\u00e4chsisches Staatsministerium f\u00fcr Wissenschaft und Kunst","doi-asserted-by":"publisher","award":["390696704"],"award-info":[{"award-number":["390696704"]}],"id":[{"id":"10.13039\/501100006114","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>In cognitive neuroscience and psychology, reaction times are an important behavioral measure. However, in instrumental learning and goal-directed decision making experiments, findings often rely only on choice probabilities from a value-based model, instead of reaction times. Recent advancements have shown that it is possible to connect value-based decision models with reaction time models. However, typically these models do not provide an integrated account of both value-based choices and reaction times, but simply link two types of models. Here, we propose a novel integrative joint model of both choices and reaction times by combining a computational account of Bayesian sequential decision making with a sampling procedure. This allows us to describe how internal uncertainty in the planning process shapes reaction time distributions. Specifically, we use a recent context-specific Bayesian forward planning model which we extend by a Markov chain Monte Carlo (MCMC) sampler to obtain both choices and reaction times. As we will show this makes the sampler an integral part of the decision making process and enables us to reproduce, using simulations, well-known experimental findings in value based-decision making as well as classical inhibition and switching tasks. Specifically, we use the proposed model to explain both choice behavior and reaction times in instrumental learning and automatized behavior, in the Eriksen flanker task and in task switching. These findings show that the proposed joint behavioral model may describe common underlying processes in these different decision making paradigms.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012228","type":"journal-article","created":{"date-parts":[[2024,7,5]],"date-time":"2024-07-05T13:49:56Z","timestamp":1720187396000},"page":"e1012228","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["Joint modeling of choices and reaction times based on Bayesian contextual behavioral control"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5232-5729","authenticated-orcid":true,"given":"Sarah","family":"Schw\u00f6bel","sequence":"first","affiliation":[]},{"given":"Dimitrije","family":"Markovi\u0107","sequence":"additional","affiliation":[]},{"given":"Michael N.","family":"Smolka","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5052-1117","authenticated-orcid":true,"given":"Stefan","family":"Kiebel","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2024,7,5]]},"reference":[{"issue":"S1","key":"pcbi.1012228.ref001","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1002\/mpr.1410","article-title":"Dysfunctions of decision-making and cognitive control as transdiagnostic mechanisms of mental disorders: advances, gaps, and needs in current research","volume":"23","author":"T Goschke","year":"2014","journal-title":"International journal of methods in psychiatric research"},{"issue":"3","key":"pcbi.1012228.ref002","doi-asserted-by":"crossref","first-page":"e13016","DOI":"10.1111\/psyp.13016","article-title":"Dynamics of cognitive control: Theoretical bases, paradigms, and a view for the future","volume":"55","author":"G Gratton","year":"2018","journal-title":"Psychophysiology"},{"issue":"3","key":"pcbi.1012228.ref003","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1111\/psyp.12518","article-title":"The NIMH research domain criteria initiative: background, issues, and pragmatics","volume":"53","author":"MJ Kozak","year":"2016","journal-title":"Psychophysiology"},{"issue":"4","key":"pcbi.1012228.ref004","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1037\/0096-3445.121.4.480","article-title":"Optimizing the use of information: strategic control of activation of responses","volume":"121","author":"G Gratton","year":"1992","journal-title":"Journal of Experimental Psychology: General"},{"issue":"3","key":"pcbi.1012228.ref005","doi-asserted-by":"crossref","first-page":"409","DOI":"10.2478\/v10053-008-0005-4","article-title":"Conditional accuracy in response interference tasks: Evidence from the Eriksen flanker task and the spatial conflict task","volume":"3","author":"JF Stins","year":"2007","journal-title":"Advances in cognitive psychology"},{"issue":"5","key":"pcbi.1012228.ref006","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1037\/a0019842","article-title":"Control and interference in task switching\u2014A review","volume":"136","author":"A Kiesel","year":"2010","journal-title":"Psychological bulletin"},{"issue":"3","key":"pcbi.1012228.ref007","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/S1364-6613(03)00028-7","article-title":"Task switching","volume":"7","author":"S Monsell","year":"2003","journal-title":"Trends in cognitive sciences"},{"issue":"6","key":"pcbi.1012228.ref008","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.1016\/j.neuron.2011.02.027","article-title":"Model-based influences on humans\u2019 choices and striatal prediction errors","volume":"69","author":"ND Daw","year":"2011","journal-title":"Neuron"},{"issue":"5","key":"pcbi.1012228.ref009","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1016\/j.neuron.2014.01.033","article-title":"Multiple neural mechanisms of decision making and their competition under changing risk pressure","volume":"81","author":"N Kolling","year":"2014","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1012228.ref010","doi-asserted-by":"crossref","first-page":"7692","DOI":"10.1038\/s41598-023-33274-0","article-title":"Shorter planning depth and higher response noise during sequential decision-making in old age","volume":"13","author":"J Steffen","year":"2023","journal-title":"Scientific Reports"},{"issue":"6","key":"pcbi.1012228.ref011","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1017\/S1930297500001285","article-title":"The drift diffusion model can account for value-based choice response times under high and low time pressure","volume":"5","author":"M Milosavljevic","year":"2010","journal-title":"Judgment and Decision Making"},{"issue":"1","key":"pcbi.1012228.ref012","doi-asserted-by":"crossref","first-page":"12400","DOI":"10.1038\/ncomms12400","article-title":"Optimal policy for value-based decision-making","volume":"7","author":"S Tajima","year":"2016","journal-title":"Nature communications"},{"issue":"4","key":"pcbi.1012228.ref013","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.3758\/s13423-016-1199-y","article-title":"The drift diffusion model as the choice rule in reinforcement learning","volume":"24","author":"ML Pedersen","year":"2017","journal-title":"Psychonomic bulletin & review"},{"issue":"4","key":"pcbi.1012228.ref014","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.3758\/s13423-018-1554-2","article-title":"A reinforcement learning diffusion decision model for value-based decisions","volume":"26","author":"L Fontanesi","year":"2019","journal-title":"Psychonomic bulletin & review"},{"issue":"2","key":"pcbi.1012228.ref015","doi-asserted-by":"crossref","first-page":"e1006803","DOI":"10.1371\/journal.pcbi.1006803","article-title":"Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling","volume":"15","author":"Consortium N","year":"2019","journal-title":"PLoS computational biology"},{"key":"pcbi.1012228.ref016","doi-asserted-by":"crossref","first-page":"e63055","DOI":"10.7554\/eLife.63055","article-title":"A new model of decision processing in instrumental learning tasks","volume":"10","author":"S Mileti\u0107","year":"2021","journal-title":"Elife"},{"issue":"2","key":"pcbi.1012228.ref017","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1037\/0033-295X.85.2.59","article-title":"A theory of memory retrieval","volume":"85","author":"R Ratcliff","year":"1978","journal-title":"Psychological review"},{"key":"pcbi.1012228.ref018","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4939-2236-9","volume-title":"An introduction to model-based cognitive neuroscience","author":"BU Forstmann","year":"2015"},{"issue":"4","key":"pcbi.1012228.ref019","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1177\/0963721412447619","article-title":"Bridging levels of analysis for probabilistic models of cognition","volume":"21","author":"TL Griffiths","year":"2012","journal-title":"Current Directions in Psychological Science"},{"issue":"12","key":"pcbi.1012228.ref020","doi-asserted-by":"crossref","first-page":"e1005186","DOI":"10.1371\/journal.pcbi.1005186","article-title":"The Hamiltonian brain: Efficient probabilistic inference with excitatory-inhibitory neural circuit dynamics","volume":"12","author":"L Aitchison","year":"2016","journal-title":"PLoS computational biology"},{"key":"pcbi.1012228.ref021","doi-asserted-by":"crossref","first-page":"e253","DOI":"10.1017\/S0140525X16001837","article-title":"Building machines that learn and think like people","volume":"40","author":"BM Lake","year":"2017","journal-title":"Behavioral and brain sciences"},{"key":"pcbi.1012228.ref022","first-page":"11662","article-title":"Deep active inference agents using Monte-Carlo methods","volume":"33","author":"Z Fountas","year":"2020","journal-title":"Advances in neural information processing systems"},{"key":"pcbi.1012228.ref023","article-title":"Interpreting neural response variability as Monte Carlo sampling of the posterior","volume":"15","author":"P Hoyer","year":"2002","journal-title":"Advances in neural information processing systems"},{"issue":"2","key":"pcbi.1012228.ref024","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1016\/j.neuron.2016.09.038","article-title":"Neural variability and sampling-based probabilistic representations in the visual cortex","volume":"92","author":"G Orb\u00e1n","year":"2016","journal-title":"Neuron"},{"issue":"9","key":"pcbi.1012228.ref025","doi-asserted-by":"crossref","first-page":"1138","DOI":"10.1038\/s41593-020-0671-1","article-title":"Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference","volume":"23","author":"R Echeveste","year":"2020","journal-title":"Nature neuroscience"},{"issue":"6013","key":"pcbi.1012228.ref026","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1126\/science.1195870","article-title":"Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment","volume":"331","author":"P Berkes","year":"2011","journal-title":"Science"},{"issue":"5","key":"pcbi.1012228.ref027","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1523\/JNEUROSCI.2854-15.2016","article-title":"Goal-directed decision making with spiking neurons","volume":"36","author":"J Friedrich","year":"2016","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1012228.ref028","article-title":"Resourceful Event-Predictive Inference: The Nature of Cognitive Effort","author":"MV Butz","year":"2022","journal-title":"The Editor\u2019s Challenge: Cognitive Resources"},{"key":"pcbi.1012228.ref029","doi-asserted-by":"crossref","first-page":"108562","DOI":"10.1016\/j.neuropsychologia.2023.108562","article-title":"Cognitive effort and active inference","volume":"184","author":"T Parr","year":"2023","journal-title":"Neuropsychologia"},{"key":"pcbi.1012228.ref030","doi-asserted-by":"crossref","first-page":"102472","DOI":"10.1016\/j.jmp.2020.102472","article-title":"Balancing control: a Bayesian interpretation of habitual and goal-directed behavior","volume":"100","author":"S Schw\u00f6bel","year":"2021","journal-title":"Journal of Mathematical Psychology"},{"key":"pcbi.1012228.ref031","first-page":"9","volume-title":"International workshop on artificial intelligence and statistics","author":"H Attias","year":"2003"},{"issue":"10","key":"pcbi.1012228.ref032","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/j.tics.2012.08.006","article-title":"Planning as inference","volume":"16","author":"M Botvinick","year":"2012","journal-title":"Trends in cognitive sciences"},{"issue":"1","key":"pcbi.1012228.ref033","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1162\/NECO_a_00912","article-title":"Active inference: a process theory","volume":"29","author":"K Friston","year":"2017","journal-title":"Neural computation"},{"key":"pcbi.1012228.ref034","doi-asserted-by":"crossref","first-page":"102447","DOI":"10.1016\/j.jmp.2020.102447","article-title":"Active inference on discrete state-spaces: A synthesis","volume":"99","author":"L Da Costa","year":"2020","journal-title":"Journal of Mathematical Psychology"},{"issue":"3","key":"pcbi.1012228.ref035","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1162\/neco_a_01357","article-title":"Active inference: demystified and compared","volume":"33","author":"N Sajid","year":"2021","journal-title":"Neural computation"},{"key":"pcbi.1012228.ref036","doi-asserted-by":"crossref","first-page":"102632","DOI":"10.1016\/j.jmp.2021.102632","article-title":"A step-by-step tutorial on active inference and its application to empirical data","volume":"107","author":"R Smith","year":"2022","journal-title":"Journal of mathematical psychology"},{"key":"pcbi.1012228.ref037","doi-asserted-by":"crossref","first-page":"862","DOI":"10.1016\/j.neubiorev.2016.06.022","article-title":"Active inference and learning","volume":"68","author":"K Friston","year":"2016","journal-title":"Neuroscience & Biobehavioral Reviews"},{"issue":"4","key":"pcbi.1012228.ref038","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/17588928.2015.1020053","article-title":"Active inference and epistemic value","volume":"6","author":"K Friston","year":"2015","journal-title":"Cognitive neuroscience"},{"issue":"9","key":"pcbi.1012228.ref039","doi-asserted-by":"crossref","first-page":"2530","DOI":"10.1162\/neco_a_01108","article-title":"Active inference, belief propagation, and the bethe approximation","volume":"30","author":"S Schw\u00f6bel","year":"2018","journal-title":"Neural computation"},{"key":"pcbi.1012228.ref040","doi-asserted-by":"crossref","first-page":"35","DOI":"10.3389\/fnhum.2019.00035","article-title":"Proactive information sampling in value-based decision-making: Deciding when and where to saccade","volume":"13","author":"M Song","year":"2019","journal-title":"Frontiers in human neuroscience"},{"issue":"4","key":"pcbi.1012228.ref041","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.tics.2016.01.007","article-title":"Diffusion decision model: Current issues and history","volume":"20","author":"R Ratcliff","year":"2016","journal-title":"Trends in cognitive sciences"},{"key":"pcbi.1012228.ref042","doi-asserted-by":"crossref","first-page":"102","DOI":"10.3389\/fnhum.2014.00102","article-title":"Perceptual decision making: drift-diffusion model is equivalent to a Bayesian model","volume":"8","author":"S Bitzer","year":"2014","journal-title":"Frontiers in human neuroscience"},{"key":"pcbi.1012228.ref043","doi-asserted-by":"crossref","first-page":"29","DOI":"10.3389\/fncom.2017.00029","article-title":"A Bayesian reformulation of the extended drift-diffusion model in perceptual decision making","volume":"11","author":"PR Fard","year":"2017","journal-title":"Frontiers in computational neuroscience"},{"issue":"4","key":"pcbi.1012228.ref044","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1037\/0033-295X.113.4.700","article-title":"The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks","volume":"113","author":"R Bogacz","year":"2006","journal-title":"Psychological review"},{"issue":"6","key":"pcbi.1012228.ref045","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1162\/089976602753712972","article-title":"Multiple model-based reinforcement learning","volume":"14","author":"K Doya","year":"2002","journal-title":"Neural computation"},{"key":"pcbi.1012228.ref046","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.neunet.2019.10.011","article-title":"A complementary learning systems approach to temporal difference learning","volume":"122","author":"S Blakeman","year":"2020","journal-title":"Neural Networks"},{"issue":"2","key":"pcbi.1012228.ref047","first-page":"489","article-title":"A test of Bayesian observer models of processing in the Eriksen flanker task","volume":"38","author":"CN White","year":"2012","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"issue":"1","key":"pcbi.1012228.ref048","doi-asserted-by":"crossref","first-page":"121","DOI":"10.3758\/PBR.16.1.121","article-title":"Sequential dependencies in the Eriksen flanker task: A direct comparison of two competing accounts","volume":"16","author":"EJ Davelaar","year":"2009","journal-title":"Psychonomic bulletin & review"},{"issue":"36","key":"pcbi.1012228.ref049","doi-asserted-by":"crossref","first-page":"17735","DOI":"10.1073\/pnas.1906788116","article-title":"A large-scale analysis of task switching practice effects across the lifespan","volume":"116","author":"M Steyvers","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1012228.ref050","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/B978-0-12-397025-1.00250-5","article-title":"Task switching processes","volume":"3","author":"S Jamadar","year":"2015","journal-title":"Brain mapping: An encyclopedic reference"},{"issue":"2","key":"pcbi.1012228.ref051","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1037\/0096-3445.124.2.207","article-title":"Costs of a predictible switch between simple cognitive tasks","volume":"124","author":"RD Rogers","year":"1995","journal-title":"Journal of experimental psychology: General"},{"key":"pcbi.1012228.ref052","first-page":"442","article-title":"Automaticity in situ: Direct context cuing of habits in daily life","volume":"2","author":"DT Neal","year":"2007","journal-title":"Psychology of action"},{"issue":"3","key":"pcbi.1012228.ref053","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1037\/0033-295X.108.3.624","article-title":"Conflict monitoring and cognitive control","volume":"108","author":"MM Botvinick","year":"2001","journal-title":"Psychological review"},{"issue":"1","key":"pcbi.1012228.ref054","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1006\/cogp.1999.0734","article-title":"The unity and diversity of executive functions and their contributions to complex \u201cfrontal lobe\u201d tasks: A latent variable analysis","volume":"41","author":"A Miyake","year":"2000","journal-title":"Cognitive psychology"},{"issue":"1","key":"pcbi.1012228.ref055","doi-asserted-by":"crossref","first-page":"e1006707","DOI":"10.1371\/journal.pcbi.1006707","article-title":"Predicting change: Approximate inference under explicit representation of temporal structure in changing environments","volume":"15","author":"D Markovi\u0107","year":"2019","journal-title":"PLoS computational biology"},{"issue":"4","key":"pcbi.1012228.ref056","doi-asserted-by":"crossref","first-page":"e1006043","DOI":"10.1371\/journal.pcbi.1006043","article-title":"Rational metareasoning and the plasticity of cognitive control","volume":"14","author":"F Lieder","year":"2018","journal-title":"PLoS computational biology"},{"key":"pcbi.1012228.ref057","doi-asserted-by":"crossref","first-page":"750","DOI":"10.3758\/s13423-012-0257-3","article-title":"Observation: Three reasons to avoid having half of the trials be congruent in a four-alternative forced-choice experiment on sequential modulation","volume":"19","author":"JT Mordkoff","year":"2012","journal-title":"Psychonomic bulletin & review"},{"issue":"2","key":"pcbi.1012228.ref058","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1037\/0033-295X.114.2.376","article-title":"Inhibitory control in mind and brain: an interactive race model of countermanding saccades","volume":"114","author":"L Boucher","year":"2007","journal-title":"Psychological review"},{"key":"pcbi.1012228.ref059","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1146\/annurev-psych-122414-033645","article-title":"Sequential sampling models in cognitive neuroscience: Advantages, applications, and extensions","volume":"67","author":"BU Forstmann","year":"2016","journal-title":"Annual review of psychology"},{"key":"pcbi.1012228.ref060","volume-title":"Optimal stopping rules","author":"AN Shiryaev","year":"2007"},{"issue":"7","key":"pcbi.1012228.ref061","doi-asserted-by":"crossref","first-page":"1786","DOI":"10.1162\/neco.2010.12-08-930","article-title":"Decision confidence and uncertainty in diffusion models with partially correlated neuronal integrators","volume":"22","author":"R Moreno-Bote","year":"2010","journal-title":"Neural computation"},{"key":"pcbi.1012228.ref062","doi-asserted-by":"crossref","first-page":"971","DOI":"10.3758\/s13423-017-1340-6","article-title":"Time-varying decision boundaries: insights from optimality analysis","volume":"25","author":"G Malhotra","year":"2018","journal-title":"Psychonomic bulletin & review"},{"issue":"9","key":"pcbi.1012228.ref063","doi-asserted-by":"crossref","first-page":"1503","DOI":"10.1038\/s41593-019-0453-9","article-title":"Optimal policy for multi-alternative decisions","volume":"22","author":"S Tajima","year":"2019","journal-title":"Nature neuroscience"},{"issue":"12","key":"pcbi.1012228.ref064","doi-asserted-by":"crossref","first-page":"e1002294","DOI":"10.1371\/journal.pcbi.1002294","article-title":"Probabilistic inference in general graphical models through sampling in stochastic networks of spiking neurons","volume":"7","author":"D Pecevski","year":"2011","journal-title":"PLoS computational biology"},{"issue":"12","key":"pcbi.1012228.ref065","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1016\/j.tics.2016.10.003","article-title":"Bayesian brains without probabilities","volume":"20","author":"AN Sanborn","year":"2016","journal-title":"Trends in cognitive sciences"},{"issue":"1","key":"pcbi.1012228.ref066","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s43586-020-00001-2","article-title":"Bayesian statistics and modelling","volume":"1","author":"R van de Schoot","year":"2021","journal-title":"Nature Reviews Methods Primers"},{"issue":"1","key":"pcbi.1012228.ref067","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TCIAIG.2012.2186810","article-title":"A survey of monte carlo tree search methods","volume":"4","author":"CB Browne","year":"2012","journal-title":"IEEE Transactions on Computational Intelligence and AI in games"},{"issue":"2","key":"pcbi.1012228.ref068","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s10489-012-0416-2","article-title":"Monte-Carlo tree search for Bayesian reinforcement learning","volume":"39","author":"NA Vien","year":"2013","journal-title":"Applied intelligence"},{"key":"pcbi.1012228.ref069","doi-asserted-by":"crossref","DOI":"10.3389\/fnhum.2013.00598","article-title":"The anatomy of choice: active inference and agency","volume":"7","author":"K Friston","year":"2013","journal-title":"Frontiers in human neuroscience"},{"key":"pcbi.1012228.ref070","doi-asserted-by":"crossref","first-page":"1212549","DOI":"10.3389\/fnins.2023.1212549","article-title":"Self-regulation learning as active inference: dynamic causal modeling of an fMRI neurofeedback task","volume":"17","author":"G Vargas","year":"2023","journal-title":"Frontiers in Neuroscience"},{"key":"pcbi.1012228.ref071","article-title":"Active inference: A process theory","author":"K Friston","year":"2017","journal-title":"Neural computation"},{"key":"pcbi.1012228.ref072","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.pneurobio.2015.09.001","article-title":"Active inference, homeostatic regulation and adaptive behavioural control","volume":"134","author":"G Pezzulo","year":"2015","journal-title":"Progress in neurobiology"},{"issue":"1","key":"pcbi.1012228.ref073","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1038\/s41598-018-38246-3","article-title":"Neuronal message passing using Mean-field, Bethe, and Marginal approximations","volume":"9","author":"T Parr","year":"2019","journal-title":"Scientific reports"},{"key":"pcbi.1012228.ref074","article-title":"The graphical brain: belief propagation and active inference","author":"KJ Friston","year":"2017","journal-title":"Network Neuroscience"},{"key":"pcbi.1012228.ref075","first-page":"105473","article-title":"The empirical status of predictive coding and active inference","author":"R Hodson","year":"2023","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"pcbi.1012228.ref076","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/12441.001.0001","volume-title":"Active inference: the free energy principle in mind, brain, and behavior","author":"T Parr","year":"2022"},{"issue":"1","key":"pcbi.1012228.ref077","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1162\/neco.2008.20.1.91","article-title":"Bayesian spiking neurons I: inference","volume":"20","author":"S Deneve","year":"2008","journal-title":"Neural computation"},{"issue":"9","key":"pcbi.1012228.ref078","doi-asserted-by":"crossref","first-page":"2502","DOI":"10.1162\/neco.2009.08-08-837","article-title":"Belief propagation in networks of spiking neurons","volume":"21","author":"A Steimer","year":"2009","journal-title":"Neural Computation"},{"key":"pcbi.1012228.ref079","article-title":"Neurons as Monte Carlo Samplers: Bayesian Inference and Learning in Spiking Networks","volume":"27","author":"Y Huang","year":"2014","journal-title":"Advances in neural information processing systems"},{"key":"pcbi.1012228.ref080","volume-title":"Reinforcement learning: An introduction","author":"RS Sutton","year":"2018"},{"key":"pcbi.1012228.ref081","doi-asserted-by":"crossref","unstructured":"Tschantz A, Baltieri M, Seth AK, Buckley CL. Scaling active inference. In: 2020 international joint conference on neural networks (ijcnn). IEEE; 2020. p. 1\u20138.","DOI":"10.1109\/IJCNN48605.2020.9207382"},{"key":"pcbi.1012228.ref082","doi-asserted-by":"crossref","first-page":"574372","DOI":"10.3389\/fncom.2020.574372","article-title":"Learning generative state space models for active inference","volume":"14","author":"O \u00c7atal","year":"2020","journal-title":"Frontiers in Computational Neuroscience"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012228","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T00:00:00Z","timestamp":1722384000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012228","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,31]],"date-time":"2024-07-31T16:10:22Z","timestamp":1722442222000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012228"}},"subtitle":[],"editor":[{"given":"Tianming","family":"Yang","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2024,7,5]]},"references-count":82,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,7,5]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012228","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.10.29.466505","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,5]]}}}