{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T06:11:26Z","timestamp":1772172686226,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1007579","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2020,12,18]],"date-time":"2020-12-18T00:00:00Z","timestamp":1608249600000}}],"reference-count":82,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2020,12,8]],"date-time":"2020-12-08T00:00:00Z","timestamp":1607385600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-11-IDEX-0001-02"],"award-info":[{"award-number":["ANR-11-IDEX-0001-02"]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-18-CE28-0016-01"],"award-info":[{"award-number":["ANR-18-CE28-0016-01"]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020","doi-asserted-by":"crossref","award":["713010"],"award-info":[{"award-number":["713010"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020","doi-asserted-by":"crossref","award":["713010"],"award-info":[{"award-number":["713010"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>In mammals, goal-directed and planning processes support flexible behaviour used to face new situations that cannot be tackled through more efficient but rigid habitual behaviours. Within the Bayesian modelling approach of brain and behaviour, models have been proposed to perform planning as probabilistic inference but this approach encounters a crucial problem: explaining how such inference might be implemented in brain spiking networks. Recently, the literature has proposed some models that face this problem through recurrent spiking neural networks able to internally simulate state trajectories, the core function at the basis of planning. However, the proposed models have relevant limitations that make them biologically implausible, namely their world model is trained \u2018off-line\u2019 before solving the target tasks, and they are trained with supervised learning procedures that are biologically and ecologically not plausible. Here we propose two novel hypotheses on how brain might overcome these problems, and operationalise them in a novel architecture pivoting on a spiking recurrent neural network. The first hypothesis allows the architecture to learn the world model in parallel with its use for planning: to this purpose, a new arbitration mechanism decides when to explore, for learning the world model, or when to exploit it, for planning, based on the entropy of the world model itself. The second hypothesis allows the architecture to use an unsupervised learning process to learn the world model by observing the effects of actions. The architecture is validated by reproducing and accounting for the learning profiles and reaction times of human participants learning to solve a visuomotor learning task that is new for them. Overall, the architecture represents the first instance of a model bridging probabilistic planning and spiking-processes that has a degree of autonomy analogous to the one of real organisms.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1007579","type":"journal-article","created":{"date-parts":[[2020,12,8]],"date-time":"2020-12-08T16:23:51Z","timestamp":1607444631000},"page":"e1007579","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":9,"title":["A generative spiking neural-network model of goal-directed behaviour and one-step planning"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4776-596X","authenticated-orcid":true,"given":"Ruggero","family":"Basanisi","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5342-1330","authenticated-orcid":true,"given":"Andrea","family":"Brovelli","sequence":"additional","affiliation":[]},{"given":"Emilio","family":"Cartoni","sequence":"additional","affiliation":[]},{"given":"Gianluca","family":"Baldassarre","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2020,12,8]]},"reference":[{"issue":"1","key":"pcbi.1007579.ref001","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3758\/BF03199951","article-title":"Motivational control of goal-directed action","volume":"22","author":"A Dickinson","year":"1994","journal-title":"Animal Learning & Behavior"},{"issue":"4","key":"pcbi.1007579.ref002","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/S0028-3908(98)00033-1","article-title":"Goal-directed instrumental action: contingency and incentive learning and their cortical substrates","volume":"37","author":"BW Balleine","year":"1998","journal-title":"Neuropharmacology"},{"issue":"2","key":"pcbi.1007579.ref003","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.neuron.2013.09.007","article-title":"Goals and Habits in the Brain","volume":"80","author":"R Dolan","year":"2013","journal-title":"Neuron"},{"key":"pcbi.1007579.ref004","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"1998"},{"key":"pcbi.1007579.ref005","doi-asserted-by":"crossref","unstructured":"Sutton RS. Integrated architectures for learning, planning, and reacting based on approximating dynamic programming. In: Proceedings of the seventh international conference on machine learning. Vol. 216; 1990. p. 216\u2013224.","DOI":"10.1016\/B978-1-55860-141-3.50030-4"},{"key":"pcbi.1007579.ref006","unstructured":"Baldassarre G. Planning with neural networks and reinforcement learning [PhD Thesis]. Computer Science Department, University of Essex. Colchester, UK; 2002."},{"key":"pcbi.1007579.ref007","first-page":"179","volume-title":"Anticipatory behaviour in adaptive learning systems. Vol. 2684 of Lecture Notes in Artificial Intelligence","author":"G Baldassarre","year":"2003"},{"issue":"3","key":"pcbi.1007579.ref008","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.cognition.2008.08.011","article-title":"Hierarchically organized behavior and its neural foundations: A reinforcement-learning perspective","volume":"113","author":"MM Botvinick","year":"2008","journal-title":"Cognition"},{"key":"pcbi.1007579.ref009","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cobeha.2015.06.001","article-title":"Hierarchical control of goal-directed action in the cortical\u2013basal ganglia network","volume":"5","author":"BW Balleine","year":"2015","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"pcbi.1007579.ref010","doi-asserted-by":"crossref","DOI":"10.3389\/fnbeh.2013.00135","article-title":"The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis","volume":"7","author":"F Mannella","year":"2013","journal-title":"Frontiers in Behavioral Neuroscience"},{"key":"pcbi.1007579.ref011","volume-title":"Artificial Intelligence: A Modern Approach","author":"SJ Russell","year":"2003"},{"key":"pcbi.1007579.ref012","doi-asserted-by":"crossref","DOI":"10.4324\/9781351001885","volume-title":"The artificial life route to artificial intelligence: Building embodied, situated agents","author":"L Steels","year":"2018"},{"issue":"2","key":"pcbi.1007579.ref013","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.neuron.2011.05.042","article-title":"A neural signature of hierarchical reinforcement learning","volume":"71","author":"JJF Ribas-Fernandes","year":"2011","journal-title":"Neuron"},{"issue":"2","key":"pcbi.1007579.ref014","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1111\/j.1460-9568.2005.04218.x","article-title":"The role of the dorsomedial striatum in instrumental conditioning","volume":"22","author":"HH Yin","year":"2005","journal-title":"Europearn Journal of Neuroscience"},{"issue":"7","key":"pcbi.1007579.ref015","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1093\/cercor\/bhm198","article-title":"Understanding the Neural Computations of Arbitrary Visuomotor Learning through fMRI and Associative Learning Theory","volume":"18","author":"A Brovelli","year":"2008","journal-title":"Cerebral Cortex"},{"issue":"4","key":"pcbi.1007579.ref016","doi-asserted-by":"crossref","first-page":"1580","DOI":"10.1016\/j.neuroimage.2011.05.059","article-title":"Differential roles of caudate nucleus and putamen during instrumental learning","volume":"57","author":"A Brovelli","year":"2011","journal-title":"NeuroImage"},{"issue":"12","key":"pcbi.1007579.ref017","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1038\/nrn4038","article-title":"A fronto\u2013striato\u2013subthalamic\u2013pallidal network for goal-directed and habitual inhibition","volume":"16","author":"M Jahanshahi","year":"2015","journal-title":"Nature Reviews Neuroscience"},{"key":"pcbi.1007579.ref018","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.neubiorev.2019.02.008","article-title":"The super-learning hypothesis: Integrating learning processes across cortex, cerebellum and basal ganglia","volume":"100","author":"D Caligiore","year":"2019","journal-title":"Neuroscience and Biobehavioral Reviews"},{"key":"pcbi.1007579.ref019","first-page":"214","volume-title":"Treatise on physiological optics (3rd ed., Vol. III, Translation 1962)","author":"H Helmholtz","year":"1866"},{"issue":"5","key":"pcbi.1007579.ref020","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1162\/neco.1995.7.5.889","article-title":"The Helmholtz machine","volume":"7","author":"P Dayan","year":"1995","journal-title":"Neural computation"},{"key":"pcbi.1007579.ref021","volume-title":"The Bayesian Brain: Probabilistic Approaches to Neural Coding","author":"K Doya","year":"2007"},{"issue":"2","key":"pcbi.1007579.ref022","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free-energy principle: a unified brain theory?","volume":"11","author":"K Friston","year":"2010","journal-title":"Nature Reviews Neuroscience"},{"key":"pcbi.1007579.ref023","volume-title":"Bayesian models of cognition","author":"TL Griffiths","year":"2008"},{"key":"pcbi.1007579.ref024","doi-asserted-by":"crossref","unstructured":"Toussaint M, Storkey A. Probabilistic inference for solving discrete and continuous state Markov Decision Processes. In: Proceedings of the 23rd international conference on Machine learning. ACM; 2006. p. 945\u2013952.","DOI":"10.1145\/1143844.1143963"},{"issue":"10","key":"pcbi.1007579.ref025","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/j.tics.2012.08.006","article-title":"Planning as inference","volume":"16","author":"M Botvinick","year":"2012","journal-title":"Trends in Cognitive Sciences"},{"issue":"2","key":"pcbi.1007579.ref026","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s10994-012-5278-7","article-title":"Optimal control as a graphical model inference problem","volume":"87","author":"HJ Kappen","year":"2012","journal-title":"Machine learning"},{"key":"pcbi.1007579.ref027","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/5583.001.0001","volume-title":"Probabilistic models of the brain: Perception and neural function","author":"RP Rao","year":"2002"},{"issue":"4","key":"pcbi.1007579.ref028","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1017\/S0140525X10003134","article-title":"Bayesian Fundamentalism or Enlightenment? On the explanatory status and theoretical contributions of Bayesian models of cognition","volume":"34","author":"M Jones","year":"2011","journal-title":"Behavioral and Brain Sciences"},{"key":"pcbi.1007579.ref029","unstructured":"Sharma S, Voelker A, Eliasmith C. A Spiking Neural Bayesian Model of Life Span Inference. In: CogSci; 2017. p. 3131\u20133136."},{"issue":"9","key":"pcbi.1007579.ref030","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1016\/S0893-6080(97)00011-7","article-title":"Networks of spiking neurons: the third generation of neural network models","volume":"10","author":"W Maass","year":"1997","journal-title":"Neural networks"},{"key":"pcbi.1007579.ref031","unstructured":"Deneve S. Bayesian inference in spiking neurons. In: Advances in neural information processing systems; 2005. p. 353\u2013360."},{"issue":"11","key":"pcbi.1007579.ref032","doi-asserted-by":"crossref","first-page":"e1002211","DOI":"10.1371\/journal.pcbi.1002211","article-title":"Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons","volume":"7","author":"L Buesing","year":"2011","journal-title":"PLoS Computational Biology"},{"key":"pcbi.1007579.ref033","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1038\/s41467-017-00181-8","article-title":"Efficient probabilistic inference in generic neural networks trained with non-probabilistic feedback","volume":"8","author":"AE Orhan","year":"2017","journal-title":"Nature communications"},{"issue":"9","key":"pcbi.1007579.ref034","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1038\/nn.3495","article-title":"Probabilistic brains: knowns and unknowns","volume":"16","author":"A Pouget","year":"2013","journal-title":"Nature Neuroscience"},{"issue":"4","key":"pcbi.1007579.ref035","first-page":"555","article-title":"Nonlinear filtering: Interacting particle resolution","volume":"2","author":"P Del Moral","year":"1996","journal-title":"Markov Processes and Related Fields"},{"issue":"12","key":"pcbi.1007579.ref036","doi-asserted-by":"crossref","first-page":"2707","DOI":"10.3390\/s17122707","article-title":"A survey of recent advances in particle filters and remaining challenges for multitarget tracking","volume":"17","author":"X Wang","year":"2017","journal-title":"Sensors"},{"key":"pcbi.1007579.ref037","unstructured":"Huang Y, Rao RP. Neurons as Monte Carlo Samplers: Bayesian Inference and Learning in Spiking Networks. In: Advances in neural information processing systems; 2014. p. 1943\u20131951."},{"issue":"1","key":"pcbi.1007579.ref038","doi-asserted-by":"crossref","DOI":"10.1038\/srep21142","article-title":"Recurrent Spiking Networks Solve Planning Tasks","volume":"6","author":"E Rueckert","year":"2016","journal-title":"Scientific Reports"},{"key":"pcbi.1007579.ref039","doi-asserted-by":"crossref","unstructured":"Tanneberg D, Paraschos A, Peters J, Rueckert E. Deep spiking networks for model-based planning in humanoids. In: Humanoid Robots (Humanoids), 2016 IEEE-RAS 16th International Conference on. IEEE; 2016. p. 656\u2013661. Available from: http:\/\/ieeexplore.ieee.org\/abstract\/document\/7803344\/.","DOI":"10.1109\/HUMANOIDS.2016.7803344"},{"issue":"5","key":"pcbi.1007579.ref040","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1523\/JNEUROSCI.2854-15.2016","article-title":"Goal-Directed Decision Making with Spiking Neurons","volume":"36","author":"J Friedrich","year":"2016","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1007579.ref041","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1037\/a0026435","article-title":"Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates","volume":"119","author":"A Solway","year":"2012","journal-title":"Psychological Review"},{"key":"pcbi.1007579.ref042","doi-asserted-by":"crossref","DOI":"10.3389\/fncom.2012.00097","article-title":"Learned graphical models for probabilistic planning provide a new class of movement primitives","volume":"6","author":"EA R\u00fcckert","year":"2013","journal-title":"Frontiers in Computational Neuroscience"},{"key":"pcbi.1007579.ref043","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:osobl\/9780199552917.001.0001","volume-title":"The neurobiology of the prefrontal cortex: anatomy, evolution, and the origin of insight","author":"RE Passingham","year":"2012"},{"issue":"7095","key":"pcbi.1007579.ref044","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1038\/nature04766","article-title":"Cortical substrates for exploratory decisions in humans","volume":"441","author":"ND Daw","year":"2006","journal-title":"Nature"},{"issue":"3","key":"pcbi.1007579.ref045","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1037\/dec0000033","article-title":"Unpacking the exploration\u2013exploitation tradeoff: A synthesis of human and animal literatures","volume":"2","author":"K Mehlhorn","year":"2015","journal-title":"Decision"},{"key":"pcbi.1007579.ref046","doi-asserted-by":"crossref","first-page":"e1007805","DOI":"10.1371\/journal.pcbi.1007805","article-title":"Learning action-oriented models through active inference","volume":"16","author":"A Tschantz","year":"2020","journal-title":"PLoS computational biology"},{"issue":"12","key":"pcbi.1007579.ref047","doi-asserted-by":"crossref","first-page":"1704","DOI":"10.1038\/nn1560","article-title":"Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control","volume":"8","author":"ND Daw","year":"2005","journal-title":"Nature Neuroscience"},{"key":"pcbi.1007579.ref048","doi-asserted-by":"crossref","DOI":"10.3389\/fnbeh.2015.00225","article-title":"Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning","volume":"9","author":"G Viejo","year":"2015","journal-title":"Frontiers in Behavioral Neuroscience"},{"issue":"3","key":"pcbi.1007579.ref049","doi-asserted-by":"crossref","first-page":"e1003511","DOI":"10.1371\/journal.pcbi.1003511","article-title":"STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning","volume":"10","author":"D Kappel","year":"2014","journal-title":"PLoS Computational Biology"},{"key":"pcbi.1007579.ref050","first-page":"219","article-title":"The Organization of the Frontal Motor Cortex","volume":"15","author":"G Luppino","year":"2000","journal-title":"News in physiological sciences"},{"key":"pcbi.1007579.ref051","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1016\/j.neubiorev.2013.01.012","article-title":"Theories and computational models of affordance and mirror systems: An integrative review","volume":"37","author":"S Thill","year":"2013","journal-title":"Neuroscience and Biobehavioral Reviews"},{"issue":"3","key":"pcbi.1007579.ref052","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1002\/hipo.450040319","article-title":"Computational analysis of the role of the hippocampus in memory","volume":"4","author":"A Treves","year":"1994","journal-title":"Hippocampus"},{"key":"pcbi.1007579.ref053","doi-asserted-by":"crossref","unstructured":"Basanisi R, Brovelli A, Cartoni E, Baldassarre G. A spiking neural-network model of goal-directed behaviour. bioRxiv. 2019; https:\/\/doi.org\/10.1101\/867366.","DOI":"10.1101\/867366"},{"issue":"4","key":"pcbi.1007579.ref054","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1016\/S1364-6613(00)01452-2","article-title":"Inhibition of return","volume":"4","author":"RM Klein","year":"2000","journal-title":"Trends in Cognitive Sciences"},{"key":"pcbi.1007579.ref055","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006"},{"key":"pcbi.1007579.ref056","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1007\/978-94-011-5014-9_12","volume-title":"Learning in graphical models","author":"RM Neal","year":"1998"},{"key":"pcbi.1007579.ref057","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006"},{"issue":"1","key":"pcbi.1007579.ref058","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s10827-006-7074-5","article-title":"Predicting spike timing of neocortical pyramidal neurons by simple threshold models","volume":"21","author":"R Jolivet","year":"2006","journal-title":"Journal of computational neuroscience"},{"issue":"1","key":"pcbi.1007579.ref059","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.neuron.2004.09.007","article-title":"Spike timing-dependent plasticity of neural circuits","volume":"44","author":"Y Dan","year":"2004","journal-title":"Neuron"},{"issue":"4","key":"pcbi.1007579.ref060","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1016\/j.neuron.2012.08.001","article-title":"The Spike-Timing Dependence of Plasticity","volume":"75","author":"D Feldman","year":"2012","journal-title":"Neuron"},{"key":"pcbi.1007579.ref061","doi-asserted-by":"crossref","DOI":"10.3389\/fnsyn.2012.00002","article-title":"Spike-Timing-Dependent Plasticity: A Comprehensive Overview","volume":"4","author":"H Markram","year":"2012","journal-title":"Frontiers in Synaptic Neuroscience"},{"issue":"8","key":"pcbi.1007579.ref062","doi-asserted-by":"crossref","first-page":"e1006227","DOI":"10.1371\/journal.pcbi.1006227","article-title":"General differential Hebbian learning: Capturing temporal relations between events in neural networks and the brain","volume":"14","author":"S Zappacosta","year":"2018","journal-title":"Plos Computational Biology"},{"key":"pcbi.1007579.ref063","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-56927-2","volume-title":"Self-organizing maps","author":"T Kohonen","year":"2001","edition":"3"},{"key":"pcbi.1007579.ref064","volume-title":"Computational maps in the visual cortex","author":"R Miikkulainen","year":"2006"},{"key":"pcbi.1007579.ref065","volume-title":"The Ecological Approach to Visual Perception","author":"JJ Gibson","year":"1979"},{"issue":"45","key":"pcbi.1007579.ref066","article-title":"An embodied agent learning affordances with intrinsic motivations and solving extrinsic tasks with attention and one-step planning","volume":"13","author":"G Baldassarre","year":"2019","journal-title":"Frontiers in Neurorobotics"},{"key":"pcbi.1007579.ref067","first-page":"2672","volume-title":"Advances in neural information processing systems","author":"I Goodfellow","year":"2014"},{"key":"pcbi.1007579.ref068","unstructured":"Kingma DP, Welling M. Auto-Encoding Variational Bayes. arXiv preprint arXiv:13126114. 2013."},{"key":"pcbi.1007579.ref069","unstructured":"Gregor K, Papamakarios G, Besse F, Buesing L, Weber T. Temporal Difference Variational Auto-Encoder. arXiv preprint arXiv:180603107. 2018."},{"issue":"8","key":"pcbi.1007579.ref070","doi-asserted-by":"crossref","first-page":"1771","DOI":"10.1162\/089976602760128018","article-title":"Training products of experts by minimizing contrastive divergence","volume":"14","author":"GE Hinton","year":"1995","journal-title":"Neural computation"},{"key":"pcbi.1007579.ref071","volume-title":"Deep Learning","author":"I Goodfellow","year":"2017"},{"key":"pcbi.1007579.ref072","unstructured":"Granato G, Baldassarre G. Human Flexible Goal-directed Behavior and the Manipulation of Internal Representations: A Computational Model. PsyArXiv. 2019; p. e1\u201333."},{"key":"pcbi.1007579.ref073","unstructured":"Newman MEJ. Complex Systems: A Survey. arXiv preprint arXiv:11121440. 2011; 79:800\u2013810."},{"issue":"11","key":"pcbi.1007579.ref074","doi-asserted-by":"crossref","first-page":"2519","DOI":"10.1162\/089976600300014827","article-title":"On the computational power of winner-take-all","volume":"12","author":"W Maass","year":"2000","journal-title":"Neural computation"},{"issue":"4","key":"pcbi.1007579.ref075","doi-asserted-by":"crossref","first-page":"e1003037","DOI":"10.1371\/journal.pcbi.1003037","article-title":"Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity","volume":"9","author":"B Nessler","year":"2013","journal-title":"PLoS Computational Biology"},{"issue":"8","key":"pcbi.1007579.ref076","doi-asserted-by":"crossref","first-page":"e0134356","DOI":"10.1371\/journal.pone.0134356","article-title":"Distributed Bayesian Computation and Self-Organized Learning in Sheets of Spiking Neurons with Local Lateral Inhibition","volume":"10","author":"J Bill","year":"2015","journal-title":"PLOS ONE"},{"key":"pcbi.1007579.ref077","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.neunet.2020.03.003","article-title":"Probabilistic inference of binary Markov random fields in spiking neural networks through mean-field approximation","volume":"126","author":"Y Zheng","year":"2020","journal-title":"Neural networks"},{"issue":"2","key":"pcbi.1007579.ref078","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1162\/089976606775093909","article-title":"Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia","volume":"18","author":"RC O\u2019Reilly","year":"2006","journal-title":"Neural Computation"},{"issue":"181","key":"pcbi.1007579.ref079","first-page":"e1","article-title":"Goal-Directed Behavior and Instrumental Devaluation: A Neural System-Level Computational Model","volume":"10","author":"F Mannella","year":"2016","journal-title":"Frontiers in Behavioral Neuroscience"},{"issue":"37","key":"pcbi.1007579.ref080","doi-asserted-by":"crossref","first-page":"12643","DOI":"10.1523\/JNEUROSCI.4892-14.2015","article-title":"Characterization of Cortical Networks and Corticocortical Functional Connectivity Mediating Arbitrary Visuomotor Mapping","volume":"35","author":"A Brovelli","year":"2015","journal-title":"Journal of Neuroscience"},{"issue":"4","key":"pcbi.1007579.ref081","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1523\/JNEUROSCI.1672-16.2016","article-title":"Dynamic reconfiguration of visuomotor-related functional connectivity networks","volume":"37","author":"A Brovelli","year":"2017","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1007579.ref082","first-page":"4","article-title":"Representational similarity analysis\u2014Connecting the branches of systems neuroscience","volume":"2","author":"N Kriegeskorte","year":"2008","journal-title":"Frontiers in systems neuroscience"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1007579","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2020,12,18]],"date-time":"2020-12-18T00:00:00Z","timestamp":1608249600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1007579","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,18]],"date-time":"2020-12-18T14:40:31Z","timestamp":1608302431000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1007579"}},"subtitle":[],"editor":[{"given":"Boris S.","family":"Gutkin","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2020,12,8]]},"references-count":82,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12,8]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1007579","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/867366","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,8]]}}}