{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T18:00:10Z","timestamp":1775066410650,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009854","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T00:00:00Z","timestamp":1644796800000}}],"reference-count":202,"publisher":"Public Library of Science (PLoS)","issue":"2","license":[{"start":{"date-parts":[[2022,2,2]],"date-time":"2022-02-02T00:00:00Z","timestamp":1643760000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"FWO","award":["12O7719N"],"award-info":[{"award-number":["12O7719N"]}]},{"name":"BOF","award":["BOF17-GOA-004"],"award-info":[{"award-number":["BOF17-GOA-004"]}]},{"DOI":"10.13039\/100000025","name":"NIMH","doi-asserted-by":"crossref","award":["R01MH084840-08A1"],"award-info":[{"award-number":["R01MH084840-08A1"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Adaptive sequential behavior is a hallmark of human cognition. In particular, humans can learn to produce precise spatiotemporal sequences given a certain context. For instance, musicians can not only reproduce learned action sequences in a context-dependent manner, they can also quickly and flexibly reapply them in any desired tempo or rhythm without overwriting previous learning. Existing neural network models fail to account for these properties. We argue that this limitation emerges from the fact that sequence information (i.e., the position of the action) and timing (i.e., the moment of response execution) are typically stored in the same neural network weights. Here, we augment a biologically plausible recurrent neural network of cortical dynamics to include a basal ganglia-thalamic module which uses reinforcement learning to dynamically modulate action. This \u201cassociative cluster-dependent chain\u201d (ACDC) model modularly stores sequence and timing information in distinct loci of the network. This feature increases computational power and allows ACDC to display a wide range of temporal properties (e.g., multiple sequences, temporal shifting, rescaling, and compositionality), while still accounting for several behavioral and neurophysiological empirical observations. Finally, we apply this ACDC network to show how it can learn the famous \u201cThunderstruck\u201d song intro and then flexibly play it in a \u201cbossa nova\u201d rhythm without further training.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009854","type":"journal-article","created":{"date-parts":[[2022,2,2]],"date-time":"2022-02-02T13:44:03Z","timestamp":1643809443000},"page":"e1009854","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":17,"title":["Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8325-2059","authenticated-orcid":true,"given":"Cristian Buc","family":"Calderon","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7783-4754","authenticated-orcid":true,"given":"Tom","family":"Verguts","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8451-0523","authenticated-orcid":true,"given":"Michael J.","family":"Frank","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2022,2,2]]},"reference":[{"key":"pcbi.1009854.ref001","doi-asserted-by":"crossref","first-page":"19156","DOI":"10.1073\/pnas.0909881106","article-title":"Neural representation of time in cortico-basal ganglia circuits","volume":"106","author":"DZ Jin","year":"2009","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1009854.ref002","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1016\/j.cub.2015.02.036","article-title":"A scalable population code for time in the striatum","volume":"25","author":"GBM Mello","year":"2015","journal-title":"Curr Biol"},{"key":"pcbi.1009854.ref003","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.27702","article-title":"Automated long-Term recording and analysis of neural activity in behaving animals","volume":"6","author":"AK Dhawale","year":"2017","journal-title":"Elife"},{"key":"pcbi.1009854.ref004","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.11386","article-title":"Striatal dynamics explain duration judgments","volume":"4","author":"TS Gouv\u00eaa","year":"2015","journal-title":"Elife"},{"key":"pcbi.1009854.ref005","doi-asserted-by":"crossref","first-page":"854","DOI":"10.1523\/JNEUROSCI.1789-16.2016","article-title":"Differential Encoding of Time by Prefrontal and Striatal Network Dynamics","volume":"37","author":"KI Bakhurin","year":"2017","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref006","doi-asserted-by":"crossref","first-page":"1322","DOI":"10.1126\/science.1159775","article-title":"Internally Generated Cell Assembly Sequences in the Rat Hippocampus","volume":"321","author":"E Pastalkova","year":"2008","journal-title":"Science (80-)"},{"key":"pcbi.1009854.ref007","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2020698118","article-title":"Crucial role for CA2 inputs in the sequential organization of CA1 time cells supporting memory","volume":"118","author":"CJ MacDonald","year":"2021","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1009854.ref008","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1038\/nrn3827","article-title":"Time cells in the hippocampus: A new dimension for mapping memories","volume":"15","author":"H. Eichenbaum","year":"2014","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1009854.ref009","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1038\/s41593-019-0415-2","article-title":"A diversity of interneurons and Hebbian plasticity facilitate rapid compressible learning in the hippocampus","volume":"22","author":"W Nicola","year":"2019","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref010","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1073\/pnas.0605643104","article-title":"Sequential structure of neocortical spontaneous activity in vivo","volume":"104","author":"A Luczak","year":"2007","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1009854.ref011","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1038\/nature10918","article-title":"Choice-specific sequences in parietal cortex during a virtual-navigation decision task","volume":"484","author":"CD Harvey","year":"2012","journal-title":"Nature"},{"key":"pcbi.1009854.ref012","doi-asserted-by":"crossref","first-page":"938","DOI":"10.1016\/j.tics.2018.07.010","article-title":"A Dynamical Systems Perspective on Flexible Motor Timing","volume":"22","author":"ED Remington","year":"2018","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1009854.ref013","doi-asserted-by":"crossref","first-page":"2861","DOI":"10.1103\/PhysRevLett.57.2861","article-title":"Temporal association in asymmetric neural networks","volume":"57","author":"H Sompolinsky","year":"1986","journal-title":"Phys Rev Lett"},{"key":"pcbi.1009854.ref014","doi-asserted-by":"crossref","first-page":"9469","DOI":"10.1073\/pnas.83.24.9469","article-title":"Sequential state generation by model neural networks","volume":"83","author":"D. Kleinfeld","year":"1986","journal-title":"Proc Natl Acad Sci"},{"key":"pcbi.1009854.ref015","first-page":"403","article-title":"Network: Computation in Neural Systems Analysis of synfire chains Analysis of synfire chains","volume":"6","author":"M Herrmann","year":"1995","journal-title":"Netw Comput Ned Syst"},{"key":"pcbi.1009854.ref016","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1006\/nlme.1998.3843","article-title":"The Basal Ganglia and Chunking of Action Repertoires","volume":"70","author":"AM Graybiel","year":"1998","journal-title":"Neurobiol Learn Mem"},{"key":"pcbi.1009854.ref017","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.cell.2018.06.012","article-title":"Optogenetic Editing Reveals the Hierarchical Organization of Learned Action Sequences","volume":"174","author":"CE Geddes","year":"2018","journal-title":"Cell"},{"key":"pcbi.1009854.ref018","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1002\/cphy.c170043","article-title":"Motor learning","volume":"9","author":"JW Krakauer","year":"2019","journal-title":"Compr Physiol"},{"key":"pcbi.1009854.ref019","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1016\/j.neuron.2010.02.003","article-title":"Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity","volume":"65","author":"IR Fiete","year":"2010","journal-title":"Neuron"},{"key":"pcbi.1009854.ref020","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/990101","article-title":"Stable propagation of synchronous spiking in cortical neural networks","volume":"402","author":"M Dlesmann","year":"1999","journal-title":"Nature"},{"key":"pcbi.1009854.ref021","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511574566","volume-title":"Corticonics: Neural circuits of the cerebral cortex","author":"M Abeles","year":"1991"},{"key":"pcbi.1009854.ref022","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.63751","article-title":"Learning precise spatiotemporal sequences via biophysically realistic learning rules in a modular, spiking network","volume":"10","author":"I Cone","year":"2021","journal-title":"Elife"},{"key":"pcbi.1009854.ref023","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fncom.2019.00097","article-title":"Unsupervised Learning of Persistent and Sequential Activity","volume":"13","author":"U Pereira","year":"2020","journal-title":"Front Comput Neurosci"},{"key":"pcbi.1009854.ref024","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/s10827-015-0574-4","article-title":"Networks that learn the precise timing of event sequences","volume":"39","author":"A Veliz-Cuba","year":"2015","journal-title":"J Comput Neurosci"},{"key":"pcbi.1009854.ref025","doi-asserted-by":"crossref","first-page":"1825","DOI":"10.1152\/jn.1998.79.4.1825","article-title":"Temporal and amplitude generalization in motor learning","volume":"79","author":"SJ Goodbody","year":"1998","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref026","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1152\/jn.00856.2011","article-title":"How is a motor skill learned? Change and invariance at the levels of task success and trajectory control","volume":"108","author":"L Shmuelof","year":"2012","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref027","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1007606","article-title":"Learning spatiotemporal signals using a recurrent spiking network that discretizes time","volume":"16","author":"A Maes","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1009854.ref028","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.26084","article-title":"Learning multiple variable-speed sequences in striatum via cortical tutoring","volume":"6","author":"JM Murray","year":"2017","journal-title":"Elife"},{"key":"pcbi.1009854.ref029","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms6319","article-title":"Formation and maintenance of neuronal assemblies through synaptic plasticity","volume":"5","author":"A Litwin-Kumar","year":"2014","journal-title":"Nat Commun"},{"key":"pcbi.1009854.ref030","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms7922","article-title":"Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks","volume":"6","author":"F Zenke","year":"2015","journal-title":"Nat Commun"},{"key":"pcbi.1009854.ref031","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1016\/j.jphysparis.2004.01.021","article-title":"Modelling the formation of working memory with networks of integrate-and-fire neurons connected by plastic synapses","volume":"97","author":"P Del Giudice","year":"2003","journal-title":"J Physiol Paris"},{"key":"pcbi.1009854.ref032","doi-asserted-by":"crossref","first-page":"2011","DOI":"10.1046\/j.1460-9568.2003.02908.x","article-title":"Retrospective and prospective persistent activity induced by Hebbian learning in a recurrent cortical network","volume":"18","author":"G Mongillo","year":"2003","journal-title":"Eur J Neurosci"},{"key":"pcbi.1009854.ref033","doi-asserted-by":"crossref","first-page":"29948","DOI":"10.1073\/pnas.1918674117","article-title":"Characteristics of sequential activity in networks with temporally asymmetric Hebbian learning","volume":"117","author":"M Gillett","year":"2020","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1009854.ref034","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-018-07161-6","article-title":"A model of temporal scaling correctly predicts that motor timing improves with speed","volume":"9","author":"NF Hardy","year":"2018","journal-title":"Nat Commun"},{"key":"pcbi.1009854.ref035","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1038\/s41593-018-0314-y","article-title":"A diverse range of factors affect the nature of neural representations underlying short-term memory","volume":"22","author":"AE Orhan","year":"2019","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref036","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1038\/nn.3405","article-title":"Robust timing and motor patterns by taming chaos in recurrent neural networks","volume":"16","author":"R Laje","year":"2013","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref037","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.neuron.2009.08.003","article-title":"Harnessing Chaos in Recurrent Neural Networks","volume":"63","author":"D V. Buonomano","year":"2009","journal-title":"Neuron"},{"key":"pcbi.1009854.ref038","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.neuron.2016.02.009","article-title":"Recurrent Network Models of Sequence Generation and Memory","volume":"90","author":"K Rajan","year":"2016","journal-title":"Neuron"},{"key":"pcbi.1009854.ref039","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.31134","article-title":"Encoding sensory and motor patterns as time-invariant trajectories in recurrent neural networks","volume":"7","author":"V Goudar","year":"2018","journal-title":"Elife"},{"key":"pcbi.1009854.ref040","doi-asserted-by":"crossref","first-page":"109090","DOI":"10.1016\/j.celrep.2021.109090","article-title":"Thalamic control of cortical dynamics in a model of flexible motor sequencing","volume":"35","author":"L Logiaco","year":"2021","journal-title":"Cell Rep"},{"key":"pcbi.1009854.ref041","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1016\/j.neuron.2009.07.018","article-title":"Generating Coherent Patterns of Activity from Chaotic Neural Networks","volume":"63","author":"D Sussillo","year":"2009","journal-title":"Neuron"},{"key":"pcbi.1009854.ref042","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-020-17236-y","article-title":"A solution to the learning dilemma for recurrent networks of spiking neurons","volume":"11","author":"G Bellec","year":"2020","journal-title":"Nat Commun"},{"key":"pcbi.1009854.ref043","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.20899","article-title":"Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks","volume":"6","author":"T. Miconi","year":"2017","journal-title":"Elife"},{"key":"pcbi.1009854.ref044","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.43299","article-title":"Local online learning in recurrent networks with random feedback","volume":"8","author":"JM Murray","year":"2019","journal-title":"Elife"},{"key":"pcbi.1009854.ref045","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1038\/s41593-017-0028-6","article-title":"Flexible timing by temporal scaling of cortical responses","volume":"21","author":"J Wang","year":"2018","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref046","first-page":"1","article-title":"Metastable attractors explain the variable timing of stable behavioral action sequences","author":"S Recanatesi","year":"2021","journal-title":"Neuron"},{"key":"pcbi.1009854.ref047","doi-asserted-by":"crossref","first-page":"e1006116","DOI":"10.1371\/journal.pcbi.1006116","article-title":"Compositional clustering in task structure learning","volume":"14","author":"NT Franklin","year":"2018","journal-title":"PLOS Comput Biol"},{"key":"pcbi.1009854.ref048","article-title":"Generalizing to generalize: Humans flexibly switch between compositional and conjunctive structures during reinforcement learning","author":"NT Franklin","year":"2020","journal-title":"PLoS Computational Biology"},{"key":"pcbi.1009854.ref049","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.neuron.2017.09.019","article-title":"Striatal Local Circuitry: A New Framework for Lateral Inhibition","volume":"96","author":"DA Burke","year":"2017","journal-title":"Neuron"},{"key":"pcbi.1009854.ref050","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1016\/j.neuron.2019.06.005","article-title":"Thalamocortical Circuit Motifs: A General Framework","volume":"103","author":"MM Halassa","year":"2019","journal-title":"Neuron"},{"key":"pcbi.1009854.ref051","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1146\/annurev-neuro-080317-062144","article-title":"Toward an Integrative Theory of Thalamic Function","volume":"41","author":"R V. Rikhye","year":"2018","journal-title":"Annu Rev Neurosci"},{"key":"pcbi.1009854.ref052","doi-asserted-by":"crossref","first-page":"1753","DOI":"10.1038\/s41593-018-0269-z","article-title":"Thalamic regulation of switching between cortical representations enables cognitive flexibility","volume":"21","author":"R V. Rikhye","year":"2018","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref053","doi-asserted-by":"crossref","first-page":"936","DOI":"10.1016\/j.neuron.2012.03.038","article-title":"Article Differential Recruitment of the Sensorimotor Putamen and Frontoparietal Cortex during Motor Chunking in Humans","volume":"74","author":"NF Wymbs","year":"2012","journal-title":"Neuron"},{"key":"pcbi.1009854.ref054","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1371\/journal.pone.0103885","article-title":"Striatal and hippocampal involvement in motor sequence chunking depends on the learning strategy","volume":"9","author":"O Lungu","year":"2014","journal-title":"PLoS One"},{"key":"pcbi.1009854.ref055","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.cobeha.2017.11.012","article-title":"ScienceDirect Current issues related to motor sequence learning in humans","volume":"20","author":"J Doyon","year":"2017","journal-title":"Curr Opin Behav Sci"},{"key":"pcbi.1009854.ref056","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1101\/cshperspect.a021691","article-title":"The striatum: Where skills and habits meet","volume":"7","author":"AM Graybiel","year":"2015","journal-title":"Cold Spring Harb Perspect Biol"},{"key":"pcbi.1009854.ref057","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpsyg.2013.00937","article-title":"Modality-specific organization in the representation of sensorimotor sequences","volume":"4","author":"A Boutin","year":"2013","journal-title":"Front Psychol"},{"key":"pcbi.1009854.ref058","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fnhum.2013.00082","article-title":"Control of automated behavior: Insights from the discrete sequence production task","volume":"7","author":"EL Abrahamse","year":"2013","journal-title":"Front Hum Neurosci"},{"key":"pcbi.1009854.ref059","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.tics.2015.02.003","article-title":"Motor skill learning between selection and execution","volume":"19","author":"J Diedrichsen","year":"2015","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1009854.ref060","doi-asserted-by":"crossref","first-page":"54","DOI":"10.3758\/s13423-014-0773-4","article-title":"A cognitive framework for explaining serial processing and sequence execution strategies","volume":"22","author":"WB Verwey","year":"2014","journal-title":"Psychon Bull Rev"},{"key":"pcbi.1009854.ref061","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1016\/j.neuron.2019.01.018","article-title":"Neural Competitive Queuing of Ordinal Structure Underlies Skilled Sequential Action","volume":"101","author":"K Kornysheva","year":"2019","journal-title":"Neuron"},{"key":"pcbi.1009854.ref062","doi-asserted-by":"crossref","first-page":"17538","DOI":"10.1073\/pnas.0805903105","article-title":"Striatum and pre-SMA facilitate decision-making under time pressure","volume":"105","author":"BU Forstmann","year":"2008","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1009854.ref063","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1002771","article-title":"Internal Representations of Temporal Statistics and Feedback Calibrate Motor-Sensory Interval Timing","volume":"8","author":"L Acerbi","year":"2012","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1009854.ref064","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1037\/0097-7403.24.1.15","article-title":"Scalar expectancy theory and peak-interval timing in humans","volume":"24","author":"BC Rakitin","year":"1998","journal-title":"J Exp Psychol Anim Behav Process"},{"key":"pcbi.1009854.ref065","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1038\/nn.2590","article-title":"Temporal context calibrates interval timing","volume":"13","author":"M Jazayeri","year":"2010","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref066","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1037\/0096-1523.21.1.3","article-title":"Perception and production of temporal intervals across a range of durations: Evidence for a common timing mechanism","volume":"21","author":"RB Ivry","year":"1995","journal-title":"J Exp Psychol Hum Percept Perform"},{"key":"pcbi.1009854.ref067","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-020-16999-8","article-title":"A neural circuit model for human sensorimotor timing","volume":"11","author":"SW Egger","year":"2020","journal-title":"Nat Commun"},{"key":"pcbi.1009854.ref068","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1111\/1467-9280.00067","article-title":"Modelling response times for two choice decisions","volume":"9","author":"R Ratcliff","year":"1998","journal-title":"Psychol Sci"},{"key":"pcbi.1009854.ref069","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1038\/331068a0","article-title":"Neuronal correlate of pictorial short-term memory in the primate temporal cortex","volume":"331","author":"Y Miyashita","year":"1988","journal-title":"Nature"},{"key":"pcbi.1009854.ref070","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1152\/jn.1995.74.1.162","article-title":"Mnemonic firing of neurons in the monkey temporal pole during a visual recognition memory task","volume":"74","author":"K Nakamura","year":"1995","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref071","doi-asserted-by":"crossref","first-page":"10404","DOI":"10.1523\/JNEUROSCI.19-23-10404.1999","article-title":"Responses of macaque perirhinal neurons during and after visual stimulus association learning","volume":"19","author":"CA Erickson","year":"1999","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref072","article-title":"Unit activity in monkey parietal cortex related to haptic perception and temporary memory","author":"KW Koch","year":"1989","journal-title":"Exp Brain Res"},{"key":"pcbi.1009854.ref073","doi-asserted-by":"crossref","first-page":"2919","DOI":"10.1152\/jn.1998.79.6.2919","article-title":"Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task","volume":"79","author":"M V. Chafee","year":"1998","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref074","doi-asserted-by":"crossref","first-page":"9376","DOI":"10.1523\/JNEUROSCI.1570-06.2006","article-title":"Neural dynamics in monkey parietal reach region reflect context-specific sensorimotor transformations","volume":"26","author":"A Gail","year":"2006","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref075","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.neuron.2011.02.053","article-title":"Choosing goals, not rules: deciding among rule-based action plans","volume":"70","author":"C Klaes","year":"2011","journal-title":"Neuron"},{"key":"pcbi.1009854.ref076","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1016\/j.neuron.2005.01.027","article-title":"Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action","volume":"45","author":"P Cisek","year":"2005","journal-title":"Neuron"},{"key":"pcbi.1009854.ref077","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1152\/jn.1990.63.4.814","article-title":"Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms","volume":"63","author":"S Funahashi","year":"1990","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref078","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1152\/jn.1989.61.2.331","article-title":"Mnemonic coding of visual space in the monkey\u2019s dorsolateral prefrontal cortex","volume":"61","author":"S Funahashi","year":"1989","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref079","doi-asserted-by":"crossref","first-page":"5154","DOI":"10.1523\/JNEUROSCI.16-16-05154.1996","article-title":"Neural mechanisms of visual working memory in prefrontal cortex of the macaque","volume":"16","author":"EK Miller","year":"1996","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref080","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/S0166-2236(00)01868-3","article-title":"Synaptic reverberation underlying mnemonic persistent activity","volume":"24","author":"XJ Wang","year":"2001","journal-title":"Trends Neurosci"},{"key":"pcbi.1009854.ref081","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.1038\/81460","article-title":"Neurocomputational Models of Working Memory","volume":"3","author":"D Durstewitz","year":"2000","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref082","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1093\/cercor\/bhg096","article-title":"Dynamics and Plasticity of Stimulus-selective Persistent Activity in Cortical Network Models","volume":"13","author":"N Brunel","year":"2003","journal-title":"Cereb Cortex"},{"key":"pcbi.1009854.ref083","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1038\/nature00974","article-title":"An ultra-sparse code underlies the generation of neural sequences in a songbird","volume":"419","author":"RHR Hahnloser","year":"2002","journal-title":"Nature"},{"key":"pcbi.1009854.ref084","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1038\/nature15741","article-title":"Growth and splitting of neural sequences in songbird vocal development","volume":"528","author":"TS Okubo","year":"2015","journal-title":"Nature"},{"key":"pcbi.1009854.ref085","doi-asserted-by":"crossref","first-page":"4271","DOI":"10.1152\/jn.00952.2006","article-title":"Singing-related activity of identified HVC neurons in the zebra finch","volume":"97","author":"AA Kozhevnikov","year":"2007","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref086","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1038\/nature11967","article-title":"Elemental gesture dynamics are encoded by song premotor cortical neurons","volume":"495","author":"A Amador","year":"2013","journal-title":"Nature"},{"key":"pcbi.1009854.ref087","first-page":"0","article-title":"Metastable attractors explain the variable timing of stable behavioral action sequences","author":"S Recanatesi","year":"2020","journal-title":"bioRxiv"},{"key":"pcbi.1009854.ref088","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1038\/nn.3924","article-title":"The striatum multiplexes contextual and kinematic information to constrain motor habits execution","volume":"18","author":"PE Rueda-Orozco","year":"2015","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref089","doi-asserted-by":"crossref","first-page":"57","DOI":"10.3389\/fnbeh.2015.00057","article-title":"Adaptive effort investment in cognitive and physical tasks: a neurocomputational model","volume":"9","author":"T Verguts","year":"2015","journal-title":"Front Behav Neurosci"},{"key":"pcbi.1009854.ref090","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1037\/a0030852","article-title":"Cognitive control over learning: creating, clustering, and generalizing task-set structure","volume":"120","author":"AGE Collins","year":"2013","journal-title":"Psychol Rev"},{"key":"pcbi.1009854.ref091","first-page":"1","article-title":"The unfolding action model of initiation times, movement times, and movement paths","author":"CB Calderon","year":"2018","journal-title":"Psychol Rev"},{"key":"pcbi.1009854.ref092","doi-asserted-by":"crossref","first-page":"908","DOI":"10.1038\/s41593-020-0653-3","article-title":"Dynamic representations in networked neural systems","volume":"23","author":"H Ju","year":"2020","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref093","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1016\/j.jml.2006.08.005","article-title":"A revised model of short-term memory and long-term learning of verbal sequences","volume":"55","author":"N Burgess","year":"2006","journal-title":"J Mem Lang"},{"key":"pcbi.1009854.ref094","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1037\/0033-295X.106.3.551","article-title":"Memory for serial order: A network model of the phonological loop and its timing","volume":"106","author":"N Burgess","year":"1999","journal-title":"Psychol Rev"},{"key":"pcbi.1009854.ref095","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1037\/0033-295X.105.4.761-781","article-title":"The primacy model: A new model of immediate serial recall","volume":"105","author":"MPA Page","year":"1998","journal-title":"Psychol Rev"},{"key":"pcbi.1009854.ref096","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1006\/jmla.1996.0001","article-title":"A linguistically constrained model of short-term memory for nonwords","volume":"35","author":"T Hartley","year":"1996","journal-title":"J Mem Lang"},{"key":"pcbi.1009854.ref097","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1016\/j.neuron.2015.03.024","article-title":"Motor Cortex Is Required for Learning but Not for Executing a Motor Skill","volume":"86","author":"R Kawai","year":"2015","journal-title":"Neuron"},{"key":"pcbi.1009854.ref098","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1038\/nature16442","article-title":"Acute off-target effects of neural circuit manipulations","volume":"528","author":"TM Otchy","year":"2015","journal-title":"Nature"},{"key":"pcbi.1009854.ref099","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84868-6","volume-title":"Subcortical structures and cognition: Implications for neuropsychological assessment","author":"LF Koziol","year":"2009"},{"key":"pcbi.1009854.ref100","first-page":"1","article-title":"Motor Demands Constrain Cognitive Rule Structures","volume":"12","author":"AGE Collins","year":"2016","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1009854.ref101","first-page":"349","volume-title":"Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)","author":"L Kozachkov","year":"2020"},{"key":"pcbi.1009854.ref102","doi-asserted-by":"crossref","first-page":"1468","DOI":"10.1162\/neco.2007.19.6.1468","article-title":"Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity","volume":"19","author":"R V. Florian","year":"2007","journal-title":"Neural Comput"},{"key":"pcbi.1009854.ref103","doi-asserted-by":"crossref","first-page":"2443","DOI":"10.1093\/cercor\/bhl152","article-title":"Solving the distal reward problem through linkage of STDP and dopamine signaling","volume":"17","author":"EM Izhikevich","year":"2007","journal-title":"Cereb Cortex"},{"key":"pcbi.1009854.ref104","doi-asserted-by":"crossref","first-page":"13326","DOI":"10.1523\/JNEUROSCI.6249-09.2010","article-title":"Functional requirements for reward-modulated spike-timing-dependent plasticity","volume":"30","author":"N Fr\u00e9maux","year":"2010","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref105","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1162\/NECO_a_00419","article-title":"Solving the distal reward problem with rare correlations","volume":"25","author":"A Soltoggio","year":"2013","journal-title":"Neural Comput"},{"key":"pcbi.1009854.ref106","unstructured":"Bellec G, Scherr F, Hajek E, Salaj D, Legenstein R, Maass W. Biologically inspired alternatives to backpropagation through time for learning in recurrent neural nets. arXiv. 2019; 1\u201337."},{"key":"pcbi.1009854.ref107","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1038\/nn.4042","article-title":"A neural network that finds a naturalistic solution for the production of muscle activity","volume":"18","author":"D Sussillo","year":"2015","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref108","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1016\/j.neuron.2018.01.004","article-title":"Motor Cortex Embeds Muscle-like Commands in an Untangled Population Response","volume":"97","author":"AA Russo","year":"2018","journal-title":"Neuron"},{"key":"pcbi.1009854.ref109","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1146\/annurev-neuro-072116-031109","article-title":"Neural Circuitry of Reward Prediction Error","volume":"40","author":"M Watabe-Uchida","year":"2017","journal-title":"Annu Rev Neurosci"},{"key":"pcbi.1009854.ref110","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1038\/npp.2013.48","article-title":"Dopamine modulates reward-related vigor","volume":"38","author":"U Beierholm","year":"2013","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1009854.ref111","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1016\/j.cell.2015.08.014","article-title":"Dopamine Is Required for the Neural Representation and Control of Movement Vigor","volume":"162","author":"B Panigrahi","year":"2015","journal-title":"Cell"},{"key":"pcbi.1009854.ref112","doi-asserted-by":"crossref","first-page":"9516","DOI":"10.1523\/JNEUROSCI.4467-15.2016","article-title":"Dopamine manipulation affects response vigor independently of opportunity cost","volume":"36","author":"A Z\u00e9non","year":"2016","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref113","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1038\/s41593-018-0152-y","article-title":"What does dopamine mean?","volume":"21","author":"JD Berke","year":"2018","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref114","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1038\/nn.4173","article-title":"Mesolimbic dopamine signals the value of work","volume":"19","author":"AA Hamid","year":"2015","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref115","article-title":"Dopamine waves as a mechanism for spatiotemporal credit assignment","author":"AA Hamid","year":"2021","journal-title":"Cell"},{"key":"pcbi.1009854.ref116","doi-asserted-by":"crossref","first-page":"6563","DOI":"10.1523\/JNEUROSCI.0463-18.2018","article-title":"Distinct populations of motor thalamic neurons encode action initiation, action selection, and movement vigor","volume":"38","author":"M Gaidica","year":"2018","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref117","doi-asserted-by":"crossref","first-page":"5010","DOI":"10.1523\/JNEUROSCI.0432-19.2019","article-title":"Reward prediction error modulates saccade vigor","volume":"39","author":"E Sedaghat-Nejad","year":"2019","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref118","doi-asserted-by":"crossref","first-page":"2087","DOI":"10.1038\/s41386-020-00799-1","article-title":"Dopamine D2 receptor signaling on iMSNs is required for initiation and vigor of learned actions","volume":"45","author":"SM Augustin","year":"2020","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1009854.ref119","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.biopsych.2005.06.005","article-title":"Critical Involvement of Dopaminergic Neurotransmission in Impulsive Decision Making","volume":"60","author":"MM van Gaalen","year":"2006","journal-title":"Biol Psychiatry"},{"key":"pcbi.1009854.ref120","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.tips.2008.01.002","article-title":"The neuropharmacology of impulsive behaviour","volume":"29","author":"T Pattij","year":"2008","journal-title":"Trends Pharmacol Sci"},{"key":"pcbi.1009854.ref121","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1126\/science.1185778","article-title":"Dopaminergic network differences in human impulsivity","volume":"329","author":"JW Buckholtz","year":"2010","journal-title":"Science (80-)"},{"key":"pcbi.1009854.ref122","doi-asserted-by":"crossref","first-page":"8888","DOI":"10.1523\/JNEUROSCI.6028-09.2010","article-title":"Dopamine, time, and impulsivity in humans","volume":"30","author":"A Pine","year":"2010","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref123","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.neuroscience.2012.03.065","article-title":"Dopamine, serotonin and impulsivity","volume":"215","author":"JW Dalley","year":"2012","journal-title":"Neuroscience"},{"key":"pcbi.1009854.ref124","doi-asserted-by":"crossref","first-page":"2057","DOI":"10.1038\/npp.2012.53","article-title":"Norepinephrine and dopamine modulate impulsivity on the five-choice serial reaction time task through opponent actions in the shell and core sub-regions of the nucleus accumbens","volume":"37","author":"D Economidou","year":"2012","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1009854.ref125","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1126\/science.1146157","article-title":"Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism","volume":"318","author":"MJ Frank","year":"2007","journal-title":"Science"},{"key":"pcbi.1009854.ref126","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1016\/j.neuropsychologia.2012.09.014","article-title":"Differential effects of amphetamine and haloperidol on temporal reproduction: Dopaminergic regulation of attention and clock speed","volume":"51","author":"JI Lake","year":"2013","journal-title":"Neuropsychologia"},{"key":"pcbi.1009854.ref127","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1037\/0033-295X.85.2.59","article-title":"A theory of memory retrieval","volume":"85","author":"R. Ratcliff","year":"1978","journal-title":"Psychol Rev"},{"key":"pcbi.1009854.ref128","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1093\/ijnp\/pyy019","article-title":"Dopamine modulates the efficiency of sensory evidence accumulation during perceptual decision making","volume":"21","author":"C Beste","year":"2018","journal-title":"Int J Neuropsychopharmacol"},{"key":"pcbi.1009854.ref129","doi-asserted-by":"crossref","first-page":"9303","DOI":"10.1523\/JNEUROSCI.4452-15.2016","article-title":"Dopamine activation preserves visual motion perception despite noise interference of human v5\/mt","volume":"36","author":"N Yousif","year":"2016","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref130","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1126\/science.aaz5891","article-title":"Dopamine promotes cognitive effort by biasing the benefits versus costs of cognitive work","volume":"367","author":"A Westbrook","year":"2020","journal-title":"Science (80-)"},{"key":"pcbi.1009854.ref131","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fnins.2014.00150","article-title":"The speed-accuracy tradeoff: History, physiology, methodology, and behavior","volume":"8","author":"RP Heitz","year":"2014","journal-title":"Front Neurosci"},{"key":"pcbi.1009854.ref132","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1037\/a0031542","article-title":"A computational model of inhibitory control in frontal cortex and basal ganglia","volume":"120","author":"TV Wiecki","year":"2013","journal-title":"Psychol Rev"},{"key":"pcbi.1009854.ref133","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1004622","article-title":"Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens","volume":"11","author":"K Lloyd","year":"2015","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1009854.ref134","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1016\/j.neunet.2006.03.006","article-title":"Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making","volume":"19","author":"MJ Frank","year":"2006","journal-title":"Neural Netw"},{"key":"pcbi.1009854.ref135","doi-asserted-by":"crossref","first-page":"1462","DOI":"10.1038\/nn.2925","article-title":"Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold","volume":"14","author":"JF Cavanagh","year":"2011","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref136","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1016\/j.cub.2016.01.051","article-title":"Neural Correlates of Decision Thresholds in the Human Subthalamic Nucleus","volume":"26","author":"DM Herz","year":"2016","journal-title":"Curr Biol"},{"key":"pcbi.1009854.ref137","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1038\/377725a0","article-title":"Bee foraging in uncertain environments","author":"PR Montague","year":"1995","journal-title":"Nature"},{"key":"pcbi.1009854.ref138","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1093\/cercor\/bhs348","article-title":"Emergence of complex computational structures from chaotic neural networks through reward-modulated hebbian learning","volume":"24","author":"GM Hoerzer","year":"2014","journal-title":"Cereb Cortex"},{"key":"pcbi.1009854.ref139","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1038\/35036191","article-title":"Is Heterosynaptic modulation essential for stabilizing hebbian plasiticity and memory","volume":"1","author":"CH Bailey","year":"2000","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1009854.ref140","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1162\/0898929052880093","article-title":"Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism","volume":"17","author":"MJ Frank","year":"2005","journal-title":"J Cogn Neurosci"},{"key":"pcbi.1009854.ref141","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fncir.2018.00053","article-title":"Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules","volume":"12","author":"W Gerstner","year":"2018","journal-title":"Front Neural Circuits"},{"key":"pcbi.1009854.ref142","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1016\/S0959-4388(00)00153-7","article-title":"Complementary roles of basal ganglia and cerebellum in learning and motor control","volume":"10","author":"K. Doya","year":"2000","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1009854.ref143","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1000180","article-title":"A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback","volume":"4","author":"R Legenstein","year":"2008","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1009854.ref144","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.34032","article-title":"Motor thalamus supports striatum-driven reinforcement","volume":"7","author":"AL Lalive","year":"2018","journal-title":"Elife"},{"key":"pcbi.1009854.ref145","first-page":"339","volume":"38","author":"SM Mcclure","year":"2003","journal-title":"Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum"},{"key":"pcbi.1009854.ref146","first-page":"452","volume":"304","author":"JO Doherty","year":"2004","journal-title":"Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning"},{"key":"pcbi.1009854.ref147","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1093\/cercor\/bhr117","article-title":"Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI","volume":"22","author":"D Badre","year":"2012","journal-title":"Cereb Cortex"},{"key":"pcbi.1009854.ref148","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms13276","article-title":"Random synaptic feedback weights support error backpropagation for deep learning","volume":"7","author":"TP Lillicrap","year":"2016","journal-title":"Nat Commun"},{"key":"pcbi.1009854.ref149","volume-title":"Computational cognitive neuroscience","author":"RC O\u2019Reilly","year":"2012"},{"key":"pcbi.1009854.ref150","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.conb.2020.11.003","article-title":"Rethinking brain-wide interactions through multi-region \u2018network of networks\u2019 models","volume":"65","author":"MG Perich","year":"2020","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1009854.ref151","doi-asserted-by":"crossref","first-page":"1569","DOI":"10.1126\/science.1211095","article-title":"Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks","volume":"334","author":"TP Vogels","year":"2011","journal-title":"Science (80-)"},{"key":"pcbi.1009854.ref152","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.conb.2016.01.010","article-title":"Why neurons mix: High dimensionality for higher cognition","volume":"37","author":"S Fusi","year":"2016","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1009854.ref153","first-page":"20","volume-title":"Current Opinion in Behavioral Sciences","author":"D Badre","year":"2021"},{"key":"pcbi.1009854.ref154","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.neunet.2020.09.008","article-title":"Learning to select actions shapes recurrent dynamics in the corticostriatal system","volume":"132","author":"CD M\u00e1rton","year":"2020","journal-title":"Neural Networks"},{"key":"pcbi.1009854.ref155","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1037\/0033-295X.109.3.545","article-title":"Dynamic field theory of movement preparation","volume":"109","author":"W Erlhagen","year":"2002","journal-title":"Psychol Rev"},{"key":"pcbi.1009854.ref156","doi-asserted-by":"crossref","first-page":"e1002774","DOI":"10.1371\/journal.pcbi.1002774","article-title":"Sensorimotor Learning Biases Choice Behavior: A Learning Neural Field Model for Decision Making","volume":"8","author":"C Klaes","year":"2012","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1009854.ref157","doi-asserted-by":"crossref","first-page":"9761","DOI":"10.1523\/JNEUROSCI.5605-05.2006","article-title":"Integrated neural processes for defining potential actions and deciding between them: a computational model","volume":"26","author":"P. Cisek","year":"2006","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref158","doi-asserted-by":"crossref","first-page":"e1004104","DOI":"10.1371\/journal.pcbi.1004104","article-title":"A Biologically Plausible Computational Theory for Value Integration and Action Selection in Decisions with Competing Alternatives","volume":"11","author":"V Christopoulos","year":"2015","journal-title":"PLOS Comput Biol"},{"key":"pcbi.1009854.ref159","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1146\/annurev.ne.15.030192.002155","article-title":"The cerebellum and the adaptive coordination of movement","author":"WT Thach","year":"1992","journal-title":"Annual Review of Neuroscience"},{"key":"pcbi.1009854.ref160","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1016\/j.conb.2006.08.016","article-title":"Learning to predict the future: the cerebellum adapts feedforward movement control","author":"AJ Bastian","year":"2006","journal-title":"Current Opinion in Neurobiology"},{"key":"pcbi.1009854.ref161","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1038\/s41593-018-0310-2","article-title":"Task representations in neural networks trained to perform many cognitive tasks","volume":"22","author":"GR Yang","year":"2019","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref162","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1016\/j.neuron.2020.11.024","article-title":"Entorhinal and ventromedial prefrontal cortices abstract and generalize the structure of reinforcement learning problems","volume":"109","author":"AB Baram","year":"2021","journal-title":"Neuron"},{"key":"pcbi.1009854.ref163","doi-asserted-by":"crossref","first-page":"1249","DOI":"10.1016\/j.cell.2020.10.024","article-title":"The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation","volume":"183","author":"JCR Whittington","year":"2020","journal-title":"Cell"},{"key":"pcbi.1009854.ref164","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1016\/j.cognition.2016.04.002","article-title":"Neural signature of hierarchically structured expectations predicts clustering and transfer of rule sets in reinforcement learning","volume":"152","author":"AGE Collins","year":"2016","journal-title":"Cognition"},{"key":"pcbi.1009854.ref165","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1008317","article-title":"Reward-predictive representations generalize across tasks in reinforcement learning","volume":"16","author":"L Lehnert","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1009854.ref166","doi-asserted-by":"crossref","first-page":"2141","DOI":"10.1073\/pnas.85.7.2141","article-title":"Neural networks counting chimes","volume":"85","author":"DJ Amit","year":"1988","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1009854.ref167","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1162\/089976606775093909","article-title":"Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia","volume":"18","author":"RC O\u2019Reilly","year":"2006","journal-title":"Neural Comput"},{"key":"pcbi.1009854.ref168","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.1162\/NECO_a_00270","article-title":"Reinforcement-based decision making in corticostriatal circuits: Mutual constraints by neurocomputational and diffusion models","volume":"24","author":"R Ratcliff","year":"2012","journal-title":"Neural Comput"},{"key":"pcbi.1009854.ref169","first-page":"568733","article-title":"The caudate nucleus contributes causally to decisions that balance reward and uncertain visual information","volume":"9","author":"T Doi","year":"2020","journal-title":"Elife"},{"key":"pcbi.1009854.ref170","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0301-0082(96)00042-1","article-title":"The basal ganglia: Focused selection and inhibition of competing motor programs","volume":"50","author":"JW Mink","year":"1996","journal-title":"Prog Neurobiol"},{"key":"pcbi.1009854.ref171","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/0166-2236(90)90107-L","article-title":"Functional architecture of basal ganglia circuits: neural substrates of parallel processing","author":"GE Alexander","year":"1990","journal-title":"Trends in Neurosciences"},{"key":"pcbi.1009854.ref172","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.12029","article-title":"A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning","volume":"4","author":"NT Franklin","year":"2015","journal-title":"Elife"},{"key":"pcbi.1009854.ref173","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1016\/j.neuron.2017.08.028","article-title":"Inhibitory Basal Ganglia Inputs Induce Excitatory Motor Signals in the Thalamus","volume":"95","author":"J Kim","year":"2017","journal-title":"Neuron"},{"key":"pcbi.1009854.ref174","doi-asserted-by":"crossref","first-page":"956","DOI":"10.1038\/nn1722","article-title":"Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks","volume":"9","author":"CC Lo","year":"2006","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref175","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1038\/nature22073","article-title":"Thalamic amplification of cortical connectivity sustains attentional control","volume":"545","author":"LI Schmitt","year":"2017","journal-title":"Nature"},{"key":"pcbi.1009854.ref176","doi-asserted-by":"crossref","first-page":"5504","DOI":"10.1523\/JNEUROSCI.5493-07.2008","article-title":"Recurrent collateral connections of striatal medium spiny neurons are disrupted in models of Parkinson\u2019s disease","volume":"28","author":"S Taverna","year":"2008","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref177","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1016\/j.neuron.2016.04.031","article-title":"Dopamine Regulation of Lateral Inhibition between Striatal Neurons Gates the Stimulant Actions of Cocaine","volume":"90","author":"LKK Dobbs","year":"2016","journal-title":"Neuron"},{"key":"pcbi.1009854.ref178","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1038\/nn1634","article-title":"Activity in prefrontal cortex during dynamic selection of action sequences","volume":"9","author":"BB Averbeck","year":"2006","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref179","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1523\/JNEUROSCI.4803-08.2009","article-title":"Monkey Supplementary Eye Field Neurons Signal the Ordinal Position of Both Actions and Objects","volume":"29","author":"TK Berdyyeva","year":"2009","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref180","doi-asserted-by":"crossref","first-page":"3054","DOI":"10.1152\/jn.00367.2003","article-title":"Contrasting Neuronal Activity in the Supplementary and Frontal Eye Fields during Temporal Organization of Multiple Saccades","volume":"90","author":"M Isoda","year":"2003","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref181","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1152\/jn.01201.2003","article-title":"Participation of the primate presupplementary motor area in sequencing multiple saccades","volume":"92","author":"M Isoda","year":"2004","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref182","doi-asserted-by":"crossref","first-page":"2148","DOI":"10.1152\/jn.2000.84.4.2148","article-title":"Neuronal activity in the supplementary and presupplementary motor areas for temporal organization of multiple movements","volume":"84","author":"K Shima","year":"2000","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref183","doi-asserted-by":"crossref","first-page":"1562","DOI":"10.1152\/jn.1998.80.3.1562","article-title":"Movement sequence-related activity reflecting numerical order of components in supplementary and presupplementary motor areas","volume":"80","author":"WT Clower","year":"1998","journal-title":"J Neurophysiol"},{"key":"pcbi.1009854.ref184","doi-asserted-by":"crossref","first-page":"4369","DOI":"10.1523\/JNEUROSCI.0164-09.2009","article-title":"Rank-Order-Selective Neurons Form a Temporal Basis Set for the Generation of Motor Sequences","volume":"29","author":"E. Salinas","year":"2009","journal-title":"J Neurosci"},{"key":"pcbi.1009854.ref185","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1016\/j.bbr.2010.09.015","article-title":"The impact of basal ganglia lesions on sensorimotor synchronization, spontaneous motor tempo, and the detection of tempo changes","volume":"216","author":"M Schwartze","year":"2011","journal-title":"Behav Brain Res"},{"key":"pcbi.1009854.ref186","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fncom.2013.00194","article-title":"Time representation in reinforcement learning models of the basal ganglia","volume":"7","author":"SJ Gershman","year":"2014","journal-title":"Front Comput Neurosci"},{"key":"pcbi.1009854.ref187","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1163\/22134468-00002009","article-title":"Contributions of the Basal Ganglia to Temporal Processing: Evidence from Parkinson\u2019s Disease","volume":"2","author":"CRG Jones","year":"2014","journal-title":"Timing Time Percept"},{"key":"pcbi.1009854.ref188","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1016\/j.neuron.2017.07.039","article-title":"The Basal Ganglia Do Not Select Reach Targets but Control the Urgency of Commitment","volume":"95","author":"D Thura","year":"2017","journal-title":"Neuron"},{"key":"pcbi.1009854.ref189","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1016\/j.neuron.2018.03.045","article-title":"The Neural Basis of Timing: Distributed Mechanisms for Diverse Functions","volume":"98","author":"JJ Paton","year":"2018","journal-title":"Neuron"},{"key":"pcbi.1009854.ref190","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/PL00007984","article-title":"A computational model of action selection in the basal ganglia. I. A new functional anatomy","volume":"84","author":"K Gurney","year":"2001","journal-title":"Biol Cybern"},{"key":"pcbi.1009854.ref191","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1146\/annurev.ne.09.030186.002041","article-title":"Parallel organization of functionally segregated circuits linking basal ganglia and cortex","volume":"VOL. 9","author":"GE Alexander","year":"1986","journal-title":"Annu Rev Neurosci"},{"key":"pcbi.1009854.ref192","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1038\/nature13186","article-title":"A mesoscale connectome of the mouse brain","volume":"508","author":"SW Oh","year":"2014","journal-title":"Nature"},{"key":"pcbi.1009854.ref193","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1038\/nn.4332","article-title":"The mouse cortico-striatal projectome","volume":"19","author":"H Hintiryan","year":"2016","journal-title":"Nat Neurosci"},{"key":"pcbi.1009854.ref194","doi-asserted-by":"crossref","first-page":"1","DOI":"10.7554\/eLife.19103","article-title":"A comprehensive excitatory input map of the striatum reveals novel functional organization","volume":"5","author":"BJ Hunnicutt","year":"2016","journal-title":"Elife"},{"key":"pcbi.1009854.ref195","doi-asserted-by":"crossref","DOI":"10.1038\/s41586-020-03166-8","article-title":"Striatal activity topographically reflects cortical activity","volume":"591","author":"AJ Peters","year":"2021","journal-title":"Nature"},{"key":"pcbi.1009854.ref196","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1093\/cercor\/13.2.162","article-title":"Foot, hand, face and eye representation in the human striatum","volume":"13","author":"E Gerardin","year":"2003","journal-title":"Cereb Cortex"},{"key":"pcbi.1009854.ref197","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1016\/j.tins.2005.06.006","article-title":"Subcortical loops through the basal ganglia","volume":"28","author":"JG McHaffie","year":"2005","journal-title":"Trends Neurosci"},{"key":"pcbi.1009854.ref198","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1038\/nature12077","article-title":"Corticostriatal neurons in auditory cortex drive decisions during auditory discrimination","volume":"497","author":"P Znamenskiy","year":"2013","journal-title":"Nature"},{"key":"pcbi.1009854.ref199","doi-asserted-by":"crossref","first-page":"1320","DOI":"10.1016\/j.cell.2015.04.049","article-title":"A corticostriatal path targeting striosomes controls decision-making under conflict","volume":"161","author":"A Friedman","year":"2015","journal-title":"Cell"},{"key":"pcbi.1009854.ref200","doi-asserted-by":"crossref","first-page":"1312","DOI":"10.1016\/j.neuron.2016.04.043","article-title":"Endocannabinoid Modulation of Orbitostriatal Circuits Gates Habit Formation","volume":"90","author":"CM Gremel","year":"2016","journal-title":"Neuron"},{"key":"pcbi.1009854.ref201","article-title":"Topographic precision in sensory and motor corticostriatal projections varies across cell type and cortical area","volume":"9","author":"BM Hooks","year":"2018","journal-title":"Nat Commun"},{"key":"pcbi.1009854.ref202","article-title":"Anatomically segregated basal ganglia pathways allow parallel behavioral modulation","author":"J Lee","year":"2020","journal-title":"Nat Neurosci"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009854","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T00:00:00Z","timestamp":1644796800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009854","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,14]],"date-time":"2022-02-14T14:09:09Z","timestamp":1644847749000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009854"}},"subtitle":[],"editor":[{"given":"Samuel J.","family":"Gershman","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2022,2,2]]},"references-count":202,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2,2]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009854","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.04.07.438842","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,2]]}}}