{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,18]],"date-time":"2026-10-18T23:11:47Z","timestamp":1792365107696,"version":"4.4.0"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011024","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,4,13]],"date-time":"2023-04-13T00:00:00Z","timestamp":1681344000000}}],"reference-count":109,"publisher":"Public Library of Science (PLoS)","issue":"4","license":[{"start":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T00:00:00Z","timestamp":1680480000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"DFG SFB 1410 Hybrid Societies","award":["416228727"],"award-info":[{"award-number":["416228727"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Motor learning involves a widespread brain network including the basal ganglia, cerebellum, motor cortex, and brainstem. Despite its importance, little is known about how this network learns motor tasks and which role different parts of this network take. We designed a systems-level computational model of motor learning, including a cortex-basal ganglia motor loop and the cerebellum that both determine the response of central pattern generators in the brainstem. First, we demonstrate its ability to learn arm movements toward different motor goals. Second, we test the model in a motor adaptation task with cognitive control, where the model replicates human data. We conclude that the cortex-basal ganglia loop learns via a novelty-based motor prediction error to determine concrete actions given a desired outcome, and that the cerebellum minimizes the remaining aiming error.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1011024","type":"journal-article","created":{"date-parts":[[2023,4,3]],"date-time":"2023-04-03T14:11:43Z","timestamp":1680531103000},"page":"e1011024","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":37,"title":["The contribution of the basal ganglia and cerebellum to motor learning: A neuro-computational approach"],"prefix":"10.1371","volume":"19","author":[{"given":"Javier","family":"Baladron","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julien","family":"Vitay","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Torsten","family":"Fietzek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9104-7143","authenticated-orcid":true,"given":"Fred H.","family":"Hamker","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2023,4,3]]},"reference":[{"key":"pcbi.1011024.ref001","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1007\/s10928-020-09723-y","article-title":"An integrative model of Parkinson\u2019s disease treatment including levodopa pharmacokinetics, dopamine kinetics, basal ganglia neurotransmission and motor action throughout disease progression","volume":"48","author":"F V\u00e9ronneau-Veilleux","year":"2021","journal-title":"Journal of Pharmacokinetics and Pharmacodynamics"},{"key":"pcbi.1011024.ref002","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1111\/ejn.14868","article-title":"A computational model-based analysis of basal ganglia pathway changes in Parkinson\u2019s disease inferred from resting-state fMRI","volume":"53","author":"O Maith","year":"2021","journal-title":"European Journal of Neuroscience"},{"key":"pcbi.1011024.ref003","doi-asserted-by":"crossref","DOI":"10.3389\/fpsyg.2019.03088","article-title":"Involvement of the cortico-basal ganglia-thalamocortical loop in developmental stuttering","volume":"10","author":"SE Chang","year":"2020","journal-title":"Frontiers in Psychology"},{"key":"pcbi.1011024.ref004","first-page":"1","article-title":"Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy","author":"H Schroll","year":"2013","journal-title":"Frontiers in Systems Neuroscience"},{"key":"pcbi.1011024.ref005","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/PL00007984","article-title":"A computational model of action selection in the basal ganglia. I. A new functional anatomy","volume":"84","author":"K Gurney","year":"2001","journal-title":"Biological Cybernetics"},{"key":"pcbi.1011024.ref006","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.conb.2011.02.013","article-title":"Computational models of motivated action selection in corticostriatal circuits","volume":"21","author":"MJ Frank","year":"2011","journal-title":"Current Opinion in Neurobiology"},{"issue":"12","key":"pcbi.1011024.ref007","doi-asserted-by":"crossref","first-page":"1563","DOI":"10.1111\/ejn.13960","article-title":"Aberrant learning in Parkinson\u2019s disease: A neurocomputational study on bradykinesia","volume":"47","author":"M Ursino","year":"2018","journal-title":"European Journal of Neuroscience"},{"key":"pcbi.1011024.ref008","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0301-0082(96)00042-1","article-title":"The Basal Ganglia: focused selection and inhibition of competing motor programs","volume":"50","author":"JW Mink","year":"1996","journal-title":"Progress in Neurobiology"},{"key":"pcbi.1011024.ref009","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neunet.2015.03.002","article-title":"A spiking neural network based on the basal ganglia functional anatomy","volume":"67","author":"J Baladron","year":"2015","journal-title":"Neural Network"},{"key":"pcbi.1011024.ref010","doi-asserted-by":"crossref","first-page":"12921","DOI":"10.1523\/JNEUROSCI.3486-06.2006","article-title":"A Physiologically Plausible Model of Action Selection and Oscillatory Activity in the Basal Gangliar","volume":"26","author":"MD Humphries","year":"2006","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1011024.ref011","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1007\/PL00007985","article-title":"A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour","volume":"84","author":"K Gurney","year":"2001","journal-title":"Biological Cybernetics"},{"key":"pcbi.1011024.ref012","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1037\/a0031542","article-title":"A Computational Model of Inhibitory Control in Frontal Cortex and Basal Ganglia","volume":"120","author":"TV Wiecki","year":"2013","journal-title":"Psychological Review"},{"key":"pcbi.1011024.ref013","doi-asserted-by":"crossref","first-page":"1120","DOI":"10.1016\/j.neunet.2006.03.006","article-title":"Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making","volume":"19","author":"MJ Frank","year":"2006","journal-title":"Neural Networks"},{"key":"pcbi.1011024.ref014","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1162\/NECO_a_00073","article-title":"Modeling basal ganglia for understanding Parkinsonian reaching movements","volume":"23","author":"KN Magdoom","year":"2011","journal-title":"Neural Computation"},{"key":"pcbi.1011024.ref015","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0075657","article-title":"Do basal Ganglia amplify willed action by stochastic resonance? A model","volume":"8","author":"VS Chakravarthy","year":"2013","journal-title":"PLOS ONE"},{"key":"pcbi.1011024.ref016","first-page":"19","article-title":"Reward Based Motor Adaptation Mediated by Basal Ganglia","volume":"11","author":"T Kim","year":"2017","journal-title":"Frontiers in Computational Neuroscience"},{"key":"pcbi.1011024.ref017","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1007\/s00422-015-0662-6","article-title":"Selection of cortical dynamics for motor behaviour by the basal ganglia","volume":"109","author":"F Mannella","year":"2015","journal-title":"Biological cybernetics"},{"key":"pcbi.1011024.ref018","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1176\/jnp.16.3.367","article-title":"Disorders of the Cerebellum: Ataxia, Dysmetria of Thought, and the Cerebellar Cognitive Affective Syndrome","volume":"16","author":"JD Schmahmann","year":"2004","journal-title":"The Journal of Neuropsychiatry and Clinical Neuroscience"},{"key":"pcbi.1011024.ref019","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1007\/s00221-002-1191-9","article-title":"Cerebellar subjects show impaired coupling of reach and grasp movements","volume":"146","author":"KM Zackowski","year":"2002","journal-title":"Experimental Brain Research"},{"key":"pcbi.1011024.ref020","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1007\/s12311-021-01281-4","article-title":"Mini\u2011review: The Role of the Cerebellum in Visuomotor Adaptation","volume":"21","author":"E Tzvi","year":"2022","journal-title":"The Cerebellum"},{"key":"pcbi.1011024.ref021","doi-asserted-by":"crossref","first-page":"1961","DOI":"10.1152\/jn.91069.2008","article-title":"Adaptation to Visuomotor Rotation and Force Field Perturbation Is Correlated to Different Brain Areas in Patients With Cerebellar Degeneration","volume":"101","author":"K Rabe","year":"2009","journal-title":"J Neurophysiol"},{"key":"pcbi.1011024.ref022","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1152\/jn.00007.2011","article-title":"Cerebellar regions involved in adaptation to force field and visuomotor perturbation","volume":"107","author":"O Donchin","year":"2012","journal-title":"J Neurophysiol"},{"key":"pcbi.1011024.ref023","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1007\/s12311-014-0620-1","article-title":"Cerebellum and Apraxia","volume":"14","author":"P Mari\u00ebn","year":"2015","journal-title":"Cerebellum"},{"key":"pcbi.1011024.ref024","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1016\/j.ejpn.2012.05.005","article-title":"Developmental coordination disorder: A review and update","volume":"16","author":"JG Zwicker","year":"2012","journal-title":"European Journal of Paediatric Neurology"},{"key":"pcbi.1011024.ref025","doi-asserted-by":"crossref","first-page":"4744","DOI":"10.1109\/TCYB.2019.2899246","article-title":"VOR Adaptation on a Humanoid iCub Robot Using a Spiking Cerebellar Model","volume":"50","author":"F Naveros","year":"2020","journal-title":"IEEE Transactions on Cybernetics"},{"key":"pcbi.1011024.ref026","doi-asserted-by":"crossref","first-page":"62","DOI":"10.2991\/jrnal.2017.4.1.14","article-title":"A Combination of Machine Learning and Cerebellar-like Neural Networks for the Motor Control and Motor Learning of the Fable Modular Robot","volume":"4","author":"IB Ojeda","year":"2017","journal-title":"Journal of Robotics, Networking and Artificial Life"},{"key":"pcbi.1011024.ref027","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0112265","article-title":"Adaptive Robotic Control Driven by a Versatile Spiking Cerebellar Network","volume":"09","author":"C Casellato","year":"2014","journal-title":"PLOS One"},{"key":"pcbi.1011024.ref028","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.neunet.2013.01.019","article-title":"Realtime cerebellum: A large-scale spiking network model of the cerebellum that runs in realtime using a graphics processing unit","volume":"47","author":"T Yamazaki","year":"2013","journal-title":"Neural Network"},{"key":"pcbi.1011024.ref029","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.biosystems.2008.05.008","article-title":"A real-time spiking cerebellum model for learning robot control","volume":"94","author":"RR Carrillo","year":"2008","journal-title":"BioSystems"},{"key":"pcbi.1011024.ref030","doi-asserted-by":"crossref","first-page":"2201","DOI":"10.1098\/rstb.2008.2272","article-title":"From \u2018Understanding the Brain by Creating the Brain\u2019 towards manipulative neuroscience","volume":"363","author":"M Kawato","year":"2008","journal-title":"Philosophical Transactions of the Royal Society B"},{"key":"pcbi.1011024.ref031","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2019\/4862157","article-title":"Control of a humanoid nao robot by an adaptive bioinspired cerebellar module in 3d motion tasks","author":"A Antonietti","year":"2019","journal-title":"Computational intelligence and neuroscience"},{"key":"pcbi.1011024.ref032","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1016\/S0959-4388(00)00153-7","article-title":"Complementary roles of basal ganglia and cerebellum in learning and motor control","volume":"10","author":"K Doya","year":"2000","journal-title":"Current Opinion Neurobiology"},{"key":"pcbi.1011024.ref033","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.neubiorev.2019.02.008","article-title":"The super-learning hypothesis: Integrating learning processes across cortex, cerebellum and basal ganglia","volume":"100","author":"D Caligiore","year":"2019","journal-title":"Neuroscience and Behavioral Reviews"},{"key":"pcbi.1011024.ref034","doi-asserted-by":"crossref","first-page":"1573","DOI":"10.1098\/rstb.2007.2063","article-title":"Action selection and refinement in subcortical loops through basal ganglia and cerebellum","volume":"362","author":"JC Houk","year":"2007","journal-title":"Phil Trans R Soc B"},{"key":"pcbi.1011024.ref035","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/s12311-016-0763-3","article-title":"Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex","volume":"16","author":"D Caligiore","year":"2017","journal-title":"Cerebellum"},{"key":"pcbi.1011024.ref036","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1005395","article-title":"Dysfunctions of the basal ganglia-cerebellar-thalamo-cortical system produce motor tics in Tourette syndrome","volume":"13","author":"D Caligiore","year":"2017","journal-title":"PLOS Computational biology"},{"key":"pcbi.1011024.ref037","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-019-13239-6","article-title":"Hierarchical motor control in mammals and machines","volume":"10","author":"J Merel","year":"2019","journal-title":"Nature Communications"},{"key":"pcbi.1011024.ref038","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1038\/s41583-018-0002-7","article-title":"The basal ganglia and the cerebellum: nodes in an integrated network","volume":"19","author":"AC Bostan","year":"2018","journal-title":"Nature Reviews Neuroscience volume"},{"key":"pcbi.1011024.ref039","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/s00221-008-1280-5","article-title":"Computational neuroanatomy for motor control","volume":"185","author":"R Shadmehr","year":"2008","journal-title":"Experimental Brain Research"},{"key":"pcbi.1011024.ref040","doi-asserted-by":"crossref","first-page":"4230","DOI":"10.1523\/JNEUROSCI.6353-11.2012","article-title":"Cerebellar contributions to reach adaptation and learning sensory consequences of action","volume":"21","author":"J Izawa","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1011024.ref041","doi-asserted-by":"crossref","first-page":"1823","DOI":"10.1162\/jocn_a_01602","article-title":"A Revised Computational Neuroanatomy for Motor Control","volume":"32","author":"S Haar","year":"2020","journal-title":"Journal of Cognitive Neuroscience"},{"key":"pcbi.1011024.ref042","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1002\/hipo.23167","article-title":"Learning, memory and consolidation mechanisms for behavioral control in hierarchically organized cortico-basal ganglia systems","volume":"30","author":"SI Rusu","year":"2020","journal-title":"Hippocampus"},{"key":"pcbi.1011024.ref043","volume":"12","author":"A Dezfouli","year":"2013","journal-title":"sd. PLoS Computational Biology"},{"key":"pcbi.1011024.ref044","doi-asserted-by":"crossref","first-page":"4613","DOI":"10.1111\/ejn.14730","article-title":"Habit learning in hierarchical cortex-basal ganglia loops","volume":"52","author":"J Baladron","year":"2020","journal-title":"European Journal of Neuroscience"},{"key":"pcbi.1011024.ref045","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1007\/s00422-007-0142-8","article-title":"The role of the striatum in adaptation learning: a computational model","volume":"96","author":"M Grosse-Wentrup","year":"2007","journal-title":"Biological Cybernetics"},{"key":"pcbi.1011024.ref046","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1162\/jocn.1993.5.4.408","article-title":"A self-organizing neural model of motor equivalent reaching and tool use by a multijoint arm","volume":"5","author":"D Bullock","year":"1993","journal-title":"Journal of Cognitive Neuroscience"},{"key":"pcbi.1011024.ref047","article-title":"Interactions between supervised and reinforcement learning processes in a neurorobotic model","author":"A Capirchio","year":"2022","journal-title":"bioRxiv"},{"key":"pcbi.1011024.ref048","first-page":"1","article-title":"The interplay between cerebellum and basal ganglia in motor adaptation: A modeling study","author":"DI Todorov","year":"2019","journal-title":"Plos One"},{"key":"pcbi.1011024.ref049","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1023\/A:1008869411135","article-title":"Oscillatory Mechanisms in Pairs of Neurons Connected with Fast Inhibitory Synapses","volume":"4","author":"P Rowat","year":"1997","journal-title":"Journal of Computational Neuroscience"},{"key":"pcbi.1011024.ref050","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780198524052.001.0001","volume-title":"Neuronal control of locomotion: from Mollusc to Man","author":"GN Orlovsky","year":"1999"},{"key":"pcbi.1011024.ref051","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1111\/j.1749-6632.1998.tb09062.x","article-title":"Evidence for a spinal central pattern generator in humans","volume":"860","author":"M Dimitrijevic","year":"1998","journal-title":"Annals of the New York Academy of Sciences"},{"key":"pcbi.1011024.ref052","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.brainresrev.2007.08.006","article-title":"Organization of mammalian locomotor rhythm and pattern generation","volume":"57","author":"D McCrea","year":"2008","journal-title":"Brain research reviews"},{"key":"pcbi.1011024.ref053","doi-asserted-by":"crossref","first-page":"14476","DOI":"10.1523\/JNEUROSCI.1908-15.2015","article-title":"Similar motor cortical control mechanisms for precise limb control during reaching and locomotion","volume":"35","author":"S Yakovenko","year":"2015","journal-title":"The Journal of Neuroscience"},{"key":"pcbi.1011024.ref054","doi-asserted-by":"crossref","first-page":"1209","DOI":"10.1126\/science.2675307","article-title":"Visuomotor coordination in reaching and locomotion","volume":"245","author":"A Georgopoulos","year":"1989","journal-title":"Science"},{"key":"pcbi.1011024.ref055","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1016\/S0167-9457(00)00028-2","article-title":"Interaction of rhythmic and discrete pattern generators in single-joint movements","volume":"19","author":"D Sternad","year":"2000","journal-title":"Human Movement Science"},{"key":"pcbi.1011024.ref056","first-page":"1","article-title":"Networking brainstem and basal ganglia circuits for movement","author":"S Arber","year":"2022","journal-title":"Nature Review Neuroscience"},{"key":"pcbi.1011024.ref057","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1146\/annurev-neuro-070918-050201","article-title":"Brainstem Circuits Controlling Action Diversification","volume":"42","author":"L Ruder","year":"2019","journal-title":"Annu Rev Neurosci"},{"key":"pcbi.1011024.ref058","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1109\/TCDS.2019.2896300","article-title":"Concrete Action Representation Model: from Neuroscience to Robotics","volume":"12","author":"J Nassour","year":"2019","journal-title":"IEEE Transactions on Cognitive and Developmental Systems"},{"key":"pcbi.1011024.ref059","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s10514-011-9235-2","article-title":"Toward simple control for complex, autonomous robotic applications: combining discrete and rhythmic motor primitives","volume":"31","author":"S Degallier","year":"2011","journal-title":"Autonomous Robots"},{"key":"pcbi.1011024.ref060","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1126\/science.1254486","article-title":"Biorobotics: using robots to emulate and investigate agile locomotion","volume":"346","author":"A Ijspeert","year":"2014","journal-title":"Science"},{"key":"pcbi.1011024.ref061","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1126\/science.1138353","article-title":"From swimming to walking with a salamander robot driven by a spinal cord model","volume":"315","author":"A Ijspeert","year":"2007","journal-title":"Science"},{"issue":"3","key":"pcbi.1011024.ref062","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1007\/s00422-014-0592-8","article-title":"Multi-layered multi-pattern CPG for adaptive locomotion of humanoid robots","volume":"108","author":"J Nassour","year":"2014","journal-title":"Biol Cybern"},{"key":"pcbi.1011024.ref063","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1016\/j.conb.2005.10.011","article-title":"Motor primitives in vertebrates and invertebrates","volume":"15","author":"T Flash","year":"2005","journal-title":"Current Opinion in Neurobiology"},{"key":"pcbi.1011024.ref064","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1016\/j.neuron.2012.10.018","article-title":"Microstimulation Activates a Handful of Muscle Synergies","volume":"76","author":"SA Overduin","year":"2012","journal-title":"Neuron"},{"key":"pcbi.1011024.ref065","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.neunet.2019.03.005","article-title":"Recent advances in physical reservoir computing: A review","volume":"115","author":"G Tanaka","year":"2019","journal-title":"Neural Networks"},{"key":"pcbi.1011024.ref066","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.neunet.2007.04.004","article-title":"The cerebellum as a liquid state machine","volume":"20","author":"T Yamazaki","year":"2007","journal-title":"Neural Networks"},{"key":"pcbi.1011024.ref067","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.neunet.2020.12.020","article-title":"Chaos may enhance expressivity in cerebellar granular layer","volume":"136","author":"K Tokuda","year":"2021","journal-title":"Neural Networks"},{"issue":"10","key":"pcbi.1011024.ref068","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1004515","article-title":"At the Edge of Chaos: How Cerebellar Granular Layer Network Dynamics Can Provide the Basis for Temporal Filters","volume":"11","author":"C R\u00f6ssert","year":"2015","journal-title":"PLOS Computational Biology"},{"key":"pcbi.1011024.ref069","doi-asserted-by":"crossref","unstructured":"Schmid K, Vitay J, Hamker FH. Forward Models in the Cerebellum Using Reservoirs and Perturbation Learning. In: 2019 Conference on Cognitive Computational Neuroscience. Berlin, Germany: Cognitive Computational Neuroscience; 2019.","DOI":"10.32470\/CCN.2019.1139-0"},{"key":"pcbi.1011024.ref070","first-page":"1","article-title":"Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks","author":"T Miconi","year":"2017","journal-title":"eLife"},{"key":"pcbi.1011024.ref071","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1007\/s00429-021-02446-x","article-title":"Enhanced habit formation in Tourette patients explained by shortcut modulation in a hierarchical cortico-basal ganglia model","volume":"227","author":"C Scholl","year":"2022","journal-title":"Brain Structure & Function"},{"key":"pcbi.1011024.ref072","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1016\/S0306-4522(00)00019-1","article-title":"Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events","volume":"96","author":"JC Horvitz","year":"2000","journal-title":"Neuroscience"},{"key":"pcbi.1011024.ref073","first-page":"371","volume-title":"Oxford Handbook of Human Action","author":"B Hommel","year":"2009"},{"key":"pcbi.1011024.ref074","article-title":"Where do action goals come from? Evidence for spontaneous action effect binding in infants","author":"SA Verschoor","year":"2010","journal-title":"Frontiers in Psychology"},{"key":"pcbi.1011024.ref075","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1007\/s00426-021-01563-w","article-title":"GOALIATH: a theory of goal\u2011directed behavior","volume":"86","author":"B Hommel","year":"2022","journal-title":"Psychological Research"},{"key":"pcbi.1011024.ref076","doi-asserted-by":"crossref","first-page":"9551","DOI":"10.1523\/JNEUROSCI.0874-18.2018","article-title":"On the Role of Cortex-Basal Ganglia Interactions for Category Learning: A Neurocomputational Approach","volume":"31","author":"F Villagrasa","year":"2018","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1011024.ref077","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1111\/ejn.12434","article-title":"Dysfunctional and compensatory synaptic plasticity in parkinsons disease","volume":"39","author":"H Schroll","year":"2014","journal-title":"European Journal of Neuroscience"},{"key":"pcbi.1011024.ref078","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1111\/ejn.13666","article-title":"The subthalamic nucleus\u2014external globus pallidus loop biases exploratory decisions towards known alternatives: A neuro-computational study","volume":"49","author":"J Baladron","year":"2019","journal-title":"European Journal of Neuroscience"},{"key":"pcbi.1011024.ref079","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1002\/cphy.c170043","article-title":"Motor Learning","volume":"9","author":"JW Krakauer","year":"2019","journal-title":"Comprehensive Physiology"},{"key":"pcbi.1011024.ref080","doi-asserted-by":"crossref","first-page":"3642","DOI":"10.1523\/JNEUROSCI.5317-05.2006","article-title":"An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation","volume":"26","author":"P Mazzoni","year":"2006","journal-title":"The Journal of Neuroscience"},{"key":"pcbi.1011024.ref081","doi-asserted-by":"crossref","first-page":"7428","DOI":"10.1073\/pnas.1716489115","article-title":"Tandem internal models execute motor learning in the cerebellum","volume":"115","author":"T Honda","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1011024.ref082","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1523\/ENEURO.0170-18.2018","article-title":"Individual Differences in Motor Noise and Adaptation Rate Are Optimally Related","volume":"5","author":"R van der Vliet","year":"2018","journal-title":"eNeuro"},{"key":"pcbi.1011024.ref083","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1038\/nn.3616","article-title":"Temporal structure of motor variability is dynamically regulated and predicts motor learning ability","volume":"17","author":"HG Wu","year":"2014","journal-title":"Nature Neuroscience"},{"key":"pcbi.1011024.ref084","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1038\/nn.3633","article-title":"Motor variability is not noise, but grist for the learning mill","volume":"17","author":"DJ Herzfeld","year":"2014","journal-title":"Nature Neuroscience"},{"key":"pcbi.1011024.ref085","doi-asserted-by":"crossref","unstructured":"Zahra O, Navarro-Alarcon D, Tolu S. A fully spiking neural control system based on cerebellar predictive learning for sensor-guided robots. In: 2021 IEEE International Conference on Robotics and Automation (ICRA); 2021.","DOI":"10.1109\/ICRA48506.2021.9561127"},{"key":"pcbi.1011024.ref086","article-title":"A neurorobotic embodiment for exploring the dynamical interactions of a spiking cerebellar model and a robot arm during vision-based manipulation tasks","volume":"32","author":"O Zahra","year":"2021","journal-title":"International Journal of Neural Systems"},{"key":"pcbi.1011024.ref087","article-title":"Interactions between sensory prediction error and task error during implicit motor learning","volume":"23","author":"J Tsay","year":"2022","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1011024.ref088","article-title":"Competition between parallel sensorimotor learning systems","author":"ST Albert","year":"2022","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1011024.ref089","article-title":"Visuomotor Learning Generalizes Around the Intended Movement","volume":"29","author":"K Day","year":"2016","journal-title":"eNeuro"},{"key":"pcbi.1011024.ref090","doi-asserted-by":"crossref","first-page":"2747","DOI":"10.1523\/JNEUROSCI.2125-20.2021","article-title":"Did We Get Sensorimotor Adaptation Wrong? Implicit Adaptation as Direct Policy Updating Rather than Forward-Model-Based Learning","volume":"24","author":"AM Hadjiosif","year":"2021","journal-title":"The Journal of Neuroscience"},{"key":"pcbi.1011024.ref091","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1016\/j.tics.2019.06.008","article-title":"Moving Forward: On the Limits of Motor-Based Forward Models","volume":"23","author":"M Dogge","year":"2019","journal-title":"Trends in Cognitive Science"},{"key":"pcbi.1011024.ref092","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1016\/j.neuron.2010.11.022","article-title":"Dopamine in motivational control: rewarding, aversive, and alerting","volume":"68","author":"ES Bromberg-Martin","year":"2010","journal-title":"Neuron"},{"key":"pcbi.1011024.ref093","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1001096","article-title":"Flexible Cognitive Strategies during Motor Learning","volume":"7","author":"JA Taylor","year":"2011","journal-title":"PLOS Computational Biology"},{"key":"pcbi.1011024.ref094","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1002\/jnr.24587","article-title":"Heterogeneity in striatal dopamine circuits: Form and function in dynamic reward seeking","author":"AL Collins","year":"2020","journal-title":"Journal of Neuroscience Research"},{"key":"pcbi.1011024.ref095","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1038\/s41583-018-0002-7","article-title":"The basal ganglia and the cerebellum: nodes in an integrated network","volume":"19","author":"AC Bostan","year":"2018","journal-title":"Nature Review Neuroscience"},{"key":"pcbi.1011024.ref096","doi-asserted-by":"crossref","first-page":"1776","DOI":"10.1152\/japplphysiol.00515.2006","article-title":"Motor training induces experience-specific patterns of plasticity across motor cortex and spinal cord","volume":"101","author":"DL Adkins","year":"2006","journal-title":"Journal of Applied Physiology"},{"key":"pcbi.1011024.ref097","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1177\/1073858405278015","article-title":"In Search of the Motor Engram: Motor Map Plasticity as a Mechanism for Encoding Motor Experience","volume":"11","author":"MH Monfils","year":"2005","journal-title":"The Neuroscientist"},{"key":"pcbi.1011024.ref098","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1101\/lm.4.1.63","article-title":"Cerebellar Guidance of Premotor Network Development and Sensorimotor Learning","volume":"4","author":"SE Hua","year":"1997","journal-title":"Learning & Memory"},{"key":"pcbi.1011024.ref099","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1016\/j.neuroimage.2005.02.041","article-title":"Cerebellum and M1 interaction during early learning of timed motor sequences","volume":"26","author":"VB Penhune","year":"2005","journal-title":"NeuroImage"},{"key":"pcbi.1011024.ref100","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s00422-010-0416-4","article-title":"Intermittent control: a computational theory of human control","volume":"104","author":"P Gawthrop","year":"2011","journal-title":"Biological Cybernetics"},{"key":"pcbi.1011024.ref101","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1249\/JES.0000000000000018","article-title":"Does the motor system need intermittent control?","volume":"42","author":"I Loram","year":"2014","journal-title":"Exercise and Sport Science Review"},{"key":"pcbi.1011024.ref102","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1146\/annurev-neuro-072116-031548","article-title":"The Role of Variability in Motor Learning","volume":"5","author":"AK Dhawale","year":"2017","journal-title":"Annual Review in Neuroscience"},{"key":"pcbi.1011024.ref103","doi-asserted-by":"crossref","first-page":"4015","DOI":"10.1523\/JNEUROSCI.3244-14.2015","article-title":"Reward-Dependent Modulation of Movement Variability","volume":"35","author":"SE Pekny","year":"2015","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1011024.ref104","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1037\/a0037016","article-title":"Integrating reinforcement learning, equilibrium points, and minimum variance to understand the development of reaching: a computational model","volume":"121","author":"D Caligiore","year":"2014","journal-title":"Psychological review"},{"key":"pcbi.1011024.ref105","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1126\/science.1160575","article-title":"Dichotomous dopaminergic control of striatal synaptic plasticity","volume":"321","author":"W Shen","year":"2008","journal-title":"Science"},{"key":"pcbi.1011024.ref106","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1111\/ejn.13921","article-title":"A silent eligibility trace enables dopamine-dependent synaptic plasticity for reinforcement learning in the mouse striatum","volume":"49","author":"T Shindou","year":"2019","journal-title":"European Journal of Neuroscience"},{"key":"pcbi.1011024.ref107","doi-asserted-by":"crossref","unstructured":"Jamone L, Metta G, Nori F, Sandini G. James: A Humanoid Robot Acting over an Unstructured World. IEEE-RAS International Conference on Humanoid Robots. 2006;.","DOI":"10.1109\/ICHR.2006.321376"},{"key":"pcbi.1011024.ref108","doi-asserted-by":"crossref","unstructured":"Natale L, Nori F, Sandini G, Metta G. Learning precise 3D reaching in a humanoid robot. IEEE 6th International Conference on Development and Learning. 2007;.","DOI":"10.1109\/DEVLRN.2007.4354059"},{"issue":"19","key":"pcbi.1011024.ref109","article-title":"ANNarchy: A Code Generation Approach to Neural Simulations on Parallel Hardware","volume":"9","author":"J Vitay","year":"2015","journal-title":"Frontiers in Neuroinformatics"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011024","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,4,13]],"date-time":"2023-04-13T00:00:00Z","timestamp":1681344000000}},{"DOI":"10.1371\/journal.pcbi.1011243","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,6,22]],"date-time":"2023-06-22T00:00:00Z","timestamp":1687392000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011024","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,13]],"date-time":"2023-04-13T14:34:31Z","timestamp":1681396471000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011024"}},"subtitle":[],"editor":[{"given":"David","family":"Golomb","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2023,4,3]]},"references-count":109,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,4,3]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011024","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,3]]}}}