{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T09:08:41Z","timestamp":1790672921839,"version":"4.1.0"},"reference-count":81,"publisher":"eLife Sciences Publications, Ltd","license":[{"start":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T00:00:00Z","timestamp":1594080000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T00:00:00Z","timestamp":1594080000000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T00:00:00Z","timestamp":1594080000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MC_UU_12024\/5"],"award-info":[{"award-number":["MC_UU_12024\/5"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","award":["MC_UU_00003\/1"],"award-info":[{"award-number":["MC_UU_00003\/1"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000268","name":"Biotechnology and Biological Sciences Research Council","doi-asserted-by":"publisher","award":["BB\/S006338\/1"],"award-info":[{"award-number":["BB\/S006338\/1"]}],"id":[{"id":"10.13039\/501100000268","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["elifesciences.org"],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>This paper describes a framework for modelling dopamine function in the mammalian brain. It proposes that both learning and action planning involve processes minimizing prediction errors encoded by dopaminergic neurons. In this framework, dopaminergic neurons projecting to different parts of the striatum encode errors in predictions made by the corresponding systems within the basal ganglia. The dopaminergic neurons encode differences between rewards and expectations in the goal-directed system, and differences between the chosen and habitual actions in the habit system. These prediction errors trigger learning about rewards and habit formation, respectively. Additionally, dopaminergic neurons in the goal-directed system play a key role in action planning: They compute the difference between a desired reward and the reward expected from the current motor plan, and they facilitate action planning until this difference diminishes. Presented models account for dopaminergic responses during movements, effects of dopamine depletion on behaviour, and make several experimental predictions.<\/jats:p>","DOI":"10.7554\/elife.53262","type":"journal-article","created":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T08:00:19Z","timestamp":1594108819000},"update-policy":"https:\/\/doi.org\/10.7554\/elife.53262","source":"Crossref","is-referenced-by-count":93,"title":["Dopamine role in learning and action inference"],"prefix":"10.7554","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8994-1661","authenticated-orcid":true,"given":"Rafal","family":"Bogacz","sequence":"first","affiliation":[{"name":"MRC Brain Networks Dynamics Unit, University of Oxford, Oxford, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4374","published-online":{"date-parts":[[2020,7,7]]},"reference":[{"key":"bib1","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1146\/annurev.ne.09.030186.002041","article-title":"Parallel organization of functionally segregated circuits linking basal ganglia and cortex","volume":"9","author":"Alexander","year":"1986","journal-title":"Annual Review of Neuroscience"},{"key":"bib2","article-title":"Planning by probabilistic inference","author":"Attias","year":"2003","unstructured":"Attias H. 2003. Planning by probabilistic inference. AISTATS."},{"key":"bib3","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1523\/JNEUROSCI.23-02-00666.2003","article-title":"The effect of lesions of the basolateral amygdala on instrumental conditioning","volume":"23","author":"Balleine","year":"2003","journal-title":"The Journal of Neuroscience"},{"key":"bib4","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1038\/s41593-018-0152-y","article-title":"What does dopamine mean?","volume":"21","author":"Berke","year":"2018","journal-title":"Nature Neuroscience"},{"key":"bib5","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1016\/S0165-0173(98)00019-8","article-title":"What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?","volume":"28","author":"Berridge","year":"1998","journal-title":"Brain Research Reviews"},{"key":"bib6","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1016\/j.tins.2007.03.006","article-title":"Dopamine neuron systems in the brain: an update","volume":"30","author":"Bj\u00f6rklund","year":"2007","journal-title":"Trends in Neurosciences"},{"key":"bib7","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1016\/j.jmp.2015.11.003","article-title":"A tutorial on the free-energy framework for modelling perception and learning","volume":"76","author":"Bogacz","year":"2017","journal-title":"Journal of Mathematical Psychology"},{"key":"bib8","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1162\/neco.2007.19.2.442","article-title":"The basal ganglia and cortex implement optimal decision making between alternative actions","volume":"19","author":"Bogacz","year":"2007","journal-title":"Neural Computation"},{"key":"bib9","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.jmp.2017.09.004","article-title":"The free energy principle for action and perception: a mathematical review","volume":"81","author":"Buckley","year":"2017","journal-title":"Journal of Mathematical Psychology"},{"key":"bib10","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1016\/j.nlm.2014.05.003","article-title":"From ventral-medial to dorsal-lateral striatum: neural correlates of reward-guided decision-making","volume":"117","author":"Burton","year":"2015","journal-title":"Neurobiology of Learning and Memory"},{"key":"bib11","doi-asserted-by":"publisher","first-page":"6729","DOI":"10.1523\/JNEUROSCI.1498-05.2005","article-title":"Extended habit training reduces dopamine mediation of appetitive response expression","volume":"25","author":"Choi","year":"2005","journal-title":"Journal of Neuroscience"},{"key":"bib12","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1037\/a0037015","article-title":"Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive","volume":"121","author":"Collins","year":"2014","journal-title":"Psychological Review"},{"key":"bib13","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1038\/nature25457","article-title":"Dopamine neuron activity before action initiation gates and invigorates future movements","volume":"554","author":"da Silva","year":"2018","journal-title":"Nature"},{"key":"bib14","doi-asserted-by":"publisher","first-page":"1704","DOI":"10.1038\/nn1560","article-title":"Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control","volume":"8","author":"Daw","year":"2005","journal-title":"Nature Neuroscience"},{"key":"bib15","doi-asserted-by":"publisher","first-page":"1637","DOI":"10.1162\/neco.2006.18.7.1637","article-title":"Representation and timing in theories of the dopamine system","volume":"18","author":"Daw","year":"2006","journal-title":"Neural Computation"},{"key":"bib16","doi-asserted-by":"publisher","first-page":"1218","DOI":"10.1162\/jocn.2010.21514","article-title":"Habitual versus goal-directed action control in parkinson disease","volume":"23","author":"de Wit","year":"2011","journal-title":"Journal of Cognitive Neuroscience"},{"key":"bib17","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1080\/14640748308400912","article-title":"The effect of the instrumental training contingency on susceptibility to reinforcer devaluation","volume":"35","author":"Dickinson","year":"1983","journal-title":"The Quarterly Journal of Experimental Psychology Section B"},{"key":"bib18","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1098\/rstb.1985.0010","article-title":"Actions and habits: the development of behavioural autonomy","volume":"308","author":"Dickinson","year":"1985","journal-title":"Philosophical Transactions of the Royal Society of London\u00a0B, Biological Sciences"},{"key":"bib19","doi-asserted-by":"publisher","first-page":"197","DOI":"10.3758\/BF03199935","article-title":"Motivational control after extended instrumental training","volume":"23","author":"Dickinson","year":"1995","journal-title":"Animal Learning & Behavior"},{"key":"bib20","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1002\/0471214426.pas0312","volume-title":"Handbook of Experimental Psychology","author":"Dickinson","year":"2002"},{"key":"bib21","doi-asserted-by":"publisher","first-page":"E2180","DOI":"10.1073\/pnas.1515941113","article-title":"Representation of spontaneous movement by dopaminergic neurons is cell-type selective and disrupted in parkinsonism","volume":"113","author":"Dodson","year":"2016","journal-title":"PNAS"},{"key":"bib22","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1038\/s41586-019-1261-9","article-title":"Specialized coding of sensory, motor and cognitive variables in VTA dopamine neurons","volume":"570","author":"Engelhard","year":"2019","journal-title":"Nature"},{"key":"bib23","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1038\/nn.4239","article-title":"Dopamine neurons share common response function for reward prediction error","volume":"19","author":"Eshel","year":"2016","journal-title":"Nature Neuroscience"},{"key":"bib24","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1037\/h0058316","article-title":"Discriminative conditioning. I. A discriminative property of conditioned anticipation","volume":"32","author":"Estes","year":"1943","journal-title":"Journal of Experimental Psychology"},{"key":"bib25","doi-asserted-by":"publisher","first-page":"2771","DOI":"10.1523\/JNEUROSCI.3894-04.2005","article-title":"Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation","volume":"25","author":"Faure","year":"2005","journal-title":"Journal of Neuroscience"},{"key":"bib26","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2014.00457","article-title":"Model averaging, optimal inference, and habit formation","volume":"8","author":"FitzGerald","year":"2014","journal-title":"Frontiers in Human Neuroscience"},{"key":"bib27","doi-asserted-by":"publisher","first-page":"1309","DOI":"10.1126\/science.1146157","article-title":"Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism","volume":"318","author":"Frank","year":"2007","journal-title":"Science"},{"key":"bib28","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1098\/rstb.2005.1622","article-title":"A theory of cortical responses","volume":"360","author":"Friston","year":"2005","journal-title":"Philosophical Transactions of the Royal Society B: Biological Sciences"},{"key":"bib29","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free-energy principle: a unified brain theory?","volume":"11","author":"Friston","year":"2010","journal-title":"Nature Reviews Neuroscience"},{"key":"bib30","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2018.1645","article-title":"Rethinking dopamine as generalized prediction error","volume":"285","author":"Gardner","year":"2018","journal-title":"Proceedings of the Royal Society B: Biological Sciences"},{"key":"bib31","doi-asserted-by":"publisher","first-page":"3311","DOI":"10.1162\/neco_a_01023","article-title":"Dopamine, inference, and uncertainty","volume":"29","author":"Gershman","year":"2017","journal-title":"Neural Computation"},{"key":"bib32","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1007\/PL00007984","article-title":"A computational model of action selection in the basal ganglia. I. A new functional anatomy","volume":"84","author":"Gurney","year":"2001","journal-title":"Biological Cybernetics"},{"key":"bib33","doi-asserted-by":"publisher","first-page":"2369","DOI":"10.1523\/JNEUROSCI.20-06-02369.2000","article-title":"Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum","volume":"20","author":"Haber","year":"2000","journal-title":"The Journal of Neuroscience"},{"key":"bib34","doi-asserted-by":"publisher","first-page":"1252","DOI":"10.1038\/s41562-019-0725-0","article-title":"Time-dependent competition between goal-directed and habitual response preparation","volume":"3","author":"Hardwick","year":"2019","journal-title":"Nature Human Behaviour"},{"key":"bib35","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/4708.001.0001","volume-title":"Models of Information Processing in the Basal Ganglia","author":"Houk","year":"1995"},{"key":"bib36","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1038\/nature12475","article-title":"Prolonged dopamine signalling in striatum signals proximity and value of distant rewards","volume":"500","author":"Howe","year":"2013","journal-title":"Nature"},{"key":"bib37","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1038\/nature18942","article-title":"Rapid signalling in distinct dopaminergic axons during locomotion and reward","volume":"535","author":"Howe","year":"2016","journal-title":"Nature"},{"key":"bib38","volume-title":"A Behavior System;\u00a0an Introduction to Behavior Theory Concerning the Individual Organism","author":"Hull","year":"1952"},{"key":"bib39","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/0169-328X(92)90107-M","article-title":"Localization of multiple dopamine receptor subtype mRNAs in human and monkey motor cortex and striatum","volume":"15","author":"Huntley","year":"1992","journal-title":"Molecular Brain Research"},{"key":"bib40","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1038\/nature09263","article-title":"Start\/stop signals emerge in nigrostriatal circuits during sequence learning","volume":"466","author":"Jin","year":"2010","journal-title":"Nature"},{"key":"bib41","doi-asserted-by":"publisher","first-page":"892","DOI":"10.1016\/j.brs.2016.06.051","article-title":"Closed-Loop deep brain stimulation effects on parkinsonian motor symptoms in a Non-Human primate - Is beta enough?","volume":"9","author":"Johnson","year":"2016","journal-title":"Brain Stimulation"},{"key":"bib42","doi-asserted-by":"publisher","first-page":"836","DOI":"10.1016\/j.tics.2019.07.012","article-title":"Where does value come from?","volume":"23","author":"Juechems","year":"2019","journal-title":"Trends in Cognitive Sciences"},{"key":"bib43","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005145","article-title":"Forgetting in reinforcement learning links sustained dopamine signals to motivation","volume":"12","author":"Kato","year":"2016","journal-title":"PLOS Computational Biology"},{"key":"bib44","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.04811","article-title":"Homeostatic reinforcement learning for integrating reward collection and physiological stability","volume":"3","author":"Keramati","year":"2014","journal-title":"eLife"},{"key":"bib45","doi-asserted-by":"publisher","first-page":"622","DOI":"10.1038\/nature09159","article-title":"Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry","volume":"466","author":"Kravitz","year":"2010","journal-title":"Nature"},{"key":"bib46","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1016\/j.conb.2017.08.020","article-title":"Learning with three factors: modulating hebbian plasticity with errors","volume":"46","author":"Ku\u015bmierz","year":"2017","journal-title":"Current Opinion in Neurobiology"},{"key":"bib47","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1016\/j.neuron.2020.01.028","article-title":"Dopaminergic transmission rapidly and persistently enhances excitability of D1 Receptor-Expressing striatal projection neurons","volume":"106","author":"Lahiri","year":"2020","journal-title":"Neuron"},{"key":"bib48","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.42992","article-title":"Reward prediction error does not explain movement selectivity in DMS-projecting dopamine neurons","volume":"8","author":"Lee","year":"2019","journal-title":"eLife"},{"key":"bib49","doi-asserted-by":"publisher","first-page":"3034","DOI":"10.1162\/neco.2008.11-07-654","article-title":"Stimulus representation and the timing of reward-prediction errors in models of the dopamine system","volume":"20","author":"Ludvig","year":"2008","journal-title":"Neural Computation"},{"key":"bib50","doi-asserted-by":"publisher","first-page":"837","DOI":"10.1038\/nature08028","article-title":"Two types of dopamine neuron distinctly convey positive and negative motivational signals","volume":"459","author":"Matsumoto","year":"2009","journal-title":"Nature"},{"key":"bib51","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/S0166-2236(03)00177-2","article-title":"A computational substrate for incentive salience","volume":"26","author":"McClure","year":"2003","journal-title":"Trends in Neurosciences"},{"key":"bib52","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005062","article-title":"Learning reward uncertainty in the basal ganglia","volume":"12","author":"Mikhael","year":"2016","journal-title":"PLOS Computational Biology"},{"key":"bib53","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1037\/rev0000120","article-title":"Habits without values","volume":"126","author":"Miller","year":"2019","journal-title":"Psychological Review"},{"key":"bib54","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/s41586-019-1235-y","article-title":"Dissociable dopamine dynamics for learning and motivation","volume":"570","author":"Mohebi","year":"2019","journal-title":"Nature"},{"key":"bib55","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1006285","article-title":"Learning the payoffs and costs of actions","volume":"15","author":"M\u00f6ller","year":"2019","journal-title":"PLOS Computational Biology"},{"key":"bib56","doi-asserted-by":"publisher","first-page":"1936","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996","article-title":"A framework for mesencephalic dopamine systems based on predictive hebbian learning","volume":"16","author":"Montague","year":"1996","journal-title":"The Journal of Neuroscience"},{"key":"bib57","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1007\/s00213-006-0502-4","article-title":"Tonic dopamine: opportunity costs and the control of response vigor","volume":"191","author":"Niv","year":"2007","journal-title":"Psychopharmacology"},{"key":"bib58","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1126\/science.1094285","article-title":"Dissociable roles of ventral and dorsal striatum in instrumental conditioning","volume":"304","author":"O'Doherty","year":"2004","journal-title":"Science"},{"key":"bib59","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/j.celrep.2016.03.031","article-title":"Mesolimbic dopamine encodes prediction errors in a State-Dependent manner","volume":"15","author":"Papageorgiou","year":"2016","journal-title":"Cell Reports"},{"key":"bib60","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1016\/0006-8993(80)90462-X","article-title":"Medium spiny neuron projection from the rat striatum: an intracellular horseradish peroxidase study","volume":"183","author":"Preston","year":"1980","journal-title":"Brain Research"},{"key":"bib61","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1038\/4580","article-title":"Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects","volume":"2","author":"Rao","year":"1999","journal-title":"Nature Neuroscience"},{"key":"bib62","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1038\/35092560","article-title":"A cellular mechanism of reward-related learning","volume":"413","author":"Reynolds","year":"2001","journal-title":"Nature"},{"key":"bib63","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1016\/j.apmr.2004.10.040","article-title":"The effect of external rhythmic cues (auditory and visual) on walking during a functional task in homes of people with Parkinson's disease","volume":"86","author":"Rochester","year":"2005","journal-title":"Archives of Physical Medicine and Rehabilitation"},{"key":"bib64","doi-asserted-by":"publisher","first-page":"2176","DOI":"10.1162\/0899766054615699","article-title":"Attention-gated reinforcement learning of internal representations for classification","volume":"17","author":"Roelfsema","year":"2005","journal-title":"Neural Computation"},{"key":"bib65","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1007\/BF00237874","article-title":"The activity of pars Compacta neurons of the monkey substantia nigra in relation to motor activation","volume":"51","author":"Schultz","year":"1983","journal-title":"Experimental Brain Research"},{"key":"bib66","doi-asserted-by":"publisher","first-page":"1439","DOI":"10.1152\/jn.1986.56.5.1439","article-title":"Responses of midbrain dopamine neurons to behavioral trigger stimuli in the monkey","volume":"56","author":"Schultz","year":"1986","journal-title":"Journal of Neurophysiology"},{"key":"bib67","doi-asserted-by":"publisher","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A neural substrate of prediction and reward","volume":"275","author":"Schultz","year":"1997","journal-title":"Science"},{"key":"bib68","doi-asserted-by":"publisher","first-page":"848","DOI":"10.1126\/science.1160575","article-title":"Dichotomous dopaminergic control of striatal synaptic plasticity","volume":"321","author":"Shen","year":"2008","journal-title":"Science"},{"key":"bib69","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1037\/a0026435","article-title":"Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates","volume":"119","author":"Solway","year":"2012","journal-title":"Psychological Review"},{"key":"bib70","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2016.00550","article-title":"Allostatic Self-efficacy: a metacognitive theory of Dyshomeostasis-Induced fatigue and depression","volume":"10","author":"Stephan","year":"2016","journal-title":"Frontiers in Human Neuroscience"},{"key":"bib71","doi-asserted-by":"crossref","DOI":"10.1109\/TNN.1998.712192","volume-title":"Introduction to Reinforcement Learning","author":"Sutton","year":"1998"},{"key":"bib72","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1038\/nn.4187","article-title":"Action initiation shapes mesolimbic dopamine encoding of future rewards","volume":"19","author":"Syed","year":"2016","journal-title":"Nature Neuroscience"},{"key":"bib73","doi-asserted-by":"publisher","first-page":"1395","DOI":"10.1016\/j.neuron.2017.08.025","article-title":"Dopamine neurons respond to errors in the prediction of sensory features of expected rewards","volume":"95","author":"Takahashi","year":"2017","journal-title":"Neuron"},{"key":"bib74","doi-asserted-by":"publisher","first-page":"2985","DOI":"10.1152\/jn.01098.2007","article-title":"Dopamine increases the gain of the input-output response of rat prefrontal pyramidal neurons","volume":"99","author":"Thurley","year":"2008","journal-title":"Journal of Neurophysiology"},{"key":"bib75","doi-asserted-by":"publisher","first-page":"1642","DOI":"10.1126\/science.1105370","article-title":"Adaptive coding of reward value by dopamine neurons","volume":"307","author":"Tobler","year":"2005","journal-title":"Science"},{"key":"bib76","doi-asserted-by":"publisher","first-page":"2225","DOI":"10.1111\/j.1460-9568.2009.06796.x","article-title":"A specific role for posterior dorsolateral striatum in human habit learning","volume":"29","author":"Tricomi","year":"2009","journal-title":"European Journal of Neuroscience"},{"key":"bib77","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1007465","article-title":"Modeling the effects of motivation on choice and learning in the basal ganglia","volume":"16","author":"van Swieten","year":"2020","journal-title":"PLOS Computational Biology"},{"key":"bib78","doi-asserted-by":"publisher","first-page":"858","DOI":"10.1016\/j.neuron.2012.03.017","article-title":"Whole-brain mapping of direct inputs to midbrain dopamine neurons","volume":"74","author":"Watabe-Uchida","year":"2012","journal-title":"Neuron"},{"key":"bib79","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1111\/j.1460-9568.2004.03095.x","article-title":"Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning","volume":"19","author":"Yin","year":"2004","journal-title":"European Journal of Neuroscience"},{"key":"bib80","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1111\/j.1460-9568.2005.04218.x","article-title":"The role of the dorsomedial striatum in instrumental conditioning","volume":"22","author":"Yin","year":"2005","journal-title":"European Journal of Neuroscience"},{"key":"bib81","doi-asserted-by":"publisher","first-page":"1496","DOI":"10.1126\/science.1167342","article-title":"Human substantia nigra neurons encode unexpected financial rewards","volume":"323","author":"Zaghloul","year":"2009","journal-title":"Science"}],"container-title":["eLife"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/cdn.elifesciences.org\/articles\/53262\/elife-53262-v2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/cdn.elifesciences.org\/articles\/53262\/elife-53262-v2.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/elifesciences.org\/articles\/53262","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T21:00:36Z","timestamp":1697058036000},"score":1,"resource":{"primary":{"URL":"https:\/\/elifesciences.org\/articles\/53262"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,7]]},"references-count":81,"alternative-id":["10.7554\/eLife.53262"],"URL":"https:\/\/doi.org\/10.7554\/elife.53262","archive":["CLOCKSS"],"relation":{"is-supplemented-by":[{"id-type":"accession","id":"simulations-action-inference","asserted-by":"subject"}],"has-preprint":[{"id-type":"doi","id":"10.1101\/837641","asserted-by":"object"}],"has-review":[{"id-type":"doi","id":"10.7554\/eLife.53262.sa1","asserted-by":"object"},{"id-type":"doi","id":"10.7554\/eLife.53262.sa2","asserted-by":"object"}]},"ISSN":["2050-084X"],"issn-type":[{"value":"2050-084X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,7]]},"article-number":"e53262"}}