{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T03:09:50Z","timestamp":1780628990541,"version":"3.54.1"},"reference-count":50,"publisher":"Society for Neuroscience","issue":"17","license":[{"start":{"date-parts":[[2011,10,27]],"date-time":"2011-10-27T00:00:00Z","timestamp":1319673600000},"content-version":"vor","delay-in-days":183,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Neurosci."],"published-print":{"date-parts":[[2011,4,27]]},"abstract":"<jats:p>Reinforcement learning theory has generated substantial interest in neurobiology, particularly because of the resemblance between phasic dopamine and reward prediction errors. Actor\u2013critic theories have been adapted to account for the functions of the striatum, with parts of the dorsal striatum equated to the actor. Here, we specifically test whether the human dorsal striatum\u2014as predicted by an actor\u2013critic instantiation\u2014is used on a trial-to-trial basis at the time of choice to choose in accordance with reinforcement learning theory, as opposed to a competing strategy: the gambler's fallacy. Using a partial-brain functional magnetic resonance imaging scanning protocol focused on the striatum and other ventral brain areas, we found that the dorsal striatum is more active when choosing consistent with reinforcement learning compared with the competing strategy. Moreover, an overlapping area of dorsal striatum along with the ventral striatum was found to be correlated with reward prediction errors at the time of outcome, as predicted by the actor\u2013critic framework. These findings suggest that the same region of dorsal striatum involved in learning stimulus\u2013response associations may contribute to the control of behavior during choice, thereby using those learned associations. Intriguingly, neither reinforcement learning nor the gambler's fallacy conformed to the optimal choice strategy on the specific decision-making task we used. Thus, the dorsal striatum may contribute to the control of behavior according to reinforcement learning even when the prescriptions of such an algorithm are suboptimal in terms of maximizing future rewards.<\/jats:p>","DOI":"10.1523\/jneurosci.6421-10.2011","type":"journal-article","created":{"date-parts":[[2011,4,27]],"date-time":"2011-04-27T16:49:38Z","timestamp":1303922978000},"page":"6296-6304","source":"Crossref","is-referenced-by-count":34,"title":["Human Dorsal Striatal Activity during Choice Discriminates Reinforcement Learning Behavior from the Gambler's Fallacy"],"prefix":"10.1523","volume":"31","author":[{"given":"Ryan K.","family":"Jessup","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John P.","family":"O'Doherty","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"393","published-online":{"date-parts":[[2011,4,27]]},"reference":[{"key":"2023041303501338000_31.17.6296.1","doi-asserted-by":"publisher","DOI":"10.1016\/S1053-8119(03)00250-7"},{"key":"2023041303501338000_31.17.6296.2","doi-asserted-by":"publisher","DOI":"10.1038\/nn1817"},{"key":"2023041303501338000_31.17.6296.3","doi-asserted-by":"publisher","DOI":"10.3758\/BF03206327"},{"key":"2023041303501338000_31.17.6296.4","doi-asserted-by":"publisher","DOI":"10.1016\/S0028-3908(98)00033-1"},{"key":"2023041303501338000_31.17.6296.5","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2009.131"},{"key":"2023041303501338000_31.17.6296.6","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1554-07.2007"},{"key":"2023041303501338000_31.17.6296.7","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.676"},{"key":"2023041303501338000_31.17.6296.8","doi-asserted-by":"publisher","DOI":"10.1007\/s11166-005-1153-2"},{"key":"2023041303501338000_31.17.6296.9","doi-asserted-by":"publisher","DOI":"10.1038\/nn1560"},{"key":"2023041303501338000_31.17.6296.10","doi-asserted-by":"publisher","DOI":"10.1038\/nature04766"},{"key":"2023041303501338000_31.17.6296.11","doi-asserted-by":"publisher","DOI":"10.1016\/S1053-8119(03)00073-9"},{"key":"2023041303501338000_31.17.6296.12","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9280.00167"},{"key":"2023041303501338000_31.17.6296.13","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(99)00046-5"},{"key":"2023041303501338000_31.17.6296.14","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(02)00044-8"},{"key":"2023041303501338000_31.17.6296.15","doi-asserted-by":"crossref","unstructured":"Estes WK (1964) in Categories of human learning, Probability learning, ed Melton AW (Academic, New York), pp 89\u2013128.","DOI":"10.1016\/B978-1-4832-3145-7.50010-8"},{"key":"2023041303501338000_31.17.6296.16","doi-asserted-by":"publisher","DOI":"10.1126\/science.1102941"},{"key":"2023041303501338000_31.17.6296.17","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2010.04.016"},{"key":"2023041303501338000_31.17.6296.18","first-page":"623","article-title":"Economic theory of choice and the preference reversal phenomenon","volume":"69","author":"Grether","year":"1979","journal-title":"Am Econ Rev"},{"key":"2023041303501338000_31.17.6296.19","doi-asserted-by":"publisher","DOI":"10.1037\/a0015241"},{"key":"2023041303501338000_31.17.6296.20","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3417-03.2004"},{"key":"2023041303501338000_31.17.6296.21","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00458.2005"},{"key":"2023041303501338000_31.17.6296.22","doi-asserted-by":"publisher","DOI":"10.1038\/1124"},{"key":"2023041303501338000_31.17.6296.23","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1038\/nn841","article-title":"Perceiving patterns in random series: dynamic processing of sequence in prefrontal cortex","volume":"5","author":"Huettel","year":"2002","journal-title":"Nat Neurosci"},{"key":"2023041303501338000_31.17.6296.24","doi-asserted-by":"publisher","DOI":"10.1037\/h0056878"},{"key":"2023041303501338000_31.17.6296.25","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9280.2008.02193.x"},{"key":"2023041303501338000_31.17.6296.26","doi-asserted-by":"crossref","unstructured":"Kahneman D Frederick S (2002) in Heuristics and biases: the psychology of intuitive judgment, Representativeness revisited: attribute substitution in intuitive judgment, eds Gilovich T Griffin D Kahneman D (Cambridge UP, New York), pp 49\u201381.","DOI":"10.1017\/CBO9780511808098.004"},{"key":"2023041303501338000_31.17.6296.27","doi-asserted-by":"publisher","DOI":"10.1097\/01.wco.0000173463.24758.f6"},{"key":"2023041303501338000_31.17.6296.28","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2008.02.021"},{"key":"2023041303501338000_31.17.6296.29","doi-asserted-by":"publisher","DOI":"10.1038\/nature00892"},{"key":"2023041303501338000_31.17.6296.30","unstructured":"Luce RD (1959) Individual choice behavior: a theoretical analysis (Wiley, New York)."},{"key":"2023041303501338000_31.17.6296.31","doi-asserted-by":"publisher","DOI":"10.1126\/science.1100907"},{"key":"2023041303501338000_31.17.6296.32","doi-asserted-by":"crossref","first-page":"1936","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996","article-title":"A framework for mesencephalic dopamine systems based on predictive Hebbian learning","volume":"16","author":"Montague","year":"1996","journal-title":"J Neurosci"},{"key":"2023041303501338000_31.17.6296.33","doi-asserted-by":"publisher","DOI":"10.1126\/science.1094285"},{"key":"2023041303501338000_31.17.6296.34","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00169-7"},{"key":"2023041303501338000_31.17.6296.35","doi-asserted-by":"publisher","DOI":"10.1196\/annals.1390.022"},{"key":"2023041303501338000_31.17.6296.36","doi-asserted-by":"crossref","unstructured":"Prevost C McCabe JA Jessup RK Bossaerts P O'Doherty JP (2011) Differentiable contributions of human amygdalar subregions in the computations underlying reward and avoidance learning. Eur J Neurosci, In press.","DOI":"10.1111\/j.1460-9568.2011.07686.x"},{"key":"2023041303501338000_31.17.6296.37","doi-asserted-by":"publisher","DOI":"10.1162\/003355302760193896"},{"key":"2023041303501338000_31.17.6296.38","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3823-03.2004"},{"key":"2023041303501338000_31.17.6296.39","doi-asserted-by":"publisher","DOI":"10.1126\/science.1115270"},{"key":"2023041303501338000_31.17.6296.40","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2496-07.2007"},{"key":"2023041303501338000_31.17.6296.41","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5306.1593"},{"key":"2023041303501338000_31.17.6296.42","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176344136"},{"key":"2023041303501338000_31.17.6296.43","doi-asserted-by":"publisher","DOI":"10.1037\/\/0033-295X.84.2.127"},{"key":"2023041303501338000_31.17.6296.44","doi-asserted-by":"crossref","unstructured":"Sutton RS Barto AG (1998) Reinforcement learning: an introduction (MIT, Cambridge, MA).","DOI":"10.1016\/S1474-6670(17)38315-5"},{"key":"2023041303501338000_31.17.6296.45","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00848-1"},{"key":"2023041303501338000_31.17.6296.46","doi-asserted-by":"publisher","DOI":"10.1037\/h0031322"},{"key":"2023041303501338000_31.17.6296.47","doi-asserted-by":"publisher","DOI":"10.1152\/jn.91195.2008"},{"key":"2023041303501338000_31.17.6296.48","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0564-07.2007"},{"key":"2023041303501338000_31.17.6296.49","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2003.10.013"},{"key":"2023041303501338000_31.17.6296.50","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-9568.2004.03095.x"}],"container-title":["The Journal of Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1523\/JNEUROSCI.6421-10.2011","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,13]],"date-time":"2023-04-13T20:27:48Z","timestamp":1681417668000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jneurosci.org\/lookup\/doi\/10.1523\/JNEUROSCI.6421-10.2011"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,4,27]]},"references-count":50,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2011,4,27]]},"published-print":{"date-parts":[[2011,4,27]]}},"alternative-id":["10.1523\/JNEUROSCI.6421-10.2011"],"URL":"https:\/\/doi.org\/10.1523\/jneurosci.6421-10.2011","relation":{},"ISSN":["0270-6474","1529-2401"],"issn-type":[{"value":"0270-6474","type":"print"},{"value":"1529-2401","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,4,27]]}}}