{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T13:05:13Z","timestamp":1781355913134,"version":"3.54.1"},"reference-count":61,"publisher":"MIT Press","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2017,12]]},"abstract":"<jats:p>The hypothesis that the phasic dopamine response reports a reward prediction error has become deeply entrenched. However, dopamine neurons exhibit several notable deviations from this hypothesis. A coherent explanation for these deviations can be obtained by analyzing the dopamine response in terms of Bayesian reinforcement learning. The key idea is that prediction errors are modulated by probabilistic beliefs about the relationship between cues and outcomes, updated through Bayesian inference. This account can explain dopamine responses to inferred value in sensory preconditioning, the effects of cue preexposure (latent inhibition), and adaptive coding of prediction errors when rewards vary across orders of magnitude. We further postulate that orbitofrontal cortex transforms the stimulus representation through recurrent dynamics, such that a simple error-driven learning rule operating on the transformed representation can implement the Bayesian reinforcement learning update.<\/jats:p>","DOI":"10.1162\/neco_a_01023","type":"journal-article","created":{"date-parts":[[2017,9,28]],"date-time":"2017-09-28T16:31:40Z","timestamp":1506616300000},"page":"3311-3326","source":"Crossref","is-referenced-by-count":36,"title":["Dopamine, Inference, and Uncertainty"],"prefix":"10.1162","volume":"29","author":[{"given":"Samuel J.","family":"Gershman","sequence":"first","affiliation":[{"name":"Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA 02138, U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_3_2_009"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1993.5.1.45"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/j.pneurobio.2003.12.001"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1038\/nn1954"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.3758\/BF03199432"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1989-14.2015"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2006.05.004"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1637"},{"key":"B9","first-page":"451","volume-title":"Advances in neural information processing systems","volume":"13","author":"Dayan P.","year":"2001"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1038\/81504"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2008.08.003"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhh103"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00483.2015"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(02)00044-8"},{"key":"B16","author":"Duff M. O.","year":"2002","journal-title":"Optimal learning: Computational procedures for Bayes-adaptive Markov decision processes"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.15-09-05999.1995"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1038\/nature14855"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4239"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1126\/science.1077349"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2015.00136"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.113.2.300"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002327"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1613\/jair.3077"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004567"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2013.00194"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2015.07.007"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1014269108"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1038\/185557a0"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1037\/0097-7403.5.1.31"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1016\/j.nlm.2014.07.010"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1126\/science.1227489"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2017.02.026"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1080\/02724990344000141"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-6632.2012.06496.x"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2008.11-07-654"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2011.00039"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005062"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.117.3.363"},{"key":"B40","volume-title":"Attention and associative learning: From brain to behaviour","author":"Mitchell C. J.","year":"2010"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3130"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0822-10.2010"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1186\/1744-9081-1-6"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.87.6.532"},{"key":"B46","first-page":"241","volume":"3","author":"Pearce J.","year":"1982","journal-title":"Quantitative Analyses of Behavior"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143932"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1196\/annals.1390.005"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2010.00146"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-9568.2011.07986.x"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.13665"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5306.1593"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhu159"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4520"},{"key":"B55","first-page":"497","volume-title":"Learning and computational neuroscience: Foundations of adaptive networks","author":"Sutton R.","year":"1990"},{"key":"B56","volume-title":"Reinforcement learning: An introduction","author":"Sutton R. S.","year":"1998"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2016.05.015"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1126\/science.1105370"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2013.11.005"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4522(93)90378-S"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2005.04.026"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00519.2001"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/neco_a_01023","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T16:42:11Z","timestamp":1615567331000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/29\/12\/3311-3326\/8314"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12]]},"references-count":61,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2017,12]]}},"alternative-id":["10.1162\/neco_a_01023"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_01023","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/149849","asserted-by":"object"}]},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12]]}}}