{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T13:29:59Z","timestamp":1761744599158},"reference-count":89,"publisher":"MIT Press - Journals","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Cognitive Neuroscience"],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:p> Substantial evidence indicates that subjective value is adapted to the statistics of reward expected within a given temporal context. However, how these contextual expectations are learned is poorly understood. To examine such learning, we exploited a recent observation that participants performing a gambling task adjust their preferences as a function of context. We show that, in the absence of contextual cues providing reward information, an average reward expectation was learned from recent past experience. Learning dependent on contextual cues emerged when two contexts alternated at a fast rate, whereas both cue-independent and cue-dependent forms of learning were apparent when two contexts alternated at a slower rate. Motivated by these behavioral findings, we reanalyzed a previous fMRI data set to probe the neural substrates of learning contextual reward expectations. We observed a form of reward prediction error related to average reward such that, at option presentation, activity in ventral tegmental area\/substantia nigra and ventral striatum correlated positively and negatively, respectively, with the actual and predicted value of options. Moreover, an inverse correlation between activity in ventral tegmental area\/substantia nigra (but not striatum) and predicted option value was greater in participants showing enhanced choice adaptation to context. The findings help understanding the mechanisms underlying learning of contextual reward expectation. <\/jats:p>","DOI":"10.1162\/jocn_a_01191","type":"journal-article","created":{"date-parts":[[2017,9,26]],"date-time":"2017-09-26T16:33:27Z","timestamp":1506443607000},"page":"50-69","source":"Crossref","is-referenced-by-count":10,"title":["Learning Contextual Reward Expectations for Value Adaptation"],"prefix":"10.1162","volume":"30","author":[{"given":"Francesco","family":"Rigoli","sequence":"first","affiliation":[{"name":"The Wellcome Trust Centre for Neuroimaging at University College London"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Chew","sequence":"additional","affiliation":[{"name":"The Wellcome Trust Centre for Neuroimaging at University College London"},{"name":"Max Planck UCL Centre for Computational Psychiatry and Ageing Research, London, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Dayan","sequence":"additional","affiliation":[{"name":"Gatsby Computational Neuroscience Unit, University College London"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raymond J.","family":"Dolan","sequence":"additional","affiliation":[{"name":"The Wellcome Trust Centre for Neuroimaging at University College London"},{"name":"Max Planck UCL Centre for Computational Psychiatry and Ageing Research, London, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"bib2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025696116075"},{"key":"bib93","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.02.063"},{"key":"bib3","doi-asserted-by":"publisher","DOI":"10.1038\/nn1954"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00540.2010"},{"key":"bib5","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0012686"},{"key":"bib6","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0173(98)00019-8"},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2008.08.011"},{"key":"bib9","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3136"},{"key":"bib10","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2014.01.020"},{"key":"bib11","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-9568.2011.07980.x"},{"key":"bib12","doi-asserted-by":"publisher","DOI":"10.1037\/a0030852"},{"key":"bib13","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2006.05.004"},{"key":"bib14","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3927-14.2014"},{"key":"bib15","doi-asserted-by":"publisher","DOI":"10.1126\/science.1150605"},{"key":"bib16","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199600434.003.0001"},{"key":"bib17","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.7.1637"},{"key":"bib19","doi-asserted-by":"publisher","DOI":"10.1038\/81504"},{"key":"bib20","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7044.114.3.468"},{"key":"bib21","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2016.04.019"},{"key":"bib22","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5445-12.2013"},{"key":"bib23","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0801489105"},{"key":"bib24","doi-asserted-by":"publisher","DOI":"10.1038\/35090500"},{"key":"bib25","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4328(99)00186-2"},{"key":"bib26","doi-asserted-by":"publisher","DOI":"10.1037\/a0017808"},{"key":"bib27","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2010.02.008"},{"key":"bib28","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.6376-10.2011"},{"key":"bib29","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4173"},{"key":"bib30","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1309-08.2008"},{"key":"bib31","doi-asserted-by":"publisher","DOI":"10.1016\/S0959-4388(99)80027-0"},{"key":"bib32","doi-asserted-by":"publisher","DOI":"10.1086\/208899"},{"key":"bib33","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4009-09.2010"},{"key":"bib34","doi-asserted-by":"publisher","DOI":"10.1038\/nn1901"},{"key":"bib35","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.112.4.841"},{"key":"bib36","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1321596111"},{"key":"bib37","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2015.08.008"},{"key":"bib38","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1217854110"},{"key":"bib39","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2851-14.2014"},{"key":"bib40","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.1792"},{"key":"bib42","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1651-08.2008"},{"key":"bib94","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1598-03.2004"},{"key":"bib43","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3130"},{"key":"bib44","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0822-10.2010"},{"key":"bib45","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-006-0502-4"},{"key":"bib46","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5498-10.2012"},{"key":"bib47","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2008.03.006"},{"key":"bib48","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00169-7"},{"key":"bib49","doi-asserted-by":"publisher","DOI":"10.1126\/science.1094285"},{"key":"bib50","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3751-09.2009"},{"key":"bib51","doi-asserted-by":"publisher","DOI":"10.1038\/nn2020"},{"key":"bib52","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2009.12.001"},{"key":"bib53","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1119969109"},{"key":"bib54","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.87.6.532"},{"key":"bib55","doi-asserted-by":"publisher","DOI":"10.1038\/nature05051"},{"key":"bib56","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.37.7.770"},{"key":"bib57","doi-asserted-by":"publisher","DOI":"10.1037\/0882-7974.16.2.323"},{"key":"bib58","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.114.3.784"},{"key":"bib59","unstructured":"Rescorla, R. A. & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. Classical Conditioning II: Current Research and Theory, 2, 64#x2013;99."},{"key":"bib60","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_00972"},{"key":"bib61","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2016.04.062"},{"key":"bib62","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms12416"},{"key":"bib63","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.16127"},{"key":"bib64","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2012.00134"},{"key":"bib65","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2015.10.017"},{"key":"bib66","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2016.68"},{"key":"bib67","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2015.12.016"},{"key":"bib68","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.108.2.370"},{"key":"bib69","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0009308"},{"key":"bib70","doi-asserted-by":"publisher","DOI":"10.1101\/lm.1494409"},{"key":"bib71","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4328(02)00282-6"},{"key":"bib72","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5306.1593"},{"key":"bib73","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.2009.21138"},{"key":"bib74","doi-asserted-by":"publisher","DOI":"10.2307\/3172740"},{"key":"bib75","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002607"},{"key":"bib76","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2014.08.064"},{"key":"bib77","doi-asserted-by":"publisher","DOI":"10.1080\/17470210902747112"},{"key":"bib78","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogpsych.2005.10.003"},{"key":"bib79","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.132.1.23"},{"key":"bib80","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2012.00070"},{"key":"bib81","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2014.11.005"},{"key":"bib83","doi-asserted-by":"publisher","DOI":"10.1126\/science.1105370"},{"key":"bib84","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1119569109"},{"key":"bib85","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1519157113"},{"key":"bib86","doi-asserted-by":"publisher","DOI":"10.1037\/a0020580"},{"key":"bib87","doi-asserted-by":"publisher","DOI":"10.1037\/h0032955"},{"key":"bib88","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.111.3.757"},{"key":"bib89","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2011.09.008"},{"key":"bib90","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2009.01.019"},{"key":"bib91","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004237"},{"key":"bib92","doi-asserted-by":"publisher","DOI":"10.1126\/science.1223252"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/jocn_a_01191","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:58:54Z","timestamp":1615586334000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/30\/1\/50-69\/28825"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1]]},"references-count":89,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1162\/jocn_a_01191"],"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01191","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,1]]}}}