{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T06:56:20Z","timestamp":1776408980856,"version":"3.51.2"},"reference-count":40,"publisher":"MIT Press - Journals","issue":"12","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2011,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Two fundamental questions underlie the expression of behavior, namely what to do and how vigorously to do it. The former is the topic of an overwhelming wealth of theoretical and empirical work particularly in the fields of reinforcement learning and decision-making, with various forms of affective prediction error playing key roles. Although vigor concerns motivation, and so is the subject of many empirical studies in diverse fields, it has suffered a dearth of computational models. Recently, Niv et al. [Niv, Y., Daw, N. D., Joel, D., &amp; Dayan, P. Tonic dopamine: Opportunity costs and the control of response vigor. Psychopharmacology (Berlin), 191, 507\u2013520, 2007] suggested that vigor should be controlled by the opportunity cost of time, which is itself determined by the average rate of reward. This coupling of reward rate and vigor can be shown to be optimal under the theory of average return reinforcement learning for a particular class of tasks but may also be a more general, perhaps hard-wired, characteristic of the architecture of control. We, therefore, tested the hypothesis that healthy human participants would adjust their RTs on the basis of the average rate of reward. We measured RTs in an odd-ball discrimination task for rewards whose magnitudes varied slowly but systematically. Linear regression on the subjects' individual RTs using the time varying average rate of reward as the regressor of interest, and including nuisance regressors such as the immediate reward in a round and in the preceding round, showed that a significant fraction of the variance in subjects' RTs could indeed be explained by the rate of experienced reward. This validates one of the key proposals associated with the model, illuminating an apparently mandatory form of coupling that may involve tonic levels of dopamine.<\/jats:p>","DOI":"10.1162\/jocn_a_00090","type":"journal-article","created":{"date-parts":[[2011,7,7]],"date-time":"2011-07-07T17:49:45Z","timestamp":1310060985000},"page":"3933-3938","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":78,"title":["Vigor in the Face of Fluctuating Rates of Reward: An Experimental Examination"],"prefix":"10.1162","volume":"23","author":[{"given":"Marc","family":"Guitart-Masip","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ulrik R.","family":"Beierholm","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raymond","family":"Dolan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emrah","family":"Duzel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Dayan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2011,12,1]]},"reference":[{"key":"2021072901062761900_R1","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1016\/j.neuron.2006.03.036","article-title":"Reward-motivated learning: Mesolimbic activation precedes memory formation.","volume":"50","author":"Adcock","year":"2006","journal-title":"Neuron"},{"key":"2021072901062761900_R2","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.neuron.2005.05.020","article-title":"Midbrain dopamine neurons encode a quantitative reward prediction error signal.","volume":"47","author":"Bayer","year":"2005","journal-title":"Neuron"},{"key":"2021072901062761900_R3","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/S0165-0173(98)00019-8","article-title":"What is the role of dopamine in reward: Hedonic impact, reward learning, or incentive salience?","volume":"28","author":"Berridge","year":"1998","journal-title":"Brain Research, Brain Research Reviews"},{"key":"2021072901062761900_R4","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1038\/npp.2010.151","article-title":"Opponency revisited: Competition and cooperation between dopamine and serotonin.","volume":"36","author":"Boureau","year":"2011","journal-title":"Neuropsychopharmacology"},{"key":"2021072901062761900_R5","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1038\/sj.npp.1300704","article-title":"Tryptophan depletion disrupts the motivational guidance of goal-directed behavior as a function of trait impulsivity.","volume":"30","author":"Cools","year":"2005","journal-title":"Neuropsychopharmacology"},{"key":"2021072901062761900_R6","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1038\/npp.2010.121","article-title":"Serotonin and dopamine: Unifying affective, activational, and decision functions.","volume":"36","author":"Cools","year":"2011","journal-title":"Neuropsychopharmacology"},{"key":"2021072901062761900_R7","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.conb.2006.03.006","article-title":"The computational neurobiology of learning and reward.","volume":"16","author":"Daw","year":"2006","journal-title":"Current Opinion in Neurobiology"},{"key":"2021072901062761900_R8","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1146\/annurev.neuro.051508.135607","article-title":"Serotonin in affective control.","volume":"32","author":"Dayan","year":"2009","journal-title":"Annual Review of Neuroscience"},{"key":"2021072901062761900_R9","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1177\/026988119100500414","article-title":"5-HT and mechanisms of defense.","volume":"5","author":"Deakin","year":"1991","journal-title":"Journal of Psychopharmacology"},{"key":"2021072901062761900_R10","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1038\/nn1103","article-title":"Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission.","volume":"6","author":"Floresco","year":"2003","journal-title":"Nature Neuroscience"},{"key":"2021072901062761900_R11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0306-4522(91)90196-U","article-title":"Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: A hypothesis for the etiology of schizophrenia.","volume":"41","author":"Grace","year":"1991","journal-title":"Neuroscience"},{"key":"2021072901062761900_R12","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.tins.2007.03.003","article-title":"Regulation of firing of dopaminergic neurons and control of goal-directed behaviors.","volume":"30","author":"Grace","year":"2007","journal-title":"Trends in Neurosciences"},{"key":"2021072901062761900_R13","doi-asserted-by":"crossref","first-page":"5623","DOI":"10.1523\/JNEUROSCI.1309-08.2008","article-title":"Dissociating the role of the orbito-frontal cortex and the striatum in the computation of goal values and prediction errors.","volume":"28","author":"Hare","year":"2008","journal-title":"Journal of Neuroscience"},{"key":"2021072901062761900_R14","doi-asserted-by":"crossref","first-page":"RC159","DOI":"10.1523\/JNEUROSCI.21-16-j0002.2001","article-title":"Anticipation of increasing monetary reward selectively recruits nucleus accumbens.","volume":"21","author":"Knutson","year":"2001","journal-title":"Journal of Neuroscience"},{"key":"2021072901062761900_R15","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/0006-8993(84)90777-7","article-title":"Selective nigral toxicity after systemic administration of 1-methyl-4-phenyl-1,2,5,6-tetrahydropyrine (MPTP) in the squirrel monkey.","volume":"292","author":"Langston","year":"1984","journal-title":"Brain Research"},{"key":"2021072901062761900_R16","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1101\/lm.978708","article-title":"Dopamine D1 and D2 receptors in the nucleus accumbens core and shell mediate Pavlovian-instrumental transfer.","volume":"15","author":"Lex","year":"2008","journal-title":"Learning and Memory"},{"key":"2021072901062761900_R17","doi-asserted-by":"crossref","first-page":"1356","DOI":"10.1038\/sj.npp.1300963","article-title":"The hippocampus modulates dopamine neuron responsivity by regulating the intensity of phasic neuron activation.","volume":"31","author":"Lodge","year":"2006","journal-title":"Neuropsychopharmacology"},{"key":"2021072901062761900_R19","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/S0896-6273(03)00154-5","article-title":"Temporal prediction errors in a passive learning task activate human striatum.","volume":"38","author":"McClure","year":"2003","journal-title":"Neuron"},{"key":"2021072901062761900_R20","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/S0896-6273(02)00974-1","article-title":"Neural economics and the biological substrates of valuation.","volume":"36","author":"Montague","year":"2002","journal-title":"Neuron"},{"key":"2021072901062761900_R21","doi-asserted-by":"crossref","first-page":"1936","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996","article-title":"A framework for mesencephalic dopamine systems based on predictive Hebbian learning.","volume":"16","author":"Montague","year":"1996","journal-title":"Journal of Neuroscience"},{"key":"2021072901062761900_R22","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1038\/nn1743","article-title":"Midbrain dopamine neurons encode decisions for future action.","volume":"9","author":"Morris","year":"2006","journal-title":"Nature Neuroscience"},{"key":"2021072901062761900_R24","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/s00213-006-0502-4","article-title":"Tonic dopamine: Opportunity costs and the control of response vigor.","volume":"191","author":"Niv","year":"2007","journal-title":"Psychopharmacology (Berlin)"},{"key":"2021072901062761900_R25","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1126\/science.1094285","article-title":"Dissociable roles of ventral and dorsal striatum in instrumental conditioning.","volume":"304","author":"O'Doherty","year":"2004","journal-title":"Science"},{"key":"2021072901062761900_R26","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/S0896-6273(03)00169-7","article-title":"Temporal difference models and reward-related learning in the human brain.","volume":"38","author":"O'Doherty","year":"2003","journal-title":"Neuron"},{"key":"2021072901062761900_R27","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/S0166-4328(02)00291-7","article-title":"Nucleus accumbens dopamine depletion impairs both acquisition and performance of appetitive Pavlovian approach behaviour: Implications for mesoaccumbens dopamine function.","volume":"137","author":"Parkinson","year":"2002","journal-title":"Behavioural Brain Research"},{"key":"2021072901062761900_R28","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1007\/s00213-006-0626-6","article-title":"Calculating utility: Preclinical evidence for cost-benefit analysis by mesolimbic dopamine.","volume":"191","author":"Phillips","year":"2007","journal-title":"Psychopharmacology (Berlin)"},{"key":"2021072901062761900_R40","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","article-title":"The diffusion decision model: Theory and data for two-choice decision tasks.","volume":"20","author":"Ratcliff","year":"2008","journal-title":"Neural Computation"},{"key":"2021072901062761900_R41","first-page":"127","article-title":"A diffusion model account of masking in two-choice letter identification.","volume":"26","author":"Ratcliff","year":"2000","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"key":"2021072901062761900_R42","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1038\/77739","article-title":"The influence of urgency on decision time.","volume":"3","author":"Reddi","year":"2000","journal-title":"Nature Neuroscience"},{"key":"2021072901062761900_R29","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1038\/nn2013","article-title":"Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards.","volume":"10","author":"Roesch","year":"2007","journal-title":"Nature Neuroscience"},{"key":"2021072901062761900_R30","doi-asserted-by":"crossref","first-page":"13525","DOI":"10.1523\/JNEUROSCI.1747-10.2010","article-title":"Testing the reward prediction error hypothesis with an axiomatic model.","volume":"30","author":"Rutledge","year":"2010","journal-title":"Journal of Neuroscience"},{"key":"2021072901062761900_R31","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/S0166-4328(02)00282-6","article-title":"Motivational views of reinforcement: Implications for understanding the behavioral functions of nucleus accumbens dopamine.","volume":"137","author":"Salamone","year":"2002","journal-title":"Behavioural Brain Research"},{"key":"2021072901062761900_R32","doi-asserted-by":"crossref","first-page":"9913","DOI":"10.1523\/JNEUROSCI.23-30-09913.2003","article-title":"Correlated coding of motivation and outcome of decision by dopamine neurons.","volume":"23","author":"Satoh","year":"2003","journal-title":"Journal of Neuroscience"},{"key":"2021072901062761900_R33","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A neural substrate of prediction and reward.","volume":"275","author":"Schultz","year":"1997","journal-title":"Science"},{"key":"2021072901062761900_R34","volume-title":"Reinforcement learning: An introduction","author":"Sutton","year":"1998"},{"key":"2021072901062761900_R35","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1152\/jn.00288.2001","article-title":"Reward-dependent spatial selectivity of anticipatory activity in monkey caudate neurons.","volume":"87","author":"Takikawa","year":"2002","journal-title":"Journal of Neurophysiology"},{"key":"2021072901062761900_R36","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1007\/BF00179197","article-title":"6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine.","volume":"90","author":"Taylor","year":"1986","journal-title":"Psychopharmacology (Berlin)"},{"key":"2021072901062761900_R37","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1111\/j.1365-201X.1971.tb11001.x","article-title":"Adipsia and aphagia after 6-hydroxydopamine induced degeneration of the nigro-striatal dopamine system.","volume":"367","author":"Ungerstedt","year":"1971","journal-title":"Acta Physiologica Scandinavica Supplement"},{"key":"2021072901062761900_R38","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1007\/s002210100856","article-title":"Behavioral reactions reflecting differential reward expectations in monkeys.","volume":"140","author":"Watanabe","year":"2001","journal-title":"Experimental Brain Research"},{"key":"2021072901062761900_R39","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1016\/j.neuron.2005.01.010","article-title":"Reward-related fMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation.","volume":"45","author":"Wittmann","year":"2005","journal-title":"Neuron"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/23\/12\/3933\/1942751\/jocn_a_00090.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/23\/12\/3933\/1942751\/jocn_a_00090.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,29]],"date-time":"2021-07-29T01:29:32Z","timestamp":1627522172000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/23\/12\/3933\/5275\/Vigor-in-the-Face-of-Fluctuating-Rates-of-Reward"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,12,1]]},"references-count":40,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2011,12,1]]},"published-print":{"date-parts":[[2011,12,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00090","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2011,12]]},"published":{"date-parts":[[2011,12,1]]}}}