{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T07:45:47Z","timestamp":1793346347429,"version":"4.5.0"},"reference-count":208,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T00:00:00Z","timestamp":1616544000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["T32GM007753"],"award-info":[{"award-number":["T32GM007753"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["T32MH020017"],"award-info":[{"award-number":["T32MH020017"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U19 NS113201-01"],"award-info":[{"award-number":["U19 NS113201-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008982","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE-1745303"],"award-info":[{"award-number":["DGE-1745303"]}],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Slow-timescale (tonic) changes in dopamine (DA) contribute to a wide variety of processes in reinforcement learning, interval timing, and other domains. Furthermore, changes in tonic DA exert distinct effects depending on when they occur (e.g., during learning vs. performance) and what task the subject is performing (e.g., operant vs. classical conditioning). Two influential theories of tonic DA\u2014the average reward theory and the Bayesian theory in which DA controls precision\u2014have each been successful at explaining a subset of empirical findings. But how the same DA signal performs two seemingly distinct functions without creating crosstalk is not well understood. Here we reconcile the two theories under the unifying framework of \u2018rational inattention,\u2019 which (1) conceptually links average reward and precision, (2) outlines how DA manipulations affect this relationship, and in so doing, (3) captures new empirical phenomena. In brief, rational inattention asserts that agents can increase their precision in a task (and thus improve their performance) by paying a cognitive cost. Crucially, whether this cost is worth paying depends on average reward availability, reported by DA. The monotonic relationship between average reward and precision means that the DA signal contains the information necessary to retrieve the precision. When this information is needed after the task is performed, as presumed by Bayesian inference, acute manipulations of DA will bias behavior in predictable ways. We show how this framework reconciles a remarkably large collection of experimental findings. In reinforcement learning, the rational inattention framework predicts that learning from positive and negative feedback should be enhanced in high and low DA states, respectively, and that DA should tip the exploration-exploitation balance toward exploitation. In interval timing, this framework predicts that DA should increase the speed of the internal clock and decrease the extent of interference by other temporal stimuli during temporal reproduction (the central tendency effect). Finally, rational inattention makes the new predictions that these effects should be critically dependent on the controllability of rewards, that post-reward delays in intertemporal choice tasks should be underestimated, and that average reward manipulations should affect the speed of the clock\u2014thus capturing empirical findings that are unexplained by either theory alone. Our results suggest that a common computational repertoire may underlie the seemingly heterogeneous roles of DA.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1008659","type":"journal-article","created":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T13:30:56Z","timestamp":1616592656000},"page":"e1008659","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":31,"title":["Rational inattention and tonic dopamine"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7622-716X","authenticated-orcid":true,"given":"John G.","family":"Mikhael","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucy","family":"Lai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6546-3298","authenticated-orcid":true,"given":"Samuel J.","family":"Gershman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2021,3,24]]},"reference":[{"issue":"5306","key":"pcbi.1008659.ref001","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A neural substrate of prediction and reward","volume":"275","author":"W Schultz","year":"1997","journal-title":"Science"},{"issue":"7","key":"pcbi.1008659.ref002","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1038\/nn.3413","article-title":"A causal link between prediction errors, dopamine neurons and learning","volume":"16","author":"EE Steinberg","year":"2013","journal-title":"Nature neuroscience"},{"key":"pcbi.1008659.ref003","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1038\/nature14855","article-title":"Arithmetic and local circuitry underlying dopamine prediction errors","volume":"525","author":"N Eshel","year":"2015","journal-title":"Nature"},{"key":"pcbi.1008659.ref004","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1126\/science.1102941","article-title":"By carrot or by stick: Cognitive reinforcement learning in Parkinsonism","volume":"306","author":"MJ Frank","year":"2004","journal-title":"Science"},{"issue":"41","key":"pcbi.1008659.ref005","doi-asserted-by":"crossref","first-page":"16311","DOI":"10.1073\/pnas.0706111104","article-title":"Genetic triple dissociation reveals multiple roles for dopamine in reinforcement learning","volume":"104","author":"MJ Frank","year":"2007","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"8","key":"pcbi.1008659.ref006","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1038\/nn.2342","article-title":"Prefrontal and striatal dopaminergic genes predict individual differences in exploration and exploitation","volume":"12","author":"MJ Frank","year":"2009","journal-title":"Nature neuroscience"},{"issue":"6","key":"pcbi.1008659.ref007","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1016\/j.neuron.2017.02.029","article-title":"Dynamic nigrostriatal dopamine biases action selection","volume":"93","author":"CD Howard","year":"2017","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1008659.ref008","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.cell.2018.06.012","article-title":"Optogenetic Editing Reveals the Hierarchical Organization of Learned Action Sequences","volume":"174","author":"CE Geddes","year":"2018","journal-title":"Cell"},{"issue":"6","key":"pcbi.1008659.ref009","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1016\/j.neuron.2018.08.002","article-title":"Monitoring and updating of action selection for goal-directed behavior through the striatal direct and indirect pathways","volume":"99","author":"S Nonomura","year":"2018","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1008659.ref010","doi-asserted-by":"crossref","first-page":"e16528","DOI":"10.1371\/journal.pone.0016528","article-title":"Conjunctive processing of locomotor signals by the ventral tegmental area neuronal population","volume":"6","author":"DV Wang","year":"2011","journal-title":"PLoS One"},{"issue":"1637","key":"pcbi.1008659.ref011","doi-asserted-by":"crossref","first-page":"20120473","DOI":"10.1098\/rstb.2012.0473","article-title":"Action, time and the basal ganglia","volume":"369","author":"HH Yin","year":"2014","journal-title":"Philosophical Transactions of the Royal Society B: Biological Sciences"},{"key":"pcbi.1008659.ref012","doi-asserted-by":"crossref","first-page":"39","DOI":"10.3389\/fnint.2015.00039","article-title":"Beyond reward prediction errors: the role of dopamine in movement kinematics","volume":"9","author":"JW Barter","year":"2015","journal-title":"Frontiers in integrative neuroscience"},{"issue":"7351","key":"pcbi.1008659.ref013","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1038\/nature09995","article-title":"Control of visual cortical signals by prefrontal dopamine","volume":"474","author":"B Noudoost","year":"2011","journal-title":"Nature"},{"issue":"1","key":"pcbi.1008659.ref014","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.celrep.2019.11.082","article-title":"Dopamine Gates Visual Signals in Monkey Prefrontal Cortex Neurons","volume":"30","author":"M Stalter","year":"2020","journal-title":"Cell Reports"},{"issue":"1","key":"pcbi.1008659.ref015","first-page":"18","article-title":"Methamphetamine and time estimation","volume":"7","author":"AV Maricq","year":"1981","journal-title":"Journal of Experimental Psychology: Animal Behavior Processes"},{"issue":"1","key":"pcbi.1008659.ref016","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1007\/BF00433008","article-title":"The differential effects of haloperidol and methamphetamine on time estimation in the rat","volume":"79","author":"AV Maricq","year":"1983","journal-title":"Psychopharmacology"},{"issue":"2","key":"pcbi.1008659.ref017","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1016\/j.neuropsychologia.2012.09.014","article-title":"Differential effects of amphetamine and haloperidol on temporal reproduction: dopaminergic regulation of attention and clock speed","volume":"51","author":"JI Lake","year":"2013","journal-title":"Neuropsychologia"},{"issue":"6317","key":"pcbi.1008659.ref018","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1126\/science.aah5234","article-title":"Midbrain dopamine neurons control judgment of time","volume":"354","author":"S Soares","year":"2016","journal-title":"Science"},{"issue":"1","key":"pcbi.1008659.ref019","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/S0301-0082(02)00011-4","article-title":"Dopamine and the regulation of cognition and attention","volume":"67","author":"A Nieoullon","year":"2002","journal-title":"Progress in neurobiology"},{"issue":"1","key":"pcbi.1008659.ref020","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0306-4522(91)90196-U","article-title":"Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia","volume":"41","author":"AA Grace","year":"1991","journal-title":"Neuroscience"},{"issue":"7","key":"pcbi.1008659.ref021","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.tics.2008.03.006","article-title":"Dialogues on prediction errors","volume":"12","author":"Y Niv","year":"2008","journal-title":"Trends in cognitive sciences"},{"issue":"Supplement 3","key":"pcbi.1008659.ref022","doi-asserted-by":"crossref","first-page":"15647","DOI":"10.1073\/pnas.1014269108","article-title":"Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis","volume":"108","author":"PW Glimcher","year":"2011","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"5","key":"pcbi.1008659.ref023","doi-asserted-by":"crossref","first-page":"1538","DOI":"10.1523\/JNEUROSCI.4467-08.2009","article-title":"Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration","volume":"29","author":"R Cools","year":"2009","journal-title":"Journal of Neuroscience"},{"issue":"6","key":"pcbi.1008659.ref024","doi-asserted-by":"crossref","first-page":"1871","DOI":"10.1093\/brain\/aws083","article-title":"Dopamine and performance in a reinforcement learning task: evidence from Parkinson\u2019s disease","volume":"135","author":"T Shiner","year":"2012","journal-title":"Brain"},{"issue":"7","key":"pcbi.1008659.ref025","doi-asserted-by":"crossref","first-page":"1144","DOI":"10.1111\/j.1460-9568.2012.08043.x","article-title":"Decomposing effects of dopaminergic medication in Parkinson\u2019s disease on probabilistic action selection\u2013learning or performance?","volume":"35","author":"P Smittenaar","year":"2012","journal-title":"European Journal of Neuroscience"},{"issue":"7106","key":"pcbi.1008659.ref026","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1038\/nature05051","article-title":"Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans","volume":"442","author":"M Pessiglione","year":"2006","journal-title":"Nature"},{"issue":"3","key":"pcbi.1008659.ref027","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1037\/a0037015","article-title":"Opponent actor learning (OpAL): Modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive","volume":"121","author":"AG Collins","year":"2014","journal-title":"Psychological review"},{"issue":"10","key":"pcbi.1008659.ref028","doi-asserted-by":"crossref","first-page":"2366","DOI":"10.1038\/npp.2014.84","article-title":"Role of dopamine D2 receptors in human reinforcement learning","volume":"39","author":"C Eisenegger","year":"2014","journal-title":"Neuropsychopharmacology"},{"issue":"16","key":"pcbi.1008659.ref029","doi-asserted-by":"crossref","first-page":"6298","DOI":"10.1523\/JNEUROSCI.4561-14.2015","article-title":"Injection of a dopamine type 2 receptor antagonist into the dorsal striatum disrupts choices driven by previous outcomes, but not perceptual inference","volume":"35","author":"E Lee","year":"2015","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1008659.ref030","doi-asserted-by":"crossref","first-page":"6770","DOI":"10.1038\/s41598-019-43245-z","article-title":"Dopamine blockade impairs the exploration-exploitation trade-off in rats","volume":"9","author":"F Cinotti","year":"2019","journal-title":"Scientific reports"},{"key":"pcbi.1008659.ref031","doi-asserted-by":"crossref","first-page":"170","DOI":"10.3389\/fnbeh.2010.00170","article-title":"Tonic dopamine modulates exploitation of reward learning","volume":"4","author":"JA Beeler","year":"2010","journal-title":"Frontiers in behavioral neuroscience"},{"key":"pcbi.1008659.ref032","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1038\/nn.4173","article-title":"Mesolimbic dopamine signals the value of work","volume":"19","author":"AA Hamid","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"2","key":"pcbi.1008659.ref033","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/0166-4328(94)90108-2","article-title":"Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost\/benefit procedure","volume":"65","author":"JD Salamone","year":"1994","journal-title":"Behavioural brain research"},{"issue":"3","key":"pcbi.1008659.ref034","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/s00213-006-0502-4","article-title":"Tonic dopamine: opportunity costs and the control of response vigor","volume":"191","author":"Y Niv","year":"2007","journal-title":"Psychopharmacology"},{"key":"pcbi.1008659.ref035","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.cortex.2015.04.003","article-title":"Dopamine enhances willingness to exert effort for reward in Parkinson\u2019s disease","volume":"69","author":"TTJ Chong","year":"2015","journal-title":"cortex"},{"issue":"6","key":"pcbi.1008659.ref036","doi-asserted-by":"crossref","first-page":"1747","DOI":"10.1016\/j.celrep.2012.11.014","article-title":"A role for dopamine-mediated learning in the pathophysiology and treatment of Parkinson\u2019s disease","volume":"2","author":"JA Beeler","year":"2012","journal-title":"Cell reports"},{"issue":"6","key":"pcbi.1008659.ref037","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1016\/0091-3057(86)90109-7","article-title":"Affinity for the dopamine D2 receptor predicts neuroleptic potency in decreasing the speed of an internal clock","volume":"25","author":"WH Meck","year":"1986","journal-title":"Pharmacology Biochemistry and Behavior"},{"issue":"2","key":"pcbi.1008659.ref038","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.nlm.2007.04.005","article-title":"Ketamine \u201cunlocks\u201d the reduced clock-speed effects of cocaine following extended training: evidence for dopamine\u2013glutamate interactions in timing and time perception","volume":"88","author":"RK Cheng","year":"2007","journal-title":"Neurobiology of learning and memory"},{"issue":"3","key":"pcbi.1008659.ref039","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1162\/089892998562762","article-title":"Coupled temporal memories in Parkinson\u2019s disease: a dopamine-related dysfunction","volume":"10","author":"C Malapani","year":"1998","journal-title":"Journal of Cognitive Neuroscience"},{"issue":"2","key":"pcbi.1008659.ref040","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1162\/089892902317236920","article-title":"Separating storage from retrieval dysfunction of temporal memory in Parkinson\u2019s disease","volume":"14","author":"C Malapani","year":"2002","journal-title":"Journal of Cognitive Neuroscience"},{"issue":"11","key":"pcbi.1008659.ref041","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1016\/j.tics.2013.09.009","article-title":"Bayesian optimization of time perception","volume":"17","author":"Z Shi","year":"2013","journal-title":"Trends in Cognitive Sciences"},{"issue":"8","key":"pcbi.1008659.ref042","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1038\/nn.2590","article-title":"Temporal context calibrates interval timing","volume":"13","author":"M Jazayeri","year":"2010","journal-title":"Nature neuroscience"},{"issue":"11","key":"pcbi.1008659.ref043","doi-asserted-by":"crossref","first-page":"e1002771","DOI":"10.1371\/journal.pcbi.1002771","article-title":"Internal representations of temporal statistics and feedback calibrate motor-sensory interval timing","volume":"8","author":"L Acerbi","year":"2012","journal-title":"PLoS computational biology"},{"key":"pcbi.1008659.ref044","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.actpsy.2013.06.011","article-title":"Temporal reproductions are influenced by an internal reference: Explaining the Vierordt effect","volume":"147","author":"KM Bausenhart","year":"2014","journal-title":"Acta Psychologica"},{"key":"pcbi.1008659.ref045","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.actpsy.2013.07.009","article-title":"Duration perception in crossmodally-defined intervals","volume":"147","author":"KM Mayer","year":"2014","journal-title":"Acta psychologica"},{"issue":"2","key":"pcbi.1008659.ref046","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1073\/pnas.1610706114","article-title":"Generalization of prior information for rapid Bayesian time estimation","volume":"114","author":"NW Roach","year":"2017","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2","key":"pcbi.1008659.ref047","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1007\/s10071-015-0935-4","article-title":"Temporal averaging across multiple response options: insight into the mechanisms underlying integration","volume":"19","author":"BJ De Corte","year":"2016","journal-title":"Animal cognition"},{"issue":"10","key":"pcbi.1008659.ref048","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1038\/nrn1764","article-title":"What makes us tick? Functional and neural mechanisms of interval timing","volume":"6","author":"CV Buhusi","year":"2005","journal-title":"Nature Reviews Neuroscience"},{"key":"pcbi.1008659.ref049","author":"E Ludvig","year":"2008","journal-title":"Stimulus representation and the timing of reward-prediction errors in models of the dopamine system"},{"key":"pcbi.1008659.ref050","doi-asserted-by":"crossref","first-page":"194","DOI":"10.3389\/fncom.2013.00194","article-title":"Time representation in reinforcement learning models of the basal ganglia","volume":"7","author":"SJ Gershman","year":"2014","journal-title":"Frontiers in computational neuroscience"},{"issue":"10","key":"pcbi.1008659.ref051","doi-asserted-by":"crossref","first-page":"911","DOI":"10.1016\/j.tics.2018.08.004","article-title":"Integrating models of interval timing and reinforcement learning","volume":"22","author":"EA Petter","year":"2018","journal-title":"Trends in Cognitive Sciences"},{"issue":"1","key":"pcbi.1008659.ref052","doi-asserted-by":"crossref","first-page":"e1002327","DOI":"10.1371\/journal.pcbi.1002327","article-title":"Dopamine, affordance and active inference","volume":"8","author":"KJ Friston","year":"2012","journal-title":"PLoS Computational Biology"},{"issue":"3","key":"pcbi.1008659.ref053","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/0301-0511(93)90018-4","article-title":"On dopaminergic modulation of temporal information processing","volume":"36","author":"TH Rammsayer","year":"1993","journal-title":"Biological psychology"},{"issue":"4","key":"pcbi.1008659.ref054","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1037\/a0016503","article-title":"Impaired timing precision produced by striatal D2 receptor overexpression is mediated by cognitive and motivational deficits","volume":"123","author":"RD Ward","year":"2009","journal-title":"Behavioral neuroscience"},{"issue":"10","key":"pcbi.1008659.ref055","doi-asserted-by":"crossref","first-page":"2811","DOI":"10.1162\/jocn.2011.21626","article-title":"Double dissociation of dopamine genes and timing in humans","volume":"23","author":"M Wiener","year":"2011","journal-title":"Journal of cognitive neuroscience"},{"issue":"50","key":"pcbi.1008659.ref056","doi-asserted-by":"crossref","first-page":"20726","DOI":"10.1073\/pnas.1211258109","article-title":"Prefrontal D1 dopamine signaling is required for temporal control","volume":"109","author":"NS Narayanan","year":"2012","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"50","key":"pcbi.1008659.ref057","doi-asserted-by":"crossref","first-page":"16774","DOI":"10.1523\/JNEUROSCI.2772-14.2014","article-title":"D1-dependent 4 Hz oscillations and ramping activity in rodent medial frontal cortex during interval timing","volume":"34","author":"KL Parker","year":"2014","journal-title":"Journal of Neuroscience"},{"issue":"14","key":"pcbi.1008659.ref058","doi-asserted-by":"crossref","first-page":"2504","DOI":"10.1002\/mds.23893","article-title":"Differential response of speed, amplitude, and rhythm to dopaminergic medications in Parkinson\u2019s disease","volume":"26","author":"AJ Espay","year":"2011","journal-title":"Movement Disorders"},{"issue":"22","key":"pcbi.1008659.ref059","doi-asserted-by":"crossref","first-page":"E3169","DOI":"10.1073\/pnas.1606098113","article-title":"Phasic dopamine release in the medial prefrontal cortex enhances stimulus discrimination","volume":"113","author":"AT Popescu","year":"2016","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2","key":"pcbi.1008659.ref060","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1167\/11.2.15","article-title":"Dopaminergic stimulation enhances confidence and accuracy in seeing rapidly presented words","volume":"11","author":"HC Lou","year":"2011","journal-title":"Journal of vision"},{"issue":"3","key":"pcbi.1008659.ref061","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1093\/schbul\/sbt064","article-title":"Dopaminergic modulation of probabilistic reasoning and overconfidence in errors: a double-blind study","volume":"40","author":"C Andreou","year":"2013","journal-title":"Schizophrenia bulletin"},{"key":"pcbi.1008659.ref062","doi-asserted-by":"crossref","first-page":"414","DOI":"10.3389\/fpsyg.2015.00414","article-title":"Associations between visual perception accuracy and confidence in a dopaminergic manipulation study","volume":"6","author":"C Andreou","year":"2015","journal-title":"Frontiers in psychology"},{"issue":"3","key":"pcbi.1008659.ref063","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1016\/S0304-3932(03)00029-1","article-title":"Implications of rational inattention","volume":"50","author":"CA Sims","year":"2003","journal-title":"Journal of Monetary Economics"},{"issue":"7","key":"pcbi.1008659.ref064","doi-asserted-by":"crossref","first-page":"2183","DOI":"10.1257\/aer.20140117","article-title":"Revealed preference, rational inattention, and costly information acquisition","volume":"105","author":"A Caplin","year":"2015","journal-title":"American Economic Review"},{"issue":"1","key":"pcbi.1008659.ref065","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1257\/aer.20130047","article-title":"Rational inattention to discrete choices: A new foundation for the multinomial logit model","volume":"105","author":"F Mat\u011bjka","year":"2015","journal-title":"American Economic Review"},{"issue":"2","key":"pcbi.1008659.ref066","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/BF00429052","article-title":"A functional effect of dopamine in the nucleus accumbens and in some other dopamine-rich parts of the rat brain","volume":"45","author":"DM Jackson","year":"1975","journal-title":"Psychopharmacologia"},{"issue":"1","key":"pcbi.1008659.ref067","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/0091-3057(87)90485-0","article-title":"Effects of systemic and intracranial amphetamine injections on behavior in the open field: a detailed analysis","volume":"27","author":"GD Carr","year":"1987","journal-title":"Pharmacology Biochemistry and Behavior"},{"issue":"1","key":"pcbi.1008659.ref068","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/0091-3057(94)90460-X","article-title":"Nucleus accumbens dopamine depletions in rats affect relative response allocation in a novel cost\/benefit procedure","volume":"49","author":"MS Cousins","year":"1994","journal-title":"Pharmacology Biochemistry and Behavior"},{"issue":"3","key":"pcbi.1008659.ref069","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1016\/S0091-3057(97)00544-3","article-title":"The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell","volume":"59","author":"J Sokolowski","year":"1998","journal-title":"Pharmacology Biochemistry and Behavior"},{"issue":"1","key":"pcbi.1008659.ref070","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/S0165-0173(99)00023-5","article-title":"The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking","volume":"31","author":"S Ikemoto","year":"1999","journal-title":"Brain Research Reviews"},{"issue":"2","key":"pcbi.1008659.ref071","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1016\/S0306-4522(99)00004-4","article-title":"Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement","volume":"92","author":"J Aberman","year":"1999","journal-title":"Neuroscience"},{"issue":"4","key":"pcbi.1008659.ref072","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1016\/S0306-4522(01)00249-4","article-title":"Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement","volume":"105","author":"J Salamone","year":"2001","journal-title":"Neuroscience"},{"issue":"1-2","key":"pcbi.1008659.ref073","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/S0166-4328(02)00292-9","article-title":"Nucleus accumbens dopamine and work requirements on interval schedules","volume":"137","author":"M Correa","year":"2002","journal-title":"Behavioural brain research"},{"issue":"6","key":"pcbi.1008659.ref074","doi-asserted-by":"crossref","first-page":"1749","DOI":"10.1111\/j.1460-9568.2005.03972.x","article-title":"Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions","volume":"21","author":"S Mingote","year":"2005","journal-title":"European Journal of Neuroscience"},{"issue":"1","key":"pcbi.1008659.ref075","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.coph.2004.09.004","article-title":"Beyond the reward hypothesis: alternative functions of nucleus accumbens dopamine","volume":"5","author":"JD Salamone","year":"2005","journal-title":"Current opinion in pharmacology"},{"issue":"3","key":"pcbi.1008659.ref076","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1007\/s00213-006-0578-x","article-title":"The debate over dopamine\u2019s role in reward: the case for incentive salience","volume":"191","author":"KC Berridge","year":"2007","journal-title":"Psychopharmacology"},{"issue":"27","key":"pcbi.1008659.ref077","doi-asserted-by":"crossref","first-page":"E255","DOI":"10.1073\/pnas.1101920108","article-title":"Disentangling pleasure from incentive salience and learning signals in brain reward circuitry","volume":"108","author":"KS Smith","year":"2011","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"7","key":"pcbi.1008659.ref078","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1101\/lm.2229311","article-title":"Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling","volume":"18","author":"KM Wassum","year":"2011","journal-title":"Learning & memory"},{"issue":"7","key":"pcbi.1008659.ref079","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1111\/j.1460-9568.2012.07990.x","article-title":"From prediction error to incentive salience: mesolimbic computation of reward motivation","volume":"35","author":"KC Berridge","year":"2012","journal-title":"European Journal of Neuroscience"},{"issue":"8","key":"pcbi.1008659.ref080","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1038\/npp.2013.48","article-title":"Dopamine modulates reward-related vigor","volume":"38","author":"U Beierholm","year":"2013","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1008659.ref081","doi-asserted-by":"crossref","first-page":"77","DOI":"10.3389\/fnhum.2011.00077","article-title":"A learning-style theory for understanding autistic behaviors","volume":"5","author":"N Qian","year":"2011","journal-title":"Frontiers in Human Neuroscience"},{"issue":"10","key":"pcbi.1008659.ref082","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1016\/j.tics.2012.08.009","article-title":"When the world becomes \u2018too real\u2019: a Bayesian explanation of autistic perception","volume":"16","author":"E Pellicano","year":"2012","journal-title":"Trends in cognitive sciences"},{"issue":"42","key":"pcbi.1008659.ref083","doi-asserted-by":"crossref","first-page":"15220","DOI":"10.1073\/pnas.1416797111","article-title":"Autism as a disorder of prediction","volume":"111","author":"P Sinha","year":"2014","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"5","key":"pcbi.1008659.ref084","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1037\/bul0000097","article-title":"Bayesian approaches to autism: Towards volatility, action, and behavior","volume":"143","author":"CJ Palmer","year":"2017","journal-title":"Psychological Bulletin"},{"issue":"10","key":"pcbi.1008659.ref085","doi-asserted-by":"crossref","first-page":"e47502","DOI":"10.1371\/journal.pone.0047502","article-title":"Smooth pursuit and visual occlusion: active inference and oculomotor control in schizophrenia","volume":"7","author":"RA Adams","year":"2012","journal-title":"PloS One"},{"key":"pcbi.1008659.ref086","doi-asserted-by":"crossref","first-page":"47","DOI":"10.3389\/fpsyt.2013.00047","article-title":"The computational anatomy of psychosis","volume":"4","author":"RA Adams","year":"2013","journal-title":"Frontiers in Psychiatry"},{"issue":"1","key":"pcbi.1008659.ref087","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1038\/npp.2010.163","article-title":"Glutamatergic model psychoses: prediction error, learning, and inference","volume":"36","author":"PR Corlett","year":"2011","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1008659.ref088","article-title":"Differential Effects of D1 and D2 Dopamine Agonists on Memory, Motivation, Learning and Response Time in Non-human Primates","author":"RA Marino","year":"2018","journal-title":"European Journal of Neuroscience"},{"key":"pcbi.1008659.ref089","unstructured":"Posner MI. Attention in cognitive neuroscience: an overview. 1995."},{"issue":"4","key":"pcbi.1008659.ref090","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1038\/nrn2258","article-title":"Noise in the nervous system","volume":"9","author":"AA Faisal","year":"2008","journal-title":"Nature Reviews Neuroscience"},{"key":"pcbi.1008659.ref091","unstructured":"Yuille AL, B\u00fclthoff HH. Bayesian decision theory and psychophysics. 1993."},{"issue":"6971","key":"pcbi.1008659.ref092","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1038\/nature02169","article-title":"Bayesian integration in sensorimotor learning","volume":"427","author":"KP K\u00f6rding","year":"2004","journal-title":"Nature"},{"issue":"7","key":"pcbi.1008659.ref093","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/j.tics.2006.05.003","article-title":"Bayesian decision theory in sensorimotor control","volume":"10","author":"KP K\u00f6rding","year":"2006","journal-title":"Trends in cognitive sciences"},{"key":"pcbi.1008659.ref094","volume-title":"Bayesian brain: Probabilistic approaches to neural coding","author":"K Doya","year":"2007"},{"issue":"4","key":"pcbi.1008659.ref095","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/j.humov.2007.05.005","article-title":"Probabilistic models in human sensorimotor control","volume":"26","author":"DM Wolpert","year":"2007","journal-title":"Human movement science"},{"issue":"26","key":"pcbi.1008659.ref096","doi-asserted-by":"crossref","first-page":"9839","DOI":"10.1073\/pnas.0308394101","article-title":"The loss function of sensorimotor learning","volume":"101","author":"KP K\u00f6rding","year":"2004","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"6","key":"pcbi.1008659.ref097","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/j.jmp.2012.08.002","article-title":"A framework for Bayesian optimality of psychophysical laws","volume":"56","author":"JZ Sun","year":"2012","journal-title":"Journal of Mathematical Psychology"},{"issue":"12","key":"pcbi.1008659.ref098","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1016\/j.tins.2004.10.007","article-title":"The Bayesian brain: the role of uncertainty in neural coding and computation","volume":"27","author":"DC Knill","year":"2004","journal-title":"TRENDS in Neurosciences"},{"issue":"3","key":"pcbi.1008659.ref099","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"CE Shannon","year":"1948","journal-title":"Bell system technical journal"},{"key":"pcbi.1008659.ref100","volume-title":"Elements of information theory","author":"TM Cover","year":"2012"},{"key":"pcbi.1008659.ref101","unstructured":"Mackowiak BA, Matejka F, Wiederholt M, et al. Survey: Rational Inattention, a Disciplined Behavioral Model. CEPR Discussion Papers; 2018."},{"issue":"6","key":"pcbi.1008659.ref102","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1017\/S0140525X12003196","article-title":"An opportunity cost model of subjective effort and task performance","volume":"36","author":"R Kurzban","year":"2013","journal-title":"Behavioral and brain sciences"},{"key":"pcbi.1008659.ref103","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.cognition.2016.03.020","article-title":"Rate\u2013distortion theory and human perception","volume":"152","author":"CR Sims","year":"2016","journal-title":"Cognition"},{"issue":"4","key":"pcbi.1008659.ref104","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1038\/nn.4506","article-title":"Motivational neural circuits underlying reinforcement learning","volume":"20","author":"BB Averbeck","year":"2017","journal-title":"Nature Neuroscience"},{"issue":"6","key":"pcbi.1008659.ref105","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1037\/h0042354","article-title":"Stimulus and response generalization: tests of a model relating generalization to distance in psychological space","volume":"55","author":"RN Shepard","year":"1958","journal-title":"Journal of Experimental Psychology"},{"key":"pcbi.1008659.ref106","volume-title":"Individual Choice Behavior: a Theoretical Analysis","author":"RD Luce","year":"1959"},{"issue":"48","key":"pcbi.1008659.ref107","doi-asserted-by":"crossref","first-page":"15104","DOI":"10.1523\/JNEUROSCI.3524-09.2009","article-title":"Dopaminergic drugs modulate learning rates and perseveration in Parkinson\u2019s patients in a dynamic foraging task","volume":"29","author":"RB Rutledge","year":"2009","journal-title":"Journal of Neuroscience"},{"issue":"6","key":"pcbi.1008659.ref108","doi-asserted-by":"crossref","first-page":"1490","DOI":"10.1002\/hbm.22000","article-title":"Ventral striatal prediction error signaling is associated with dopamine synthesis capacity and fluid intelligence","volume":"34","author":"F Schlagenhauf","year":"2013","journal-title":"Human brain mapping"},{"issue":"2-3","key":"pcbi.1008659.ref109","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.beproc.2005.11.016","article-title":"Effects of prefeeding, intercomponent-interval food, and extinction on temporal discrimination and pacemaker rate","volume":"71","author":"RD Ward","year":"2006","journal-title":"Behavioural Processes"},{"issue":"1","key":"pcbi.1008659.ref110","doi-asserted-by":"crossref","first-page":"60","DOI":"10.3758\/BF03196075","article-title":"Disruption of temporal discrimination and the choose-short effect","volume":"35","author":"RD Ward","year":"2007","journal-title":"Animal Learning & Behavior"},{"issue":"1","key":"pcbi.1008659.ref111","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.beproc.2012.02.014","article-title":"Motivation and timing: clues for modeling the reward system","volume":"90","author":"T Galtress","year":"2012","journal-title":"Behavioural processes"},{"issue":"2","key":"pcbi.1008659.ref112","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1037\/0735-7044.116.2.291","article-title":"Differential effects of methamphetamine and haloperidol on the control of an internal clock","volume":"116","author":"CV Buhusi","year":"2002","journal-title":"Behavioral neuroscience"},{"issue":"1","key":"pcbi.1008659.ref113","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/S0091-3057(03)00036-4","article-title":"Effects of dopamine antagonists on the timing of two intervals","volume":"75","author":"MR Drew","year":"2003","journal-title":"Pharmacology Biochemistry and Behavior"},{"issue":"3","key":"pcbi.1008659.ref114","doi-asserted-by":"crossref","DOI":"10.46867\/C49P4Q","article-title":"Pharmacology of temporal cognition in two mouse strains","volume":"14","author":"RT Abner","year":"2001","journal-title":"International Journal of Comparative Psychology"},{"issue":"4","key":"pcbi.1008659.ref115","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1037\/0735-7044.117.4.774","article-title":"Effects of methamphetanine on duration discrimination","volume":"117","author":"M\u00d6 \u00c7evik","year":"2003","journal-title":"Behavioral Neuroscience"},{"issue":"2","key":"pcbi.1008659.ref116","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s00213-006-0489-x","article-title":"Single-trials analyses demonstrate that increases in clock speed contribute to the methamphetamine-induced horizontal shifts in peak-interval timing functions","volume":"188","author":"MS Matell","year":"2006","journal-title":"Psychopharmacology"},{"issue":"2","key":"pcbi.1008659.ref117","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1037\/0033-295X.95.2.274","article-title":"A behavioral theory of timing","volume":"95","author":"PR Killeen","year":"1988","journal-title":"Psychological review"},{"issue":"1","key":"pcbi.1008659.ref118","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/0023-9690(91)90024-3","article-title":"Adjusting the pacemaker","volume":"22","author":"JG Fetterman","year":"1991","journal-title":"Learning and Motivation"},{"issue":"2","key":"pcbi.1008659.ref119","doi-asserted-by":"crossref","first-page":"164","DOI":"10.3758\/BF03197872","article-title":"The effects of rate and amount of reinforcement on the speed of the pacemaker in pigeons\u2019 timing behavior","volume":"19","author":"D MacEwen","year":"1991","journal-title":"Learning & behavior"},{"issue":"3","key":"pcbi.1008659.ref120","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0376-6357(93)90138-H","article-title":"Changing rates of reinforcement perturbs the flow of time","volume":"30","author":"L Morgan","year":"1993","journal-title":"Behavioural Processes"},{"issue":"1","key":"pcbi.1008659.ref121","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/S0376-6357(99)00014-5","article-title":"A clock not wound runs down","volume":"45","author":"PR Killeen","year":"1999","journal-title":"Behavioural Processes"},{"issue":"2","key":"pcbi.1008659.ref122","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.lmot.2008.05.004","article-title":"Reward value effects on timing in the peak procedure","volume":"40","author":"T Galtress","year":"2009","journal-title":"Learning and Motivation"},{"key":"pcbi.1008659.ref123","first-page":"121","article-title":"Internal clock and reward pathways share physiologically similar information-processing stages","volume":"7","author":"WH Meck","year":"2014","journal-title":"Quantitative analyses of behavior: Biological determinants of reinforcement"},{"issue":"4","key":"pcbi.1008659.ref124","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1037\/0735-7044.101.4.465","article-title":"Nutrients that modify the speed of internal clock and memory storage processes","volume":"101","author":"WH Meck","year":"1987","journal-title":"Behavioral Neuroscience"},{"issue":"3","key":"pcbi.1008659.ref125","first-page":"242","article-title":"Isolation of an internal clock","volume":"7","author":"S Roberts","year":"1981","journal-title":"Journal of Experimental Psychology: Animal Behavior Processes"},{"issue":"9","key":"pcbi.1008659.ref126","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1016\/j.cub.2015.02.036","article-title":"A scalable population code for time in the striatum","volume":"25","author":"GB Mello","year":"2015","journal-title":"Current Biology"},{"issue":"1","key":"pcbi.1008659.ref127","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1038\/s41593-017-0028-6","article-title":"Flexible timing by temporal scaling of cortical responses","volume":"21","author":"J Wang","year":"2018","journal-title":"Nature neuroscience"},{"issue":"3","key":"pcbi.1008659.ref128","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1037\/0033-295X.84.3.279","article-title":"Scalar expectancy theory and Weber\u2019s law in animal timing","volume":"84","author":"J Gibbon","year":"1977","journal-title":"Psychological review"},{"key":"pcbi.1008659.ref129","first-page":"3","article-title":"A concise introduction to scalar timing theory","author":"RM Church","year":"2003","journal-title":"Functional and neural mechanisms of interval timing"},{"issue":"1","key":"pcbi.1008659.ref130","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1901\/jeab.1965.8-19","article-title":"Some properties of spaced responding in pigeons","volume":"8","author":"J Staddon","year":"1965","journal-title":"Journal of the Experimental Analysis of Behavior"},{"issue":"1","key":"pcbi.1008659.ref131","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1037\/rev0000081","article-title":"Neural scaling laws for an uncertain world","volume":"125","author":"MW Howard","year":"2018","journal-title":"Psychological review"},{"key":"pcbi.1008659.ref132","first-page":"1","article-title":"The mechanistic foundation of Weber\u2019s law","author":"JL Pardo-Vazquez","year":"2019","journal-title":"Nature neuroscience"},{"issue":"1","key":"pcbi.1008659.ref133","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1901\/jeab.1994.61-19","article-title":"The behavioral theory of timing: Reinforcer rate determines pacemaker rate","volume":"61","author":"LA Bizo","year":"1994","journal-title":"Journal of the Experimental Analysis of Behavior"},{"issue":"4","key":"pcbi.1008659.ref134","doi-asserted-by":"crossref","first-page":"376","DOI":"10.3758\/BF03198937","article-title":"Reinforcement context and pacemaker rate in the behavioral theory of timing","volume":"23","author":"LA Bizo","year":"1995","journal-title":"Learning & behavior"},{"issue":"5","key":"pcbi.1008659.ref135","doi-asserted-by":"crossref","first-page":"3333","DOI":"10.1523\/JNEUROSCI.14-05-03333.1994","article-title":"Opposite responses of mesolimbic dopamine system to controllable and uncontrollable aversive experiences","volume":"14","author":"S Cabib","year":"1994","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1008659.ref136","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.neubiorev.2011.04.012","article-title":"The mesoaccumbens dopamine in coping with stress","volume":"36","author":"S Cabib","year":"2012","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"pcbi.1008659.ref137","doi-asserted-by":"crossref","unstructured":"Kacelnik A. Normative and descriptive models of decision making: time discounting and risk sensitivity. In: CIBA foundation symposium. Wiley Online Library; 1997. p. 51\u201370.","DOI":"10.1002\/9780470515372.ch5"},{"key":"pcbi.1008659.ref138","first-page":"679","article-title":"Behavioral considerations suggest an average reward TD model of the dopamine system","volume":"32","author":"ND Daw","year":"2000","journal-title":"Neurocomputing"},{"issue":"38","key":"pcbi.1008659.ref139","doi-asserted-by":"crossref","first-page":"15491","DOI":"10.1073\/pnas.1310446110","article-title":"Postreward delays and systematic biases in measures of animal temporal discounting","volume":"110","author":"TC Blanchard","year":"2013","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"4","key":"pcbi.1008659.ref140","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1037\/h0076860","article-title":"Specious reward: a behavioral theory of impulsiveness and impulse control","volume":"82","author":"G Ainslie","year":"1975","journal-title":"Psychological bulletin"},{"key":"pcbi.1008659.ref141","article-title":"Adapting the Flow of Time with Dopamine","author":"JG Mikhael","year":"2019","journal-title":"Journal of neurophysiology"},{"issue":"13","key":"pcbi.1008659.ref142","doi-asserted-by":"crossref","first-page":"1707","DOI":"10.1016\/j.cub.2015.05.038","article-title":"Reward pays the cost of noise reduction in motor and cognitive control","volume":"25","author":"SG Manohar","year":"2015","journal-title":"Current Biology"},{"key":"pcbi.1008659.ref143","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.neuropsychologia.2018.07.011","article-title":"Motivation dynamically increases noise resistance by internal feedback during movement","volume":"123","author":"SG Manohar","year":"2019","journal-title":"Neuropsychologia"},{"key":"pcbi.1008659.ref144","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.neuropsychologia.2018.05.006","article-title":"The opportunity cost of time modulates cognitive effort","volume":"123","author":"AR Otto","year":"2019","journal-title":"Neuropsychologia"},{"issue":"21","key":"pcbi.1008659.ref145","doi-asserted-by":"crossref","first-page":"8528","DOI":"10.1523\/JNEUROSCI.17-21-08528.1997","article-title":"Supranormal stimulation of D1 dopamine receptors in the rodent prefrontal cortex impairs spatial working memory performance","volume":"17","author":"J Zahrt","year":"1997","journal-title":"Journal of neuroscience"},{"issue":"3","key":"pcbi.1008659.ref146","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1038\/nn1846","article-title":"Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory","volume":"10","author":"S Vijayraghavan","year":"2007","journal-title":"Nature neuroscience"},{"issue":"12","key":"pcbi.1008659.ref147","doi-asserted-by":"crossref","first-page":"e113","DOI":"10.1016\/j.biopsych.2011.03.028","article-title":"Inverted-U\u2013shaped dopamine actions on human working memory and cognitive control","volume":"69","author":"R Cools","year":"2011","journal-title":"Biological psychiatry"},{"issue":"1","key":"pcbi.1008659.ref148","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1163\/22134468-00002005","article-title":"Dopaminergic modulation of motor timing in healthy volunteers differs as a function of baseline DA precursor availability","volume":"1","author":"JT Coull","year":"2013","journal-title":"Timing & Time Perception"},{"key":"pcbi.1008659.ref149","article-title":"The role of dopamine in the brain-lessons learned from Parkinson\u2019s disease","author":"D Meder","year":"2018","journal-title":"NeuroImage"},{"issue":"8","key":"pcbi.1008659.ref150","doi-asserted-by":"crossref","first-page":"e6507","DOI":"10.1371\/journal.pone.0006507","article-title":"Dopamine modulates persistent synaptic activity and enhances the signal-to-noise ratio in the prefrontal cortex","volume":"4","author":"S Kroener","year":"2009","journal-title":"PloS one"},{"key":"pcbi.1008659.ref151","doi-asserted-by":"crossref","first-page":"11829","DOI":"10.1038\/ncomms11829","article-title":"Activation of D2 dopamine receptor-expressing neurons in the nucleus accumbens increases motivation","volume":"7","author":"C Soares-Cunha","year":"2016","journal-title":"Nature communications"},{"key":"pcbi.1008659.ref152","article-title":"Dynamic dopaminergic activity controls the timing of self-timed movement","author":"AE Hamilos","year":"2020","journal-title":"bioRxiv"},{"key":"pcbi.1008659.ref153","article-title":"Application of a unifying reward-prediction error (RPE)-based framework to explain underlying dynamic dopaminergic activity in timing tasks","author":"AE Hamilos","year":"2020","journal-title":"bioRxiv"},{"issue":"7464","key":"pcbi.1008659.ref154","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1038\/nature12475","article-title":"Prolonged dopamine signalling in striatum signals proximity and value of distant rewards","volume":"500","author":"MW Howe","year":"2013","journal-title":"Nature"},{"issue":"31","key":"pcbi.1008659.ref155","doi-asserted-by":"crossref","first-page":"7837","DOI":"10.1523\/JNEUROSCI.1600-08.2008","article-title":"Influence of reward delays on responses of dopamine neurons","volume":"28","author":"S Kobayashi","year":"2008","journal-title":"Journal of neuroscience"},{"issue":"5896","key":"pcbi.1008659.ref156","doi-asserted-by":"crossref","first-page":"1690","DOI":"10.1126\/science.1160873","article-title":"Reward-predictive cues enhance excitatory synaptic strength onto midbrain dopamine neurons","volume":"321","author":"GD Stuber","year":"2008","journal-title":"Science"},{"issue":"7328","key":"pcbi.1008659.ref157","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1038\/nature09588","article-title":"A selective role for dopamine in stimulus\u2013reward learning","volume":"469","author":"SB Flagel","year":"2011","journal-title":"Nature"},{"issue":"12","key":"pcbi.1008659.ref158","doi-asserted-by":"crossref","first-page":"e1004622","DOI":"10.1371\/journal.pcbi.1004622","article-title":"Tamping ramping: Algorithmic, implementational, and computational explanations of phasic dopamine signals in the accumbens","volume":"11","author":"K Lloyd","year":"2015","journal-title":"PLoS computational biology"},{"issue":"3","key":"pcbi.1008659.ref159","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1162\/NECO_a_00559","article-title":"Dopamine ramps are a consequence of reward prediction errors","volume":"26","author":"SJ Gershman","year":"2014","journal-title":"Neural computation"},{"key":"pcbi.1008659.ref160","article-title":"A unified framework for dopamine signals across timescales","author":"HR Kim","year":"2020","journal-title":"Cell"},{"key":"pcbi.1008659.ref161","article-title":"Ramping and State Uncertainty in the Dopamine Signal","author":"JG Mikhael","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1008659.ref162","article-title":"Dopamine waves as a mechanism for spatiotemporal credit assignment","author":"AA Hamid","year":"2019","journal-title":"bioRxiv"},{"issue":"4409","key":"pcbi.1008659.ref163","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1126\/science.112679","article-title":"Cognitive deficit caused by regional depletion of dopamine in prefrontal cortex of rhesus monkey","volume":"205","author":"TJ Brozoski","year":"1979","journal-title":"Science"},{"issue":"7","key":"pcbi.1008659.ref164","doi-asserted-by":"crossref","first-page":"1907","DOI":"10.1523\/JNEUROSCI.11-07-01907.1991","article-title":"The effect of amphetamine on regional cerebral blood flow during cognitive activation in schizophrenia","volume":"11","author":"D Daniel","year":"1991","journal-title":"Journal of Neuroscience"},{"issue":"2-3","key":"pcbi.1008659.ref165","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1007\/BF02245167","article-title":"L-dopa withdrawal in Parkinson\u2019s disease selectively impairs cognitive performance in tests sensitive to frontal lobe dysfunction","volume":"107","author":"KW Lange","year":"1992","journal-title":"Psychopharmacology"},{"issue":"6541","key":"pcbi.1008659.ref166","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1038\/376572a0","article-title":"Modulation of memory fields by dopamine Dl receptors in prefrontal cortex","volume":"376","author":"GV Williams","year":"1995","journal-title":"Nature"},{"key":"pcbi.1008659.ref167","article-title":"Representation of spontaneous movement by dopaminergic neurons is cell-type selective and disrupted in parkinsonism","author":"PD Dodson","year":"2016","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"7613","key":"pcbi.1008659.ref168","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1038\/nature18942","article-title":"Rapid signalling in distinct dopaminergic axons during locomotion and reward","volume":"535","author":"MW Howe","year":"2016","journal-title":"Nature"},{"issue":"4","key":"pcbi.1008659.ref169","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1007\/s002130050410","article-title":"Central 5-HT depletion enhances impulsive responding without affecting the accuracy of attentional performance: interactions with dopaminergic mechanisms","volume":"133","author":"AA Harrison","year":"1997","journal-title":"Psychopharmacology"},{"issue":"1","key":"pcbi.1008659.ref170","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1093\/cercor\/bhi088","article-title":"Double dissociation between serotonergic and dopaminergic modulation of medial prefrontal and orbitofrontal cortex during a test of impulsive choice","volume":"16","author":"CA Winstanley","year":"2006","journal-title":"Cerebral Cortex"},{"issue":"4","key":"pcbi.1008659.ref171","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1038\/sj.npp.1300610","article-title":"Interactions between serotonin and dopamine in the control of impulsive choice in rats: therapeutic implications for impulse control disorders","volume":"30","author":"CA Winstanley","year":"2005","journal-title":"Neuropsychopharmacology"},{"issue":"26","key":"pcbi.1008659.ref172","doi-asserted-by":"crossref","first-page":"8888","DOI":"10.1523\/JNEUROSCI.6028-09.2010","article-title":"Dopamine, time, and impulsivity in humans","volume":"30","author":"A Pine","year":"2010","journal-title":"Journal of Neuroscience"},{"issue":"27","key":"pcbi.1008659.ref173","doi-asserted-by":"crossref","first-page":"9402","DOI":"10.1523\/JNEUROSCI.1180-12.2012","article-title":"Dopamine, corticostriatal connectivity, and intertemporal choice","volume":"32","author":"AS Kayser","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1008659.ref174","article-title":"Dopaminergic modulation of reward discounting: a systematic review and meta-analysis","author":"JJ Castrellon","year":"2020","journal-title":"bioRxiv"},{"key":"pcbi.1008659.ref175","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.neubiorev.2017.04.007","article-title":"Creative cognition and dopaminergic modulation of fronto-striatal networks: Integrative review and research agenda","volume":"78","author":"N Boot","year":"2017","journal-title":"Neuroscience & Biobehavioral Reviews"},{"issue":"6","key":"pcbi.1008659.ref176","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1002\/ana.24181","article-title":"Enhanced creative thinking under dopaminergic therapy in Parkinson disease","volume":"75","author":"A Faust-Socher","year":"2014","journal-title":"Annals of neurology"},{"issue":"14","key":"pcbi.1008659.ref177","doi-asserted-by":"crossref","first-page":"R509","DOI":"10.1016\/S0960-9822(00)00593-5","article-title":"The basal ganglia","volume":"10","author":"AM Graybiel","year":"2000","journal-title":"Current Biology"},{"key":"pcbi.1008659.ref178","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1016\/0166-2236(89)90074-X","article-title":"The functional anatomy of basal ganglia disorders","volume":"12","author":"RL Albin","year":"1989","journal-title":"Trends in Neurosciences"},{"key":"pcbi.1008659.ref179","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/0166-2236(90)90110-V","article-title":"Primate models of movement disorders of basal ganglia origin","volume":"13","author":"MR DeLong","year":"1990","journal-title":"Trends in Neurosciences"},{"issue":"5890","key":"pcbi.1008659.ref180","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1126\/science.1160575","article-title":"Dichotomous dopaminergic control of striatal synaptic plasticity","volume":"321","author":"W Shen","year":"2008","journal-title":"Science"},{"issue":"42","key":"pcbi.1008659.ref181","doi-asserted-by":"crossref","first-page":"14273","DOI":"10.1523\/JNEUROSCI.1894-10.2010","article-title":"Influence of phasic and tonic dopamine release on receptor activation","volume":"30","author":"JK Dreyer","year":"2010","journal-title":"The Journal of Neuroscience"},{"issue":"1","key":"pcbi.1008659.ref182","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1162\/0898929052880093","article-title":"Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism","volume":"17","author":"M Frank","year":"2005","journal-title":"Cognitive Neuroscience, Journal of"},{"issue":"29","key":"pcbi.1008659.ref183","doi-asserted-by":"crossref","first-page":"7731","DOI":"10.1523\/JNEUROSCI.1736-07.2007","article-title":"Transient overexpression of striatal D2 receptors impairs operant motivation and interval timing","volume":"27","author":"MR Drew","year":"2007","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1008659.ref184","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1038\/npp.2010.113","article-title":"Neuroanatomical and neurochemical substrates of timing","volume":"36","author":"JT Coull","year":"2011","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1008659.ref185","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.bbr.2018.08.030","article-title":"Striatal dopamine and the temporal control of behavior","volume":"356","author":"BJ De Corte","year":"2019","journal-title":"Behavioural brain research"},{"key":"pcbi.1008659.ref186","unstructured":"Marr D. Vision: A computational investigation into the human representation and processing of visual information, henry holt and co. Inc, New York, NY. 1982;2(4.2)."},{"key":"pcbi.1008659.ref187","unstructured":"Bjorklund A, Lindvall O. Dopamine-containing systems in the CNS; 1984."},{"issue":"1","key":"pcbi.1008659.ref188","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1152\/physrev.1991.71.1.155","article-title":"Mesocorticolimbic dopaminergic network: functional and regulatory roles","volume":"71","author":"M Le Moal","year":"1991","journal-title":"Physiological reviews"},{"issue":"2","key":"pcbi.1008659.ref189","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.neuropsychologia.2012.08.002","article-title":"Epistasis effects of dopamine genes on interval timing and reward magnitude in humans","volume":"51","author":"F Balc\u0131","year":"2013","journal-title":"Neuropsychologia"},{"key":"pcbi.1008659.ref190","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.neuropsychologia.2018.10.009","article-title":"Dopaminergic genes are associated with both directed and random exploration","volume":"120","author":"SJ Gershman","year":"2018","journal-title":"Neuropsychologia"},{"issue":"7","key":"pcbi.1008659.ref191","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1037\/bul0000046","article-title":"What limits working memory capacity?","volume":"142","author":"K Oberauer","year":"2016","journal-title":"Psychological bulletin"},{"issue":"1766","key":"pcbi.1008659.ref192","doi-asserted-by":"crossref","first-page":"20180138","DOI":"10.1098\/rstb.2018.0138","article-title":"Uncertainty and computational complexity","volume":"374","author":"P Bossaerts","year":"2019","journal-title":"Philosophical Transactions of the Royal Society B"},{"key":"pcbi.1008659.ref193","article-title":"Parallel processing capability versus efficiency of representation in neural networks","author":"S Musslick","year":"2016","journal-title":"Network"},{"issue":"4","key":"pcbi.1008659.ref194","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1177\/1088868307303030","article-title":"The physiology of willpower: Linking blood glucose to self-control","volume":"11","author":"MT Gailliot","year":"2007","journal-title":"Personality and social psychology review"},{"key":"pcbi.1008659.ref195","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1146\/annurev-neuro-072116-031526","article-title":"Toward a rational and mechanistic account of mental effort","volume":"40","author":"A Shenhav","year":"2017","journal-title":"Annual review of neuroscience"},{"issue":"9","key":"pcbi.1008659.ref196","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1038\/nn1954","article-title":"Learning the value of information in an uncertain world","volume":"10","author":"TE Behrens","year":"2007","journal-title":"Nature neuroscience"},{"issue":"4","key":"pcbi.1008659.ref197","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.neuron.2005.04.026","article-title":"Uncertainty, neuromodulation, and attention","volume":"46","author":"AJ Yu","year":"2005","journal-title":"Neuron"},{"issue":"4","key":"pcbi.1008659.ref198","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1038\/nn.4520","article-title":"Dopamine reward prediction errors reflect hidden-state inference across time","volume":"20","author":"CK Starkweather","year":"2017","journal-title":"Nature Neuroscience"},{"key":"pcbi.1008659.ref199","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1016\/j.neuron.2018.03.036","article-title":"The Medial Prefrontal Cortex Shapes Dopamine Reward Prediction Errors under State Uncertainty","volume":"98","author":"CK Starkweather","year":"2018","journal-title":"Neuron"},{"issue":"5614","key":"pcbi.1008659.ref200","doi-asserted-by":"crossref","first-page":"1898","DOI":"10.1126\/science.1077349","article-title":"Discrete coding of reward probability and uncertainty by dopamine neurons","volume":"299","author":"CD Fiorillo","year":"2003","journal-title":"Science"},{"key":"pcbi.1008659.ref201","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.nlm.2014.07.010","article-title":"Dynamic shaping of dopamine signals during probabilistic Pavlovian conditioning","volume":"117","author":"AS Hart","year":"2015","journal-title":"Neurobiology of Learning and Memory"},{"key":"pcbi.1008659.ref202","doi-asserted-by":"crossref","first-page":"9","DOI":"10.3389\/fnins.2012.00009","article-title":"Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia","volume":"6","author":"MD Humphries","year":"2012","journal-title":"Frontiers in neuroscience"},{"issue":"6","key":"pcbi.1008659.ref203","doi-asserted-by":"crossref","first-page":"2074","DOI":"10.1037\/a0038199","article-title":"Humans use directed and random exploration to solve the explore\u2013exploit dilemma","volume":"143","author":"RC Wilson","year":"2014","journal-title":"Journal of Experimental Psychology: General"},{"key":"pcbi.1008659.ref204","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.cognition.2017.12.014","article-title":"Deconstructing the human algorithms for exploration","volume":"173","author":"SJ Gershman","year":"2018","journal-title":"Cognition"},{"issue":"3","key":"pcbi.1008659.ref205","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1901\/jeab.1995.64-263","article-title":"Discounting of delayed rewards: Models of individual choice","volume":"64","author":"J Myerson","year":"1995","journal-title":"Journal of the experimental analysis of behavior"},{"issue":"4","key":"pcbi.1008659.ref206","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1093\/icb\/36.4.402","article-title":"Risky theories\u2014the effects of variance on foraging decisions","volume":"36","author":"A Kacelnik","year":"1996","journal-title":"American Zoologist"},{"issue":"1","key":"pcbi.1008659.ref207","doi-asserted-by":"crossref","first-page":"23","DOI":"10.2307\/1909829","article-title":"Exposition of a new theory on the measurement of risk","volume":"22","author":"D Bernoulli","year":"1954","journal-title":"Econometrica"},{"key":"pcbi.1008659.ref208","doi-asserted-by":"crossref","first-page":"263","DOI":"10.2307\/1914185","article-title":"Prospect theory: An analysis of decision under risk","author":"D Kahneman","year":"1979","journal-title":"Econometrica: Journal of the Econometric Society"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008659","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T05:10:48Z","timestamp":1671685848000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008659"}},"subtitle":[],"editor":[{"given":"Jean","family":"Daunizeau","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,3,24]]},"references-count":208,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,3,24]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1008659","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.10.04.325175","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,24]]}}}