{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T07:51:08Z","timestamp":1770969068930,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1008555","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T00:00:00Z","timestamp":1611187200000}}],"reference-count":82,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T00:00:00Z","timestamp":1610064000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000268","name":"Biotechnology and Biological Sciences Research Council","doi-asserted-by":"publisher","award":["BB\/M009122\/1"],"award-info":[{"award-number":["BB\/M009122\/1"]}],"id":[{"id":"10.13039\/501100000268","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004189","name":"Max-Planck-Gesellschaft","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004189","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005156","name":"Alexander von Humboldt-Stiftung","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100005156","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Links between affective states and risk-taking are often characterised using summary statistics from serial decision-making tasks. However, our understanding of these links, and the utility of decision-making as a marker of affect, needs to accommodate the fact that ongoing (e.g., within-task) experience of rewarding and punishing decision outcomes may alter future decisions and affective states. To date, the interplay between affect, ongoing reward and punisher experience, and decision-making has received little detailed investigation. Here, we examined the relationships between reward and loss experience, affect, and decision-making in humans using a novel judgement bias task analysed with a novel computational model. We demonstrated the influence of within-task favourability on decision-making, with more risk-averse\/\u2018pessimistic\u2019 decisions following more positive previous outcomes and a greater current average earning rate. Additionally, individuals reporting more negative affect tended to exhibit greater risk-seeking decision-making, and, based on our model, estimated time more poorly. We also found that individuals reported more positive affective valence during periods of the task when prediction errors and offered decision outcomes were more positive. Our results thus provide new evidence that (short-term) within-task rewarding and punishing experiences determine both future decision-making and subjectively experienced affective states.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1008555","type":"journal-article","created":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T20:57:51Z","timestamp":1610139471000},"page":"e1008555","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":16,"title":["Dissecting the links between reward and loss, decision-making, and self-reported affect using a computational approach"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2961-1353","authenticated-orcid":true,"given":"Vikki","family":"Neville","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3476-1839","authenticated-orcid":true,"given":"Peter","family":"Dayan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2070-6679","authenticated-orcid":true,"given":"Iain D.","family":"Gilchrist","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5884-5709","authenticated-orcid":true,"given":"Elizabeth S.","family":"Paul","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5302-1871","authenticated-orcid":true,"given":"Michael","family":"Mendl","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2021,1,8]]},"reference":[{"key":"pcbi.1008555.ref001","volume-title":"Signal detection theory and psychophysics","author":"DM Green","year":"1966"},{"key":"pcbi.1008555.ref002","doi-asserted-by":"crossref","DOI":"10.1109\/TNN.1998.712192","volume-title":"Introduction to reinforcement learning","author":"RS Sutton","year":"1998"},{"issue":"3","key":"pcbi.1008555.ref003","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/S1364-6613(00)01856-8","article-title":"Perceptual adaptation: motion parallels orientation","volume":"6","author":"CW Clifford","year":"2002","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1008555.ref004","first-page":"1046","article-title":"Statistical learning and adaptive decision-making underlie human response time variability in inhibitory control","volume":"6","author":"N Ma","year":"2015","journal-title":"Front Psychol"},{"issue":"5304","key":"pcbi.1008555.ref005","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1126\/science.275.5304.1293","article-title":"Deciding advantageously before knowing the advantageous strategy","volume":"275","author":"A Bechara","year":"1997","journal-title":"Science"},{"issue":"1-2","key":"pcbi.1008555.ref006","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.jad.2009.11.013","article-title":"Impaired flexible decision-making in major depressive disorder","volume":"124","author":"M Cella","year":"2010","journal-title":"J Affect Disord"},{"issue":"1","key":"pcbi.1008555.ref007","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.adolescence.2011.06.009","article-title":"Selective neurocognitive impairments in adolescents with major depressive disorder","volume":"35","author":"G Han","year":"2012","journal-title":"J Adolesc"},{"issue":"7","key":"pcbi.1008555.ref008","doi-asserted-by":"crossref","first-page":"e6002","DOI":"10.1371\/journal.pone.0006002","article-title":"Acute stress increases sex differences in risk seeking in the balloon analogue risk task","volume":"4","author":"NR Lighthall","year":"2009","journal-title":"PLOS One"},{"key":"pcbi.1008555.ref009","doi-asserted-by":"crossref","first-page":"670","DOI":"10.3389\/fpsyg.2017.00670","article-title":"Clinical depression and punishment sensitivity on the BART","volume":"8","author":"D Hevey","year":"2017","journal-title":"Front Psychol"},{"issue":"2","key":"pcbi.1008555.ref010","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1037\/1076-898X.8.2.75","article-title":"Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART)","volume":"8","author":"CW Lejuez","year":"2002","journal-title":"J Exp Psychol Appl"},{"issue":"10","key":"pcbi.1008555.ref011","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1016\/j.biopsych.2006.03.037","article-title":"Acute stress reduces reward responsiveness: implications for depression","volume":"60","author":"R Bogdan","year":"2006","journal-title":"Biol Psychiatry"},{"issue":"1","key":"pcbi.1008555.ref012","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.jpsychires.2008.03.001","article-title":"Reduced hedonic capacity in major depressive disorder: evidence from a probabilistic reward task","volume":"43","author":"DA Pizzagalli","year":"2008","journal-title":"J Psychiatr Res"},{"issue":"6972","key":"pcbi.1008555.ref013","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1038\/427312a","article-title":"Animal behaviour: cognitive bias and affective state","volume":"427","author":"EJ Harding","year":"2004","journal-title":"Nature"},{"key":"pcbi.1008555.ref014","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.neubiorev.2019.11.008","article-title":"Pharmacological manipulations of judgement bias: a systematic review and meta-analysis","volume":"108","author":"V Neville","year":"2020","journal-title":"Neurosci Biobehav Rev"},{"key":"pcbi.1008555.ref015","article-title":"Optimism, pessimism and judgement bias in animals: a systematic review and meta-analysis","author":"M Lagisz","year":"2020","journal-title":"Neurosci Biobehav Rev"},{"key":"pcbi.1008555.ref016","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780198570035.001.0001","volume-title":"Emotion explained","author":"ET Rolls","year":"2005"},{"key":"pcbi.1008555.ref017","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.neubiorev.2020.01.025","article-title":"Animal affect and decision-making","volume":"112","author":"M Mendl","year":"2020","journal-title":"Neurosci Biobehav Rev"},{"key":"pcbi.1008555.ref018","volume-title":"The psychology of fear and stress","author":"JA Gray","year":"1987"},{"issue":"4","key":"pcbi.1008555.ref019","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1038\/nrn2119","article-title":"The neurobiology of punishment","volume":"8","author":"B Seymour","year":"2007","journal-title":"Nat Rev Neurosci"},{"issue":"4","key":"pcbi.1008555.ref020","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1038\/nrn2333","article-title":"A common neurobiology for pain and pleasure","volume":"9","author":"S Leknes","year":"2008","journal-title":"Nat Rev Neurosci"},{"issue":"33","key":"pcbi.1008555.ref021","doi-asserted-by":"crossref","first-page":"12252","DOI":"10.1073\/pnas.1407535111","article-title":"A computational and neural model of momentary subjective well-being","volume":"111","author":"RB Rutledge","year":"2014","journal-title":"Proc Natl Acad Sci USA"},{"issue":"1","key":"pcbi.1008555.ref022","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.tics.2015.07.010","article-title":"Mood as representation of momentum","volume":"20","author":"E Eldar","year":"2016","journal-title":"Trends Cogn Sci"},{"issue":"14","key":"pcbi.1008555.ref023","doi-asserted-by":"crossref","first-page":"2277","DOI":"10.1017\/S0033291718000430","article-title":"What is mood? A computational perspective","volume":"48","author":"JE Clark","year":"2018","journal-title":"Psychol Med"},{"issue":"1","key":"pcbi.1008555.ref024","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.evolhumbehav.2010.07.005","article-title":"Mood and the speed of decisions about anticipated resources and hazards","volume":"32","author":"ES Paul","year":"2011","journal-title":"Evol Hum Behav"},{"issue":"1696","key":"pcbi.1008555.ref025","doi-asserted-by":"crossref","first-page":"2895","DOI":"10.1098\/rspb.2010.0303","article-title":"An integrative and functional framework for the study of animal emotion and mood","volume":"277","author":"M Mendl","year":"2010","journal-title":"Proc R Soc B"},{"issue":"4","key":"pcbi.1008555.ref026","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1007\/s10071-011-0387-4","article-title":"Decision-making under uncertainty: biases and Bayesians","volume":"14","author":"PC Trimmer","year":"2011","journal-title":"Anim Cogn"},{"issue":"3-4","key":"pcbi.1008555.ref027","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.applanim.2009.02.023","article-title":"Cognitive bias as an indicator of animal emotion and welfare: Emerging evidence and underlying mechanisms","volume":"118","author":"M Mendl","year":"2009","journal-title":"Appl Anim Behav Sci"},{"key":"pcbi.1008555.ref028","first-page":"1","article-title":"An evolutionary model of low mood states","author":"D Nettle","year":"2008","journal-title":"J Theor Biol"},{"key":"pcbi.1008555.ref029","doi-asserted-by":"crossref","DOI":"10.1176\/appi.books.9780890425596","volume-title":"Diagnostic and statistical manual of mental disorders: DSM-5","author":"American Psychiatric Association","year":"2013"},{"issue":"1","key":"pcbi.1008555.ref030","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/2045-5380-3-12","article-title":"Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis","volume":"3","author":"QJ Huys","year":"2013","journal-title":"Biol Mood Anxiety Disord"},{"issue":"4","key":"pcbi.1008555.ref031","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","article-title":"The diffusion decision model: theory and data for two-choice decision tasks","volume":"20","author":"R Ratcliff","year":"2008","journal-title":"Neural Comput"},{"key":"pcbi.1008555.ref032","article-title":"The neural basis of decision making","volume":"30","author":"JI Gold","year":"2007","journal-title":"Annu Rev Neurosci"},{"issue":"8","key":"pcbi.1008555.ref033","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.3758\/BF03194544","article-title":"The psychometric function: I. Fitting, sampling, and goodness of fit","volume":"63","author":"FA Wichmann","year":"2001","journal-title":"Atten Percept Psychophys"},{"issue":"3","key":"pcbi.1008555.ref034","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1177\/0956797615618366","article-title":"Unexpected but incidental positive outcomes predict real-world gambling","volume":"27","author":"AR Otto","year":"2016","journal-title":"Psychol Sci"},{"issue":"2","key":"pcbi.1008555.ref035","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/S2215-0366(14)70275-5","article-title":"Computational psychiatry: the brain as a phantastic organ","volume":"1","author":"KJ Friston","year":"2014","journal-title":"Lancet Psychiatry"},{"issue":"8","key":"pcbi.1008555.ref036","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1038\/npp.2013.48","article-title":"Dopamine modulates reward-related vigor","volume":"38","author":"U Beierholm","year":"2013","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1008555.ref037","doi-asserted-by":"crossref","first-page":"42287","DOI":"10.1038\/srep42287","article-title":"Opposing effects of reward and punishment on human vigor","volume":"7","author":"B Griffiths","year":"2017","journal-title":"Sci Rep"},{"issue":"12","key":"pcbi.1008555.ref038","doi-asserted-by":"crossref","first-page":"3933","DOI":"10.1162\/jocn_a_00090","article-title":"Vigor in the face of fluctuating rates of reward: an experimental examination","volume":"23","author":"M Guitart-Masip","year":"2011","journal-title":"J Cogn Neurosci"},{"issue":"2","key":"pcbi.1008555.ref039","doi-asserted-by":"crossref","first-page":"639","DOI":"10.2466\/pr0.1998.83.2.639","article-title":"The affect grid: a moderately valid, nonspecific measure of pleasure and arousal","volume":"83","author":"WDS Killgore","year":"1998","journal-title":"Psychol Rep"},{"issue":"3","key":"pcbi.1008555.ref040","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1037\/0022-3514.57.3.493","article-title":"Affect grid: a single-item scale of pleasure and arousal","volume":"57","author":"JA Russell","year":"1989","journal-title":"J Pers Soc Psychol"},{"issue":"2","key":"pcbi.1008555.ref041","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1037\/h0030219","article-title":"Chronic fear and ulcers in rats as a function of the unpredictability of safety","volume":"73","author":"ME Seligman","year":"1970","journal-title":"J Comp Physiol Psychol"},{"issue":"3-4","key":"pcbi.1008555.ref042","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.applanim.2006.05.029","article-title":"Effects of predictability on the welfare of captive animals","volume":"102","author":"L Bassett","year":"2007","journal-title":"Appl Anim Behav Sci"},{"issue":"5","key":"pcbi.1008555.ref043","doi-asserted-by":"crossref","first-page":"e1003605","DOI":"10.1371\/journal.pcbi.1003605","article-title":"Optimism as a prior belief about the probability of future reward","volume":"10","author":"A Stankevicius","year":"2014","journal-title":"PLOS Computat Biol"},{"issue":"11","key":"pcbi.1008555.ref044","doi-asserted-by":"crossref","first-page":"e0165840","DOI":"10.1371\/journal.pone.0165840","article-title":"Cognitive bias in ambiguity judgements: using computational models to dissect the effects of mild mood manipulation in humans","volume":"11","author":"K Iigaya","year":"2016","journal-title":"PlOS One"},{"issue":"1","key":"pcbi.1008555.ref045","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1037\/0033-2909.110.1.67","article-title":"Asymmetrical effects of positive and negative events: the mobilization-minimization hypothesis","volume":"110","author":"SE Taylor","year":"1991","journal-title":"Psychol Bull"},{"issue":"8","key":"pcbi.1008555.ref046","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1111\/j.1467-9280.2006.01760.x","article-title":"Loss aversion is an affective forecasting error","volume":"17","author":"DA Kermer","year":"2006","journal-title":"Psychol Sci"},{"issue":"2","key":"pcbi.1008555.ref047","doi-asserted-by":"crossref","first-page":"263","DOI":"10.2307\/1914185","article-title":"Prospect Theory: An Analysis of Decision under Risk","volume":"47","author":"D Kahneman","year":"1979","journal-title":"Econometrica"},{"issue":"2","key":"pcbi.1008555.ref048","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the dimension of a model","volume":"6","author":"G Schwarz","year":"1978","journal-title":"Ann Stat"},{"key":"pcbi.1008555.ref049","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"H Akaike","year":"1974","journal-title":"IEEE T Automat Contr"},{"issue":"1","key":"pcbi.1008555.ref050","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-020-68737-1","article-title":"Reward and punisher experience alter rodent decision-making in a judgement bias task","volume":"10","author":"V Neville","year":"2020","journal-title":"Sci Rep"},{"issue":"4","key":"pcbi.1008555.ref051","doi-asserted-by":"crossref","first-page":"857","DOI":"10.1016\/j.anbehav.2008.12.010","article-title":"Successive negative contrast in a bird: starlings\u2019 behaviour after unpredictable negative changes in food quality","volume":"77","author":"E Freidin","year":"2009","journal-title":"Anim Behav"},{"issue":"2","key":"pcbi.1008555.ref052","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1037\/0097-7403.25.2.153","article-title":"Incentive downshifts evoke search repertoires in rats","volume":"25","author":"NC Pecoraro","year":"1999","journal-title":"J Exp Psychol Anim Behav Process"},{"issue":"2","key":"pcbi.1008555.ref053","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/0030-5073(83)90120-4","article-title":"The effect of positive feelings on risk taking: When the chips are down","volume":"31","author":"AM Isen","year":"1983","journal-title":"Organ Beha Hum Perform"},{"issue":"1","key":"pcbi.1008555.ref054","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1006\/obhd.1996.0038","article-title":"The influence of positive affect on the decision rule in risk situations: Focus on outcome (and especially avoidance of loss) rather than probability","volume":"66","author":"TE Nygren","year":"1996","journal-title":"Organ Behav Hum Decis Process"},{"issue":"5","key":"pcbi.1008555.ref055","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1037\/0022-3514.55.5.710","article-title":"Influence of positive affect on the subjective utility of gains and losses: it is just not worth the risk","volume":"55","author":"AM Isen","year":"1988","journal-title":"J Pers Soc Psychol"},{"key":"pcbi.1008555.ref056","first-page":"55","article-title":"Unpredictability and uncertainty in anxiety: a new direction for emotional timing research","volume":"5","author":"JI Lake","year":"2011","journal-title":"Front Integr Neurosci"},{"issue":"2","key":"pcbi.1008555.ref057","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.beproc.2008.11.012","article-title":"Time perception, depression and sadness","volume":"80","author":"S Gil","year":"2009","journal-title":"Behav Process"},{"issue":"5","key":"pcbi.1008555.ref058","doi-asserted-by":"crossref","first-page":"567","DOI":"10.2174\/18715273113129990080","article-title":"Time perception distortion in neuropsychiatric and neurological disorders","volume":"12","author":"S Teixeira","year":"2013","journal-title":"CNS Neurol Disord Drug Targets"},{"issue":"4","key":"pcbi.1008555.ref059","first-page":"255","article-title":"Time perception, emotions and mood disorders","volume":"107","author":"S Droit-Volet","year":"2013","journal-title":"J Physiol"},{"issue":"3","key":"pcbi.1008555.ref060","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1080\/00207454.2017.1385614","article-title":"The dopaminergic system dynamic in the time perception: a review of the evidence","volume":"128","author":"V Marinho","year":"2018","journal-title":"Int J Neurosci"},{"issue":"4","key":"pcbi.1008555.ref061","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1038\/sj.mp.4001949","article-title":"Mood is indirectly related to serotonin, norepinephrine and dopamine levels in humans: a meta-analysis of monoamine depletion studies","volume":"12","author":"HG Ruh\u00e9","year":"2007","journal-title":"Mol Psychiatry"},{"issue":"2","key":"pcbi.1008555.ref062","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/0010-440X(92)90007-D","article-title":"The role of dopamine in mood disorders","volume":"33","author":"DJ Diehl","year":"1992","journal-title":"Compr Psychiatry"},{"key":"pcbi.1008555.ref063","doi-asserted-by":"crossref","first-page":"2036","DOI":"10.3389\/fpsyg.2015.02036","article-title":"Increased risk taking in relation to chronic stress in adults","volume":"6","author":"S Ceccato","year":"2016","journal-title":"Front Psychol"},{"issue":"5","key":"pcbi.1008555.ref064","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1016\/j.cell.2017.10.017","article-title":"Chronic stress alters striosome-circuit dynamics, leading to aberrant decision-making","volume":"171","author":"A Friedman","year":"2017","journal-title":"Cell"},{"issue":"4","key":"pcbi.1008555.ref065","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/S0191-8869(00)00162-8","article-title":"Individual differences in energetic arousal and sustained attention: A dual-task study","volume":"31","author":"G Matthews","year":"2001","journal-title":"Pers Individ Differ"},{"issue":"2","key":"pcbi.1008555.ref066","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1037\/a0019572","article-title":"Task engagement, cerebral blood flow velocity, and diagnostic monitoring for sustained attention","volume":"16","author":"G Matthews","year":"2010","journal-title":"J Expl Psychol Appl"},{"issue":"17","key":"pcbi.1008555.ref067","doi-asserted-by":"crossref","first-page":"R712","DOI":"10.1016\/j.cub.2012.06.020","article-title":"The evolutionary origins of mood and its disorders","volume":"22","author":"D Nettle","year":"2012","journal-title":"Curr Biol"},{"issue":"4","key":"pcbi.1008555.ref068","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1207\/S15327957PSPR0504_4","article-title":"Affect and the functional bases of behavior: On the dimensional structure of affective experience","volume":"5","author":"CS Carver","year":"2001","journal-title":"Pers Soc Psychol Rev"},{"issue":"3","key":"pcbi.1008555.ref069","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1177\/1754073913477514","article-title":"What are emotional states, and why do we have them?","volume":"5","author":"ET Rolls","year":"2013","journal-title":"Emotion Rev"},{"issue":"4","key":"pcbi.1008555.ref070","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1038\/nn.3961","article-title":"Anxious individuals have difficulty learning the causal statistics of aversive environments","volume":"18","author":"M Browning","year":"2015","journal-title":"Nat Neurosci"},{"issue":"4","key":"pcbi.1008555.ref071","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.neuron.2005.04.026","article-title":"Uncertainty, neuromodulation, and attention","volume":"46","author":"AJ Yu","year":"2005","journal-title":"Neuron"},{"key":"pcbi.1008555.ref072","first-page":"201900872","article-title":"Endogenous fluctuations in the dopaminergic midbrain drive behavioral choice variability","author":"B Chew","year":"2019","journal-title":"Proc Natl Acad Sci USA"},{"issue":"4","key":"pcbi.1008555.ref073","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1163\/156856897X00357","article-title":"The psychophysics toolbox","volume":"10","author":"DH Brainard","year":"1997","journal-title":"Spat Vision"},{"issue":"1","key":"pcbi.1008555.ref074","doi-asserted-by":"crossref","first-page":"12400","DOI":"10.1038\/s41598-018-30571-x","article-title":"Assessing animal affect: an automated and self-initiated judgement bias task based on natural investigative behaviour","volume":"8","author":"S Jones","year":"2018","journal-title":"Sci Rep"},{"key":"pcbi.1008555.ref075","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.bbr.2017.05.044","article-title":"Pavlovian influences on learning differ between rats and mice in a counter-balanced Go\/NoGo judgement bias task","volume":"331","author":"S Jones","year":"2017","journal-title":"Behav Brain Res"},{"issue":"1","key":"pcbi.1008555.ref076","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/0022-247X(65)90154-X","article-title":"Optimal control of Markov processes with incomplete state information","volume":"10","author":"KJ \u00c5str\u00f6m","year":"1965","journal-title":"J Math Anal Appl"},{"issue":"5","key":"pcbi.1008555.ref077","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1287\/opre.21.5.1071","article-title":"The optimal control of partially observable Markov processes over a finite horizon","volume":"21","author":"RD Smallwood","year":"1973","journal-title":"Oper Res"},{"issue":"3","key":"pcbi.1008555.ref078","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1037\/0033-295X.84.3.279","article-title":"Scalar expectancy theory and Weber\u2019s law in animal timing","volume":"84","author":"J Gibbon","year":"1977","journal-title":"Psychol Rev"},{"issue":"8","key":"pcbi.1008555.ref079","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1073\/pnas.38.8.716","article-title":"On the theory of dynamic programming","volume":"38","author":"R Bellman","year":"1952","journal-title":"Proc Natl Acad Sci USA"},{"key":"pcbi.1008555.ref080","volume-title":"Classical Conditioning II Current Research and Theory","author":"RA Rescorla","year":"1972"},{"key":"pcbi.1008555.ref081","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Core Team","year":"2017"},{"key":"pcbi.1008555.ref082","volume-title":"nlme: Linear and Nonlinear Mixed Effects Models","author":"R Core Team","year":"2018"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1008555","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T00:00:00Z","timestamp":1611187200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008555","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T18:31:51Z","timestamp":1611253911000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008555"}},"subtitle":[],"editor":[{"given":"Alireza","family":"Soltani","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,1,8]]},"references-count":82,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1,8]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1008555","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1008555","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,8]]}}}