{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T10:12:18Z","timestamp":1767175938929,"version":"build-2238731810"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1013646","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T00:00:00Z","timestamp":1762473600000}}],"reference-count":50,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T00:00:00Z","timestamp":1761782400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["206691\/Z\/17\/Z"],"award-info":[{"award-number":["206691\/Z\/17\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100011706","name":"Autistica","doi-asserted-by":"publisher","award":["7265"],"award-info":[{"award-number":["7265"]}],"id":[{"id":"10.13039\/100011706","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Anxiety is known to alter learning in uncertain environments. Experimental paradigms and computational models addressing these differences have mainly assessed the impact of volatility, with more highly anxious individuals showing a reduced adaptation of learning rate in volatile compared to stable environments. Previous research has not, however, independently assessed the impact of both changes in volatility, i.e., reversals in reward contingency, and changes in stochasticity (noise) in the same individuals. Here, in an original online study (Experiment 1; N\u2009=\u200980) and a pre-registered replication attempt (Experiment 2; N\u2009=\u2009160), we use a simple probabilistic reversal learning paradigm to independently manipulate the level of volatility and noise at the experimental level in a fully orthogonal design. We replicate previous studies showing general increases, irrespective of anxiety levels, in positive learning rate (Experiment 1) and negative learning rate (Experiments 1 and 2) for high compared to low volatility, but here only in the context of low noise. Across both experiments, there was an interaction between volatility and noise on behaviour, with more win-stay responses for high compared to low volatility under low noise, but similar or fewer win-stay responses for the same comparison under high noise. The impact of anxious traits presented differently across experiments; in Experiment 1, increases in lose-shift responses in high versus low noise conditions scaled with level of anxious traits, whereas in Experiment 2, there was a full interaction between volatility, noise and anxious traits on win-stay behaviour. These anxiety-related lose-shift or win-stay differences were reflected in their corresponding negative and positive reinforcement learning rate parameters, respectively. Experiment 2 represents a more robust set of results with a larger sample size, balanced gender representation, and extended block order balancing. These findings suggest that changes in both sources of uncertainty - stochasticity and volatility - should be carefully considered when investigating learning and how learning is shaped by anxiety.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1013646","type":"journal-article","created":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T17:43:57Z","timestamp":1761846237000},"page":"e1013646","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["The relationship between anxious traits and learning about changes in stochasticity and volatility"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-4738-6723","authenticated-orcid":true,"given":"Br\u00f3nagh","family":"McCoy","sequence":"first","affiliation":[]},{"given":"Rebecca P.","family":"Lawson","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2025,10,30]]},"reference":[{"issue":"9","key":"pcbi.1013646.ref001","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1038\/nn1954","article-title":"Learning the value of information in an uncertain world","volume":"10","author":"TEJ Behrens","year":"2007","journal-title":"Nat Neurosci"},{"issue":"7","key":"pcbi.1013646.ref002","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1016\/j.tics.2007.05.008","article-title":"Neurocognitive mechanisms of anxiety: an integrative account","volume":"11","author":"SJ Bishop","year":"2007","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1013646.ref003","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.janxdis.2016.02.007","article-title":"Into the unknown: A review and synthesis of contemporary models involving uncertainty","volume":"39","author":"RN Carleton","year":"2016","journal-title":"J Anxiety Disord"},{"issue":"2","key":"pcbi.1013646.ref004","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1177\/1362361320962237","article-title":"Autistic traits are related to worse performance in a volatile reward learning task despite adaptive learning rates","volume":"25","author":"J Goris","year":"2021","journal-title":"Autism"},{"key":"pcbi.1013646.ref005","doi-asserted-by":"crossref","first-page":"105123","DOI":"10.1016\/j.neubiorev.2023.105123","article-title":"Transdiagnostic computations of uncertainty: towards a new lens on intolerance of uncertainty","volume":"148","author":"TR Sandhu","year":"2023","journal-title":"Neurosci Biobehav Rev"},{"issue":"7","key":"pcbi.1013646.ref006","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1038\/nrn3524","article-title":"Uncertainty and anticipation in anxiety: an integrated neurobiological and psychological perspective","volume":"14","author":"DW Grupe","year":"2013","journal-title":"Nat Rev Neurosci"},{"issue":"2","key":"pcbi.1013646.ref007","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.beth.2005.11.003","article-title":"The role of risk avoidance in anxiety","volume":"37","author":"JK Maner","year":"2006","journal-title":"Behav Ther"},{"issue":"1","key":"pcbi.1013646.ref008","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.janxdis.2009.09.005","article-title":"Predicting anxiety: the role of experiential avoidance and anxiety sensitivity","volume":"24","author":"NC Berman","year":"2010","journal-title":"J Anxiety Disord"},{"issue":"9","key":"pcbi.1013646.ref009","doi-asserted-by":"crossref","first-page":"764","DOI":"10.1016\/j.tics.2018.06.002","article-title":"How do expectations shape perception?","volume":"22","author":"FP de Lange","year":"2018","journal-title":"Trends in Cognitive Sciences"},{"key":"pcbi.1013646.ref010","volume-title":"Bayesian brain: Probabilistic approaches to neural coding","author":"K Doya","year":"2007"},{"issue":"1","key":"pcbi.1013646.ref011","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1038\/4580","article-title":"Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects","volume":"2","author":"RP Rao","year":"1999","journal-title":"Nat Neurosci"},{"key":"pcbi.1013646.ref012","first-page":"64","article-title":"A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement","volume-title":"Classical Conditioning II: Current Research and Theory","author":"RA Rescorla","year":"1972"},{"key":"pcbi.1013646.ref013","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"1998"},{"issue":"10","key":"pcbi.1013646.ref014","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1016\/j.tics.2019.07.007","article-title":"The Misestimation of Uncertainty in Affective Disorders","volume":"23","author":"E Pulcu","year":"2019","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1013646.ref015","doi-asserted-by":"crossref","first-page":"85","DOI":"10.3389\/fnins.2012.00085","article-title":"Different varieties of uncertainty in human decision-making","volume":"6","author":"AR Bland","year":"2012","journal-title":"Front Neurosci"},{"key":"pcbi.1013646.ref016","doi-asserted-by":"crossref","first-page":"10996","DOI":"10.1038\/ncomms10996","article-title":"Computations of uncertainty mediate acute stress responses in humans","volume":"7","author":"AO de Berker","year":"2016","journal-title":"Nat Commun"},{"key":"pcbi.1013646.ref017","first-page":"105","article-title":"Making predictions in a changing world-inference, uncertainty, and learning","volume":"7","author":"JX O\u2019Reilly","year":"2013","journal-title":"Front Neurosci"},{"key":"pcbi.1013646.ref018","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.neuron.2005.04.026","article-title":"Uncertainty, neuromodulation, and attention","volume":"46","author":"AJ Yu","year":"2005","journal-title":"Neuron"},{"issue":"6","key":"pcbi.1013646.ref019","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1016\/j.biopsych.2017.07.007","article-title":"Computational dysfunctions in anxiety: failure to differentiate signal from noise","volume":"82","author":"H Huang","year":"2017","journal-title":"Biol Psychiatry"},{"issue":"4","key":"pcbi.1013646.ref020","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1038\/nn.3961","article-title":"Anxious individuals have difficulty learning the causal statistics of aversive environments","volume":"18","author":"M Browning","year":"2015","journal-title":"Nat Neurosci"},{"issue":"9","key":"pcbi.1013646.ref021","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1038\/nn.4615","article-title":"Adults with autism overestimate the volatility of the sensory environment","volume":"20","author":"RP Lawson","year":"2017","journal-title":"Nat Neurosci"},{"issue":"5","key":"pcbi.1013646.ref022","doi-asserted-by":"crossref","DOI":"10.1111\/desc.12435","article-title":"Children on the autism spectrum update their behaviour in response to a volatile environment","volume":"20","author":"C Manning","year":"2017","journal-title":"Dev Sci"},{"issue":"23","key":"pcbi.1013646.ref023","doi-asserted-by":"crossref","first-page":"8625","DOI":"10.1523\/JNEUROSCI.1020-11.2011","article-title":"Dissociable contributions by prefrontal D1 and D2 receptors to risk-based decision making","volume":"31","author":"JR St Onge","year":"2011","journal-title":"J Neurosci"},{"issue":"6","key":"pcbi.1013646.ref024","doi-asserted-by":"crossref","first-page":"1640","DOI":"10.1037\/a0028146","article-title":"Working-memory load and temporal myopia in dynamic decision making","volume":"38","author":"DA Worthy","year":"2012","journal-title":"J Exp Psychol Learn Mem Cogn"},{"key":"pcbi.1013646.ref025","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.jmp.2013.10.001","article-title":"A Comparison Model of Reinforcement-Learning and Win-Stay-Lose-Shift Decision-Making Processes: A Tribute to W.K. Estes","volume":"59","author":"DA Worthy","year":"2014","journal-title":"J Math Psychol"},{"key":"pcbi.1013646.ref026","doi-asserted-by":"crossref","first-page":"100733","DOI":"10.1016\/j.dcn.2019.100733","article-title":"Reinforcement learning across development: What insights can we draw from a decade of research?","volume":"40","author":"K Nussenbaum","year":"2019","journal-title":"Dev Cogn Neurosci"},{"key":"pcbi.1013646.ref027","first-page":"95","article-title":"Cross-task contributions of frontobasal ganglia circuitry in response inhibition and conflict-induced slowing","volume":"4","author":"S Jahfari","year":"2019","journal-title":"Cereb Cortex"},{"issue":"11","key":"pcbi.1013646.ref028","doi-asserted-by":"crossref","first-page":"3605","DOI":"10.1093\/brain\/awz276","article-title":"Dopaminergic medication reduces striatal sensitivity to negative outcomes in Parkinson\u2019s disease","volume":"142","author":"B McCoy","year":"2019","journal-title":"Brain"},{"issue":"11","key":"pcbi.1013646.ref029","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1006632","article-title":"How pupil responses track value-based decision-making during and after reinforcement learning","volume":"14","author":"JC Van Slooten","year":"2018","journal-title":"PLoS Comput Biol"},{"issue":"8","key":"pcbi.1013646.ref030","doi-asserted-by":"crossref","first-page":"4140","DOI":"10.1002\/hbm.22466","article-title":"Pupil diameter covaries with BOLD activity in human locus coeruleus","volume":"35","author":"PR Murphy","year":"2014","journal-title":"Hum Brain Mapp"},{"key":"pcbi.1013646.ref031","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1146\/annurev.neuro.28.061604.135709","article-title":"An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance","volume":"28","author":"G Aston-Jones","year":"2005","journal-title":"Annu Rev Neurosci"},{"issue":"10","key":"pcbi.1013646.ref032","doi-asserted-by":"crossref","first-page":"1116","DOI":"10.1038\/s41562-019-0628-0","article-title":"Altered learning under uncertainty in unmedicated mood and anxiety disorders","volume":"3","author":"J Aylward","year":"2019","journal-title":"Nat Hum Behav"},{"key":"pcbi.1013646.ref033","doi-asserted-by":"crossref","first-page":"117424","DOI":"10.1016\/j.neuroimage.2020.117424","article-title":"State anxiety biases estimates of uncertainty and impairs reward learning in volatile environments","volume":"224","author":"TP Hein","year":"2021","journal-title":"Neuroimage"},{"issue":"1","key":"pcbi.1013646.ref034","doi-asserted-by":"crossref","first-page":"6587","DOI":"10.1038\/s41467-021-26731-9","article-title":"A model for learning based on the joint estimation of stochasticity and volatility","volume":"12","author":"P Piray","year":"2021","journal-title":"Nat Commun"},{"key":"pcbi.1013646.ref035","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.11305","article-title":"Characterizing a psychiatric symptom dimension related to deficits in goal-directed control","volume":"5","author":"CM Gillan","year":"2016","journal-title":"Elife"},{"key":"pcbi.1013646.ref036","volume-title":"Doing bayesian data analysis: A tutorial with r, jags, and stan","author":"JK Kruschke","year":"2015","edition":"2"},{"issue":"10","key":"pcbi.1013646.ref037","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pbio.3000908","article-title":"Modeling flexible behavior in childhood to adulthood shows age-dependent learning mechanisms and less optimal learning in autism in each age group","volume":"18","author":"D Crawley","year":"2020","journal-title":"PLoS Biol"},{"issue":"11","key":"pcbi.1013646.ref038","doi-asserted-by":"crossref","first-page":"4563","DOI":"10.1523\/JNEUROSCI.22-11-04563.2002","article-title":"Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging","volume":"22","author":"R Cools","year":"2002","journal-title":"J Neurosci"},{"issue":"4","key":"pcbi.1013646.ref039","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1016\/j.neuron.2013.08.030","article-title":"Dissociable effects of dopamine and serotonin on reversal learning","volume":"80","author":"HEM den Ouden","year":"2013","journal-title":"Neuron"},{"issue":"5762","key":"pcbi.1013646.ref040","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1126\/science.1121218","article-title":"Neurochemical modulation of response inhibition and probabilistic learning in humans","volume":"311","author":"SR Chamberlain","year":"2006","journal-title":"Science"},{"key":"pcbi.1013646.ref041","volume-title":"JASP (Version 0.14.1)","author":"JASP Team","year":"2020"},{"key":"pcbi.1013646.ref042","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1162\/CPSY_a_00002","article-title":"Revealing Neurocomputational Mechanisms of Reinforcement Learning and Decision-Making With the hBayesDM Package","volume":"1","author":"W-Y Ahn","year":"2017","journal-title":"Comput Psychiatr"},{"issue":"2","key":"pcbi.1013646.ref043","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1037\/a0020684","article-title":"A Model-Based fMRI Analysis with Hierarchical Bayesian Parameter Estimation","volume":"4","author":"W-Y Ahn","year":"2011","journal-title":"J Neurosci Psychol Econ"},{"key":"pcbi.1013646.ref044","doi-asserted-by":"crossref","first-page":"14","DOI":"10.3389\/fninf.2013.00014","article-title":"HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python","volume":"7","author":"TV Wiecki","year":"2013","journal-title":"Front Neuroinform"},{"issue":"4","key":"pcbi.1013646.ref045","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1214\/ss\/1177011136","article-title":"Inference from iterative simulation using multiple sequences","volume":"7","author":"A Gelman","year":"1992","journal-title":"Stat Sci"},{"key":"pcbi.1013646.ref046","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","article-title":"Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC","volume":"27","author":"A Vehtari","year":"2017","journal-title":"Stat and Comp"},{"key":"pcbi.1013646.ref047","doi-asserted-by":"crossref","DOI":"10.1201\/9780429029608","volume-title":"Statistical rethinking: A Bayesian course with examples in R and Stan","author":"R McElreath","year":"2020","edition":"2"},{"issue":"40","key":"pcbi.1013646.ref048","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.21105\/joss.01541","article-title":"bayestestR: Describing Effects and their Uncertainty, Existence and Significance within the Bayesian Framework","volume":"4","author":"D Makowski","year":"2019","journal-title":"JOSS"},{"key":"pcbi.1013646.ref049","volume-title":"Statistical power analysis for the behavioural sciences","author":"J Cohen"},{"key":"pcbi.1013646.ref050","volume-title":"State-Trait Anxiety Inventory for Adults","author":"CD Spielberger","year":"1983"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1013646","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T00:00:00Z","timestamp":1762473600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013646","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T18:53:57Z","timestamp":1762541637000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013646"}},"subtitle":[],"editor":[{"given":"Varun","family":"Dutt","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2025,10,30]]},"references-count":50,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10,30]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1013646","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,30]]}}}