{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T11:05:07Z","timestamp":1784891107198,"version":"3.55.0"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,2]],"date-time":"2025-07-02T00:00:00Z","timestamp":1751414400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,2]],"date-time":"2025-07-02T00:00:00Z","timestamp":1751414400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]},{"name":"NSPCC and ESRC","award":["539220"],"award-info":[{"award-number":["539220"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Optimal reward learning requires individuals to adjust their learning rates \u2013 the extent to which new information replaces old. Learning rates should be higher in volatile environments, where new information is more salient, and lower in stable environments, where the longer-term history of outcomes is more predictive. It is not known, however, whether this adjustment in learning rates changes with age or is associated with better mental health and social functioning. We administered a child-friendly probabilistic reinforcement learning task with both fixed and fluctuating reward schedules to 121 participants aged 8\u201316\u00a0years. Adjustment of learning rates across childhood and adolescence to suit the levels of uncertainty in the environment did not differ by age, nor was it associated with better mental health and social functioning. Instead we found that learning rates for worse-than-expected outcomes generally decreased with age, temperature increased with age and higher learning rates, specifically during positive stable environments, were associated with greater self-reported prosocial behaviour. Our results highlight the exaggerated impact of negative feedback on children and suggest an increase in exploratory behaviour between childhood and adolescence.<\/jats:p>","DOI":"10.1038\/s41598-025-05725-3","type":"journal-article","created":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T20:23:04Z","timestamp":1751401384000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Navigating a varying reward environment in childhood and adolescence"],"prefix":"10.1038","volume":"15","author":[{"given":"Louise","family":"Neil","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vincent","family":"Valton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Essi","family":"Viding","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diana","family":"Armbruster-Genc","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vivien","family":"Vuong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katy","family":"Packer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Molly","family":"Sharp","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan P.","family":"Roiser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eamon","family":"McCrory","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,2]]},"reference":[{"issue":"5","key":"5725_CR1","doi-asserted-by":"publisher","first-page":"1601","DOI":"10.1111\/cdev.13791","volume":"93","author":"K Nussenbaum","year":"2022","unstructured":"Nussenbaum, K., Velez, J. A., Washington, B. T., Hamling, H. E. & Hartley, C. A. Flexibility in valenced reinforcement learning computations across development. Child Dev. 93(5), 1601\u20131615 (2022).","journal-title":"Child Dev."},{"key":"5725_CR2","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.jecp.2018.11.019","volume":"180","author":"JM Rodriguez Buritica","year":"2019","unstructured":"Rodriguez Buritica, J. M., Heekeren, H. R. & van den Bos, W. The computational basis of following advice in adolescents. J. Exp. Child Psychol. 180, 39\u201354. https:\/\/doi.org\/10.1016\/j.jecp.2018.11.019 (2019).","journal-title":"J. Exp. Child Psychol."},{"issue":"6","key":"5725_CR3","doi-asserted-by":"publisher","first-page":"12471255","DOI":"10.1093\/cercor\/bhr198","volume":"22","author":"W van den Bos","year":"2012","unstructured":"van den Bos, W., Cohen, M. X., Kahnt, T. & Crone, E. A. Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning. Cereb. Cortex 22(6), 12471255. https:\/\/doi.org\/10.1093\/cercor\/bhr198 (2012).","journal-title":"Cereb. Cortex"},{"issue":"6","key":"5725_CR4","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1038\/nn.2558","volume":"13","author":"JR Cohen","year":"2010","unstructured":"Cohen, J. R. et al. A unique adolescent response to reward prediction errors. Nat. Neurosci. 13(6), 669\u2013671. https:\/\/doi.org\/10.1038\/nn.2558 (2010).","journal-title":"Nat. Neurosci."},{"issue":"1","key":"5725_CR5","doi-asserted-by":"publisher","first-page":"15770","DOI":"10.1038\/s41598-020-72628-w","volume":"10","author":"HA Raab","year":"2020","unstructured":"Raab, H. A. & Hartley, C. A. Adolescents exhibit reduced Pavlovian biases on instrumental learning. Sci. Rep. 10(1), 15770. https:\/\/doi.org\/10.1038\/s41598-020-72628-w (2020).","journal-title":"Sci. Rep."},{"issue":"11","key":"5725_CR6","doi-asserted-by":"publisher","first-page":"1807","DOI":"10.1162\/jocn_a_00447","volume":"25","author":"A Christakou","year":"2013","unstructured":"Christakou, A. et al. Neural and psychological maturation of decision-making in adolescence and young adulthood. J. Cogn. Neurosci. 25(11), 1807\u20131823. https:\/\/doi.org\/10.1162\/jocn_a_00447 (2013).","journal-title":"J. Cogn. Neurosci."},{"key":"5725_CR7","doi-asserted-by":"publisher","first-page":"100733","DOI":"10.1016\/j.dcn.2019.100733","volume":"40","author":"K Nussenbaum","year":"2019","unstructured":"Nussenbaum, K. & Hartley, C. A. Reinforcement learning across development: What insights can we draw from a decade of research?. Dev. Cogn. Neurosci. 40, 100733 (2019).","journal-title":"Dev. Cogn. Neurosci."},{"issue":"10","key":"5725_CR8","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1016\/j.tics.2019.07.007","volume":"23","author":"E Pulcu","year":"2019","unstructured":"Pulcu, E. & Browning, M. The misestimation of uncertainty in affective disorders. Trends Cogn. Sci. 23(10), 865\u2013875 (2019).","journal-title":"Trends Cogn. Sci."},{"issue":"9","key":"5725_CR9","doi-asserted-by":"publisher","first-page":"1214","DOI":"10.1038\/nn1954","volume":"10","author":"TE Behrens","year":"2007","unstructured":"Behrens, T. E., Woolrich, M. W., Walton, M. E. & Rushworth, M. F. Learning the value of information in an uncertain world. Nat. Neurosci. 10(9), 1214\u20131221 (2007).","journal-title":"Nat. Neurosci."},{"issue":"10","key":"5725_CR10","doi-asserted-by":"publisher","first-page":"1116","DOI":"10.1038\/s41562-019-0628-0","volume":"3","author":"J Aylward","year":"2019","unstructured":"Aylward, J. et al. Altered learning under uncertainty in unmedicated mood and anxiety disorders. Nat. Hum. Behav. 3(10), 1116\u20131123 (2019).","journal-title":"Nat. Hum. Behav."},{"issue":"12","key":"5725_CR11","doi-asserted-by":"publisher","first-page":"1286","DOI":"10.1001\/jamapsychiatry.2020.2139","volume":"77","author":"DC Halahakoon","year":"2020","unstructured":"Halahakoon, D. C. et al. Reward-processing behavior in depressed participants relative to healthy volunteers: A systematic review and meta-analysis. JAMA Psychiat. 77(12), 1286\u20131295 (2020).","journal-title":"JAMA Psychiat."},{"key":"5725_CR12","doi-asserted-by":"publisher","first-page":"S107","DOI":"10.1093\/schbul\/sbt197","volume":"40","author":"GP Strauss","year":"2014","unstructured":"Strauss, G. P., Waltz, J. A. & Gold, J. M. A review of reward processing and motivational impairment in schizophrenia. Schizophr. Bull. 40, S107\u2013S116 (2014).","journal-title":"Schizophr. Bull."},{"key":"5725_CR13","doi-asserted-by":"publisher","first-page":"105087","DOI":"10.1016\/j.neubiorev.2023.105087","volume":"147","author":"T Gibbs-Dean","year":"2023","unstructured":"Gibbs-Dean, T. et al. Belief updating in psychosis, depression and anxiety disorders: a systematic review across computational modelling approaches. Neurosci. Biobehav. Rev. 147, 105087 (2023).","journal-title":"Neurosci. Biobehav. Rev."},{"key":"5725_CR14","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1001\/jamapsychiatry.2022.0051","volume":"79","author":"AC Pike","year":"2022","unstructured":"Pike, A. C. & Robinson, O. J. Reinforcement learning in patients with mood and anxiety disorders vs control individuals: A systematic review and meta-analysis. JAMA Psychiatry 79, 313 (2022).","journal-title":"JAMA Psychiatry"},{"issue":"6","key":"5725_CR15","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1016\/j.biopsych.2017.07.007","volume":"82","author":"H Huang","year":"2017","unstructured":"Huang, H., Thompson, W. & Paulus, M. P. Computational dysfunctions in anxiety: Failure to differentiate signal from noise. Biol. Psychiat. 82(6), 440\u2013446 (2017).","journal-title":"Biol. Psychiat."},{"key":"5725_CR16","doi-asserted-by":"crossref","unstructured":"Browning, M., Behrens, T.E., Jocham, G., O'reilly, J.X., & Bishop, S. J.  Anxious individuals have difficulty learning the causal statistics of aversive environments. Nature neuroscience, 18(4), 590\u2013596 (2015).","DOI":"10.1038\/nn.3961"},{"issue":"2","key":"5725_CR17","doi-asserted-by":"publisher","first-page":"310","DOI":"10.3758\/s13415-014-0332-5","volume":"15","author":"JH Decker","year":"2015","unstructured":"Decker, J. H., Lourenco, F. S., Doll, B. B. & Hartley, C. A. Experiential reward learning outweighs instruction prior to adulthood. Cogn. Affect. Behav. Neurosci. 15(2), 310\u2013320. https:\/\/doi.org\/10.3758\/s13415-014-0332-5 (2015).","journal-title":"Cogn. Affect. Behav. Neurosci."},{"issue":"7","key":"5725_CR18","doi-asserted-by":"publisher","first-page":"e1008524","DOI":"10.1371\/journal.pcbi.1008524","volume":"17","author":"L Xia","year":"2021","unstructured":"Xia, L. et al. Modeling changes in probabilistic reinforcement learning during adolescence. PLoS Comput. Biol. 17(7), e1008524. https:\/\/doi.org\/10.1371\/journal.pcbi.1008524 (2021).","journal-title":"PLoS Comput. Biol."},{"key":"5725_CR19","doi-asserted-by":"crossref","unstructured":"Weiss, E. O., Kruppa, J. A., Fink, G. R., Herpertz-Dahlmann, B., Konrad, K., & Schulte-R\u00fcther, M. Developmental differences in probabilistic reversal learning: A computational modeling approach. Frontiers in neuroscience, 14, 536596 (2021).","DOI":"10.3389\/fnins.2020.536596"},{"key":"5725_CR20","doi-asserted-by":"publisher","DOI":"10.1186\/2045-5380-3-12","author":"QJ Huys","year":"2013","unstructured":"Huys, Q. J., Pizzagalli, D. A., Bogdan, R. & Dayan, P. Mapping anhedonia onto reinforcement learning: A behavioural meta-analysis. Biol. Mood Anxiety Disord. https:\/\/doi.org\/10.1186\/2045-5380-3-12 (2013).","journal-title":"Biol. Mood Anxiety Disord."},{"key":"5725_CR21","volume-title":"The Adolescent Brain: A Second Window of Opportunity","author":"R Dahl","year":"2017","unstructured":"Dahl, R. & Suleiman, A. Adolescent brain development: Windows of opportunity. In The Adolescent Brain: A Second Window of Opportunity (eds Dahl, R. & Suleiman, A.) (UNICEF Office of Research, 2017)."},{"key":"5725_CR22","volume-title":"WASI-II: Wechsler Abbreviated Scale of Intelligence","author":"D Wechsler","year":"2011","unstructured":"Wechsler, D. WASI-II: Wechsler Abbreviated Scale of Intelligence 2nd edn. (Psychological Corporation, 2011).","edition":"2"},{"issue":"5","key":"5725_CR23","doi-asserted-by":"publisher","first-page":"e12435","DOI":"10.1111\/desc.12435","volume":"20","author":"C Manning","year":"2017","unstructured":"Manning, C., Kilner, J., Neil, L., Karaminis, T. & Pellicano, E. Children on the autism spectrum update their behaviour in response to a volatile environment. Dev. Sci. 20(5), e12435 (2017).","journal-title":"Dev. Sci."},{"issue":"1","key":"5725_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v076.i01","volume":"76","author":"B Carpenter","year":"2017","unstructured":"Carpenter, B. et al. Stan: A probabilistic programming language. J. Stat. Softw. 76(1), 1\u201332 (2017).","journal-title":"J. Stat. Softw."},{"key":"5725_CR25","unstructured":"Valton, V., Wise, T., & Robinson, O. J. Recommendations for Bayesian hierarchical model specifications for case-control studies in mental health. [Cs, Stat]. (2020)."},{"key":"5725_CR26","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","volume":"27","author":"A Vehtari","year":"2017","unstructured":"Vehtari, A., Gelman, A. & Gabry, J. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat. Comput. 27, 1413\u20131432 (2017).","journal-title":"Stat. Comput."},{"key":"5725_CR27","unstructured":"Watanabe, S. A widely applicable Bayesian information criterion. The Journal of Machine Learning Research, 14(1), 867\u2013897 (2013)."},{"issue":"430","key":"5725_CR28","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","volume":"90","author":"RE Kass","year":"1995","unstructured":"Kass, R. E. & Raftery, A. E. Bayes factors. J. Am. Stat. Assoc. 90(430), 773\u2013795 (1995).","journal-title":"J. Am. Stat. Assoc."},{"key":"5725_CR29","doi-asserted-by":"crossref","unstructured":"Goodman, R. (1997). The Strengths and Difficulties Questionnaire: a research note. Journal of child psychology and psychiatry, 38(5), 581-586.","DOI":"10.1111\/j.1469-7610.1997.tb01545.x"},{"key":"5725_CR30","doi-asserted-by":"crossref","unstructured":"Goodman, R. Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40(11), 1337-1345 (2001).","DOI":"10.1097\/00004583-200111000-00015"},{"issue":"1","key":"5725_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","volume":"67","author":"D Bates","year":"2015","unstructured":"Bates, D., M\u00e4chler, M., Bolker, B. & Walker, S. Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67(1), 1\u201348. https:\/\/doi.org\/10.18637\/jss.v067.i01 (2015).","journal-title":"J. Stat. Softw."},{"key":"5725_CR32","doi-asserted-by":"crossref","unstructured":"Eppinger, B., Mock, B., & Kray, J.  Developmental differences in learning and error processing: evidence from ERPs. Psychophysiology, 46(5), 1043\u20131053 (2009).","DOI":"10.1111\/j.1469-8986.2009.00838.x"},{"key":"5725_CR33","doi-asserted-by":"crossref","unstructured":"Van Duijvenvoorde, A.C., Zanolie, K., Rombouts, S.A., Raijmakers, M.E., & Crone, E.A. Evaluating the negative or valuing the positive? Neural mechanisms supporting feedback-based learning across development. Journal of Neuroscience, 28(38), 9495\u20139503 (2008).","DOI":"10.1523\/JNEUROSCI.1485-08.2008"},{"key":"5725_CR34","doi-asserted-by":"crossref","unstructured":"Palminteri, S., Kilford, E.J., Coricelli, G., & Blakemore, S.J.  The computational development of reinforcement learning during adolescence. PLoS computational biology, 12(6), e1004953 (2016).","DOI":"10.1371\/journal.pcbi.1004953"},{"key":"5725_CR35","doi-asserted-by":"crossref","unstructured":"Javadi, A.H., Schmidt, D.H., & Smolka, M.N. Adolescents adapt more slowly than adults to varying reward contingencies. Journal of cognitive neuroscience, 26(12), 2670\u20132681 (2014).","DOI":"10.1162\/jocn_a_00677"},{"issue":"1","key":"5725_CR36","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1093\/scan\/nss113","volume":"9","author":"KL Mills","year":"2014","unstructured":"Mills, K. L., Lalonde, F., Clasen, L. S., Giedd, J. N. & Blakemore, S. J. Developmental changes in the structure of the social brain in late childhood and adolescence. Soc. Cognitive Affect. Neurosci. 9(1), 123\u2013131 (2014).","journal-title":"Soc. Cognitive Affect. Neurosci."},{"key":"5725_CR37","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1177\/0963721412473755","volume":"22","author":"JS Peper","year":"2013","unstructured":"Peper, J. S. & Dahl, R. E. Surging hormones\u2014brain-behavior interactions during puberty. Curr. Dir. Psychol. Sci. 22, 134\u2013139 (2013).","journal-title":"Curr. Dir. Psychol. Sci."},{"key":"5725_CR38","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1037\/13493-010","volume-title":"The Adolescent Brain: Learning, Reasoning, and Decision Making","author":"A Galv\u00e1n","year":"2012","unstructured":"Galv\u00e1n, A. Risky behavior in adolescents: The role of the developing brain. In The Adolescent Brain: Learning, Reasoning, and Decision Making (eds Reyna, V. F. et al.) 267\u2013289 (American Psychological Association, 2012)."},{"key":"5725_CR39","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1016\/0273-2297(92)90013-R","volume":"12","author":"J Arnett","year":"1992","unstructured":"Arnett, J. Review: Reckless behavior in adolescence: A developmental perspective. Dev. Rev. 12, 339\u2013373 (1992).","journal-title":"Dev. Rev."},{"issue":"9","key":"5725_CR40","doi-asserted-by":"publisher","first-page":"1184","DOI":"10.1038\/nn.3177","volume":"15","author":"SJ Blakemore","year":"2012","unstructured":"Blakemore, S. J. & Robbins, T. W. Decision-making in the adolescent brain. Nat. Neurosci. 15(9), 1184\u20131191 (2012).","journal-title":"Nat. Neurosci."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-05725-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-05725-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-05725-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,24]],"date-time":"2025-10-24T08:57:27Z","timestamp":1761296247000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-025-05725-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,2]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["5725"],"URL":"https:\/\/doi.org\/10.1038\/s41598-025-05725-3","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,2]]},"assertion":[{"value":"14 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 October 2025","order":5,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":6,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The original online version of this Article was revised: In the original version of this Article, the Author name Jonathan P. Roiser was incorrectly indexed. The original Article has been corrected.","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Vincent Valton is currently an employee of Oura Health Oy. His contributions to this work, as well as statements and opinions expressed in this work, are solely the responsibility of the author and do not represent the official views of Oura Health Oy. None of the remaining authors declare any competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"22715"}}