{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T11:19:56Z","timestamp":1767179996826,"version":"build-2238731810"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010664","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T00:00:00Z","timestamp":1668988800000}}],"reference-count":54,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2022,11,2]],"date-time":"2022-11-02T00:00:00Z","timestamp":1667347200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NIH","award":["R01MH124092"],"award-info":[{"award-number":["R01MH124092"]}]},{"name":"NIH","award":["R01MH125564"],"award-info":[{"award-number":["R01MH125564"]}]},{"DOI":"10.13039\/501100003977","name":"Israel Science Foundation","doi-asserted-by":"publisher","award":["1094\/20"],"award-info":[{"award-number":["1094\/20"]}],"id":[{"id":"10.13039\/501100003977","id-type":"DOI","asserted-by":"publisher"}]},{"name":"US-Israel BSF","award":["2019802"],"award-info":[{"award-number":["2019802"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>\n                    Many decision-making studies have demonstrated that humans learn either expected values or relative preferences among choice options, yet little is known about what environmental conditions promote one strategy over the other. Here, we test the novel hypothesis that humans adapt the degree to which they form absolute values to the diversity of the learning environment. Since absolute values generalize better to new sets of options, we predicted that the more options a person learns about the more likely they would be to form absolute values. To test this, we designed a multi-day learning experiment comprising twenty learning sessions in which subjects chose among pairs of images each associated with a different probability of reward. We assessed the degree to which subjects formed absolute values and relative preferences by asking them to choose between images they learned about in separate sessions. We found that\n                    <jats:italic>concurrently<\/jats:italic>\n                    learning about more images within a session enhanced absolute-value, and suppressed relative-preference, learning. Conversely,\n                    <jats:italic>cumulatively<\/jats:italic>\n                    pitting each image against a larger number of other images across multiple sessions did not impact the form of learning. These results show that the way humans encode preferences is adapted to the diversity of experiences offered by the immediate learning context.\n                  <\/jats:p>","DOI":"10.1371\/journal.pcbi.1010664","type":"journal-article","created":{"date-parts":[[2022,11,2]],"date-time":"2022-11-02T14:03:19Z","timestamp":1667397799000},"page":"e1010664","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":6,"title":["Training diversity promotes absolute-value-guided choice"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2933-607X","authenticated-orcid":true,"given":"Levi","family":"Solomyak","sequence":"first","affiliation":[]},{"given":"Paul B.","family":"Sharp","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8988-6124","authenticated-orcid":true,"given":"Eran","family":"Eldar","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,11,2]]},"reference":[{"issue":"6","key":"pcbi.1010664.ref001","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1016\/j.neuron.2009.09.003","article-title":"The neurobiology of decision: consensus and controversy","volume":"63","author":"JW Kable","year":"2009","journal-title":"Neuron"},{"issue":"2","key":"pcbi.1010664.ref002","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/S0896-6273(02)00974-1","article-title":"Neural economics and the biological substrates of valuation","volume":"36","author":"PR Montague","year":"2002","journal-title":"Neuron"},{"key":"pcbi.1010664.ref003","doi-asserted-by":"crossref","first-page":"14004","DOI":"10.1523\/JNEUROSCI.3751-09.2009","article-title":"Range-adapting representation of economic value in the orbitofrontal cortex","volume":"29","author":"C Padoa-Schioppa","year":"2011","journal-title":"J Neurosci"},{"key":"pcbi.1010664.ref004","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.neubiorev.2014.03.027","article-title":"The problem with value","volume":"43","author":"JP O\u2019Doherty","year":"2014","journal-title":"Neurosci Biobehav Rev"},{"issue":"6","key":"pcbi.1010664.ref005","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1016\/j.conb.2012.06.001","article-title":"The root of all value: a neural common currency for choice","author":"DJ Levy","year":"2012","journal-title":"Curr Opin Neurobiol"},{"issue":"4","key":"pcbi.1010664.ref006","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1109\/JPROC.2014.2307022","article-title":"The Misbehavior of Reinforcement Learning","volume":"102","author":"G. Mongillo","year":"2014","journal-title":"Proceedings of the IEEE"},{"key":"pcbi.1010664.ref007","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1037\/bne0000448","article-title":"The case against economic values in the orbitofrontal cortex (or anywhere else in the brain)","volume":"135","author":"BY Hayden","year":"2021","journal-title":"Behavioral Neuroscience"},{"key":"pcbi.1010664.ref008","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.cobeha.2021.04.020","article-title":"Value-free reinforcement learning: Policy optimization as a minimal model of operant behavior","volume":"41","author":"D. Bennett","year":"2021","journal-title":"Current Opinion in Behavioral Sciences"},{"issue":"5306","key":"pcbi.1010664.ref009","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A neural substrate of prediction and reward","volume":"275","author":"W Schultz","year":"1997","journal-title":"Science"},{"issue":"6","key":"pcbi.1010664.ref010","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.tics.2020.03.001","article-title":"Unraveling the Mysteries of Motivation","author":"RC O\u2019Reilly","year":"2020","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1010664.ref011","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.neuroimage.2013.02.063","article-title":"The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value","volume":"76","author":"O Bartra","year":"2013","journal-title":"Neuroimage"},{"key":"pcbi.1010664.ref012","first-page":"31","article-title":"Signals in human striatum are appropriate for policy update rather than value prediction","author":"J Li","year":"2011","journal-title":"J Neurosci"},{"issue":"1","key":"pcbi.1010664.ref013","doi-asserted-by":"crossref","first-page":"4648","DOI":"10.1038\/s41467-021-24907-x","article-title":"Memory and decision making interact to shape the value of unchosen options","volume":"12","author":"N Biderman","year":"2021","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1010664.ref014","doi-asserted-by":"crossref","first-page":"3206","DOI":"10.1038\/s41467-018-05507-8","article-title":"Multiple timescales of normalized value coding underlie adaptive choice behavior","volume":"9","author":"J Zimmermann","year":"2018","journal-title":"Nat Commun"},{"key":"pcbi.1010664.ref015","doi-asserted-by":"crossref","first-page":"14004","DOI":"10.1523\/JNEUROSCI.3751-09.2009","article-title":"Range-Adapting Representation of Economic Value in the Orbitofrontal Cortex","volume":"29","author":"C. Padoa Schioppa","year":"2009","journal-title":"The Journal of neuroscience"},{"issue":"11","key":"pcbi.1010664.ref016","doi-asserted-by":"crossref","first-page":"e2003091","DOI":"10.1371\/journal.pbio.2003091","article-title":"Correlates of decisional dynamics in the dorsal anterior cingulate cortex","volume":"15","author":"H. Azab","year":"2017","journal-title":"PLoS biology"},{"issue":"10","key":"pcbi.1010664.ref017","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1038\/s41593-018-0239-5","article-title":"Triple dissociation of attention and decision computations across prefrontal cortex","volume":"21","author":"LT Hunt","year":"2018","journal-title":"Nat Neurosci"},{"key":"pcbi.1010664.ref018","article-title":"Reinforcement learning in and out of context: The effects of attentional focus","author":"WM Hayes","year":"2022","journal-title":"J Exp Psychol Learn Mem Cogn"},{"issue":"11","key":"pcbi.1010664.ref019","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1016\/j.tics.2011.09.008","article-title":"Does the brain calculate value?","volume":"15","author":"I Vlaev","year":"2011","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1010664.ref020","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1146\/annurev-psych-120709-145346","article-title":"Heuristic decision making","volume":"62","author":"G. Gigerenzer","year":"2011","journal-title":"Annual review of psychology"},{"key":"pcbi.1010664.ref021","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511618031","volume-title":"The construction of preference","author":"S. Lichtenstein","year":"2006"},{"issue":"48","key":"pcbi.1010664.ref022","doi-asserted-by":"crossref","first-page":"12696","DOI":"10.1073\/pnas.1715293114","article-title":"Normalized value coding explains dynamic adaptation in the human valuation process","volume":"114","author":"MW Khaw","year":"2017","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1010664.ref023","article-title":"Learning relative values in the striatum induces violations of normative decision making","author":"T. Klein","year":"2017","journal-title":"Nat Commun"},{"issue":"4","key":"pcbi.1010664.ref024","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1016\/j.neuroimage.2004.12.043","article-title":"Activity in human reward-sensitive brain areas is strongly context dependent","volume":"25","author":"S Nieuwenhuis","year":"2005","journal-title":"Neuroimage"},{"issue":"2","key":"pcbi.1010664.ref025","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1037\/xge0000842","article-title":"It\u2019s all relative: Reward-induced cognitive control modulation depends on context","volume":"150","author":"A. R. Otto","year":"2021","journal-title":"Journal of Experimental Psychology"},{"key":"pcbi.1010664.ref026","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-018-06781-2","article-title":"Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences","volume":"9","author":"S Bavard","year":"2018","journal-title":"Nature Communications"},{"key":"pcbi.1010664.ref027","article-title":"Two sides of the same coin: Beneficial and detrimental consequences of range adaptation in human reinforcement learning","author":"S Bavard","year":"2021","journal-title":"Sci Adv"},{"key":"pcbi.1010664.ref028","article-title":"Context-dependent Outcome Encoding in Human Reinforcement Learning","author":"S. Palminteri","year":"2021","journal-title":"PsyArXiv"},{"key":"pcbi.1010664.ref029","doi-asserted-by":"crossref","first-page":"e1002607","DOI":"10.1371\/journal.pcbi.1002607","article-title":"A range-normalization model of context-dependent choice: a new model and evidence","volume":"8","author":"A Soltani","year":"2012","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1010664.ref030","article-title":"Diversity in Machine Learning","author":"Z. Gong","year":"1807","journal-title":"IEEE Access 2018 arXiv"},{"issue":"11","key":"pcbi.1010664.ref031","doi-asserted-by":"crossref","first-page":"2647","DOI":"10.1177\/1747021819857065","article-title":"Evidential diversity increases generalization in predictive learning","volume":"72","author":"JC Lee","year":"2019","journal-title":"Q J Exp Psychol"},{"key":"pcbi.1010664.ref032","doi-asserted-by":"crossref","DOI":"10.1016\/j.cub.2018.03.038","article-title":"Decodability of Reward Learning Signals Predicts Mood Fluctuations","author":"E Eldar","year":"2018","journal-title":"Curr Biol"},{"issue":"368","key":"pcbi.1010664.ref033","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1080\/01621459.1979.10481038","article-title":"Cleveland, William S Robust Locally Weighted Regression and Smoothing Scatterplots.","volume":"74","year":"1979","journal-title":"Journal of the American Statistical Association"},{"issue":"12","key":"pcbi.1010664.ref034","doi-asserted-by":"crossref","first-page":"2066","DOI":"10.1038\/s41593-019-0518-9","article-title":"Computational noise in reward-guided learning drives behavioral variability in volatile environments","volume":"22","author":"C Findling","year":"2019","journal-title":"Nat Neurosci"},{"issue":"7095","key":"pcbi.1010664.ref035","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1038\/nature04766","article-title":"Cortical substrates for exploratory decisions in humans","volume":"441","author":"ND Daw","year":"2006","journal-title":"Nature"},{"issue":"430","key":"pcbi.1010664.ref036","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","article-title":"Bayes Factors","volume":"90","author":"Robert E. Kass","year":"1995","journal-title":"Journal of the American Statistical Association"},{"key":"pcbi.1010664.ref037","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1038\/s41593-018-0292-0","article-title":"Efficient coding of subjective value","volume":"22","author":"R Polania","year":"2019","journal-title":"Nat Neurosci"},{"key":"pcbi.1010664.ref038","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.cobeha.2021.05.001","article-title":"Context-sensitive valuation and learning","volume":"41","author":"L Hunter","year":"2021","journal-title":"Current Opinion in Behavioral Sciences"},{"issue":"9","key":"pcbi.1010664.ref039","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1038\/s41562-022-01360-4","article-title":"Human value learning and representation reflects rational adaption to task demands","volume":"6","author":"K. Juechems","year":"2022","journal-title":"Nat Hum Behav"},{"issue":"16","key":"pcbi.1010664.ref040","doi-asserted-by":"crossref","first-page":"4332","DOI":"10.1523\/JNEUROSCI.2700-16.2017","article-title":"Working Memory Load Strengthens Reward Prediction Errors","volume":"37","author":"AGE Collins","year":"2017","journal-title":"J Neurosci"},{"key":"pcbi.1010664.ref041","doi-asserted-by":"crossref","first-page":"15958","DOI":"10.1038\/ncomms15958","article-title":"Reminders of past choices bias decisions for reward in humans","volume":"8","author":"AM Bornstein","year":"2017","journal-title":"Nat Commun"},{"issue":"7","key":"pcbi.1010664.ref042","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1038\/nn.4573","article-title":"Reinstated episodic context guides sampling-based decisions for reward","volume":"20","author":"AM Bornstein","year":"2017","journal-title":"Nat Neurosci"},{"issue":"6","key":"pcbi.1010664.ref043","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1037\/rev0000123","article-title":"Decision by sampling implements efficient coding of psychoeconomic functions","volume":"125","author":"R Bhui","year":"2018","journal-title":"Psychol Rev"},{"key":"pcbi.1010664.ref044","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.jmp.2017.08.005","article-title":"Multi-attribute decision by sampling: An account of the attraction, compromise and similarity effects","volume":"81","author":"D. Ronayne","year":"2017","journal-title":"Journal of Mathematical Psychology"},{"key":"pcbi.1010664.ref045","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1146\/annurev-psych-122414-033625","article-title":"Reinforcement learning and episodic memory in humans and animals: an integrative framework","volume":"68","author":"S. J. Gershman","year":"2017","journal-title":"Annual review of psychology"},{"key":"pcbi.1010664.ref046","author":"Levi Solomyak","year":"2022","journal-title":"Training diversity promotes absolute value guided choice, Dryad, Dataset"},{"key":"pcbi.1010664.ref047","volume-title":"Statistical Power Analysis for the Behavioral Sciences (2nd ed.)","author":"J. Cohen","year":"1988"},{"issue":"4","key":"pcbi.1010664.ref048","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"W. Zhou","year":"2004","journal-title":"IEEE Transactions on Image Processing"},{"key":"pcbi.1010664.ref049","first-page":"64","article-title":"A Theory of Pavlovian Conditioning: Variations in the Effectiveness of Reinforcement and Nonreinforcement","author":"R. A. Recorla","year":"1972","journal-title":"Classical Conditioning II: Current Research and Theory"},{"issue":"1","key":"pcbi.1010664.ref050","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/2045-5380-3-12","article-title":"Mapping anhedonia onto reinforcement learning: a behavioural meta-analysis","volume":"3","author":"QJ Huys","year":"2013","journal-title":"Biol Mood Anxiety Disord"},{"issue":"17","key":"pcbi.1010664.ref051","doi-asserted-by":"crossref","first-page":"4812","DOI":"10.1073\/pnas.1519829113","article-title":"Striatal structure and function predict individual biases in learning to avoid pain","volume":"113","author":"E Eldar","year":"2016","journal-title":"Proc Natl Acad Sci USA"},{"key":"pcbi.1010664.ref052","doi-asserted-by":"crossref","first-page":"e56911","DOI":"10.7554\/eLife.56911","article-title":"The roles of online and offline replay in planning","volume":"9","author":"E Eldar","year":"2020","journal-title":"Elife"},{"key":"pcbi.1010664.ref053","doi-asserted-by":"crossref","first-page":"e74402","DOI":"10.7554\/eLife.74402","article-title":"Humans perseverate on punishment avoidance goals in multigoal reinforcement learning","volume":"11","author":"PB Sharp","year":"2022","journal-title":"Elife"},{"key":"pcbi.1010664.ref054","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1038\/s41562-021-01263-w","article-title":"Asymmetric reinforcement learning facilitates human inference of transitive relations","volume":"6","author":"S. Ciranka","year":"2022","journal-title":"Nat Hum Behav"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010664","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T00:00:00Z","timestamp":1668988800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010664","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T13:57:06Z","timestamp":1669039026000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010664"}},"subtitle":[],"editor":[{"given":"Lusha","family":"Zhu","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,11,2]]},"references-count":54,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,11,2]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010664","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,2]]}}}