{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T18:20:44Z","timestamp":1783621244060,"version":"3.55.0"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1014459","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T00:00:00Z","timestamp":1783555200000}}],"reference-count":82,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T00:00:00Z","timestamp":1782691200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000077","name":"Division of Social and Economic Sciences","doi-asserted-by":"publisher","award":["2333979"],"award-info":[{"award-number":["2333979"]}],"id":[{"id":"10.13039\/100000077","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Learning is fundamental to adaptive behavior. In the typical learning task, each action is associated with only one outcome, which could be immediate or delayed. However, actions often have multiple consequences that unfold over time. Here, we used behavioral and eye-tracking experiments to study how people learn when their choices yield both immediate and delayed reward information. Importantly, the rewards themselves were all delivered at the end of the study so there was no reason to weight immediate and delayed reward information differently. Instead, we found that our subjects overweighted immediate reward information. Moreover, this bias increased over the course of the experiment and was still present when learning from others\u2019 choices. The gaze data reveal mixed evidence that subjects looked more at immediate vs. delayed feedback, and across subjects, the relative dwell proportion did not predict the behavioral bias. Our results indicate that people prioritize not just immediate rewards, but immediate reward information. Unlike temporal discounting, this form of impatience is a clear mistake and leads to objectively worse outcomes.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1014459","type":"journal-article","created":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T17:34:16Z","timestamp":1782754456000},"page":"e1014459","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Delayed reward information is underweighted in reinforcement learning with dispersed feedback"],"prefix":"10.1371","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4301-4755","authenticated-orcid":true,"given":"Miruna","family":"Cotet","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2098-2120","authenticated-orcid":true,"given":"David","family":"Poensgen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6618-5675","authenticated-orcid":true,"given":"Ian","family":"Krajbich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,6,29]]},"reference":[{"issue":"6","key":"pcbi.1014459.ref001","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1016\/j.conb.2012.08.003","article-title":"The ubiquity of model-based reinforcement learning","volume":"22","author":"BB Doll","year":"2012","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1014459.ref002","doi-asserted-by":"crossref","first-page":"15647","DOI":"10.1073\/pnas.1014269108","article-title":"Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesis","volume":"108","author":"PW Glimcher","year":"2011","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"2","key":"pcbi.1014459.ref003","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.conb.2006.03.006","article-title":"The computational neurobiology of learning and reward","volume":"16","author":"ND Daw","year":"2006","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1014459.ref004","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"2018","edition":"2"},{"issue":"44","key":"pcbi.1014459.ref005","doi-asserted-by":"crossref","first-page":"17163","DOI":"10.1073\/pnas.0807749105","article-title":"A double dissociation revealing bidirectional competition between striatum and hippocampus during learning","volume":"105","author":"AS Lee","year":"2008","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"2","key":"pcbi.1014459.ref006","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/S0896-6273(03)00169-7","article-title":"Temporal Difference Models and Reward-Related Learning in the Human Brain","volume":"38","author":"JP O\u2019Doherty","year":"2003","journal-title":"Neuron"},{"issue":"12","key":"pcbi.1014459.ref007","doi-asserted-by":"crossref","first-page":"2124","DOI":"10.1111\/j.1460-9568.2010.07282.x","article-title":"Subjective neuronal coding of reward: temporal value discounting and risk","volume":"31","author":"W Schultz","year":"2010","journal-title":"Eur J Neurosci"},{"issue":"33","key":"pcbi.1014459.ref008","doi-asserted-by":"crossref","first-page":"7193","DOI":"10.1523\/JNEUROSCI.0151-18.2018","article-title":"The successor representation: its computational logic and neural substrates","volume":"38","author":"SJ Gershman","year":"2018","journal-title":"J Neurosci"},{"issue":"7","key":"pcbi.1014459.ref009","doi-asserted-by":"crossref","first-page":"2234","DOI":"10.1111\/ejn.14745","article-title":"The credit assignment problem in cortico-basal ganglia-thalamic networks: A review, a problem and a possible solution","volume":"53","author":"JE Rubin","year":"2021","journal-title":"Eur J Neurosci"},{"issue":"16","key":"pcbi.1014459.ref010","doi-asserted-by":"crossref","DOI":"10.1016\/j.neuron.2022.05.021","article-title":"Neural mechanisms of credit assignment for inferred relationships in a structured world","volume":"110","author":"PP Witkowski","year":"2022","journal-title":"Neuron"},{"issue":"4","key":"pcbi.1014459.ref011","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1509\/jmkr.46.4.543","article-title":"Discounting Time and Time Discounting: Subjective Time Perception and Intertemporal Preferences","volume":"46","author":"G Zauberman","year":"2009","journal-title":"Journal of Marketing Research"},{"issue":"2","key":"pcbi.1014459.ref012","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1257\/jel.40.2.351","article-title":"Time Discounting and Time Preference: A Critical Review","volume":"40","author":"S Frederick","year":"2002","journal-title":"Journal of Economic Literature"},{"key":"pcbi.1014459.ref013","first-page":"1","article-title":"Intertemporal choice","author":"KM Ericson","year":"2019","journal-title":"Handbook of Behavioral Economics: Applications and Foundations 1"},{"key":"pcbi.1014459.ref014","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/B978-0-12-416008-8.00010-3","article-title":"Valuation, intertemporal choice, and self-control.","author":"JW. Kable","year":"2014","journal-title":"Neuroeconomics"},{"issue":"4","key":"pcbi.1014459.ref015","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1037\/a0035976","article-title":"A probabilistic, dynamic, and attribute-wise model of intertemporal choice","volume":"143","author":"J Dai","year":"2014","journal-title":"J Exp Psychol Gen"},{"issue":"10","key":"pcbi.1014459.ref016","doi-asserted-by":"crossref","first-page":"1292","DOI":"10.1038\/nn.2635","article-title":"Visual fixations and the computation and comparison of value in simple choice","volume":"13","author":"I Krajbich","year":"2010","journal-title":"Nat Neurosci"},{"key":"pcbi.1014459.ref017","doi-asserted-by":"crossref","first-page":"102594","DOI":"10.1016\/j.jmp.2021.102594","article-title":"Attention as a source of variability in decision-making: Accounting for overall-value effects with diffusion models","volume":"105","author":"BRK Shevlin","year":"2021","journal-title":"Journal of Mathematical Psychology"},{"issue":"3","key":"pcbi.1014459.ref018","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1016\/j.neuron.2014.06.035","article-title":"A reinforcement learning mechanism responsible for the valuation of free choice","volume":"83","author":"J Cockburn","year":"2014","journal-title":"Neuron"},{"issue":"16","key":"pcbi.1014459.ref019","doi-asserted-by":"crossref","first-page":"6255","DOI":"10.1523\/JNEUROSCI.4181-14.2015","article-title":"The simple act of choosing influences declarative memory","volume":"35","author":"VP Murty","year":"2015","journal-title":"J Neurosci"},{"issue":"10","key":"pcbi.1014459.ref020","doi-asserted-by":"crossref","first-page":"1067","DOI":"10.1038\/s41562-020-0919-5","article-title":"Information about action outcomes differentially affects learning from self-determined versus imposed choices","volume":"4","author":"V Chambon","year":"2020","journal-title":"Nat Hum Behav"},{"key":"pcbi.1014459.ref021","doi-asserted-by":"crossref","first-page":"105371","DOI":"10.1016\/j.neubiorev.2023.105371","article-title":"Signed and unsigned effects of prediction error on memory: Is it a matter of choice?","volume":"153","author":"F Pupillo","year":"2023","journal-title":"Neuroscience & Biobehavioral Reviews"},{"issue":"1","key":"pcbi.1014459.ref022","doi-asserted-by":"crossref","first-page":"2948","DOI":"10.1038\/s41467-024-46657-2","article-title":"Attribute latencies causally shape intertemporal decisions","volume":"15","author":"F Chen","year":"2024","journal-title":"Nat Commun"},{"issue":"9","key":"pcbi.1014459.ref023","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1038\/s41562-020-0893-y","article-title":"Dissociable mechanisms govern when and how strongly reward attributes affect decisions","volume":"4","author":"SU Maier","year":"2020","journal-title":"Nat Hum Behav"},{"issue":"12","key":"pcbi.1014459.ref024","doi-asserted-by":"crossref","first-page":"1698","DOI":"10.1038\/s41562-021-01154-0","article-title":"Healthful choices depend on the latency and rate of information accumulation","volume":"5","author":"NJ Sullivan","year":"2021","journal-title":"Nat Hum Behav"},{"issue":"6","key":"pcbi.1014459.ref025","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1111\/j.1467-9280.2007.01932.x","article-title":"Asymmetric discounting in intertemporal choice: a query-theory account","volume":"18","author":"EU Weber","year":"2007","journal-title":"Psychol Sci"},{"issue":"20","key":"pcbi.1014459.ref026","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2022685118","article-title":"Retrieval-constrained valuation: Toward prediction of open-ended decisions","volume":"118","author":"Z Zhang","year":"2021","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"37","key":"pcbi.1014459.ref027","doi-asserted-by":"crossref","first-page":"13157","DOI":"10.1523\/JNEUROSCI.2701-11.2011","article-title":"Feedback timing modulates brain systems for learning in humans","volume":"31","author":"K Foerde","year":"2011","journal-title":"J Neurosci"},{"issue":"5280","key":"pcbi.1014459.ref028","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1126\/science.273.5280.1399","article-title":"A neostriatal habit learning system in humans","volume":"273","author":"BJ Knowlton","year":"1996","journal-title":"Science"},{"issue":"13","key":"pcbi.1014459.ref029","doi-asserted-by":"crossref","first-page":"5698","DOI":"10.1523\/JNEUROSCI.5217-12.2013","article-title":"A role for the medial temporal lobe in feedback-driven learning: evidence from amnesia","volume":"33","author":"K Foerde","year":"2013","journal-title":"J Neurosci"},{"key":"pcbi.1014459.ref030","volume-title":"Conditioned reflexes: an investigation of the physiological activity of the cerebral cortex","author":"IP Pavlov","year":"1927"},{"issue":"34","key":"pcbi.1014459.ref031","doi-asserted-by":"crossref","first-page":"8702","DOI":"10.1523\/JNEUROSCI.1742-06.2006","article-title":"Trace conditioning and the hippocampus: the importance of contiguity","volume":"26","author":"DA Bangasser","year":"2006","journal-title":"J Neurosci"},{"key":"pcbi.1014459.ref032","first-page":"64","volume-title":"Classical conditioning II: current research and theory","author":"RA Rescorla","year":"1972"},{"issue":"5","key":"pcbi.1014459.ref033","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.1162\/NECO_a_00270","article-title":"Reinforcement-based decision making in corticostriatal circuits: mutual constraints by neurocomputational and diffusion models","volume":"24","author":"R Ratcliff","year":"2012","journal-title":"Neural Comput"},{"key":"pcbi.1014459.ref034","doi-asserted-by":"crossref","first-page":"12438","DOI":"10.1038\/ncomms12438","article-title":"Gaze data reveal distinct choice processes underlying model-based and model-free reinforcement learning","volume":"7","author":"A Konovalov","year":"2016","journal-title":"Nat Commun"},{"issue":"4","key":"pcbi.1014459.ref035","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.3758\/s13423-018-1554-2","article-title":"A reinforcement learning diffusion decision model for value-based decisions","volume":"26","author":"L Fontanesi","year":"2019","journal-title":"Psychon Bull Rev"},{"issue":"4","key":"pcbi.1014459.ref036","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1007\/s42113-020-00084-w","article-title":"Simultaneous Hierarchical Bayesian Parameter Estimation for Reinforcement Learning and Drift Diffusion Models: a Tutorial and Links to Neural Data","volume":"3","author":"ML Pedersen","year":"2020","journal-title":"Comput Brain Behav"},{"issue":"6","key":"pcbi.1014459.ref037","article-title":"High-value decisions are fast and accurate, inconsistent with diminishing value sensitivity","volume":"119","author":"BRK Shevlin","year":"2022","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"3","key":"pcbi.1014459.ref038","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1038\/nn.3017","article-title":"Mechanisms underlying cortical activity during value-guided choice","volume":"15","author":"LT Hunt","year":"2012","journal-title":"Nat Neurosci"},{"issue":"2","key":"pcbi.1014459.ref039","first-page":"129","article-title":"Evidence for the speed-value trade-off: human and monkey decision making is magnitude sensitive","volume":"5","author":"A Pirrone","year":"2018","journal-title":"Decision (Wash D C)"},{"issue":"1","key":"pcbi.1014459.ref040","doi-asserted-by":"crossref","first-page":"1958","DOI":"10.1038\/s41598-019-38927-7","article-title":"Dissociable components of the reward circuit are involved in appraisal versus choice","volume":"9","author":"A Shenhav","year":"2019","journal-title":"Sci Rep"},{"issue":"6","key":"pcbi.1014459.ref041","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1017\/S1930297500008512","article-title":"Webcam-based online eye-tracking for behavioral research","volume":"16","author":"X Yang","year":"2021","journal-title":"Judgm decis mak"},{"issue":"3","key":"pcbi.1014459.ref042","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1037\/0033-295X.100.3.432","article-title":"Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment","volume":"100","author":"JR Busemeyer","year":"1993","journal-title":"Psychol Rev"},{"issue":"3","key":"pcbi.1014459.ref043","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1006\/jmps.1997.1167","article-title":"Dynamic Stochastic Models for Decision Making under Time Constraints","volume":"41","author":"A Diederich","year":"1997","journal-title":"J Math Psychol"},{"issue":"2","key":"pcbi.1014459.ref044","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1037\/0033-295X.108.2.370","article-title":"Multialternative decision field theory: a dynamic connectionist model of decision making","volume":"108","author":"RM Roe","year":"2001","journal-title":"Psychol Rev"},{"issue":"4","key":"pcbi.1014459.ref045","doi-asserted-by":"crossref","DOI":"10.1017\/S1930297500006082","article-title":"Revealed strength of preference: inference from response times","volume":"14","author":"A Konovalov","year":"2019","journal-title":"Judgment and decision making"},{"issue":"4","key":"pcbi.1014459.ref046","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","article-title":"The diffusion decision model: theory and data for two-choice decision tasks","volume":"20","author":"R Ratcliff","year":"2008","journal-title":"Neural Comput"},{"issue":"3","key":"pcbi.1014459.ref047","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1016\/j.neuron.2014.03.014","article-title":"Neural oscillations and synchronization differentially support evidence accumulation in perceptual and value-based decision making","volume":"82","author":"R Polan\u00eda","year":"2014","journal-title":"Neuron"},{"issue":"4","key":"pcbi.1014459.ref048","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.1037\/a0035813","article-title":"Eye tracking and pupillometry are indicators of dissociable latent decision processes","volume":"143","author":"JF Cavanagh","year":"2014","journal-title":"J Exp Psychol Gen"},{"key":"pcbi.1014459.ref049","doi-asserted-by":"crossref","unstructured":"Papoutsaki A. Scalable Webcam Eye Tracking by Learning from User Interactions. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, 2015. 219\u201322. https:\/\/doi.org\/10.1145\/2702613.2702627","DOI":"10.1145\/2702613.2702627"},{"issue":"2","key":"pcbi.1014459.ref050","doi-asserted-by":"crossref","first-page":"451","DOI":"10.3758\/s13428-017-0913-7","article-title":"Online webcam-based eye tracking in cognitive science: A first look","volume":"50","author":"K Semmelmann","year":"2018","journal-title":"Behav Res Methods"},{"issue":"3","key":"pcbi.1014459.ref051","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1257\/jep.5.3.137","article-title":"Melioration: A Theory of Distributed Choice","volume":"5","author":"RJ Herrnstein","year":"1991","journal-title":"The Journal of Economic Perspectives"},{"issue":"4","key":"pcbi.1014459.ref052","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/j.1467-9280.1990.tb00203.x","article-title":"Behavior, Reinforcement and Utility","volume":"1","author":"RJ Herrnstein","year":"1990","journal-title":"Psychol Sci"},{"key":"pcbi.1014459.ref053","first-page":"360","article-title":"Experiments on stable sub-optimality in individual behavior","author":"RJ Herrnstein","year":"1991","journal-title":"American Economic Review"},{"issue":"3","key":"pcbi.1014459.ref054","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1901\/jeab.1986.46-331","article-title":"More on concurrent interval-ratio schedules: a replication and review","volume":"46","author":"GM Heyman","year":"1986","journal-title":"J Exp Anal Behav"},{"issue":"2","key":"pcbi.1014459.ref055","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1901\/jeab.1981.36-141","article-title":"Melioration, matching, and maximization","volume":"36","author":"W Vaughan","year":"1981","journal-title":"Journal of the Experimental Analysis of Behavior"},{"issue":"3","key":"pcbi.1014459.ref056","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1002\/bdm.3960060302","article-title":"Utility maximization and melioration: Internalities in individual choice","volume":"6","author":"RJ Herrnstein","year":"1993","journal-title":"Behavioral Decision Making"},{"key":"pcbi.1014459.ref057","volume-title":"The Matching Law: Papers in Psychology and Economics","author":"RJ. Herrnstein","year":"1997"},{"key":"pcbi.1014459.ref058","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199679355.003.0007","article-title":"Consuming at the Wrong Rate: Lessons from the Harvard Game","volume-title":"Sustainable Consumption: Multi-disciplinary Perspectives In Honour of Professor Sir Partha Dasgupta","author":"D Prelec","year":"2014"},{"issue":"3","key":"pcbi.1014459.ref059","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.cognition.2009.03.013","article-title":"Short-term gains, long-term pains: how cues about state aid learning in dynamic environments","volume":"113","author":"TM Gureckis","year":"2009","journal-title":"Cognition"},{"key":"pcbi.1014459.ref060","article-title":"Melioration dominates maximization: stable suboptimal performance despite global feedback","volume":"6","author":"H Neth","year":"2023","journal-title":"N\/A"},{"issue":"4","key":"pcbi.1014459.ref061","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1002\/bdm.415","article-title":"A re\u2010examination of melioration and rational choice","volume":"15","author":"RJ Tunney","year":"2002","journal-title":"Behavioral Decision Making"},{"issue":"10","key":"pcbi.1014459.ref062","doi-asserted-by":"crossref","first-page":"6038","DOI":"10.1093\/cercor\/bhac482","article-title":"Distinct neural activations correlate with maximization of reward magnitude versus frequency","volume":"33","author":"PP Balasubramani","year":"2022","journal-title":"Cerebral Cortex"},{"issue":"1","key":"pcbi.1014459.ref063","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1037\/a0030850","article-title":"Melioration as rational choice: sequential decision making in uncertain environments","volume":"120","author":"CR Sims","year":"2013","journal-title":"Psychol Rev"},{"issue":"8","key":"pcbi.1014459.ref064","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1038\/nn.2159","article-title":"The temporal precision of reward prediction in dopamine neurons","volume":"11","author":"CD Fiorillo","year":"2008","journal-title":"Nat Neurosci"},{"issue":"31","key":"pcbi.1014459.ref065","doi-asserted-by":"crossref","first-page":"7837","DOI":"10.1523\/JNEUROSCI.1600-08.2008","article-title":"Influence of reward delays on responses of dopamine neurons","volume":"28","author":"S Kobayashi","year":"2008","journal-title":"J Neurosci"},{"issue":"4","key":"pcbi.1014459.ref066","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1016\/j.nlm.2011.08.006","article-title":"The role of the basal ganglia in learning and memory: insight from Parkinson\u2019s disease","volume":"96","author":"K Foerde","year":"2011","journal-title":"Neurobiol Learn Mem"},{"issue":"39","key":"pcbi.1014459.ref067","doi-asserted-by":"crossref","first-page":"8453","DOI":"10.1523\/JNEUROSCI.0769-18.2018","article-title":"Feedback-based learning in aging: contributions and trajectories of change in striatal and hippocampal systems","volume":"38","author":"NR Lighthall","year":"2018","journal-title":"J Neurosci"},{"key":"pcbi.1014459.ref068","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.46080","article-title":"The hippocampus supports deliberation during value-based decisions","volume":"8","author":"A Bakkour","year":"2019","journal-title":"eLife"},{"key":"pcbi.1014459.ref069","first-page":"167","article-title":"Systems of category learning: Fact or fantasy?","volume-title":"The psychology of learning and motivation: Advances in research and theory","author":"BR Newell","year":"2011"},{"issue":"1","key":"pcbi.1014459.ref070","doi-asserted-by":"crossref","first-page":"5826","DOI":"10.1038\/s41467-019-13737-7","article-title":"Controllability governs the balance between Pavlovian and instrumental action selection","volume":"10","author":"HM Dorfman","year":"2019","journal-title":"Nat Commun"},{"key":"pcbi.1014459.ref071","doi-asserted-by":"crossref","DOI":"10.3386\/w23254","author":"X Gabaix","year":"2017","journal-title":"Myopia and discounting. Working Paper Series"},{"issue":"3","key":"pcbi.1014459.ref072","doi-asserted-by":"crossref","first-page":"1507","DOI":"10.1152\/jn.90730.2008","article-title":"Short-term temporal discounting of reward value in human ventral striatum","volume":"101","author":"L Gregorios-Pippas","year":"2009","journal-title":"J Neurophysiol"},{"issue":"1","key":"pcbi.1014459.ref073","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1016\/j.actpsy.2013.06.003","article-title":"Attention and choice: a review on eye movements in decision making","volume":"144","author":"JL Orquin","year":"2013","journal-title":"Acta Psychol (Amst)"},{"key":"pcbi.1014459.ref074","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.jbef.2015.12.001","article-title":"oTree\u2014An open-source platform for laboratory, online, and field experiments","volume":"9","author":"DL Chen","year":"2016","journal-title":"Journal of Behavioral and Experimental Finance"},{"issue":"1","key":"pcbi.1014459.ref075","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3758\/s13428-014-0458-y","article-title":"jsPsych: a JavaScript library for creating behavioral experiments in a Web browser","volume":"47","author":"JR de Leeuw","year":"2015","journal-title":"Behav Res Methods"},{"issue":"4","key":"pcbi.1014459.ref076","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1037\/h0043688","article-title":"Age differences in short-term retention of rapidly changing information","volume":"55","author":"WK Kirchner","year":"1958","journal-title":"J Exp Psychol"},{"issue":"2","key":"pcbi.1014459.ref077","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1037\/xlm0000732","article-title":"The forgotten history of signal detection theory","volume":"46","author":"JT Wixted","year":"2020","journal-title":"J Exp Psychol Learn Mem Cogn"},{"issue":"1","key":"pcbi.1014459.ref078","doi-asserted-by":"crossref","first-page":"46","DOI":"10.3758\/BF03203619","article-title":"Corrections for extreme proportions and their biasing effects on estimated values of d\u2032","volume":"27","author":"MJ Hautus","year":"1995","journal-title":"Behavior Research Methods, Instruments & Computers"},{"issue":"1","key":"pcbi.1014459.ref079","doi-asserted-by":"crossref","first-page":"137","DOI":"10.3758\/BF03207704","article-title":"Calculation of signal detection theory measures","volume":"31","author":"H Stanislaw","year":"1999","journal-title":"Behav Res Methods Instrum Comput"},{"issue":"4","key":"pcbi.1014459.ref080","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.tics.2016.01.007","article-title":"Diffusion Decision Model: Current Issues and History","volume":"20","author":"R Ratcliff","year":"2016","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1014459.ref081","first-page":"3571","article-title":"Asymptotic equivalence of Bayes cross validation and widely applicable information criterion in singular learning theory","volume":"11","author":"S Watanabe","year":"2010","journal-title":"J Mach Learn Res"},{"key":"pcbi.1014459.ref082","doi-asserted-by":"crossref","DOI":"10.1201\/b16018","volume-title":"Bayesian Data Analysis, Third Edition","author":"A Gelman","year":"2013"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1014459","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T00:00:00Z","timestamp":1783555200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014459","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T17:54:48Z","timestamp":1783619688000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014459"}},"subtitle":[],"editor":[{"given":"Lusha","family":"Zhu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,6,29]]},"references-count":82,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6,29]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1014459","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,29]]}}}