{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T19:01:05Z","timestamp":1774638065865,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1014093","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T00:00:00Z","timestamp":1774569600000}}],"reference-count":103,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T00:00:00Z","timestamp":1773964800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/Y034724\/1"],"award-info":[{"award-number":["EP\/Y034724\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009187","name":"Medical Research Foundation","doi-asserted-by":"publisher","award":["MR\/W02005X\/1"],"award-info":[{"award-number":["MR\/W02005X\/1"]}],"id":[{"id":"10.13039\/501100009187","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["222292\/Z\/20\/Z"],"award-info":[{"award-number":["222292\/Z\/20\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>The ability to use context to flexibly adjust our decision-making is vital for navigating a complex world. To do this, the brain must both use environmental features and behavioural outcomes to distinguish between different, often hidden contexts; and also learn how to use these inferred contexts to guide behaviour. However, how these two interacting processes can be performed simultaneously remains unclear. Within the brain it is thought that interaction between the prefrontal cortex (PFC) and hippocampus (HPC) supports contextual inference. We show that models using environmental features (similar to those proposed to be implemented in hippocampus) readily support context-specific behaviour, but struggle to differentiate ambiguous contexts during learning. In contrast, models using behavioural outcomes (similar to those proposed in PFC) can stably differentiate contexts during periods of learning, but struggle to guide context-specific behaviour. We show that supporting feature-based with outcome-based strategies during learning overcomes the limitations of both approaches, allowing for the formation of distinct contextual representations that support contextual inference. Moreover, agents using this joint approach reproduce both behavioural- and cellular-level phenomena associated with the interaction between PFC and HPC. Together, these results provide insight into how the brain uses contextual information to guide flexible behaviour.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1014093","type":"journal-article","created":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T17:43:07Z","timestamp":1774028587000},"page":"e1014093","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Contextual inference through flexible integration of environmental features and behavioural outcomes"],"prefix":"10.1371","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1043-3980","authenticated-orcid":true,"given":"Jessica","family":"Passlack","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0196-3779","authenticated-orcid":true,"given":"Andrew F.","family":"MacAskill","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2026,3,20]]},"reference":[{"key":"pcbi.1014093.ref001","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.51140","article-title":"Hippocampal remapping as hidden state inference","volume":"9","author":"H Sanders","year":"2020","journal-title":"Elife"},{"issue":"8","key":"pcbi.1014093.ref002","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1038\/nrn.2016.56","article-title":"Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex","volume":"17","author":"AM Wikenheiser","year":"2016","journal-title":"Nat Rev Neurosci"},{"issue":"3","key":"pcbi.1014093.ref003","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.tics.2020.12.007","article-title":"The Continuity of Context: A Role for the Hippocampus","volume":"25","author":"AP Maurer","year":"2021","journal-title":"Trends Cogn Sci"},{"issue":"2","key":"pcbi.1014093.ref004","doi-asserted-by":"crossref","first-page":"557","DOI":"10.3758\/s13423-016-1110-x","article-title":"Context-dependent learning and causal structure","volume":"24","author":"SJ Gershman","year":"2017","journal-title":"Psychon Bull Rev"},{"issue":"6","key":"pcbi.1014093.ref005","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1038\/nrn3492","article-title":"The contextual brain: implications for fear conditioning, extinction and psychopathology","volume":"14","author":"S Maren","year":"2013","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1014093.ref006","article-title":"Zero-shot reinforcement learning under partial observability","author":"S Jeen","year":"2025","journal-title":"Reinforcement Learning Journal"},{"key":"pcbi.1014093.ref007","unstructured":"Heess N, Hunt JJ, Lillicrap TP, Silver D. Memory-based control with recurrent neural networks. arXiv. 2015. arXiv:1512.04455"},{"key":"pcbi.1014093.ref008","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.artint.2018.01.002","article-title":"Autonomous agents modelling other agents: A comprehensive survey and open problems","volume":"258","author":"SV Albrecht","year":"2018","journal-title":"Artificial Intelligence"},{"key":"pcbi.1014093.ref009","doi-asserted-by":"crossref","unstructured":"Schaeffer R, Khona M, Meshulam L, Fiete IR. Reverse-engineering Recurrent Neural Network solutions to a hierarchical inference task for mice. bioRxiv. 2020. https:\/\/doi.org\/10.1101\/2020.06.09.142745","DOI":"10.1101\/2020.06.09.142745"},{"issue":"1","key":"pcbi.1014093.ref010","doi-asserted-by":"crossref","first-page":"9619","DOI":"10.1038\/s41467-025-64591-9","article-title":"Hippocampus supports multi-task reinforcement learning under partial observability","volume":"16","author":"D Pedamonti","year":"2025","journal-title":"Nat Commun"},{"issue":"4","key":"pcbi.1014093.ref011","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1037\/0735-7044.112.4.863","article-title":"The dorsal hippocampus is essential for context discrimination but not for contextual conditioning","volume":"112","author":"PW Frankland","year":"1998","journal-title":"Behav Neurosci"},{"key":"pcbi.1014093.ref012","first-page":"66","article-title":"The hippocampus is required for visually cued contextual response selection, but not for visual discrimination of contexts","volume":"6","author":"S Kim","year":"2012","journal-title":"Front Behav Neurosci"},{"key":"pcbi.1014093.ref013","article-title":"Reinforcement Learning with Long Short-Term Memory","volume":"14","author":"B Bakker","year":"2001","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"1","key":"pcbi.1014093.ref014","doi-asserted-by":"crossref","DOI":"10.1016\/j.neuron.2021.10.003","article-title":"Rapid synaptic plasticity contributes to a learned conjunctive code of position and choice-related information in the hippocampus","volume":"110","author":"X Zhao","year":"2022","journal-title":"Neuron"},{"issue":"6208","key":"pcbi.1014093.ref015","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1126\/science.1256573","article-title":"Medial prefrontal activity during delay period contributes to learning of a working memory task","volume":"346","author":"D Liu","year":"2014","journal-title":"Science"},{"issue":"9","key":"pcbi.1014093.ref016","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1002\/hipo.20323","article-title":"Structural learning and the hippocampus","volume":"17","author":"JP Aggleton","year":"2007","journal-title":"Hippocampus"},{"issue":"9","key":"pcbi.1014093.ref017","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1038\/nrn.2017.74","article-title":"Prefrontal-hippocampal interactions in episodic memory","volume":"18","author":"H Eichenbaum","year":"2017","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1014093.ref018","doi-asserted-by":"crossref","unstructured":"Okazawa G, Kiani R. Neural mechanisms that make perceptual decisions flexible. Annual Review of Physiology. 2023. https:\/\/doi.org\/10.1146\/annurev-physiol-031722","DOI":"10.1146\/annurev-physiol-031722-024731"},{"issue":"7889","key":"pcbi.1014093.ref019","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1038\/s41586-021-04129-3","article-title":"Contextual inference underlies the learning of sensorimotor repertoires","volume":"600","author":"JB Heald","year":"2021","journal-title":"Nature"},{"issue":"3","key":"pcbi.1014093.ref020","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.tins.2022.12.006","article-title":"Continual task learning in natural and artificial agents","volume":"46","author":"T Flesch","year":"2023","journal-title":"Trends Neurosci"},{"issue":"9","key":"pcbi.1014093.ref021","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1011067","article-title":"Emergence of belief-like representations through reinforcement learning","volume":"19","author":"JA Hennig","year":"2023","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1014093.ref022","article-title":"Reward-based training of recurrent neural networks for cognitive and value-based tasks","volume":"6","author":"HF Song","year":"2017","journal-title":"Elife"},{"key":"pcbi.1014093.ref023","doi-asserted-by":"crossref","first-page":"012309","DOI":"10.1103\/PhysRevE.95.012309","article-title":"Effect of similarity between patterns in associative memory","volume":"95","author":"S-J Wang","year":"2017","journal-title":"Phys Rev E"},{"issue":"2","key":"pcbi.1014093.ref024","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1037\/rev0000414","article-title":"A probabilistic successor representation for context-dependent learning","volume":"131","author":"JP Geerts","year":"2024","journal-title":"Psychol Rev"},{"issue":"3","key":"pcbi.1014093.ref025","doi-asserted-by":"crossref","first-page":"255","DOI":"10.3758\/s13420-012-0080-8","article-title":"Exploring a latent cause theory of classical conditioning","volume":"40","author":"SJ Gershman","year":"2012","journal-title":"Learn Behav"},{"key":"pcbi.1014093.ref026","unstructured":"Guntupalli JS, Raju RV, Kushagra S, Wendelken C, Sawyer D, Deshpande I. Graph schemas as abstractions for transfer learning, inference, and planning. ArXiv. 2023. http:\/\/arxiv.org\/abs\/2302.07350"},{"issue":"2","key":"pcbi.1014093.ref027","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1038\/s41593-023-01514-1","article-title":"Inferring neural activity before plasticity as a foundation for learning beyond backpropagation","volume":"27","author":"Y Song","year":"2024","journal-title":"Nat Neurosci"},{"issue":"10","key":"pcbi.1014093.ref028","doi-asserted-by":"crossref","first-page":"7967","DOI":"10.1007\/s10994-024-06559-2","article-title":"POMDP inference and robust solution via deep reinforcement learning: an application to railway optimal maintenance","volume":"113","author":"G Arcieri","year":"2024","journal-title":"Mach Learn"},{"key":"pcbi.1014093.ref029","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1016\/j.neunet.2023.07.023","article-title":"Warming up recurrent neural networks to maximise reachable multistability greatly improves learning","volume":"166","author":"G Lambrechts","year":"2023","journal-title":"Neural Netw"},{"key":"pcbi.1014093.ref030","unstructured":"Hess F, Monfared Z, Brenner M, Durstewitz D. Generalized Teacher Forcing for Learning Chaotic Dynamics. In: Proceedings of the 40th International Conference on Machine Learning, 2023. 13017\u201349."},{"issue":"1","key":"pcbi.1014093.ref031","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1038\/s41467-022-35658-8","article-title":"Cerebro-cerebellar networks facilitate learning through feedback decoupling","volume":"14","author":"E Boven","year":"2023","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1014093.ref032","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1010808","article-title":"Modelling continual learning in humans with Hebbian context gating and exponentially decaying task signals","volume":"19","author":"T Flesch","year":"2023","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pcbi.1014093.ref033","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1038\/s41467-024-44871-6","article-title":"Latent representations in hippocampal network model co-evolve with behavioral exploration of task structure","volume":"15","author":"I Cone","year":"2024","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1014093.ref034","doi-asserted-by":"crossref","first-page":"16782","DOI":"10.1038\/s41598-024-64272-5","article-title":"Reconciling shared versus context-specific information in a neural network model of latent causes","volume":"14","author":"Q Lu","year":"2024","journal-title":"Sci Rep"},{"issue":"7554","key":"pcbi.1014093.ref035","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1038\/nature14396","article-title":"A prefrontal-thalamo-hippocampal circuit for goal-directed spatial navigation","volume":"522","author":"HT Ito","year":"2015","journal-title":"Nature"},{"issue":"8","key":"pcbi.1014093.ref036","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0023538","article-title":"Role of reuniens nucleus projections to the medial prefrontal cortex and to the hippocampal pyramidal CA1 area in associative learning","volume":"6","author":"L Eleore","year":"2011","journal-title":"PLoS One"},{"issue":"6125","key":"pcbi.1014093.ref037","doi-asserted-by":"crossref","first-page":"1290","DOI":"10.1126\/science.1229534","article-title":"A neural circuit for memory specificity and generalization","volume":"339","author":"W Xu","year":"2013","journal-title":"Science"},{"issue":"7647","key":"pcbi.1014093.ref038","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1038\/nature21692","article-title":"Mapping of a non-spatial dimension by the hippocampal-entorhinal circuit","volume":"543","author":"D Aronov","year":"2017","journal-title":"Nature"},{"issue":"2","key":"pcbi.1014093.ref039","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1016\/j.neuron.2018.10.002","article-title":"What Is a Cognitive Map? Organizing Knowledge for Flexible Behavior","volume":"100","author":"TEJ Behrens","year":"2018","journal-title":"Neuron"},{"issue":"11","key":"pcbi.1014093.ref040","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1038\/nrn3827","article-title":"Time cells in the hippocampus: a new dimension for mapping memories","volume":"15","author":"H Eichenbaum","year":"2014","journal-title":"Nat Rev Neurosci"},{"issue":"1","key":"pcbi.1014093.ref041","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/0014-4886(76)90055-8","article-title":"Place units in the hippocampus of the freely moving rat","volume":"51","author":"J O\u2019Keefe","year":"1976","journal-title":"Exp Neurol"},{"issue":"6720","key":"pcbi.1014093.ref042","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1038\/17605","article-title":"The global record of memory in hippocampal neuronal activity","volume":"397","author":"ER Wood","year":"1999","journal-title":"Nature"},{"key":"pcbi.1014093.ref043","article-title":"Remapping in a recurrent neural network model of navigation and context inference","volume":"12","author":"IIC Low","year":"2023","journal-title":"Elife"},{"issue":"11","key":"pcbi.1014093.ref044","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.1038\/nn.4650","article-title":"The hippocampus as a predictive map","volume":"20","author":"KL Stachenfeld","year":"2017","journal-title":"Nat Neurosci"},{"key":"pcbi.1014093.ref045","doi-asserted-by":"crossref","first-page":"1044659","DOI":"10.3389\/fncom.2022.1044659","article-title":"Artificial intelligence insights into hippocampal processing","volume":"16","author":"HS Wirtshafter","year":"2022","journal-title":"Front Comput Neurosci"},{"issue":"1","key":"pcbi.1014093.ref046","doi-asserted-by":"crossref","DOI":"10.1016\/j.neuron.2017.03.011","article-title":"Medial Prefrontal Cortex Reduces Memory Interference by Modifying Hippocampal Encoding","volume":"94","author":"KG Guise","year":"2017","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1014093.ref047","doi-asserted-by":"crossref","first-page":"1942","DOI":"10.1038\/s41467-017-02169-w","article-title":"Simultaneous representation of a spectrum of dynamically changing value estimates during decision making","volume":"8","author":"D Meder","year":"2017","journal-title":"Nat Commun"},{"issue":"10","key":"pcbi.1014093.ref048","doi-asserted-by":"crossref","DOI":"10.1016\/j.cell.2021.03.047","article-title":"Prefrontal deep projection neurons enable cognitive flexibility via persistent feedback monitoring","volume":"184","author":"T Spellman","year":"2021","journal-title":"Cell"},{"issue":"6","key":"pcbi.1014093.ref049","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1038\/s41593-018-0147-8","article-title":"Prefrontal cortex as a meta-reinforcement learning system","volume":"21","author":"JX Wang","year":"2018","journal-title":"Nat Neurosci"},{"key":"pcbi.1014093.ref050","unstructured":"Barreto A, Dabney W, Munos R, Hunt JJ, Schaul T, Van Hasselt H, et al. Successor features for transfer in reinforcement learning. 31st Conference on Neural Information Processing Systems. 2018."},{"key":"pcbi.1014093.ref051","first-page":"1","article-title":"Inferred successor maps for better transfer learning","volume":"33","author":"TJ Madarasz","year":"2019","journal-title":"NeurIPS"},{"key":"pcbi.1014093.ref052","doi-asserted-by":"crossref","unstructured":"Allen C, Kirtland A, Tao RY, Lobel S, Scott D, Petrocelli N. Mitigating Partial Observability in Sequential Decision Processes via the Lambda Discrepancy. In: 2024. http:\/\/arxiv.org\/abs\/2407.07333","DOI":"10.52202\/079017-2011"},{"issue":"6","key":"pcbi.1014093.ref053","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1037\/a0034653","article-title":"Transient inactivation of the thalamic nucleus reuniens and rhomboid nucleus produces deficits of a working-memory dependent tactile-visual conditional discrimination task","volume":"127","author":"HL Hallock","year":"2013","journal-title":"Behav Neurosci"},{"issue":"7392","key":"pcbi.1014093.ref054","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1038\/nature10918","article-title":"Choice-specific sequences in parietal cortex during a virtual-navigation decision task","volume":"484","author":"CD Harvey","year":"2012","journal-title":"Nature"},{"issue":"1","key":"pcbi.1014093.ref055","doi-asserted-by":"crossref","first-page":"15512","DOI":"10.1038\/s41598-019-52017-8","article-title":"Dynamically changing neuronal activity supporting working memory for predictable and unpredictable durations","volume":"9","author":"JC Park","year":"2019","journal-title":"Sci Rep"},{"issue":"1","key":"pcbi.1014093.ref056","doi-asserted-by":"crossref","first-page":"4352","DOI":"10.1038\/s41467-021-24565-z","article-title":"Parallel processing of working memory and temporal information by distinct types of cortical projection neurons","volume":"12","author":"JW Bae","year":"2021","journal-title":"Nat Commun"},{"issue":"17","key":"pcbi.1014093.ref057","doi-asserted-by":"crossref","first-page":"3120","DOI":"10.1523\/JNEUROSCI.1636-22.2023","article-title":"Effects of Stimulus Timing on the Acquisition of an Olfactory Working Memory Task in Head-Fixed Mice","volume":"43","author":"J Reuschenbach","year":"2023","journal-title":"J Neurosci"},{"key":"pcbi.1014093.ref058","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.43191","article-title":"Active information maintenance in working memory by a sensory cortex","volume":"8","author":"X Zhang","year":"2019","journal-title":"Elife"},{"issue":"4","key":"pcbi.1014093.ref059","article-title":"Context coding in the mouse nucleus accumbens modulates motivationally relevant information","volume":"20","author":"JM Gmaz","year":"2022","journal-title":"PLoS Biol"},{"key":"pcbi.1014093.ref060","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.nlm.2012.12.009","article-title":"Dissociable roles of the dorsal striatum and dorsal hippocampus in conditional discrimination and spatial alternation T-maze tasks","volume":"100","author":"HL Hallock","year":"2013","journal-title":"Neurobiol Learn Mem"},{"key":"pcbi.1014093.ref061","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.76051","article-title":"Cognitive experience alters cortical involvement in goal-directed navigation","volume":"11","author":"C Arlt","year":"2022","journal-title":"Elife"},{"issue":"44","key":"pcbi.1014093.ref062","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.1800755115","article-title":"Comparing continual task learning in minds and machines","volume":"115","author":"T Flesch","year":"2018","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"3","key":"pcbi.1014093.ref063","doi-asserted-by":"crossref","first-page":"481","DOI":"10.3758\/s13421-013-0371-0","article-title":"Putting category learning in order: Category structure and temporal arrangement affect the benefit of interleaved over blocked study","volume":"42","author":"PF Carvalho","year":"2014","journal-title":"Mem Cognit"},{"key":"pcbi.1014093.ref064","doi-asserted-by":"crossref","first-page":"505","DOI":"10.3389\/fpsyg.2015.00505","article-title":"What you learn is more than what you see: what can sequencing effects tell us about inductive category learning?","volume":"6","author":"PF Carvalho","year":"2015","journal-title":"Front Psychol"},{"issue":"7865","key":"pcbi.1014093.ref065","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1038\/s41586-021-03652-7","article-title":"Geometry of abstract learned knowledge in the hippocampus","volume":"595","author":"EH Nieh","year":"2021","journal-title":"Nature"},{"key":"pcbi.1014093.ref066","doi-asserted-by":"crossref","first-page":"36","DOI":"10.3389\/fnbeh.2018.00036","article-title":"An Accumulation-of-Evidence Task Using Visual Pulses for Mice Navigating in Virtual Reality","volume":"12","author":"L Pinto","year":"2018","journal-title":"Front Behav Neurosci"},{"issue":"3","key":"pcbi.1014093.ref067","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1038\/s41593-022-01021-9","article-title":"Opponent control of behavior by dorsomedial striatal pathways depends on task demands and internal state","volume":"25","author":"SS Bolkan","year":"2022","journal-title":"Nat Neurosci"},{"issue":"1","key":"pcbi.1014093.ref068","doi-asserted-by":"crossref","first-page":"4942","DOI":"10.1038\/s41467-021-25123-3","article-title":"Linear reinforcement learning in planning, grid fields, and cognitive control","volume":"12","author":"P Piray","year":"2021","journal-title":"Nat Commun"},{"issue":"4","key":"pcbi.1014093.ref069","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1037\/h0061626","article-title":"Cognitive maps in rats and men","volume":"55","author":"EC Tolman","year":"1948","journal-title":"Psychol Rev"},{"issue":"9","key":"pcbi.1014093.ref070","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1005768","article-title":"Predictive representations can link model-based reinforcement learning to model-free mechanisms","volume":"13","author":"EM Russek","year":"2017","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1014093.ref071","unstructured":"Raju RV, Guntupalli JS, Zhou G, L\u00e1zaro-Gredilla M, George D. Space is a latent sequence: Structured sequence learning as a unified theory of representation in the hippocampus. arXiv. 2022. http:\/\/arxiv.org\/abs\/2212.01508"},{"key":"pcbi.1014093.ref072","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.78904","article-title":"Successor-like representation guides the prediction of future events in human visual cortex and hippocampus","volume":"12","author":"M Ekman","year":"2023","journal-title":"Elife"},{"key":"pcbi.1014093.ref073","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.82357","article-title":"Temporal context and latent state inference in the hippocampal splitter signal","volume":"12","author":"\u00c9 Duvelle","year":"2023","journal-title":"Elife"},{"issue":"3","key":"pcbi.1014093.ref074","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1016\/S0896-6273(00)00071-4","article-title":"Hippocampal neurons encode information about different types of memory episodes occurring in the same location","volume":"27","author":"ER Wood","year":"2000","journal-title":"Neuron"},{"key":"pcbi.1014093.ref075","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.15986","article-title":"Place cells on a maze encode routes rather than destinations","volume":"5","author":"RM Grieves","year":"2016","journal-title":"Elife"},{"issue":"6724","key":"pcbi.1014093.ref076","doi-asserted-by":"crossref","first-page":"926","DOI":"10.1126\/science.adq5874","article-title":"Hidden state inference requires abstract contextual representations in the ventral hippocampus","volume":"386","author":"K Mishchanchuk","year":"2024","journal-title":"Science"},{"issue":"3","key":"pcbi.1014093.ref077","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/S0166-4328(89)80118-4","article-title":"Responses of hippocampal formation neurons in the monkey related to delayed spatial response and object-place memory tasks","volume":"33","author":"PM Cahusac","year":"1989","journal-title":"Behav Brain Res"},{"issue":"1","key":"pcbi.1014093.ref078","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1523\/JNEUROSCI.16-01-00354.1996","article-title":"Hippocampal ensemble activity during spatial delayed-nonmatch-to-sample performance in rats","volume":"16","author":"SA Deadwyler","year":"1996","journal-title":"J Neurosci"},{"issue":"3","key":"pcbi.1014093.ref079","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1002\/hipo.450020310","article-title":"Neuronal activity in the hippocampus during delayed non-match to sample performance in rats: evidence for hippocampal processing in recognition memory","volume":"2","author":"T Otto","year":"1992","journal-title":"Hippocampus"},{"issue":"5","key":"pcbi.1014093.ref080","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1037\/0735-7044.106.5.762","article-title":"Complementary roles of the orbital prefrontal cortex and the perirhinal-entorhinal cortices in an odor-guided delayed-nonmatching-to-sample task","volume":"106","author":"T Otto","year":"1992","journal-title":"Behav Neurosci"},{"issue":"2","key":"pcbi.1014093.ref081","doi-asserted-by":"crossref","first-page":"129","DOI":"10.3758\/BF03337828","article-title":"Configural association theory: The role of the hippocampal formation in learning, memory, and amnesia","volume":"17","author":"RJ Sutherland","year":"1989","journal-title":"Psychobiology"},{"issue":"4","key":"pcbi.1014093.ref082","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1037\/0735-7044.105.4.499","article-title":"Conditioning and contextual retrieval in hippocampal rats","volume":"105","author":"M Good","year":"1991","journal-title":"Behav Neurosci"},{"issue":"6","key":"pcbi.1014093.ref083","doi-asserted-by":"crossref","first-page":"1781","DOI":"10.1111\/j.1460-9568.2006.05035.x","article-title":"The importance of the rat hippocampus for learning the structure of visual arrays","volume":"24","author":"DJ Sanderson","year":"2006","journal-title":"Eur J Neurosci"},{"issue":"11","key":"pcbi.1014093.ref084","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1101\/lm.052134.120","article-title":"Using rat operant delayed match-to-sample task to identify neural substrates recruited with increased working memory load","volume":"27","author":"C Gobin","year":"2020","journal-title":"Learn Mem"},{"issue":"2","key":"pcbi.1014093.ref085","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/j.bbr.2006.03.042","article-title":"Hippocampal lesions impair performance on a conditional delayed matching and non-matching to position task in the rat","volume":"171","author":"HL Sloan","year":"2006","journal-title":"Behav Brain Res"},{"issue":"2","key":"pcbi.1014093.ref086","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1002\/hipo.1035","article-title":"Rats with lesions of the hippocampus are impaired on the delayed nonmatching-to-sample task","volume":"11","author":"RE Clark","year":"2001","journal-title":"Hippocampus"},{"issue":"20","key":"pcbi.1014093.ref087","doi-asserted-by":"crossref","DOI":"10.1016\/j.neuron.2025.07.008","article-title":"Competitive integration of time and reward explains value-sensitive foraging decisions and frontal cortex ramping dynamics","volume":"113","author":"M Bukwich","year":"2025","journal-title":"Neuron"},{"key":"pcbi.1014093.ref088","doi-asserted-by":"crossref","unstructured":"Evans T, Pathak S, Merzic H, Schwarz J, Tanno R, Henaff OJ. Bad Students Make Great Teachers: Active Learning Accelerates Large-Scale Visual Understanding. arXiv. 2024. http:\/\/arxiv.org\/abs\/2312.05328","DOI":"10.1007\/978-3-031-72643-9_16"},{"issue":"7","key":"pcbi.1014093.ref089","doi-asserted-by":"crossref","first-page":"1340","DOI":"10.1038\/s41593-024-01675-7","article-title":"A recurrent network model of planning explains hippocampal replay and human behavior","volume":"27","author":"KT Jensen","year":"2024","journal-title":"Nat Neurosci"},{"issue":"4","key":"pcbi.1014093.ref090","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1016\/j.neuron.2022.12.028","article-title":"Replay and compositional computation","volume":"111","author":"Z Kurth-Nelson","year":"2023","journal-title":"Neuron"},{"issue":"9","key":"pcbi.1014093.ref091","doi-asserted-by":"crossref","first-page":"680","DOI":"10.1038\/s41562-017-0180-8","article-title":"The successor representation in human reinforcement learning","volume":"1","author":"I Momennejad","year":"2017","journal-title":"Nat Hum Behav"},{"issue":"10","key":"pcbi.1014093.ref092","doi-asserted-by":"crossref","first-page":"988","DOI":"10.1002\/hipo.20301","article-title":"Exploring the role of context-dependent hippocampal activity in spatial alternation behavior","volume":"17","author":"JA Ainge","year":"2007","journal-title":"Hippocampus"},{"key":"pcbi.1014093.ref093","doi-asserted-by":"crossref","unstructured":"Geerts JP, Gershman SJ, Burgess N, Stachenfeld KL. A probabilistic successor representation for context-dependent prediction. bioRxiv. 2022. https:\/\/doi.org\/10.1101\/2022.06.03.494671","DOI":"10.1101\/2022.06.03.494671"},{"issue":"10","key":"pcbi.1014093.ref094","doi-asserted-by":"crossref","first-page":"2825","DOI":"10.1111\/j.1460-9568.2003.03035.x","article-title":"Context-specific acquisition of location discrimination by hippocampal place cells","volume":"18","author":"RMA Hayman","year":"2003","journal-title":"Eur J Neurosci"},{"issue":"9","key":"pcbi.1014093.ref095","doi-asserted-by":"crossref","first-page":"1901","DOI":"10.1002\/hipo.22025","article-title":"Dynamics of decision-related activity in hippocampus","volume":"22","author":"J Catanese","year":"2012","journal-title":"Hippocampus"},{"issue":"3","key":"pcbi.1014093.ref096","doi-asserted-by":"crossref","first-page":"1575","DOI":"10.1152\/jn.91106.2008","article-title":"Striatal versus hippocampal representations during win-stay maze performance","volume":"101","author":"JD Berke","year":"2009","journal-title":"J Neurophysiol"},{"key":"pcbi.1014093.ref097","doi-asserted-by":"crossref","unstructured":"Seamans JK, Floresco SB, Phillips AG. Functional differences between the prelimbic and anterior cingulate regions of the rat prefrontal cortex. 1995;6.","DOI":"10.1037\/0735-7044.109.6.1063"},{"issue":"30","key":"pcbi.1014093.ref098","doi-asserted-by":"crossref","first-page":"7817","DOI":"10.1523\/JNEUROSCI.0659-16.2016","article-title":"A Probability Distribution over Latent Causes, in the Orbitofrontal Cortex","volume":"36","author":"SCY Chan","year":"2016","journal-title":"J Neurosci"},{"key":"pcbi.1014093.ref099","doi-asserted-by":"crossref","unstructured":"Miller KJ, Eckstein M, Botvinick MM, Kurth-Nelson Z. Cognitive model discovery via disentangled RNNs. In: 2023.","DOI":"10.1101\/2023.06.23.546250"},{"key":"pcbi.1014093.ref100","doi-asserted-by":"crossref","unstructured":"Eckstein MK, Summerfield C, Daw ND, Miller KJ. Hybrid neural-cognitive models reveal how memory shapes human reward learning. PsyArXiv. 2024. https:\/\/doi.org\/10.31234\/osf.io\/u9ks4","DOI":"10.31234\/osf.io\/u9ks4"},{"issue":"8078","key":"pcbi.1014093.ref101","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1038\/s41586-025-09142-4","article-title":"Discovering cognitive strategies with tiny recurrent neural networks","volume":"644","author":"L Ji-An","year":"2025","journal-title":"Nature"},{"key":"pcbi.1014093.ref102","unstructured":"Klissarov M, Bagaria A, Luo Z, Konidaris G, Precup D, Machado MC. Discovering temporal structure: an overview of hierarchical reinforcement learning. arXiv. 2025. https:\/\/doi.org\/arXiv:2506.14045"},{"key":"pcbi.1014093.ref103","doi-asserted-by":"crossref","unstructured":"Tomar M, Ramesh R, Ravindran B. Successor options: An option discovery framework for reinforcement learning. arXiv. 2019. https:\/\/doi.org\/arXiv:1905.05731","DOI":"10.24963\/ijcai.2019\/458"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1014093","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T00:00:00Z","timestamp":1774569600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014093","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T18:03:19Z","timestamp":1774634599000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014093"}},"subtitle":[],"editor":[{"given":"Alejandro","family":"Tabas","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2026,3,20]]},"references-count":103,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3,20]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1014093","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,20]]}}}