{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,2,26]],"date-time":"2024-02-26T05:27:38Z","timestamp":1708925258686},"reference-count":82,"publisher":"MIT Press - Journals","issue":"8","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Simple probabilistic reinforcement learning is recognized as a striatum-based learning system, but in recent years, has also been associated with hippocampal involvement. This study examined whether such involvement may be attributed to observation-based learning (OL) processes, running in parallel to striatum-based reinforcement learning. A computational model of OL, mirroring classic models of reinforcement-based learning (RL), was constructed and applied to the neuroimaging data set of Palombo, Hayes, Reid, and Verfaellie [2019. Hippocampal contributions to value-based learning: Converging evidence from fMRI and amnesia. Cognitive, Affective &amp; Behavioral Neuroscience, 19(3), 523\u2013536]. Results suggested that OL processes may indeed take place concomitantly to reinforcement learning and involve activation of the hippocampus and central orbitofrontal cortex. However, rather than independent mechanisms running in parallel, the brain correlates of the OL and RL prediction errors indicated collaboration between systems, with direct implication of the hippocampus in computations of the discrepancy between the expected and actual reinforcing values of actions. These findings are consistent with previous accounts of a role for the hippocampus in encoding the strength of observed stimulus\u2013outcome associations, with updating of such associations through striatal reinforcement-based computations. In addition, enhanced negative RL prediction error signaling was found in the anterior insula with greater use of OL over RL processes. This result may suggest an additional mode of collaboration between the OL and RL systems, implicating the error monitoring network.<\/jats:p>","DOI":"10.1162\/jocn_a_01873","type":"journal-article","created":{"date-parts":[[2022,5,23]],"date-time":"2022-05-23T14:10:55Z","timestamp":1653315055000},"page":"1429-1446","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":1,"title":["Hippocampal Contribution to Probabilistic Feedback Learning: Modeling Observation- and Reinforcement-based Processes"],"prefix":"10.1162","volume":"34","author":[{"given":"Virginie M.","family":"Patt","sequence":"first","affiliation":[{"name":"VA Boston Healthcare System, MA"},{"name":"Boston University School of Medicine, MA"}]},{"given":"Daniela J.","family":"Palombo","sequence":"additional","affiliation":[{"name":"University of British Columbia, Vancouver, Canada"}]},{"given":"Michael","family":"Esterman","sequence":"additional","affiliation":[{"name":"VA Boston Healthcare System, MA"},{"name":"Boston University School of Medicine, MA"}]},{"given":"Mieke","family":"Verfaellie","sequence":"additional","affiliation":[{"name":"VA Boston Healthcare System, MA"},{"name":"Boston University School of Medicine, MA"}]}],"member":"281","published-online":{"date-parts":[[2022,7,1]]},"reference":[{"key":"2022063021250976900_bib1","doi-asserted-by":"publisher","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"Akaike","year":"1974","journal-title":"IEEE Transactions on Automatic Control"},{"key":"2022063021250976900_bib2","doi-asserted-by":"publisher","first-page":"2960","DOI":"10.1523\/JNEUROSCI.3730-10.2010","article-title":"Stimulus predictability reduces responses in primary visual cortex","volume":"30","author":"Alink","year":"2010","journal-title":"Journal of Neuroscience"},{"key":"2022063021250976900_bib3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-019-08998-1","article-title":"Hippocampal pattern separation supports reinforcement learning","volume":"10","author":"Ballard","year":"2019","journal-title":"Nature Communications"},{"key":"2022063021250976900_bib4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","author":"Bates","year":"2015","journal-title":"Journal of Statistical Software"},{"key":"2022063021250976900_bib5","doi-asserted-by":"publisher","first-page":"3451","DOI":"10.1038\/s41467-020-17287-1","article-title":"Mnemonic prediction errors bias hippocampal states","volume":"11","author":"Bein","year":"2020","journal-title":"Nature Communications"},{"key":"2022063021250976900_bib6","doi-asserted-by":"publisher","first-page":"1343","DOI":"10.1016\/j.neuron.2016.02.014","article-title":"Two anatomically and computationally distinct learning signals predict changes to stimulus\u2013outcome associations in hippocampus","volume":"89","author":"Boorman","year":"2016","journal-title":"Neuron"},{"key":"2022063021250976900_bib7","doi-asserted-by":"publisher","first-page":"1011","DOI":"10.1111\/j.1460-9568.2011.07920.x","article-title":"Dissociating hippocampal and striatal contributions to sequential prediction learning","volume":"35","author":"Bornstein","year":"2012","journal-title":"European Journal of Neuroscience"},{"key":"2022063021250976900_bib8","doi-asserted-by":"publisher","first-page":"e1003387","DOI":"10.1371\/journal.pcbi.1003387","article-title":"Cortical and hippocampal correlates of deliberation during model-based decisions for rewards in humans","volume":"9","author":"Bornstein","year":"2013","journal-title":"PLoS Computational Biology"},{"key":"2022063021250976900_bib9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/ncomms15958","article-title":"Reminders of past choices bias decisions for reward in humans","volume":"8","author":"Bornstein","year":"2017","journal-title":"Nature Communications"},{"key":"2022063021250976900_bib10","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1146\/annurev.psych.60.110707.163508","article-title":"The role of the hippocampus in prediction and imagination","volume":"61","author":"Buckner","year":"2010","journal-title":"Annual Review of Psychology"},{"key":"2022063021250976900_bib11","doi-asserted-by":"publisher","first-page":"1380","DOI":"10.1002\/hbm.20939","article-title":"A common mechanism for adaptive scaling of reward and novelty","volume":"31","author":"Bunzeck","year":"2010","journal-title":"Human Brain Mapping"},{"key":"2022063021250976900_bib12","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1016\/s0896-6273(02)00830-9","article-title":"The human hippocampus and spatial and episodic memory","volume":"35","author":"Burgess","year":"2002","journal-title":"Neuron"},{"key":"2022063021250976900_bib13","doi-asserted-by":"publisher","first-page":"14431","DOI":"10.1073\/pnas.1003111107","article-title":"Neural mechanisms of observational learning","volume":"107","author":"Burke","year":"2010","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2022063021250976900_bib14","doi-asserted-by":"publisher","first-page":"1716","DOI":"10.1523\/JNEUROSCI.1785-20.2020","article-title":"Signed reward prediction errors in the ventral striatum drive episodic memory","volume":"41","author":"Calderon","year":"2021","journal-title":"Journal of Neuroscience"},{"key":"2022063021250976900_bib15","doi-asserted-by":"publisher","first-page":"1227","DOI":"10.1152\/jn.00149.2015","article-title":"Prediction strength modulates responses in human area CA1 to sequence violations","volume":"114","author":"Chen","year":"2015","journal-title":"Journal of Neurophysiology"},{"key":"2022063021250976900_bib16","first-page":"326","volume-title":"Memory, amnesia, and the hippocampal system","author":"Cohen","year":"1993"},{"key":"2022063021250976900_bib17","doi-asserted-by":"publisher","first-page":"1024","DOI":"10.1111\/j.1460-9568.2011.07980.x","article-title":"How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis","volume":"35","author":"Collins","year":"2012","journal-title":"European Journal of Neuroscience"},{"key":"2022063021250976900_bib18","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.neuron.2016.08.031","article-title":"An upside to reward sensitivity: The hippocampus supports enhanced reinforcement learning in adolescence","volume":"92","author":"Davidow","year":"2016","journal-title":"Neuron"},{"key":"2022063021250976900_bib19","doi-asserted-by":"publisher","first-page":"3210","DOI":"10.1523\/JNEUROSCI.4458-09.2010","article-title":"Striatal prediction error modulates cortical coupling","volume":"30","author":"den Ouden","year":"2010","journal-title":"Journal of Neuroscience"},{"key":"2022063021250976900_bib20","doi-asserted-by":"publisher","first-page":"1175","DOI":"10.1093\/cercor\/bhn161","article-title":"A dual role for prediction error in associative learning","volume":"19","author":"den Ouden","year":"2009","journal-title":"Cerebral Cortex"},{"key":"2022063021250976900_bib21","doi-asserted-by":"publisher","first-page":"968","DOI":"10.1016\/j.neuroimage.2006.01.021","article-title":"An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest","volume":"31","author":"Desikan","year":"2006","journal-title":"Neuroimage"},{"key":"2022063021250976900_bib22","doi-asserted-by":"publisher","first-page":"861","DOI":"10.3758\/s13415-015-0364-5","article-title":"Contributions of the hippocampus to feedback learning","volume":"15","author":"Dickerson","year":"2015","journal-title":"Cognitive, Affective, & Behavioral Neuroscience"},{"key":"2022063021250976900_bib23","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1016\/j.neuroimage.2010.10.080","article-title":"Parallel contributions of distinct human memory systems during probabilistic learning","volume":"55","author":"Dickerson","year":"2011","journal-title":"Neuroimage"},{"key":"2022063021250976900_bib24","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1016\/j.neuron.2018.03.042","article-title":"More than the sum of its parts: A role for the hippocampus in configural reinforcement learning","volume":"98","author":"Duncan","year":"2018","journal-title":"Neuron"},{"key":"2022063021250976900_bib25","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1002\/hipo.20933","article-title":"Evidence for area CA1 as a match\/mismatch detector: A high-resolution fMRI study of the human hippocampus","volume":"22","author":"Duncan","year":"2012","journal-title":"Hippocampus"},{"key":"2022063021250976900_bib26","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1038\/35036213","article-title":"A cortical\u2013hippocampal system for declarative memory","volume":"1","author":"Eichenbaum","year":"2000","journal-title":"Nature Reviews Neuroscience"},{"key":"2022063021250976900_bib27","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1016\/s0896-6273(00)80773-4","article-title":"The hippocampus, memory, and place cells: Is it spatial memory or a memory space?","volume":"23","author":"Eichenbaum","year":"1999","journal-title":"Neuron"},{"key":"2022063021250976900_bib28","doi-asserted-by":"publisher","first-page":"7900","DOI":"10.1073\/pnas.1602413113","article-title":"Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates","volume":"113","author":"Eklund","year":"2016","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2022063021250976900_bib29","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1016\/j.tics.2020.02.009","article-title":"Reward prediction error and declarative memory","volume":"24","author":"Ergo","year":"2020","journal-title":"Trends in Cognitive Sciences"},{"key":"2022063021250976900_bib30","first-page":"400","article-title":"Dopaminergic regulation of limbic-striatal interplay","volume":"32","author":"Floresco","year":"2007","journal-title":"Journal of Psychiatry & Neuroscience: JPN"},{"key":"2022063021250976900_bib31","doi-asserted-by":"publisher","first-page":"5698","DOI":"10.1523\/JNEUROSCI.5217-12.2013","article-title":"A role for the medial temporal lobe in feedback-driven learning: Evidence from amnesia","volume":"33","author":"Foerde","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2022063021250976900_bib32","doi-asserted-by":"publisher","first-page":"13157","DOI":"10.1523\/JNEUROSCI.2701-11.2011","article-title":"Feedback timing modulates brain systems for learning in humans","volume":"31","author":"Foerde","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"2022063021250976900_bib33","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1086\/670067","article-title":"Emcee: The MCMC hammer","volume":"125","author":"Foreman-Mackey","year":"2013","journal-title":"Publications of the Astronomical Society of the Pacific"},{"key":"2022063021250976900_bib34","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1016\/j.neuron.2005.06.020","article-title":"Error-related negativity predicts reinforcement learning and conflict biases","volume":"47","author":"Frank","year":"2005","journal-title":"Neuron"},{"key":"2022063021250976900_bib35","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1111\/j.1467-9868.2007.00650.x","article-title":"Marginal likelihood estimation via power posteriors","volume":"70","author":"Friel","year":"2008","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2022063021250976900_bib36","doi-asserted-by":"publisher","first-page":"1297","DOI":"10.1016\/j.neubiorev.2013.03.023","article-title":"Prediction error in reinforcement learning: A meta-analysis of neuroimaging studies","volume":"37","author":"Garrison","year":"2013","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"2022063021250976900_bib37","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1146\/annurev-psych-122414-033625","article-title":"Reinforcement learning and episodic memory in humans and animals: An integrative framework","volume":"68","author":"Gershman","year":"2017","journal-title":"Annual Review of Psychology"},{"key":"2022063021250976900_bib38","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1016\/j.neuron.2010.04.016","article-title":"States versus rewards: Dissociable neural prediction error signals underlying model-based and model-free reinforcement learning","volume":"66","author":"Gl\u00e4scher","year":"2010","journal-title":"Neuron"},{"key":"2022063021250976900_bib39","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1016\/j.nlm.2004.07.003","article-title":"Coordination of multiple memory systems","volume":"82","author":"Gold","year":"2004","journal-title":"Neurobiology of Learning and Memory"},{"key":"2022063021250976900_bib40","doi-asserted-by":"publisher","first-page":"65","DOI":"10.2140\/camcos.2010.5.65","article-title":"Ensemble samplers with affine invariance","volume":"5","author":"Goodman","year":"2010","journal-title":"Communications in Applied Mathematics and Computational Science"},{"key":"2022063021250976900_bib41","volume-title":"Grinsted\/gwmcmc","author":"Grinsted","year":"2015"},{"key":"2022063021250976900_bib42","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1016\/j.neunet.2005.11.002","article-title":"Encoding uncertainty in the hippocampus","volume":"19","author":"Harrison","year":"2006","journal-title":"Neural Networks"},{"key":"2022063021250976900_bib43","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1016\/j.neuroimage.2014.09.018","article-title":"Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development","volume":"104","author":"Hauser","year":"2015","journal-title":"Neuroimage"},{"key":"2022063021250976900_bib44","doi-asserted-by":"publisher","first-page":"3989","DOI":"10.1038\/s41467-019-12016-9","article-title":"Hippocampal\u2013neocortical interactions sharpen over time for predictive actions","volume":"10","author":"Hindy","year":"2019","journal-title":"Nature Communications"},{"key":"2022063021250976900_bib45","volume-title":"The theory of probability","author":"Jeffreys","year":"1961","edition":"3rd ed."},{"key":"2022063021250976900_bib46","doi-asserted-by":"publisher","first-page":"1606","DOI":"10.1523\/JNEUROSCI.3904-10.2011","article-title":"Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices","volume":"31","author":"Jocham","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"2022063021250976900_bib47","doi-asserted-by":"publisher","first-page":"692","DOI":"10.1016\/j.conb.2008.01.003","article-title":"Integrating hippocampus and striatum in decision-making","volume":"17","author":"Johnson","year":"2007","journal-title":"Current Opinion in Neurobiology"},{"key":"2022063021250976900_bib48","doi-asserted-by":"publisher","first-page":"733","DOI":"10.1016\/j.neuron.2009.09.003","article-title":"The neurobiology of decision: Consensus and controversy","volume":"63","author":"Kable","year":"2009","journal-title":"Neuron"},{"key":"2022063021250976900_bib49","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1002\/hipo.22077","article-title":"Intrinsic connectivity between the hippocampus, nucleus accumbens, and ventral tegmental area in humans","volume":"23","author":"Kahn","year":"2013","journal-title":"Hippocampus"},{"key":"2022063021250976900_bib50","doi-asserted-by":"publisher","first-page":"1399","DOI":"10.1126\/science.273.5280.1399","article-title":"A neostriatal habit learning system in humans","volume":"273","author":"Knowlton","year":"1996","journal-title":"Science"},{"key":"2022063021250976900_bib51","doi-asserted-by":"publisher","first-page":"6888","DOI":"10.1523\/JNEUROSCI.0163-18.2018","article-title":"Associative prediction of visual shape in the hippocampus","volume":"38","author":"Kok","year":"2018","journal-title":"The Journal of Neuroscience"},{"key":"2022063021250976900_bib52","doi-asserted-by":"publisher","first-page":"e424","DOI":"10.1371\/journal.pbio.0040424","article-title":"An unexpected sequence of events: Mismatch detection in the human hippocampus","volume":"4","author":"Kumaran","year":"2006","journal-title":"PLoS Biology"},{"key":"2022063021250976900_bib53","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1038\/nn1890","article-title":"Medial prefrontal cell activity signaling prediction errors of action values","volume":"10","author":"Matsumoto","year":"2007","journal-title":"Nature Neuroscience"},{"key":"2022063021250976900_bib54","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1016\/S0896-6273(03)00154-5","article-title":"Temporal prediction errors in a passive learning task activate human striatum","volume":"38","author":"McClure","year":"2003","journal-title":"Neuron"},{"key":"2022063021250976900_bib55","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1016\/j.neuroimage.2016.04.019","article-title":"Chasing probabilities\u2014Signaling negative and positive prediction errors across domains","volume":"134","author":"Meder","year":"2016","journal-title":"Neuroimage"},{"key":"2022063021250976900_bib56","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/0301-0082(80)90018-0","article-title":"From motivation to action: Functional interface between the limbic system and the motor system","volume":"14","author":"Mogenson","year":"1980","journal-title":"Progress in Neurobiology"},{"key":"2022063021250976900_bib57","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1111\/j.2041-210x.2012.00261.x","article-title":"A general and simple method for obtaining R2 from generalized linear mixed-effects models","volume":"4","author":"Nakagawa","year":"2013","journal-title":"Methods in Ecology and Evolution"},{"key":"2022063021250976900_bib58","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1016\/S0896-6273(03)00169-7","article-title":"Temporal difference models and reward-related learning in the human brain","volume":"38","author":"O'Doherty","year":"2003","journal-title":"Neuron"},{"key":"2022063021250976900_bib59","doi-asserted-by":"publisher","first-page":"1044","DOI":"10.1002\/hipo.22178","article-title":"Factors that influence the relative use of multiple memory systems","volume":"23","author":"Packard","year":"2013","journal-title":"Hippocampus"},{"key":"2022063021250976900_bib60","doi-asserted-by":"publisher","first-page":"523","DOI":"10.3758\/s13415-018-00687-8","article-title":"Hippocampal contributions to value-based learning: Converging evidence from fMRI and amnesia","volume":"19","author":"Palombo","year":"2019","journal-title":"Cognitive, Affective, & Behavioral Neuroscience"},{"key":"2022063021250976900_bib61","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1002\/hipo.23317","article-title":"Probabilistic value learning in medial temporal lobe amnesia","volume":"31","author":"Palombo","year":"2021","journal-title":"Hippocampus"},{"key":"2022063021250976900_bib62","doi-asserted-by":"publisher","first-page":"1042","DOI":"10.1038\/nature05051","article-title":"Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans","volume":"442","author":"Pessiglione","year":"2006","journal-title":"Nature"},{"key":"2022063021250976900_bib63","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1038\/35107080","article-title":"Interactive memory systems in the human brain","volume":"414","author":"Poldrack","year":"2001","journal-title":"Nature"},{"key":"2022063021250976900_bib64","volume-title":"R: A language and environment for statistical computing","author":"R Core Team","year":"2019"},{"key":"2022063021250976900_bib65","article-title":"A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement","volume-title":"Classical conditioning II: Current research and theory","author":"Rescorla","year":"1972"},{"key":"2022063021250976900_bib66","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1038\/nrn2213","article-title":"Remembering the past to imagine the future: The prospective brain","volume":"8","author":"Schacter","year":"2007","journal-title":"Nature Reviews Neuroscience"},{"key":"2022063021250976900_bib67","doi-asserted-by":"publisher","first-page":"1622","DOI":"10.1016\/j.cub.2012.06.056","article-title":"Shaping of object representations in the human medial temporal lobe based on temporal regularities","volume":"22","author":"Schapiro","year":"2012","journal-title":"Current Biology"},{"key":"2022063021250976900_bib68","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1016\/j.neuroimage.2009.08.011","article-title":"Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: Evidence from a model-based fMRI study","volume":"49","author":"Schonberg","year":"2010","journal-title":"Neuroimage"},{"key":"2022063021250976900_bib69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1152\/jn.1998.80.1.1","article-title":"Predictive reward signal of dopamine neurons","volume":"80","author":"Schultz","year":"1998","journal-title":"Journal of Neurophysiology"},{"key":"2022063021250976900_bib70","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the dimension of a model","volume":"6","author":"Schwarz","year":"1978","journal-title":"Annals of Statistics"},{"key":"2022063021250976900_bib71","doi-asserted-by":"publisher","first-page":"664","DOI":"10.1038\/nature02581","article-title":"Temporal difference models describe higher-order learning in humans","volume":"429","author":"Seymour","year":"2004","journal-title":"Nature"},{"key":"2022063021250976900_bib72","doi-asserted-by":"publisher","first-page":"464","DOI":"10.1016\/j.tics.2010.08.002","article-title":"Dopamine and adaptive memory","volume":"14","author":"Shohamy","year":"2010","journal-title":"Trends in Cognitive Sciences"},{"key":"2022063021250976900_bib73","doi-asserted-by":"publisher","first-page":"e2117625118","DOI":"10.1073\/pnas.2117625118","article-title":"Prediction errors disrupt hippocampal representations and update episodic memories","volume":"118","author":"Sinclair","year":"2021","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2022063021250976900_bib74","doi-asserted-by":"publisher","first-page":"S208","DOI":"10.1016\/j.neuroimage.2004.07.051","article-title":"Advances in functional and structural MR image analysis and implementation as FSL","volume":"23","author":"Smith","year":"2004","journal-title":"Neuroimage"},{"key":"2022063021250976900_bib75","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.nlm.2004.06.005","article-title":"Memory systems of the brain: A brief history and current perspective","volume":"82","author":"Squire","year":"2004","journal-title":"Neurobiology of Learning and Memory"},{"key":"2022063021250976900_bib76","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1146\/annurev.ps.44.020193.002321","article-title":"The structure and organization of memory","volume":"44","author":"Squire","year":"1993","journal-title":"Annual Review of Psychology"},{"key":"2022063021250976900_bib77","volume-title":"Reinforcement learning: An introduction","author":"Sutton","year":"2018"},{"key":"2022063021250976900_bib78","doi-asserted-by":"publisher","first-page":"1934","DOI":"10.1162\/jocn.2009.21131","article-title":"Neural evidence of statistical learning: Efficient detection of visual regularities without awareness","volume":"21","author":"Turk-Browne","year":"2009","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2022063021250976900_bib79","doi-asserted-by":"publisher","first-page":"e3000578","DOI":"10.1371\/journal.pbio.3000578","article-title":"Interactions between human orbitofrontal cortex and hippocampus support model-based inference","volume":"18","author":"Wang","year":"2020","journal-title":"PLoS Biology"},{"key":"2022063021250976900_bib80","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1006\/nlme.2001.4008","article-title":"Multiple parallel memory systems in the brain of the rat","volume":"77","author":"White","year":"2002","journal-title":"Neurobiology of Learning and Memory"},{"key":"2022063021250976900_bib81","doi-asserted-by":"publisher","first-page":"e49547","DOI":"10.7554\/eLife.49547","article-title":"Ten simple rules for the computational modeling of behavioral data","volume":"8","author":"Wilson","year":"2019","journal-title":"eLife"},{"key":"2022063021250976900_bib82","doi-asserted-by":"publisher","first-page":"1370","DOI":"10.1006\/nimg.2001.0931","article-title":"Temporal autocorrelation in univariate linear modeling of FMRI data","volume":"14","author":"Woolrich","year":"2001","journal-title":"Neuroimage"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/34\/8\/1429\/2033154\/jocn_a_01873.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/34\/8\/1429\/2033154\/jocn_a_01873.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,30]],"date-time":"2022-06-30T21:26:04Z","timestamp":1656624364000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/34\/8\/1429\/111263\/Hippocampal-Contribution-to-Probabilistic-Feedback"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":82,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,7,1]]},"published-print":{"date-parts":[[2022,7,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01873","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022]]}}}