{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T15:05:14Z","timestamp":1790694314354,"version":"4.1.0"},"reference-count":70,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,10,13]],"date-time":"2022-10-13T00:00:00Z","timestamp":1665619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["FA8750-18-C-0103"],"award-info":[{"award-number":["FA8750-18-C-0103"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["W911NF-16-C-0018"],"award-info":[{"award-number":["W911NF-16-C-0018"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Syst. Neurosci."],"abstract":"<jats:p>The standard theory of memory consolidation posits a dual-store memory system: a fast-learning fast-decaying hippocampus that transfers memories to slow-learning long-term cortical storage. Hippocampal lesions interrupt this transfer, so recent memories are more likely to be lost than more remote memories. Existing models of memory consolidation that simulate this temporally graded retrograde amnesia operate only on static patterns or unitary variables as memories and study only one-way interaction from the hippocampus to the cortex. However, the mechanisms underlying the consolidation of episodes, which are sequential in nature and comprise multiple events, are not well-understood. The representation of learning for sequential experiences in the cortical-hippocampal network as a self-consistent dynamical system is not sufficiently addressed in prior models. Further, there is evidence for a bi-directional interaction between the two memory systems during offline periods, whereby the reactivation of waking neural patterns originating in the cortex triggers time-compressed sequential replays in the hippocampus, which in turn drive the consolidation of the pertinent sequence in the cortex. We have developed a computational model of memory encoding, consolidation, and recall for storing temporal sequences that explores the dynamics of this bi-directional interaction and time-compressed replays in four simulation experiments, providing novel insights into whether hippocampal learning needs to be suppressed for stable memory consolidation and into how new and old memories compete for limited replay opportunities during offline periods. The salience of experienced events, based on factors such as recency and frequency of use, is shown to have considerable impact on memory consolidation because it biases the relative probability that a particular event will be cued in the cortex during offline periods. In the presence of hippocampal learning during sleep, our model predicts that the fast-forgetting hippocampus can continually refresh the memory traces of a given episodic sequence if there are no competing experiences to be replayed.<\/jats:p>","DOI":"10.3389\/fnsys.2022.972235","type":"journal-article","created":{"date-parts":[[2022,10,13]],"date-time":"2022-10-13T08:36:14Z","timestamp":1665650174000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["A model of bi-directional interactions between complementary learning systems for memory consolidation of sequential experiences"],"prefix":"10.3389","volume":"16","author":[{"given":"Michael D.","family":"Howard","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven W.","family":"Skorheim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Praveen K.","family":"Pilly","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,10,13]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"7041","DOI":"10.1073\/pnas.91.15.7041","article-title":"Memory consolidation and the medial temporal lobe: a simple network model","volume":"91","author":"Alvarez","year":"1994","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1038\/nn.3152","article-title":"Cued memory reactivation during sleep influences skill learning","volume":"15","author":"Antony","year":"2012","journal-title":"Nat. Neurosci."},{"key":"B3","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1016\/j.tins.2015.07.004","article-title":"Memory trace replay: the shaping of memory consolidation by neuromodulation","volume":"38","author":"Atherton","year":"2015","journal-title":"Trends Neurosci."},{"key":"B4","doi-asserted-by":"publisher","first-page":"5134","DOI":"10.1523\/JNEUROSCI.5274-13.2014","article-title":"Slow-wave sleep-imposed replay modulates both strength and precision of memory","volume":"34","author":"Barnes","year":"2014","journal-title":"J. Neurosci."},{"key":"B5","doi-asserted-by":"publisher","first-page":"10464","DOI":"10.1523\/JNEUROSCI.18-24-10464.1998","article-title":"Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type","volume":"18","author":"Bi","year":"1998","journal-title":"J. Neurosci."},{"key":"B6","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1007\/s00426-011-0335-6","article-title":"System consolidation of memory during sleep","volume":"76","author":"Born","year":"2012","journal-title":"Psychol. Res."},{"key":"B7","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1016\/0006-8993(89)91001-9","article-title":"Synaptic plasticity in the hippocampus is modulated by behavioral state","volume":"493","author":"Bramham","year":"1989","journal-title":"Brain Res."},{"key":"B8","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1016\/0306-4522(89)90423-5","article-title":"Two-stage model of memory trace formation: a role for \u201cnoisy\u201d brain states","volume":"31","author":"Buzs\u00e1ki","year":"1989","journal-title":"Neuroscience"},{"key":"B9","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1046\/j.1365-2869.7.s1.3.x","article-title":"Memory consolidation during sleep: a neurophysiological perspective","volume":"7","author":"Buzs\u00e1ki","year":"1998","journal-title":"J. Sleep Res."},{"key":"B10","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1002\/hipo.20113","article-title":"Theta rhythm of navigation: Link between path integration and landmark navigation, episodic and semantic memory","volume":"15","author":"Buzs\u00e1ki","year":"2005","journal-title":"Hippocampus"},{"key":"B11","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature17955","article-title":"A shared neural ensemble links distinct contextual memories encoded close in time","volume":"534","author":"Cai","year":"2016","journal-title":"Nature"},{"key":"B12","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1146\/annurev.neuro.31.060407.125639","article-title":"Spike timing\u2013dependent plasticity: a Hebbian learning rule","volume":"31","author":"Caporale","year":"2008","journal-title":"Annu. Rev. Neurosci."},{"key":"B13","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1038\/nn.2732","article-title":"Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval","volume":"14","author":"Carr","year":"2011","journal-title":"Nat. Neurosci."},{"key":"B14","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1016\/j.neuron.2007.11.035","article-title":"New experiences enhance coordinated neural activity in the hippocampus","volume":"57","author":"Cheng","year":"2008","journal-title":"Neuron"},{"key":"B15","doi-asserted-by":"publisher","first-page":"6160","DOI":"10.1523\/JNEUROSCI.14-10-06160.1994","article-title":"Selective activation of deep layer (V-VI) retrohippocampal cortical neurons during hippocampal sharp waves in the behaving rat","volume":"14","author":"Chrobak","year":"1994","journal-title":"J. Neurosci."},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0101567","article-title":"Sound asleep: processing and retention of slow oscillation phase-targeted stimuli","author":"Cox","year":"2014","journal-title":"PLoS ONE"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1241","DOI":"10.1038\/nn1961","article-title":"Forward and reverse hippocampal place-cell sequences during ripples","volume":"10","author":"Diba","year":"2007","journal-title":"Nat. Neurosci."},{"key":"B18","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1146\/annurev.psych.55.090902.142050","volume":"55","author":"Dudai","year":"2004","journal-title":"Annu. Rev. Psychol."},{"key":"B19","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1016\/j.conb.2006.03.010","article-title":"Reconsolidation: the advantage of being refocused","volume":"16","author":"Dudai","year":"2006","journal-title":"Curr. Opin. Neurobiol."},{"key":"B20","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1126\/science.1148979","article-title":"Fast-forward playback of recent memory sequences in prefrontal cortex during sleep","volume":"318","author":"Euston","year":"2007","journal-title":"Science"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2809","DOI":"10.1111\/j.1460-9568.2006.04806.x","article-title":"The role of the basolateral amygdala in stimulus\u2013reward memory and extinction memory consolidation and in subsequent conditioned cued reinstatement of cocaine seeking","volume":"23","author":"Fuchs","year":"2006","journal-title":"Eur. J. Neurosci."},{"key":"B22","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1101\/lm.80504","article-title":"Declarative memory consolidation: mechanisms acting during human sleep","volume":"11","author":"Gais","year":"2004","journal-title":"Learn. Mem."},{"key":"B23","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/BF00344744","article-title":"Adaptive pattern classification and universal recoding, i: Parallel development and coding of neural feature detectors","volume":"23","author":"Grossberg","year":"1976","journal-title":"Biol. Cybern."},{"key":"B24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/978-94-009-7758-7_1","volume":"87","author":"Grossberg","year":"1980","journal-title":"Psychol. Rev."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1038\/nn1788","article-title":"Phase-locking of hippocampal interneurons' membrane potential to neocortical up-down states","volume":"9","author":"Hahn","year":"2006","journal-title":"Nat. Neurosci."},{"key":"B26","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1006\/nlme.1997.3799","article-title":"Memory formation: the sequence of biochemical events in the hippocampus and its connection to activity in other brain structures","volume":"68","author":"Izquierdo","year":"1997","journal-title":"Neurobiol. Learn. Mem."},{"key":"B27","doi-asserted-by":"publisher","first-page":"2209","DOI":"10.1038\/s41467-018-04498-w","article-title":"Specific hippocampal representations are linked to generalized cortical representations in memory","volume":"9","author":"Jai","year":"2018","journal-title":"Nat. Commun."},{"key":"B28","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1038\/nn1825","article-title":"Coordinated memory replay in the visual cortex and hippocampus during sleep","volume":"10","author":"Ji","year":"2007","journal-title":"Nat. Neurosci."},{"key":"B29","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1038\/nn1202","article-title":"Off-line replay maintains declarative memories in a model of hippocampal-neocortical interactions","volume":"7","author":"K\u00e1li","year":"2004","journal-title":"Nat. Neurosci."},{"key":"B30","doi-asserted-by":"publisher","first-page":"7314","DOI":"10.1523\/JNEUROSCI.0273-18.2018","article-title":"Closed-loop slow-wave tACS improves sleep-dependent long-term memory generalization by modulating endogenous oscillations","volume":"38","author":"Ketz","year":"2018","journal-title":"J. Neurosci."},{"key":"B31","volume-title":"Biophysics of Computation: Information Processing in Single Neurons","author":"Koch","year":"2004"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1183","DOI":"10.1016\/S0896-6273(02)01096-6","article-title":"Memory of sequential experience in the hippocampus during slow wave sleep","volume":"36","author":"Lee","year":"2002","journal-title":"Neuron"},{"key":"B33","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1016\/0006-8993(87)90496-3","article-title":"Suppression of hippocampal synaptic plasticity during slow-wave sleep","volume":"425","author":"Leonard","year":"1987","journal-title":"Brain Res."},{"key":"B34","doi-asserted-by":"publisher","first-page":"1516","DOI":"10.1038\/s41598-018-36107-7","article-title":"Transcranial current stimulation during sleep facilitates insight into temporal rules, but does not consolidate memories of individual sequential experiences","volume":"9","author":"Lerner","year":"2019","journal-title":"Sci. Rep."},{"key":"B35","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/j.smrv.2019.05.004","article-title":"Sleep and the extraction of hidden regularities: a systematic review and the importance of temporal rules","volume":"47","author":"Lerner","year":"2019","journal-title":"Sleep Med. Rev."},{"key":"B36","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1038\/nature11028","article-title":"Optogenetic stimulation of a hippocampal engram activates fear memory recall","volume":"484","author":"Liu","year":"2012","journal-title":"Nature"},{"key":"B37","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1016\/0092-8674(94)90517-7","article-title":"Synaptic plasticity in the hippocampus: LTP and LTD","volume":"78","author":"Malenka","year":"1994","journal-title":"Cell"},{"key":"B38","volume-title":"From the Retina to the Neocortex","author":"Marr","year":"1991"},{"key":"B39","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1038\/nature05278","article-title":"Boosting slow oscillations during sleep potentiates memory","volume":"444","author":"Marshall","year":"2006","journal-title":"Nature"},{"key":"B40","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1016\/j.tics.2007.09.001","article-title":"The contribution of sleep to hippocampus-dependent memory consolidation","volume":"11","author":"Marshall","year":"2007","journal-title":"Trends Cogn. Sci."},{"key":"B41","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1037\/0033-295X.102.3.419","article-title":"Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory","volume":"102","author":"McClelland","year":"1995","journal-title":"Psychol. Rev."},{"key":"B42","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/S0079-7421(08)60536-8","article-title":"Catastrophic interference in connectionist networks: the sequential learning problem","volume":"24","author":"McCloskey","year":"1989","journal-title":"Psychol. Learn. Motiv."},{"key":"B43","doi-asserted-by":"publisher","first-page":"1658","DOI":"10.1038\/nn.3843","article-title":"Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence","volume":"17","author":"McNamara","year":"2014","journal-title":"Nat. Neurosci."},{"key":"B44","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1038\/s41562-018-0491-4","article-title":"Speed of time-compressed forward replay flexibly changes in human episodic memory","volume":"3","author":"Michelmann","year":"2019","journal-title":"Nat. Hum. Behav."},{"key":"B45","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1016\/S0006-3495(99)77248-6","article-title":"Properties of slow, cumulative sodium channel inactivation in rat hippocampal CA1 pyramidal neurons","volume":"76","author":"Mickus","year":"1999","journal-title":"Biophys. J."},{"key":"B46","doi-asserted-by":"publisher","first-page":"9497","DOI":"10.1523\/JNEUROSCI.19-21-09497.1999","article-title":"Replay and time compression of recurring spike sequences in the hippocampus","volume":"19","author":"N\u00e1dasdy","year":"1999","journal-title":"J. Neurosci."},{"key":"B47","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1002\/1098-1063(2000)10:4<352::AID-HIPO2>3.0.CO;2-D","article-title":"Multiple trace theory of human memory: computational, neuroimaging, and neuropsychological results","volume":"10","author":"Nadel","year":"2000","journal-title":"Hippocampus"},{"key":"B48","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1038\/35021052","article-title":"Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval","volume":"406","author":"Nader","year":"2000","journal-title":"Nature"},{"key":"B49","doi-asserted-by":"publisher","first-page":"664","DOI":"10.1101\/lm.75704","article-title":"Memory reactivation and consolidation during sleep","volume":"11","author":"Paller","year":"2004","journal-title":"Learn. Mem."},{"key":"B50","doi-asserted-by":"publisher","first-page":"672378","DOI":"10.1101\/672378","article-title":"One-shot tagging during wake and cueing during sleep with spatiotemporal patterns of transcranial electrical stimulation can boost long-term metamemory of individual episodes in humans","volume":"1101","author":"Pilly","year":"2019","journal-title":"bioRxiv"},{"key":"B51","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1126\/science.1239073","article-title":"Creating a false memory in the hippocampus","volume":"341","author":"Ramirez","year":"2013","journal-title":"Science"},{"key":"B52","doi-asserted-by":"publisher","first-page":"1426","DOI":"10.1126\/science.1138581","article-title":"Odor cues during slow-wave sleep prompt declarative memory consolidation","volume":"315","author":"Rasch","year":"2007","journal-title":"Science"},{"key":"B53","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1152\/physrev.00032.2012","article-title":"About sleep's role in memory","volume":"93","author":"Rasch","year":"2013","journal-title":"Physiol. Rev."},{"key":"B54","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1037\/0033-295x.97.2.285","article-title":"Connectionist models of recognition memory: constraints imposed by learning and forgetting functions","volume":"97","author":"Ratcliff","year":"1990","journal-title":"Psychol. Rev."},{"key":"B55","doi-asserted-by":"publisher","first-page":"R66","DOI":"10.1016\/j.cub.2011.11.051","article-title":"New insights in human memory interference and consolidation","volume":"22","author":"Robertson","year":"2012","journal-title":"Curr. Biol."},{"key":"B56","doi-asserted-by":"publisher","first-page":"1079","DOI":"10.1126\/science.1179013","article-title":"Strengthening individual memories by reactivating them during sleep","volume":"326","author":"Rudoy","year":"2009","journal-title":"Science"},{"key":"B57","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/j.cophys.2020.04.005","article-title":"Origin and dynamics of cortical slow oscillations","volume":"15","author":"Sanchez-Vives","year":"2020","journal-title":"Curr. Opin. Physiol."},{"key":"B58","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1136\/jnnp.20.1.11","article-title":"Loss of recent memory after bilateral hippocampal lesions","volume":"20","author":"Scoville","year":"1957","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"B59","doi-asserted-by":"publisher","first-page":"910","DOI":"10.1016\/j.neuron.2009.11.016","article-title":"Rewarded outcomes enhance reactivation of experience in the hippocampus","volume":"64","author":"Singer","year":"2009","journal-title":"Neuron"},{"key":"B60","doi-asserted-by":"publisher","first-page":"1870","DOI":"10.1126\/science.271.5257.1870","article-title":"Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience","volume":"271","author":"Skaggs","year":"1996","journal-title":"Science"},{"key":"B61","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1162\/jocn.1992.4.3.232","article-title":"Declarative and nondeclarative memory: multiple brain systems supporting learning and memory","volume":"4","author":"Squire","year":"1992","journal-title":"J. Cogn. Neurosci."},{"key":"B62","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/0959-4388(95)80023-9","article-title":"Retrograde amnesia and memory consolidation: a neurobiological perspective","volume":"5","author":"Squire","year":"1995","journal-title":"Curr. Opin. Neurobiol."},{"key":"B63","first-page":"381","article-title":"Episodic and semantic memory","volume":"1","author":"Tulving","year":"1972","journal-title":"Organ. Mem."},{"key":"B64","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1002\/(SICI)1098-1063(1998)8:3<198::AID-HIPO2>3.0.CO","article-title":"Episodic and declarative memory: role of the hippocampus","volume":"8","author":"Tulving","year":"1998","journal-title":"Hippocampus"},{"key":"B65","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1002\/hipo.22049","article-title":"The balance of forward and backward hippocampal sequences shifts across behavioral states","volume":"23","author":"Wikenheiser","year":"2013","journal-title":"Hippocampus"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1126\/science.8036517","article-title":"Reactivation of hippocampal ensemble memories during sleep","author":"Wilson","year":"1994","journal-title":"Science 265"},{"key":"B67","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1126\/science.aal2690","article-title":"Overlapping memory trace indispensable for linking, but not recalling, individual memories","volume":"355","author":"Yokose","year":"2017","journal-title":"Science"},{"key":"B68","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.tics.2015.02.009","article-title":"The slow forgetting of emotional episodic memories: an emotional binding account","volume":"19","author":"Yonelinas","year":"2015","journal-title":"Trends Cogn. Sci."},{"key":"B69","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1126\/science.2218534","article-title":"The primate hippocampal formation: evidence for a time-limited role in memory storage","volume":"250","author":"Zola-Morgan","year":"1990","journal-title":"Science"},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.26177","article-title":"An inhibitory gate for state transition in cortex","author":"Zucca","year":"2017","journal-title":"eLife"}],"container-title":["Frontiers in Systems Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnsys.2022.972235\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,13]],"date-time":"2022-10-13T08:36:22Z","timestamp":1665650182000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnsys.2022.972235\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,13]]},"references-count":70,"alternative-id":["10.3389\/fnsys.2022.972235"],"URL":"https:\/\/doi.org\/10.3389\/fnsys.2022.972235","relation":{},"ISSN":["1662-5137"],"issn-type":[{"value":"1662-5137","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,13]]},"article-number":"972235"}}