{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"Research Square"}],"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T21:47:49Z","timestamp":1785880069442,"version":"3.56.0"},"posted":{"date-parts":[[2026,8,4]]},"group-title":"In Review","reference-count":75,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T00:00:00Z","timestamp":1785801600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2026,6,25]]},"abstract":"<title>Abstract<\/title>\n                <p>Background \/ Introduction:\n Biologically inspired spiking neural networks can model adaptive behavior, but learning multiple goals is difficult because synaptic updates for different targets can interfere. We tested whether multi-timescale plasticity and context-specific credit assignment could improve continual multi-goal learning in a spiking navigation system inspired by entorhinal-hippocampal circuitry.\nMethods\n We developed a closed-loop spiking model containing grid-like, place-like, target-related, association, and motor-output populations. An agent navigated in a two-dimensional environment with randomized starting locations and learned through reward-modulated spike-timing dependent plasticity (STDP\/RL) and a novel evidence-gated plasticity (EGP) framework. EGP accumulates candidate synaptic modifications, evaluates them using reward evidence, and consolidates only changes that improve performance. A target-context variant maintained separate proposal stores and reward evaluation for each target.\nResults\n STDP\/RL learned and retained a single-target navigation policy, but multi-target training produced substantial interference, including attraction to incorrect targets after learning. Across 10 connectivity seeds, target-context EGP achieved higher late-stage reward than global EGP, improved weakest-target performance, and increased the fraction of targets achieving positive reward. In a longer continual-learning simulation, reward increased for all targets, TEST-phase performance increasingly exceeded TRAIN-phase performance, and proposal magnitudes grew over learning. Dwell-time confusion analyses showed that target-context EGP reduced wrong-target attraction and improved target selectivity relative to multi-target STDP\/RL.\nConclusions\n These results demonstrate that spiking navigation circuits can learn goal-directed behavior using local plasticity, but robust multi-goal learning benefits from context-specific evidence-based consolidation. Target-context EGP provides a biologically motivated mechanism for reducing interference during continual reinforcement learning in spiking neural networks.<\/p>","DOI":"10.21203\/rs.3.rs-10157488\/v1","type":"posted-content","created":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T21:07:18Z","timestamp":1785877638000},"source":"Crossref","is-referenced-by-count":0,"title":["Context-Aware Evidence-Gated Plasticity for Multi-Goal Learning in Spiking Neural Networks"],"prefix":"10.21203","author":[{"given":"Samuel A","family":"Neymotin","sequence":"first","affiliation":[{"name":"Nathan S. Kline Institute for Psychiatric Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hananel","family":"Hazan","sequence":"additional","affiliation":[{"name":"Tufts University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gozde","family":"Unal","sequence":"additional","affiliation":[{"name":"Nathan S. Kline Institute for Psychiatric Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Earl","sequence":"additional","affiliation":[{"name":"Okinawa Institute of Science and Technology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haroon","family":"Anwar","sequence":"additional","affiliation":[{"name":"Nathan S. Kline Institute for Psychiatric Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Piotr J","family":"Franaszczuk","sequence":"additional","affiliation":[{"name":"DEVCOM Army Research Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Boothe","sequence":"additional","affiliation":[{"name":"DEVCOM Army Research Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1016\/j.neuron.2015.09.021","article-title":"The cognitive architecture of spatial navigation: Hippocampal and striatal contributions","volume":"88","author":"Chersi F","year":"2015","unstructured":"Chersi F, Burgess N. The cognitive architecture of spatial navigation: Hippocampal and striatal contributions. Neuron. 2015;88:64\u201377.","journal-title":"Neuron"},{"key":"ref2","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1038\/s41583-021-00479-z","article-title":"Navigating for reward","volume":"22","author":"Sosa M","year":"2021","unstructured":"Sosa M, Giocomo LM. Navigating for reward. Nat Rev Neurosci. 2021;22:472\u201387.","journal-title":"Nat Rev Neurosci"},{"key":"ref3","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.neuron.2018.06.008","article-title":"A dedicated population for reward coding in the hippocampus","volume":"99","author":"Gauthier JL","year":"2018","unstructured":"Gauthier JL, Tank DW. A dedicated population for reward coding in the hippocampus. Neuron. 2018;99:179\u2013e1937.","journal-title":"Neuron"},{"key":"ref4","doi-asserted-by":"crossref","first-page":"31427","DOI":"10.1073\/pnas.2007981117","article-title":"A general model of hippocampal and dorsal striatal learning and decision making","volume":"117","author":"Geerts JP","year":"2020","unstructured":"Geerts JP, Chersi F, Stachenfeld KL, Burgess N. A general model of hippocampal and dorsal striatal learning and decision making. Proc Natl Acad Sci U S A. 2020;117:31427\u201337.","journal-title":"Proc Natl Acad Sci U S A"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1146\/annurev.neuro.31.061307.090723","article-title":"Place cells, grid cells, and the brain\u2019s spatial representation system","volume":"31","author":"Moser EI","year":"2008","unstructured":"Moser EI, Kropff E, Moser M-B. Place cells, grid cells, and the brain\u2019s spatial representation system. Annu Rev Neurosci. 2008;31:69\u201389.","journal-title":"Annu Rev Neurosci"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1016\/j.conb.2005.10.002","article-title":"Place cells, spatial maps and the population code for memory","volume":"15","author":"Leutgeb S","year":"2005","unstructured":"Leutgeb S, Leutgeb JK, Moser M-B, Moser EI. Place cells, spatial maps and the population code for memory. Curr Opin Neurobiol. 2005;15:738\u201346.","journal-title":"Curr Opin Neurobiol"},{"key":"ref7","doi-asserted-by":"crossref","first-page":"11250","DOI":"10.1523\/JNEUROSCI.2862-08.2008","article-title":"Unmasking the CA1 ensemble place code by exposures to small and large environments: more place cells and multiple, irregularly arranged, and expanded place fields in the larger space","volume":"28","author":"Fenton AA","year":"2008","unstructured":"Fenton AA, Kao H-Y, Neymotin SA, Olypher A, Vayntrub Y, Lytton WW, et al. Unmasking the CA1 ensemble place code by exposures to small and large environments: more place cells and multiple, irregularly arranged, and expanded place fields in the larger space. J Neurosci. 2008;28:11250\u201362.","journal-title":"J Neurosci"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"1945","DOI":"10.1523\/JNEUROSCI.12-05-01945.1992","article-title":"The positional firing properties of medial entorhinal neurons: description and comparison with hippocampal place cells","volume":"12","author":"Quirk GJ","year":"1992","unstructured":"Quirk GJ, Muller RU, Kubie JL, Ranck JB Jr. The positional firing properties of medial entorhinal neurons: description and comparison with hippocampal place cells. J Neurosci. 1992;12:1945\u201363.","journal-title":"J Neurosci"},{"key":"ref9","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1002\/hipo.23248","article-title":"Optogenetic low-theta pacing of the septohippocampal circuit is sufficient for spatial goal finding and is influenced by behavioral state and cognitive demand","volume":"30","author":"Mouchati PR","year":"2020","unstructured":"Mouchati PR, Kloc ML, Holmes GL, White SL, Barry JM. Optogenetic low-theta pacing of the septohippocampal circuit is sufficient for spatial goal finding and is influenced by behavioral state and cognitive demand. Hippocampus. 2020;30:1167\u201393.","journal-title":"Hippocampus"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1038\/nn.3304","article-title":"Memory, navigation and theta rhythm in the hippocampal-entorhinal system","volume":"16","author":"Buzs\u00e1ki G","year":"2013","unstructured":"Buzs\u00e1ki G, Moser EI. Memory, navigation and theta rhythm in the hippocampal-entorhinal system. Nat Neurosci. 2013;16:130\u20138.","journal-title":"Nat Neurosci"},{"key":"ref11","doi-asserted-by":"crossref","first-page":"1434","DOI":"10.1038\/nn.4661","article-title":"Viewpoints: how the hippocampus contributes to memory, navigation and cognition","volume":"20","author":"Lisman J","year":"2017","unstructured":"Lisman J, Buzs\u00e1ki G, Eichenbaum H, Nadel L, Ranganath C, Redish AD. Viewpoints: how the hippocampus contributes to memory, navigation and cognition. Nat Neurosci. 2017;20:1434\u201347.","journal-title":"Nat Neurosci"},{"key":"ref12","doi-asserted-by":"crossref","first-page":"1239","DOI":"10.1002\/hipo.20509","article-title":"Conversion of a phase- to a rate-coded position signal by a three-stage model of theta cells, grid cells, and place cells","volume":"18","author":"Blair HT","year":"2008","unstructured":"Blair HT, Gupta K, Zhang K. Conversion of a phase- to a rate-coded position signal by a three-stage model of theta cells, grid cells, and place cells. Hippocampus. 2008;18:1239\u201355.","journal-title":"Hippocampus"},{"key":"ref13","doi-asserted-by":"crossref","first-page":"5065","DOI":"10.1523\/JNEUROSCI.4017-13.2014","article-title":"A hybrid oscillatory interference\/continuous attractor network model of grid cell firing","volume":"34","author":"Bush D","year":"2014","unstructured":"Bush D, Burgess N. A hybrid oscillatory interference\/continuous attractor network model of grid cell firing. J Neurosci. 2014;34:5065\u201379.","journal-title":"J Neurosci"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"20120524","DOI":"10.1098\/rstb.2012.0524","article-title":"Coordinated learning of grid cell and place cell spatial and temporal properties: multiple scales, attention and oscillations","volume":"369","author":"Grossberg S","year":"2014","unstructured":"Grossberg S, Pilly PK. Coordinated learning of grid cell and place cell spatial and temporal properties: multiple scales, attention and oscillations. Philos Trans R Soc Lond B Biol Sci. 2014;369:20120524.","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"key":"ref15","doi-asserted-by":"crossref","first-page":"30","DOI":"10.3389\/fncir.2012.00030","article-title":"A model combining oscillations and attractor dynamics for generation of grid cell firing","volume":"6","author":"Hasselmo ME","year":"2012","unstructured":"Hasselmo ME, Brandon MP. A model combining oscillations and attractor dynamics for generation of grid cell firing. Front Neural Circuits. 2012;6:30.","journal-title":"Front Neural Circuits"},{"key":"ref16","doi-asserted-by":"crossref","first-page":"1926","DOI":"10.1126\/science.1099745","article-title":"Neuronal oscillations in cortical networks","volume":"304","author":"Buzs\u00e1ki G","year":"2004","unstructured":"Buzs\u00e1ki G, Draguhn A. Neuronal oscillations in cortical networks. Science. 2004;304:1926\u20139.","journal-title":"Science"},{"key":"ref17","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.neuron.2014.06.018","article-title":"A model of grid cell development through spatial exploration and spike time-dependent plasticity","volume":"83","author":"Widloski J","year":"2014","unstructured":"Widloski J, Fiete IR. A model of grid cell development through spatial exploration and spike time-dependent plasticity. Neuron. 2014;83:481\u201395.","journal-title":"Neuron"},{"key":"ref18","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1002\/hipo.20661","article-title":"Encoding and retrieval in a model of the hippocampal CA1 microcircuit","volume":"20","author":"Cutsuridis V","year":"2010","unstructured":"Cutsuridis V, Cobb S, Graham BP. Encoding and retrieval in a model of the hippocampal CA1 microcircuit. Hippocampus. 2010;20:423\u201346.","journal-title":"Hippocampus"},{"key":"ref19","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.neuron.2004.09.007","article-title":"Spike timing-dependent plasticity of neural circuits","volume":"44","author":"Dan Y","year":"2004","unstructured":"Dan Y, Poo M-M. Spike timing-dependent plasticity of neural circuits. Neuron. 2004;44:23\u201330.","journal-title":"Neuron"},{"key":"ref20","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1152\/physrev.00030.2005","article-title":"Spike timing-dependent plasticity: from synapse to perception","volume":"86","author":"Dan Y","year":"2006","unstructured":"Dan Y, Poo M-M. Spike timing-dependent plasticity: from synapse to perception. Physiol Rev. 2006;86:1033\u201348.","journal-title":"Physiol Rev"},{"key":"ref21","doi-asserted-by":"crossref","first-page":"4","DOI":"10.3389\/fnsyn.2011.00004","article-title":"A history of spike-timing-dependent plasticity","volume":"3","author":"Markram H","year":"2011","unstructured":"Markram H, Gerstner W, Sj\u00f6str\u00f6m PJ. A history of spike-timing-dependent plasticity. Front Synaptic Neurosci. 2011;3:4.","journal-title":"Front Synaptic Neurosci"},{"key":"ref22","doi-asserted-by":"crossref","first-page":"1468","DOI":"10.1162\/neco.2007.19.6.1468","article-title":"Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity","volume":"19","author":"Florian RV","year":"2007","unstructured":"Florian RV. Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Comput. 2007;19:1468\u2013502.","journal-title":"Neural Comput"},{"key":"ref23","doi-asserted-by":"crossref","first-page":"2443","DOI":"10.1093\/cercor\/bhl152","article-title":"Solving the distal reward problem through linkage of STDP and dopamine signaling","volume":"17","author":"Izhikevich EM","year":"2007","unstructured":"Izhikevich EM. Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex. 2007;17:2443\u201352.","journal-title":"Cereb Cortex"},{"key":"ref24","doi-asserted-by":"crossref","first-page":"e0265808","DOI":"10.1371\/journal.pone.0265808","article-title":"Training a spiking neuronal network model of visual-motor cortex to play a virtual racket-ball game using reinforcement learning","volume":"17","author":"Anwar H","year":"2022","unstructured":"Anwar H, Caby S, Dura-Bernal S, D\u2019Onofrio D, Hasegan D, Deible M, et al. Training a spiking neuronal network model of visual-motor cortex to play a virtual racket-ball game using reinforcement learning. PLoS ONE. 2022;17:e0265808.","journal-title":"PLoS ONE"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2022.1017284","article-title":"Training spiking neuronal networks to perform motor control using reinforcement and evolutionary learning","volume":"16","author":"Ha\u015fegan D","year":"2022","unstructured":"Ha\u015fegan D, Deible M, Earl C, D\u2019Onofrio D, Hazan H, Anwar H, et al. Training spiking neuronal networks to perform motor control using reinforcement and evolutionary learning. Front Comput Neurosci. 2022;16. 10.3389\/fncom.2022.1017284.","journal-title":"Front Comput Neurosci"},{"key":"ref26","doi-asserted-by":"crossref","first-page":"e47251","DOI":"10.1371\/journal.pone.0047251","article-title":"Reinforcement learning of targeted movement in a spiking neuronal model of motor cortex","volume":"7","author":"Chadderdon GL","year":"2012","unstructured":"Chadderdon GL, Neymotin SA, Kerr CC, Lytton WW. Reinforcement learning of targeted movement in a spiking neuronal model of motor cortex. PLoS ONE. 2012;7:e47251.","journal-title":"PLoS ONE"},{"key":"ref27","author":"Earl C","year":"2026","unstructured":"Earl C, Tannenbaum M, Anwar H, Hazan H, Neymotin S. Hybridizing Machine Reinforcement Learning with Neuromimetic Navigation Systems. 2026;54. Available: https:\/\/scholar.google.com\/citations?view_op=view_citation&hl=en&citation_for_view=CTeS-SsAAAAJ:oAywNP-vUhwC"},{"key":"ref28","author":"Anwar H","year":"2026","unstructured":"Anwar H, Earl C, Hazan H, Neymotin S. Neuromimetic models of mammalian spatial navigation circuits learn to navigate in complex simulated environments. 2026;54. Available: https:\/\/scholar.google.com\/citations?view_op=view_citation&hl=en&citation_for_view=jjmzPRAAAAAJ:QIV2ME_5wuYC"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.64898\/2026.06.12.731882","article-title":"DeltaQ: Value-guided Hebbian learning in spiking neuronal networks for multi-goal navigation","author":"Earl C","year":"2026","unstructured":"Earl C, Unal G, Hazan H, Neymotin SA. DeltaQ: Value-guided Hebbian learning in spiking neuronal networks for multi-goal navigation. bioRxiv bioRxiv. 2026. 10.64898\/2026.06.12.731882.","journal-title":"bioRxiv bioRxiv"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.neunet.2019.01.012","article-title":"Continual lifelong learning with neural networks: A review","volume":"113","author":"Parisi GI","year":"2019","unstructured":"Parisi GI, Kemker R, Part JL, Kanan C, Wermter S. Continual lifelong learning with neural networks: A review. Neural Netw. 2019;113:54\u201371.","journal-title":"Neural Netw"},{"key":"ref31","doi-asserted-by":"crossref","first-page":"29872","DOI":"10.1073\/pnas.2009591117","article-title":"A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex","volume":"117","author":"Tsuda B","year":"2020","unstructured":"Tsuda B, Tye KM, Siegelmann HT, Sejnowski TJ. A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex. Proc Natl Acad Sci U S A. 2020;117:29872\u201382.","journal-title":"Proc Natl Acad Sci U S A"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1101\/2023.11.12.566754","article-title":"Multi-timescale reinforcement learning in the brain","author":"Masset P","year":"2023","unstructured":"Masset P, Tano P, Kim HR, Malik AN, Pouget A, Uchida N. Multi-timescale reinforcement learning in the brain. bioRxiv. 2023. 10.1101\/2023.11.12.566754.","journal-title":"bioRxiv"},{"key":"ref33","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1038\/s41583-024-00836-8","article-title":"Timescales of learning in prefrontal cortex","volume":"25","author":"Miller JA","year":"2024","unstructured":"Miller JA, Constantinidis C. Timescales of learning in prefrontal cortex. Nat Rev Neurosci. 2024;25:597\u2013610.","journal-title":"Nat Rev Neurosci"},{"key":"ref34","author":"Wei Y","year":"2016","unstructured":"Wei Y, Krishnan GP, Bazhenov M. Synaptic mechanisms of memory consolidation during sleep slow oscillations. Journal of Neuroscience. 2016. Available: https:\/\/www.jneurosci.org\/content\/36\/15\/4231?utm_source=TrendMD&utm_medium=cpc&utm_campaign=JNeurosci_TrendMD_0"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.51005","article-title":"Can sleep protect memories from catastrophic forgetting?","volume":"9","author":"Gonz\u00e1lez OC","year":"2020","unstructured":"Gonz\u00e1lez OC, Sokolov Y, Krishnan GP, Delanois JE, Bazhenov M. Can sleep protect memories from catastrophic forgetting? Elife. 2020;9. 10.7554\/eLife.51005.","journal-title":"Elife"},{"key":"ref36","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1038\/nn.2732","article-title":"Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval","volume":"14","author":"Carr MF","year":"2011","unstructured":"Carr MF, Jadhav SP, Frank LM. Hippocampal replay in the awake state: a potential substrate for memory consolidation and retrieval. Nat Neurosci. 2011;14:147\u201353.","journal-title":"Nat Neurosci"},{"key":"ref37","doi-asserted-by":"crossref","first-page":"a021766","DOI":"10.1101\/cshperspect.a021766","article-title":"Memory consolidation","volume":"7","author":"Squire LR","year":"2015","unstructured":"Squire LR, Genzel L, Wixted JT, Morris RG. Memory consolidation. Cold Spring Harb Perspect Biol. 2015;7:a021766.","journal-title":"Cold Spring Harb Perspect Biol"},{"key":"ref38","doi-asserted-by":"crossref","first-page":"e1006322","DOI":"10.1371\/journal.pcbi.1006322","article-title":"Differential roles of sleep spindles and sleep slow oscillations in memory consolidation","volume":"14","author":"Wei Y","year":"2018","unstructured":"Wei Y, Krishnan GP, Komarov M, Bazhenov M. Differential roles of sleep spindles and sleep slow oscillations in memory consolidation. PLoS Comput Biol. 2018;14:e1006322.","journal-title":"PLoS Comput Biol"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.44494","article-title":"NetPyNE, a tool for data-driven multiscale modeling of brain circuits","volume":"8","author":"Dura-Bernal S","year":"2019","unstructured":"Dura-Bernal S, Suter BA, Gleeson P, Cantarelli M, Quintana A, Rodriguez F, et al. NetPyNE, a tool for data-driven multiscale modeling of brain circuits. Elife. 2019;8. 10.7554\/eLife.44494.","journal-title":"Elife"},{"key":"ref40","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511541612","volume-title":"The NEURON Book","author":"Carnevale NT","year":"2006","unstructured":"Carnevale NT, Hines ML. The NEURON Book. Cambridge University Press; 2006."},{"key":"ref41","doi-asserted-by":"crossref","first-page":"3263","DOI":"10.1162\/NECO_a_00521","article-title":"Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex","volume":"25","author":"Neymotin SA","year":"2013","unstructured":"Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW. Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex. Neural Comput. 2013;25:3263\u201393.","journal-title":"Neural Comput"},{"key":"ref42","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/385533a0","article-title":"Synaptic tagging and long-term potentiation","volume":"385","author":"Frey U","year":"1997","unstructured":"Frey U, Morris RGM, Others. Synaptic tagging and long-term potentiation. Nature. 1997;385:533\u20136.","journal-title":"Nature"},{"key":"ref43","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/B:JCNS.0000023869.22017.2e","article-title":"ModelDB: A Database to Support Computational Neuroscience","volume":"17","author":"Hines ML","year":"2004","unstructured":"Hines ML, Morse T, Migliore M, Carnevale NT, Shepherd GM. ModelDB: A Database to Support Computational Neuroscience. J Comput Neurosci. 2004;17:7\u201311.","journal-title":"J Comput Neurosci"},{"key":"ref44","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1101\/lm.2024811","article-title":"Synaptic tagging, evaluation of memories, and the distal reward problem","volume":"18","author":"P\u00e4pper M","year":"2011","unstructured":"P\u00e4pper M, Kempter R, Leibold C. Synaptic tagging, evaluation of memories, and the distal reward problem. Learn Mem. 2011;18:58\u201370.","journal-title":"Learn Mem"},{"key":"ref45","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1038\/nrn2963","article-title":"Making memories last: the synaptic tagging and capture hypothesis","volume":"12","author":"Redondo RL","year":"2011","unstructured":"Redondo RL, Morris RGM. Making memories last: the synaptic tagging and capture hypothesis. Nat Rev Neurosci. 2011;12:17\u201330.","journal-title":"Nat Rev Neurosci"},{"key":"ref46","doi-asserted-by":"crossref","first-page":"6826","DOI":"10.1111\/ejn.14902","article-title":"Initial memory consolidation and the synaptic tagging and capture hypothesis","volume":"54","author":"Okuda K","year":"2021","unstructured":"Okuda K, H\u00f8jgaard K, Privitera L, Bayraktar G, Takeuchi T. Initial memory consolidation and the synaptic tagging and capture hypothesis. Eur J Neurosci. 2021;54:6826\u201349.","journal-title":"Eur J Neurosci"},{"key":"ref47","doi-asserted-by":"crossref","first-page":"19373","DOI":"10.1523\/JNEUROSCI.0414-13.2013","article-title":"Memory consolidation by replay of stimulus-specific neural activity","volume":"33","author":"Deuker L","year":"2013","unstructured":"Deuker L, Olligs J, Fell J, Kranz TA, Mormann F, Montag C, et al. Memory consolidation by replay of stimulus-specific neural activity. J Neurosci. 2013;33:19373\u201383.","journal-title":"J Neurosci"},{"key":"ref48","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1007\/s12559-011-9114-3","article-title":"Spatial memory sequence encoding and replay during modeled theta and ripple oscillations","volume":"3","author":"Cutsuridis V","year":"2011","unstructured":"Cutsuridis V, Hasselmo M. Spatial memory sequence encoding and replay during modeled theta and ripple oscillations. Cognit Comput. 2011;3:554\u201374.","journal-title":"Cognit Comput"},{"key":"ref49","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1016\/j.tins.2011.08.001","article-title":"The hippocampal-striatal axis in learning, prediction and goal-directed behavior","volume":"34","author":"Pennartz CMA","year":"2011","unstructured":"Pennartz CMA, Ito R, Verschure PFMJ, Battaglia FP, Robbins TW. The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci. 2011;34:548\u201359.","journal-title":"Trends Neurosci"},{"key":"ref50","doi-asserted-by":"crossref","first-page":"250","DOI":"10.3389\/fnhum.2018.00250","article-title":"The complex nature of hippocampal-striatal interactions in spatial navigation","volume":"12","author":"Goodroe SC","year":"2018","unstructured":"Goodroe SC, Starnes J, Brown TI. The complex nature of hippocampal-striatal interactions in spatial navigation. Front Hum Neurosci. 2018;12:250.","journal-title":"Front Hum Neurosci"},{"key":"ref51","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1038\/nrn.2017.74","article-title":"Prefrontal-hippocampal interactions in episodic memory","volume":"18","author":"Eichenbaum H","year":"2017","unstructured":"Eichenbaum H. Prefrontal-hippocampal interactions in episodic memory. Nat Rev Neurosci. 2017;18:547\u201358.","journal-title":"Nat Rev Neurosci"},{"key":"ref52","doi-asserted-by":"crossref","first-page":"R764","DOI":"10.1016\/j.cub.2013.05.041","article-title":"Interplay of hippocampus and prefrontal cortex in memory","volume":"23","author":"Preston AR","year":"2013","unstructured":"Preston AR, Eichenbaum H. Interplay of hippocampus and prefrontal cortex in memory. Curr Biol. 2013;23:R764\u201373.","journal-title":"Curr Biol"},{"key":"ref53","doi-asserted-by":"crossref","first-page":"7476","DOI":"10.1523\/JNEUROSCI.1083-07.2007","article-title":"Induction of long-term memory by exposure to novelty requires protein synthesis: evidence for a behavioral tagging","volume":"27","author":"Moncada D","year":"2007","unstructured":"Moncada D, Viola H. Induction of long-term memory by exposure to novelty requires protein synthesis: evidence for a behavioral tagging. J Neurosci. 2007;27:7476\u201381.","journal-title":"J Neurosci"},{"key":"ref54","doi-asserted-by":"crossref","first-page":"14599","DOI":"10.1073\/pnas.0907078106","article-title":"Behavioral tagging is a general mechanism of long-term memory formation","volume":"106","author":"Ballarini F","year":"2009","unstructured":"Ballarini F, Moncada D, Martinez MC, Alen N, Viola H. Behavioral tagging is a general mechanism of long-term memory formation. Proc Natl Acad Sci U S A. 2009;106:14599\u2013604.","journal-title":"Proc Natl Acad Sci U S A"},{"key":"ref55","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1002\/hipo.22497","article-title":"Dopamine D1\/D5 receptor signaling regulates synaptic cooperation and competition in hippocampal CA1 pyramidal neurons via sustained ERK1\/2 activation: DOPAMINERGIC REGULATION OF SYNAPTIC ASSOCIATIVITY","volume":"26","author":"Shivarama Shetty M","year":"2016","unstructured":"Shivarama Shetty M, Gopinadhan S, Sajikumar S. Dopamine D1\/D5 receptor signaling regulates synaptic cooperation and competition in hippocampal CA1 pyramidal neurons via sustained ERK1\/2 activation: DOPAMINERGIC REGULATION OF SYNAPTIC ASSOCIATIVITY. Hippocampus. 2016;26:137\u201350.","journal-title":"Hippocampus"},{"key":"ref56","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.neuron.2005.05.020","article-title":"Midbrain dopamine neurons encode a quantitative reward prediction error signal","volume":"47","author":"Bayer HM","year":"2005","unstructured":"Bayer HM, Glimcher PW. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron. 2005;47:129\u201341.","journal-title":"Neuron"},{"key":"ref57","doi-asserted-by":"crossref","first-page":"1936","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996","article-title":"A framework for mesencephalic dopamine systems based on predictive Hebbian learning","volume":"16","author":"Montague PR","year":"1996","unstructured":"Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci. 1996;16:1936\u201347.","journal-title":"J Neurosci"},{"key":"ref58","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1016\/j.bbr.2010.11.033","article-title":"Acetylcholine and attention","volume":"221","author":"Klinkenberg I","year":"2011","unstructured":"Klinkenberg I, Sambeth A, Blokland A. Acetylcholine and attention. Behav Brain Res. 2011;221:430\u201342.","journal-title":"Behav Brain Res"},{"key":"ref59","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1111\/j.1460-9568.1997.tb01635.x","article-title":"The neural correlates of the noradrenergic modulation of human attention, arousal and learning","volume":"9","author":"Coull JT","year":"1997","unstructured":"Coull JT, Frith CD, Dolan RJ, Frackowiak RS, Grasby PM. The neural correlates of the noradrenergic modulation of human attention, arousal and learning. Eur J Neurosci. 1997;9:589\u201398.","journal-title":"Eur J Neurosci"},{"key":"ref60","doi-asserted-by":"crossref","first-page":"e2510270122","DOI":"10.1073\/pnas.2510270122","article-title":"Parallel trade-offs in human cognition and neural networks: The dynamic interplay between in-context and in-weight learning","volume":"122","author":"Russin J","year":"2025","unstructured":"Russin J, Pavlick E, Frank MJ. Parallel trade-offs in human cognition and neural networks: The dynamic interplay between in-context and in-weight learning. Proc Natl Acad Sci U S A. 2025;122:e2510270122.","journal-title":"Proc Natl Acad Sci U S A"},{"key":"ref61","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1038\/s43588-023-00417-2","article-title":"Full-scale scaffold model of the human hippocampus CA1 area","volume":"3","author":"Gandolfi D","year":"2023","unstructured":"Gandolfi D, Mapelli J, Solinas SMG, Triebkorn P, D\u2019Angelo E, Jirsa V, et al. Full-scale scaffold model of the human hippocampus CA1 area. Nat Comput Sci. 2023;3:264\u201376.","journal-title":"Nat Comput Sci"},{"key":"ref62","author":"Dura-Bernal S","year":"2024","unstructured":"Dura-Bernal S, Herrera B, Lupascu C, Marsh BM, Gandolfi D, Marasco A et al. Large-scale mechanistic models of brain circuits with biophysically and morphologically detailed neurons. 2024;44. Available: https:\/\/www.jneurosci.org\/content\/44\/40\/e1236242024.abstract"},{"key":"ref63","doi-asserted-by":"crossref","first-page":"S60","DOI":"10.1016\/j.neures.2009.09.169","article-title":"Theta oscillations provide temporal windows for local circuit computation in the entorhinal-hippocampal loop","volume":"65","author":"Mizuseki K","year":"2009","unstructured":"Mizuseki K, Buzsaki G. Theta oscillations provide temporal windows for local circuit computation in the entorhinal-hippocampal loop. Neurosci Res. 2009;65:S60.","journal-title":"Neurosci Res"},{"key":"ref64","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1038\/s41593-024-01839-5","article-title":"Context-dependent decision-making in the primate hippocampal-prefrontal circuit","volume":"28","author":"Elston TW","year":"2025","unstructured":"Elston TW, Wallis JD. Context-dependent decision-making in the primate hippocampal-prefrontal circuit. Nat Neurosci. 2025;28:374\u201382.","journal-title":"Nat Neurosci"},{"key":"ref65","author":"Bull MS","year":"2025","unstructured":"Bull MS, Kuo P-C, Smith AL, Buice MA. Volume transmission implements context factorization to target online credit assignment and enable compositional generalization. In: Advances in Neural Information Processing Systems [Internet]. Curran Associates, Inc.; 2025 [cited 19 Jun 2026]. Available: https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2025\/hash\/da4dffbe0ea5181d0ad8c59e1641cecd-Abstract-Conference.html"},{"key":"ref66","doi-asserted-by":"crossref","first-page":"8096","DOI":"10.1038\/ncomms9096","article-title":"Contextual modulation of value signals in reward and punishment learning","volume":"6","author":"Palminteri S","year":"2015","unstructured":"Palminteri S, Khamassi M, Joffily M, Coricelli G. Contextual modulation of value signals in reward and punishment learning. Nat Commun. 2015;6:8096.","journal-title":"Nat Commun"},{"key":"ref67","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1007\/s12559-024-10308-x","article-title":"Neuromorphic cognitive learning systems: The future of artificial intelligence?","volume":"16","author":"Cutsuridis V","year":"2024","unstructured":"Cutsuridis V. Neuromorphic cognitive learning systems: The future of artificial intelligence? Cognit Comput. 2024;16:1433\u20135.","journal-title":"Cognit Comput"},{"key":"ref68","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1109\/JPROC.2020.3045625","article-title":"Brain-inspired learning on neuromorphic substrates","volume":"109","author":"Zenke F","year":"2021","unstructured":"Zenke F, Neftci EO. Brain-inspired learning on neuromorphic substrates. Proc IEEE Inst Electr Electron Eng. 2021;109:935\u201350.","journal-title":"Proc IEEE Inst Electr Electron Eng"},{"key":"ref69","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1038\/s41467-021-27653-2","article-title":"Brain-inspired global-local learning incorporated with neuromorphic computing","volume":"13","author":"Wu Y","year":"2022","unstructured":"Wu Y, Zhao R, Zhu J, Chen F, Xu M, Li G, et al. Brain-inspired global-local learning incorporated with neuromorphic computing. Nat Commun. 2022;13:65.","journal-title":"Nat Commun"},{"key":"ref70","doi-asserted-by":"crossref","first-page":"2","DOI":"10.3389\/fnins.2013.00002","article-title":"STDP and STDP variations with memristors for spiking neuromorphic learning systems","volume":"7","author":"Serrano-Gotarredona T","year":"2013","unstructured":"Serrano-Gotarredona T, Masquelier T, Prodromakis T, Indiveri G, Linares-Barranco B. STDP and STDP variations with memristors for spiking neuromorphic learning systems. Front Neurosci. 2013;7:2.","journal-title":"Front Neurosci"},{"key":"ref71","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1038\/s42256-024-00854-2","article-title":"Discovering neural policies to drive behaviour by integrating deep reinforcement learning agents with biological neural networks","volume":"6","author":"Li C","year":"2024","unstructured":"Li C, Kreiman G, Ramanathan S. Discovering neural policies to drive behaviour by integrating deep reinforcement learning agents with biological neural networks. Nat Mach Intell. 2024;6:726\u201338.","journal-title":"Nat Mach Intell"},{"key":"ref72","doi-asserted-by":"crossref","first-page":"30","DOI":"10.2976\/1.2732246\/10.2976\/1","article-title":"Reinforcement learning: Computational theory and biological mechanisms","volume":"1","author":"Doya K","year":"2007","unstructured":"Doya K. Reinforcement learning: Computational theory and biological mechanisms. HFSP J. 2007;1:30.","journal-title":"HFSP J"},{"key":"ref73","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1038\/s42256-019-0025-4","article-title":"Reinforcement learning in artificial and biological systems","volume":"1","author":"Neftci EO","year":"2019","unstructured":"Neftci EO, Averbeck BB. Reinforcement learning in artificial and biological systems. Nat Mach Intell. 2019;1:133\u201343.","journal-title":"Nat Mach Intell"},{"key":"ref74","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/s12559-025-10476-4","article-title":"Systematic evaluation of memory retrieval in a neuromorphic model of the hippocampus","volume":"17","author":"Andreakos N","year":"2025","unstructured":"Andreakos N, Yue S, Cutsuridis V. Systematic evaluation of memory retrieval in a neuromorphic model of the hippocampus. Cognit Comput. 2025;17:123.","journal-title":"Cognit Comput"},{"key":"ref75","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1126\/science.1102941","article-title":"By carrot or by stick: cognitive reinforcement learning in parkinsonism","volume":"306","author":"Frank MJ","year":"2004","unstructured":"Frank MJ, Seeberger LC, O\u2019reilly RC. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science. 2004;306:1940\u20133.","journal-title":"Science"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/www.researchsquare.com\/article\/rs-10157488\/v1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.researchsquare.com\/article\/rs-10157488\/v1.html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T21:07:25Z","timestamp":1785877645000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.researchsquare.com\/article\/rs-10157488\/v1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,4]]},"references-count":75,"URL":"https:\/\/doi.org\/10.21203\/rs.3.rs-10157488\/v1","relation":{},"subject":[],"published":{"date-parts":[[2026,8,4]]},"subtype":"preprint"}}