{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T23:34:21Z","timestamp":1773704061898,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011354","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T00:00:00Z","timestamp":1708387200000}}],"reference-count":57,"publisher":"Public Library of Science (PLoS)","issue":"2","license":[{"start":{"date-parts":[[2024,2,7]],"date-time":"2024-02-07T00:00:00Z","timestamp":1707264000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>It is widely believed that memory storage depends on activity-dependent synaptic modifications. Classical studies of learning and memory in neural networks describe synaptic efficacy either as continuous or discrete. However, recent results suggest an intermediate scenario in which synaptic efficacy can be described by a continuous variable, but whose distribution is peaked around a small set of discrete values. Motivated by these results, we explored a model in which each synapse is described by a continuous variable that evolves in a potential with multiple minima. External inputs to the network can switch synapses from one potential well to another. Our analytical and numerical results show that this model can interpolate between models with discrete synapses which correspond to the deep potential limit, and models in which synapses evolve in a single quadratic potential. We find that the storage capacity of the network with double well synapses exhibits a power law dependence on the network size, rather than the logarithmic dependence observed in models with single well synapses. In addition, synapses with deeper potential wells lead to more robust information storage in the presence of noise. When memories are sparsely encoded, the scaling of the capacity with network size is similar to previously studied network models in the sparse coding limit.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1011354","type":"journal-article","created":{"date-parts":[[2024,2,7]],"date-time":"2024-02-07T13:42:12Z","timestamp":1707313332000},"page":"e1011354","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":2,"title":["Attractor neural networks with double well synapses"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3688-0284","authenticated-orcid":true,"given":"Yu","family":"Feng","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2272-3248","authenticated-orcid":true,"given":"Nicolas","family":"Brunel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2024,2,7]]},"reference":[{"key":"pcbi.1011354.ref001","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1113\/jphysiol.1973.sp010273","article-title":"Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path","volume":"232","author":"TVP Bliss","year":"1973","journal-title":"J Physiol London"},{"key":"pcbi.1011354.ref002","doi-asserted-by":"crossref","first-page":"2910","DOI":"10.1523\/JNEUROSCI.13-07-02910.1993","article-title":"Bidirectional long-term modification of synaptic effectiveness in the adult and immature hippocampus","volume":"13","author":"SM Dudek","year":"1993","journal-title":"J Neurosci"},{"key":"pcbi.1011354.ref003","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1126\/science.275.5297.213","article-title":"Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs","volume":"275","author":"H Markram","year":"1997","journal-title":"Science"},{"key":"pcbi.1011354.ref004","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1016\/S0896-6273(01)00542-6","article-title":"Rate, timing, and cooperativity jointly determine cortical synaptic plasticity","volume":"32","author":"PJ Sj\u00f6str\u00f6m","year":"2001","journal-title":"Neuron"},{"key":"pcbi.1011354.ref005","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1126\/science.aan3846","article-title":"Behavioral time scale synaptic plasticity underlies CA1 place fields","volume":"357","author":"KC Bittner","year":"2017","journal-title":"Science"},{"key":"pcbi.1011354.ref006","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1038\/nature15257","article-title":"Labelling and optical erasure of synaptic memory traces in the motor cortex","volume":"525","author":"A Hayashi-Takagi","year":"2015","journal-title":"Nature"},{"key":"pcbi.1011354.ref007","doi-asserted-by":"crossref","first-page":"2554","DOI":"10.1073\/pnas.79.8.2554","article-title":"Neural networks and physical systems with emergent collective computational abilities","volume":"79","author":"JJ Hopfield","year":"1982","journal-title":"Proc Natl Acad Sci USA"},{"key":"pcbi.1011354.ref008","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511623257","volume-title":"Modeling brain function","author":"DJ Amit","year":"1989"},{"key":"pcbi.1011354.ref009","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1038\/s41583-022-00642-0","article-title":"Attractor and integrator networks in the brain","volume":"23","author":"M Khona","year":"2022","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1011354.ref010","doi-asserted-by":"crossref","first-page":"1530","DOI":"10.1103\/PhysRevLett.55.1530","article-title":"Storing infinite numbers of patterns in a spin-glass model of neural networks","volume":"55","author":"DJ Amit","year":"1985","journal-title":"Phys Rev Lett"},{"key":"pcbi.1011354.ref011","doi-asserted-by":"crossref","first-page":"2293","DOI":"10.1103\/PhysRevA.35.2293","article-title":"Information storage in neural networks with low levels of activity","volume":"35","author":"DJ Amit","year":"1987","journal-title":"Phys Rev A"},{"key":"pcbi.1011354.ref012","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1088\/0305-4470\/21\/1\/030","article-title":"The phase space of interactions in neural network models","volume":"21","author":"EJ Gardner","year":"1988","journal-title":"J Phys A: Math Gen"},{"issue":"8","key":"pcbi.1011354.ref013","doi-asserted-by":"crossref","first-page":"4732","DOI":"10.1073\/pnas.95.8.4732","article-title":"All-or-none potentiation at CA3-CA1 synapses","volume":"95","author":"CC Petersen","year":"1998","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"27","key":"pcbi.1011354.ref014","doi-asserted-by":"crossref","first-page":"9679","DOI":"10.1073\/pnas.0502332102","article-title":"Graded bidirectional synaptic plasticity is composed of switch-like unitary events","volume":"102","author":"DH O\u2019Connor","year":"2005","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"5","key":"pcbi.1011354.ref015","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1038\/s41593-018-0138-9","article-title":"Synaptic nanomodules underlie the organization and plasticity of spine synapses","volume":"21","author":"M Hruska","year":"2018","journal-title":"Nature neuroscience"},{"key":"pcbi.1011354.ref016","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1007\/BFb0057531","volume-title":"Heidelberg colloquium on glassy dynamics","author":"H Sompolinsky","year":"1987"},{"issue":"8","key":"pcbi.1011354.ref017","doi-asserted-by":"crossref","first-page":"2554","DOI":"10.1073\/pnas.79.8.2554","article-title":"Neural networks and physical systems with emergent collective computational abilities","volume":"79","author":"JJ Hopfield","year":"1982","journal-title":"Proceedings of the national academy of sciences"},{"key":"pcbi.1011354.ref018","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1142\/S0217984990000891","article-title":"Associative Memory in Neural Networks with Binary Synapses","volume":"4","author":"M Tsodyks","year":"1990","journal-title":"Mod Phys Lett B"},{"issue":"4","key":"pcbi.1011354.ref019","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1088\/0954-898X_3_4_008","article-title":"Constraints on learning in dynamic synapses","volume":"3","author":"DJ Amit","year":"1992","journal-title":"Network: Computation in Neural Systems"},{"issue":"5","key":"pcbi.1011354.ref020","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1162\/neco.1994.6.5.957","article-title":"Learning in neural networks with material synapses","volume":"6","author":"DJ Amit","year":"1994","journal-title":"Neural Computation"},{"issue":"8","key":"pcbi.1011354.ref021","doi-asserted-by":"crossref","first-page":"e1003727","DOI":"10.1371\/journal.pcbi.1003727","article-title":"Memory capacity of networks with stochastic binary synapses","volume":"10","author":"AM Dubreuil","year":"2014","journal-title":"PLoS computational biology"},{"issue":"4","key":"pcbi.1011354.ref022","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1016\/j.neuron.2005.02.001","article-title":"Cascade models of synaptically stored memories","volume":"45","author":"S Fusi","year":"2005","journal-title":"Neuron"},{"issue":"4","key":"pcbi.1011354.ref023","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1038\/nn1859","article-title":"Limits on the memory storage capacity of bounded synapses","volume":"10","author":"S Fusi","year":"2007","journal-title":"Nature neuroscience"},{"key":"pcbi.1011354.ref024","article-title":"A memory frontier for complex synapses","volume":"26","author":"S Lahiri","year":"2013","journal-title":"Advances in neural information processing systems"},{"issue":"12","key":"pcbi.1011354.ref025","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1038\/nn.4401","article-title":"Computational principles of synaptic memory consolidation","volume":"19","author":"MK Benna","year":"2016","journal-title":"Nature neuroscience"},{"key":"pcbi.1011354.ref026","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.76120","article-title":"Binary and analog variation of synapses between cortical pyramidal neurons","volume":"11","author":"S Dorkenwald","year":"2022","journal-title":"Elife"},{"issue":"9","key":"pcbi.1011354.ref027","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1051\/jphys:019860047090145700","article-title":"Solvable models of working memories","volume":"47","author":"M M\u00e9zard","year":"1986","journal-title":"Journal de physique"},{"issue":"1","key":"pcbi.1011354.ref028","doi-asserted-by":"crossref","first-page":"13107","DOI":"10.1038\/s41598-022-16407-9","article-title":"Stochastic consolidation of lifelong memory","volume":"12","author":"N Shaham","year":"2022","journal-title":"Scientific Reports"},{"issue":"2","key":"pcbi.1011354.ref029","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1209\/0295-5075\/6\/2\/002","article-title":"The enhanced storage capacity in neural networks with low activity level","volume":"6","author":"MV Tsodyks","year":"1988","journal-title":"EPL (Europhysics Letters)"},{"issue":"3","key":"pcbi.1011354.ref030","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1209\/0295-5075\/7\/3\/003","article-title":"Associative memory in asymmetric diluted network with low level of activity","volume":"7","author":"M Tsodyks","year":"1988","journal-title":"EPL (Europhysics Letters)"},{"key":"pcbi.1011354.ref031","first-page":"011009","article-title":"Forgetting leads to chaos in attractor networks","volume":"13","author":"U Pereira","year":"2022","journal-title":"Phys Rev X"},{"key":"pcbi.1011354.ref032","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1088\/0954-898X_3_4_008","article-title":"Constraints on learning in dynamics synapses","volume":"3","author":"DJ Amit","year":"1992","journal-title":"Network"},{"key":"pcbi.1011354.ref033","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1162\/neco.1994.6.5.957","article-title":"Dynamic learning in neural networks with material synapses","volume":"6","author":"DJ Amit","year":"1994","journal-title":"Neural Computation"},{"issue":"1","key":"pcbi.1011354.ref034","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/0003-4916(87)90092-3","article-title":"Statistical mechanics of neural networks near saturation","volume":"173","author":"DJ Amit","year":"1987","journal-title":"Annals of physics"},{"issue":"3","key":"pcbi.1011354.ref035","doi-asserted-by":"crossref","first-page":"2571","DOI":"10.1103\/PhysRevA.34.2571","article-title":"Neural networks with nonlinear synapses and a static noise","volume":"34","author":"H Sompolinsky","year":"1986","journal-title":"Physical Review A"},{"key":"pcbi.1011354.ref036","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1007\/BF01017556","article-title":"Learning and forgetting on asymmetric diluted neural networks","volume":"49","author":"B Derrida","year":"1987","journal-title":"J Stat Phys"},{"key":"pcbi.1011354.ref037","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1038\/nn.4401","article-title":"Computational principles of synaptic memory consolidation","volume":"19","author":"MK Benna","year":"2016","journal-title":"Nat Neurosci"},{"issue":"50","key":"pcbi.1011354.ref038","doi-asserted-by":"crossref","first-page":"13592","DOI":"10.1523\/JNEUROSCI.0603-08.2008","article-title":"Principles of long-term dynamics of dendritic spines","volume":"28","author":"N Yasumatsu","year":"2008","journal-title":"Journal of Neuroscience"},{"issue":"2","key":"pcbi.1011354.ref039","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.neuron.2005.01.003","article-title":"Transient and persistent dendritic spines in the neocortex in vivo","volume":"45","author":"AJ Holtmaat","year":"2005","journal-title":"Neuron"},{"key":"pcbi.1011354.ref040","doi-asserted-by":"crossref","first-page":"4732","DOI":"10.1073\/pnas.95.8.4732","article-title":"All-or-none potentiation at CA3-CA1 synapses","volume":"95","author":"CC Petersen","year":"1998","journal-title":"ProcNatlAcadSciUSA"},{"key":"pcbi.1011354.ref041","doi-asserted-by":"crossref","first-page":"960","DOI":"10.1038\/222960a0","article-title":"Non-holographic associative memory","volume":"222","author":"D Willshaw","year":"1969","journal-title":"Nature"},{"key":"pcbi.1011354.ref042","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1088\/0305-4470\/24\/5\/023","article-title":"Associative memory: on the (puzzling) sparse coding limit","volume":"24","author":"JP Nadal","year":"1991","journal-title":"J Phys A: Math Gen"},{"key":"pcbi.1011354.ref043","doi-asserted-by":"crossref","first-page":"e1003727","DOI":"10.1371\/journal.pcbi.1003727","article-title":"Memory capacity of networks with stochastic binary synapses","volume":"10","author":"AM Dubreuil","year":"2014","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1011354.ref044","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1016\/j.tins.2004.10.006","article-title":"Discrete synaptic states define a major mechanism of synapse plasticity","volume":"27","author":"JM Montgomery","year":"2004","journal-title":"Trends Neurosci"},{"issue":"6616","key":"pcbi.1011354.ref045","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/385533a0","article-title":"Synaptic tagging and long-term potentiation","volume":"385","author":"U Frey","year":"1997","journal-title":"Nature"},{"issue":"44","key":"pcbi.1011354.ref046","doi-asserted-by":"crossref","first-page":"9318","DOI":"10.1523\/JNEUROSCI.2119-18.2018","article-title":"Linking nanoscale dynamics of AMPA receptor organization to plasticity of excitatory synapses and learning","volume":"38","author":"D Choquet","year":"2018","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1011354.ref047","doi-asserted-by":"crossref","first-page":"2211","DOI":"10.1016\/S0006-3495(00)76469-1","article-title":"Bistability in the Ca2+\/calmodulin-dependent protein kinase-phosphatase system","volume":"79","author":"AM Zhabotinsky","year":"2000","journal-title":"Biophys J"},{"key":"pcbi.1011354.ref048","doi-asserted-by":"crossref","first-page":"e107","DOI":"10.1371\/journal.pbio.0030107","article-title":"The stability of a stochastic CaMKII switch: dependence on the number of enzyme molecules and protein turnover","volume":"3","author":"P Miller","year":"2005","journal-title":"PLoS Biol"},{"key":"pcbi.1011354.ref049","doi-asserted-by":"crossref","first-page":"e221","DOI":"10.1371\/journal.pcbi.0030221","article-title":"STDP in a bistable synapse model based on CaMKII and associated signaling pathways","volume":"3","author":"M Graupner","year":"2007","journal-title":"PLoS Comput Biol"},{"issue":"12","key":"pcbi.1011354.ref050","doi-asserted-by":"crossref","first-page":"e1000248","DOI":"10.1371\/journal.pcbi.1000248","article-title":"Tag-trigger-consolidation: a model of early and late long-term-potentiation and depression","volume":"4","author":"C Clopath","year":"2008","journal-title":"PLoS computational biology"},{"issue":"3","key":"pcbi.1011354.ref051","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1523\/JNEUROSCI.3989-14.2015","article-title":"Synaptic consolidation: from synapses to behavioral modeling","volume":"35","author":"L Ziegler","year":"2015","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"pcbi.1011354.ref052","doi-asserted-by":"crossref","first-page":"e1000259","DOI":"10.1371\/journal.pcbi.1000259","article-title":"State based model of long-term potentiation and synaptic tagging and capture","volume":"5","author":"AB Barrett","year":"2009","journal-title":"PLoS computational biology"},{"key":"pcbi.1011354.ref053","doi-asserted-by":"crossref","first-page":"78","DOI":"10.3389\/fncom.2019.00078","article-title":"Optimal stimulation protocol in a bistable synaptic consolidation model","volume":"13","author":"C Gastaldi","year":"2019","journal-title":"Frontiers in computational neuroscience"},{"key":"pcbi.1011354.ref054","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1038\/s41583-022-00624-2","article-title":"CaMKII: a central molecular organizer of synaptic plasticity, learning and memory","volume":"23","author":"R Yasuda","year":"2022","journal-title":"Nat Rev Neurosci"},{"issue":"1","key":"pcbi.1011354.ref055","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1038\/nrn2963","article-title":"Making memories last: the synaptic tagging and capture hypothesis","volume":"12","author":"RL Redondo","year":"2011","journal-title":"Nature Reviews Neuroscience"},{"key":"pcbi.1011354.ref056","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/s00109-009-0560-2","article-title":"Structural traces of past experience in the cerebral cortex","volume":"88","author":"SB Hofer","year":"2010","journal-title":"Journal of molecular medicine"},{"key":"pcbi.1011354.ref057","first-page":"1034","volume-title":"Advances in Neural Information Processing Systems","author":"S Lahiri","year":"2013"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011354","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T00:00:00Z","timestamp":1708387200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011354","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T13:37:19Z","timestamp":1708436239000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011354"}},"subtitle":[],"editor":[{"given":"Thomas","family":"Serre","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,2,7]]},"references-count":57,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,2,7]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011354","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.07.17.549266","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,7]]}}}