{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T12:25:25Z","timestamp":1784204725470,"version":"3.55.0"},"reference-count":102,"publisher":"MIT Press - Journals","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2010,2]]},"abstract":"<jats:p> Neural associative networks with plastic synapses have been proposed as computational models of brain functions and also for applications such as pattern recognition and information retrieval. To guide biological models and optimize technical applications, several definitions of memory capacity have been used to measure the efficiency of associative memory. Here we explain why the currently used performance measures bias the comparison between models and cannot serve as a theoretical benchmark. We introduce fair measures for information-theoretic capacity in associative memory that also provide a theoretical benchmark. <\/jats:p><jats:p> In neural networks, two types of manipulating synapses can be discerned: synaptic plasticity, the change in strength of existing synapses, and structural plasticity, the creation and pruning of synapses. One of the new types of memory capacity we introduce permits quantifying how structural plasticity can increase the network efficiency by compressing the network structure, for example, by pruning unused synapses. Specifically, we analyze operating regimes in the Willshaw model in which structural plasticity can compress the network structure and push performance to the theoretical benchmark. The amount C of information stored in each synapse can scale with the logarithm of the network size rather than being constant, as in classical Willshaw and Hopfield nets (\u2a7d ln 2 \u2248 0.7). Further, the review contains novel technical material: a capacity analysis of the Willshaw model that rigorously controls for the level of retrieval quality, an analysis for memories with a nonconstant number of active units (where C \u2a7d 1\/eln 2 \u2248 0.53), and the analysis of the computational complexity of associative memories with and without network compression. <\/jats:p>","DOI":"10.1162\/neco.2009.08-07-588","type":"journal-article","created":{"date-parts":[[2009,11,20]],"date-time":"2009-11-20T01:19:56Z","timestamp":1258679996000},"page":"289-341","source":"Crossref","is-referenced-by-count":108,"title":["Memory Capacities for Synaptic and Structural Plasticity"],"prefix":"10.1162","volume":"22","author":[{"given":"Andreas","family":"Knoblauch","sequence":"first","affiliation":[{"name":"Honda Research Institute Europe GmbH, D-63073 Offenbach, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G\u00fcnther","family":"Palm","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Neuroinformatik, Fakult\u00e4t f\u00fcr Ingenieurwissenschaften und Informatik, Universit\u00e4t Ulm, D-89069 Ulm, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Friedrich T.","family":"Sommer","sequence":"additional","affiliation":[{"name":"University of California at Berkeley, Redwood Center for Theoretical Neuroscience, Berkeley, CA 94720-3220, U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-81708-3"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1993.70.4.1629"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/0025-5564(71)90051-4"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(89)90043-9"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.35.2293"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/0003-4916(87)90092-3"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1007\/BF00288902"},{"key":"B8","volume-title":"Associative neural memories","author":"Anderson J.","year":"1993"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.84.5.413"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1126\/science.273.5283.1868"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1097\/00004647-200110000-00001"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1162\/0899766053019962"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1068\/p010371"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(89)90038-5"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1002\/hipo.10093"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008925909305"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00035-5"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-93083-6_9"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-02728-8"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_3_4_005"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_4_4_003"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2003.816367"},{"key":"B25","first-page":"531","volume-title":"Handbook of biological physics","volume":"4","author":"Coolen A.","year":"2001"},{"key":"B26","first-page":"597","volume-title":"Handbook of biological physics","volume":"4","author":"Coolen A.","year":"2001"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1002\/0471200611"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1007\/BF00206223"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1038\/990101"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1038\/19978"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X\/9\/2\/006"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X\/4\/4\/006"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2005.02.001"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1088\/0305-4470\/21\/1\/031"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.1976.0084"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.41.1843"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1966.1053907"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1007\/BF00202789"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_8_1_005"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1109\/SFCS.1994.365720"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1038\/nature00974"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.1990.137621"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1007\/0-387-28487-7_6"},{"key":"B44","volume-title":"The organization of behavior: A neuropsychological theory","author":"Hebb D.","year":"1949"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1023\/A:1013707829174"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1007\/PL00007964"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/11\/5\/003"},{"key":"B48","volume-title":"Introduction to the theory of neural computation","author":"Hertz J.","year":"1991"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.79.8.2554"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.81.10.3088"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1126\/science.3755256"},{"key":"B52","first-page":"1098","volume":"40","author":"Huffman D.","year":"1952","journal-title":"Proceedings of the Institute of Radio Engineers"},{"key":"B53","volume-title":"Sparse distributed memory","author":"Kanerva P.","year":"1988"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44989-2_39"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipl.2005.05.021"},{"key":"B57","volume-title":"On compressing the memory structures of binary neural associative networks","author":"Knoblauch A.","year":"2006"},{"key":"B58","volume-title":"Asymptotic conditions for high-capacity neural associative networks","author":"Knoblauch A.","year":"2007"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1137\/070700012"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1142\/9789812834232_0007"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(01)00084-3"},{"key":"B62","volume-title":"Performance characteristics of sparsely and densely potentiated associative networks","author":"Knoblauch A.","year":"2008"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-96384-1"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1301"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1162\/089976604323057434"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1126\/science.1089662"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1038\/nrn964"},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.1016\/S0960-9822(03)00135-0"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.1016\/0025-5564(74)90031-5"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.1971.0078"},{"key":"B72","volume-title":"Perceptrons: An introduction to computational geometry","author":"Minsky M.","year":"1969"},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.1007\/s11063-006-9001-1"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.1088\/0305-4470\/24\/5\/023"},{"key":"B75","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_1_1_005"},{"key":"B76","doi-asserted-by":"publisher","DOI":"10.1007\/BF00337019"},{"key":"B77","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-81792-2"},{"key":"B78","doi-asserted-by":"publisher","DOI":"10.1126\/science.235.4793.1227b"},{"key":"B79","first-page":"133","volume":"1","author":"Palm G.","year":"1990","journal-title":"Concepts in Neuroscience"},{"key":"B80","first-page":"97","volume":"2","author":"Palm G.","year":"1991","journal-title":"Concepts in Neuroscience"},{"key":"B81","volume-title":"Proceedings of the 2nd International Conference on Microelectronics for Neural Networks","author":"Palm G.","year":"1991"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_3_2_006"},{"key":"B83","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0723-8_3"},{"key":"B84","doi-asserted-by":"publisher","DOI":"10.1126\/science.1070502"},{"key":"B85","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(01)00252-5"},{"key":"B86","doi-asserted-by":"publisher","DOI":"10.1016\/0885-2308(89)90015-6"},{"key":"B87","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511615528"},{"key":"B88","doi-asserted-by":"publisher","DOI":"10.1038\/nature03687"},{"key":"B89","doi-asserted-by":"publisher","DOI":"10.1162\/089976601300014592"},{"key":"B90","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2005.12.080"},{"key":"B91","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-1063(1996)6:6<601::AID-HIPO5>3.0.CO;2-J"},{"key":"B92","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(95)00112-3"},{"key":"B93","volume-title":"The mathematical theory of communication","author":"Shannon C.","year":"1949"},{"key":"B94","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.13-01-00334.1993"},{"key":"B95","doi-asserted-by":"publisher","DOI":"10.1109\/72.701183"},{"key":"B96","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00125-7"},{"key":"B97","doi-asserted-by":"publisher","DOI":"10.1007\/BF00293853"},{"key":"B98","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)00652-9"},{"key":"B99","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X\/2\/4\/004"},{"key":"B100","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/6\/2\/002"},{"key":"B101","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2101-06.2006"},{"key":"B102","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-61510-5_78"},{"key":"B103","doi-asserted-by":"publisher","DOI":"10.1038\/222960a0"},{"key":"B104","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195159561.003.0009"},{"key":"B105","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4695(199610)31:2<219::AID-NEU7>3.0.CO;2-E"},{"key":"B106","first-page":"339","volume-title":"Dendrites","author":"Woolley C.","year":"1999"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/neco.2009.08-07-588","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:37:34Z","timestamp":1615585054000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/22\/2\/289-341\/7537"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,2]]},"references-count":102,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2010,2]]}},"alternative-id":["10.1162\/neco.2009.08-07-588"],"URL":"https:\/\/doi.org\/10.1162\/neco.2009.08-07-588","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,2]]}}}