{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T21:25:57Z","timestamp":1648675557392},"reference-count":65,"publisher":"MIT Press - Journals","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2017,5]]},"abstract":"<jats:p> The connection density of nearby neurons in the cortex has been observed to be around 0.1, whereas the longer-range connections are present with much sparser density (Kalisman, Silberberg, &amp; Markram, 2005 ). We propose a memory association model that qualitatively explains these empirical observations. The model we consider is a multiassociative, sparse, Willshaw-like model consisting of binary threshold neurons and binary synapses. It uses recurrent synapses for iterative retrieval of stored memories. We quantify the usefulness of recurrent synapses by simulating the model for small network sizes and by doing a precise mathematical analysis for large network sizes. Given the network parameters, we can determine the precise values of recurrent and afferent synapse densities that optimize the storage capacity of the network. If the network size is like that of a cortical column, then the predicted optimal recurrent density lies in a range that is compatible with biological measurements. Furthermore, we show that our model is able to surpass the standard Willshaw model in the multiassociative case if the information capacity is normalized per strong synapse or per bits required to store the model, as considered in Knoblauch, Palm, and Sommer ( 2010 ). <\/jats:p>","DOI":"10.1162\/neco_a_00954","type":"journal-article","created":{"date-parts":[[2017,3,23]],"date-time":"2017-03-23T20:38:01Z","timestamp":1490301481000},"page":"1375-1405","source":"Crossref","is-referenced-by-count":2,"title":["Multiassociative Memory: Recurrent Synapses Increase Storage Capacity"],"prefix":"10.1162","volume":"29","author":[{"given":"Marcelo Matheus","family":"Gauy","sequence":"first","affiliation":[{"name":"Department of Computer Science, Institute of Theoretical Computer Science, ETH Zurich, Zurich 8092, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florian","family":"Meier","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Institute of Theoretical Computer Science, ETH Zurich, Zurich 8092, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Angelika","family":"Steger","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Institute of Theoretical Computer Science, ETH Zurich, Zurich 8092, Switzerland, and Collegium Helveticum, Zurich 8090, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511574566"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X00040164"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1994.6.5.957"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1097\/00004647-200110000-00001"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1017\/S0305004100061806"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.88.24.11569"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1400-04.2004"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00035-5"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-93083-6_9"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1038\/nn1228"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_4_4_003"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1002\/0471200611.ch12"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2014.00140"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_9_2_006"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1007\/BF00344251"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.08-08-02928.1988"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2008.12.012"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1007\/BF00202789"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_8_1_005"},{"key":"B20","volume-title":"The organization of behavior: A neuropsychological theory","author":"Hebb D. O.","year":"1949"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.2003.044784"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.79.8.2554"},{"key":"B23","volume-title":"Random graphs","author":"Janson S.","year":"2011"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1214\/11-AAP822"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0407088102"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.1965.0016"},{"key":"B27","author":"Knoblauch A.","year":"2004","journal-title":"Synchronization and pattern separation in spiking associative memories and visual cortical areas"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipl.2005.05.021"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1137\/070700012"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2010.5596604"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00795"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2009.08-07-588"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.3389\/fnana.2016.00063"},{"key":"B34","first-page":"1097","volume-title":"Advances in neural information processing systems, 25","author":"Krizhevsky A.","year":"2012"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2008.12.002"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1162\/089976604323057434"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1126\/science.1089662"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2008.12.020"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2010.06.015"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1016\/S0960-9822(03)00135-0"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1997.sp022031"},{"key":"B42","volume-title":"Simple memory: A theory for archicortex","author":"Marr D.","year":"1991"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.11-01-00072.1991"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1007\/BF02478259"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2004.10.006"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/120.4.701"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0502332102"},{"issue":"1","key":"B48","first-page":"133","volume":"1","author":"Palm G.","year":"1990","journal-title":"Concepts in Neuroscience"},{"key":"B49","volume-title":"Neural assemblies: An alternative approach to artificial intelligence","author":"Palm G.","year":"2012"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0723-8_3"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1016051108"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.95.8.4732"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1038\/nature03687"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-1063(1996)6:6<601::AID-HIPO5>3.0.CO;2-J"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(95)00112-3"},{"key":"B56","volume-title":"The mathematical theory of communication","author":"Shannon C. E.","year":"1949"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(01)00542-6"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1109\/72.701183"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00125-7"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1016\/j.heares.2009.03.012"},{"issue":"1","key":"B61","first-page":"36","volume":"1","author":"Steinbuch K.","year":"1961","journal-title":"Biological Cybernetics"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1038\/371704a0"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.01.1.1.002.2007"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00629.2013"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1038\/222960a0"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00954","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:41:52Z","timestamp":1615585312000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/29\/5\/1375-1405\/8277"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5]]},"references-count":65,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2017,5]]}},"alternative-id":["10.1162\/NECO_a_00954"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00954","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,5]]}}}