{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T00:49:51Z","timestamp":1775954991035,"version":"3.50.1"},"reference-count":55,"publisher":"MIT Press - Journals","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2014,11]]},"abstract":"<jats:p> Recent advances in associative memory design through structured pattern sets and graph-based inference algorithms have allowed reliable learning and recall of an exponential number of patterns that satisfy certain subspace constraints. Although these designs correct external errors in recall, they assume neurons that compute noiselessly, in contrast to the highly variable neurons in brain regions thought to operate associatively, such as hippocampus and olfactory cortex. Here we consider associative memories with boundedly noisy internal computations and analytically characterize performance. As long as the internal noise level is below a specified threshold, the error probability in the recall phase can be made exceedingly small. More surprising, we show that internal noise improves the performance of the recall phase while the pattern retrieval capacity remains intact: the number of stored patterns does not reduce with noise (up to a threshold). Computational experiments lend additional support to our theoretical analysis. This work suggests a functional benefit to noisy neurons in biological neuronal networks. <\/jats:p>","DOI":"10.1162\/neco_a_00655","type":"journal-article","created":{"date-parts":[[2014,8,23]],"date-time":"2014-08-23T02:29:02Z","timestamp":1408760942000},"page":"2493-2526","source":"Crossref","is-referenced-by-count":15,"title":["Noise Facilitation in Associative Memories of Exponential Capacity"],"prefix":"10.1162","volume":"26","author":[{"given":"Amin","family":"Karbasi","sequence":"first","affiliation":[{"name":"Yale University, New Haven, CT 06511, U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amir Hesam","family":"Salavati","sequence":"additional","affiliation":[{"name":"Ecole Polytechnique Federale de Lausanne, Lausanne 1015, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amin","family":"Shokrollahi","sequence":"additional","affiliation":[{"name":"Ecole Polytechnique Federale de Lausanne, Lausanne 1015, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lav R.","family":"Varshney","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL 61801, U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","author":"Amit D. J.","year":"1992","journal-title":"Modeling brain function"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1994.6.5.957"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1109\/18.87008"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.5.1344"},{"key":"B5","author":"Biswas S.","year":"1993","journal-title":"A performance analysis of sparse neural associative memory"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2004.08.023"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2006.885507"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2007.893757"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1995.7.5.889"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2008.20.1.91"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-79020-6"},{"key":"B12","author":"Doya K.","year":"2007","journal-title":"Bayesian brain: Probabilistic approaches to neural coding"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2012.08.058"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2258"},{"key":"B15","first-page":"2555","volume-title":"Advances in neural information processing systems","volume":"24","author":"Fletcher A. K.","year":"2011"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2011.2146789"},{"key":"B17","author":"Hebb D.\u00a0O.","year":"1949","journal-title":"The organization of behavior: A neuropsychological theory"},{"key":"B18","first-page":"282","volume-title":"Parallel distributed processing: Explorations in the microfoundations of cognition, Vol. 1: Foundations","author":"Hinton G.\u00a0E.","year":"1986"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.79.8.2554"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1109\/72.548176"},{"key":"B21","first-page":"445","author":"Karbasi A.","year":"2013","journal-title":"Proc. 30th Int. Conf. Mach. Learn. (ICML 2013)"},{"key":"B22","author":"Koch C.","year":"1999","journal-title":"Biophysics of computation: Information processing in single neurons"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2011.07.031"},{"issue":"3","key":"B24","first-page":"100","volume":"9","author":"Kuznetsov A.\u00a0V.","year":"1973","journal-title":"Probl. Inf. Transm."},{"key":"B25","first-page":"1279","volume-title":"Advances in neural information processing systems","volume":"23","author":"Le Q. V.","year":"2010"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2006.878786"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065795000032"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2009.05-08-783"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1109\/18.910575"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1038\/nn1790"},{"issue":"3","key":"B31","first-page":"143","volume":"3","author":"Mackworth N.\u00a0H.","year":"1946","journal-title":"Br. J. Ind. Med."},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3061"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1987.1057328"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2003.813844"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2004.07.007"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1007\/BF00337019"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1007\/BF00337115"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511791338"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199587865.001.0001"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2012.6283014"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017052"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1948.tb00917.x"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0030068"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1145\/990308.990310"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2009.09.005"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1109\/TCOMM.2013.031213.120153"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1002\/j.1538-7305.1968.tb01087.x"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1002\/hipo.450040319"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2011.2145870"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2006.10.017"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-2696-4_6"},{"key":"B52","first-page":"1096","author":"Vincent P.","year":"2008","journal-title":"Proc. 25th Int. Conf. Mach. Learn. (ICML 2008)"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2011.10.027"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065791000169"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(02)00092-8"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00655","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:40:31Z","timestamp":1615585231000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/26\/11\/2493-2526\/8013"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,11]]},"references-count":55,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2014,11]]}},"alternative-id":["10.1162\/NECO_a_00655"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00655","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,11]]}}}