{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T08:03:10Z","timestamp":1771920190721,"version":"3.50.1"},"reference-count":36,"publisher":"MIT Press","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2012,11]]},"abstract":"<jats:p>Computing sparse redundant representations is an important problem in both applied mathematics and neuroscience. In many applications, this problem must be solved in an energy-efficient way. Here, we propose a hybrid distributed algorithm (HDA), which solves this problem on a network of simple nodes communicating by low-bandwidth channels. HDA nodes perform both gradient-descent-like steps on analog internal variables and coordinate-descent-like steps via quantized external variables communicated to each other. Interestingly, the operation is equivalent to a network of integrate-and-fire neurons, suggesting that HDA may serve as a model of neural computation. We show that the numerical performance of HDA is on par with existing algorithms. In the asymptotic regime, the representation error of HDA decays with time, t, as 1\/t. HDA is stable against time-varying noise; specifically, the representation error decays as 1\/[Formula: see text] for gaussian white noise.<\/jats:p>","DOI":"10.1162\/neco_a_00353","type":"journal-article","created":{"date-parts":[[2012,8,24]],"date-time":"2012-08-24T17:27:44Z","timestamp":1345829264000},"page":"2852-2872","source":"Crossref","is-referenced-by-count":16,"title":["A Network of Spiking Neurons for Computing Sparse Representations in an Energy-Efficient Way"],"prefix":"10.1162","volume":"24","author":[{"given":"Tao","family":"Hu","sequence":"first","affiliation":[{"name":"Howard Hughes Medical Institute, Janelia Farm Research Campus, Ashburn, VA 20147, U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Genkin","sequence":"additional","affiliation":[{"name":"AVG Consulting, Brooklyn, NY 11374, U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dmitri B.","family":"Chklovskii","sequence":"additional","affiliation":[{"name":"Howard Hughes Medical Institute, Janelia Farm Research Campus, Ashburn, VA 20147, U.S.A."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1097\/00004647-200110000-00001"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2007.4286571"},{"key":"B3","volume-title":"Convex optimization theory","author":"Bertsekas D. P.","year":"2009"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1001080"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511804441"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/0041-5553(67)90040-7"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1007\/s10827-007-0038-6"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1090\/S0025-5718-09-02242-X"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1090\/S0025-5718-08-02189-3"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827596304010"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)00679-7"},{"key":"B13","volume-title":"Convex optimization and Euclidean distance geometry","author":"Dattorro J.","year":"2008"},{"key":"B14","volume-title":"Theoretical neuroscience: computational and mathematical modeling of neural systems","author":"Dayan P.","year":"2001"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-21-07940.2003"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1214\/009053604000000067"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1117\/12.741299"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1214\/07-AOAS131"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1126\/science.287.5456.1273"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1198\/004017007000000245"},{"key":"B22","volume-title":"Advances in neural information processing systems","volume":"23","author":"Kavukcuoglu K.","year":"2010"},{"key":"B23","volume-title":"Biophysics of computation","author":"Koch C.","year":"1999"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1126\/science.1089662"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1016\/S0960-9822(03)00135-0"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.3934\/ipi.2009.3.487"},{"key":"B27","first-page":"19","volume":"11","author":"Mairal J.","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1038\/nn0901-877"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1038\/381607a0"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2004.07.007"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.4310\/CMS.2010.v8.n1.a6"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(88)90015-X"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2008.03-07-486"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017052"},{"issue":"1","key":"B36","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","volume":"58","author":"Tibshirani R.","year":"1996","journal-title":"Journal of the Royal Statistical Society Series B-Methodological"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1109\/MP.2003.1197877"},{"key":"B38","first-page":"2543","volume":"11","author":"Xiao L.","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00353","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,28]],"date-time":"2024-04-28T18:03:02Z","timestamp":1714327382000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/24\/11\/2852-2872\/7822"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,11]]},"references-count":36,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2012,11]]}},"alternative-id":["10.1162\/NECO_a_00353"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00353","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,11]]}}}