{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T05:09:55Z","timestamp":1772082595652,"version":"3.50.1"},"reference-count":29,"publisher":"World Scientific Pub Co Pte Lt","issue":"05","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2014,8]]},"abstract":"<jats:p>Population coding is widely regarded as a key mechanism for achieving reliable behavioral decisions. We previously introduced reinforcement learning for population-based decision making by spiking neurons. Here we generalize population reinforcement learning to spike-based plasticity rules that take account of the postsynaptic neural code. We consider spike\/no-spike, spike count and spike latency codes. The multi-valued and continuous-valued features in the postsynaptic code allow for a generalization of binary decision making to multi-valued decision making and continuous-valued action selection. We show that code-specific learning rules speed up learning both for the discrete classification and the continuous regression tasks. The suggested learning rules also speed up with increasing population size as opposed to standard reinforcement learning rules. Continuous action selection is further shown to explain realistic learning speeds in the Morris water maze. Finally, we introduce the concept of action perturbation as opposed to the classical weight- or node-perturbation as an exploration mechanism underlying reinforcement learning. Exploration in the action space greatly increases the speed of learning as compared to exploration in the neuron or weight space.<\/jats:p>","DOI":"10.1142\/s0129065714500026","type":"journal-article","created":{"date-parts":[[2013,11,12]],"date-time":"2013-11-12T11:46:55Z","timestamp":1384256815000},"page":"1450002","source":"Crossref","is-referenced-by-count":38,"title":["CODE-SPECIFIC LEARNING RULES IMPROVE ACTION SELECTION BY POPULATIONS OF SPIKING NEURONS"],"prefix":"10.1142","volume":"24","author":[{"given":"JOHANNES","family":"FRIEDRICH","sequence":"first","affiliation":[{"name":"Institute of Physiology, University of Bern, B\u00fchlplatz 5, 3012 Bern, Switzerland"},{"name":"Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Trumpington Street, Cambridge CB2 1PZ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ROBERT","family":"URBANCZIK","sequence":"additional","affiliation":[{"name":"Institute of Physiology, University of Bern, B\u00fchlplatz 5, 3012 Bern, Switzerland"},{"name":"Center for Cognition, Learning and Memory, University of Bern, Factory Street 8, CH-3012 Bern, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"WALTER","family":"SENN","sequence":"additional","affiliation":[{"name":"Institute of Physiology, University of Bern, B\u00fchlplatz 5, 3012 Bern, Switzerland"},{"name":"Center for Cognition, Learning and Memory, University of Bern, Factory Street 8, CH-3012 Bern, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2014,5,30]]},"reference":[{"key":"rf1","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5297.213"},{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.18-24-10464.1998"},{"key":"rf3","doi-asserted-by":"publisher","DOI":"10.1016\/0959-4388(94)90059-0"},{"key":"rf4","doi-asserted-by":"publisher","DOI":"10.1080\/13506289508401721"},{"key":"rf5","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065706000524"},{"key":"rf6","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065709002002"},{"key":"rf7","doi-asserted-by":"publisher","DOI":"10.1038\/35039062"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1888"},{"key":"rf9","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2264"},{"key":"rf10","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2010.05-09-1010"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002691"},{"key":"rf12","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065710002565"},{"key":"rf13","unstructured":"H.\u00a0Sprekeler, G.\u00a0Hennequin and W.\u00a0Gerstner, Advances in Neural Information Processing Systems 22, eds. Y.\u00a0Bengio (2009)\u00a0pp. 1741\u20131749."},{"key":"rf14","first-page":"229","volume":"8","author":"Williams R. J.","journal-title":"Mach. Learn."},{"key":"rf15","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.6.1318"},{"key":"rf16","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.6.1468"},{"key":"rf17","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.97.048104"},{"key":"rf18","unstructured":"D.\u00a0Di Castro, D.\u00a0Volkinshtein and R.\u00a0Meir, Advances in Neural Information Processing Systems 21, eds. D.\u00a0Koller (2008)\u00a0pp. 385\u2013392."},{"key":"rf19","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/2190-8567-2-2","volume":"2","author":"Schiess M.","journal-title":"J. Math. Neurosci."},{"key":"rf20","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.041909"},{"key":"rf21","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065712500128"},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00761-X"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065706000548"},{"key":"rf24","doi-asserted-by":"publisher","DOI":"10.1038\/297681a0"},{"key":"rf25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1000586"},{"key":"rf26","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002092"},{"key":"rf27","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003024"},{"key":"rf28","doi-asserted-by":"publisher","DOI":"10.1162\/089976605774320539"},{"key":"rf29","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2479"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065714500026","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,8,7]],"date-time":"2020-08-07T19:54:55Z","timestamp":1596830095000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0129065714500026"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,5,30]]},"references-count":29,"journal-issue":{"issue":"05","published-online":{"date-parts":[[2014,5,30]]},"published-print":{"date-parts":[[2014,8]]}},"alternative-id":["10.1142\/S0129065714500026"],"URL":"https:\/\/doi.org\/10.1142\/s0129065714500026","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,5,30]]}}}