{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T07:54:43Z","timestamp":1767167683499,"version":"build-2238731810"},"reference-count":42,"publisher":"MIT Press","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2009,4]]},"abstract":"<jats:p>In this theoretical contribution, we provide mathematical proof that two of the most important classes of network learning\u2014correlation-based differential Hebbian learning and reward-based temporal difference learning\u2014are asymptotically equivalent when timing the learning with a modulatory signal. This opens the opportunity to consistently reformulate most of the abstract reinforcement learning framework from a correlation-based perspective more closely related to the biophysics of neurons.<\/jats:p>","DOI":"10.1162\/neco.2008.04-08-750","type":"journal-article","created":{"date-parts":[[2008,11,19]],"date-time":"2008-11-19T17:51:05Z","timestamp":1227117065000},"page":"1173-1202","source":"Crossref","is-referenced-by-count":10,"title":["On the Asymptotic Equivalence Between Differential Hebbian and Temporal Difference Learning"],"prefix":"10.1162","volume":"21","author":[{"given":"Christoph","family":"Kolodziejski","sequence":"first","affiliation":[{"name":"Bernstein Center for Computational Neuroscience, University of G\u00f6ttingen, 37073 G\u00f6ttingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bernd","family":"Porr","sequence":"additional","affiliation":[{"name":"Department of Electronics and Electrical Engineering, University of Glasgow, Glasgow, Scotland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florentin","family":"W\u00f6rg\u00f6tter","sequence":"additional","affiliation":[{"name":"Bernstein Center for Computational Neuroscience, University of G\u00f6ttingen, 37073 G\u00f6ttingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA280862"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.807"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(00)01851-9"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1007\/BF00993978"},{"key":"B5","first-page":"1073","volume-title":"Advances in neural information processing systems","volume":"8","author":"Doya K.","year":"1996"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1016\/S0959-4388(00)00153-7"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.89.10.4363"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.6.1468"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1038\/383076a0"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1006\/nlme.1998.3843"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1152\/jn.2001.85.6.2477"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.79.8.2554"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhl152"},{"issue":"2","key":"B14","doi-asserted-by":"crossref","first-page":"85","DOI":"10.3758\/BF03333113","volume":"16","author":"Klopf A. H.","year":"1988","journal-title":"Psychobiol."},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-007-0209-6"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1063\/1.36225"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4684-9352-8"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1109\/2.36"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5297.213"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2004.06.012"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1038\/nn1743"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1007\/BF00275687"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4402-07.2008"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2003.1273"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.10.2694"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2008.08-07-593"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1162\/089976601750541787"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2022"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008910918445"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-008-0265-6"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1998.80.1.1"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.12-12-04595.1992"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007678930559"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1007\/BF00115009"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.88.2.135"},{"key":"B37","volume-title":"Reinforcement learning: An introduction","author":"Sutton R.","year":"1998"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1007\/s10827-008-0094-6"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1109\/9.580874"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.21236\/AD0241531"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30115-8_44"}],"updated-by":[{"DOI":"10.1162\/neco.2009.21.10.2990c","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2009,10,1]],"date-time":"2009-10-01T00:00:00Z","timestamp":1254355200000}}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/neco.2008.04-08-750","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,21]],"date-time":"2023-05-21T02:13:05Z","timestamp":1684635185000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/21\/4\/1173-1202\/7408"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,4]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2009,4]]}},"alternative-id":["10.1162\/neco.2008.04-08-750"],"URL":"https:\/\/doi.org\/10.1162\/neco.2008.04-08-750","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,4]]}}}