{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T09:49:51Z","timestamp":1764841791191,"version":"3.37.3"},"reference-count":23,"publisher":"Wiley","license":[{"start":{"date-parts":[[2015,1,1]],"date-time":"2015-01-01T00:00:00Z","timestamp":1420070400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"funder":[{"DOI":"10.13039\/100000185","name":"DARPA","doi-asserted-by":"crossref","award":["N66001-10-C-2008"],"award-info":[{"award-number":["N66001-10-C-2008"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Intelligence and Neuroscience"],"published-print":{"date-parts":[[2015]]},"abstract":"<jats:p>We study the feasibility and capability of the kernel temporal difference (KTD)(<mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"M1\"><mml:mrow><mml:mi>\u03bb<\/mml:mi><\/mml:mrow><\/mml:math>) algorithm for neural decoding. KTD(<mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" id=\"M2\"><mml:mrow><mml:mi>\u03bb<\/mml:mi><\/mml:mrow><\/mml:math>) is an online, kernel-based learning algorithm, which has been introduced to estimate value functions in reinforcement learning. This algorithm combines kernel-based representations with the temporal difference approach to learning. One of our key observations is that by using strictly positive definite kernels, algorithm\u2019s convergence can be guaranteed for policy evaluation. The algorithm\u2019s nonlinear functional approximation capabilities are shown in both simulations of policy evaluation and neural decoding problems (policy improvement). KTD can handle high-dimensional neural states containing spatial-temporal information at a reasonable computational complexity allowing real-time applications. When the algorithm seeks a proper mapping between a monkey\u2019s neural states and desired positions of a computer cursor or a robot arm, in both open-loop and closed-loop experiments, it can effectively learn the neural state to action mapping. Finally, a visualization of the coadaptation process between the decoder and the subject shows the algorithm\u2019s capabilities in reinforcement learning brain machine interfaces.<\/jats:p>","DOI":"10.1155\/2015\/481375","type":"journal-article","created":{"date-parts":[[2015,3,17]],"date-time":"2015-03-17T18:39:15Z","timestamp":1426617555000},"page":"1-17","source":"Crossref","is-referenced-by-count":10,"title":["Kernel Temporal Differences for Neural Decoding"],"prefix":"10.1155","volume":"2015","author":[{"given":"Jihye","family":"Bae","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Luis G.","family":"Sanchez Giraldo","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Eric A.","family":"Pohlmeyer","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, University of Miami, Coral Gables, FL 33146, USA"}]},{"given":"Joseph T.","family":"Francis","sequence":"additional","affiliation":[{"name":"Department of Physiology and Pharmacology, Robert F. Furchgott Center for Neural & Behavioral Science, SUNY Downstate Medical Center, Brooklyn, NY 11203, USA"}]},{"given":"Justin C.","family":"Sanchez","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, University of Miami, Coral Gables, FL 33146, USA"}]},{"given":"Jos\u00e9 C.","family":"Pr\u00edncipe","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL 32611, USA"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2008.926699"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0087253"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/10\/6\/066008"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1007\/BF00115009"},{"key":"8","first-page":"33","volume":"22","year":"1996","journal-title":"Machine Learning"},{"first-page":"441","volume-title":"ilstd: eligibility traces and convergence analysis","year":"2007","key":"9"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1109\/9.580874"},{"year":"2009","key":"13"},{"year":"2002","key":"14"},{"issue":"9","key":"16","first-page":"54","volume":"11","year":"2005","journal-title":"International Journal of Information Technology"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2004.830985"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2011.2178446"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2013.2270561"},{"year":"1998","key":"24"},{"year":"2010","key":"25"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.1909.0016"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1007\/bf00993978"},{"volume":"26","year":"1978","series-title":"Applied Mathematical Sciences","key":"28"},{"key":"30"},{"key":"31","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2013.02.012"},{"key":"32","doi-asserted-by":"publisher","DOI":"10.1109\/tnn.2009.2033676"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1023\/a:1017936530646"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1007\/bf00992698"}],"container-title":["Computational Intelligence and Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2015\/481375.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2015\/481375.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2015\/481375.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2016,8,18]],"date-time":"2016-08-18T15:02:01Z","timestamp":1471532521000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.hindawi.com\/journals\/cin\/2015\/481375\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015]]},"references-count":23,"alternative-id":["481375","481375"],"URL":"https:\/\/doi.org\/10.1155\/2015\/481375","relation":{},"ISSN":["1687-5265","1687-5273"],"issn-type":[{"type":"print","value":"1687-5265"},{"type":"electronic","value":"1687-5273"}],"subject":[],"published":{"date-parts":[[2015]]}}}