{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,18]],"date-time":"2026-01-18T09:26:04Z","timestamp":1768728364662,"version":"3.49.0"},"reference-count":38,"publisher":"MIT Press","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2012,11]]},"abstract":"<jats:p>We introduce a probabilistic model that combines a classifier with an extra reinforcement signal (RS) encoding the probability of an erroneous feedback being delivered by the classifier. This representation computes the class probabilities given the task related features and the reinforcement signal. Using expectation maximization (EM) to estimate the parameter values under such a model shows that some existing adaptive classifiers are particular cases of such an EM algorithm. Further, we present a new algorithm for adaptive classification, which we call constrained means adaptive classifier, and show using EEG data and simulated RS that this classifier is able to significantly outperform state-of-the-art adaptive classifiers.<\/jats:p>","DOI":"10.1162\/neco_a_00348","type":"journal-article","created":{"date-parts":[[2012,7,30]],"date-time":"2012-07-30T15:28:25Z","timestamp":1343662105000},"page":"2900-2923","source":"Crossref","is-referenced-by-count":29,"title":["Adaptive Classification on Brain-Computer Interfaces Using Reinforcement Signals"],"prefix":"10.1162","volume":"24","author":[{"given":"A.","family":"Llera","sequence":"first","affiliation":[{"name":"Radboud University Nijmegen, the Netherlands, and Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Gelderland 6525 EZ, Netherlands"}]},{"given":"V.","family":"G\u00f3mez","sequence":"additional","affiliation":[{"name":"Radboud University Nijmegen, the Netherlands, and Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Gelderland 6525 EZ, Netherlands"}]},{"given":"H. J.","family":"Kappen","sequence":"additional","affiliation":[{"name":"Radboud University Nijmegen, the Netherlands, and Donders Institute for Brain, Cognition and Behaviour, Nijmegen, Gelderland 6525 EZ, Netherlands"}]}],"member":"281","reference":[{"key":"B1","volume-title":"Pattern recognition and machine learning","author":"Bishop C. M.","year":"2007"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2004.826692"},{"key":"B3","first-page":"113","volume-title":"Advances in neural information processing systems","volume":"20","author":"Blankertz B.","year":"2008"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2007.4352845"},{"key":"B5","first-page":"777","volume-title":"Proceedings of the International Conference on Cognitive Neurodynamics","author":"Chavarriaga R.","year":"2007"},{"key":"B6","volume-title":"Theoretical neuroscience: Computational and mathematical modeling of neural systems","author":"Dayan P.","year":"2001"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2007.908083"},{"key":"B9","volume-title":"Introduction to statistical pattern recognition","author":"Fukunaga K.","year":"1990"},{"key":"B10","first-page":"50","volume-title":"Proceedings of the 3rd International Workshop on Brain-Computer Interfaces","author":"Gan J. G.","year":"2006"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1109\/NER.2009.5109291"},{"key":"B12","volume-title":"Sequential EM for unsupervised adaptive gaussian mixture model based classifier","author":"Hasan B.A.S.","year":"2009"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.1991.155285"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.44.2718"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.45.8885"},{"key":"B16","first-page":"54","volume-title":"In Proceedings of the 3rd International Brain-Computer Interface Workshop and Training Course 2006","author":"Kawanabe M.","year":"2006"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2010.5626233"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2005.851521"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.11.2730"},{"key":"B21","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1002\/cnm.1362","volume":"26","author":"Liu G.","year":"2010","journal-title":"International Journal for Numerical Methods in Biomedical Engineering"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2011.05.006"},{"key":"B23","first-page":"2877","volume":"4","author":"Mill\u00e1n J. del R.","year":"2004","journal-title":"IEEE Proc. of the Int. Joint Conf. on Neural Networks"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/S1388-2457(98)00038-8"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1109\/86.895946"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1037\/h0024109"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2011.6091139"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/9\/2\/026013"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/3\/1\/R02"},{"key":"B30","volume-title":"Reinforcement learning: An introduction","author":"Sutton R. S.","year":"1998"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2004.824128"},{"key":"B32","first-page":"65","volume-title":"Proceedings of 2006 Workshop on Information-Based Induction Sciences","author":"Tomioka R.","year":"2006"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2009.01.016"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1007\/s10548-009-0121-6"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2010.2093133"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00089"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2006.873542"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1109\/IEMBS.2010.5626537"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1016\/S1388-2457(02)00057-3"},{"key":"B40","first-page":"302","volume-title":"Proceedings of the 17th IEEE International Conference on Tools with Artificial Intelligence","author":"Zhou Y.","year":"2005"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00348","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,27]],"date-time":"2024-04-27T23:15:43Z","timestamp":1714259743000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/24\/11\/2900-2923\/7821"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,11]]},"references-count":38,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2012,11]]}},"alternative-id":["10.1162\/NECO_a_00348"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00348","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,11]]}}}