{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,26]],"date-time":"2026-04-26T05:40:36Z","timestamp":1777182036379,"version":"3.51.4"},"reference-count":43,"publisher":"World Scientific Pub Co Pte Lt","issue":"04","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2009,8]]},"abstract":"<jats:p> This paper presents a new methodology for automatically learning an optimal neurostimulation strategy for the treatment of epilepsy. The technical challenge is to automatically modulate neurostimulation parameters, as a function of the observed EEG signal, so as to minimize the frequency and duration of seizures. The methodology leverages recent techniques from the machine learning literature, in particular the reinforcement learning paradigm, to formalize this optimization problem. We present an algorithm which is able to automatically learn an adaptive neurostimulation strategy directly from labeled training data acquired from animal brain tissues. Our results suggest that this methodology can be used to automatically find a stimulation strategy which effectively reduces the incidence of seizures, while also minimizing the amount of stimulation applied. This work highlights the crucial role that modern machine learning techniques can play in the optimization of treatment strategies for patients with chronic disorders such as epilepsy. <\/jats:p>","DOI":"10.1142\/s0129065709001987","type":"journal-article","created":{"date-parts":[[2009,9,2]],"date-time":"2009-09-02T04:09:31Z","timestamp":1251864571000},"page":"227-240","source":"Crossref","is-referenced-by-count":84,"title":["TREATING EPILEPSY VIA ADAPTIVE NEUROSTIMULATION: A REINFORCEMENT LEARNING APPROACH"],"prefix":"10.1142","volume":"19","author":[{"given":"JOELLE","family":"PINEAU","sequence":"first","affiliation":[{"name":"School of Computer Science, McGill University, Montreal, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ARTHUR","family":"GUEZ","sequence":"additional","affiliation":[{"name":"School of Computer Science, McGill University, Montreal, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ROBERT","family":"VINCENT","sequence":"additional","affiliation":[{"name":"School of Computer Science, McGill University, Montreal, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"GABRIELLA","family":"PANUCCIO","sequence":"additional","affiliation":[{"name":"Montreal Neurological Institute, McGill University, Montreal, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"MASSIMO","family":"AVOLI","sequence":"additional","affiliation":[{"name":"Montreal Neurological Institute, McGill University, Montreal, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2011,11,21]]},"reference":[{"key":"rf1","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0270(02)00340-0"},{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00406611"},{"key":"rf3","doi-asserted-by":"publisher","DOI":"10.1016\/S0301-0082(02)00077-1"},{"key":"rf4","doi-asserted-by":"crossref","first-page":"9308","DOI":"10.1523\/JNEUROSCI.17-23-09308.1997","volume":"17","author":"Barbarosie M.","journal-title":"J. Neurosci."},{"key":"rf5","volume":"6","author":"Bellman R.","journal-title":"Journal of Mathematics and Mechanics"},{"key":"rf6","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-7793.2001.0181j.x"},{"key":"rf7","doi-asserted-by":"publisher","DOI":"10.1111\/j.1528-1167.2007.01005.x"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065707000993"},{"key":"rf10","doi-asserted-by":"publisher","DOI":"10.1016\/j.nbd.2004.11.012"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1109\/5.939821"},{"key":"rf12","first-page":"503","volume":"6","author":"Ernst D.","journal-title":"Journal of Machine Learning Research"},{"key":"rf14","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-006-6226-1"},{"key":"rf15","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2007.891945"},{"key":"rf16","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1523\/JNEUROSCI.21-02-00590.2001","volume":"21","author":"Gluckman B. J.","journal-title":"Journal of Neuroscience"},{"key":"rf18","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.51.1.48"},{"key":"rf19","doi-asserted-by":"publisher","DOI":"10.1016\/S0933-3657(99)00042-1"},{"key":"rf20","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2003.810705"},{"key":"rf21","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1152\/jn.1995.73.2.876","volume":"73","author":"Jerger K.","journal-title":"J of Neurophysiol"},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1613\/jair.301"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1016\/S0006-3495(03)74888-7"},{"key":"rf24","doi-asserted-by":"publisher","DOI":"10.1111\/j.0013-9580.2004.26104.x"},{"key":"rf25","volume":"3567","author":"Le Van Quyen M.","journal-title":"The Lancet"},{"key":"rf26","first-page":"122","volume":"1","author":"Litt B.","journal-title":"The Lancet Neurology"},{"key":"rf27","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1152\/jn.1987.57.3.869","volume":"57","author":"Mody I.","journal-title":"J. Neurophysiol."},{"key":"rf28","first-page":"569","volume":"116","author":"Mormann F.","journal-title":"Clinical Neuropsychology"},{"key":"rf29","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1509-04.2004"},{"key":"rf30","doi-asserted-by":"publisher","DOI":"10.1111\/j.1528-1167.2007.01044.x"},{"key":"rf31","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065707001019"},{"key":"rf32","doi-asserted-by":"crossref","first-page":"S52","DOI":"10.1016\/j.drugalcdep.2007.01.005","volume":"88","author":"Pineau J.","journal-title":"Drug and Alcohol Dependence"},{"key":"rf33","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316887"},{"key":"rf34","doi-asserted-by":"publisher","DOI":"10.1109\/10.552241"},{"key":"rf35","doi-asserted-by":"publisher","DOI":"10.1016\/S0920-1211(98)00106-5"},{"key":"rf36","volume":"22","author":"Ghosh-Dastidar S.","journal-title":"Neural Networks"},{"key":"rf37","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"1998"},{"key":"rf38","doi-asserted-by":"publisher","DOI":"10.1038\/370615a0"},{"key":"rf39","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1152\/jn.1988.59.1.259","volume":"59","author":"Traynelis S. F.","journal-title":"J. Neurophysiol."},{"key":"rf41","doi-asserted-by":"publisher","DOI":"10.1142\/S0218127406015866"},{"key":"rf42","doi-asserted-by":"publisher","DOI":"10.1212\/01.WNL.0000138499.87068.C0"},{"key":"rf43","doi-asserted-by":"publisher","DOI":"10.1111\/j.1528-1167.2007.01181.x"},{"key":"rf44","doi-asserted-by":"publisher","DOI":"10.1111\/j.1528-1167.2007.01166.x"},{"key":"rf45","doi-asserted-by":"publisher","DOI":"10.1002\/ana.10323"},{"key":"rf46","doi-asserted-by":"publisher","DOI":"10.1016\/S0006-8993(98)00723-9"},{"key":"rf47","doi-asserted-by":"publisher","DOI":"10.1016\/j.clinph.2005.09.015"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065709001987","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T22:06:04Z","timestamp":1565129164000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0129065709001987"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,8]]},"references-count":43,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2011,11,21]]},"published-print":{"date-parts":[[2009,8]]}},"alternative-id":["10.1142\/S0129065709001987"],"URL":"https:\/\/doi.org\/10.1142\/s0129065709001987","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,8]]}}}