{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T23:30:15Z","timestamp":1777591815055,"version":"3.51.4"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,1,9]],"date-time":"2020-01-09T00:00:00Z","timestamp":1578528000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,1,9]],"date-time":"2020-01-09T00:00:00Z","timestamp":1578528000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Walter L. Copeland Fund of the Pittsburgh Foundation","award":["N\/A"],"award-info":[{"award-number":["N\/A"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neuroinform"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Closed-loop brain stimulation is increasingly used in level 4 epilepsy centers without an understanding of how the device behaves on a daily basis. This lack of insight is a barrier to improving closed-loop therapy and ultimately understanding why some patients never achieve seizure reduction. We aimed to quantify the accuracy of closed-loop seizure detection and stimulation on the RNS device through extrapolating information derived from manually reviewed ECoG recordings and comprehensive device logging information. RNS System event logging data were obtained, reviewed, and analyzed using a custom-built software package. A weighted-means methodology was developed to adjust for bias and incompleteness in event logs and evaluated using Bland\u2013Altman plots and Wilcoxon signed-rank tests to compare adjusted and non-weighted (standard method) results. Twelve patients implanted for a mean of 21.5 (interquartile range 13.5\u201331) months were reviewed. The mean seizure frequency reduction post-RNS implantation was 40.1% (interquartile range 0\u201396.2%). Three primary levels of event logging granularity were identified (ECoG recordings: 3.0% complete (interquartile range 0.3\u20131.8%); Event Lists: 72.9% complete (interquartile range 44.7\u201399.8%); Activity Logs: 100% complete; completeness measured with respect to Activity Logs). Bland\u2013Altman interpretation confirmed non-equivalence with unpredictable differences in both magnitude and direction. Wilcoxon signed rank tests demonstrated significant (<jats:italic>p<\/jats:italic>\u2009&lt;\u200910<jats:sup>\u22126<\/jats:sup>) differences in accuracy, sensitivity, and specificity at &gt;5% absolute mean difference for extrapolated versus standard results. Device behavior logged by the RNS System should be used in conjunction with careful review of stored ECoG data to extrapolate metrics for detector performance and stimulation.<\/jats:p>","DOI":"10.1007\/s12021-019-09446-7","type":"journal-article","created":{"date-parts":[[2020,1,9]],"date-time":"2020-01-09T23:02:16Z","timestamp":1578610936000},"page":"365-375","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["A Rational Approach to Understanding and Evaluating Responsive Neurostimulation"],"prefix":"10.1007","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1886-4056","authenticated-orcid":false,"given":"Nathaniel D.","family":"Sisterson","sequence":"first","affiliation":[]},{"given":"Thomas A.","family":"Wozny","sequence":"additional","affiliation":[]},{"given":"Vasileios","family":"Kokkinos","sequence":"additional","affiliation":[]},{"given":"Anto","family":"Bagic","sequence":"additional","affiliation":[]},{"given":"Alexandra P.","family":"Urban","sequence":"additional","affiliation":[]},{"given":"R. Mark","family":"Richardson","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,1,9]]},"reference":[{"issue":"1","key":"9446_CR1","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.eplepsyres.2009.03.003.The","volume":"85","author":"PN Banerjee","year":"2009","unstructured":"Banerjee, P. N., Filippi, D., & Hauser, W. A. (2009). The descriptive epidemiology of epilepsy - a review. Epilepsy Research, 85(1), 31\u201345. https:\/\/doi.org\/10.1016\/j.eplepsyres.2009.03.003.The.","journal-title":"Epilepsy Research"},{"issue":"1","key":"9446_CR2","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1038\/s41467-017-02577-y","volume":"9","author":"MO Baud","year":"2018","unstructured":"Baud, M. O., Kleen, J. K., Mirro, E. A., Andrechak, J. C., King-Stephens, D., Chang, E. F., & Rao, V. R. (2018). Multi-day rhythms modulate seizure risk in epilepsy. Nature Communications, 9(1), 88. https:\/\/doi.org\/10.1038\/s41467-017-02577-y.","journal-title":"Nature Communications"},{"issue":"4","key":"9446_CR3","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1111\/j.1528-1167.2010.02522.x","volume":"51","author":"AT Berg","year":"2010","unstructured":"Berg, A. T., Berkovic, S. F., Brodie, M. J., Buchhalter, J., Cross, J. H., Van Emde Boas, W., et al. (2010). Revised terminology and concepts for organization of seizures and epilepsies: Report of the ILAE commission on classification and terminology, 2005-2009. Epilepsia, 51(4), 676\u2013685. https:\/\/doi.org\/10.1111\/j.1528-1167.2010.02522.x.","journal-title":"Epilepsia"},{"issue":"8","key":"9446_CR4","doi-asserted-by":"publisher","first-page":"810","DOI":"10.1212\/WNL.0000000000001280","volume":"84","author":"GK Bergey","year":"2015","unstructured":"Bergey, G. K., Morrell, M. J., Mizrahi, E. M., Goldman, A., King-Stephens, D., Nair, D., et al. (2015). Long-term outcomes of treatment with responsive brain stimulation in adults with refractory partial seizures. Neurology, 84(8), 810\u2013817. https:\/\/doi.org\/10.1212\/WNL.0000000000001280.","journal-title":"Neurology"},{"issue":"8476","key":"9446_CR5","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1016\/S0140-6736(86)90837-8","volume":"1","author":"JM Bland","year":"1986","unstructured":"Bland, J. M., & Altman, D. G. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. Lancet (London, England), 1(8476), 307\u2013310. https:\/\/doi.org\/10.1016\/S0140-6736(86)90837-8.","journal-title":"Lancet (London, England)"},{"issue":"1","key":"9446_CR6","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1016\/0006-8993(86)90121-6","volume":"382","author":"D Durand","year":"1986","unstructured":"Durand, D. (1986). Electrical stimulation can inhibit synchronized neuronal activity. Brain Research, 382(1), 139\u2013144.","journal-title":"Brain Research"},{"issue":"6","key":"9446_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11910-017-0758-6","volume":"17","author":"RS Fisher","year":"2017","unstructured":"Fisher, R. S. (2017). The new classification of seizures by the international league against epilepsy 2017. Current Neurology and Neuroscience Reports, 17(6), 1\u20136. https:\/\/doi.org\/10.1007\/s11910-017-0758-6.","journal-title":"Current Neurology and Neuroscience Reports"},{"key":"9446_CR8","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1016\/j.yebeh.2014.09.060","volume":"42","author":"RS Fisher","year":"2015","unstructured":"Fisher, R. S., Nune, G., Roberts, S. E., & Cramer, J. A. (2015). The personal impact of epilepsy scale (PIES). Epilepsy & Behavior, 42, 140\u2013146. https:\/\/doi.org\/10.1016\/j.yebeh.2014.09.060.","journal-title":"Epilepsy & Behavior"},{"issue":"6","key":"9446_CR9","doi-asserted-by":"publisher","first-page":"994","DOI":"10.1111\/epi.13740","volume":"58","author":"EB Geller","year":"2017","unstructured":"Geller, E. B., Skarpaas, T. L., Gross, R. E., Goodman, R. R., Barkley, G. L., Bazil, C. W., et al. (2017). Brain-responsive neurostimulation in patients with medically intractable mesial temporal lobe epilepsy. Epilepsia, 58(6), 994\u20131004. https:\/\/doi.org\/10.1111\/epi.13740.","journal-title":"Epilepsia"},{"issue":"2","key":"9446_CR10","doi-asserted-by":"publisher","first-page":"141","DOI":"10.11613\/BM.2015.015","volume":"25","author":"D Giavarina","year":"2015","unstructured":"Giavarina, D. (2015). Understanding Bland Altman analysis. Biochemia Medica, 25(2), 141\u2013151. https:\/\/doi.org\/10.11613\/BM.2015.015.","journal-title":"Biochemia Medica"},{"issue":"3","key":"9446_CR11","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1111\/epi.12534","volume":"55","author":"CN Heck","year":"2014","unstructured":"Heck, C. N., King-Stephens, D., Massey, A. D., Nair, D. R., Jobst, B. C., Barkley, G. L., et al. (2014). Two-year seizure reduction in adults with medically intractable partial onset epilepsy treated with responsive neurostimulation: Final results of the RNS system pivotal trial. Epilepsia, 55(3), 432\u2013441. https:\/\/doi.org\/10.1111\/epi.12534.","journal-title":"Epilepsia"},{"issue":"6","key":"9446_CR12","doi-asserted-by":"publisher","first-page":"1005","DOI":"10.1111\/epi.13739","volume":"58","author":"BC Jobst","year":"2017","unstructured":"Jobst, B. C., Kapur, R., Barkley, G. L., Bazil, C. W., Berg, M. J., Bergey, G. K., et al. (2017). Brain-responsive neurostimulation in patients with medically intractable seizures arising from eloquent and other neocortical areas. Epilepsia, 58(6), 1005\u20131014. https:\/\/doi.org\/10.1111\/epi.13739.","journal-title":"Epilepsia"},{"issue":"7","key":"9446_CR13","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1111\/j.0013-9580.2004.60203.x","volume":"45","author":"M Kinoshita","year":"2004","unstructured":"Kinoshita, M., Ikeda, A., Matsumoto, R., Begum, T., Usui, K., Yamamoto, J., et al. (2004). Electric stimulation on human cortex suppresses fast cortical activity and epileptic spikes. Epilepsia, 45(7), 787\u2013791. https:\/\/doi.org\/10.1111\/j.0013-9580.2004.60203.x.","journal-title":"Epilepsia"},{"issue":"6","key":"9446_CR14","doi-asserted-by":"publisher","first-page":"1291","DOI":"10.1016\/j.clinph.2005.02.010","volume":"116","author":"M Kinoshita","year":"2005","unstructured":"Kinoshita, M., Ikeda, A., Matsuhashi, M., Matsumoto, R., Hitomi, T., Begum, T., et al. (2005). Electric cortical stimulation suppresses epileptic and background activities in neocortical epilepsy and mesial temporal lobe epilepsy. Clinical Neurophysiology, 116(6), 1291\u20131299. https:\/\/doi.org\/10.1016\/j.clinph.2005.02.010.","journal-title":"Clinical Neurophysiology"},{"issue":"7","key":"9446_CR15","doi-asserted-by":"publisher","first-page":"800","DOI":"10.1001\/jamaneurol.2019.0658","volume":"76","author":"V Kokkinos","year":"2019","unstructured":"Kokkinos, V., Sisterson, N. D., Wozny, T. A., & Richardson, R. M. (2019). Association of Closed-Loop Brain Stimulation Neurophysiological Features with Seizure Control among Patients with Focal Epilepsy. JAMA Neurology, 76(7), 800\u2013808. https:\/\/doi.org\/10.1001\/jamaneurol.2019.0658.","journal-title":"JAMA Neurology"},{"issue":"12","key":"9446_CR16","doi-asserted-by":"publisher","first-page":"1560","DOI":"10.1111\/j.0013-9580.2004.26104.x","volume":"45","author":"EH Kossoff","year":"2004","unstructured":"Kossoff, E. H., Ritzl, E. K., Politsky, J. M., Murro, A. M., Smith, J. R., Duckrow, R. B., et al. (2004). Effect of an external responsive neurostimulator on seizures and electrographic discharges during subdural electrode monitoring. Epilepsia, 45(12), 1560\u20131567. https:\/\/doi.org\/10.1111\/j.0013-9580.2004.26104.x.","journal-title":"Epilepsia"},{"key":"9446_CR17","doi-asserted-by":"publisher","DOI":"10.1097\/00007611-195407000-00024","volume-title":"Epilepsy and the functional anatomy of the human brain","author":"W Penfield","year":"1954","unstructured":"Penfield, W., & Jasper, H. (1954). Epilepsy and the functional anatomy of the human brain. Boston: Little Brown."},{"issue":"3","key":"9446_CR18","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1007\/s13311-014-0280-3","volume":"11","author":"FT Sun","year":"2014","unstructured":"Sun, F. T., & Morrell, M. J. (2014). Closed-loop Neurostimulation: The clinical experience. Neurotherapeutics, 11(3), 553\u2013563. https:\/\/doi.org\/10.1007\/s13311-014-0280-3.","journal-title":"Neurotherapeutics"},{"issue":"1","key":"9446_CR19","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1016\/j.nurt.2007.10.069","volume":"5","author":"FT Sun","year":"2008","unstructured":"Sun, F. T., Morrell, M. J., & Wharen, R. E. (2008). Responsive cortical stimulation for the treatment of epilepsy. Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics, 5(1), 68\u201374. https:\/\/doi.org\/10.1016\/j.nurt.2007.10.069.","journal-title":"Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics"}],"container-title":["Neuroinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12021-019-09446-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s12021-019-09446-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12021-019-09446-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,8]],"date-time":"2021-01-08T00:23:35Z","timestamp":1610065415000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s12021-019-09446-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,9]]},"references-count":19,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["9446"],"URL":"https:\/\/doi.org\/10.1007\/s12021-019-09446-7","relation":{},"ISSN":["1539-2791","1559-0089"],"issn-type":[{"value":"1539-2791","type":"print"},{"value":"1559-0089","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,9]]},"assertion":[{"value":"9 January 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}