{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T03:13:55Z","timestamp":1784258035824,"version":"3.55.0"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T00:00:00Z","timestamp":1629158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurosci."],"abstract":"<jats:p>Millions of people worldwide suffer motor or sensory impairment due to stroke, spinal cord injury, multiple sclerosis, traumatic brain injury, diabetes, and motor neuron diseases such as ALS (amyotrophic lateral sclerosis). A brain-computer interface (BCI), which links the brain directly to a computer, offers a new way to study the brain and potentially restore impairments in patients living with these debilitating conditions. One of the challenges currently facing BCI technology, however, is to minimize surgical risk while maintaining efficacy. Minimally invasive techniques, such as stereoelectroencephalography (SEEG) have become more widely used in clinical applications in epilepsy patients since they can lead to fewer complications. SEEG depth electrodes also give access to sulcal and white matter areas of the brain but have not been widely studied in brain-computer interfaces. Here we show the first demonstration of decoding sulcal and subcortical activity related to both movement and tactile sensation in the human hand. Furthermore, we have compared decoding performance in SEEG-based depth recordings versus those obtained with electrocorticography electrodes (ECoG) placed on gyri. Initial poor decoding performance and the observation that most neural modulation patterns varied in amplitude trial-to-trial and were transient (significantly shorter than the sustained finger movements studied), led to the development of a feature selection method based on a repeatability metric using temporal correlation. An algorithm based on temporal correlation was developed to isolate features that consistently repeated (required for accurate decoding) and possessed information content related to movement or touch-related stimuli. We subsequently used these features, along with deep learning methods, to automatically classify various motor and sensory events for individual fingers with high accuracy. Repeating features were found in sulcal, gyral, and white matter areas and were predominantly phasic or phasic-tonic across a wide frequency range for both HD (high density) ECoG and SEEG recordings. These findings motivated the use of long short-term memory (LSTM) recurrent neural networks (RNNs) which are well-suited to handling transient input features. Combining temporal correlation-based feature selection with LSTM yielded decoding accuracies of up to 92.04 \u00b1 1.51% for hand movements, up to 91.69 \u00b1 0.49% for individual finger movements, and up to 83.49 \u00b1 0.72% for focal tactile stimuli to individual finger pads while using a relatively small number of SEEG electrodes. These findings may lead to a new class of minimally invasive brain-computer interface systems in the future, increasing its applicability to a wide variety of conditions.<\/jats:p>","DOI":"10.3389\/fnins.2021.699631","type":"journal-article","created":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T00:57:42Z","timestamp":1629161862000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Decoding Neural Activity in Sulcal and White Matter Areas of the Brain to Accurately Predict Individual Finger Movement and Tactile Stimuli of the Human Hand"],"prefix":"10.3389","volume":"15","author":[{"given":"Chad","family":"Bouton","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikunj","family":"Bhagat","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Santosh","family":"Chandrasekaran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jose","family":"Herrero","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Noah","family":"Markowitz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Espinal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joo-won","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Ramdeo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junqian","family":"Xu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew F.","family":"Glasser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephan","family":"Bickel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashesh","family":"Mehta","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2021,8,17]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-018-37359-z","article-title":"Towards reconstructing intelligible speech from the human auditory cortex.","volume":"9","author":"Akbari","year":"2019","journal-title":"Sci. Rep."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1855","DOI":"10.2105\/ajph.2016.303270","article-title":"Prevalence and causes of paralysis - United States, 2013.","volume":"106","author":"Armour","year":"2016","journal-title":"Am. J. Public Health"},{"key":"B3","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1109\/72.279181","article-title":"Learning long-term dependencies with gradient descent is difficult.","volume":"5","author":"Bengio","year":"1994","journal-title":"IEEE Trans. Neural Netw."},{"key":"B4","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1038\/nature17435","article-title":"Restoring cortical control of functional movement in a human with quadriplegia.","volume":"533","author":"Bouton","year":"2016","journal-title":"Nature"},{"key":"B5","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1227\/NEU.0b013e31827d1161","article-title":"Stereoelectroencephalography: surgical methodology, safety, and stereotactic application accuracy in 500 procedures.","volume":"72","author":"Cardinale","year":"2013","journal-title":"Neurosurgery"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0000042","article-title":"Learning to control a brain-machine interface for reaching and grasping by primates.","volume":"1","author":"Carmena","year":"2003","journal-title":"PLoS Biol"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1101\/2020.11.06.20217372","article-title":"Evoking highly focal percepts in the fingertips through targeted stimulation of sulcal regions of the brain for sensory restoration.","author":"Chandrasekaran","year":"2020","journal-title":"MedRxiv [preprint]"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neures.2014.03.010","article-title":"Decoding grasp force profile from electrocorticography signals in non-human primate sensorimotor cortex.","volume":"83","author":"Chen","year":"2014","journal-title":"Neurosci. Res"},{"key":"B9","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.48198","article-title":"Area 2 of primary somatosensory cortex encodes kinematics of the whole arm.","volume":"9","author":"Chowdhury","year":"2020","journal-title":"ELife"},{"key":"B10","doi-asserted-by":"crossref","DOI":"10.1126\/scitranslmed.aaf8083","article-title":"Intracortical microstimulation of human somatosensory cortex.","volume":"8","author":"Flesher","year":"2016","journal-title":"Sci. Transl. Med."},{"key":"B11","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1126\/science.abd0380","article-title":"A brain-computer interface that evokes tactile sensations improves robotic arm control.","volume":"372","author":"Flesher","year":"2021","journal-title":"Science"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/14\/1\/016005","article-title":"Continuous decoding of human grasp kinematics using epidural and subdural signals.","volume":"14","author":"Flint","year":"2017","journal-title":"J. Neural Eng."},{"key":"B13","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.neuroimage.2013.04.127","article-title":"The minimal preprocessing pipelines for the Human Connectome Project.","volume":"80","author":"Glasser","year":"2013","journal-title":"NeuroImage"},{"key":"B14","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.jneumeth.2017.01.022","article-title":"iELVis: an open source MATLAB toolbox for localizing and visualizing human intracranial electrode data.","volume":"281","author":"Groppe","year":"2017","journal-title":"J. Neurosci. Methods"},{"key":"B15","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1038\/nature04970","article-title":"Neuronal ensemble control of prosthetic devices by a human with tetraplegia.","volume":"442","author":"Hochberg","year":"2006","journal-title":"Nature"},{"key":"B16","article-title":"BCI decoder performance comparison of an LSTM recurrent neural network and a Kalman filter in retrospective simulation","author":"Hosman","year":"2019","journal-title":"Proceeding of the International IEEE\/EMBS Conference on Neural Engineering, NER"},{"key":"B17","doi-asserted-by":"crossref","first-page":"3062","DOI":"10.1109\/EMBC.2019.8857724","article-title":"A P300-based brain computer interface using stereo-electroencephalography signals","author":"Huang","year":"2019","journal-title":"Proceeding of the 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)"},{"key":"B18","doi-asserted-by":"crossref","first-page":"2509","DOI":"10.1109\/TBME.2020.3047812","article-title":"A P300-Based BCI system using stereoelectroencephalography and its application in a brain mechanistic study.","volume":"68","author":"Huang","year":"2021","journal-title":"IEEE Trans. Bio-Med. Eng."},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2020.00100","article-title":"Power modulations of ECoG alpha\/beta and gamma bands correlate with time-derivative of force during hand grasp.","volume":"14","author":"Jiang","year":"2020","journal-title":"Front. Neurosci"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/8\/2\/025006","article-title":"Control of a brain-computer interface using stereotactic depth electrodes in and adjacent to the hippocampus.","volume":"8","author":"Krusienski","year":"2011","journal-title":"J. Neural Eng"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/6\/6\/066001","article-title":"Decoding flexion of individual fingers using electrocorticographic signals in humans.","volume":"6","author":"Kub\u00e1nek","year":"2009","journal-title":"J. Neural Eng."},{"key":"B22","article-title":"Minimally invasive brain computer interface for fast typing","author":"Li","year":"2017","journal-title":"Proceeding of the International IEEE\/EMBS Conference on Neural Engineering, NER"},{"key":"B23","article-title":"A preliminary study towards prosthetic hand control using human stereo-electroencephalography (SEEG) signals","author":"Li","year":"2017","journal-title":"Proceeding of the International IEEE\/EMBS Conference on Neural Engineering, NER"},{"key":"B24","doi-asserted-by":"crossref","DOI":"10.1038\/s41598-017-04757-8","article-title":"EEG correlates of sensorimotor processing: independent components involved in sensory and motor processing.","volume":"7","author":"Melnik","year":"2017","journal-title":"Sci. Rep."},{"key":"B25","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1016\/j.neuroimage.2016.08.037","article-title":"Evaluation of cortical local field potential diffusion in stereotactic electro-encephalography recordings: a glimpse on white matter signal.","volume":"147","author":"Mercier","year":"2017","journal-title":"NeuroImage"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0150359","article-title":"Contributions of subsurface cortical modulations to discrimination of executed and imagined grasp forces through stereoelectroencephalography.","volume":"11","author":"Murphy","year":"2016","journal-title":"PLoS One"},{"key":"B27","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.51121","article-title":"Stable task information from an unstable neural population.","volume":"9","author":"Rule","year":"2020","journal-title":"ELife"},{"key":"B28","doi-asserted-by":"publisher","first-page":"1210","DOI":"10.1002\/mrm.23097","article-title":"Blipped-controlled aliasing in parallel imaging for simultaneous multislice echo planar imaging with reduced g-factor penalty.","volume":"67","author":"Setsompop","year":"2012","journal-title":"Magnetic Resonance Med"},{"key":"B29","doi-asserted-by":"publisher","first-page":"235","DOI":"10.2478\/jaiscr-2019-0006","article-title":"Performance evaluation of deep neural networks applied to speech recognition: RNN, LSTM and GRU.","volume":"9","author":"Shewalkar","year":"2019","journal-title":"J. Artificial Intelligence Soft Computing Res."},{"key":"B30","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1016\/j.jneumeth.2011.10.012","article-title":"Signals from intraventricular depth electrodes can control a brain-computer interface.","volume":"203","author":"Shih","year":"2012","journal-title":"J. Neurosci. Methods"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0047992","article-title":"Prediction of muscle activities from electrocorticograms in primary motor cortex of primates.","volume":"7","author":"Shin","year":"2012","journal-title":"PLoS One"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1230","DOI":"10.1109\/tbcas.2018.2880148","article-title":"A chronically implantable neural coprocessor for investigating the treatment of neurological disorders.","volume":"12","author":"Stanslaski","year":"2018","journal-title":"IEEE Trans. Biomed. Circuits Syst"},{"key":"B33","first-page":"113","article-title":"Stereoelectroencephalography (sEEG) versus grids and strips","author":"Stricsek","year":"2018","journal-title":"Functional Neurosurgery and Neuromodulation"},{"key":"B34","doi-asserted-by":"crossref","DOI":"10.3171\/2013.3.FOCUS1373","article-title":"Stereoelectroencephalography for continuous two-dimensional cursor control in a brain-machine interface.","volume":"34","author":"Vadera","year":"2013","journal-title":"Neurosurg. Focus"},{"key":"B35","doi-asserted-by":"publisher","first-page":"1370","DOI":"10.1006\/nimg.2001.0931","article-title":"Temporal autocorrelation in univariate linear modeling of FMRI data.","volume":"14","author":"Woolrich","year":"2001","journal-title":"NeuroImage"},{"key":"B36","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1016\/j.neuroimage.2013.07.055","article-title":"Evaluation of slice accelerations using multiband echo planar imaging at 3T.","volume":"83","author":"Xu","year":"2013","journal-title":"NeuroImage"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1125","DOI":"10.1152\/jn.00338.2011","article-title":"The organization of the human cerebral cortex estimated by intrinsic functional connectivity.","volume":"106","author":"Yeo","year":"2011","journal-title":"J. Neurophysiol."},{"key":"B38","doi-asserted-by":"crossref","DOI":"10.1186\/s42234-018-0011-x","article-title":"Extracting wavelet based neural features from human intracortical recordings for neuroprosthetics applications.","volume":"4","author":"Zhang","year":"2018","journal-title":"Bioelectronic Med."}],"container-title":["Frontiers in Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2021.699631\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,7]],"date-time":"2023-01-07T08:35:00Z","timestamp":1673080500000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnins.2021.699631\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,17]]},"references-count":38,"alternative-id":["10.3389\/fnins.2021.699631"],"URL":"https:\/\/doi.org\/10.3389\/fnins.2021.699631","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.04.06.21255006","asserted-by":"object"}]},"ISSN":["1662-453X"],"issn-type":[{"value":"1662-453X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,17]]},"article-number":"699631"}}