{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,22]],"date-time":"2025-11-22T17:07:06Z","timestamp":1763831226123},"reference-count":58,"publisher":"MIT Press","issue":"5","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motor brain machine interfaces (BMIs) interpret neural activities from motor-related cortical areas in the brain into movement commands to control a prosthesis. As the subject adapts to control the neural prosthesis, the medial prefrontal cortex (mPFC), upstream of the primary motor cortex (M1), is heavily involved in reward-guided motor learning. Thus, considering mPFC and M1 functionality within a hierarchical structure could potentially improve the effectiveness of BMI decoding while subjects are learning. The commonly used Kalman decoding method with only one simple state model may not be able to represent the multiple brain states that evolve over time as well as along the neural pathway. In addition, the performance of Kalman decoders degenerates in heavy-tailed nongaussian noise, which is usually generated due to the nonlinear neural system or influences of movement-related noise in online neural recording. In this letter, we propose a hierarchical model to represent the brain states from multiple cortical areas that evolve along the neural pathway. We then introduce correntropy theory into the hierarchical structure to address the heavy-tailed noise existing in neural recordings. We test the proposed algorithm on in vivo recordings collected from the mPFC and M1 of two rats when the subjects were learning to perform a lever-pressing task. Compared with the classic Kalman filter, our results demonstrate better movement decoding performance due to the hierarchical structure that integrates the past failed trial information over multisite recording and the combination with correntropy criterion to deal with noisy heavy-tailed neural recordings.<\/jats:p>","DOI":"10.1162\/neco_a_01380","type":"journal-article","created":{"date-parts":[[2021,4,15]],"date-time":"2021-04-15T00:36:14Z","timestamp":1618446974000},"page":"1372-1401","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":6,"title":["Hierarchical Dynamical Model for Multiple Cortical Neural Decoding"],"prefix":"10.1162","volume":"33","author":[{"given":"Xi","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Kowloon, Hong Kong SAR 999077, China eeliux@ust.hk"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiang","family":"Shen","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Kowloon, Hong Kong SAR 999077, China xshenai@connect.ust.hk"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuhang","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Kowloon, Hong Kong SAR 999077, China schenbx@connect.ust.hk"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Kowloon, Hong Kong SAR 999077, China xzhangaz@ust.hk"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yifan","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Kowloon, Hong Kong SAR 999077, China yhuangau@connect.ust.hk"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yueming","family":"Wang","sequence":"additional","affiliation":[{"name":"Qiushi Academy for Advanced Studies, Zhejiang University, Hangzhou 310027, China, and Zhejiang Lab, Hangzhou 311121, China ymingwang@zju.edu.cn"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiwen","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electronic and Computer Engineering and Department of Chemical and Biological Engineering, Hong Kong University of Science and Technology, Kowloon, Hong Kong SAR 999077, China eewangyw@ust.hk"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2021,4,13]]},"reference":[{"key":"2021121722454619200_B1","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511543005","author":"Agarwal","year":"2001","journal-title":"Fixed point theory and applications"},{"issue":"10081","key":"2021121722454619200_B2","doi-asserted-by":"crossref","first-page":"1821","DOI":"10.1016\/S0140-6736(17)30601-3","article-title":"Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: A proof-of-concept demonstration","volume":"389","author":"Ajiboye","year":"2017","journal-title":"Lancet"},{"issue":"10","key":"2021121722454619200_B3","doi-asserted-by":"crossref","first-page":"1338","DOI":"10.1038\/nn.2921","article-title":"Medial prefrontal cortex as an action-outcome predictor","volume":"14","author":"Alexander","year":"2011","journal-title":"Nature Neuroscience"},{"issue":"1","key":"2021121722454619200_B4","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1111\/tops.12307","article-title":"The role of the anterior cingulate cortex in prediction error and signaling surprise","volume":"11","author":"Alexander","year":"2019","journal-title":"Topics in Cognitive Science"},{"key":"2021121722454619200_B5","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1038\/nature17435","article-title":"Restoring cortical control of functional movement in a human with quadriplegia","volume":"533","author":"Bouton","year":"2016","journal-title":"Nature"},{"issue":"1","key":"2021121722454619200_B6","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1080\/13803390500507196","article-title":"Decisions under ambiguity and decisions under risk: Correlations with executive functions and comparisons of two different gambling tasks with implicit and explicit rules","volume":"29","author":"Brand","year":"2007","journal-title":"Journal of Clinical and Experimental Neuropsychology"},{"issue":"2","key":"2021121722454619200_B7","doi-asserted-by":"crossref","DOI":"10.1088\/1741-2552\/aa9ee7","article-title":"Rapid calibration of an intracortical brain-computer interface for people with tetraplegia","volume":"15","author":"Brandman","year":"2018","journal-title":"Journal of Neural Engineering"},{"key":"2021121722454619200_B8","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1038\/10223","article-title":"Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex","volume":"2","author":"Chapin","year":"1999","journal-title":"Nature Neurosience"},{"key":"2021121722454619200_B9","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.automatica.2016.10.004","article-title":"Maximum correntropy Kalman filter","volume":"76","author":"Chen","year":"2017","journal-title":"Automatica"},{"issue":"10","key":"2021121722454619200_B10","doi-asserted-by":"crossref","first-page":"1723","DOI":"10.1109\/LSP.2015.2428713","article-title":"Convergence of a fixed-point algorithm under maximum correntropy criterion","volume":"22","author":"Chen","year":"2015","journal-title":"IEEE Signal Processing Letters"},{"issue":"1","key":"2021121722454619200_B11","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0052286","article-title":"Towards a naturalistic brain-machine interface: Hybrid torque and position control allows generalization to novel dynamics","volume":"8","author":"Chhatbar","year":"2013","journal-title":"PLOS One"},{"key":"2021121722454619200_B12","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1038\/nature11129","article-title":"Neural population dynamics during reaching","volume":"487","author":"Churchland","year":"2012","journal-title":"Nature"},{"issue":"14","key":"2021121722454619200_B13","doi-asserted-by":"crossref","first-page":"3697","DOI":"10.1523\/JNEUROSCI.3762-05.2006","article-title":"Neural variability in premotor cortex provides a signature of motor preparation","volume":"26","author":"Churchland","year":"2006","journal-title":"Journal of Neuroscience"},{"issue":"9866","key":"2021121722454619200_B14","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1016\/S0140-6736(12)61816-9","article-title":"High-performance neuroprosthetic control by an individual with tetraplegia","volume":"381","author":"Collinger","year":"2013","journal-title":"Lancet"},{"issue":"3","key":"2021121722454619200_B15","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1037\/1082-989X.2.3.292","article-title":"On the meaning and use of kurtosis","volume":"2","author":"Decarlo","year":"1997","journal-title":"Psychological Methods"},{"issue":"4","key":"2021121722454619200_B16","doi-asserted-by":"crossref","first-page":"1440","DOI":"10.1109\/TCYB.2018.2804326","article-title":"Robust graph-based semisupervised learning for noisy labeled data via maximum correntropy criterion","volume":"49","author":"Du","year":"2019","journal-title":"IEEE Transactions on Cybernetics"},{"key":"2021121722454619200_B17","volume-title":"Cognitive neuroscience: The biology of the mind","author":"Gazzaniga","year":"2008","edition":"3rd"},{"issue":"12","key":"2021121722454619200_B18","doi-asserted-by":"crossref","first-page":"1752","DOI":"10.1038\/nn.3265","article-title":"A high-performance neural prosthesis enabled by control algorithm design","volume":"15","author":"Gilja","year":"2012","journal-title":"Nature Neuroscience"},{"key":"2021121722454619200_B19","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1038\/nm.3953","article-title":"Clinical translation of a high-performance neural prosthesis","volume":"21","author":"Gilja","year":"2015","journal-title":"Nature Medicine"},{"issue":"6","key":"2021121722454619200_B20","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1109\/TIP.2010.2103949","article-title":"Robust principal component analysis based on maximum correntropy criterion","volume":"20","author":"He","year":"2011","journal-title":"IEEE Transactions on Image Processing"},{"issue":"8","key":"2021121722454619200_B21","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.1109\/TPAMI.2010.220","article-title":"Maximum correntropy criterion for robust face recognition","volume":"33","author":"He","year":"2011","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2021121722454619200_B22","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1038\/nature11076","article-title":"Neuronal ensemble control of prosthetic devices by a human with tetraplegia","volume":"485","author":"Hochberg","year":"2012","journal-title":"Nature"},{"key":"2021121722454619200_B23","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1038\/nature04970","article-title":"Neuronal ensemble control of prosthetic devices by a human with tetraplegia","volume":"442","author":"Hochberg","year":"2006","journal-title":"Nature"},{"issue":"2","key":"2021121722454619200_B24","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/TNSRE.2013.2287768","article-title":"Efficient decoding with steady-state Kalman filter in neural interface systems","volume":"22","author":"Homer","year":"2014","journal-title":"IEEE Transactions on Neural Systems and Rehabilitation Engineering"},{"issue":"5642","key":"2021121722454619200_B25","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1126\/science.1087847","article-title":"Performance monitoring by the anterior cingulate cortex during saccade countermanding","volume":"302","author":"Ito","year":"2003","journal-title":"Science"},{"key":"2021121722454619200_B26","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.neures.2018.08.017","article-title":"Prefrontal circuit organization for executive control","volume":"140","author":"Kamigaki","year":"2019","journal-title":"Neuroscience Research"},{"issue":"9","key":"2021121722454619200_B27","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.tins.2006.07.004","article-title":"Brain-machine interfaces: Past, present and future","volume":"29","author":"Lebedev","year":"2006","journal-title":"Trends in Neurosciences"},{"issue":"5","key":"2021121722454619200_B28","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1109\/TNSRE.2016.2580620","article-title":"The neural mechanism exploration of adaptive motor control: dynamical economic cell allocation in the primary motor cortex","volume":"25","author":"Li","year":"2017","journal-title":"IEEE Transactions on Neural Systems and Rehabilitation Engineering"},{"issue":"11","key":"2021121722454619200_B29","doi-asserted-by":"crossref","first-page":"5286","DOI":"10.1109\/TSP.2007.896065","article-title":"Correntropy: Properties and applications in non-gaussian signal processing","volume":"55","author":"Liu","year":"2007","journal-title":"IEEE Transactions on Signal Processing"},{"key":"2021121722454619200_B30","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.sigpro.2016.06.025","article-title":"State space maximum correntropy filter","volume":"130","author":"Liu","year":"2017","journal-title":"Signal Processing"},{"issue":"1","key":"2021121722454619200_B31","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/TNSRE.2010.2092443","article-title":"Efficient decoding with steady-state Kalman filter in neural interface systems","volume":"19","author":"Malik","year":"2011","journal-title":"IEEE Transactions on Neural Systems and Rehabilitation Engineering"},{"issue":"4","key":"2021121722454619200_B32","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1109\/TSP.2016.2625265","article-title":"Robust multidimensional scaling using a maximum correntropy criterion","volume":"65","author":"Mandanas","year":"2017","journal-title":"IEEE Transactions on Signal Processing"},{"key":"2021121722454619200_B33","doi-asserted-by":"crossref","first-page":"1111","DOI":"10.1038\/nature05860","article-title":"Lateral habenula as a source of negative reward signals in dopamine neurons","volume":"447","author":"Matsumoto","year":"2007","journal-title":"Nature"},{"key":"2021121722454619200_B34","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1038\/nature07418","article-title":"Direct control of paralysed muscles by cortical neurons","volume":"456","author":"Moritz","year":"2008","journal-title":"Nature"},{"issue":"5681","key":"2021121722454619200_B35","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1126\/science.1097938","article-title":"Cognitive control signals for neural prosthetics","volume":"305","author":"Musallam","year":"2004","journal-title":"Science"},{"issue":"5","key":"2021121722454619200_B36","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1038\/nrn1105","article-title":"Brain-machine interfaces to restore motor function and probe neural circuits","volume":"4","author":"Nicolelis","year":"2003","journal-title":"Nature Reviews Neuroscience"},{"key":"2021121722454619200_B37","doi-asserted-by":"crossref","DOI":"10.3389\/neuro.07.020.2009","article-title":"A brain-machine interface instructed by direct intracortical microstimulation","volume":"3","author":"O'Doherty","year":"2009","journal-title":"Frontiers in Integrative Neuroscience"},{"issue":"6","key":"2021121722454619200_B38","doi-asserted-by":"crossref","first-page":"1380","DOI":"10.1016\/j.neuron.2014.04.048","article-title":"Closed-loop decoder adaptation shapes neural plasticity for skillful neuroprosthetic control","volume":"82","author":"Orsborn","year":"2014","journal-title":"Neuron"},{"key":"2021121722454619200_B39","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1038\/nature21376","article-title":"Prefrontal cortex output circuits guide reward seeking through divergent cue encoding","volume":"543","author":"Otis","year":"2017","journal-title":"Nature"},{"issue":"8","key":"2021121722454619200_B40","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1038\/nn890","article-title":"Temporal structure in neuronal activity during working memory in macaque parietal cortex","volume":"5","author":"Pesaran","year":"2002","journal-title":"Nature Neuroscience"},{"key":"2021121722454619200_B41","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4419-1570-2","author":"Principe","year":"2010","journal-title":"Information theoretic learning: Renyis entropy and kernel perspectives"},{"issue":"2","key":"2021121722454619200_B42","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1137\/0613040","article-title":"A Sherman-Morrison-Woodbury identity for rank augmenting matrices with application to centering","volume":"13","author":"Riedel","year":"1992","journal-title":"SIAM Journal on Matrix Analysis and Applications"},{"issue":"6","key":"2021121722454619200_B43","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1016\/j.neuron.2011.05.014","article-title":"Frontal cortex and reward-guided learning and decision-making","volume":"70","author":"Rushworth","year":"2011","journal-title":"Neuron"},{"issue":"2","key":"2021121722454619200_B44","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1214\/aos\/1176325511","article-title":"Robust recursive estimation in the presence of heavy-tailed observation noise","volume":"22","author":"Schick","year":"1994","journal-title":"Annals of Statistics"},{"issue":"11","key":"2021121722454619200_B45","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1109\/LSP.2014.2337899","article-title":"Convex combination of adaptive filters under the maximum correntropy criterion in impulsive interference","volume":"21","author":"Shi","year":"2014","journal-title":"IEEE Signal Processing Letters"},{"key":"2021121722454619200_B46","doi-asserted-by":"crossref","DOI":"10.3389\/fnhum.2011.00075","article-title":"Value and prediction error in medial frontal cortex: Integrating the single-unit and systems levels of analysis","volume":"5","author":"Silvetti","year":"2011","journal-title":"Frontiers in Human Neuroscience"},{"key":"2021121722454619200_B47","first-page":"2950","article-title":"Using correntropy as a cost function in linear adaptive filters.","author":"Principe","year":"2009","journal-title":"Proceedings of the International Joint Conference on Neural Networks"},{"key":"2021121722454619200_B48","doi-asserted-by":"crossref","first-page":"2070","DOI":"10.1109\/ICASSP.2010.5495055","article-title":"A closed form recursive solution for maximum correntropy training","author":"Singh","year":"2010","journal-title":"Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing"},{"issue":"5574","key":"2021121722454619200_B49","doi-asserted-by":"crossref","first-page":"1829","DOI":"10.1126\/science.1070291","article-title":"Direct cortical control of 3D neuroprosthetic devices","volume":"296","author":"Taylor","year":"2002","journal-title":"Science"},{"issue":"5","key":"2021121722454619200_B50","doi-asserted-by":"crossref","first-page":"1163","DOI":"10.1523\/JNEUROSCI.4415-07.2008","article-title":"Primary motor cortex tuning to intended movement kinematics in humans with tetraplegia","volume":"28","author":"Truccolo","year":"2008","journal-title":"Journal of Neuroscience"},{"issue":"1\u20132","key":"2021121722454619200_B51","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.bbr.2003.09.028","article-title":"Do rats have a prefrontal cortex?","volume":"146","author":"Uylings","year":"2003","journal-title":"Behavioural Brain Research"},{"key":"2021121722454619200_B52","doi-asserted-by":"crossref","DOI":"10.3389\/fnins.2017.00316","article-title":"Computational models of anterior cingulate cortex: At the crossroads between prediction and effort","volume":"11","author":"Vassena","year":"2017","journal-title":"Frontiers in Neuroscience"},{"key":"2021121722454619200_B53","doi-asserted-by":"crossref","first-page":"1098","DOI":"10.1038\/nature06996","article-title":"Cortical control of a prosthetic arm for self-feeding","volume":"453","author":"Velliste","year":"2008","journal-title":"Nature"},{"issue":"5","key":"2021121722454619200_B54","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1016\/j.neuron.2018.01.040","article-title":"Neural population dynamics underlying motor learning transfer","volume":"97","author":"Vyas","year":"2018","journal-title":"Neuron"},{"key":"2021121722454619200_B55","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1038\/s41593-018-0147-8","article-title":"Prefrontal cortex as a meta-reinforcement learning system","volume":"21","author":"Wang","year":"2018","journal-title":"Nature Neuroscience"},{"issue":"2","key":"2021121722454619200_B56","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1109\/TRE.2000.847807","article-title":"Brain-computer interface technology: A review of the first international meeting","volume":"8","author":"Wolpaw","year":"2000","journal-title":"IEEE Transactions on Rehabilitation Engineering"},{"issue":"1","key":"2021121722454619200_B57","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1162\/089976606774841585","article-title":"Bayesian population decoding of motor cortical activity using a Kalman filter","volume":"18","author":"Wu","year":"2006","journal-title":"Neural Computation"},{"issue":"40","key":"2021121722454619200_B58","doi-asserted-by":"crossref","first-page":"17199","DOI":"10.1073\/pnas.0901077106","article-title":"Neural computations underlying action-based decision making in the human brain","volume":"106","author":"Wunderlich","year":"2009","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/33\/5\/1372\/1978077\/neco_a_01380.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/33\/5\/1372\/1978077\/neco_a_01380.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,24]],"date-time":"2022-12-24T09:07:59Z","timestamp":1671872879000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/33\/5\/1372\/98295\/Hierarchical-Dynamical-Model-for-Multiple-Cortical"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":58,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,4,13]]},"published-print":{"date-parts":[[2021,4,13]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01380","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,5]]},"published":{"date-parts":[[2021,4,13]]}}}