{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T03:49:00Z","timestamp":1793159340201,"version":"4.5.0"},"reference-count":40,"publisher":"IOP Publishing","issue":"2","license":[{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"vor","delay-in-days":16,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T00:00:00Z","timestamp":1713312000000},"content-version":"tdm","delay-in-days":16,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Emory Neuromodulation and Technology Innovation Center"},{"name":"Eunice Kennedy Shriver National Institute of Child Health and Human Development","award":["F32HD112173"],"award-info":[{"award-number":["F32HD112173"]}]},{"DOI":"10.13039\/100000055","name":"National Institute on Deafness and Other Communication Disorders","doi-asserted-by":"crossref","award":["DP2DC021055"],"award-info":[{"award-number":["DP2DC021055"]}],"id":[{"id":"10.13039\/100000055","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000893","name":"Simons Foundation","doi-asserted-by":"crossref","award":["872146SPI"],"award-info":[{"award-number":["872146SPI"]}],"id":[{"id":"10.13039\/100000893","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006380","name":"Rehabilitation Research and Development Service","doi-asserted-by":"crossref","award":["A2295R"],"award-info":[{"award-number":["A2295R"]}],"id":[{"id":"10.13039\/100006380","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000065","name":"National Institute of Neurological Disorders and Stroke","doi-asserted-by":"crossref","award":["DP2NS127291"],"award-info":[{"award-number":["DP2NS127291"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging and Bioengineering","doi-asserted-by":"crossref","award":["T32EB025816"],"award-info":[{"award-number":["T32EB025816"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["J. Neural Eng."],"published-print":{"date-parts":[[2024,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    <jats:italic>Objective.<\/jats:italic>\n                    Artificial neural networks (ANNs) are state-of-the-art tools for modeling and decoding neural activity, but deploying them in closed-loop experiments with tight timing constraints is challenging due to their limited support in existing real-time frameworks. Researchers need a platform that fully supports high-level languages for running ANNs (e.g. Python and Julia) while maintaining support for languages that are critical for low-latency data acquisition and processing (e.g. C and C++).\n                    <jats:italic>Approach.<\/jats:italic>\n                    To address these needs, we introduce the Backend for Realtime Asynchronous Neural Decoding (BRAND). BRAND comprises Linux processes, termed\n                    <jats:italic>nodes<\/jats:italic>\n                    , which communicate with each other in a\n                    <jats:italic>graph<\/jats:italic>\n                    via streams of data. Its asynchronous design allows for acquisition, control, and analysis to be executed in parallel on streams of data that may operate at different timescales. BRAND uses Redis, an in-memory database, to send data between nodes, which enables fast inter-process communication and supports 54 different programming languages. Thus, developers can easily deploy existing ANN models in BRAND with minimal implementation changes.\n                    <jats:italic>Main results.<\/jats:italic>\n                    In our tests, BRAND achieved &lt;600 microsecond latency between processes when sending large quantities of data (1024 channels of 30 kHz neural data in 1 ms chunks). BRAND runs a brain-computer interface with a recurrent neural network (RNN) decoder with less than 8 ms of latency from neural data input to decoder prediction. In a real-world demonstration of the system, participant T11 in the BrainGate2 clinical trial (ClinicalTrials.gov Identifier: NCT00912041) performed a standard cursor control task, in which 30 kHz signal processing, RNN decoding, task control, and graphics were all executed in BRAND. This system also supports real-time inference with complex latent variable models like Latent Factor Analysis via Dynamical Systems.\n                    <jats:italic>Significance.<\/jats:italic>\n                    By providing a framework that is fast, modular, and language-agnostic, BRAND lowers the barriers to integrating the latest tools in neuroscience and machine learning into closed-loop experiments.\n                  <\/jats:p>","DOI":"10.1088\/1741-2552\/ad3b3a","type":"journal-article","created":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T18:28:51Z","timestamp":1712341731000},"page":"026046","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":37,"title":["BRAND: a platform for closed-loop experiments with deep network models"],"prefix":"10.1088","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8618-3837","authenticated-orcid":true,"given":"Yahia H","family":"Ali","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6329-7353","authenticated-orcid":false,"given":"Kevin","family":"Bodkin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7298-274X","authenticated-orcid":false,"given":"Mattia","family":"Rigotti-Thompson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kushant","family":"Patel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6858-268X","authenticated-orcid":false,"given":"Nicholas S","family":"Card","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4564-2555","authenticated-orcid":true,"given":"Bareesh","family":"Bhaduri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7127-0986","authenticated-orcid":true,"given":"Samuel R","family":"Nason-Tomaszewski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8200-8193","authenticated-orcid":false,"given":"Domenick M","family":"Mifsud","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2066-8561","authenticated-orcid":false,"given":"Xianda","family":"Hou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7761-3943","authenticated-orcid":false,"given":"Claire","family":"Nicolas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7903-5091","authenticated-orcid":false,"given":"Shane","family":"Allcroft","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0261-2273","authenticated-orcid":true,"given":"Leigh R","family":"Hochberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7898-7832","authenticated-orcid":false,"given":"Nicholas","family":"Au Yong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5238-0573","authenticated-orcid":true,"given":"Sergey D","family":"Stavisky","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8675-7140","authenticated-orcid":true,"given":"Lee E","family":"Miller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3224-7019","authenticated-orcid":true,"given":"David M","family":"Brandman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1241-1432","authenticated-orcid":true,"given":"Chethan","family":"Pandarinath","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2024,4,17]]},"reference":[{"key":"jnead3b3abib1","doi-asserted-by":"publisher","first-page":"7398","DOI":"10.1038\/nature11076","article-title":"Reach and grasp by people with tetraplegia using a neurally controlled robotic arm","volume":"485","author":"Hochberg","year":"2012","journal-title":"Nature"},{"key":"jnead3b3abib2","doi-asserted-by":"publisher","first-page":"557","DOI":"10.1016\/S0140-6736(12)61816-9","article-title":"High-performance neuroprosthetic control by an individual with tetraplegia","volume":"381","author":"Collinger","year":"2013","journal-title":"Lancet"},{"key":"jnead3b3abib3","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.18554","article-title":"High performance communication by people with paralysis using an intracortical brain-computer interface","volume":"6","author":"Pandarinath","year":"2017","journal-title":"eLife"},{"key":"jnead3b3abib4","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1038\/s41586-021-03506-2","article-title":"High-performance brain-to-text communication via handwriting","volume":"593","author":"Willett","year":"2021","journal-title":"Nature"},{"key":"jnead3b3abib5","doi-asserted-by":"publisher","first-page":"1821","DOI":"10.1016\/S0140-6736(17)30601-3","article-title":"Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: a proof-of-concept demonstration","volume":"389","author":"Ajiboye","year":"2017","journal-title":"Lancet"},{"key":"jnead3b3abib6","doi-asserted-by":"publisher","first-page":"1142","DOI":"10.1038\/nm.3953","article-title":"Clinical translation of a high-performance neural prosthesis","volume":"21","author":"Gilja","year":"2015","journal-title":"Nat. Med."},{"key":"jnead3b3abib7","doi-asserted-by":"publisher","first-page":"1932","DOI":"10.1152\/jn.00503.2010","article-title":"A closed-loop human simulator for investigating the role of feedback control in brain-machine interfaces","volume":"105","author":"Cunningham","year":"2011","journal-title":"J. Neurophysiol."},{"key":"jnead3b3abib8","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms13825","article-title":"Rapid control and feedback rates enhance neuroprosthetic control","volume":"8","author":"Shanechi","year":"2017","journal-title":"Nat. Commun."},{"key":"jnead3b3abib9","author":"Simulink Real-Time\u2014MATLAB","year":"2024"},{"key":"jnead3b3abib10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005430","article-title":"Hard real-time closed-loop electrophysiology with the real-time eXperiment interface (RTXI)","volume":"13","author":"Patel","year":"2017","journal-title":"PLoS Comput. Biol."},{"key":"jnead3b3abib11","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aa7526","article-title":"Falcon: a highly flexible open-source software for closed-loop neuroscience","volume":"14","author":"Ciliberti","year":"2017","journal-title":"J. Neural Eng."},{"key":"jnead3b3abib12","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1145\/3211332.3211344","article-title":"An open-source realtime computational platform (short WIP paper)","author":"Mehrotra","year":"2018"},{"key":"jnead3b3abib13","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/12\/3\/036009","article-title":"A high performing brain\u2013machine interface driven by low-frequency local field potentials alone and together with spikes","volume":"12","author":"Stavisky","year":"2015","journal-title":"J. Neural Eng."},{"key":"jnead3b3abib14","author":"Clients"},{"key":"jnead3b3abib15","author":"realtime:start [Wiki]"},{"key":"jnead3b3abib16","doi-asserted-by":"publisher","first-page":"1687","DOI":"10.1109\/TNSRE.2017.2677443","article-title":"Review: human intracortical recording and neural decoding for brain\u2013computer interfaces","volume":"25","author":"Brandman","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"jnead3b3abib17","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1152\/physrev.00034.2020","article-title":"The science and engineering behind sensitized brain-controlled bionic hands","volume":"102","author":"Pandarinath","year":"2022","journal-title":"Physiol. Rev."},{"key":"jnead3b3abib18","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1038\/s41551-020-0591-0","article-title":"A low-power band of neuronal spiking activity dominated by local single units improves the performance of brain\u2013machine interfaces","volume":"4","author":"Nason","year":"2020","journal-title":"Nat. Biomed. Eng."},{"key":"jnead3b3abib19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.51628\/001c.27358","article-title":"Representation learning for neural population activity with neural data transformers","volume":"5","author":"Ye","year":"2021","journal-title":"Neurons Behav. Data Anal. Theory"},{"key":"jnead3b3abib20","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1038\/s41592-018-0109-9","article-title":"Inferring single-trial neural population dynamics using sequential auto-encoders","volume":"15","author":"Pandarinath","year":"2018","journal-title":"Nat. Methods"},{"key":"jnead3b3abib21","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1109\/TASSP.1980.1163420","article-title":"Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences","volume":"28","author":"Davis","year":"1980","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"jnead3b3abib22","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/8\/2\/025027","article-title":"Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array","volume":"8","author":"Simeral","year":"2011","journal-title":"J. Neural Eng."},{"key":"jnead3b3abib23","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1038\/nn.3265","article-title":"A high-performance neural prosthesis enabled by control algorithm design","volume":"15","author":"Gilja","year":"2012","journal-title":"Nat. Neurosci."},{"key":"jnead3b3abib24","doi-asserted-by":"publisher","first-page":"1829","DOI":"10.1126\/science.1070291","article-title":"Direct cortical control of 3D neuroprosthetic devices","volume":"296","author":"Taylor","year":"2002","journal-title":"Science"},{"key":"jnead3b3abib25","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aa9ee7","article-title":"Rapid calibration of an intracortical brain\u2013computer interface for people with tetraplegia","volume":"15","author":"Brandman","year":"2018","journal-title":"J. Neural Eng."},{"key":"jnead3b3abib26","article-title":"Neural latents benchmark\u201921: evaluating latent variable models of neural population activity","volume":"vol 1","author":"Pei","year":"2021"},{"key":"jnead3b3abib27","doi-asserted-by":"publisher","first-page":"7","DOI":"10.3389\/fninf.2015.00007","article-title":"Bonsai: an event-based framework for processing and controlling data streams","volume":"9","author":"Lopes","year":"2015","journal-title":"Front. Neuroinform."},{"key":"jnead3b3abib28","doi-asserted-by":"publisher","DOI":"10.3217\/978-3-85125-682-6-17","article-title":"Timeflux: an open-source framework for the acquisition and near real-time processing of signal streams","author":"Clisson","year":"2019"},{"key":"jnead3b3abib29","author":"LabGraph","year":"2023"},{"key":"jnead3b3abib30","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1016\/j.brs.2023.01.591","article-title":"Project dareplane for closed-loop deep brain stimulation","volume":"16","author":"Dold","year":"2023","journal-title":"Brain Stimul. Basic Transl. Clin. Res. Neuromodulation"},{"key":"jnead3b3abib31","article-title":"ROS: an open-source robot operating system","author":"Quigley","year":"2009"},{"key":"jnead3b3abib32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TBME.2021.3069119","article-title":"Home use of a percutaneous wireless intracortical brain-computer interface by individuals with tetraplegia","author":"Simeral","year":"2021"},{"key":"jnead3b3abib33","doi-asserted-by":"publisher","DOI":"10.1101\/2023.01.21.524489","article-title":"A high-performance speech neuroprosthesis","author":"Willett","year":"2023"},{"key":"jnead3b3abib34","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1056\/NEJMoa2027540","article-title":"Neuroprosthesis for decoding speech in a paralyzed person with anarthria","volume":"385","author":"Moses","year":"2021","journal-title":"New Engl. J. Med."},{"key":"jnead3b3abib35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/NER52421.2023.10123880","article-title":"Synthesizing speech by decoding intracortical neural activity from dorsal motor cortex","author":"Wairagkar","year":"2023"},{"key":"jnead3b3abib36","doi-asserted-by":"publisher","DOI":"10.1101\/2021.01.13.426570","article-title":"A large-scale neural network training framework for generalized estimation of single-trial population dynamics","author":"Keshtkaran","year":"2021"},{"key":"jnead3b3abib37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41593-020-00733-0","article-title":"Modeling behaviorally relevant neural dynamics enabled by preferential subspace identification","volume":"24","author":"Sani","year":"2021","journal-title":"Nat. Neurosci."},{"key":"jnead3b3abib38","doi-asserted-by":"publisher","first-page":"S49","DOI":"10.1016\/j.yebeh.2011.08.041","article-title":"Quickest detection of drug-resistant seizures: an optimal control approach","volume":"22","author":"Santaniello","year":"2011","journal-title":"Epilepsy Behav."},{"key":"jnead3b3abib39","author":"ZeroMQ","year":"2023"},{"key":"jnead3b3abib40","doi-asserted-by":"publisher","first-page":"1034","DOI":"10.1109\/TBME.2004.827072","article-title":"BCI2000: a general-purpose brain-computer interface (BCI) system","volume":"51","author":"Schalk","year":"2004","journal-title":"IEEE Trans. Biomed Eng."}],"container-title":["Journal of Neural Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T02:56:05Z","timestamp":1713322565000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad3b3a"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,1]]},"references-count":40,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,4,17]]},"published-print":{"date-parts":[[2024,4,1]]}},"URL":"https:\/\/doi.org\/10.1088\/1741-2552\/ad3b3a","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.08.08.552473","asserted-by":"object"}]},"ISSN":["1741-2560","1741-2552"],"issn-type":[{"value":"1741-2560","type":"print"},{"value":"1741-2552","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,1]]},"assertion":[{"value":"BRAND: a platform for closed-loop experiments with deep network models","name":"article_title","label":"Article Title"},{"value":"Journal of Neural Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-08-11","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-04-05","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-04-17","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}