{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T08:51:09Z","timestamp":1781599869352,"version":"3.54.5"},"reference-count":53,"publisher":"National Academy of Sciences","issue":"42","license":[{"start":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T00:00:00Z","timestamp":1696982400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1912286"],"award-info":[{"award-number":["IIS-1912286"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000065","name":"HHS | NIH | National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["R01NS109367"],"award-info":[{"award-number":["R01NS109367"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000065","name":"HHS | NIH | National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["R01NS115929"],"award-info":[{"award-number":["R01NS115929"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000055","name":"HHS | NIH | National Institute on Deafness and Other Communication Disorders","doi-asserted-by":"publisher","award":["R01DC018805"],"award-info":[{"award-number":["R01DC018805"]}],"id":[{"id":"10.13039\/100000055","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2023,10,17]]},"abstract":"<jats:p>Speech production is a complex human function requiring continuous feedforward commands together with reafferent feedback processing. These processes are carried out by distinct frontal and temporal cortical networks, but the degree and timing of their recruitment and dynamics remain poorly understood. We present a deep learning architecture that translates neural signals recorded directly from the cortex to an interpretable representational space that can reconstruct speech. We leverage learned decoding networks to disentangle feedforward vs. feedback processing. Unlike prevailing models, we find a mixed cortical architecture in which frontal and temporal networks each process both feedforward and feedback information in tandem. We elucidate the timing of feedforward and feedback\u2013related processing by quantifying the derived receptive fields. Our approach provides evidence for a surprisingly mixed cortical architecture of speech circuitry together with decoding advances that have important implications for neural prosthetics.<\/jats:p>","DOI":"10.1073\/pnas.2300255120","type":"journal-article","created":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T13:38:39Z","timestamp":1697031519000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":22,"title":["Distributed feedforward and feedback cortical processing supports human speech production"],"prefix":"10.1073","volume":"120","author":[{"given":"Ran","family":"Wang","sequence":"first","affiliation":[{"name":"Electrical and Computer Engineering Department, New York University, New York, NY 11201"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xupeng","family":"Chen","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering Department, New York University, New York, NY 11201"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amirhossein","family":"Khalilian-Gourtani","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering Department, New York University, New York, NY 11201"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-8998-1545","authenticated-orcid":false,"given":"Leyao","family":"Yu","sequence":"additional","affiliation":[{"name":"Neurology Department, New York University, New York, NY 10016"},{"name":"Biomedical Engineering Department, New York University, New York, NY 11201"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Patricia","family":"Dugan","sequence":"additional","affiliation":[{"name":"Neurology Department, New York University, New York, NY 10016"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Friedman","sequence":"additional","affiliation":[{"name":"Neurology Department, New York University, New York, NY 10016"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Werner","family":"Doyle","sequence":"additional","affiliation":[{"name":"Neurosurgery Department, New York University, New York, NY 10016"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Orrin","family":"Devinsky","sequence":"additional","affiliation":[{"name":"Neurology Department, New York University, New York, NY 10016"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3199-3802","authenticated-orcid":false,"given":"Yao","family":"Wang","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering Department, New York University, New York, NY 11201"},{"name":"Biomedical Engineering Department, New York University, New York, NY 11201"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1247-1283","authenticated-orcid":false,"given":"Adeen","family":"Flinker","sequence":"additional","affiliation":[{"name":"Neurology Department, New York University, New York, NY 10016"},{"name":"Biomedical Engineering Department, New York University, New York, NY 11201"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2023,10,11]]},"reference":[{"key":"e_1_3_4_1_2","volume-title":"Principles of Neural Science","author":"Kandel E. R.","year":"2000","unstructured":"E. R. Kandel , Principles of Neural Science (McGraw-Hill, New York, NY, 2000), vol. 4."},{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(01)00285-9"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2005.11.002"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-804281-6.00001-X"},{"key":"e_1_3_4_5_2","volume-title":"Principles of Frontal Lobe Function","author":"Stuss D. T.","year":"2013","unstructured":"D. T. Stuss, R. T. Knight, Principles of Frontal Lobe Function (Oxford University Press, 2013)."},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2113"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.3171\/2014.10.JNS132647"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2424-16.2016"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00206237"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/10471.001.0001"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2011.00082"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3158"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2012.06.004"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1080\/01690965.2013.834370"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1414491112"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature11911"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2018.04.031"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2010.10.029"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1809-10.2010"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0014744"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0060783"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-37359-z"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ab0c59"},{"key":"e_1_3_4_24_2","doi-asserted-by":"crossref","unstructured":"R. Wang Y. Wang A. Flinker \u201cReconstructing speech stimuli from human auditory cortex activity using a WaveNet approach\u201d in 2018 IEEE Signal Processing in Medicine and Biology Symposium (SPMB) (IEEE 2018) pp. 1\u20136.","DOI":"10.1109\/SPMB.2018.8615605"},{"key":"e_1_3_4_25_2","doi-asserted-by":"crossref","unstructured":"R. Wang et al . \u201cStimulus speech decoding from human cortex with generative adversarial network transfer learning in 2020\u201d in 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI) (2020) pp. 390\u2013394.","DOI":"10.1109\/ISBI45749.2020.9098589"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1119-1"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42003-021-02578-0"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0000000000010639"},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.10.080"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2019.01267"},{"key":"e_1_3_4_31_2","doi-asserted-by":"crossref","unstructured":"C. H. Taal R. C. Hendriks R. Heusdens J. Jensen \u201cA short-time objective intelligibility measure for time-frequency weighted noisy speech\u201d in 2010 IEEE International Conference on Acoustics Speech and Signal Processing (IEEE 2010) pp. 4214\u20134217.","DOI":"10.1109\/ICASSP.2010.5495701"},{"key":"e_1_3_4_32_2","unstructured":"J. Kominek T. Schultz A. W. Black \u201cSynthesizer voice quality of new languages calibrated with mean MEL cepstral distortion\u201d in Spoken Languages Technologies for Under-Resourced Languages (2008)."},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-020-0608-8"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMoa2027540"},{"key":"e_1_3_4_35_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2014.00406"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10237-014-0632-2"},{"key":"e_1_3_4_37_2","volume-title":"Speech Analysis Synthesis and Perception","author":"Flanagan J. L.","year":"2013","unstructured":"J. L. Flanagan, Speech Analysis Synthesis and Perception (Springer Science& Business Media, 2013), vol. 3."},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1216827110"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3001493"},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2331"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00622503"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2457"},{"key":"e_1_3_4_43_2","doi-asserted-by":"crossref","unstructured":"A. Khalilian-Gourtani . A corollary discharge circuit in human speech. bioRxiv [Preprint] (2022). https:\/\/doi.org\/10.1101\/2022.09.12.507590 (Accessed 28 September 2023).","DOI":"10.1101\/2022.09.12.507590"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2004.02.004"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.12577"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2012.06.039"},{"key":"e_1_3_4_47_2","doi-asserted-by":"crossref","unstructured":"K. He X. Zhang S. Ren J. Sun \u201cDeep residual learning for image recognition\u201d in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016) pp. 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/abb25e"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781482276237"},{"key":"e_1_3_4_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2005.08.009"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1121\/1.2149841"},{"key":"e_1_3_4_52_2","unstructured":"J. Engel L. Hantrakul C. Gu A. Roberts DDSP: Differentiable digital signal processing. arXiv [Preprint] (2020). http:\/\/arxiv.org\/abs\/2001.04643 (Accessed 7 December 2021)."},{"key":"e_1_3_4_53_2","unstructured":"R. Wang A. Flinker DistributedFeedforwardFeedbackProcessing Repository. GitHub. https:\/\/github.com\/flinkerlab\/DistributedFeedforwardFeedbackProcessing. Deposited 28 September 2023."}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2300255120","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T13:41:03Z","timestamp":1697031663000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/10.1073\/pnas.2300255120"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,11]]},"references-count":53,"journal-issue":{"issue":"42","published-print":{"date-parts":[[2023,10,17]]}},"alternative-id":["10.1073\/pnas.2300255120"],"URL":"https:\/\/doi.org\/10.1073\/pnas.2300255120","relation":{},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,11]]},"assertion":[{"value":"2023-01-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-22","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2300255120"}}