{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T03:07:30Z","timestamp":1784948850270,"version":"3.55.0"},"reference-count":42,"publisher":"MIT Press","issue":"8","funder":[{"name":"STI2030-Major Project","award":["2021ZD0204105"],"award-info":[{"award-number":["2021ZD0204105"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32222035"],"award-info":[{"award-number":["32222035"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key R&D Program of Zhejiang","award":["2022C03011"],"award-info":[{"award-number":["2022C03011"]}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>When listening to connected speech, the human brain can extract multiple levels of linguistic units, such as syllables, words, and sentences. It has been hypothesized that the time scale of cortical activity encoding each linguistic unit is commensurate with the time scale of that linguistic unit in speech. Evidence for the hypothesis originally comes from studies using the frequency-tagging paradigm that presents each linguistic unit at a constant rate, and more recently extends to studies on natural speech. For natural speech, it is sometimes assumed that neural encoding of different levels of linguistic units is captured by the neural response tracking speech envelope in different frequency bands (e.g., around 1 Hz for phrases, around 2 Hz for words, and around 4 Hz for syllables). Here, we analyze the coherence between speech envelope and idealized responses, each of which tracks a single level of linguistic unit. Four units, that is, phones, syllables, words, and sentences, are separately considered. We show that the idealized phone-, syllable-, and word-tracking responses all correlate with the speech envelope both around 3\u20136 Hz and below \u223c1 Hz. Further analyses reveal that the 1-Hz correlation mainly originates from the pauses in connected speech. The results here suggest that a simple frequency-domain decomposition of envelope-tracking activity cannot separate the neural responses to different linguistic units in natural speech.<\/jats:p>","DOI":"10.1162\/jocn_a_02013","type":"journal-article","created":{"date-parts":[[2023,6,1]],"date-time":"2023-06-01T19:25:42Z","timestamp":1685647542000},"page":"1361-1368","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":8,"title":["Complex Mapping between Neural Response Frequency and Linguistic Units in Natural Speech"],"prefix":"10.1162","volume":"35","author":[{"given":"Yuran","family":"Zhang","sequence":"first","affiliation":[{"name":"Zhejiang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiajie","family":"Zou","sequence":"additional","affiliation":[{"name":"Zhejiang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nai","family":"Ding","sequence":"additional","affiliation":[{"name":"Zhejiang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2023,8,1]]},"reference":[{"key":"2023071721430898100_bib1","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1007\/BF00336731","article-title":"The spectro-temporal receptive field: A functional characteristic of auditory neurons","volume":"42","author":"Aertsen","year":"1981","journal-title":"Biological Cybernetics"},{"key":"2023071721430898100_bib2","doi-asserted-by":"publisher","first-page":"119203","DOI":"10.1016\/j.neuroimage.2022.119203","article-title":"Event-related responses reflect chunk boundaries in natural speech","volume":"255","author":"Anurova","year":"2022","journal-title":"Neuroimage"},{"key":"2023071721430898100_bib3","doi-asserted-by":"publisher","first-page":"3976","DOI":"10.1016\/j.cub.2018.10.042","article-title":"Rapid transformation from auditory to linguistic representations of continuous speech","volume":"28","author":"Brodbeck","year":"2018","journal-title":"Current Biology"},{"key":"2023071721430898100_bib4","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/j.cophys.2020.07.014","article-title":"Continuous speech processing","volume":"18","author":"Brodbeck","year":"2020","journal-title":"Current Opinion in Physiology"},{"key":"2023071721430898100_bib5","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1016\/j.cub.2018.01.080","article-title":"Electrophysiological correlates of semantic dissimilarity reflect the comprehension of natural, narrative speech","volume":"28","author":"Broderick","year":"2018","journal-title":"Current Biology"},{"key":"2023071721430898100_bib6","doi-asserted-by":"publisher","first-page":"2446","DOI":"10.1038\/s41598-021-81901-5","article-title":"Grammatical category and the neural processing of phrases","volume":"11","author":"Burroughs","year":"2021","journal-title":"Scientific Reports"},{"key":"2023071721430898100_bib7","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1523\/JNEUROSCI.4137-08.2009","article-title":"Prelude to and resolution of an error: EEG phase synchrony reveals cognitive control dynamics during action monitoring","volume":"29","author":"Cavanagh","year":"2009","journal-title":"Journal of Neuroscience"},{"key":"2023071721430898100_bib8","doi-asserted-by":"publisher","first-page":"6273","DOI":"10.1093\/cercor\/bhac502","article-title":"Speech onsets and sustained speech contribute differentially to delta and theta speech tracking in auditory cortex","volume":"33","author":"Chalas","year":"2023","journal-title":"Cerebral Cortex"},{"key":"2023071721430898100_bib9","doi-asserted-by":"publisher","first-page":"42","DOI":"10.18653\/v1\/2021.emnlp-demo.6","article-title":"N-LTP: An open-source neural language technology platform for Chinese","volume-title":"Proceedings of the 2021 conference on empirical methods in natural language processing: System demonstrations","author":"Che","year":"2021"},{"key":"2023071721430898100_bib10","doi-asserted-by":"publisher","first-page":"3670","DOI":"10.21437\/Interspeech.2021-1965","article-title":"Gigaspeech: An evolving, multi-domain ASR corpus with 10,000 hours of transcribed audio","volume-title":"Proceedings of Interspeech 2021","author":"Chen","year":"2021"},{"key":"2023071721430898100_bib11","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1162\/nol_a_00070","article-title":"Effects of structure and meaning on cortical tracking of linguistic units in naturalistic speech","volume":"3","author":"Coopmans","year":"2022","journal-title":"Neurobiology of Language"},{"key":"2023071721430898100_bib12","doi-asserted-by":"publisher","first-page":"eaaw2594","DOI":"10.1126\/sciadv.aaw2594","article-title":"Different languages, similar encoding efficiency: Comparable information rates across the human communicative niche","volume":"5","author":"Coup\u00e9","year":"2019","journal-title":"Science Advances"},{"key":"2023071721430898100_bib13","doi-asserted-by":"publisher","first-page":"2457","DOI":"10.1016\/j.cub.2015.08.030","article-title":"Low-frequency cortical entrainment to speech reflects phoneme-level processing","volume":"25","author":"Di Liberto","year":"2015","journal-title":"Current Biology"},{"key":"2023071721430898100_bib14","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.tics.2015.12.006","article-title":"Rhythm of silence","volume":"20","author":"Ding","year":"2016","journal-title":"Trends in Cognitive Sciences"},{"key":"2023071721430898100_bib15","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1038\/nn.4186","article-title":"Cortical tracking of hierarchical linguistic structures in connected speech","volume":"19","author":"Ding","year":"2016","journal-title":"Nature Neuroscience"},{"key":"2023071721430898100_bib16","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.neubiorev.2017.02.011","article-title":"Temporal modulations in speech and music","volume":"81","author":"Ding","year":"2017","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"2023071721430898100_bib17","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1016\/j.neuroimage.2013.06.035","article-title":"Acoustic landmarks drive delta-theta oscillations to enable speech comprehension by facilitating perceptual parsing","volume":"85","author":"Doelling","year":"2014","journal-title":"Neuroimage"},{"key":"2023071721430898100_bib18","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1016\/S0022-5371(65)80081-0","article-title":"The psychological reality of linguistic segments","volume":"4","author":"Fodor","year":"1965","journal-title":"Journal of Verbal Learning and Verbal Behavior"},{"key":"2023071721430898100_bib19","volume-title":"An introduction to language","author":"Fromkin","year":"1983"},{"key":"2023071721430898100_bib20","doi-asserted-by":"publisher","first-page":"14759","DOI":"10.1038\/s41598-022-18162-3","article-title":"Overt and implicit prosody contribute to neurophysiological responses previously attributed to grammatical processing","volume":"12","author":"Glushko","year":"2022","journal-title":"Scientific Reports"},{"key":"2023071721430898100_bib21","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1016\/j.wocn.2003.09.005","article-title":"Temporal properties of spontaneous speech\u2014A syllable-centric perspective","volume":"31","author":"Greenberg","year":"2003","journal-title":"Journal of Phonetics"},{"key":"2023071721430898100_bib22","volume-title":"Linguistic theory and psychological reality","author":"Halle","year":"1978"},{"key":"2023071721430898100_bib23","doi-asserted-by":"publisher","first-page":"15846","DOI":"10.1038\/s41598-020-72739-4","article-title":"Sequences of intonation units form a \u223c1 Hz rhythm","volume":"10","author":"Inbar","year":"2020","journal-title":"Scientific Reports"},{"key":"2023071721430898100_bib24","doi-asserted-by":"publisher","first-page":"e55613","DOI":"10.7554\/eLife.55613","article-title":"Low-frequency neural activity reflects rule-based chunking during speech listening","volume":"9","author":"Jin","year":"2020","journal-title":"eLife"},{"key":"2023071721430898100_bib25","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.cortex.2021.09.012","article-title":"Frequency tagging of syntactic structure or lexical properties; A registered MEG study","volume":"146","author":"Kalenkovich","year":"2022","journal-title":"Cortex"},{"key":"2023071721430898100_bib26","doi-asserted-by":"publisher","first-page":"9467","DOI":"10.1523\/JNEUROSCI.0302-20.2020","article-title":"Linguistic structure and meaning organize neural oscillations into a content-specific hierarchy","volume":"40","author":"Kaufeld","year":"2020","journal-title":"Journal of Neuroscience"},{"key":"2023071721430898100_bib27","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1038\/s41583-022-00659-5","article-title":"What neural oscillations can and cannot do for syntactic structure building","volume":"24","author":"Kazanina","year":"2023","journal-title":"Nature Reviews Neuroscience"},{"key":"2023071721430898100_bib28","doi-asserted-by":"publisher","first-page":"e2004473","DOI":"10.1371\/journal.pbio.2004473","article-title":"Perceptually relevant speech tracking in auditory and motor cortex reflects distinct linguistic features","volume":"16","author":"Keitel","year":"2018","journal-title":"PLoS Biology"},{"key":"2023071721430898100_bib29","doi-asserted-by":"publisher","first-page":"e48971","DOI":"10.7554\/eLife.48971","article-title":"Neural tracking of speech mental imagery during rhythmic inner counting","volume":"8","author":"Lu","year":"2019","journal-title":"eLife"},{"key":"2023071721430898100_bib30","doi-asserted-by":"publisher","first-page":"1515","DOI":"10.3389\/fpsyg.2015.01515","article-title":"The brain dynamics of linguistic computation","volume":"6","author":"Murphy","year":"2015","journal-title":"Frontiers in Psychology"},{"key":"2023071721430898100_bib31","doi-asserted-by":"publisher","first-page":"10234","DOI":"10.1523\/JNEUROSCI.0411-11.2011","article-title":"Tagging the neuronal entrainment to beat and meter","volume":"31","author":"Nozaradan","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"2023071721430898100_bib32","doi-asserted-by":"publisher","first-page":"1378","DOI":"10.1093\/cercor\/bhs118","article-title":"Phase-locked responses to speech in human auditory cortex are enhanced during comprehension","volume":"23","author":"Peelle","year":"2013","journal-title":"Cerebral Cortex"},{"key":"2023071721430898100_bib33","doi-asserted-by":"publisher","first-page":"13477","DOI":"10.1038\/s41598-022-17401-x","article-title":"Language specificity in cortical tracking of speech rhythm at the mora, syllable, and foot levels","volume":"12","author":"Peter","year":"2022","journal-title":"Scientific Reports"},{"key":"2023071721430898100_bib34","doi-asserted-by":"publisher","first-page":"322","DOI":"10.1038\/s41583-020-0304-4","article-title":"Speech rhythms and their neural foundations","volume":"21","author":"Poeppel","year":"2020","journal-title":"Nature Reviews Neuroscience"},{"key":"2023071721430898100_bib35","doi-asserted-by":"publisher","first-page":"104891","DOI":"10.1016\/j.bandl.2020.104891","article-title":"Neural tracking of the speech envelope is differentially modulated by attention and language experience","volume":"213","author":"Reetzke","year":"2021","journal-title":"Brain and Language"},{"key":"2023071721430898100_bib36","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/c9sgb","article-title":"Rhythm comes, rhythm goes: Short-term periodicity of prosodic phrasing [preprint]","author":"Stehwien","year":"2021","journal-title":"PsyArXiv"},{"key":"2023071721430898100_bib37","doi-asserted-by":"publisher","first-page":"e77468","DOI":"10.7554\/eLife.77468","article-title":"Neural tracking of phrases in spoken language comprehension is automatic and task-dependent","volume":"11","author":"ten Oever","year":"2022","journal-title":"eLife"},{"key":"2023071721430898100_bib38","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1080\/net.12.3.289.316","article-title":"Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli","volume":"12","author":"Theunissen","year":"2001","journal-title":"Network: Computation in Neural Systems"},{"key":"2023071721430898100_bib39","doi-asserted-by":"publisher","first-page":"6182","DOI":"10.1109\/ICASSP43922.2022.9746682","article-title":"WenetSpeech: A 10000+ hours multi-domain mandarin corpus for speech recognition","volume-title":"IEEE international conference on acoustics, speech and signal processing (ICASSP)","author":"Zhang","year":"2022"},{"key":"2023071721430898100_bib40","doi-asserted-by":"publisher","first-page":"105111","DOI":"10.1016\/j.neubiorev.2023.105111","article-title":"Acoustic correlates of the syllabic rhythm of speech: Modulation spectrum or local features of the temporal envelope","volume":"147","author":"Zhang","year":"2023","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"2023071721430898100_bib41","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.neuroimage.2019.02.047","article-title":"Auditory and language contributions to neural encoding of speech features in noisy environments","volume":"192","author":"Zou","year":"2019","journal-title":"Neuroimage"},{"key":"2023071721430898100_bib42","doi-asserted-by":"publisher","DOI":"10.1523\/ENEURO.0058-21.2021","article-title":"\u03b8-Band cortical tracking of the speech envelope shows the linear phase property","volume":"8","author":"Zou","year":"2021","journal-title":"eNeuro"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/8\/1361\/2145173\/jocn_a_02013.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/8\/1361\/2145173\/jocn_a_02013.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,17]],"date-time":"2023-07-17T21:43:21Z","timestamp":1689630201000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/35\/8\/1361\/116259\/Complex-Mapping-between-Neural-Response-Frequency"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":42,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8,1]]},"published-print":{"date-parts":[[2023,8,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_02013","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}