{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T06:00:13Z","timestamp":1791352813129,"version":"4.3.1"},"reference-count":60,"publisher":"Acoustical Society of America (ASA)","issue":"5","content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2013,5,1]]},"abstract":"<jats:p>There is much debate on how the spectrotemporal modulations of speech (or its spectrogram) are encoded in the responses of the auditory nerve, and whether speech intelligibility is best conveyed via the \u201cenvelope\u201d (E) or \u201ctemporal fine-structure\u201d (TFS) of the neural responses. Wide use of vocoders to resolve this question has commonly assumed that manipulating the amplitude-modulation and frequency-modulation components of the vocoded signal alters the relative importance of E or TFS encoding on the nerve, thus facilitating assessment of their relative importance to intelligibility. Here we argue that this assumption is incorrect, and that the vocoder approach is ineffective in differentially altering the neural E and TFS. In fact, we demonstrate using a simplified model of early auditory processing that both neural E and TFS encode the speech spectrogram with constant and comparable relative effectiveness regardless of the vocoder manipulations. However, we also show that neural TFS cues are less vulnerable than their E counterparts under severe noisy conditions, and hence should play a more prominent role in cochlear stimulation strategies.<\/jats:p>","DOI":"10.1121\/1.4795783","type":"journal-article","created":{"date-parts":[[2013,5,7]],"date-time":"2013-05-07T13:11:23Z","timestamp":1367932283000},"page":"2818-2833","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":83,"title":["On the balance of envelope and temporal fine structure in the encoding of speech in the early auditory system"],"prefix":"10.1121","volume":"133","author":[{"given":"Shihab","family":"Shamma","sequence":"first","affiliation":[{"name":"Electrical and Computer Engineering Department and Institute for Systems Research, University of Maryland , College Park, Maryland 20742"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Lorenzi","sequence":"additional","affiliation":[{"name":"Institut d'Etude de la Cognition, Ecole normale sup\u00e9rieure, Paris Sciences et Lettres , 29 rue d'Ulm, 75005 Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"231","published-online":{"date-parts":[[2013,5,6]]},"reference":[{"key":"2023071703153466600_c1","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.heares.2009.12.002","article-title":"Effects of lowpass and highpass filtering on the intelligibility of speech based on temporal fine-structure or envelope cues","volume":"260","year":"2010","journal-title":"Hear. Res."},{"key":"2023071703153466600_c2","doi-asserted-by":"publisher","first-page":"823","DOI":"10.3109\/14992027.2010.492402","article-title":"Perception of temporal fine structure cues in speech with minimal envelope cues for listeners with mild- to-moderate hearing loss","volume":"49","year":"2010","journal-title":"Int. J. Audiol."},{"key":"2023071703153466600_c3","doi-asserted-by":"publisher","first-page":"2908","DOI":"10.1121\/1.2354017","article-title":"Speech recognition in normal hearing and sensorineural hearing loss as a function of the number of spectral channels","volume":"120","year":"2006","journal-title":"J. Acoust. Soc. Am."},{"issue":"5","key":"2023071703153466600_c4","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1152\/jn.1990.63.5.1191","article-title":"The representations of the steady-state vowel sound \/e\/ in the discharge patterns of cat anteroventral cochlear nucleus neurons","volume":"63","year":"1990","journal-title":"J. Neurophysiol."},{"key":"2023071703153466600_c5","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1097\/01.AUD.0000130796.73809.09","article-title":"Temporal fine structure cues to speech recognition and pure tone modulation in observers with sensorineural hearing loss","volume":"25","year":"2004","journal-title":"Ear. Hear."},{"key":"2023071703153466600_c6","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1121\/1.1577557","article-title":"An account of monaural phase sensitivity","volume":"114","year":"2003","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c7","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1152\/jn.1990.64.2.437","article-title":"Sensitivities of cells in anteroventral cochlear nucleus of cat to spatiotemporal discharge patterns across primary afferents","volume":"64","year":"1990","journal-title":"J. Neurophysiol."},{"key":"2023071703153466600_c58","first-page":"334","article-title":"Auditory phase opponency: A temporal model for masked detection at low frequencies","volume":"88","year":"2002","journal-title":"Acta Acust. Acust."},{"key":"2023071703153466600_c8","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/978-3-540-73009-5","article-title":"Spatio-temporal representation of the pitch of complex tones in the auditory nerve","volume-title":"Hearing\u2014From Sensory Processing to Perception","author":"Kollmeier","year":"2007"},{"issue":"11","key":"2023071703153466600_c59","doi-asserted-by":"publisher","first-page":"4323","DOI":"10.1109\/TSP.2009.2025107","article-title":"Time-frequency coherent modulation filtering of non-stationary signals","volume":"57","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"2023071703153466600_c60","doi-asserted-by":"publisher","first-page":"1977","DOI":"10.1121\/1.395642","article-title":"Responses of auditory-nerve fibers to nasal consonant-vowel syllables","volume":"82","year":"1987","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c9","doi-asserted-by":"publisher","first-page":"3886","DOI":"10.1121\/1.2714913","article-title":"Speech enhancement using the modified phase-opponency model","volume":"121","year":"2007","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c10","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1121\/1.413112","article-title":"Temporal envelope and fine structure cues for speech intelligibility","volume":"97","year":"1995","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c11","doi-asserted-by":"publisher","first-page":"2670","DOI":"10.1121\/1.409836","article-title":"Effect of reducing slow temporal modulations on speech reception","volume":"95","year":"1994","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c12","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1016\/S0016-0032(39)90816-1","article-title":"A synthetic speaker","volume":"227","year":"1939","journal-title":"J. Franklin Inst."},{"key":"2023071703153466600_c13","doi-asserted-by":"publisher","first-page":"1150","DOI":"10.1121\/1.1381538","article-title":"Speech recognition in noise as a function of the number of spectral channels: comparison of acoustic hearing and cochlear implants","volume":"110","year":"2001","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c14","doi-asserted-by":"publisher","first-page":"1628","DOI":"10.1121\/1.1396325","article-title":"On the upper cutoff frequency of the auditory critical-band envelope detectors in the context of speech perception","volume":"110","year":"2001","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c55","doi-asserted-by":"publisher","first-page":"1336","DOI":"10.1121\/1.2756161","article-title":"Effects of periodic interruption on the intelligibility of speech based on temporal fine-structure or envelope cues","volume":"122","year":"2007","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c15","doi-asserted-by":"publisher","first-page":"2438","DOI":"10.1121\/1.2173522","article-title":"The ability of listeners to use recovered envelope cues from speech fine structure","volume":"119","year":"2006","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c16","doi-asserted-by":"publisher","first-page":"4023","DOI":"10.1121\/1.3126344","article-title":"Effects of spectral smearing and temporal fine structure degradation on speech masking release","volume":"125","year":"2009","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c17","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1007\/s10162-009-0169-8","article-title":"Quantifying Envelope and Fine-Structure Coding in Auditory Nerve Responses to Chimaeric Speech","volume":"10","year":"2009","journal-title":"J. Assoc. Res. Otolaryngol."},{"key":"2023071703153466600_c18","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1007\/978-1-4419-5686-6","article-title":"Across-fiber coding of temporal fine structure: Effects of noise-induced hearing loss on auditory-nerve responses","volume-title":"The Neurophysiological Bases of Auditory Perception","author":"Lopez- Poveda","year":"2010"},{"key":"2023071703153466600_c19","doi-asserted-by":"publisher","first-page":"1140","DOI":"10.1121\/1.2824018","article-title":"Effects of moderate cochlear hearing loss on the ability to benefit from temporal fine structure information in speech","volume":"123","year":"2008","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c20","doi-asserted-by":"publisher","first-page":"2150","DOI":"10.1121\/1.3478773","article-title":"The effects of the addition of low-level, low-noise noise on the intelligibility of sentences processed to remove temporal envelope information","volume":"128","year":"2010","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c21","doi-asserted-by":"publisher","first-page":"12063","DOI":"10.1523\/JNEUROSCI.1840-10.2010","article-title":"dynamic spike thresholds during synaptic integration preserve and enhance temporal response properties in the avian cochlear nucleus","volume":"30","year":"2010","journal-title":"J. Neurosci."},{"key":"2023071703153466600_c22","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1007\/978-1-4419-5686-6","article-title":"Effects of peripheral tuning on the auditory nerve's representation of speech envelope and temporal fine structure cues","volume-title":"The Neurophysiological Bases of Auditory Perception","author":"Lopez-Poveda","year":"2010"},{"key":"2023071703153466600_c23","doi-asserted-by":"publisher","first-page":"1115","DOI":"10.1121\/1.384982","article-title":"The relationship between spike rate and synchrony in responses of auditory-nerve fibers to single tones","volume":"68","year":"1980","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c24","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1121\/1.402757","article-title":"Responses to amplitude-modulated tones in the auditory nerve of the cat","volume":"91","year":"1992","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c25","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1152\/jn.1994.71.3.1022","article-title":"Enhancement of neural synchronization in the anteroventral cochlear nucleus. I. Responses to tones at the characteristic frequency","volume":"71","year":"1994","journal-title":"J. Neurophysiol."},{"key":"2023071703153466600_c26","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1007\/s10162-010-0223-6","article-title":"Envelope coding in auditory nerve fibers following noise-induced hearing loss","volume":"11","year":"2010","journal-title":"J. Assoc. Res. Otolaryngol."},{"key":"2023071703153466600_c27","doi-asserted-by":"publisher","first-page":"14077","DOI":"10.1523\/JNEUROSCI.2845-09.2009","article-title":"Adding insult to injury: Cochlear nerve degeneration after \u2018temporary\u2019 noise-induced hearing loss","volume":"29","year":"2009","journal-title":"J. Neurosci."},{"key":"2023071703153466600_c57","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1007\/BF00337005","article-title":"Spatial cross-correlation, A proposed mechanism for acoustic pitch perception","volume":"47","year":"1983","journal-title":"Biol. Cybern."},{"key":"2023071703153466600_c28","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1002\/j.1538-7305.1977.tb00522.x","article-title":"Information in the zero crossings of bandpass signals","volume":"56","year":"1977","journal-title":"Bell Syst. Tech. J."},{"key":"2023071703153466600_c29","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1121\/1.2939125","article-title":"Abnormal processing of temporal fine structure in speech for frequencies where absolute thresholds are normal","volume":"125","year":"2009","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c30","doi-asserted-by":"publisher","first-page":"18866","DOI":"10.1073\/pnas.0607364103","article-title":"Speech perception problems of the hearing impaired reflect inability to use temporal fine structure","volume":"103","year":"2006","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023071703153466600_c31","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1007\/978-1-4612-4070-9","article-title":"Auditory representations of timbre and pitch","volume-title":"Auditory Computation","author":"Hawkins","year":"1996"},{"key":"2023071703153466600_c32","doi-asserted-by":"publisher","first-page":"3602","DOI":"10.1121\/1.418321","article-title":"Effects of acoustic trauma on the representation of the vowel \u27e8\u27e8eh\u27e9\u27e9 in cat auditory nerve fibers","volume":"101","year":"1997","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c34","first-page":"1","volume-title":"Cochlear Hearing Loss: Physiological, Psychological, and Technical Issues","year":"2007","edition":"2nd ed."},{"key":"2023071703153466600_c35","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1177\/1084713808317819","article-title":"The choice of compression speed in hearing aids: Theoretical and practical considerations and the role of individual differences","volume":"12","year":"2008","journal-title":"Trends Amplif."},{"key":"2023071703153466600_c33","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1038\/nn.2326","article-title":"Beyond cochlear implants: awakening the deafened brain","volume":"12","year":"2009","journal-title":"Nat. Neurosci."},{"key":"2023071703153466600_c36","doi-asserted-by":"publisher","first-page":"961","DOI":"10.1121\/1.1531983","article-title":"Understanding speech in modulated interference: cochlear implant users and normal-hearing listeners","volume":"113","year":"2003","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c37","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1002\/j.1538-7305.1973.tb01981.x","article-title":"Distortion produced by band limitation of an FM wave","volume":"52","year":"1973","journal-title":"Bell Syst. Tech. J."},{"key":"2023071703153466600_c38","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1121\/1.383098","article-title":"Encoding of steady state vowels in the auditory nerve: Representation in terms of discharge rate","volume":"66","year":"1979","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c39","doi-asserted-by":"publisher","first-page":"1612","DOI":"10.1121\/1.392799","article-title":"Speech processing in the auditory system: I. The representation of speech sounds in the responses of the auditory nerve","volume":"78","year":"1985","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c40","doi-asserted-by":"publisher","first-page":"1622","DOI":"10.1121\/1.392800","article-title":"Speech processing in the auditory system: II. Lateral inhibition and the central processing of speech evoked activity in the auditory nerve","volume":"78","year":"1985","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c42","doi-asserted-by":"publisher","first-page":"2631","DOI":"10.1121\/1.428649","article-title":"The case of the missing pitch templates: How harmonic templates may form in the early auditory system","volume":"107","year":"2000","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c41","doi-asserted-by":"publisher","first-page":"1486","DOI":"10.1121\/1.394501","article-title":"Synchrony suppression in complex stimulus responses of a biophysical model of the cochlea","volume":"81","year":"1987","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c43","doi-asserted-by":"publisher","first-page":"6883","DOI":"10.1073\/pnas.0702220104","article-title":"Understanding hearing through deafness","volume":"104","year":"2007","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023071703153466600_c44","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1126\/science.270.5234.303","article-title":"Speech recognition with primarily temporal cues","volume":"270","year":"1995","journal-title":"Science"},{"key":"2023071703153466600_c45","doi-asserted-by":"publisher","first-page":"562","DOI":"10.1121\/1.2918540","article-title":"Speech identification based on temporal fine structure cues","volume":"124","year":"2008","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c46","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1038\/416087a","article-title":"Chimaeric sounds reveal dichotomies in auditory perception","volume":"416","year":"2002","journal-title":"Nature"},{"key":"2023071703153466600_c47","unstructured":"Swaminathan, J. (2010). \u201cThe role of envelope and temporal fine structure in the perception of noise degraded speech,\u201d Ph.D. Dissertation, University of Purdue."},{"key":"2023071703153466600_c56","doi-asserted-by":"publisher","first-page":"1747","DOI":"10.1523\/JNEUROSCI.4493-11.2012","article-title":"Psychophysiological analyses demonstrate the importance of neural envelope coding for speech perception in noise","volume":"32","year":"2012","journal-title":"J. Neurosci."},{"key":"2023071703153466600_c48","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1109\/PROC.1966.4695","article-title":"Towards a unified theory of modulation. I. phase-envelope relationships","volume":"54","year":"1966","journal-title":"Proc. IEEE"},{"key":"2023071703153466600_c49","doi-asserted-by":"publisher","first-page":"695","DOI":"10.1682\/JRRD.2007.10.0173","article-title":"Cochlear implants: Current designs and future possibilities","volume":"45","year":"2008","journal-title":"J. Rehabil. Res. Dev."},{"key":"2023071703153466600_c50","doi-asserted-by":"publisher","first-page":"824","DOI":"10.1109\/18.119739","article-title":"Auditory representations of acoustic signals","volume":"38","year":"1992","journal-title":"IEEE Trans. Info. Theory"},{"key":"2023071703153466600_c51","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1152\/jn.1987.58.3.562","article-title":"Effects of interaural time delays of noise stimuli on low-frequency cells in the cats inferior colliculus III. Evidence for cross correlation","volume":"58","year":"1987","journal-title":"J. Neurophysiol."},{"key":"2023071703153466600_c52","doi-asserted-by":"publisher","first-page":"1381","DOI":"10.1121\/1.383532","article-title":"Representation of steady-state vowels in the temporal aspects of the discharge patterns of populations of auditory-nerve fibers","volume":"66","year":"1979","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c53","doi-asserted-by":"publisher","first-page":"1351","DOI":"10.1121\/1.1777938","article-title":"On the dichotomy in auditory perception between temporal envelope and fine structure cues","volume":"116","year":"2004","journal-title":"J. Acoust. Soc. Am."},{"key":"2023071703153466600_c54","doi-asserted-by":"publisher","first-page":"2293","DOI":"10.1073\/pnas.0406460102","article-title":"Speech recognition with amplitude and frequency modulations","volume":"102","year":"2005","journal-title":"Proc. Natl. Acad. Sci. USA"}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/133\/5\/2818\/13504775\/2818_1_online.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/133\/5\/2818\/13504775\/2818_1_online.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,17]],"date-time":"2023-07-17T03:15:52Z","timestamp":1689563752000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/133\/5\/2818\/610036\/On-the-balance-of-envelope-and-temporal-fine"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,5,1]]},"references-count":60,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2013,5,1]]}},"URL":"https:\/\/doi.org\/10.1121\/1.4795783","relation":{},"ISSN":["0001-4966","1520-8524"],"issn-type":[{"value":"0001-4966","type":"print"},{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2013,5]]},"published":{"date-parts":[[2013,5,1]]}}}