{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T20:03:43Z","timestamp":1789848223632,"version":"4.0.1"},"reference-count":48,"publisher":"Acoustical Society of America (ASA)","issue":"2","content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2007,2,1]]},"abstract":"<jats:p>In face-to-face speech communication, the listener extracts and integrates information from the acoustic and optic speech signals. Integration occurs within the auditory modality (i.e., across the acoustic frequency spectrum) and across sensory modalities (i.e., across the acoustic and optic signals). The difficulties experienced by some hearing-impaired listeners in understanding speech could be attributed to losses in the extraction of speech information, the integration of speech cues, or both. The present study evaluated the ability of normal-hearing and hearing-impaired listeners to integrate speech information within and across sensory modalities in order to determine the degree to which integration efficiency may be a factor in the performance of hearing-impaired listeners. Auditory-visual nonsense syllables consisting of eighteen medial consonants surrounded by the vowel [a] were processed into four nonoverlapping acoustic filter bands between 300 and 6000Hz. A variety of one, two, three, and four filter-band combinations were presented for identification in auditory-only and auditory-visual conditions: A visual-only condition was also included. Integration efficiency was evaluated using a model of optimal integration. Results showed that normal-hearing and hearing-impaired listeners integrated information across the auditory and visual sensory modalities with a high degree of efficiency, independent of differences in auditory capabilities. However, across-frequency integration for auditory-only input was less efficient for hearing-impaired listeners. These individuals exhibited particular difficulty extracting information from the highest frequency band (4762\u20136000Hz) when speech information was presented concurrently in the next lower-frequency band (1890\u20132381Hz). Results suggest that integration of speech information within the auditory modality, but not across auditory and visual modalities, affects speech understanding in hearing-impaired listeners.<\/jats:p>","DOI":"10.1121\/1.2405859","type":"journal-article","created":{"date-parts":[[2007,2,2]],"date-time":"2007-02-02T19:26:54Z","timestamp":1170444414000},"page":"1164-1176","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":31,"title":["Integration efficiency for speech perception within and across sensory modalities by normal-hearing and hearing-impaired individuals"],"prefix":"10.1121","volume":"121","author":[{"given":"Ken W.","family":"Grant","sequence":"first","affiliation":[{"name":"Army Audiology and Speech Center Walter Reed Army Medical Center, , Washington, D.C. 20307-5001"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer B.","family":"Tufts","sequence":"additional","affiliation":[{"name":"University of Connecticut Department of Communication Sciences, , Storrs, Connecticut 06269"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"Greenberg","sequence":"additional","affiliation":[{"name":"Silicon Speech , 46 Oxford Drive, Santa Venetia, California 94903"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"231","reference":[{"key":"2023080104404465900_c1","year":"1989"},{"key":"2023080104404465900_c2","first-page":"15","article-title":"Speech perception using combinations of auditory, visual, and tactile information","volume":"26","year":"1989","journal-title":"J. Rehabil. Res. Dev."},{"key":"2023080104404465900_c3","volume-title":"Multidimensional Similarity Structure Analysis","year":"1987"},{"key":"2023080104404465900_c4","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1080\/14640749108400991","article-title":"Crossmodal integration in the identification of consonant segments","volume":"43","year":"1991","journal-title":"Q. J. Exp. Psychol."},{"key":"2023080104404465900_c5","doi-asserted-by":"publisher","first-page":"1128","DOI":"10.1121\/1.421224","article-title":"Speech recognition of hearing-impaired listeners: Predictions from audibility and the limited role of high-frequency amplification","volume":"103","year":"1998","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c6","article-title":"Spectro-temporal processing of speech\u2013An information-theoretic framework"},{"key":"2023080104404465900_c7","first-page":"585","article-title":"Frequency selective filtering of the modulation spectrum and its impact on consonant identification","year":"2005"},{"key":"2023080104404465900_c8","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1097\/00003446-200210000-00006","article-title":"Auditory-visual speech perception and aging","volume":"23","year":"2002","journal-title":"Ear Hear."},{"key":"2023080104404465900_c9","first-page":"166","article-title":"The integration of auditory-visual information for speech in older adults","volume":"28","year":"2004","journal-title":"J. Speech Lang. Path. Aud."},{"key":"2023080104404465900_c10","doi-asserted-by":"publisher","first-page":"3769","DOI":"10.1121\/1.417336","article-title":"Use of a correlational method to estimate a listener\u2019s weighting function for speech","volume":"100","year":"1996","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c11","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1055\/s-2002-24974","article-title":"Hearing, vision, communication, and older people","volume":"23","year":"2002","journal-title":"Seminars in Hearing"},{"key":"2023080104404465900_c12","doi-asserted-by":"publisher","first-page":"1150","DOI":"10.1121\/1.1381538","article-title":"Speech recognition in noise as a function of the number of spectral channels: Comparison of acoustic hearing and cochlear implants","volume":"110","year":"2001","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c13","doi-asserted-by":"publisher","first-page":"2311","DOI":"10.1121\/1.396362","article-title":"Excess masking among listeners with a sensorineural hearing loss","volume":"83","year":"1988","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c14","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1044\/jslhr.4202.300","article-title":"Profile of auditory temporal processing in older listeners","volume":"42","year":"1999","journal-title":"J. Speech Lang. Hear. Res."},{"key":"2023080104404465900_c15","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1121\/1.1482076","article-title":"Measures of auditory-visual integration for speech understanding: A theoretical perspective (L)","volume":"112","year":"2002","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c16","doi-asserted-by":"publisher","first-page":"2438","DOI":"10.1121\/1.423751","article-title":"Measures of auditory-visual integration in nonsense syllables and sentences","volume":"104","year":"1998","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c17","doi-asserted-by":"publisher","first-page":"2415","DOI":"10.1121\/1.417950","article-title":"Evaluating the articulation index for auditory-visual consonant recognition","volume":"100","year":"1996","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c18","doi-asserted-by":"publisher","first-page":"2677","DOI":"10.1121\/1.422788","article-title":"Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration","volume":"103","year":"1998","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c19","volume-title":"Signal Detection Theory and Psychophysics","year":"1966"},{"key":"2023080104404465900_c20","first-page":"1059","article-title":"What are the essential cues for understanding spoken language?","volume":"87D","year":"2004","journal-title":"IEICE Trans. Inf. Syst."},{"key":"2023080104404465900_c21","first-page":"74","article-title":"Speech intelligibility from exceedingly sparse spectral information","volume-title":"Proc. Int. Conf. Spoken Lang. Processing","year":"1998"},{"key":"2023080104404465900_c22","doi-asserted-by":"crossref","first-page":"1262","DOI":"10.1044\/1092-4388(2002\/101)","article-title":"Across-frequency comparison of temporal speech information by listeners with normal and impaired hearing","volume":"45","year":"2002","journal-title":"J. Speech Lang. Hear. Res."},{"key":"2023080104404465900_c23","first-page":"1236","article-title":"An across-frequency processing deficit in listeners with hearing impairment is supported by acoustic correlation","volume":"48","year":"2002","journal-title":"J. Speech Lang. Hear. Res."},{"key":"2023080104404465900_c24","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1121\/1.1911047","article-title":"Speech recognition as a function of channel capacity in a discrete set of channels","volume":"44","year":"1968","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c25","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1121\/1.423247","article-title":"High-frequency audibility: Benefits for hearing-impaired listeners","volume":"104","year":"1998","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c26","doi-asserted-by":"publisher","first-page":"1706","DOI":"10.1121\/1.1553458","article-title":"The effects of hearing loss on the contribution of high- and low-frequency speech information to speech understanding","volume":"113","year":"2003","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c27","doi-asserted-by":"publisher","first-page":"1752","DOI":"10.1121\/1.2161432","article-title":"The effects of hearing loss on the contribution of high- and low-frequency speech information to speech understanding. II. Sloping hearing loss","volume":"119","year":"2006","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c28","volume-title":"Multidimensional Scaling","year":"1978"},{"key":"2023080104404465900_c29","doi-asserted-by":"publisher","first-page":"1262","DOI":"10.1121\/1.396626","article-title":"Vowel and consonant resolution: Basic sensitivity and context memory","volume":"84","year":"1988","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c30","volume-title":"Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry","year":"1987"},{"key":"2023080104404465900_c31","volume-title":"Perceiving Talking Faces: From Speech Perception to a Behavioral Principle","year":"1998"},{"key":"2023080104404465900_c32","doi-asserted-by":"publisher","first-page":"784","DOI":"10.1121\/1.429611","article-title":"Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception","volume":"108","year":"2000","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c33","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1121\/1.1907526","article-title":"An analysis of perceptual confusions among some English consonants","volume":"27","year":"1955","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c34","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1097\/01.AUD.0000120359.49711.D7","article-title":"Dead regions in the cochlea: Conceptual foundations, diagnosis, and clinical applications","volume":"25","year":"2004","journal-title":"Ear Hear."},{"key":"2023080104404465900_c35","doi-asserted-by":"publisher","first-page":"2910","DOI":"10.1121\/1.1371972","article-title":"Using statistical decision theory to predict speech intelligibility. II. Measurement and prediction of consonant-discrimination performance","volume":"109","year":"2001","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c36","volume-title":"The Acoustics of Speech Communication","year":"1999"},{"key":"2023080104404465900_c37","article-title":"Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments","year":"2006"},{"key":"2023080104404465900_c38","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1126\/science.270.5234.303","article-title":"Speech recognition with primarily temporal cues","volume":"270","year":"1995","journal-title":"Science"},{"key":"2023080104404465900_c39","first-page":"2687","article-title":"Temporal constraints on speech intelligibility as deduced from exceedingly sparse spectral representations","volume-title":"Proc. Eurospeech","year":"1999"},{"key":"2023080104404465900_c40","doi-asserted-by":"crossref","first-page":"2574","DOI":"10.1121\/1.4788583","article-title":"The effects of signal-to-noise ratio on auditory-visual integration: Integration and encoding are not independent (A)","volume":"117","year":"2005","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c41","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1097\/00003446-200506000-00003","article-title":"Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults","volume":"26","year":"2005","journal-title":"Ear Hear."},{"key":"2023080104404465900_c42","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1044\/1092-4388(2006\/011)","article-title":"Combining temporal-envelope cues across channels: Effects of age and hearing loss","volume":"49","year":"2006","journal-title":"J. Speech Lang. Hear. Res."},{"key":"2023080104404465900_c43","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1097\/00003446-200412000-00005","article-title":"Time-compressed visual speech and age: A first report","volume":"25","year":"2004","journal-title":"Ear Hear."},{"key":"2023080104404465900_c44","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1121\/1.1907309","article-title":"Visual contribution to speech intelligibility in noise","volume":"26","year":"1954","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c45","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1044\/1059-0889(1999\/002)","article-title":"Speech audibility for listeners with high-frequency hearing loss","volume":"8","year":"1999","journal-title":"Am. J. Audiol."},{"key":"2023080104404465900_c46","doi-asserted-by":"publisher","first-page":"1675","DOI":"10.1121\/1.1506158","article-title":"Benefits of amplification for speech recognition in background noise","volume":"112","year":"2002","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080104404465900_c47","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1044\/jslhr.4204.773","article-title":"Limiting spectral resolution in speech for listeners with sensorineural hearing loss","volume":"42","year":"1999","journal-title":"J. Speech Lang. Hear. Res."},{"key":"2023080104404465900_c48","doi-asserted-by":"crossref","first-page":"471","DOI":"10.3758\/BF03202187","article-title":"SINFA: Multivariate uncertainty analysis for confusion matrices","volume":"8","year":"1976","journal-title":"Behav. Res. Methods Instrum."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/121\/2\/1164\/15281201\/1164_1_online.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/121\/2\/1164\/15281201\/1164_1_online.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T05:05:13Z","timestamp":1690866313000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/121\/2\/1164\/921328\/Integration-efficiency-for-speech-perception"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,2,1]]},"references-count":48,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2007,2,1]]}},"URL":"https:\/\/doi.org\/10.1121\/1.2405859","relation":{},"ISSN":["0001-4966","1520-8524"],"issn-type":[{"value":"0001-4966","type":"print"},{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2007,2]]},"published":{"date-parts":[[2007,2,1]]}}}