{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,5]],"date-time":"2025-11-05T20:56:24Z","timestamp":1762376184742},"reference-count":36,"publisher":"MIT Press","issue":"6","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In many everyday listening situations, an otherwise audible sound may go unnoticed amid multiple other sounds. This auditory phenomenon, called informational masking (IM), is sensitive to visual input and involves early (50\u2013250 msec) activity in the auditory cortex (the so-called awareness-related negativity). It is still unclear whether and how the timing of visual input influences the neural correlates of IM in auditory cortex. To address this question, we obtained simultaneous behavioral and neural measures of IM from human listeners in the presence of a visual input stream and varied the asynchrony between the visual stream and the rhythmic auditory target stream (in-phase, antiphase, or random). Results show effects of cross-modal asynchrony on both target detectability (RT and sensitivity) and the awareness-related negativity measured with EEG, which were driven primarily by antiphasic audiovisual stimuli. The neural effect was limited to the interval shortly before listeners' behavioral report of the target. Our results indicate that the relative timing of visual input can influence the IM of a target sound in the human auditory cortex. They further show that this audiovisual influence occurs early during the perceptual buildup of the target sound. In summary, these findings provide novel insights into the interaction of IM and multisensory interaction in the human brain.<\/jats:p>","DOI":"10.1162\/jocn_a_01097","type":"journal-article","created":{"date-parts":[[2017,1,27]],"date-time":"2017-01-27T18:21:48Z","timestamp":1485541308000},"page":"980-990","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":5,"title":["Effects of Cross-modal Asynchrony on Informational Masking in Human Cortex"],"prefix":"10.1162","volume":"29","author":[{"given":"Lars","family":"Hausfeld","sequence":"first","affiliation":[{"name":"Maastricht University"}]},{"given":"Alexander","family":"Gutschalk","sequence":"additional","affiliation":[{"name":"Ruprecht-Karls-Universit\u00e4t Heidelberg"}]},{"given":"Elia","family":"Formisano","sequence":"additional","affiliation":[{"name":"Maastricht University"}]},{"given":"Lars","family":"Riecke","sequence":"additional","affiliation":[{"name":"Maastricht University"}]}],"member":"281","published-online":{"date-parts":[[2017,6,1]]},"reference":[{"key":"2021073021092849000_R1","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1109\/EMBC.2012.6345945","article-title":"ErpICASSO: A tool for reliability estimates of independent components in EEG event-related analysis","volume-title":"2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE","author":"Artoni","year":"2012"},{"key":"2021073021092849000_R2","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"Journal of the Royal Statistical Society, Series B, Methodological"},{"key":"2021073021092849000_R3","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/42.750253","article-title":"Global, voxel, and cluster tests, by theory and permutation, for a difference between two groups of structural MR images of the brain","volume":"18","author":"Bullmore","year":"1999","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"2021073021092849000_R4","doi-asserted-by":"crossref","first-page":"14195","DOI":"10.1523\/JNEUROSCI.1829-15.2015","article-title":"Congruent visual speech enhances cortical entrainment to continuous auditory speech in noise-free conditions","volume":"35","author":"Crosse","year":"2015","journal-title":"Journal of Neuroscience"},{"key":"2021073021092849000_R5","doi-asserted-by":"crossref","first-page":"e1500677","DOI":"10.1126\/sciadv.1500677","article-title":"Does the mismatch negativity operate on a consciously accessible memory trace?","volume":"1","author":"Dykstra","year":"2015","journal-title":"Science Advances"},{"key":"2021073021092849000_R6","doi-asserted-by":"crossref","first-page":"e1000129","DOI":"10.1371\/journal.pbio.1000129","article-title":"Interaction between attention and bottom\u2013up saliency mediates the representation of foreground and background in an auditory scene","volume":"7","author":"Elhilali","year":"2009","journal-title":"PLoS Biology"},{"key":"2021073021092849000_R7","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.neuroimage.2015.07.001","article-title":"Detecting tones in complex auditory scenes","volume":"122","author":"Giani","year":"2015","journal-title":"Neuroimage"},{"key":"2021073021092849000_R8","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/0378-5955(90)90170-T","article-title":"Derivation of auditory filter shapes from notched-noise data","volume":"47","author":"Glasberg","year":"1990","journal-title":"Hearing Research"},{"key":"2021073021092849000_R9","doi-asserted-by":"crossref","first-page":"e138","DOI":"10.1371\/journal.pbio.0060138","article-title":"Neural correlates of auditory perceptual awareness under informational masking","volume":"6","author":"Gutschalk","year":"2008","journal-title":"PLoS Biology"},{"key":"2021073021092849000_R10","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1121\/1.1836832","article-title":"The role of visual speech cues in reducing energetic and informational masking","volume":"117","author":"Helfer","year":"2005","journal-title":"Journal of the Acoustical Society of America"},{"key":"2021073021092849000_R32","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1016\/j.neuroimage.2004.03.027","article-title":"Validating the independent components of neuroimaging time series via clustering and visualization","volume":"22","author":"Himber","year":"2004","journal-title":"Neuroimage"},{"key":"2021073021092849000_R33","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1016\/S0893-6080(00)00026-5","article-title":"Independent component analysis: Algorithms and applications","volume":"13","author":"Hyv\u00e4rinen","year":"2000","journal-title":"Neural Networks"},{"key":"2021073021092849000_R11","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1121\/1.1448342","article-title":"Similarity, uncertainty, and masking in the identification of nonspeech auditory patterns","volume":"111","author":"Kidd","year":"2002","journal-title":"Journal of the Acoustical Society of America"},{"key":"2021073021092849000_R12","doi-asserted-by":"crossref","first-page":"3475","DOI":"10.1121\/1.410023","article-title":"Reducing informational masking by sound segregation","volume":"95","author":"Kidd","year":"1994","journal-title":"Journal of the Acoustical Society of America"},{"key":"2021073021092849000_R13","doi-asserted-by":"crossref","first-page":"EL223","DOI":"10.1121\/1.2968302","article-title":"Informational masking increases the costs of monitoring multiple channels","volume":"124","author":"Kidd","year":"2008","journal-title":"Journal of the Acoustical Society of America"},{"key":"2021073021092849000_R14","doi-asserted-by":"crossref","first-page":"3283","DOI":"10.1111\/j.1460-9568.2012.08240.x","article-title":"Functional lateralization in auditory cortex under informational masking and in silence","volume":"36","author":"K\u00f6nigs","year":"2012","journal-title":"The European Journal of Neuroscience"},{"key":"2021073021092849000_R15","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.neuron.2006.12.011","article-title":"Neuronal oscillations and multisensory interaction in primary auditory cortex","volume":"53","author":"Lakatos","year":"2007","journal-title":"Neuron"},{"key":"2021073021092849000_R16","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1016\/j.neuron.2009.10.014","article-title":"The leading sense: Supramodal control of neurophysiological context by attention","volume":"64","author":"Lakatos","year":"2009","journal-title":"Neuron"},{"key":"2021073021092849000_R17","volume-title":"Detection theory: A user's guide","author":"Macmillan","year":"1991"},{"key":"2021073021092849000_R18","doi-asserted-by":"crossref","first-page":"e04995","DOI":"10.7554\/eLife.04995","article-title":"Auditory selective attention is enhanced by a task-irrelevant temporally coherent visual stimulus in human listeners","volume":"4","author":"Maddox","year":"2015","journal-title":"Elife"},{"key":"2021073021092849000_R34","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/j.jneumeth.2007.03.024","article-title":"Nonparametric statistical testing of EEG- and MEG-data","volume":"164","author":"Maris","year":"2007","journal-title":"Journal of Neuroscience Methods"},{"key":"2021073021092849000_R19","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1111\/j.1469-8986.1987.tb00311.x","article-title":"The N1 wave of the human electric and magnetic response to sound: A review and an analysis of the component structure","volume":"24","author":"N\u00e4\u00e4t\u00e4nen","year":"1987","journal-title":"Psychophysiology"},{"key":"2021073021092849000_R20","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/S0166-2236(00)01790-2","article-title":"\u201cPrimitive intelligence\u201d in the auditory cortex","volume":"24","author":"N\u00e4\u00e4t\u00e4nen","year":"2001","journal-title":"Trends in Neuroscience"},{"key":"2021073021092849000_R35","doi-asserted-by":"crossref","first-page":"409","DOI":"10.3109\/14992027.2013.781278","article-title":"A short form of the Speech, Spatial and Qualities of Hearing scale suitable for clinical use: The SSQ12","volume":"52","author":"Noble","year":"2013","journal-title":"International Journal of Audiology"},{"key":"2021073021092849000_R21","doi-asserted-by":"crossref","first-page":"565","DOI":"10.3758\/BF03205954","article-title":"Cross-modal effects on visual and auditory object perception","volume":"35","author":"O'Leary","year":"1984","journal-title":"Perception & Psychophysics"},{"key":"2021073021092849000_R22","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/0013-4694(74)90155-2","article-title":"Human auditory evoked potentials. I. Evaluation of components","volume":"36","author":"Picton","year":"1974","journal-title":"Electroencephalography and Clinical Neurophysiology"},{"key":"2021073021092849000_R23","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.brainres.2007.01.074","article-title":"Visual cues can modulate integration and segregation of objects in auditory scene analysis","volume":"1144","author":"Rahne","year":"2007","journal-title":"Brain Research"},{"key":"2021073021092849000_R24","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.brainres.2009.08.086","article-title":"Visual cues release the temporal coherence of auditory objects in auditory scene analysis","volume":"1300","author":"Rahne","year":"2009","journal-title":"Brain Research"},{"key":"2021073021092849000_R25","doi-asserted-by":"crossref","first-page":"EL1","DOI":"10.1121\/1.2918786","article-title":"Method-of-adjustment measures of informational masking between auditory streams","volume":"124","author":"Sheft","year":"2008","journal-title":"Journal of the Acoustical Society of America"},{"key":"2021073021092849000_R26","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.tics.2008.02.003","article-title":"Object-based auditory and visual attention","volume":"12","author":"Shinn-Cunningham","year":"2008","journal-title":"Trends in Cognitive Sciences"},{"key":"2021073021092849000_R27","doi-asserted-by":"crossref","first-page":"136","DOI":"10.3758\/BF03194460","article-title":"The role of attention in the formation of auditory streams","volume":"69","author":"Sussman","year":"2007","journal-title":"Perception & Psychophysics"},{"key":"2021073021092849000_R36","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1111\/j.1469-8986.2007.00612.x","article-title":"Auto-adaptive averaging: Detecting in event-related potential data using a fully automated procedure","volume":"45","author":"Talsma","year":"2008","journal-title":"Psychophysiology"},{"key":"2021073021092849000_R28","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/s10162-012-0314-7","article-title":"How visual cues for when to listen aid selective auditory attention","volume":"13","author":"Varghese","year":"2012","journal-title":"Journal of the Association for Research in Otolaryngology"},{"key":"2021073021092849000_R29","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1016\/0013-4694(70)90228-2","article-title":"The sources of auditory evoked responses recorded from the human scalp","volume":"28","author":"Vaughan","year":"1970","journal-title":"Electroencephalography and Clinical Neurophysiology"},{"key":"2021073021092849000_R30","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.neuroimage.2012.02.067","article-title":"Correlates of perceptual awareness in human primary auditory cortex revealed by an informational masking experiment","volume":"61","author":"Wiegand","year":"2012","journal-title":"Neuroimage"},{"key":"2021073021092849000_R31","doi-asserted-by":"crossref","first-page":"531","DOI":"10.3758\/BF03193329","article-title":"Audio-visual simultaneity judgments","volume":"67","author":"Zampini","year":"2005","journal-title":"Perception & Psychophysics"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/29\/6\/980\/1952778\/jocn_a_01097.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/29\/6\/980\/1952778\/jocn_a_01097.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,22]],"date-time":"2024-06-22T03:29:44Z","timestamp":1719026984000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/29\/6\/980\/28655\/Effects-of-Cross-modal-Asynchrony-on-Informational"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,1]]},"references-count":36,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2017,6,1]]},"published-print":{"date-parts":[[2017,6,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01097","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,6]]},"published":{"date-parts":[[2017,6,1]]}}}