{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,11]],"date-time":"2024-07-11T08:34:39Z","timestamp":1720686879333},"reference-count":57,"publisher":"MIT Press - Journals","issue":"3","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2013,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Neural representation of auditory regularities can be probed using the MMN, a component of ERPs generated in the auditory cortex by any violation of that regularity. Although several studies have shown that visual information can influence or even trigger an MMN by altering an acoustic regularity, it is not known whether audiovisual regularities are encoded in the auditory representation supporting MMN generation. We compared the MMNs elicited by the auditory violation of (a) an auditory regularity (a succession of identical standard sounds), (b) an audiovisual regularity (a succession of identical audiovisual stimuli), and (c) an auditory regularity accompanied by variable visual stimuli. In all three conditions, the physical difference between the standard and the deviant sound was identical. We found that the MMN triggered by the same auditory deviance was larger for audiovisual regularities than for auditory-only regularities or for auditory regularities paired with variable visual stimuli, suggesting that the visual regularity influenced the representation of the auditory regularity. This result provides evidence for the encoding of audiovisual regularities in the human brain.<\/jats:p>","DOI":"10.1162\/jocn_a_00334","type":"journal-article","created":{"date-parts":[[2012,11,28]],"date-time":"2012-11-28T15:43:00Z","timestamp":1354117380000},"page":"365-373","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":11,"title":["The Representation of Audiovisual Regularities in the Human Brain"],"prefix":"10.1162","volume":"25","author":[{"given":"Julien","family":"Besle","sequence":"first","affiliation":[{"name":"1Lyon Neuroscience Research Centre, DYCOG Team (CRNL, INSERM\/CNRS), Lyon, France"},{"name":"2Universit\u00e9 Lyon 1"},{"name":"3University of Nottingham"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zahra","family":"Hussain","sequence":"additional","affiliation":[{"name":"3University of Nottingham"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marie-H\u00e9l\u00e8ne","family":"Giard","sequence":"additional","affiliation":[{"name":"1Lyon Neuroscience Research Centre, DYCOG Team (CRNL, INSERM\/CNRS), Lyon, France"},{"name":"2Universit\u00e9 Lyon 1"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olivier","family":"Bertrand","sequence":"additional","affiliation":[{"name":"1Lyon Neuroscience Research Centre, DYCOG Team (CRNL, INSERM\/CNRS), Lyon, France"},{"name":"2Universit\u00e9 Lyon 1"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2013,3,1]]},"reference":[{"key":"2021072913272820400_R1","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.brainres.2005.11.017","article-title":"Modulation of early auditory processing by visually based sound prediction.","volume":"1068","author":"Aoyama","year":"2006","journal-title":"Brain Research"},{"key":"2021072913272820400_R2","doi-asserted-by":"crossref","first-page":"13445","DOI":"10.1523\/JNEUROSCI.3194-09.2009","article-title":"Dual neural routing of visual facilitation in speech processing.","volume":"29","author":"Arnal","year":"2009","journal-title":"Journal of Neuroscience"},{"key":"2021072913272820400_R3","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1027\/0269-8803.21.34.204","article-title":"ERP repetition effects and mismatch negativity generation: A predictive coding perspective.","volume":"21","author":"Baldeweg","year":"2007","journal-title":"Journal of Psychophysiology"},{"key":"2021072913272820400_R4","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1027\/0269-8803.21.34.231","article-title":"Audiovisual events in sensory memory.","volume":"21","author":"Besle","year":"2007","journal-title":"Journal of Psychophysiology"},{"key":"2021072913272820400_R5","doi-asserted-by":"crossref","first-page":"14301","DOI":"10.1523\/JNEUROSCI.2875-08.2008","article-title":"Visual activation and audiovisual interactions in the auditory cortex during speech perception: Intracranial recordings in humans.","volume":"28","author":"Besle","year":"2008","journal-title":"The Journal of Neuroscience"},{"key":"2021072913272820400_R6","doi-asserted-by":"crossref","first-page":"2225","DOI":"10.1111\/j.1460-9568.2004.03670.x","article-title":"Bimodal speech: Early suppressive visual effects in the human auditory cortex.","volume":"20","author":"Besle","year":"2004","journal-title":"European Journal of Neuroscience"},{"key":"2021072913272820400_R7","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1007\/s00221-005-2375-x","article-title":"Is the auditory sensory memory sensitive to visual information?","volume":"166","author":"Besle","year":"2005","journal-title":"Experimental Brain Research"},{"key":"2021072913272820400_R8","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1016\/j.conb.2006.06.008","article-title":"Seeing sounds: Visual and auditory interactions in the brain.","volume":"16","author":"Bulkin","year":"2006","journal-title":"Current Opinion in Neurobiology"},{"key":"2021072913272820400_R9","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1016\/S1388-2457(02)00028-7","article-title":"Electrophysiology of spatial scene analysis: The mismatch negativity (MMN) is sensitive to the ventriloquism illusion.","volume":"113","author":"Colin","year":"2002","journal-title":"Clinical Neurophysiology"},{"key":"2021072913272820400_R10","doi-asserted-by":"crossref","first-page":"1989","DOI":"10.1016\/j.clinph.2004.03.027","article-title":"Generalization of the generation of an MMN by illusory McGurk percepts: Voiceless consonants.","volume":"115","author":"Colin","year":"2004","journal-title":"Clinical Neurophysiology"},{"key":"2021072913272820400_R11","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/S1388-2457(02)00024-X","article-title":"Mismatch negativity evoked by the McGurk\u2013MacDonald effect: A phonetic representation within short-term memory.","volume":"113","author":"Colin","year":"2002","journal-title":"Clinical Neurophysiology"},{"key":"2021072913272820400_R12","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1027\/0269-8803.21.34.224","article-title":"Visual mismatch negativity: Violation of nonattended environmental regularities.","volume":"21","author":"Czigler","year":"2007","journal-title":"Journal of Psychophysiology"},{"key":"2021072913272820400_R13","doi-asserted-by":"crossref","first-page":"3749","DOI":"10.1097\/00001756-199912160-00005","article-title":"Attention-dependent allocation of auditory processing resources as measured by mismatch negativity.","volume":"10","author":"Dittmann-Balcar","year":"1999","journal-title":"NeuroReport"},{"key":"2021072913272820400_R14","doi-asserted-by":"crossref","first-page":"1031","DOI":"10.1093\/cercor\/12.10.1031","article-title":"Dynamics of cortico-subcortical crossmodal operations involved in audio-visual object detection in humans.","volume":"12","author":"Fort","year":"2002","journal-title":"Cerebral Cortex"},{"key":"2021072913272820400_R15","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/S0926-6410(02)00058-7","article-title":"Early auditory\u2013visual interactions in human cortex during nonredundant target identification.","volume":"14","author":"Fort","year":"2002","journal-title":"Cognitive Brain Research"},{"key":"2021072913272820400_R16","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.neulet.2007.10.014","article-title":"Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds.","volume":"430","author":"Froyen","year":"2008","journal-title":"Neuroscience Letters"},{"key":"2021072913272820400_R17","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.tics.2006.04.008","article-title":"Is neocortex essentially multisensory?","volume":"10","author":"Ghazanfar","year":"2006","journal-title":"Trends in Cognitive Sciences"},{"key":"2021072913272820400_R18","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1162\/089892999563544","article-title":"Auditory\u2013visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study.","volume":"11","author":"Giard","year":"1999","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913272820400_R19","doi-asserted-by":"crossref","first-page":"627","DOI":"10.1111\/j.1469-8986.1990.tb03184.x","article-title":"Brain generators implicated in the processing of auditory stimulus deviance: A topographic event-related potential study.","volume":"27","author":"Giard","year":"1990","journal-title":"Psychophysiology"},{"key":"2021072913272820400_R20","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1111\/j.1469-8986.1997.tb02146.x","article-title":"Storage of feature conjunctions in transient auditory memory.","volume":"34","author":"Gomes","year":"1997","journal-title":"Psychophysiology"},{"key":"2021072913272820400_R21","doi-asserted-by":"crossref","first-page":"1342","DOI":"10.1016\/j.neuropsychologia.2006.09.019","article-title":"Sequential audiovisual interactions during speech perception: A whole-head MEG study.","volume":"45","author":"Hertrich","year":"2007","journal-title":"Neuropsychologia"},{"key":"2021072913272820400_R22","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1111\/1469-8986.3840723","article-title":"Is there pre-attentive memory-based comparison of pitch?","volume":"38","author":"Jacobsen","year":"2001","journal-title":"Psychophysiology"},{"key":"2021072913272820400_R23","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1016\/S1388-2457(03)00043-9","article-title":"Measuring duration mismatch negativity.","volume":"114","author":"Jacobsen","year":"2003","journal-title":"Clinical Neurophysiology"},{"key":"2021072913272820400_R24","doi-asserted-by":"crossref","first-page":"2245","DOI":"10.1016\/j.neuroimage.2003.08.014","article-title":"Processing abstract auditory features in the human auditory cortex.","volume":"20","author":"Korzyukov","year":"2003","journal-title":"Neuroimage"},{"key":"2021072913272820400_R25","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1111\/j.1469-8986.1995.tb01226.x","article-title":"Mismatch negativity to auditory stimulus change recorded directly from the human temporal cortex.","volume":"32","author":"Kropotov","year":"1995","journal-title":"Psychophysiology"},{"key":"2021072913272820400_R26","volume-title":"Designing experiments and analyzing data: A model comparison perspective.","author":"Maxwell","year":"2004"},{"key":"2021072913272820400_R27","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1111\/j.1469-8986.2009.00856.x","article-title":"Mismatch negativity (MMN), the deviance-elicited auditory deflection, explained.","volume":"47","author":"May","year":"2009","journal-title":"Psychophysiology"},{"key":"2021072913272820400_R28","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1038\/264746a0","article-title":"Hearing lips and seeing voices.","volume":"264","author":"McGurk","year":"1976","journal-title":"Nature"},{"key":"2021072913272820400_R29","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/s00221-011-2686-z","article-title":"The effects of visual material and temporal synchrony on the processing of letters and speech sounds.","volume":"211","author":"Mittag","year":"2011","journal-title":"Experimental Brain Research"},{"key":"2021072913272820400_R30","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/S0926-6410(02)00053-8","article-title":"Processing of changes in visual speech in the human auditory cortex.","volume":"13","author":"M\u00f6tt\u00f6nen","year":"2002","journal-title":"Cognitive Brain Research"},{"key":"2021072913272820400_R31","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.brainres.2005.12.125","article-title":"The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the mismatch negativity.","volume":"1078","author":"Muller-Gass","year":"2006","journal-title":"Brain Research"},{"key":"2021072913272820400_R32","volume-title":"Attention and brain function.","author":"N\u00e4\u00e4t\u00e4nen","year":"1992"},{"key":"2021072913272820400_R33","doi-asserted-by":"crossref","first-page":"2544","DOI":"10.1016\/j.clinph.2007.04.026","article-title":"The mismatch negativity (MMN) in basic research of central auditory processing: A review.","volume":"118","author":"N\u00e4\u00e4t\u00e4nen","year":"2007","journal-title":"Clinical Neurophysiology"},{"key":"2021072913272820400_R34","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/S0166-2236(00)01790-2","article-title":"\u201cPrimitive intelligence\u201d in the auditory cortex.","volume":"24","author":"N\u00e4\u00e4t\u00e4nen","year":"2001","journal-title":"Trends in Neurosciences"},{"key":"2021072913272820400_R35","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1097\/00001756-200003200-00043","article-title":"Effects of visual attentional load on auditory processing.","volume":"11","author":"Otten","year":"2000","journal-title":"NeuroReport"},{"key":"2021072913272820400_R36","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1097\/WNR.0b013e328010e2ac","article-title":"Preattentive detection of nonsalient contingencies between auditory features.","volume":"18","author":"Paavilainen","year":"2007","journal-title":"NeuroReport"},{"key":"2021072913272820400_R37","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/0013-4694(89)90180-6","article-title":"Spherical splines for scalp potential and current density mapping.","volume":"72","author":"Perrin","year":"1989","journal-title":"Electroencephalography and Clinical Neurophysiology"},{"key":"2021072913272820400_R38","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/0013-4694(87)90141-6","article-title":"Mapping of scalp potentials by surface spline interpolation.","volume":"66","author":"Perrin","year":"1987","journal-title":"Electroencephalography and Clinical Neurophysiology"},{"key":"2021072913272820400_R39","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1097\/00001756-199212000-00030","article-title":"Representation of abstract attributes of auditory stimuli in the human brain.","volume":"3","author":"Saarinen","year":"1992","journal-title":"NeuroReport"},{"key":"2021072913272820400_R40","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.neuropsychologia.2006.03.036","article-title":"Seeing voices: High-density electrical mapping and source-analysis of the multisensory mismatch negativity evoked during the McGurk illusion.","volume":"45","author":"Saint-Amour","year":"2007","journal-title":"Neuropsychologia"},{"key":"2021072913272820400_R41","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/0304-3940(91)90914-F","article-title":"Seeing speech: Visual information from lip movements modifies activity in the human auditory cortex.","volume":"127","author":"Sams","year":"1991","journal-title":"Neuroscience Letters"},{"key":"2021072913272820400_R42","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1016\/j.conb.2005.06.008","article-title":"Multisensory contributions to low-level, \u201cunisensory\u201d processing.","volume":"15","author":"Schroeder","year":"2005","journal-title":"Current Opinion in Neurobiology"},{"key":"2021072913272820400_R43","doi-asserted-by":"crossref","first-page":"3005","DOI":"10.1097\/00001756-199611250-00041","article-title":"Mismatch response of the human brain to changes in sound location.","volume":"7","author":"Schr\u00f6ger","year":"1996","journal-title":"NeuroReport"},{"key":"2021072913272820400_R44","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.neulet.2003.12.085","article-title":"Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativity.","volume":"357","author":"Stekelenburg","year":"2004","journal-title":"Neuroscience Letters"},{"key":"2021072913272820400_R45","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1027\/0269-8803.21.34.164","article-title":"A new view on the MMN and attention debate.","volume":"21","author":"Sussman","year":"2007","journal-title":"Journal of Psychophysiology"},{"key":"2021072913272820400_R57","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/S0926-6410(01)00131-8","article-title":"Top-down effects can modify the initially stimulus-driven auditory organization.","volume":"13","author":"Sussman","year":"2002","journal-title":"Cognitive Brain Research"},{"key":"2021072913272820400_R46","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.cogbrainres.2005.05.006","article-title":"Preattentive representation of feature conjunctions for concurrent spatially distributed auditory objects.","volume":"25","author":"Takegata","year":"2005","journal-title":"Brain Research, Cognitive Brain Research"},{"key":"2021072913272820400_R47","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1037\/h0055183","article-title":"Experimental study of the influence of vision on sound localization.","volume":"28","author":"Thomas","year":"1941","journal-title":"Journal of Experimental Psychology"},{"key":"2021072913272820400_R48","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.ijpsycho.2005.06.007","article-title":"When sound and picture do not fit: Mismatch negativity and sensory interaction.","volume":"59","author":"Ullsperger","year":"2006","journal-title":"International Journal of Psychophysiology"},{"key":"2021072913272820400_R49","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/S0926-6410(03)00137-X","article-title":"Visual short-term memory load affects sensory processing of irrelevant sounds in human auditory cortex.","volume":"17","author":"Valtonen","year":"2003","journal-title":"Brain Research, Cognitive Brain Research"},{"key":"2021072913272820400_R50","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1186\/1471-2202-11-11","article-title":"fMR-adaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex.","volume":"11","author":"van Atteveldt","year":"2010","journal-title":"BMC Neuroscience"},{"key":"2021072913272820400_R51","doi-asserted-by":"crossref","first-page":"3665","DOI":"10.1523\/JNEUROSCI.5003-11.2012","article-title":"A neuronal model of predictive coding accounting for the mismatch negativity.","volume":"32","author":"Wacongne","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"2021072913272820400_R52","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1111\/j.1469-8986.2004.00208.x","article-title":"From symbols to sounds: Visual symbolic information activates sound representations.","volume":"41","author":"Widmann","year":"2004","journal-title":"Psychophysiology"},{"key":"2021072913272820400_R53","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1027\/0269-8803.21.34.147","article-title":"Interpreting the mismatch negativity.","volume":"21","author":"Winkler","year":"2007","journal-title":"Journal of Psychophysiology"},{"key":"2021072913272820400_R54","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.biopsycho.2009.08.011","article-title":"Deviance detection in congruent audiovisual speech: Evidence for implicit integrated audiovisual memory representations.","volume":"82","author":"Winkler","year":"2009","journal-title":"Biological Psychology"},{"key":"2021072913272820400_R55","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1111\/j.1469-8986.1992.tb01707.x","article-title":"Can echoic memory store two traces simultaneously? A study of event-related brain potentials.","volume":"29","author":"Winkler","year":"1992","journal-title":"Psychophysiology"},{"key":"2021072913272820400_R56","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1097\/00001756-200505310-00005","article-title":"Audiovisual phonological mismatch produces early negativity in auditory cortex.","volume":"16","author":"Yumoto","year":"2005","journal-title":"NeuroReport"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/25\/3\/365\/1944907\/jocn_a_00334.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/25\/3\/365\/1944907\/jocn_a_00334.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,29]],"date-time":"2021-07-29T14:08:19Z","timestamp":1627567699000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/25\/3\/365\/27904\/The-Representation-of-Audiovisual-Regularities-in"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,3,1]]},"references-count":57,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2013,3,1]]},"published-print":{"date-parts":[[2013,3,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00334","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2013,3]]},"published":{"date-parts":[[2013,3,1]]}}}