{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T05:18:20Z","timestamp":1770441500920,"version":"3.49.0"},"reference-count":60,"publisher":"MIT Press","issue":"10","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2014,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The human ability to integrate the input of several sensory systems is essential for building a meaningful interpretation out of the complexity of the environment. Training studies have shown that the involvement of multiple senses during training enhances neuroplasticity, but it is not clear to what extent integration of the senses during training is required for the observed effects. This study intended to elucidate the differential contributions of uni- and multisensory elements of music reading training in the resulting plasticity of abstract audiovisual incongruency identification. We used magnetoencephalography to measure the pre- and posttraining cortical responses of two randomly assigned groups of participants that followed either an audiovisual music reading training that required multisensory integration (AV-Int group) or a unisensory training that had separate auditory and visual elements (AV-Sep group). Results revealed a network of frontal generators for the abstract audiovisual incongruency response, confirming previous findings, and indicated the central role of anterior prefrontal cortex in this process. Differential neuroplastic effects of the two types of training in frontal and temporal regions point to the crucial role of multisensory integration occurring during training. Moreover, a comparison of the posttraining cortical responses of both groups to a group of musicians that were tested using the same paradigm revealed that long-term music training leads to significantly greater responses than the short-term training of the AV-Int group in anterior prefrontal regions as well as to significantly greater responses than both short-term training protocols in the left superior temporal gyrus (STG).<\/jats:p>","DOI":"10.1162\/jocn_a_00620","type":"journal-article","created":{"date-parts":[[2014,3,26]],"date-time":"2014-03-26T14:15:13Z","timestamp":1395843313000},"page":"2224-2238","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":29,"title":["Multisensory Integration during Short-term Music Reading Training Enhances Both Uni- and Multisensory Cortical Processing"],"prefix":"10.1162","volume":"26","author":[{"given":"Evangelos","family":"Paraskevopoulos","sequence":"first","affiliation":[{"name":"1University of M\u00fcnster"}]},{"given":"Anja","family":"Kuchenbuch","sequence":"additional","affiliation":[{"name":"1University of M\u00fcnster"}]},{"given":"Sibylle C.","family":"Herholz","sequence":"additional","affiliation":[{"name":"2German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany"}]},{"given":"Christo","family":"Pantev","sequence":"additional","affiliation":[{"name":"1University of M\u00fcnster"}]}],"member":"281","published-online":{"date-parts":[[2014,10,1]]},"reference":[{"key":"2021073000485716700_R1","first-page":"353","article-title":"Lesions of frontal cortex diminish the auditory mismatch negativity.","volume":"91","author":"Alho","year":"1994","journal-title":"Electroencephalography"},{"key":"2021073000485716700_R2","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1162\/0898929053279586","article-title":"Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions.","volume":"17","author":"Barraclough","year":"2005","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073000485716700_R3","doi-asserted-by":"crossref","first-page":"526","DOI":"10.1002\/hbm.20884","article-title":"Primary and multisensory cortical activity is correlated with audiovisual percepts.","volume":"31","author":"Benoit","year":"2010","journal-title":"Human Brain Mapping"},{"key":"2021073000485716700_R4","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1162\/jocn_a_00334","article-title":"The representation of audiovisual regularities in the human brain.","volume":"25","author":"Besle","year":"2013","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073000485716700_R5","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/S1364-6613(00)01483-2","article-title":"Cognitive and emotional influences in anterior cingulate cortex.","volume":"4","author":"Bush","year":"2000","journal-title":"Trends in Cognitive Sciences"},{"key":"2021073000485716700_R6","doi-asserted-by":"crossref","first-page":"3515","DOI":"10.1162\/jocn_a_00015","article-title":"Enhanced multisensory integration and motor reactivation after active motor learning of audiovisual associations.","volume":"23","author":"Butler","year":"2011","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073000485716700_R7","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1068\/p7161","article-title":"Cross-modality correspondence between pitch and spatial location modulates attentional orienting.","volume":"41","author":"Chiou","year":"2012","journal-title":"Perception"},{"key":"2021073000485716700_R8","doi-asserted-by":"crossref","first-page":"640","DOI":"10.3389\/fnhum.2013.00640","article-title":"Task decomposition: A framework for comparing diverse training models in human brain plasticity studies.","volume":"7","author":"Coffey","year":"2013","journal-title":"Frontiers in Human Neuroscience"},{"key":"2021073000485716700_R9","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1016\/j.neuroimage.2003.12.049","article-title":"Specialization within the ventral stream: The case for the visual word form area.","volume":"22","author":"Cohen","year":"2004","journal-title":"Neuroimage"},{"key":"2021073000485716700_R10","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1038\/386608a0","article-title":"Transient and sustained activity in a distributed neural system for human working memory.","volume":"386","author":"Courtney","year":"1997","journal-title":"Nature"},{"key":"2021073000485716700_R11","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.neuron.2007.12.013","article-title":"Multisensory interplay reveals crossmodal influences on \u201csensory-specific\u201d brain regions, neural responses, and judgments.","volume":"57","author":"Driver","year":"2008","journal-title":"Neuron"},{"key":"2021073000485716700_R12","first-page":"1","article-title":"Natural cross-modal mappings between visual and auditory features.","volume":"10","author":"Evans","year":"2010","journal-title":"Journal of Vision"},{"key":"2021073000485716700_R13","doi-asserted-by":"crossref","first-page":"1350","DOI":"10.1093\/cercor\/bhp199","article-title":"A role for the intraparietal sulcus in transforming musical pitch information.","volume":"20","author":"Foster","year":"2010","journal-title":"Cerebral Cortex"},{"key":"2021073000485716700_R14","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.neuroimage.2010.06.042","article-title":"Cortical structure predicts success in performing musical transformation judgments.","volume":"53","author":"Foster","year":"2010","journal-title":"Neuroimage"},{"key":"2021073000485716700_R15","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.neuroimage.2005.11.046","article-title":"Improvement-related functional plasticity following pitch memory training.","volume":"31","author":"Gaab","year":"2006","journal-title":"Neuroimage"},{"key":"2021073000485716700_R16","doi-asserted-by":"crossref","first-page":"9240","DOI":"10.1523\/JNEUROSCI.23-27-09240.2003","article-title":"Brain structures differ between musicians and nonmusicians.","volume":"23","author":"Gaser","year":"2003","journal-title":"The Journal of Neuroscience"},{"key":"2021073000485716700_R17","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.tics.2006.04.008","article-title":"Is neocortex essentially multisensory?","volume":"10","author":"Ghazanfar","year":"2006","journal-title":"Trends in Cognitive Sciences"},{"key":"2021073000485716700_R18","doi-asserted-by":"crossref","first-page":"486","DOI":"10.1016\/j.neuron.2012.10.011","article-title":"Musical training as a framework for brain plasticity: Behavior, function, and structure.","volume":"76","author":"Herholz","year":"2012","journal-title":"Neuron"},{"key":"2021073000485716700_R19","doi-asserted-by":"crossref","first-page":"2544","DOI":"10.1162\/jocn.2011.21619","article-title":"Color, context, and cognitive style: Variations in color knowledge retrieval as a function of task and subject variables.","volume":"23","author":"Hsu","year":"2011","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073000485716700_R20","doi-asserted-by":"crossref","first-page":"3019","DOI":"10.1523\/JNEUROSCI.5118-08.2009","article-title":"Musical training shapes structural brain development.","volume":"29","author":"Hyde","year":"2009","journal-title":"The Journal of Neuroscience"},{"key":"2021073000485716700_R21","doi-asserted-by":"crossref","first-page":"e6450","DOI":"10.1371\/journal.pone.0006450","article-title":"The impact of spatial incongruence on an auditory-visual illusion.","volume":"4","author":"Innes-Brown","year":"2009","journal-title":"PloS One"},{"key":"2021073000485716700_R22","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1097\/WNR.0b013e32834973ba","article-title":"Visual mismatch negativity and its importance in visual cognitive sciences.","volume":"22","author":"Kimura","year":"2011","journal-title":"NeuroReport"},{"key":"2021073000485716700_R23","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1038\/20178","article-title":"The role of the anterior prefrontal cortex in human cognition.","volume":"399","author":"Koechlin","year":"1999","journal-title":"Nature"},{"key":"2021073000485716700_R24","doi-asserted-by":"crossref","first-page":"9632","DOI":"10.1523\/JNEUROSCI.2254-08.2008","article-title":"Cortical plasticity induced by short-term unimodal and multimodal musical training.","volume":"28","author":"Lappe","year":"2008","journal-title":"The Journal of Neuroscience"},{"key":"2021073000485716700_R25","doi-asserted-by":"crossref","first-page":"e21493","DOI":"10.1371\/journal.pone.0021493","article-title":"Cortical plasticity induced by short-term multimodal musical rhythm training.","volume":"6","author":"Lappe","year":"2011","journal-title":"PloS One"},{"key":"2021073000485716700_R26","doi-asserted-by":"crossref","first-page":"E1441","DOI":"10.1073\/pnas.1115267108","article-title":"Long-term music training tunes how the brain temporally binds signals from multiple senses.","volume":"108","author":"Lee","year":"2011","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021073000485716700_R27","doi-asserted-by":"crossref","first-page":"6782","DOI":"10.1523\/JNEUROSCI.4882-12.2013","article-title":"Connectivity-based parcellation of the human frontal pole with diffusion tensor imaging.","volume":"33","author":"Liu","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2021073000485716700_R28","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1016\/j.neuroimage.2004.02.033","article-title":"Common and distinct neural substrates of attentional control in an integrated Simon and spatial Stroop task as assessed by event-related fMRI.","volume":"22","author":"Liu","year":"2004","journal-title":"Neuroimage"},{"key":"2021073000485716700_R29","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1016\/j.neuroimage.2004.11.028","article-title":"Combined ICA-LORETA analysis of mismatch negativity.","volume":"25","author":"Marco-Pallar\u00e9s","year":"2005","journal-title":"Neuroimage"},{"key":"2021073000485716700_R30","doi-asserted-by":"crossref","first-page":"3721","DOI":"10.1073\/pnas.92.9.3721","article-title":"Distinct neural correlates of visual long-term memory for spatial location and object identity: A positron emission tomography study in humans.","volume":"92","author":"Moscovitch","year":"1995","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021073000485716700_R31","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1097\/00003446-199502000-00002","article-title":"The mismatch negativity: A powerful tool for cognitive neuroscience.","volume":"16","author":"N\u00e4\u00e4t\u00e4nen","year":"1995","journal-title":"Ear and Hearing"},{"key":"2021073000485716700_R32","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1016\/0001-6918(78)90006-9","article-title":"Early selective-attention effect on evoked potential reinterpreted.","volume":"42","author":"N\u00e4\u00e4t\u00e4nen","year":"1978","journal-title":"Acta Psychologica"},{"key":"2021073000485716700_R33","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.clinph.2003.04.001","article-title":"The mismatch negativity (MMN): Towards the optimal paradigm.","volume":"115","author":"N\u00e4\u00e4t\u00e4nen","year":"2004","journal-title":"Clinical Neurophysiology"},{"key":"2021073000485716700_R34","doi-asserted-by":"crossref","first-page":"1641","DOI":"10.1093\/cercor\/bhn200","article-title":"Cortical plasticity of audiovisual object representations.","volume":"19","author":"Naumer","year":"2009","journal-title":"Cerebral Cortex"},{"key":"2021073000485716700_R35","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0028-3932(71)90067-4","article-title":"The assessment and analysis of handedness: The Edinburgh inventory.","volume":"9","author":"Oldfield","year":"1971","journal-title":"Neuropsychologia"},{"key":"2021073000485716700_R36","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1111\/1469-8986.3820359","article-title":"Preattentive extraction of abstract feature conjunctions from auditory stimulation as reflected by the mismatch negativity (MMN).","volume":"38","author":"Paavilainen","year":"2001","journal-title":"Psychophysiology"},{"key":"2021073000485716700_R37","doi-asserted-by":"crossref","first-page":"e36534","DOI":"10.1371\/journal.pone.0036534","article-title":"Evidence for training-induced plasticity in multisensory brain structures: An MEG study.","volume":"7","author":"Paraskevopoulos","year":"2012","journal-title":"PLoS One"},{"key":"2021073000485716700_R38","doi-asserted-by":"crossref","first-page":"18196","DOI":"10.1523\/JNEUROSCI.1947-12.2012","article-title":"Musical expertise induces audiovisual integration of abstract congruency rules.","volume":"32","author":"Paraskevopoulos","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"2021073000485716700_R39","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1038\/349061a0","article-title":"Localization of a human system for sustained attention by positron emission tomography.","volume":"349","author":"Pardo","year":"1991","journal-title":"Nature"},{"key":"2021073000485716700_R40","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/0167-8760(84)90014-X","article-title":"Low resolution electromagnetic tomography: A new method for localizing electrical activity in the brain.","volume":"18","author":"Pascual-Marqui","year":"1994","journal-title":"International Journal of Psychophysiology"},{"key":"2021073000485716700_R41","doi-asserted-by":"crossref","first-page":"S125","DOI":"10.1006\/nimg.2001.0836","article-title":"Contrasting the dorsal and ventral visual systems: Guidance of movement versus decision making.","volume":"14","author":"Passingham","year":"2001","journal-title":"Neuroimage"},{"key":"2021073000485716700_R42","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1002\/hbm.21254","article-title":"Neural correlates of audiovisual object recognition: Effects of implicit spatial congruency.","volume":"33","author":"Plank","year":"2011","journal-title":"Human Brain Mapping"},{"key":"2021073000485716700_R43","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1038\/nrn1343","article-title":"Anterior prefrontal cortex: Insights into function from anatomy and neuroimaging.","volume":"5","author":"Ramnani","year":"2004","journal-title":"Nature Reviews Neuroscience"},{"key":"2021073000485716700_R44","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.cognition.2005.01.004","article-title":"Spatial representation of pitch height: The SMARC effect.","volume":"99","author":"Rusconi","year":"2006","journal-title":"Cognition"},{"key":"2021073000485716700_R45","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/S0304-3940(01)01977-2","article-title":"Event-related brain potentials to sound omissions differ in musicians and nonmusicians.","volume":"308","author":"R\u00fcsseler","year":"2001","journal-title":"Neuroscience Letters"},{"key":"2021073000485716700_R46","doi-asserted-by":"crossref","first-page":"1370","DOI":"10.1038\/nn.2412","article-title":"Training induces changes in white-matter architecture.","volume":"12","author":"Scholz","year":"2009","journal-title":"Nature Neuroscience"},{"key":"2021073000485716700_R47","doi-asserted-by":"crossref","first-page":"e25031","DOI":"10.1371\/journal.pone.0025031","article-title":"REST: A toolkit for resting-state functional magnetic resonance imaging data processing.","volume":"6","author":"Song","year":"2011","journal-title":"PLoS One"},{"key":"2021073000485716700_R48","doi-asserted-by":"crossref","first-page":"971","DOI":"10.3758\/s13414-010-0073-7","article-title":"Crossmodal correspondences: A tutorial review.","volume":"73","author":"Spence","year":"2011","journal-title":"Attention, Perception & Psychophysics"},{"key":"2021073000485716700_R49","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1196\/annals.1360.032","article-title":"A neurocognitive approach to music reading.","volume":"1060","author":"Stewart","year":"2005","journal-title":"Annals of the New York Academy of Sciences"},{"key":"2021073000485716700_R50","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/S1053-8119(03)00248-9","article-title":"Brain changes after learning to read and play music.","volume":"20","author":"Stewart","year":"2003","journal-title":"Neuroimage"},{"key":"2021073000485716700_R51","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.neuroimage.2005.07.013","article-title":"Event-related optical imaging reveals the temporal dynamics of right temporal and frontal cortex activation in pre-attentive change detection.","volume":"29","author":"Tse","year":"2006","journal-title":"Neuroimage"},{"key":"2021073000485716700_R52","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1006\/nimg.2001.0978","article-title":"Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain.","volume":"15","author":"Tzourio-Mazoyer","year":"2002","journal-title":"Neuroimage"},{"key":"2021073000485716700_R53","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1073\/pnas.95.3.883","article-title":"A neural system for human visual working memory.","volume":"95","author":"Ungerleider","year":"1998","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021073000485716700_R54","first-page":"905","article-title":"Cortical dynamics of the visual change detection process.","volume":"47","author":"Urakawa","year":"2010","journal-title":"Psychophysiology"},{"key":"2021073000485716700_R55","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/S0304-3940(01)01988-7","article-title":"Spatio-temporal source imaging reveals subcomponents of the human auditory mismatch negativity in the cingulum and right inferior temporal gyrus.","volume":"308","author":"Waberski","year":"2001","journal-title":"Neuroscience Letters"},{"key":"2021073000485716700_R56","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1177\/0956797609354734","article-title":"Preverbal infants' sensitivity to synaesthetic cross-modality correspondences.","volume":"21","author":"Walker","year":"2010","journal-title":"Psychological Science"},{"key":"2021073000485716700_R57","doi-asserted-by":"crossref","first-page":"1829","DOI":"10.1093\/cercor\/bhp248","article-title":"Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization.","volume":"20","author":"Werner","year":"2010","journal-title":"Cerebral Cortex"},{"key":"2021073000485716700_R58","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1097\/00001756-200505310-00005","article-title":"Audiovisual phonological mismatch produces early negativity in auditory cortex.","volume":"16","author":"Yumoto","year":"2005","journal-title":"NeuroReport"},{"key":"2021073000485716700_R59","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1098\/rstb.2007.2161","article-title":"Neural specializations for speech and pitch: Moving beyond the dichotomies.","volume":"363","author":"Zatorre","year":"2008","journal-title":"Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences"},{"key":"2021073000485716700_R60","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1111\/j.1749-6632.2012.06455.x","article-title":"The multisensory brain and its ability to learn music.","volume":"1252","author":"Zimmerman","year":"2012","journal-title":"Annals of the New York Academy of Sciences"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/26\/10\/2224\/1948425\/jocn_a_00620.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/26\/10\/2224\/1948425\/jocn_a_00620.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T04:53:30Z","timestamp":1746161610000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/26\/10\/2224\/28185\/Multisensory-Integration-during-Short-term-Music"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,1]]},"references-count":60,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2014,10,1]]},"published-print":{"date-parts":[[2014,10,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00620","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2014,10]]},"published":{"date-parts":[[2014,10,1]]}}}