{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T18:55:58Z","timestamp":1774464958762,"version":"3.50.1"},"reference-count":52,"publisher":"MIT Press - Journals","issue":"11","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2011,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Everyday experience affords us many opportunities to learn about objects through multiple senses using physical interaction. Previous work has shown that active motor learning of unisensory items enhances memory and leads to the involvement of motor systems during subsequent perception. However, the impact of active motor learning on subsequent perception and recognition of associations among multiple senses has not been investigated. Twenty participants were included in an fMRI study that explored the impact of active motor learning on subsequent processing of unisensory and multisensory stimuli. Participants were exposed to visuo-motor associations between novel objects and novel sounds either through self-generated actions on the objects or by observing an experimenter produce the actions. Immediately after exposure, accuracy, RT, and BOLD fMRI measures were collected with unisensory and multisensory stimuli in associative perception and recognition tasks. Response times during audiovisual associative and unisensory recognition were enhanced by active learning, as was accuracy during audiovisual associative recognition. The difference in motor cortex activation between old and new associations was greater for the active than the passive group. Furthermore, functional connectivity between visual and motor cortices was stronger after active learning than passive learning. Active learning also led to greater activation of the fusiform gyrus during subsequent unisensory visual perception. Finally, brain regions implicated in audiovisual integration (e.g., STS) showed greater multisensory gain after active learning than after passive learning. Overall, the results show that active motor learning modulates the processing of multisensory associations.<\/jats:p>","DOI":"10.1162\/jocn_a_00015","type":"journal-article","created":{"date-parts":[[2011,3,31]],"date-time":"2011-03-31T13:27:41Z","timestamp":1301578061000},"page":"3515-3528","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":41,"title":["Enhanced Multisensory Integration and Motor Reactivation after Active Motor Learning of Audiovisual Associations"],"prefix":"10.1162","volume":"23","author":[{"given":"Andrew J.","family":"Butler","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas W.","family":"James","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karin Harman","family":"James","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2011,11,1]]},"reference":[{"key":"2021072901023259000_R1","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1007\/s00221-005-2396-5","article-title":"Functional imaging of human crossmodal identification and object recognition.","volume":"166","author":"Amedi","year":"2005","journal-title":"Experimental Brain Research"},{"key":"2021072901023259000_R2","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1017\/S0140525X99002149","article-title":"Perceptual symbol systems.","volume":"22","author":"Barsalou","year":"1999","journal-title":"Behavioral and Brain Sciences"},{"key":"2021072901023259000_R3","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1385\/NI:3:2:093","article-title":"Statistical criteria in fMRI studies of multisensory integration.","volume":"3","author":"Beauchamp","year":"2005","journal-title":"Neuroinformatics"},{"key":"2021072901023259000_R4","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1006\/nimg.2000.0635","article-title":"Representation of manipulable man-made objects in the dorsal stream.","volume":"12","author":"Chao","year":"2000","journal-title":"Neuroimage"},{"key":"2021072901023259000_R5","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/BF01326550","article-title":"Memory for action events: The power of enactment.","volume":"1","author":"Cohen","year":"1989","journal-title":"Educational Psychological Reviews"},{"key":"2021072901023259000_R6","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.conb.2006.03.005","article-title":"Human parietal cortex in action.","volume":"16","author":"Culham","year":"2006","journal-title":"Current Opinion in Neurobiology"},{"key":"2021072901023259000_R7","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0010-0277(89)90005-X","article-title":"Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition.","volume":"33","author":"Damasio","year":"1989","journal-title":"Cognition"},{"key":"2021072901023259000_R8","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/j.neuroimage.2009.06.041","article-title":"The role of actions in auditory object discrimination.","volume":"48","author":"De Lucia","year":"2009","journal-title":"Neuroimage"},{"key":"2021072901023259000_R9","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.cub.2007.11.004","article-title":"A mirror up to nature.","volume":"18","author":"Dinstein","year":"2008","journal-title":"Current Biology"},{"key":"2021072901023259000_R10","volume-title":"The human memory. A multimodal approach","author":"Engelkamp","year":"1994"},{"key":"2021072901023259000_R11","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0001-6918(97)00005-X","article-title":"Sensory factors in memory for subject-performed tasks.","volume":"96","author":"Engelkamp","year":"1997","journal-title":"Acta Psychologica"},{"key":"2021072901023259000_R12","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1080\/09541449308520127","article-title":"Bizarreness effects in verbal tasks and subject-performed tasks.","volume":"5","author":"Engelkamp","year":"1993","journal-title":"European Journal of Cognitive Psychology"},{"key":"2021072901023259000_R13","first-page":"1","article-title":"Testing simulation theory with cross-modal multivariate classification of fMRI data.","volume":"3","author":"Etzel","year":"2008","journal-title":"Public Library of Science One"},{"key":"2021072901023259000_R14","article-title":"Learning of arbitrary association between visual and auditory stimuli in adults: The \u201cbond effect\u201d of haptic exploration.","volume":"4","author":"Fredembach","year":"2009","journal-title":"Public Library of Science One"},{"key":"2021072901023259000_R15","doi-asserted-by":"crossref","first-page":"2047","DOI":"10.1162\/jocn.2009.21280","article-title":"Cortex and memory: Emergence of a new paradigm.","volume":"21","author":"Fuster","year":"2009","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072901023259000_R16","article-title":"The theory of affordances.","volume-title":"Perceiving, acting, and knowing","author":"Gibson","year":"1977"},{"key":"2021072901023259000_R53","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/0166-2236(92)90344-8","article-title":"Separate visual pathways for perception and action.","volume":"15","author":"Goodale","year":"1992","journal-title":"Trends in Neuroscience"},{"key":"2021072901023259000_R17","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/S0028-3932(01)00089-6","article-title":"Does visual perception of object afford action? Evidence from a neuroimaging study.","volume":"40","author":"Grezes","year":"2002","journal-title":"Neuropsychologia"},{"key":"2021072901023259000_R18","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1038\/77754","article-title":"The dynamics of object-selective activation correlate with recognition performance in humans.","volume":"3","author":"Grill-Spector","year":"2000","journal-title":"Nature Neuroscience"},{"key":"2021072901023259000_R19","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1016\/S0960-9822(00)80053-6","article-title":"Active manual control of object views facilitates visual recognition.","volume":"9","author":"Harman","year":"1999","journal-title":"Current Biology"},{"key":"2021072901023259000_R54","doi-asserted-by":"crossref","first-page":"5461","DOI":"10.1073\/pnas.0835746100","article-title":"Modular organization of internal models of tools in the human cerebellum.","volume":"100","author":"Imamizu","year":"2003","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072901023259000_R20","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1080\/02643290802425914","article-title":"The role of sensorimotor learning in the perception of letter-like forms: Tracking the causes of neural specialization for letters.","volume":"26","author":"James","year":"2009","journal-title":"Cognitive Neuropsychology"},{"key":"2021072901023259000_R21","doi-asserted-by":"crossref","first-page":"2937","DOI":"10.1016\/j.neuropsychologia.2006.06.026","article-title":"Letter processing automatically recruits a sensory-motor brain network.","volume":"44","author":"James","year":"2006","journal-title":"Neuropsychologia"},{"key":"2021072901023259000_R22","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1037\/h0087358","article-title":"Manipulating and recognizing virtual objects: Where the action is.","volume":"55","author":"James","year":"2001","journal-title":"Canadian Journal of Experimental Psychology"},{"key":"2021072901023259000_R23","doi-asserted-by":"crossref","first-page":"383","DOI":"10.3758\/BF03195466","article-title":"Learning three-dimensional object structure: A virtual reality study.","volume":"34","author":"James","year":"2002","journal-title":"Behavioral Research Methods, Instruments and Computers"},{"key":"2021072901023259000_R24","doi-asserted-by":"crossref","first-page":"F26","DOI":"10.1111\/j.1467-7687.2009.00919.x","article-title":"Auditory verb perception recruits motor systems in the developing brain: An fMRI investigation.","volume":"12","author":"James","year":"2009","journal-title":"Developmental Science"},{"key":"2021072901023259000_R25","doi-asserted-by":"crossref","first-page":"1792","DOI":"10.1016\/j.cub.2003.09.039","article-title":"Auditory and action semantic features activate sensory-specific perceptual brain regions.","volume":"13","author":"James","year":"2003","journal-title":"Current Biology"},{"key":"2021072901023259000_R26","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1016\/S0896-6273(02)00803-6","article-title":"Differential effects of viewing on object-driven activation in dorsal and ventral streams.","volume":"35","author":"James","year":"2002","journal-title":"Neuron"},{"key":"2021072901023259000_R27","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.neuropsychologia.2010.10.030","article-title":"Multisensory perception of action in temporal and parietal cortices.","volume":"49","author":"James","year":"2011","journal-title":"Neuropsychologia"},{"key":"2021072901023259000_R28","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1016\/j.neuron.2009.08.011","article-title":"Recollection, familiarity, and cortical reinstatement: A multivoxel pattern analysis.","volume":"63","author":"Johnson","year":"2009","journal-title":"Neuron"},{"key":"2021072901023259000_R29","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1007\/s00221-005-2370-2","article-title":"On the use of superadditivity as a metric for characterizing multisensory integration in functional neuroimaging studies.","volume":"166","author":"Laurienti","year":"2009","journal-title":"Experimental Brain Research"},{"key":"2021072901023259000_R30","doi-asserted-by":"crossref","first-page":"1801","DOI":"10.1016\/j.neuropsychologia.2005.01.020","article-title":"Premotor activations in response to visually presented single letters depend on the hand used to write: A study on left-handers.","volume":"43","author":"Longcamp","year":"2005","journal-title":"Neuropsychologia"},{"key":"2021072901023259000_R31","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.1162\/jocn.2009.21281","article-title":"fMRI activation during observation of others' reach errors.","volume":"22","author":"Malfait","year":"2010","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072901023259000_R32","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.brainres.2006.05.033","article-title":"Reactivation of physical motor information in the memory of action events.","volume":"1101","author":"Masumoto","year":"2006","journal-title":"Brain Research"},{"key":"2021072901023259000_R33","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.neuron.2005.02.009","article-title":"Motor learning by observing.","volume":"46","author":"Mattar","year":"2005","journal-title":"Neuron"},{"key":"2021072901023259000_R34","first-page":"1","article-title":"A rapid sound-action association effect in human insular cortex.","volume":"2","author":"Mutschler","year":"2007","journal-title":"Public Library of Science One"},{"key":"2021072901023259000_R35","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1097\/00001756-200007140-00027","article-title":"Activity in motor areas while remembering action events.","volume":"11","author":"Nilsson","year":"2000","journal-title":"NeuroReport"},{"key":"2021072901023259000_R36","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1006\/nimg.2001.0801","article-title":"Reactivation of motor brain areas during explicit memory for actions.","volume":"14","author":"Nyberg","year":"2001","journal-title":"Neuroimage"},{"key":"2021072901023259000_R37","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1006\/brln.2000.2390","article-title":"Walking or talking: Behavioral and neurophysiological correlates of action verb processing.","volume":"78","author":"Pulvermuller","year":"2001","journal-title":"Brain and Language"},{"key":"2021072901023259000_R38","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/0926-6410(95)00038-0","article-title":"Premotor cortex and the recognition of motor actions.","volume":"3","author":"Rizzolatti","year":"1996","journal-title":"Cognitive Brain Research"},{"key":"2021072901023259000_R39","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/S0079-6123(07)00021-0","article-title":"Encoding-retrieval overlap in human episodic memory: A functional neuroimaging perspective.","volume":"169","author":"Rugg","year":"2008","journal-title":"Progress in Brain Research"},{"key":"2021072901023259000_R40","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1162\/089892902317361921","article-title":"Episodic action memory for real objects: An ERP investigation with perform, watch, and imagine action encoding tasks versus a non-action encoding task.","volume":"14","author":"Senkfor","year":"2002","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072901023259000_R41","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.1038\/nn.2196","article-title":"Mirror-image representation of action in the anterior parietal cortex.","volume":"11","author":"Shmuelof","year":"2008","journal-title":"Nature Neuroscience"},{"key":"2021072901023259000_R42","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1177\/1534582304274070","article-title":"Visual memory and visual perception recruit common neural substrates.","volume":"3","author":"Slotnick","year":"2004","journal-title":"Behavioral and Cognitive Neuroscience Reviews"},{"key":"2021072901023259000_R43","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s00221-006-0770-6","article-title":"Superadditive BOLD response in superior temporal sulcus with threshold non-speech objects.","volume":"179","author":"Stevenson","year":"2007","journal-title":"Experimental Brain Research"},{"key":"2021072901023259000_R44","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/s00221-009-1783-8","article-title":"An additive-factors design to disambiguate neuronal and areal convergence: Measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI.","volume":"198","author":"Stevenson","year":"2009","journal-title":"Experimental Brain Research"},{"key":"2021072901023259000_R45","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1162\/jocn.2009.21006","article-title":"Corticle activation patterns during long-term memory retrieval of visually or hapitcally encoded objects and locations.","volume":"21","author":"Stock","year":"2009","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072901023259000_R46","volume-title":"A co-planar stereotactic atlas of the human brain: 3-Dimensional proportional system: An approach to cerebral mapping (M. Rayport, Trans.)","author":"Talairach","year":"1988"},{"key":"2021072901023259000_R47","doi-asserted-by":"crossref","first-page":"6409","DOI":"10.1523\/JNEUROSCI.0636-05.2005","article-title":"Functionally segregated neural substrates for arbitrary audiovisual paired-association learning.","volume":"25","author":"Tanabe","year":"2005","journal-title":"The Journal of Neuroscience"},{"key":"2021072901023259000_R49","doi-asserted-by":"crossref","first-page":"445","DOI":"10.3758\/BF03196504","article-title":"Memory effects of motor activation in subject-performed tasks and sign language.","volume":"10","author":"von Essen","year":"2003","journal-title":"Psychonomic Bulletin & Review"},{"key":"2021072901023259000_R52","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1093\/cercor\/bhj176","article-title":"A neural system for learning about object function.","volume":"17","author":"Weisberg","year":"2007","journal-title":"Cerebral Cortex"},{"key":"2021072901023259000_R51","doi-asserted-by":"crossref","first-page":"11125","DOI":"10.1073\/pnas.97.20.11125","article-title":"Memory's echo: Vivid remembering reactivates sensory-specific cortex.","volume":"97","author":"Wheeler","year":"2000","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/23\/11\/3515\/1942252\/jocn_a_00015.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/23\/11\/3515\/1942252\/jocn_a_00015.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,29]],"date-time":"2021-07-29T01:22:23Z","timestamp":1627521743000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/23\/11\/3515\/5229\/Enhanced-Multisensory-Integration-and-Motor"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,11,1]]},"references-count":52,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2011,11,1]]},"published-print":{"date-parts":[[2011,11,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00015","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2011,11]]},"published":{"date-parts":[[2011,11,1]]}}}