{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T09:34:18Z","timestamp":1777628058299,"version":"3.51.4"},"reference-count":55,"publisher":"MIT Press - Journals","issue":"2","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2013,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Our experience with the world commonly involves physical interaction with objects enabling us to learn associations between multisensory information perceived during an event and our actions that create an event. The interplay among active interactions during learning and multisensory integration of object properties is not well understood. To better understand how action might enhance multisensory associative recognition, we investigated the interplay among motor and perceptual systems after active learning. Fifteen participants were included in an fMRI study during which they learned visuo-auditory-motor associations between novel objects and the sounds they produce, either through self-generated actions on the objects (active learning) or by observing an experimenter produce the actions (passive learning). Immediately after learning, behavioral and BOLD fMRI measures were collected while perceiving the objects used during unisensory and multisensory training in associative perception and recognition tasks. Active learning was faster and led to more accurate recognition of audiovisual associations than passive learning. Functional ROI analyses showed that in motor, somatosensory, and cerebellar regions there was greater activation during both the perception and recognition of actively learned associations. Finally, functional connectivity between visual- and motor-related processing regions was enhanced during the presentation of actively learned audiovisual associations. Overall, the results of the current study clarify and extend our own previous work [Butler, A. J., James, T. W., &amp; Harman James, K. Enhanced multisensory integration and motor reactivation after active motor learning of audiovisual associations. Journal of Cognitive Neuroscience, 23, 3515\u20133528, 2011] by providing several novel findings and highlighting the task-based nature of motor reactivation and retrieval after active learning.<\/jats:p>","DOI":"10.1162\/jocn_a_00284","type":"journal-article","created":{"date-parts":[[2012,8,20]],"date-time":"2012-08-20T13:55:37Z","timestamp":1345470937000},"page":"203-218","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":22,"title":["Active Learning of Novel Sound-producing Objects: Motor Reactivation and Enhancement of Visuo-motor Connectivity"],"prefix":"10.1162","volume":"25","author":[{"given":"Andrew J.","family":"Butler","sequence":"first","affiliation":[{"name":"1Indiana University"},{"name":"2Butler University"}]},{"given":"Karin Harman","family":"James","sequence":"additional","affiliation":[{"name":"1Indiana University"}]}],"member":"281","published-online":{"date-parts":[[2013,2,1]]},"reference":[{"key":"2021072913274919100_R1","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1017\/S0140525X99002149","article-title":"Perceptual symbol systems.","volume":"22","author":"Barsalou","year":"1999","journal-title":"Behavioral and Brain Sciences"},{"key":"2021072913274919100_R2","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/s00221-004-2005-z","article-title":"\u201cAcoustical vision\u201d of below threshold stimuli: Interaction among spatially converging audiovisual inputs.","volume":"160","author":"Bolognini","year":"2005","journal-title":"Experimental Brain Research"},{"key":"2021072913274919100_R3","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/S0896-6273(04)00181-3","article-title":"Neural circuits underlying imitation learning of hand actions: An event-related fMRI study.","volume":"42","author":"Buccino","year":"2004","journal-title":"Neuron"},{"key":"2021072913274919100_R4","doi-asserted-by":"crossref","first-page":"3515","DOI":"10.1162\/jocn_a_00015","article-title":"Enhanced multisensory integration and motor reactivation after active motor learning of audiovisual associations.","volume":"23","author":"Butler","year":"2011","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913274919100_R5","doi-asserted-by":"crossref","first-page":"1148","DOI":"10.1016\/j.neuroimage.2009.12.112","article-title":"ALE meta-analysis of action observation and imitation in the human brain.","volume":"50","author":"Caspers","year":"2010","journal-title":"Neuroimage"},{"key":"2021072913274919100_R6","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1006\/nimg.2000.0635","article-title":"Representation of manipulable man-made objects in the dorsal stream.","volume":"12","author":"Chao","year":"2000","journal-title":"Neuroimage"},{"key":"2021072913274919100_R7","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0010-0277(89)90005-X","article-title":"Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition.","volume":"33","author":"Damasio","year":"1989","journal-title":"Cognition"},{"key":"2021072913274919100_R8","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/j.neuroimage.2009.06.041","article-title":"The role of actions in auditory object discrimination.","volume":"48","author":"De Lucia","year":"2009","journal-title":"Neuroimage"},{"key":"2021072913274919100_R9","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.cub.2007.11.004","article-title":"A mirror up to nature.","volume":"18","author":"Dinstein","year":"2008","journal-title":"Current Biology"},{"key":"2021072913274919100_R55","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1111\/j.1460-9568.2009.07067.x","article-title":"Neurons in primary motor cortex engaged during action observation.","volume":"31","author":"Dushanova","year":"2010","journal-title":"European Journal of Neuroscience"},{"key":"2021072913274919100_R10","first-page":"1","article-title":"Testing simulation theory with cross-modal multivariate classification of fMRI data.","volume":"3","author":"Etzel","year":"2008","journal-title":"PLoS"},{"key":"2021072913274919100_R11","doi-asserted-by":"crossref","first-page":"e4844","DOI":"10.1371\/journal.pone.0004844","article-title":"Learning of arbitrary association between visual and auditory stimuli in adults: The \u201cbond effect\u201d of haptic exploration.","volume":"4","author":"Fredembach","year":"2009","journal-title":"PLoS"},{"key":"2021072913274919100_R12","doi-asserted-by":"crossref","first-page":"2047","DOI":"10.1162\/jocn.2009.21280","article-title":"Cortex and memory: Emergence of a new paradigm.","volume":"21","author":"Fuster","year":"2009","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913274919100_R13","first-page":"67","article-title":"The theory of affordances.","volume-title":"Perceiving, acting, and knowing","author":"Gibson","year":"1977"},{"key":"2021072913274919100_R14","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1016\/S0896-6273(04)00270-3","article-title":"Remembrance of odors past: Human olfactory cortex in cross-modal recognition memory.","volume":"42","author":"Gottfried","year":"2004","journal-title":"Neuron"},{"key":"2021072913274919100_R15","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/S0028-3932(01)00089-6","article-title":"Does visual perception of object afford action? Evidence from a neuroimaging study.","volume":"40","author":"Grezes","year":"2002","journal-title":"Neuropsychologia"},{"key":"2021072913274919100_R16","doi-asserted-by":"crossref","first-page":"2735","DOI":"10.1046\/j.1460-9568.2003.02695.x","article-title":"Objects automatically potentiate action: An fMRI study of implicit processing.","volume":"17","author":"Grezes","year":"2003","journal-title":"European Journal of Neuroscience"},{"key":"2021072913274919100_R17","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1016\/S0960-9822(00)80053-6","article-title":"Active manual control of object views facilitates visual recognition.","volume":"9","author":"Harman","year":"1999","journal-title":"Current Biology"},{"key":"2021072913274919100_R18","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1016\/j.neuropsychologia.2005.12.009","article-title":"fMRI correlates of retrieval orientation.","volume":"44","author":"Hornberger","year":"2006","journal-title":"Neuropsychologia"},{"key":"2021072913274919100_R19","doi-asserted-by":"crossref","first-page":"5461","DOI":"10.1073\/pnas.0835746100","article-title":"Modular organization of internal models of tools in the human cerebellum.","volume":"100","author":"Imamizu","year":"2003","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072913274919100_R20","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1080\/02643290802425914","article-title":"The role of sensorimotor learning in the perception of letter-like forms: Tracking the causes of neural specialization for letters.","volume":"26","author":"James","year":"2009","journal-title":"Cognitive Neuropsychology"},{"key":"2021072913274919100_R21","doi-asserted-by":"crossref","first-page":"2937","DOI":"10.1016\/j.neuropsychologia.2006.06.026","article-title":"Letter processing automatically recruits a sensory-motor brain network.","volume":"44","author":"James","year":"2006","journal-title":"Neuropsychologia"},{"key":"2021072913274919100_R22","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1037\/h0087358","article-title":"Manipulating and recognizing virtual objects: Where the action is.","volume":"55","author":"James","year":"2001","journal-title":"Canadian Journal of Experimental Psychology"},{"key":"2021072913274919100_R23","doi-asserted-by":"crossref","first-page":"383","DOI":"10.3758\/BF03195466","article-title":"Learning three-dimensional object structure: A virtual reality study.","volume":"34","author":"James","year":"2002","journal-title":"Behavioral Research Methods, Instruments and Computers"},{"key":"2021072913274919100_R24","doi-asserted-by":"crossref","first-page":"F26","DOI":"10.1111\/j.1467-7687.2009.00919.x","article-title":"Auditory verb perception recruits motor systems in the developing brain: An fMRI investigation.","volume":"12","author":"James","year":"2009","journal-title":"Developmental Science"},{"key":"2021072913274919100_R25","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1111\/j.1467-7687.2009.00883.x","article-title":"Only self-generated actions create sensori-motor systems in the developing brain.","volume":"13","author":"James","year":"2011","journal-title":"Developmental Science"},{"key":"2021072913274919100_R26","doi-asserted-by":"crossref","first-page":"2463","DOI":"10.1093\/brain\/awg248","article-title":"Ventral occipital lesions impair object recognition but not object-directed grasping: A fMRI study.","volume":"126","author":"James","year":"2003","journal-title":"Brain"},{"key":"2021072913274919100_R27","doi-asserted-by":"crossref","first-page":"1792","DOI":"10.1016\/j.cub.2003.09.039","article-title":"Auditory and action semantic features activate sensory-specific perceptual brain regions.","volume":"13","author":"James","year":"2003","journal-title":"Current Biology"},{"key":"2021072913274919100_R28","doi-asserted-by":"crossref","first-page":"4172","DOI":"10.1523\/JNEUROSCI.0624-04.2004","article-title":"Functional-neuroanatomic correlates of recollection: Implications for models of recognition memory.","volume":"24","author":"Kahn","year":"2004","journal-title":"The Journal of Neuroscience"},{"key":"2021072913274919100_R29","doi-asserted-by":"crossref","first-page":"1801","DOI":"10.1016\/j.neuropsychologia.2005.01.020","article-title":"Premotor activations in response to visually presented single letters depend on the hand used to write: A study on left-handers.","volume":"43","author":"Longcamp","year":"2005","journal-title":"Neuropsychologia"},{"key":"2021072913274919100_R30","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.brainres.2006.05.033","article-title":"Reactivation of physical motor information in the memory of action events.","volume":"1101","author":"Masumoto","year":"2006","journal-title":"Brain Research"},{"key":"2021072913274919100_R32","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1016\/j.neuroimage.2005.04.016","article-title":"The brain uses single-trial multisensory memories to discriminate without awareness.","volume":"27","author":"Murray","year":"2005","journal-title":"Neuroimage"},{"key":"2021072913274919100_R33","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/978-1-4419-5615-6_11","article-title":"Single-trial multisensory learning and memory retrieval.","volume-title":"Multisensory object perception in the primate brain","author":"Murray","year":"2010"},{"key":"2021072913274919100_R34","first-page":"1","article-title":"A rapid sound-action association effect in human insular cortex.","volume":"2","author":"Mutschler","year":"2007","journal-title":"PLoS"},{"key":"2021072913274919100_R35","doi-asserted-by":"crossref","first-page":"2199","DOI":"10.1097\/00001756-200007140-00027","article-title":"Activity in motor areas while remembering action events.","volume":"11","author":"Nilsson","year":"2000","journal-title":"NeuroReport"},{"key":"2021072913274919100_R36","doi-asserted-by":"crossref","first-page":"11120","DOI":"10.1073\/pnas.97.20.11120","article-title":"Reactivation of encoding-related brain activity during memory retrieval.","volume":"9","author":"Nyberg","year":"2000","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2021072913274919100_R37","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1006\/nimg.2001.0801","article-title":"Reactivation of motor brain areas during explicit memory for actions.","volume":"14","author":"Nyberg","year":"2001","journal-title":"Neuroimage"},{"key":"2021072913274919100_R38","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1006\/brln.2000.2390","article-title":"Walking or talking: Behavioral and neurophysiological correlates of action verb processing.","volume":"78","author":"Pulvermuller","year":"2001","journal-title":"Brain and Language"},{"key":"2021072913274919100_R39","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/0926-6410(95)00038-0","article-title":"Premotor cortex and the recognition of motor actions.","volume":"3","author":"Rizzolatti","year":"1996","journal-title":"Cognitive Brain Research"},{"key":"2021072913274919100_R40","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1038\/35090060","article-title":"Neurophysiological mechanisms underlying the understanding of imitation of action.","volume":"2","author":"Rizzolatti","year":"2001","journal-title":"Nature Reviews Neuroscience"},{"key":"2021072913274919100_R41","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1068\/p5721","article-title":"Effect of active exploration of 3-D object views on the view-matching process in object recognition.","volume":"39","author":"Sasaoka","year":"2010","journal-title":"Perception"},{"key":"2021072913274919100_R42","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1016\/j.neuroimage.2005.12.062","article-title":"Divide and conquer: A defense of functional localizers.","volume":"30","author":"Saxe","year":"2006","journal-title":"Neuroimage"},{"key":"2021072913274919100_R43","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1162\/089892902317361921","article-title":"Episodic action memory for real objects: An ERP investigation with perform, watch, and imagine action encoding tasks versus a non-action encoding task.","volume":"14","author":"Senkfor","year":"2002","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913274919100_R44","doi-asserted-by":"crossref","first-page":"2874","DOI":"10.1016\/j.neuropsychologia.2006.06.021","article-title":"The nature of memory related activity in early visual areas.","volume":"44","author":"Slotnick","year":"2006","journal-title":"Neuropsychologia"},{"key":"2021072913274919100_R45","doi-asserted-by":"crossref","first-page":"3308","DOI":"10.1016\/j.neuroimage.2009.12.001","article-title":"Neural processing of asynchronous audiovisual speech perception.","volume":"49","author":"Stevenson","year":"2010","journal-title":"Neuroimage"},{"key":"2021072913274919100_R46","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s00221-006-0770-6","article-title":"Superadditive BOLD response in superior temporal sulcus with threshold non-speech objects.","volume":"179","author":"Stevenson","year":"2007","journal-title":"Experimental Brain Research"},{"key":"2021072913274919100_R47","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1016\/j.neuroimage.2008.09.034","article-title":"Neuronal convergence and inverse effectiveness with audiovisual integration of speech and tools in human superior temporal sulcus: Evidence from BOLD fMRI.","volume":"44","author":"Stevenson","year":"2009","journal-title":"Neuroimage"},{"key":"2021072913274919100_R48","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1162\/jocn.2009.21006","article-title":"Cortical activation patterns during long-term memory retrieval of visually or haptically encoded objects and locations.","volume":"21","author":"Stock","year":"2009","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913274919100_R49","volume-title":"A co-planar stereotactic atlas of the human brain: 3-Dimensional proportional system: An approach to cerebral mapping","author":"Talairach","year":"1988"},{"key":"2021072913274919100_R50","doi-asserted-by":"crossref","first-page":"2136","DOI":"10.1016\/S0028-3932(02)00053-2","article-title":"Evidence for cortical encoding specificity in episodic memory: Memory-induced re-activation of picture processing areas.","volume":"40","author":"Vaidya","year":"2002","journal-title":"Neuropsychologia"},{"key":"2021072913274919100_R51","doi-asserted-by":"crossref","first-page":"2216","DOI":"10.1016\/j.neuropsychologia.2007.02.027","article-title":"Dissociation of the neural correlates of recognition memory according to familiarity, recollection, and amount of recollected information.","volume":"45","author":"Vilberg","year":"2007","journal-title":"Neuropsychologia"},{"key":"2021072913274919100_R52","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1016\/j.neuroimage.2007.07.005","article-title":"Prefrontal involvement in imitation learning of hand actions: Effects of practice and expertise.","volume":"37","author":"Vogt","year":"2008","journal-title":"Neuroimage"},{"key":"2021072913274919100_R56","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1093\/cercor\/bhj176","article-title":"A neural system for learning about object function.","volume":"17","author":"Weisberg","year":"2007","journal-title":"Cerebral Cortex"},{"key":"2021072913274919100_R53","doi-asserted-by":"crossref","first-page":"11125","DOI":"10.1073\/pnas.97.20.11125","article-title":"Memory's echo: Vivid remembering reactivates sensory-specific cortex.","volume":"97","author":"Wheeler","year":"2000","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2021072913274919100_R54","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1093\/cercor\/bhj037","article-title":"Evidence for separate perceptual reactivation and search processes during remembering.","volume":"16","author":"Wheeler","year":"2006","journal-title":"Cerebral Cortex"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/25\/2\/203\/1944971\/jocn_a_00284.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/25\/2\/203\/1944971\/jocn_a_00284.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,29]],"date-time":"2021-07-29T14:12:01Z","timestamp":1627567921000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/25\/2\/203\/27885\/Active-Learning-of-Novel-Sound-producing-Objects"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,2,1]]},"references-count":55,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2013,2,1]]},"published-print":{"date-parts":[[2013,2,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00284","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2013,2]]},"published":{"date-parts":[[2013,2,1]]}}}