{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T18:18:33Z","timestamp":1760984313249},"reference-count":55,"publisher":"MIT Press - Journals","issue":"4","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2012,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>We investigated the neural substrates involved in visuo-haptic neuronal convergence using an additive-factors design in combination with fMRI. Stimuli were explored under three sensory modality conditions: viewing the object through a mirror without touching (V), touching the object with eyes closed (H), or simultaneously viewing and touching the object (VH). This modality factor was crossed with a task difficulty factor, which had two levels. On the basis of an idea similar to the principle of inverse effectiveness, we predicted that increasing difficulty would increase the relative level of multisensory gain in brain regions where visual and haptic sensory inputs converged. An ROI analysis focused on the lateral occipital tactile\u2013visual area found evidence of inverse effectiveness in the left lateral occipital tactile\u2013visual area, but not in the right. A whole-brain analysis also found evidence for the same pattern in the anterior aspect of the intraparietal sulcus, the premotor cortex, and the posterior insula, all in the left hemisphere. In conclusion, this study is the first to demonstrate visuo-haptic neuronal convergence based on an inversely effective pattern of brain activation.<\/jats:p>","DOI":"10.1162\/jocn_a_00176","type":"journal-article","created":{"date-parts":[[2011,12,20]],"date-time":"2011-12-20T14:33:11Z","timestamp":1324391591000},"page":"830-842","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":20,"title":["Visuo-haptic Neuronal Convergence Demonstrated with an Inversely Effective Pattern of BOLD Activation"],"prefix":"10.1162","volume":"24","author":[{"given":"Sunah","family":"Kim","sequence":"first","affiliation":[{"name":"1Indiana University"},{"name":"2University of California\u2014Berkeley"}]},{"given":"Ryan A.","family":"Stevenson","sequence":"additional","affiliation":[{"name":"1Indiana University"},{"name":"3Vanderbilt University"}]},{"given":"Thomas W.","family":"James","sequence":"additional","affiliation":[{"name":"1Indiana University"}]}],"member":"281","published-online":{"date-parts":[[2012,4,1]]},"reference":[{"key":"2021072913175977200_R1","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1038\/85201","article-title":"Visuo-haptic object-related activation in the ventral visual pathway.","volume":"4","author":"Amedi","year":"2001","journal-title":"Nature Neuroscience"},{"key":"2021072913175977200_R2","doi-asserted-by":"crossref","first-page":"143","DOI":"10.3233\/RNN-2010-0503","article-title":"Cortical activity during tactile exploration of objects in blind and sighted humans.","volume":"28","author":"Amedi","year":"2010","journal-title":"Restorative Neurology and Neuroscience"},{"key":"2021072913175977200_R3","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1007\/s00221-005-2396-5","article-title":"Functional imaging of human crossmodal identification and object recognition.","volume":"166","author":"Amedi","year":"2005","journal-title":"Experimental Brain Research"},{"key":"2021072913175977200_R4","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/S0028-3932(99)00074-3","article-title":"The functional anatomy of visual-tactile integration in man: A study using positron emission tomography.","volume":"38","author":"Banati","year":"2000","journal-title":"Neuropsychologia"},{"key":"2021072913175977200_R5","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/S0959-4388(00)00191-4","article-title":"Neuroimaging of cognitive functions in human parietal cortex.","volume":"11","author":"Culham","year":"2001","journal-title":"Current Opinion in Neurobiology"},{"key":"2021072913175977200_R6","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1017\/S0140525X07001392","article-title":"Somatosensory processes subserving perception and action.","volume":"30","author":"Dijkerman","year":"2007","journal-title":"Behavioral and Brain Sciences"},{"key":"2021072913175977200_R7","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1080\/13576500342000248","article-title":"Towards an improved measure of the Edinburgh Handedness Inventory: A one-factor congeneric measurement model using confirmatory factor analysis.","volume":"9","author":"Dragovic","year":"2004","journal-title":"Laterality"},{"key":"2021072913175977200_R8","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1126\/science.272.5261.545","article-title":"Cerebellum implicated in sensory acquisition and discrimination rather than motor control.","volume":"272","author":"Gao","year":"1996","journal-title":"Science"},{"key":"2021072913175977200_R9","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1152\/jn.00840.2010","article-title":"Integration of visual and tactile signals from the hand in the human brain: An fMRI study.","volume":"105","author":"Gentile","year":"2011","journal-title":"Journal of Neurophysiology"},{"key":"2021072913175977200_R10","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1167\/5.11.7","article-title":"The combination of vision and touch depends on spatial proximity.","volume":"5","author":"Gepshtein","year":"2005","journal-title":"Journal of Vision"},{"key":"2021072913175977200_R11","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/S0896-6273(02)00741-9","article-title":"Crossmodal processing of object features in human anterior intraparietal cortex: An fMRI study implies equivalencies between humans and monkeys.","volume":"35","author":"Grefkes","year":"2002","journal-title":"Neuron"},{"key":"2021072913175977200_R12","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1523\/JNEUROSCI.18-03-01072.1998","article-title":"Cross-modal transfer of information between the tactile and the visual representations in the human brain: A positron emission tomographic study.","volume":"18","author":"Hadjikhani","year":"1998","journal-title":"Journal of Neuroscience"},{"key":"2021072913175977200_R13","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1068\/p5851","article-title":"Knowledge about a common source can promote visual-haptic integration.","volume":"36","author":"Helbig","year":"2007","journal-title":"Perception"},{"key":"2021072913175977200_R14","doi-asserted-by":"crossref","first-page":"3340","DOI":"10.1016\/j.neuropsychologia.2007.05.025","article-title":"The law of inverse effectiveness in neurons and behaviour: Multisensory integration versus normal variability.","volume":"45","author":"Holmes","year":"2007","journal-title":"Neuropsychologia"},{"key":"2021072913175977200_R15","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1007\/s10548-009-0097-2","article-title":"The principle of inverse effectiveness in multisensory integration: Some statistical considerations.","volume":"21","author":"Holmes","year":"2009","journal-title":"Brain Topography"},{"key":"2021072913175977200_R16","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.neulet.2009.09.010","article-title":"Differential effects of eyes open or closed in darkness on brain activation patterns in blind subjects.","volume":"466","author":"Hufner","year":"2009","journal-title":"Neuroscience Letters"},{"key":"2021072913175977200_R17","doi-asserted-by":"crossref","first-page":"2463","DOI":"10.1093\/brain\/awg248","article-title":"Ventral occipital lesions impair object recognition but not object-directed grasping: An fMRI study.","volume":"126","author":"James","year":"2003","journal-title":"Brain"},{"key":"2021072913175977200_R18","doi-asserted-by":"crossref","first-page":"1706","DOI":"10.1016\/S0028-3932(02)00017-9","article-title":"Haptic study of three-dimensional objects activates extrastriate visual areas.","volume":"40","author":"James","year":"2002","journal-title":"Neuropsychologia"},{"key":"2021072913175977200_R19","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1007\/978-1-4419-5615-6_13","article-title":"Dorsal and ventral cortical pathways for visuo-haptic integration revealed using fMRI.","volume-title":"Multisensory object perception in the primate brain","author":"James","year":"2010"},{"key":"2021072913175977200_R20","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1037\/cjep2007023","article-title":"The neural basis of haptic object processing.","volume":"61","author":"James","year":"2007","journal-title":"Canadian Journal of Experimental Psychology"},{"key":"2021072913175977200_R21","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.neulet.2005.12.052","article-title":"The influence of familiarity on brain activation during haptic exploration of 3-D facemasks.","volume":"397","author":"James","year":"2006","journal-title":"Neuroscience Letters"},{"key":"2021072913175977200_R22","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1201\/9781439812174-11","article-title":"The use of fMRI to assess multisensory integration.","volume-title":"Frontiers in the neural bases of multisensory processes","author":"James","year":"2011"},{"key":"2021072913175977200_R23","article-title":"Inverse effectiveness in multisensory processing.","volume-title":"The new handbook of multisensory processes.","author":"James","year":""},{"key":"2021072913175977200_R24","doi-asserted-by":"crossref","first-page":"364","DOI":"10.3758\/CABN.4.3.364","article-title":"Cortical regions associated with different aspects of object recognition performance.","volume":"4","author":"Joseph","year":"2004","journal-title":"Cognitive, Affective & Behavioral Neuroscience"},{"key":"2021072913175977200_R25","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.neuron.2005.09.018","article-title":"Integration of touch and sound in auditory cortex.","volume":"48","author":"Kayser","year":"2005","journal-title":"Neuron"},{"key":"2021072913175977200_R26","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.bandc.2005.07.004","article-title":"Haptic face identification activates ventral occipital and temporal areas: An fMRI study.","volume":"59","author":"Kilgour","year":"2005","journal-title":"Brain and Cognition"},{"key":"2021072913175977200_R27","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1002\/hbm.20897","article-title":"Enhanced effectiveness in visuo-haptic object-selective brain regions with increasing stimulus salience.","volume":"31","author":"Kim","year":"2010","journal-title":"Human Brain Mapping"},{"key":"2021072913175977200_R54","first-page":"143","article-title":"Hierarchical neural pathways of haptic object processing.","volume-title":"The handbook of touch","author":"Kim","year":"2011"},{"key":"2021072913175977200_R28","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1007\/BF00236934","article-title":"Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus.","volume":"60","author":"King","year":"1985","journal-title":"Experimental Brain Research"},{"key":"2021072913175977200_R29","doi-asserted-by":"crossref","first-page":"1818","DOI":"10.1016\/j.neuroimage.2003.12.026","article-title":"Eyes open and eyes closed as rest conditions: Impact on brain activation patterns.","volume":"21","author":"Marx","year":"2004","journal-title":"Neuroimage"},{"key":"2021072913175977200_R30","doi-asserted-by":"crossref","first-page":"924","DOI":"10.1016\/S1053-8119(03)00150-2","article-title":"Eye closure in darkness animates sensory systems.","volume":"19","author":"Marx","year":"2003","journal-title":"Neuroimage"},{"key":"2021072913175977200_R31","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.1523\/JNEUROSCI.07-10-03215.1987","article-title":"Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors.","volume":"7","author":"Meredith","year":"1987","journal-title":"Journal of Neuroscience"},{"key":"2021072913175977200_R32","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1126\/science.6867718","article-title":"Interactions among converging sensory inputs in the superior colliculus.","volume":"221","author":"Meredith","year":"1983","journal-title":"Science"},{"key":"2021072913175977200_R33","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1016\/0006-8993(86)91648-3","article-title":"Spatial factors determine the activity of multisensory neurons in cat superior colliculus.","volume":"365","author":"Meredith","year":"1986","journal-title":"Brain Research"},{"key":"2021072913175977200_R34","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1152\/jn.1986.56.3.640","article-title":"Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration.","volume":"56","author":"Meredith","year":"1986","journal-title":"Journal of Neurophysiology"},{"key":"2021072913175977200_R35","doi-asserted-by":"crossref","first-page":"5884","DOI":"10.1523\/JNEUROSCI.0896-05.2005","article-title":"Perceptual fusion and stimulus coincidence in the cross-modal integration of speech.","volume":"25","author":"Miller","year":"2005","journal-title":"The Journal of Neuroscience: The Official Journal of the Society for Neuroscience"},{"key":"2021072913175977200_R36","doi-asserted-by":"crossref","first-page":"1730","DOI":"10.1111\/j.1460-9568.2010.07208.x","article-title":"Visuohaptic convergence in a corticocerebellar network.","volume":"31","author":"Naumer","year":"2010","journal-title":"European Journal of Neuroscience"},{"key":"2021072913175977200_R37","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/0028-3932(71)90067-4","article-title":"The assessment and analysis of handedness: The Edinburgh inventory.","volume":"9","author":"Oldfield","year":"1971","journal-title":"Neuropsychologia"},{"key":"2021072913175977200_R38","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.neuropsychologia.2006.03.003","article-title":"Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception.","volume":"45","author":"Peltier","year":"2007","journal-title":"Neuropsychologia"},{"key":"2021072913175977200_R39","doi-asserted-by":"crossref","first-page":"2575","DOI":"10.1152\/jn.00926.2004","article-title":"Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli.","volume":"93","author":"Perrault","year":"2005","journal-title":"Journal of Neurophysiology"},{"key":"2021072913175977200_R40","doi-asserted-by":"crossref","first-page":"5658","DOI":"10.1073\/pnas.0400707101","article-title":"Beyond sensory images: Object-based representation in the human ventral pathway.","volume":"101","author":"Pietrini","year":"2004","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072913175977200_R41","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1016\/j.neuropsychologia.2003.12.013","article-title":"Task-specific recruitment of dorsal and ventral visual areas during tactile perception.","volume":"42","author":"Prather","year":"2004","journal-title":"Neuropsychologia"},{"key":"2021072913175977200_R42","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1016\/j.neuroimage.2004.11.044","article-title":"What vs. where in touch: An fMRI study.","volume":"25","author":"Reed","year":"2005","journal-title":"Neuroimage"},{"key":"2021072913175977200_R43","first-page":"421","article-title":"Memory-scanning: Mental processes revealed by reaction-time experiments.","volume":"57","author":"Sternberg","year":"1969","journal-title":"American Science"},{"key":"2021072913175977200_R44","doi-asserted-by":"crossref","first-page":"3308","DOI":"10.1016\/j.neuroimage.2009.12.001","article-title":"Neural processing of asynchronous audiovisual speech perception.","volume":"49","author":"Stevenson","year":"2010","journal-title":"Neuroimage"},{"key":"2021072913175977200_R45","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1016\/j.neuroimage.2008.09.034","article-title":"Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition.","volume":"44","author":"Stevenson","year":"2009","journal-title":"Neuroimage"},{"key":"2021072913175977200_R46","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/s00221-009-1783-8","article-title":"An additive-factors design to disambiguate neuronal and areal convergence: Measuring multisensory interactions between audio, visual, and haptic sensory streams using fMRI.","volume":"198","author":"Stevenson","year":"2009","journal-title":"Experimental Brain Research"},{"key":"2021072913175977200_R47","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1016\/j.neuroimage.2010.12.063","article-title":"Discrete neural substrates underlie complementary audiovisual speech integration processes.","volume":"55","author":"Stevenson","year":"2011","journal-title":"Neuroimage"},{"key":"2021072913175977200_R48","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1002\/hbm.20456","article-title":"Selective visuo-haptic processing of shape and texture.","volume":"29","author":"Stilla","year":"2008","journal-title":"Human Brain Mapping"},{"key":"2021072913175977200_R49","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/S0167-8760(03)00123-5","article-title":"Neural networks active during tactile form perception: Common and differential activity during macrospatial and microspatial tasks.","volume":"50","author":"Stoesz","year":"2003","journal-title":"International Journal of Psychophysiology"},{"key":"2021072913175977200_R50","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1146\/annurev.neuro.31.060407.125606","article-title":"Cerebellum and nonmotor function.","volume":"32","author":"Strick","year":"2009","journal-title":"Annual Review of Neuroscience"},{"key":"2021072913175977200_R51","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s00221-009-1949-4","article-title":"Multisensory visual-tactile object related network in humans: Insights gained using a novel crossmodal adaptation approach.","volume":"198","author":"Tal","year":"2009","journal-title":"Experimental Brain Research"},{"key":"2021072913175977200_R55","volume-title":"Co-planar sterotaxic atlas of the human brain.","author":"Talairach","year":"1988"},{"key":"2021072913175977200_R52","doi-asserted-by":"crossref","first-page":"1829","DOI":"10.1093\/cercor\/bhp248","article-title":"Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization.","volume":"20","author":"Werner","year":"2009","journal-title":"Cerebral Cortex"},{"key":"2021072913175977200_R53","doi-asserted-by":"crossref","first-page":"251","DOI":"10.3758\/CABN.4.2.251","article-title":"Multisensory cortical processing of object shape and its relation to mental imagery.","volume":"4","author":"Zhang","year":"2004","journal-title":"Cognitive, Affective & Behavioral Neuroscience"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/24\/4\/830\/1943288\/jocn_a_00176.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/24\/4\/830\/1943288\/jocn_a_00176.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,29]],"date-time":"2021-07-29T13:24:33Z","timestamp":1627565073000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/24\/4\/830\/27748\/Visuo-haptic-Neuronal-Convergence-Demonstrated"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,4,1]]},"references-count":55,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2012,4,1]]},"published-print":{"date-parts":[[2012,4,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00176","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2012,4]]},"published":{"date-parts":[[2012,4,1]]}}}