{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T13:19:46Z","timestamp":1762521586868,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2013,5,31]],"date-time":"2013-05-31T00:00:00Z","timestamp":1369958400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Information obtained from multiple sensory modalities, such as vision and touch, is integrated to yield a holistic percept. As a haptic approach usually involves  cross-modal sensory experiences, it is necessary to develop an apparatus that can characterize how a biological system integrates visual-tactile sensory information as well as how a robotic device infers object information emanating from both vision and touch. In the present study, we develop a novel visual-tactile cross-modal integration stimulator that consists of an LED panel to present visual stimuli and a tactile stimulator with three degrees of freedom that can present tactile motion stimuli with arbitrary motion direction, speed, and indentation depth in the skin. The apparatus can present cross-modal stimuli in which the spatial locations of visual and tactile stimulations are perfectly aligned. We presented visual-tactile stimuli in which the visual and tactile directions were either congruent or incongruent, and human observers reported the perceived visual direction of motion. Results showed that perceived direction of visual motion can be biased by the direction of tactile motion when visual signals are weakened. The results also showed that the visual-tactile motion integration follows the rule of temporal congruency of  multi-modal inputs, a fundamental property known for cross-modal integration.<\/jats:p>","DOI":"10.3390\/s130607212","type":"journal-article","created":{"date-parts":[[2013,5,31]],"date-time":"2013-05-31T11:20:36Z","timestamp":1369999236000},"page":"7212-7223","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Cross-Modal Sensory Integration of Visual-Tactile Motion Information: Instrument Design and Human Psychophysics"],"prefix":"10.3390","volume":"13","author":[{"given":"Yu-Cheng","family":"Pei","sequence":"first","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, No. 5, Fushing St, Taoyuan 333, Taiwan"},{"name":"Healthy Aging Research Center, Chang Gung University, No. 259, Wen-Hwa 1st Road,  Taoyuan 333, Taiwan"},{"name":"School of Medicine, Chang Gung University, No. 259, Wen-Hwa 1st Road, Taoyuan 333, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting-Yu","family":"Chang","sequence":"additional","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, No. 5, Fushing St, Taoyuan 333, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tsung-Chi","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, No. 5, Fushing St, Taoyuan 333, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sudipta","family":"Saha","sequence":"additional","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, No. 5, Fushing St, Taoyuan 333, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hsin-Yi","family":"Lai","sequence":"additional","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, No. 5, Fushing St, Taoyuan 333, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manuel","family":"Gomez-Ramirez","sequence":"additional","affiliation":[{"name":"The Zanvyl Krieger Mind\/Brain Institute, Johns Hopkins University, 3400 N. Charles Street 338 Krieger Hall, Baltimore, MD 21218, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shih-Wei","family":"Chou","sequence":"additional","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, No. 5, Fushing St, Taoyuan 333, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alice","family":"Wong","sequence":"additional","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, Chang Gung Memorial Hospital at Linkou, No. 5, Fushing St, Taoyuan 333, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2013,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1038\/nrn2331","article-title":"Multisensory integration: current issues from the perspective of the single neuron","volume":"9","author":"Stein","year":"2008","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.conb.2005.03.011","article-title":"See me, hear me, touch me: Multisensory integration in lateral occipital-temporal cortex","volume":"15","author":"Beauchamp","year":"2005","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.tics.2004.02.002","article-title":"Merging the senses into a robust percept","volume":"8","author":"Ernst","year":"2004","journal-title":"Trends Cogn. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1038\/264746a0","article-title":"Hearing lips and seeing voices","volume":"264","author":"McGurk","year":"1976","journal-title":"Nature"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1038\/385308a0","article-title":"Sound alters visual motion perception","volume":"385","author":"Sekuler","year":"1997","journal-title":"Nature"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/s00221-002-1164-z","article-title":"Audiotactile interactions in roughness perception","volume":"146","author":"Guest","year":"2002","journal-title":"Exp. Brain Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1038\/71140","article-title":"Touch can change visual slant perception","volume":"3","author":"Ernst","year":"2000","journal-title":"Nat. Neurosci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"148","DOI":"10.3758\/CABN.4.2.148","article-title":"Spatial constraints on visual-tactile cross-modal distractor congruency effects","volume":"4","author":"Spence","year":"2004","journal-title":"Cogn. Affect Behav. Neurosci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.3758\/BF03194758","article-title":"Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture","volume":"64","author":"Kennett","year":"2002","journal-title":"Per. Psychophys."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1016\/0006-8993(79)90404-9","article-title":"Distribution of visual and somatic functions in the parietal associative area 7 of the monkey","volume":"169","author":"Shelepin","year":"1979","journal-title":"Brain Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/0006-8993(81)90533-3","article-title":"Regional distribution of functions in parietal association area 7 of the monkey","volume":"206","year":"1981","journal-title":"Brain Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1038\/nn1480","article-title":"Reference frames for representing visual and tactile locations in parietal cortex","volume":"8","author":"Avillac","year":"2005","journal-title":"Nat. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1016\/j.cub.2008.06.027","article-title":"Tactile rivalry demonstrated with an ambiguous apparent-motion quartet","volume":"18","author":"Carter","year":"2008","journal-title":"Curr. Biol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1016\/j.cub.2009.03.035","article-title":"Motion aftereffects transfer between touch and vision","volume":"19","author":"Konkle","year":"2009","journal-title":"Curr. Biol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1625","DOI":"10.1152\/jn.00192.2006","article-title":"Influence of visual motion on tactile motion perception","volume":"96","author":"Bensmaia","year":"2006","journal-title":"J. Neurophysiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1111\/j.0956-7976.2004.00691.x","article-title":"Neural synergy between kinetic vision and touch","volume":"15","author":"Blake","year":"2004","journal-title":"Psychol. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.neulet.2005.09.001","article-title":"Temporal aspects of the visuotactile congruency effect","volume":"392","author":"Shore","year":"2006","journal-title":"Neurosci. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"8130","DOI":"10.1073\/pnas.0800028105","article-title":"The tactile integration of local motion cues is analogous to its visual counterpart","volume":"105","author":"Pei","year":"2008","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.neuron.2010.12.033","article-title":"Neural mechanisms of tactile motion integration in somatosensory cortex","volume":"69","author":"Pei","year":"2011","journal-title":"Neuron"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.jneumeth.2006.10.012","article-title":"A dense array stimulator to generate arbitrary spatio-temporal tactile stimuli","volume":"161","author":"Killebrew","year":"2007","journal-title":"J. Neurosci. Meth."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Gori, M., Mazzilli, G., Sandini, G., and Burr, D. (2011). Cross-sensory facilitation reveals neural interactions between visual and tactile motion in humans. Front Psychol.","DOI":"10.3389\/fpsyg.2011.00055"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/0165-0270(88)90043-X","article-title":"A rotating drum stimulator for scanning embossed patterns and textures across the skin","volume":"22","author":"Johnson","year":"1988","journal-title":"J. Neurosci. Meth."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/0165-0173(85)90025-6","article-title":"Factors influencing cutaneous directional sensitivity: A correlative psychophysical and neurophysiological investigation","volume":"357","author":"Essick","year":"1985","journal-title":"Brain Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3215","DOI":"10.1523\/JNEUROSCI.07-10-03215.1987","article-title":"Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors","volume":"7","author":"Meredith","year":"1987","journal-title":"J. Neurosci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"R762","DOI":"10.1016\/j.cub.2005.08.058","article-title":"Multisensory integration: Space, time and superadditivity","volume":"15","author":"Holmes","year":"2005","journal-title":"Curr. Biol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/415429a","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"Ernst","year":"2002","journal-title":"Nature"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1126\/science.6867718","article-title":"Interactions among converging sensory inputs in the superior colliculus","volume":"221","author":"Meredith","year":"1983","journal-title":"Science"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1016\/0006-8993(86)91648-3","article-title":"Spatial factors determine the activity of multisensory neurons in cat superior colliculus","volume":"365","author":"Meredith","year":"1986","journal-title":"Brain Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1016\/j.neuron.2008.06.024","article-title":"Multisensory integration in macaque visual cortex depends on cue reliability","volume":"59","author":"Morgan","year":"2008","journal-title":"Neuron"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1038\/nn.2983","article-title":"Neural correlates of reliability-based cue weighting during multisensory integration","volume":"15","author":"Fetsch","year":"2012","journal-title":"Nat. Neurosci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"967","DOI":"10.1167\/4.12.1","article-title":"Slant from texture and disparity cues: Optimal cue combination","volume":"4","author":"Hillis","year":"2004","journal-title":"J. Vis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3621","DOI":"10.1016\/S0042-6989(99)00088-7","article-title":"Optimal integration of texture and motion cues to depth","volume":"39","author":"Jacobs","year":"1999","journal-title":"Vis. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.cub.2004.01.029","article-title":"The ventriloquist effect results from near-optimal bimodal integration","volume":"14","author":"Alais","year":"2004","journal-title":"Curr. Biol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00221-010-2420-2","article-title":"Remapping motion across modalities: Tactile rotations influence visual motion judgments","volume":"207","author":"Butz","year":"2010","journal-title":"Exp. Brain Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1046\/j.1460-9568.2002.02139.x","article-title":"Tactile motion activates the human middle temporal\/V5 (MT\/V5) complex","volume":"16","author":"Hagen","year":"2002","journal-title":"Eur. J. Neurosci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"8261","DOI":"10.1523\/JNEUROSCI.0754-07.2007","article-title":"Human MST but not MT responds to tactile stimulation","volume":"27","author":"Beauchamp","year":"2007","journal-title":"J. Neurosci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1016\/j.tics.2003.08.014","article-title":"Multisensory integration, perception and ecological validity","volume":"7","author":"Bertelson","year":"2003","journal-title":"Trends Cogn. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/6\/7212\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:47:07Z","timestamp":1760219227000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/13\/6\/7212"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,5,31]]},"references-count":37,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2013,6]]}},"alternative-id":["s130607212"],"URL":"https:\/\/doi.org\/10.3390\/s130607212","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2013,5,31]]}}}