{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,8]],"date-time":"2026-11-08T07:26:14Z","timestamp":1794122774572,"version":"4.8.0"},"reference-count":32,"publisher":"IOP Publishing","issue":"5","license":[{"start":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T00:00:00Z","timestamp":1730160000000},"content-version":"vor","delay-in-days":28,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T00:00:00Z","timestamp":1730160000000},"content-version":"tdm","delay-in-days":28,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"European Union [Europaeischer Fonds fuer regionale Entwicklung (EFRE)]","award":["Multi-Immerse"],"award-info":[{"award-number":["Multi-Immerse"]}]},{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"crossref","award":["13FH050KX1"],"award-info":[{"award-number":["13FH050KX1"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["J. Neural Eng."],"published-print":{"date-parts":[[2024,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    <jats:italic>Objective.<\/jats:italic>\n                    To create highly immersive experiences in virtual reality (VR) it is important to not only include the visual sense but also to involve multimodal sensory input. To achieve optimal results, the temporal and spatial synchronization of these multimodal inputs is critical. It is therefore necessary to find methods to objectively evaluate the synchronization of VR experiences with a continuous tracking of the user.\n                    <jats:italic>Approach.<\/jats:italic>\n                    In this study a passive touch experience was incorporated in a visual-tactile VR setup using VR glasses and tactile sensations in mid-air. Inconsistencies of multimodal perception were intentionally integrated into a discrimination task. The participants\u2019 electroencephalogram (EEG) was recorded to obtain neural correlates of visual-tactile mismatch situations.\n                    <jats:italic>Main results.<\/jats:italic>\n                    The results showed significant differences in the event-related potentials (ERP) between match and mismatch situations. A biphasic ERP configuration consisting of a positivity at 120 ms and a later negativity at 370 ms was observed following a visual-tactile mismatch.\n                    <jats:italic>Significance.<\/jats:italic>\n                    This late negativity could be related to the N400 that is associated with semantic incongruency. These results provide a promising approach towards the objective evaluation of visual-tactile synchronization in virtual experiences.\n                  <\/jats:p>","DOI":"10.1088\/1741-2552\/ad83f5","type":"journal-article","created":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T18:52:16Z","timestamp":1728327136000},"page":"056042","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Feeling senseless sensations: a crossmodal EEG study of mismatched tactile and visual experiences in virtual reality"],"prefix":"10.1088","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-2493-2036","authenticated-orcid":true,"given":"Caroline","family":"Lehser","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven A","family":"Hillyard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel J","family":"Strauss","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2024,10,29]]},"reference":[{"key":"jnead83f5bib1","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainresbull.2024.110923","article-title":"The role of attention in immersion: the two\u2013competitor model","volume":"210","author":"Strauss","year":"2024","journal-title":"Brain Res. Bull."},{"key":"jnead83f5bib2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3508361","article-title":"Multimodality in VR: a survey","volume":"54","author":"Martin","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"jnead83f5bib3","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1109\/TIE.2019.2920602","article-title":"Multimodal haptic display for virtual reality: a survey","volume":"67","author":"Wang","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"jnead83f5bib4","first-page":"pp 505","article-title":"Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces","author":"Carter","year":"2013"},{"key":"jnead83f5bib5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2661229.2661257","article-title":"Rendering volumetric haptic shapes in mid-air using ultrasound","volume":"33","author":"Long","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"jnead83f5bib6","doi-asserted-by":"publisher","first-page":"2070","DOI":"10.1109\/TNSRE.2018.2869992","article-title":"Somatosensory evoked responses elicited by haptic sensations in midair","volume":"26","author":"Lehser","year":"2018","journal-title":"IEEE Trans. Neural Syst. Rehab. Eng."},{"key":"jnead83f5bib7","first-page":"pp 1","article-title":"I\u2019m sensing in the rain: spatial incongruity in visual-tactile mid-air stimulation can elicit ownership in VR users","author":"Pittera","year":"2019"},{"key":"jnead83f5bib8","first-page":"pp 297","article-title":"Can stiffness sensations be rendered in virtual reality using mid-air ultrasound haptic technologies?","author":"Marchal","year":"2020"},{"key":"jnead83f5bib9","doi-asserted-by":"publisher","first-page":"756","DOI":"10.1038\/35784","article-title":"Rubber hands feel touch that eyes see","volume":"391","author":"Botvinick","year":"1998","journal-title":"Nature"},{"key":"jnead83f5bib10","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2023.1138406","article-title":"The instant effect of embodiment via mirror visual feedback on electroencephalogram-based brain connectivity changes: a pilot study","volume":"17","author":"Ding","year":"2023","journal-title":"Front. Neurosci."},{"key":"jnead83f5bib11","doi-asserted-by":"publisher","first-page":"181","DOI":"10.3389\/neuro.09.006.2008","article-title":"Towards a digital body: the virtual arm illusion","volume":"2","author":"Slater","year":"2008","journal-title":"Front. Hum. Neurosci."},{"key":"jnead83f5bib12","doi-asserted-by":"publisher","first-page":"676","DOI":"10.3389\/neuro.01.029.2009","article-title":"Inducing illusory ownership of a virtual body","volume":"3","author":"Slater","year":"2009","journal-title":"Front. Neurosci."},{"key":"jnead83f5bib13","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ac69bc","article-title":"Neural sources of prediction errors detect unrealistic VR interactions","volume":"19","author":"Gehrke","year":"2022","journal-title":"J. Neural Eng."},{"key":"jnead83f5bib14","doi-asserted-by":"publisher","first-page":"24617","DOI":"10.1109\/ACCESS.2018.2832089","article-title":"Visual appearance modulates prediction error in virtual reality","volume":"6","author":"Singh","year":"2018","journal-title":"IEEE Access"},{"key":"jnead83f5bib15","doi-asserted-by":"publisher","first-page":"1436","DOI":"10.1038\/s41598-020-80807-y","article-title":"Virtual reality alters cortical oscillations related to visuo-tactile integration during rubber hand illusion","volume":"11","author":"Kanayama","year":"2021","journal-title":"Sci. Rep."},{"key":"jnead83f5bib16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0282967","article-title":"EEG signature of breaks in embodiment in VR","volume":"18","author":"Porssut","year":"2023","journal-title":"PLoS One"},{"key":"jnead83f5bib17","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/0304-3940(89)90513-2","article-title":"Do event-related potentials reveal the mechanism of the auditory sensory memory in the human brain?","volume":"98","author":"N\u00e4\u00e4t\u00e4nen","year":"1989","journal-title":"Neurosci. Lett."},{"key":"jnead83f5bib18","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1080\/14992020802340116","article-title":"Mismatch negativity (MMN) as an index of central auditory system plasticity","volume":"47","author":"N\u00e4\u00e4t\u00e4nen","year":"2008","journal-title":"Int. J. Audiol."},{"key":"jnead83f5bib19","doi-asserted-by":"publisher","first-page":"3363","DOI":"10.1097\/00001756-199911080-00020","article-title":"Mismatch negativity in the visual modality","volume":"10","author":"Tales","year":"1999","journal-title":"Neuroreport"},{"key":"jnead83f5bib20","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1016\/S0301-0511(97)05249-6","article-title":"Rate effect and mismatch responses in the somatosensory system: ERP-recordings in humans","volume":"46","author":"Kekoni","year":"1997","journal-title":"Biol. Psychol."},{"key":"jnead83f5bib21","doi-asserted-by":"publisher","first-page":"1930","DOI":"10.1016\/j.clinph.2005.04.021","article-title":"Mismatch responses related to temporal discrimination of somatosensory stimulation","volume":"116","author":"Akatsuka","year":"2005","journal-title":"Clin. Neurophysiol."},{"key":"jnead83f5bib22","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/S0926-6410(98)00020-2","article-title":"Somatosensory automatic responses to deviant stimuli","volume":"7","author":"Shinozaki","year":"1998","journal-title":"Cogn. Brain Res."},{"key":"jnead83f5bib23","doi-asserted-by":"publisher","first-page":"293","DOI":"10.3389\/fnagi.2014.00293","article-title":"Somatosensory mismatch response in young and elderly adults","volume":"6","author":"Str\u00f6mmer","year":"2014","journal-title":"Front. Aging Neurosci."},{"key":"jnead83f5bib24","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/0301-0511(80)90046-0","article-title":"Event-related brain potentials to semantically inappropriate and surprisingly large words","volume":"11","author":"Kutas","year":"1980","journal-title":"Biol. Psychol."},{"key":"jnead83f5bib25","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1146\/annurev.psych.093008.131123","article-title":"Thirty years and counting: finding meaning in the n400 component of the event-related brain potential (ERP)","volume":"62","author":"Kutas","year":"2011","journal-title":"Annu. Rev. Psychol."},{"key":"jnead83f5bib26","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/S0926-6410(02)00244-6","article-title":"An electrophysiological study of scene effects on object identification","volume":"16","author":"Ganis","year":"2003","journal-title":"Cogn. Brain Res."},{"key":"jnead83f5bib27","doi-asserted-by":"publisher","first-page":"1271","DOI":"10.1016\/j.neuropsychologia.2012.02.011","article-title":"ERP correlates of spatially incongruent object identification during scene viewing: contextual expectancy versus simultaneous processing","volume":"50","author":"Demiral","year":"2012","journal-title":"Neuropsychologia"},{"key":"jnead83f5bib28","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","article-title":"EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis","volume":"134","author":"Delorme","year":"2004","journal-title":"J. Neurosci. Methods"},{"key":"jnead83f5bib29","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. B"},{"key":"jnead83f5bib30","doi-asserted-by":"publisher","first-page":"576","DOI":"10.1109\/TNSRE.2012.2220568","article-title":"Exploiting the self-similarity in ERP images by nonlocal means for single-trial denoising","volume":"21","author":"Strauss","year":"2012","journal-title":"IEEE Trans. Neural Syst. Rehab. Eng."},{"key":"jnead83f5bib31","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/0013-4694(90)90148-D","article-title":"Human somatosensory evoked potentials to mechanical pulses and vibration: contributions of SI and SII somatosensory cortices to P50 and P100 components","volume":"75","author":"H\u00e4m\u00e4l\u00e4inen","year":"1990","journal-title":"Electroencephalogr. Clin. Neurophysiol."},{"key":"jnead83f5bib32","doi-asserted-by":"publisher","first-page":"1711","DOI":"10.1016\/S1388-2457(00)00383-7","article-title":"Relationships between attention effects and intensity effects on the cognitive N140 and P300 components of somatosensory ERPs","volume":"111","author":"Nakajima","year":"2000","journal-title":"Clin. Neurophysiol."}],"container-title":["Journal of Neural Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T03:23:36Z","timestamp":1730172216000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1741-2552\/ad83f5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,1]]},"references-count":32,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,10,29]]},"published-print":{"date-parts":[[2024,10,1]]}},"URL":"https:\/\/doi.org\/10.1088\/1741-2552\/ad83f5","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.04.30.591838","asserted-by":"object"}]},"ISSN":["1741-2560","1741-2552"],"issn-type":[{"value":"1741-2560","type":"print"},{"value":"1741-2552","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,1]]},"assertion":[{"value":"Feeling senseless sensations: a crossmodal EEG study of mismatched tactile and visual experiences in virtual reality","name":"article_title","label":"Article Title"},{"value":"Journal of Neural Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2024-05-30","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-10-07","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-10-29","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}