{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T03:57:20Z","timestamp":1790913440215,"version":"4.1.0"},"reference-count":24,"publisher":"Walter de Gruyter GmbH","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Multisens. Res."],"published-print":{"date-parts":[[2026,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In this viewpoint, Christoph Kayser, Uta Noppeney, and Tim Rohe highlight the central role of normative Bayesian frameworks, in particular Bayesian causal inference, for explaining how the brain decides whether sensory signals should be integrated or segregated and how they are weighted by their reliabilities. In parallel, the Multisensory Correlation Detector model is emphasized as a mechanistic proposal for how the brain computes spatial and temporal relations across sensory channels. Together, these developments have shifted the field from merely locating multisensory processing in the brain to characterizing the specific computations implemented across cortical hierarchies. The authors outline current trends, such as model-based analyses of neuroimaging and neurophysiological data, increasing use of artificial neural networks to study multisensory processing at larger scales, and emerging work in naturalistic, real-world settings. They discuss ongoing controversies surrounding the influence of attention and tasks on multisensory integration, the limits of Bayes optimality, and the role of neural oscillations, especially alpha rhythms, in shaping multisensory binding. They further advocate for stronger open-science practices and systematic replication of influential findings to consolidate the empirical and theoretical foundations of the field. Finally, they encourage early-career scientists to develop strong methodological skills, cultivate their own conceptual \u2018angle\u2019, and actively engage with the multisensory community.<\/jats:p>","DOI":"10.1163\/22134808-bja10211","type":"journal-article","created":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T03:21:34Z","timestamp":1790911294000},"page":"1-10","source":"Crossref","is-referenced-by-count":0,"title":["Viewpoint on Hierarchical Organization of Multisensory Integration and Segregation"],"prefix":"10.1163","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7362-5704","authenticated-orcid":true,"given":"Christoph","family":"Kayser","sequence":"first","affiliation":[{"name":"Department for Cognitive Neuroscience, Faculty of Biology, https:\/\/dx.doi.org\/9167Bielefeld University, Bielefeld, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7697-2290","authenticated-orcid":true,"given":"Uta","family":"Noppeney","sequence":"additional","affiliation":[{"name":"Donders Institute for Brain, Cognition and Behaviour, https:\/\/dx.doi.org\/6029Radboud University, Nijmegen, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9713-3712","authenticated-orcid":true,"given":"Tim","family":"Rohe","sequence":"additional","affiliation":[{"name":"Institute of Psychology, https:\/\/dx.doi.org\/9171Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg, Erlangen, Germany"},{"name":"Department of Sensory Analytics and Technologies, Fraunhofer Institute for Process Engineering and Packaging IVV, Freising, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","reference":[{"key":"R000001","series-title":"Nature Human Behav.","first-page":"732","article-title":"The role of alpha oscillations in temporal binding within and across the senses","volume":"6","author":"Buergers, S.","unstructured":"Buergers, S. and Noppeney, U. (2022). The role of alpha oscillations in temporal binding within and across the senses, Nature Human Behav. 6, 732\u2013742."},{"key":"R000002","series-title":"Curr. Biol.","first-page":"649","article-title":"Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex","volume":"10","author":"Calvert, G.\u00a0A.","unstructured":"Calvert, G.\u00a0A., Campbell, R. and Brammer, M.\u00a0J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex, Curr. Biol. 10, 649\u2013657."},{"key":"R000003","series-title":"Neuron","first-page":"1076","article-title":"Causal inference in the multisensory brain","volume":"102","author":"Cao, Y.","unstructured":"Cao, Y., Summerfield, C., Park, H., Giordano, B.\u00a0L. and Kayser, C. (2019). Causal inference in the multisensory brain, Neuron 102, 1076\u20131087."},{"key":"R000004","series-title":"J.\u00a0Exp. Soc. Psychol.","first-page":"93","article-title":"On the scientific superiority of conceptual replications for scientific progress","volume":"66","author":"Crandall, C.\u00a0S.","unstructured":"Crandall, C.\u00a0S. and Sherman, J.\u00a0W. (2016). On the scientific superiority of conceptual replications for scientific progress, J.\u00a0Exp. Soc. Psychol. 66, 93\u201399."},{"key":"R000005","series-title":"Nature","first-page":"429","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"Ernst, M.\u00a0O.","unstructured":"Ernst, M.\u00a0O. and Banks, M.\u00a0S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion, Nature 415, 429\u2013433."},{"key":"R000006","series-title":"Eur. J. Neurosci.","first-page":"1770","article-title":"Both stimulus-specific and configurational features of multiple visual stimuli shape the spatial ventriloquism effect","volume":"59","author":"Kayser, C.","unstructured":"Kayser, C., Debats, N. and Heuer, H. (2024). Both stimulus-specific and configurational features of multiple visual stimuli shape the spatial ventriloquism effect, Eur. J. Neurosci. 59, 1770\u20131788."},{"key":"R000007","series-title":"PLoS ONE","first-page":"e943","article-title":"Causal inference in multisensory perception","volume":"2","author":"K\u00f6rding, K.\u00a0P.","unstructured":"K\u00f6rding, K.\u00a0P., Beierholm, U., Ma, W.\u00a0J., Quartz, S., Tenenbaum, J.\u00a0B. and Shams, L. (2007). Causal inference in multisensory perception, PLoS ONE 2, e943."},{"key":"R000008","series-title":"ACM Computing Surveys","first-page":"1","article-title":"Foundations and trends in multimodal machine learning: Principles, challenges and open questions","volume":"56","author":"Liang, P.\u00a0P.","unstructured":"Liang, P.\u00a0P., Zadeh, A. and Morency, L.-P. (2024). Foundations and trends in multimodal machine learning: Principles, challenges and open questions, ACM Computing Surveys 56, 1\u201342."},{"key":"R000009","series-title":"Behav. Brain Sci.","first-page":"e1","article-title":"Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources","volume":"43","author":"Lieder, F.","unstructured":"Lieder, F. and Griffiths, T.\u00a0L. (2020). Resource-rational analysis: Understanding human cognition as the optimal use of limited computational resources, Behav. Brain Sci. 43, e1."},{"key":"R000010","series-title":"Cogn. Brain Res.","first-page":"115","article-title":"Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study","volume":"14","author":"Molholm, S.","unstructured":"Molholm, S., Ritter, W., Murray, M.\u00a0M., Javitt, D.\u00a0C., Schroeder, C.\u00a0E. and Foxe, J.\u00a0J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study, Cogn. Brain Res. 14, 115\u2013128."},{"key":"R000011","series-title":"Eur. J. Neurosci.","first-page":"1230","article-title":"Atypical audiovisual temporal function in autism and schizophrenia: Similar phenotype, different cause","volume":"47","author":"Noel, J.\u00a0P.","unstructured":"Noel, J.\u00a0P., Stevenson, R.\u00a0A. and Wallace, M.\u00a0T. (2018). Atypical audiovisual temporal function in autism and schizophrenia: Similar phenotype, different cause, Eur. J. Neurosci. 47, 1230\u20131241."},{"key":"R000012","series-title":"Nature Commun.","first-page":"11543","article-title":"Correlation detection as a general mechanism for multisensory integration","volume":"7","author":"Parise, C.\u00a0V.","unstructured":"Parise, C.\u00a0V. and Ernst, M.\u00a0O. (2016). Correlation detection as a general mechanism for multisensory integration, Nature Commun. 7, 11543."},{"key":"R000013","series-title":"Nature Commun.","first-page":"2489","article-title":"Multisensory correlation computations in the human brain identified by a time-resolved encoding model","volume":"13","author":"Pesnot Lerousseau, J.","unstructured":"Pesnot Lerousseau, J., Parise, C.\u00a0V., Ernst, M.\u00a0O. and van Wassenhove, V. (2022). Multisensory correlation computations in the human brain identified by a time-resolved encoding model, Nature Commun. 13, 2489."},{"key":"R000014","series-title":"Proc. Natl. Acad. Sci. USA","first-page":"e2106235118","article-title":"How multisensory neurons solve causal inference","volume":"118","author":"Rideaux, R.","unstructured":"Rideaux, R., Storrs, K.\u00a0R., Maiello, G. and Welchman, A.\u00a0E. (2021). How multisensory neurons solve causal inference, Proc. Natl. Acad. Sci. USA 118, e2106235118."},{"key":"R000015","author":"Rohe, T.","unstructured":"Rohe, T. (2014). Causal inference in multisensory perception and the brain. Doctoral dissertation, Eberhard-Karls-Universit\u00e4t T\u00fcbingen, T\u00fcbingen."},{"key":"R000016","series-title":"PLoS Biol.","first-page":"e1002073","article-title":"Cortical hierarchies perform Bayesian causal inference in multisensory perception","volume":"13","author":"Rohe, T.","unstructured":"Rohe, T. and Noppeney, U. (2015). Cortical hierarchies perform Bayesian causal inference in multisensory perception, PLoS Biol. 13, e1002073."},{"key":"R000017","series-title":"Curr. Biol.","first-page":"509","article-title":"Distinct computational principles govern multisensory integration in primary sensory and association cortices","volume":"26","author":"Rohe, T.","unstructured":"Rohe, T. and Noppeney, U. (2016). Distinct computational principles govern multisensory integration in primary sensory and association cortices, Curr. Biol. 26, 509\u2013514."},{"key":"R000018","series-title":"Nature Commun.","first-page":"1907","article-title":"The neural dynamics of hierarchical Bayesian causal inference in multisensory perception","volume":"10","author":"Rohe, T.","unstructured":"Rohe, T., Ehlis, A.-C. and Noppeney, U. (2019). The neural dynamics of hierarchical Bayesian causal inference in multisensory perception, Nature Commun. 10, 1907."},{"key":"R000019","series-title":"PLoS Biol.","first-page":"e3002790","article-title":"Multisensory perceptual and causal inference is largely preserved in medicated post-acute individuals with schizophrenia","volume":"22","author":"Rohe, T.","unstructured":"Rohe, T., Hesse, K., Ehlis, A.-C. and Noppeney, U. (2024). Multisensory perceptual and causal inference is largely preserved in medicated post-acute individuals with schizophrenia, PLoS Biol. 22, e3002790."},{"key":"R000020","series-title":"J.\u00a0Cogn. Neurosci.","first-page":"640","article-title":"Alpha-band frequency and temporal windows in perception: a review and living meta-analysis of 27 experiments (and counting)","volume":"36","author":"Samaha, J.","unstructured":"Samaha, J. and Romei, V. (2024). Alpha-band frequency and temporal windows in perception: a review and living meta-analysis of 27 experiments (and counting), J.\u00a0Cogn. Neurosci. 36, 640\u2013654."},{"key":"R000021","series-title":"Multisensory interactions in the real world","author":"Soto-Faraco, S.","unstructured":"Soto-Faraco, S., Kvasova, D., Biau, E., Ikumi, N., Ruzzoli, M., Mor\u00eds-Fern\u00e1ndez, L. and Torralba, M. (2019). Multisensory interactions in the real world. Cambridge University Press, Cambridge."},{"key":"R000022","series-title":"Cell","first-page":"24","article-title":"Multisensory flavor perception","volume":"161","author":"Spence, C.","unstructured":"Spence, C. (2015). Multisensory flavor perception, Cell 161, 24\u201335."},{"key":"R000023","series-title":"The merging of the senses","author":"Stein, B.\u00a0E.","unstructured":"Stein, B.\u00a0E. and Meredith, M.\u00a0A. (1993). The merging of the senses. MIT Press, Cambridge, MA."},{"key":"R000024","series-title":"Neurosci. Biobehav. Rev.","article-title":"Can cognitive neuroscience solve the lab-dilemma by going wild?","volume":"155","author":"Vallet, W.","unstructured":"Vallet, W. and van Wassenhove, V. (2023). Can cognitive neuroscience solve the lab-dilemma by going wild?, Neurosci. Biobehav. Rev. 155, 105463."}],"container-title":["Multisensory Research"],"original-title":[],"link":[{"URL":"https:\/\/brill.com\/view\/journals\/msr\/aop\/article-10.1163-22134808-bja10211\/article-10.1163-22134808-bja10211.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/brill.com\/downloadpdf\/journals\/msr\/aop\/article-10.1163-22134808-bja10211\/article-10.1163-22134808-bja10211.xml","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T03:27:35Z","timestamp":1790911655000},"score":1,"resource":{"primary":{"URL":"https:\/\/brill.com\/view\/journals\/msr\/aop\/article-10.1163-22134808-bja10211\/article-10.1163-22134808-bja10211.xml"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,1]]},"references-count":24,"URL":"https:\/\/doi.org\/10.1163\/22134808-bja10211","relation":{},"ISSN":["2213-4794","2213-4808"],"issn-type":[{"value":"2213-4794","type":"print"},{"value":"2213-4808","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,1]]}}}