{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T04:06:12Z","timestamp":1790741172515,"version":"4.1.0"},"reference-count":31,"publisher":"Walter de Gruyter GmbH","license":[{"start":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T00:00:00Z","timestamp":1790640000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Multisens. Res."],"published-print":{"date-parts":[[2026,9,29]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This article presents a compiled interview with three prominent figures in multisensory research: Ulrik Ravnsborg Beierholm, Hans Colonius, and Ladan Shams. Through structured dialogue, the authors reflect on the evolution of computational modeling, from early mathematical psychology to the current dominance of Bayesian causal inference (BCI). The discussion highlights key paradigm shifts, specifically the transition from descriptive studies of illusions to normative, mechanistic explanations of perception. The authors identify the 2002 demonstration by Ernst and Banks of statistically optimal integration as a pivotal milestone in establishing how the brain weighs sensory reliability. Crucially, the authors discuss the subsequent development of BCI as the first framework to formally address the \u2018binding problem\u2019\u00a0\u2014 the computational challenge of determining whether sensory signals originate from a common source (integration) or distinct sources (segregation). Current trends and controversies are explored, including the application of computational phenotypes to clinical populations, the debate over the neural implementation of Bayesian computations, and the rising influence of deep neural networks. While artificial intelligence (AI) offers new avenues for analyzing high-dimensional data, the authors emphasize the need for biological realism and explainability. The dialogue also addresses the importance of open science, the challenge of accounting for individual differences, and the necessity of moving toward naturalistic environments. The article concludes with professional advice for early-career scientists, emphasizing interdisciplinary training in mathematics and statistics. Collectively, the authors argue that multisensory processing is not a \u2018special case\u2019 of perception but the default mode of brain operation, providing essential principles for understanding learning, plasticity, and memory.<\/jats:p>","DOI":"10.1163\/22134808-bja10212","type":"journal-article","created":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T03:43:01Z","timestamp":1790739781000},"page":"1-10","source":"Crossref","is-referenced-by-count":0,"title":["Viewpoint on Computational Modeling of Multisensory Integration"],"prefix":"10.1163","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7296-7996","authenticated-orcid":true,"given":"Ulrik\u00a0Ravnsborg","family":"Beierholm","sequence":"first","affiliation":[{"name":"Department of Psychology, https:\/\/dx.doi.org\/3057Durham University, Durham, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9733-6939","authenticated-orcid":true,"given":"Hans","family":"Colonius","sequence":"additional","affiliation":[{"name":"Department of Psychology, Oldenburg University, Oldenburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9303-9921","authenticated-orcid":true,"given":"Ladan","family":"Shams","sequence":"additional","affiliation":[{"name":"Department of Psychology and Bioengineering, and Interdepartmental Neuroscience Program, University of California Los Angeles (UCLA), Los Angeles, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","reference":[{"key":"R000001","series-title":"PLoS Biol.","first-page":"e3000210","article-title":"To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference","volume":"17","author":"Aller, M.","unstructured":"Aller, M. and Noppeney, U. (2019). To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference, PLoS Biol. 17, e3000210."},{"key":"R000002","series-title":"Behav. Brain Sci.","first-page":"e385","article-title":"Deep problems with neural network models of human vision","volume":"46","author":"Bowers, J.\u00a0S.","unstructured":"Bowers, J.\u00a0S., Malhotra, G., Dujmovi\u0107, M., Llera Montero, M., Tsvetkov, C., Biscione, V., Puebla, G., Adolfi, F., Hummel, J.\u00a0E., Heaton, R.\u00a0F., Evans, B.\u00a0D., Mitchell, J. and Blything, R. (2023). Deep problems with neural network models of human vision, Behav. Brain Sci. 46, e385. DOI:10.1017\/S0140525X22002813."},{"key":"R000003","series-title":"Percept. Psychophys.","first-page":"251","article-title":"Measuring channel dependence in separate activation models","volume":"40","author":"Colonius, H.","unstructured":"Colonius, H. (1986). Measuring channel dependence in separate activation models, Percept. Psychophys. 40, 251\u2013255."},{"key":"R000004","series-title":"Psychol. Rese.","first-page":"23","article-title":"Intersensory facilitation in the motor component?","volume":"49","author":"Diederich, A.","unstructured":"Diederich, A. and Colonius, H. (1987). Intersensory facilitation in the motor component?, Psychol. Rese. 49, 23\u201329."},{"key":"R000005","series-title":"eLife","first-page":"e03005","article-title":"Optimal multisensory decision-making in a reaction-time task","volume":"3","author":"Drugowitsch, J.","unstructured":"Drugowitsch, J., DeAngelis, G.\u00a0C., Klier, E.\u00a0M., Angelaki, D.\u00a0E. and Pouget, A. (2014). Optimal multisensory decision-making in a reaction-time task, eLife 3, e03005. DOI:10.7554\/eLife.03005."},{"key":"R000006","series-title":"Nature Human Behav.","first-page":"49","article-title":"Distinct audio and visual accumulators co-activate motor preparation for multisensory detection","volume":"10","author":"Egan, J.\u00a0M.","unstructured":"Egan, J.\u00a0M., Gomez-Ramirez, M., Foxe, J.\u00a0J., O\u2019Connell, R.\u00a0G. and Kelly, S.\u00a0P. (2026). Distinct audio and visual accumulators co-activate motor preparation for multisensory detection, Nature Human Behav. 10, 49\u201363. DOI:10.1038\/s41562-025-02280-9."},{"key":"R000007","series-title":"Nature","first-page":"429","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"Ernst, M.\u00a0O.","unstructured":"Ernst, M.\u00a0O. and Banks, M.\u00a0S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion, Nature 415, 429\u2013433."},{"key":"R000008","series-title":"Sensory cue integration","first-page":"224","article-title":"Multisensory perception: from integration to remapping","author":"Ernst, M.\u00a0O.","unstructured":"Ernst, M.\u00a0O. and Di Luca, M. (2011). Multisensory perception: from integration to remapping, in: Sensory cue integration, J.\u00a0Trommersh\u00e4user, K.\u00a0K\u00f6rding and M.\u00a0Landy (Eds), pp.\u00a0224\u2013250. Oxford University Press, Oxford."},{"key":"R000009","series-title":"Trends Cogn. Sci.","first-page":"119","article-title":"Statistically optimal perception and learning: from behavior to neural representations","volume":"14","author":"Fiser, J.","unstructured":"Fiser, J., Berkes, P., Orb\u00e1n, G. and Lengyel, M. (2010). Statistically optimal perception and learning: from behavior to neural representations, Trends Cogn. Sci. 14, 119\u2013130. DOI:10.1016\/j.tics.2010.01.003."},{"key":"R000010","series-title":"Neuropsychologia","article-title":"Audio-visual spatial alignment improves integration in the presence of a competing audio-visual stimulus","volume":"146","author":"Fleming, J.\u00a0T.","unstructured":"Fleming, J.\u00a0T., Noyce, A.\u00a0L. and Shinn-Cunningham, B.\u00a0G. (2020). Audio-visual spatial alignment improves integration in the presence of a competing audio-visual stimulus, Neuropsychologia 146, 107530."},{"key":"R000011","series-title":"eLife","article-title":"Comprehensive neural representations of naturalistic stimuli through multimodal deep learning","volume":"14","author":"Fu, M.","unstructured":"Fu, M., Chen, G., Zhang, Y., Zhang, M. and Wang, Y. (2025). Comprehensive neural representations of naturalistic stimuli through multimodal deep learning, eLife 14. DOI:10.7554\/eLife.107607.1."},{"key":"R000012","series-title":"J.\u00a0Vis.","first-page":"967","article-title":"Slant from texture and disparity cues: optimal cue combination","volume":"4","author":"Hillis, J.\u00a0M.","unstructured":"Hillis, J.\u00a0M., Watt, S.\u00a0J., Landy, M.\u00a0S. and Banks, M.\u00a0S. (2004). Slant from texture and disparity cues: optimal cue combination, J.\u00a0Vis. 4, 967\u2013992."},{"key":"R000013","series-title":"PLoS ONE","first-page":"e943","article-title":"Causal inference in multisensory perception","volume":"2","author":"K\u00f6rding, K.\u00a0P.","unstructured":"K\u00f6rding, K.\u00a0P., Beierholm, U., Ma, W.\u00a0J., Quartz, S., Tenenbaum, J.\u00a0B. and Shams, L. (2007). Causal inference in multisensory perception, PLoS ONE 2, e943. DOI:10.1371\/journal.pone.0000943."},{"key":"R000014","series-title":"Nature Neurosci.","first-page":"1432","article-title":"Bayesian inference with probabilistic population codes","volume":"9","author":"Ma, W.\u00a0J.","unstructured":"Ma, W.\u00a0J., Beck, J., Latham, P. and Pouget, A. (2006). Bayesian inference with probabilistic population codes, Nature Neurosci. 9, 1432\u20131438. DOI:10.1038\/nn1790."},{"key":"R000015","series-title":"Cogn. Psychol.","first-page":"247","article-title":"Divided attention: evidence for coactivation with redundant signals","volume":"14","author":"Miller, J.","unstructured":"Miller, J. (1982). Divided attention: evidence for coactivation with redundant signals, Cogn. Psychol. 14, 247\u2013279."},{"key":"R000016","series-title":"Neuropsychologia","first-page":"113","article-title":"A matter of attention: crossmodal congruence enhances and impairs performance in a novel trimodal matching paradigm","volume":"88","author":"Misselhorn, J.","unstructured":"Misselhorn, J., Daume, J., Engel, A.\u00a0K. and Friese, U. (2016). A matter of attention: crossmodal congruence enhances and impairs performance in a novel trimodal matching paradigm, Neuropsychologia 88, 113\u2013122."},{"key":"R000017","series-title":"eLife","first-page":"e71866","article-title":"Aberrant causal inference and presence of a compensatory mechanism in autism spectrum disorder","volume":"11","author":"Noel, J.-P.","unstructured":"Noel, J.-P., Shivkumar, S., Dokka, K., Haefner, R.\u00a0M. and Angelaki, D.\u00a0E. (2022). Aberrant causal inference and presence of a compensatory mechanism in autism spectrum disorder, eLife 11, e71866. DOI:10.7554\/eLife.71866."},{"key":"R000018","series-title":"Cognition","article-title":"Does multisensory study benefit memory for pictures and sounds?","volume":"226","author":"Pecher, D.","unstructured":"Pecher, D. and Zeelenberg, R. (2022). Does multisensory study benefit memory for pictures and sounds?, Cognition 226, 105181."},{"key":"R000019","series-title":"Nature Rev. Neurosci.","first-page":"488","article-title":"Biological constraints on neural network models of cognitive function","volume":"22","author":"Pulverm\u00fcller, F.","unstructured":"Pulverm\u00fcller, F., Tomasello, R., Henningsen-Schomers, M.\u00a0R. and Wennekers, T. (2021). Biological constraints on neural network models of cognitive function, Nature Rev. Neurosci. 22, 488\u2013502. DOI:10.1038\/s41583-021-00473-5."},{"key":"R000020","series-title":"Trans. N.Y. Acad. Sci.","first-page":"574","article-title":"Statistical facilitation of simple reaction times","volume":"24","author":"Raab, D.\u00a0H.","unstructured":"Raab, D.\u00a0H. (1962). Statistical facilitation of simple reaction times, Trans. N.Y. Acad. Sci. 24, 574\u2013590."},{"key":"R000021","series-title":"Behav. Brain Sci.","first-page":"e223","article-title":"Suboptimality in perceptual decision making","volume":"41","author":"Rahnev, D.","unstructured":"Rahnev, D. and Denison, R.\u00a0N. (2018). Suboptimality in perceptual decision making, Behav. Brain Sci. 41, e223."},{"key":"R000022","series-title":"Proc. Roy. Soc. Lond. B: Biol. Sci.","first-page":"2159","article-title":"Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration","volume":"273","author":"Roach, N.\u00a0W.","unstructured":"Roach, N.\u00a0W., Heron, J. and McGraw, P.\u00a0V. (2006). Resolving multisensory conflict: a strategy for balancing the costs and benefits of audio-visual integration, Proc. Roy. Soc. Lond. B: Biol. Sci. 273, 2159\u20132168."},{"key":"R000023","series-title":"Nature Commun.","first-page":"1907","article-title":"The neural dynamics of hierarchical Bayesian causal inference in multisensory perception","volume":"10","author":"Rohe, T.","unstructured":"Rohe, T., Ehlis, A.\u00a0C. and Noppeney, U. (2019). The neural dynamics of hierarchical Bayesian causal inference in multisensory perception, Nature Commun. 10, 1907."},{"key":"R000024","series-title":"PLoS Biol.","first-page":"e3002790","article-title":"Multisensory perceptual and causal inference is largely preserved in medicated post-acute individuals with schizophrenia","volume":"22","author":"Rohe, T.","unstructured":"Rohe, T., Hesse, K., Ehlis, A.-C. and Noppeney, U. (2024). Multisensory perceptual and causal inference is largely preserved in medicated post-acute individuals with schizophrenia, PLoS Biol. 22, e3002790."},{"key":"R000025","series-title":"Trends Cogn. Sci.","first-page":"425","article-title":"Causal inference in perception","volume":"14","author":"Shams, L.","unstructured":"Shams, L. and Beierholm, U.\u00a0R. (2011). Causal inference in perception, Trends Cogn. Sci. 14, 425\u2013432."},{"key":"R000026","series-title":"Nature","first-page":"788","article-title":"Illusions: What you see is what you hear","volume":"408","author":"Shams, L.","unstructured":"Shams, L., Kamitani, Y. and Shimojo, S. (2000). Illusions: What you see is what you hear, Nature 408, 788."},{"key":"R000027","series-title":"The merging of the senses","author":"Stein, B.\u00a0E.","unstructured":"Stein, B.\u00a0E. and Meredith, M.\u00a0A. (1993). The merging of the senses. MIT Press, Cambridge, MA."},{"key":"R000028","series-title":"Cognition","first-page":"148","article-title":"Single-trial multisensory memories affect later auditory and visual object discrimination","volume":"138","author":"Thelen, A.","unstructured":"Thelen, A., Talsma, D. and Murray, M.\u00a0M. (2015). Single-trial multisensory memories affect later auditory and visual object discrimination, Cognition 138, 148\u2013158."},{"key":"R000029","series-title":"J.\u00a0Vis.","first-page":"1","article-title":"Continuous tracking of audiovisual motion","volume":"25","author":"Tonelli, A.","unstructured":"Tonelli, A., Burr, D., Gori, M. and Alais, D. (2025). Continuous tracking of audiovisual motion, J.\u00a0Vis. 25, 1\u201316."},{"key":"R000030","series-title":"Front. Neuroinform.","first-page":"14","article-title":"HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python","volume":"7","author":"Wiecki, T.\u00a0V.","unstructured":"Wiecki, T.\u00a0V., Sofer, I. and Frank, M.\u00a0J. (2013). HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python, Front. Neuroinform. 7, 14. DOI:10.3389\/fninf.2013.00014."},{"key":"R000031","series-title":"PLoS Comput. Biol.","first-page":"e1011791","article-title":"BCI Toolbox: an open-source Python package for the Bayesian causal inference model","volume":"20","author":"Zhu, H.","unstructured":"Zhu, H., Beierholm, U. and Shams, L. (2024). BCI Toolbox: an open-source Python package for the Bayesian causal inference model, PLoS Comput. Biol. 20, e1011791."}],"container-title":["Multisensory Research"],"original-title":[],"link":[{"URL":"https:\/\/brill.com\/view\/journals\/msr\/aop\/article-10.1163-22134808-bja10212\/article-10.1163-22134808-bja10212.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/brill.com\/downloadpdf\/journals\/msr\/aop\/article-10.1163-22134808-bja10212\/article-10.1163-22134808-bja10212.xml","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T03:48:54Z","timestamp":1790740134000},"score":1,"resource":{"primary":{"URL":"https:\/\/brill.com\/view\/journals\/msr\/aop\/article-10.1163-22134808-bja10212\/article-10.1163-22134808-bja10212.xml"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,29]]},"references-count":31,"URL":"https:\/\/doi.org\/10.1163\/22134808-bja10212","relation":{},"ISSN":["2213-4794","2213-4808"],"issn-type":[{"value":"2213-4794","type":"print"},{"value":"2213-4808","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,29]]}}}