{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T06:37:33Z","timestamp":1774420653458,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1013468","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T00:00:00Z","timestamp":1758240000000}}],"reference-count":105,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2025,9,12]],"date-time":"2025-09-12T00:00:00Z","timestamp":1757635200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004004","name":"Universit\u00c3\u00a0 degli Studi di Trento","doi-asserted-by":"publisher","award":["DM737\/21-StartGrant-R06"],"award-info":[{"award-number":["DM737\/21-StartGrant-R06"]}],"id":[{"id":"10.13039\/501100004004","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell\u00e2\u20ac\u2122Istruzione, dell\u00e2\u20ac\u2122Universit\u00c3\u00a0 e della Ricerca","doi-asserted-by":"publisher","award":["MUR-PRIN 2017 n20177894ZH"],"award-info":[{"award-number":["MUR-PRIN 2017 n20177894ZH"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell\u00e2\u20ac\u2122Istruzione, dell\u00e2\u20ac\u2122Universit\u00c3\u00a0 e della Ricerca","doi-asserted-by":"publisher","award":["MUR-PRIN 2017 n20177894ZH"],"award-info":[{"award-number":["MUR-PRIN 2017 n20177894ZH"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell\u00e2\u20ac\u2122Istruzione, dell\u00e2\u20ac\u2122Universit\u00c3\u00a0 e della Ricerca","doi-asserted-by":"publisher","award":["MUR-PRIN 2022 n.2022FT8HNC"],"award-info":[{"award-number":["MUR-PRIN 2022 n.2022FT8HNC"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell\u00e2\u20ac\u2122Istruzione, dell\u00e2\u20ac\u2122Universit\u00c3\u00a0 e della Ricerca","doi-asserted-by":"publisher","award":["MUR-PRIN 2022 n.2022FT8HNC"],"award-info":[{"award-number":["MUR-PRIN 2022 n.2022FT8HNC"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Face-to-face communication relies on the seamless integration of multisensory signals, including voice, gaze, and head movements, to convey meaning effectively. This poses a fundamental computational challenge: optimally binding signals sharing the same communicative intention (e.g., looking at the addressee while speaking) and segregating unrelated signals (e.g., looking away while coughing), all within the rapid turn-taking dynamics of conversation. Critically, the computational mechanisms underlying this extraordinary feat remain largely unknown. Here, we cast face-to-face communication as a Bayesian Causal Inference problem to formally test whether prior expectations arbitrate between the integration and segregation of vocal and bodily signals. Specifically, we asked whether there is a stronger prior tendency to integrate audiovisual signals that convey the same communicative intention, thus establishing a crossmodal pragmatic correspondence. Additionally, we evaluated whether observers solve causal inference by adopting optimal Bayesian decision strategies or non-optimal approximate heuristics. In a spatial localization task, participants watched audiovisual clips of a speaker where the audio (voice) and the video (bodily cues) were sampled either from congruent positions or at increasing spatial disparities. Crucially, we manipulated the pragmatic correspondence of the signals: in a communicative condition, the speaker addressed the participant with their head, gaze and speech; in a non-communicative condition, the speaker kept the head down and produced a meaningless vocalization. We measured audiovisual integration through the ventriloquist effect, which quantifies how much the perceived audio position is misplaced towards the video position. Combining psychophysics with computational modelling, we show that observers solved audiovisual causal inference using non-optimal heuristics that nevertheless approximate optimal Bayesian inference with high accuracy. Remarkably, participants showed a stronger tendency to integrate vocal and bodily information when signals conveyed congruent communicative intent, suggesting that pragmatic correspondences enhance multisensory integration. Collectively, our findings provide novel and compelling evidence that face-to-face communication is shaped by deeply ingrained expectations about how multisensory signals should be structured and interpreted.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1013468","type":"journal-article","created":{"date-parts":[[2025,9,12]],"date-time":"2025-09-12T17:53:47Z","timestamp":1757699627000},"page":"e1013468","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Prior expectations guide multisensory integration during face-to-face communication"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-6166-4264","authenticated-orcid":true,"given":"Giulia","family":"Mazzi","sequence":"first","affiliation":[]},{"given":"Ambra","family":"Ferrari","sequence":"additional","affiliation":[]},{"given":"Maria Laura","family":"Mencaroni","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1354-3288","authenticated-orcid":true,"given":"Chiara","family":"Valzolgher","sequence":"additional","affiliation":[]},{"given":"Mirko","family":"Tommasini","sequence":"additional","affiliation":[]},{"given":"Francesco","family":"Pavani","sequence":"additional","affiliation":[]},{"given":"Stefania","family":"Benetti","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2025,9,12]]},"reference":[{"issue":"1651","key":"pcbi.1013468.ref001","doi-asserted-by":"crossref","first-page":"20130302","DOI":"10.1098\/rstb.2013.0302","article-title":"The origin of human multi-modal communication","volume":"369","author":"SC Levinson","year":"2014","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"1651","key":"pcbi.1013468.ref002","doi-asserted-by":"crossref","first-page":"20130292","DOI":"10.1098\/rstb.2013.0292","article-title":"Language as a multimodal phenomenon: implications for language learning, processing and evolution","volume":"369","author":"G Vigliocco","year":"2014","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"key":"pcbi.1013468.ref003","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.3389\/fpsyg.2018.01109","article-title":"Why We Should Study Multimodal Language","volume":"9","author":"P Perniss","year":"2018","journal-title":"Front Psychol"},{"issue":"8","key":"pcbi.1013468.ref004","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1016\/j.tics.2019.05.006","article-title":"Multimodal Language Processing in Human Communication","volume":"23","author":"J Holler","year":"2019","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1013468.ref005","doi-asserted-by":"crossref","first-page":"1108354","DOI":"10.3389\/fnhum.2023.1108354","article-title":"Multimodal processing in face-to-face interactions: A bridging link between psycholinguistics and sensory neuroscience","volume":"17","author":"S Benetti","year":"2023","journal-title":"Front Hum Neurosci"},{"issue":"1859","key":"pcbi.1013468.ref006","doi-asserted-by":"crossref","first-page":"20210094","DOI":"10.1098\/rstb.2021.0094","article-title":"Visual bodily signals as core devices for coordinating minds in interaction","volume":"377","author":"J Holler","year":"2022","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"key":"pcbi.1013468.ref007","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511635649","author":"T Wharton","year":"2009","journal-title":"Pragmatics and Non-Verbal Communication"},{"issue":"5","key":"pcbi.1013468.ref008","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1002\/hbm.22746","article-title":"Feeling addressed! The role of body orientation and co-speech gesture in social communication","volume":"36","author":"A Nagels","year":"2015","journal-title":"Hum Brain Mapp"},{"issue":"1","key":"pcbi.1013468.ref009","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3758\/s13415-021-00959-w","article-title":"Eye Direction Detection and Perception as Premises of a Social Brain: A Narrative Review of Behavioral and Neural Data","volume":"22","author":"M-N Babinet","year":"2022","journal-title":"Cogn Affect Behav Neurosci"},{"issue":"8","key":"pcbi.1013468.ref010","doi-asserted-by":"crossref","first-page":"1845","DOI":"10.1162\/jocn.2010.21462","article-title":"The role of synchrony and ambiguity in speech-gesture integration during comprehension","volume":"23","author":"B Habets","year":"2011","journal-title":"J Cogn Neurosci"},{"issue":"1","key":"pcbi.1013468.ref011","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1016\/j.tics.2015.10.010","article-title":"Turn-taking in Human Communication--Origins and Implications for Language Processing","volume":"20","author":"SC Levinson","year":"2016","journal-title":"Trends Cogn Sci"},{"issue":"5","key":"pcbi.1013468.ref012","doi-asserted-by":"crossref","first-page":"1900","DOI":"10.3758\/s13423-017-1363-z","article-title":"Processing language in face-to-face conversation: Questions with gestures get faster responses","volume":"25","author":"J Holler","year":"2018","journal-title":"Psychon Bull Rev"},{"issue":"2","key":"pcbi.1013468.ref013","doi-asserted-by":"crossref","first-page":"792","DOI":"10.3758\/s13423-022-02178-x","article-title":"The multimodal facilitation effect in human communication","volume":"30","author":"L Drijvers","year":"2023","journal-title":"Psychon Bull Rev"},{"issue":"2","key":"pcbi.1013468.ref014","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1177\/0956797609357327","article-title":"Two sides of the same coin: speech and gesture mutually interact to enhance comprehension","volume":"21","author":"SD Kelly","year":"2010","journal-title":"Psychol Sci"},{"issue":"2","key":"pcbi.1013468.ref015","doi-asserted-by":"crossref","first-page":"600","DOI":"10.3758\/s13423-021-02009-5","article-title":"The role of iconic gestures and mouth movements in face-to-face communication","volume":"29","author":"A Krason","year":"2022","journal-title":"Psychon Bull Rev"},{"issue":"5","key":"pcbi.1013468.ref016","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1037\/xlm0001399","article-title":"Understanding discourse in face-to-face settings: The impact of multimodal cues and listening conditions","volume":"51","author":"A Krason","year":"2025","journal-title":"J Exp Psychol Learn Mem Cogn"},{"issue":"4","key":"pcbi.1013468.ref017","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1080\/23273798.2024.2314021","article-title":"Gestures speed up responses to questions","volume":"39","author":"M Ter Bekke","year":"2024","journal-title":"Lang Cogn Neurosci"},{"key":"pcbi.1013468.ref018","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1146\/annurev-neuro-100120-085519","article-title":"Perceptual Inference, Learning, and Attention in a Multisensory World","volume":"44","author":"U Noppeney","year":"2021","journal-title":"Annu Rev Neurosci"},{"issue":"37","key":"pcbi.1013468.ref019","doi-asserted-by":"crossref","first-page":"12329","DOI":"10.1523\/JNEUROSCI.5745-09.2010","article-title":"Audiovisual synchrony improves motion discrimination via enhanced connectivity between early visual and auditory areas","volume":"30","author":"R Lewis","year":"2010","journal-title":"J Neurosci"},{"key":"pcbi.1013468.ref020","doi-asserted-by":"crossref","first-page":"798","DOI":"10.3389\/fpsyg.2013.00798","article-title":"Causal inference of asynchronous audiovisual speech","volume":"4","author":"JF Magnotti","year":"2013","journal-title":"Front Psychol"},{"issue":"1","key":"pcbi.1013468.ref021","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1037\/a0019952","article-title":"Audiovisual asynchrony detection in human speech","volume":"37","author":"JX Maier","year":"2011","journal-title":"J Exp Psychol Hum Percept Perform"},{"issue":"3","key":"pcbi.1013468.ref022","doi-asserted-by":"crossref","first-page":"351","DOI":"10.3758\/BF03206811","article-title":"Temporal constraints on the McGurk effect","volume":"58","author":"KG Munhall","year":"1996","journal-title":"Percept Psychophys"},{"issue":"42","key":"pcbi.1013468.ref023","doi-asserted-by":"crossref","first-page":"11431","DOI":"10.1523\/JNEUROSCI.2252-07.2007","article-title":"Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices","volume":"27","author":"T Noesselt","year":"2007","journal-title":"J Neurosci"},{"key":"pcbi.1013468.ref024","doi-asserted-by":"crossref","first-page":"11543","DOI":"10.1038\/ncomms11543","article-title":"Correlation detection as a general mechanism for multisensory integration","volume":"7","author":"CV Parise","year":"2016","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1013468.ref025","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.cub.2011.11.039","article-title":"When correlation implies causation in multisensory integration","volume":"22","author":"CV Parise","year":"2012","journal-title":"Curr Biol"},{"issue":"3","key":"pcbi.1013468.ref026","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1016\/j.neuropsychologia.2006.01.001","article-title":"Temporal window of integration in auditory-visual speech perception","volume":"45","author":"V van Wassenhove","year":"2007","journal-title":"Neuropsychologia"},{"issue":"3","key":"pcbi.1013468.ref027","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1016\/S0926-6410(03)00074-0","article-title":"Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli","volume":"16","author":"J Lewald","year":"2003","journal-title":"Brain Res Cogn Brain Res"},{"issue":"1","key":"pcbi.1013468.ref028","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1097\/00001756-200101220-00009","article-title":"Temporal and spatial dependency of the ventriloquism effect","volume":"12","author":"DA Slutsky","year":"2001","journal-title":"Neuroreport"},{"key":"pcbi.1013468.ref029","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1111\/nyas.12121","article-title":"Just how important is spatial coincidence to multisensory integration? Evaluating the spatial rule","volume":"1296","author":"C Spence","year":"2013","journal-title":"Ann N Y Acad Sci"},{"issue":"4","key":"pcbi.1013468.ref030","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1016\/j.neuroimage.2010.05.002","article-title":"Prior auditory information shapes visual category-selectivity in ventral occipito-temporal cortex","volume":"52","author":"R Adam","year":"2010","journal-title":"Neuroimage"},{"issue":"8","key":"pcbi.1013468.ref031","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0024016","article-title":"Speech cues contribute to audiovisual spatial integration","volume":"6","author":"CW Bishop","year":"2011","journal-title":"PLoS One"},{"issue":"1","key":"pcbi.1013468.ref032","doi-asserted-by":"crossref","first-page":"123","DOI":"10.3758\/s13423-010-0027-z","article-title":"Perceptual congruency of audio-visual speech affects ventriloquism with bilateral visual stimuli","volume":"18","author":"S Kanaya","year":"2011","journal-title":"Psychon Bull Rev"},{"issue":"31","key":"pcbi.1013468.ref033","doi-asserted-by":"crossref","first-page":"11338","DOI":"10.1523\/JNEUROSCI.6510-10.2011","article-title":"Physical and perceptual factors shape the neural mechanisms that integrate audiovisual signals in speech comprehension","volume":"31","author":"H Lee","year":"2011","journal-title":"J Neurosci"},{"issue":"21","key":"pcbi.1013468.ref034","doi-asserted-by":"crossref","first-page":"7434","DOI":"10.1523\/JNEUROSCI.0455-10.2010","article-title":"Perceptual decisions formed by accumulation of audiovisual evidence in prefrontal cortex","volume":"30","author":"U Noppeney","year":"2010","journal-title":"J Neurosci"},{"issue":"5","key":"pcbi.1013468.ref035","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0005664","article-title":"\u201cWhen birds of a feather flock together\u201d: synesthetic correspondences modulate audiovisual integration in non-synesthetes","volume":"4","author":"CV Parise","year":"2009","journal-title":"PLoS One"},{"issue":"20","key":"pcbi.1013468.ref036","doi-asserted-by":"crossref","first-page":"6490","DOI":"10.1523\/JNEUROSCI.5437-08.2009","article-title":"Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing","volume":"29","author":"S Sadaghiani","year":"2009","journal-title":"J Neurosci"},{"issue":"4","key":"pcbi.1013468.ref037","doi-asserted-by":"crossref","first-page":"971","DOI":"10.3758\/s13414-010-0073-7","article-title":"Crossmodal correspondences: a tutorial review","volume":"73","author":"C Spence","year":"2011","journal-title":"Atten Percept Psychophys"},{"issue":"5","key":"pcbi.1013468.ref038","doi-asserted-by":"crossref","first-page":"790","DOI":"10.3758\/s13414-013-0475-4","article-title":"Intersensory binding across space and time: a tutorial review","volume":"75","author":"L Chen","year":"2013","journal-title":"Atten Percept Psychophys"},{"key":"pcbi.1013468.ref039","first-page":"445","article-title":"Assessing the Role of the \u201cUnity Assumption\u201d on Multisensory Integration: A Review","volume":"8","author":"Y-C Chen","year":"2017","journal-title":"Front Psychol"},{"key":"pcbi.1013468.ref040","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1163\/22134808-00002502","article-title":"Crossmodal Correspondences: Standing Issues and Experimental Guidelines","volume":"29","author":"CV Parise","year":"2016","journal-title":"Multisens Res"},{"issue":"3","key":"pcbi.1013468.ref041","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1037\/0033-2909.88.3.638","article-title":"Immediate perceptual response to intersensory discrepancy","volume":"88","author":"RB Welch","year":"1980","journal-title":"Psychol Bull"},{"issue":"5","key":"pcbi.1013468.ref042","doi-asserted-by":"crossref","first-page":"744","DOI":"10.3758\/BF03193776","article-title":"Crossmodal binding: evaluating the \u201cunity assumption\u201d using audiovisual speech stimuli","volume":"69","author":"A Vatakis","year":"2007","journal-title":"Percept Psychophys"},{"issue":"10","key":"pcbi.1013468.ref043","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1068\/p5851","article-title":"Knowledge about a common source can promote visual- haptic integration","volume":"36","author":"HB Helbig","year":"2007","journal-title":"Perception"},{"key":"pcbi.1013468.ref044","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1016\/j.neuroimage.2015.09.045","article-title":"How prior expectations shape multisensory perception","volume":"124","author":"R Gau","year":"2016","journal-title":"Neuroimage"},{"issue":"2","key":"pcbi.1013468.ref045","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1121\/1.4728187","article-title":"Binding and unbinding the auditory and visual streams in the McGurk effect","volume":"132","author":"O Nahorna","year":"2012","journal-title":"J Acoust Soc Am"},{"key":"pcbi.1013468.ref046","doi-asserted-by":"crossref","DOI":"10.7717\/peerj.3143","article-title":"A simple and efficient method to enhance audiovisual binding tendencies","volume":"5","author":"B Odegaard","year":"2017","journal-title":"PeerJ"},{"issue":"10","key":"pcbi.1013468.ref047","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1016\/j.tics.2016.08.006","article-title":"Metacognition in Multisensory Perception","volume":"20","author":"O Deroy","year":"2016","journal-title":"Trends Cogn Sci"},{"issue":"5","key":"pcbi.1013468.ref048","doi-asserted-by":"crossref","DOI":"10.1167\/7.5.7","article-title":"Learning to integrate arbitrary signals from vision and touch","volume":"7","author":"MO Ernst","year":"2007","journal-title":"J Vis"},{"issue":"51","key":"pcbi.1013468.ref049","article-title":"Long-term music training tunes how the brain temporally binds signals from multiple senses","volume":"108","author":"H Lee","year":"2011","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"3","key":"pcbi.1013468.ref050","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1111\/j.1467-7687.2007.00584.x","article-title":"Bayesian networks, Bayesian learning and cognitive development","volume":"10","author":"A Gopnik","year":"2007","journal-title":"Dev Sci"},{"issue":"1420","key":"pcbi.1013468.ref051","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1098\/rstb.2001.1055","article-title":"Bayesian natural selection and the evolution of perceptual systems","volume":"357","author":"WS Geisler","year":"2002","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"9","key":"pcbi.1013468.ref052","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0000943","article-title":"Causal inference in multisensory perception","volume":"2","author":"KP K\u00f6rding","year":"2007","journal-title":"PLoS One"},{"issue":"9","key":"pcbi.1013468.ref053","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.tics.2010.07.001","article-title":"Causal inference in perception","volume":"14","author":"L Shams","year":"2010","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1013468.ref054","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.cophys.2020.04.004","article-title":"Multisensory neural processing: from cue integration to causal inference","volume":"16","author":"RL French","year":"2020","journal-title":"Curr Opin Physiol"},{"issue":"7","key":"pcbi.1013468.ref055","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1006110","article-title":"Bayesian comparison of explicit and implicit causal inference strategies in multisensory heading perception","volume":"14","author":"L Acerbi","year":"2018","journal-title":"PLoS Comput Biol"},{"issue":"2","key":"pcbi.1013468.ref056","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1005229","article-title":"A Causal Inference Model Explains Perception of the McGurk Effect and Other Incongruent Audiovisual Speech","volume":"13","author":"JF Magnotti","year":"2017","journal-title":"PLoS Comput Biol"},{"issue":"5","key":"pcbi.1013468.ref057","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1167\/15.5.22","article-title":"Sensory reliability shapes perceptual inference via two mechanisms","volume":"15","author":"T Rohe","year":"2015","journal-title":"J Vis"},{"issue":"2","key":"pcbi.1013468.ref058","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pbio.1002073","article-title":"Cortical hierarchies perform Bayesian causal inference in multisensory perception","volume":"13","author":"T Rohe","year":"2015","journal-title":"PLoS Biol"},{"issue":"4","key":"pcbi.1013468.ref059","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pbio.3000210","article-title":"To integrate or not to integrate: Temporal dynamics of hierarchical Bayesian causal inference","volume":"17","author":"M Aller","year":"2019","journal-title":"PLoS Biol"},{"issue":"6870","key":"pcbi.1013468.ref060","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/415429a","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"MO Ernst","year":"2002","journal-title":"Nature"},{"issue":"3","key":"pcbi.1013468.ref061","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.cub.2004.01.029","article-title":"The ventriloquist effect results from near-optimal bimodal integration","volume":"14","author":"D Alais","year":"2004","journal-title":"Curr Biol"},{"issue":"4","key":"pcbi.1013468.ref062","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1016\/j.tics.2004.02.002","article-title":"Merging the senses into a robust percept","volume":"8","author":"MO Ernst","year":"2004","journal-title":"Trends Cogn Sci"},{"issue":"1","key":"pcbi.1013468.ref063","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1146\/annurev-psych-011624-025340","article-title":"Attentional Capture and Control","volume":"76","author":"J Theeuwes","year":"2025","journal-title":"Annu Rev Psychol"},{"issue":"1","key":"pcbi.1013468.ref064","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1080\/13506280444000157","article-title":"Direct gaze captures visuospatial attention","volume":"12","author":"A Senju","year":"2005","journal-title":"Visual Cognition"},{"issue":"10","key":"pcbi.1013468.ref065","doi-asserted-by":"crossref","first-page":"2293","DOI":"10.1177\/17470218231161044","article-title":"Are social interactions preferentially attended in real-world scenes? Evidence from change blindness","volume":"76","author":"M Barzy","year":"2023","journal-title":"Q J Exp Psychol (Hove)"},{"issue":"10","key":"pcbi.1013468.ref066","doi-asserted-by":"crossref","first-page":"2303","DOI":"10.1177\/17470218221140879","article-title":"Attentional bias towards social interactions during viewing of naturalistic scenes","volume":"76","author":"S Skripkauskaite","year":"2023","journal-title":"Q J Exp Psychol (Hove)"},{"key":"pcbi.1013468.ref067","doi-asserted-by":"crossref","first-page":"104029","DOI":"10.1016\/j.cognition.2019.104029","article-title":"Human body motion captures visual attention and elicits pupillary dilation","volume":"193","author":"EH Williams","year":"2019","journal-title":"Cognition"},{"issue":"3","key":"pcbi.1013468.ref068","doi-asserted-by":"crossref","first-page":"720","DOI":"10.1177\/0956797613516147","article-title":"Catching eyes: effects of social and nonsocial cues on attention capture","volume":"25","author":"A B\u00f6ckler","year":"2014","journal-title":"Psychol Sci"},{"issue":"6","key":"pcbi.1013468.ref069","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1177\/09567976241242995","article-title":"Visual Preference for Socially Relevant Spatial Relations in Humans and Monkeys","volume":"35","author":"N Goupil","year":"2024","journal-title":"Psychol Sci"},{"issue":"2","key":"pcbi.1013468.ref070","doi-asserted-by":"crossref","first-page":"408","DOI":"10.3758\/s13414-021-02429-4","article-title":"Self-related objects increase alertness and orient attention through top-down saliency","volume":"84","author":"B Li","year":"2022","journal-title":"Atten Percept Psychophys"},{"issue":"9","key":"pcbi.1013468.ref071","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1037\/xhp0001013","article-title":"Social relevance modulates multisensory integration","volume":"48","author":"M Scheller","year":"2022","journal-title":"J Exp Psychol Hum Percept Perform"},{"issue":"2","key":"pcbi.1013468.ref072","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1111\/bjop.12683","article-title":"Self as a prior: The malleability of Bayesian multisensory integration to social salience","volume":"115","author":"M Scheller","year":"2024","journal-title":"Br J Psychol"},{"issue":"11","key":"pcbi.1013468.ref073","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pbio.3001465","article-title":"Attention controls multisensory perception via two distinct mechanisms at different levels of the cortical hierarchy","volume":"19","author":"A Ferrari","year":"2021","journal-title":"PLoS Biol"},{"issue":"3","key":"pcbi.1013468.ref074","first-page":"967","article-title":"Effects of degree of visual association and angle of displacement on the \u201cventriloquism\u201d effect","volume":"37","author":"CE Jack","year":"1973","journal-title":"Percept Mot Skills"},{"issue":"4","key":"pcbi.1013468.ref075","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.3758\/BRM.41.4.1149","article-title":"Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses","volume":"41","author":"F Faul","year":"2009","journal-title":"Behav Res Methods"},{"key":"pcbi.1013468.ref076","unstructured":"Majdak P. ARI HRTF database. 2022. Available: https:\/\/www.oeaw.ac.at\/isf\/das-institut\/software\/hrtf-database"},{"key":"pcbi.1013468.ref077","first-page":"456","article-title":"Virtual sound source positioning using vector base amplitude panning","volume":"45","author":"V Pulkki","year":"1997","journal-title":"J Audio Eng Soc"},{"issue":"12","key":"pcbi.1013468.ref078","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1004649","article-title":"Biases in Visual, Auditory, and Audiovisual Perception of Space","volume":"11","author":"B Odegaard","year":"2015","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1013468.ref079","doi-asserted-by":"crossref","first-page":"104409","DOI":"10.1016\/j.cognition.2020.104409","article-title":"Updating spatial hearing abilities through multisensory and motor cues","volume":"204","author":"C Valzolgher","year":"2020","journal-title":"Cognition"},{"issue":"1","key":"pcbi.1013468.ref080","doi-asserted-by":"crossref","first-page":"2469","DOI":"10.1038\/s41598-024-51892-0","article-title":"Spatial hearing training in virtual reality with simulated asymmetric hearing loss","volume":"14","author":"C Valzolgher","year":"2024","journal-title":"Sci Rep"},{"issue":"8","key":"pcbi.1013468.ref081","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1000871","article-title":"Probability matching as a computational strategy used in perception","volume":"6","author":"DR Wozny","year":"2010","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pcbi.1013468.ref082","doi-asserted-by":"crossref","first-page":"1907","DOI":"10.1038\/s41467-019-09664-2","article-title":"The neural dynamics of hierarchical Bayesian causal inference in multisensory perception","volume":"10","author":"T Rohe","year":"2019","journal-title":"Nat Commun"},{"key":"pcbi.1013468.ref083","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/B978-0-12-812492-5.00005-X","article-title":"Computational models of multisensory integration","author":"D Meijer","year":"2020","journal-title":"Multisensory Perception"},{"issue":"430","key":"pcbi.1013468.ref084","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1080\/01621459.1995.10476572","article-title":"Bayes Factors","volume":"90","author":"RE Kass","year":"1995","journal-title":"Journal of the American Statistical Association"},{"issue":"4","key":"pcbi.1013468.ref085","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1016\/j.neuroimage.2009.03.025","article-title":"Bayesian model selection for group studies","volume":"46","author":"KE Stephan","year":"2009","journal-title":"Neuroimage"},{"issue":"6","key":"pcbi.1013468.ref086","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/nrn3503","article-title":"Bridging the gap between theories of sensory cue integration and the physiology of multisensory neurons","volume":"14","author":"CR Fetsch","year":"2013","journal-title":"Nat Rev Neurosci"},{"key":"pcbi.1013468.ref087","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.cortex.2019.03.026","article-title":"Integration of audiovisual spatial signals is not consistent with maximum likelihood estimation","volume":"119","author":"D Meijer","year":"2019","journal-title":"Cortex"},{"issue":"1","key":"pcbi.1013468.ref088","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1038\/nn.2983","article-title":"Neural correlates of reliability-based cue weighting during multisensory integration","volume":"15","author":"CR Fetsch","year":"2011","journal-title":"Nat Neurosci"},{"issue":"5","key":"pcbi.1013468.ref089","article-title":"Causal Inference in the Multisensory Brain","volume":"102","author":"Y Cao","year":"2019","journal-title":"Neuron"},{"key":"pcbi.1013468.ref090","volume-title":"Spatial hearing: the psychophysics of human sound localization","author":"J Blauert","year":"2008","edition":"6"},{"key":"pcbi.1013468.ref091","doi-asserted-by":"crossref","first-page":"1695","DOI":"10.1121\/1.394282","article-title":"Localization of sound in rooms, III: Onset and duration effects","volume":"80","author":"B Rakerd","year":"1986","journal-title":"J Acoust Soc Am"},{"issue":"3","key":"pcbi.1013468.ref092","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1177\/1745691613475454","article-title":"Cue Integration: A Common Framework for Social Cognition and Physical Perception","volume":"8","author":"J Zaki","year":"2013","journal-title":"Perspect Psychol Sci"},{"issue":"1955","key":"pcbi.1013468.ref093","first-page":"20210500","article-title":"More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension","volume":"288","author":"Y Zhang","year":"2021","journal-title":"Proc Biol Sci"},{"key":"pcbi.1013468.ref094","doi-asserted-by":"crossref","first-page":"1136","DOI":"10.1177\/17456916221141422","article-title":"Interactionally Embedded Gestalt Principles of Multimodal Human Communication","volume":"18","author":"JP Trujillo","year":"2023","journal-title":"Perspect Psychol Sci"},{"issue":"5","key":"pcbi.1013468.ref095","doi-asserted-by":"crossref","first-page":"1809","DOI":"10.1111\/brv.12535","article-title":"Multimodal communication and language origins: integrating gestures and vocalizations","volume":"94","author":"M Fr\u00f6hlich","year":"2019","journal-title":"Biol Rev Camb Philos Soc"},{"key":"pcbi.1013468.ref096","first-page":"39","article-title":"On the human \u201cinteraction engine.\u201d","volume-title":"Roots of human sociality: culture, cognition and interaction","author":"SC Levinson","year":"2006"},{"issue":"1859","key":"pcbi.1013468.ref097","doi-asserted-by":"crossref","first-page":"20210092","DOI":"10.1098\/rstb.2021.0092","article-title":"Revisiting the human \u201cinteraction engine\u201d: comparative approaches to social action coordination","volume":"377","author":"R Heesen","year":"2022","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"7","key":"pcbi.1013468.ref098","doi-asserted-by":"crossref","first-page":"728","DOI":"10.1177\/0956797612438734","article-title":"Electrophysiological evidence for the understanding of maternal speech by 9-month-old infants","volume":"23","author":"E Parise","year":"2012","journal-title":"Psychol Sci"},{"issue":"8","key":"pcbi.1013468.ref099","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0072360","article-title":"Neural responses to multimodal ostensive signals in 5-month-old infants","volume":"8","author":"E Parise","year":"2013","journal-title":"PLoS One"},{"issue":"14","key":"pcbi.1013468.ref100","doi-asserted-by":"crossref","first-page":"9602","DOI":"10.1073\/pnas.152159999","article-title":"Eye contact detection in humans from birth","volume":"99","author":"T Farroni","year":"2002","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1013468.ref101","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7551.001.0001","volume-title":"Origins of human communication","author":"M Tomasello","year":"2008"},{"issue":"4","key":"pcbi.1013468.ref102","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.tics.2009.01.005","article-title":"Natural pedagogy","volume":"13","author":"G Csibra","year":"2009","journal-title":"Trends Cogn Sci"},{"issue":"1567","key":"pcbi.1013468.ref103","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1098\/rstb.2010.0319","article-title":"Natural pedagogy as evolutionary adaptation","volume":"366","author":"G Csibra","year":"2011","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"1","key":"pcbi.1013468.ref104","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1162\/jocn.2009.21187","article-title":"Cross-cultural reading the mind in the eyes: an fMRI investigation","volume":"22","author":"Jr Adams RB","year":"2010","journal-title":"J Cogn Neurosci"},{"issue":"7","key":"pcbi.1013468.ref105","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1111\/j.1467-9280.2007.01946.x","article-title":"The effect of culture on perspective taking","volume":"18","author":"S Wu","year":"2007","journal-title":"Psychol Sci"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1013468","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T00:00:00Z","timestamp":1758240000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013468","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T21:52:37Z","timestamp":1758318757000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013468"}},"subtitle":[],"editor":[{"given":"Zhiyi","family":"Chen","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2025,9,12]]},"references-count":105,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9,12]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1013468","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2025.02.19.638980","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,12]]}}}