{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T23:09:47Z","timestamp":1784675387159,"version":"3.55.0"},"reference-count":33,"publisher":"Acoustical Society of America (ASA)","issue":"1","funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["RGPIN-2021-03182"],"award-info":[{"award-number":["RGPIN-2021-03182"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008240","name":"Soci\u00e9t\u00e9 et culture","doi-asserted-by":"publisher","award":["doi.org\/10.69777\/263513"],"award-info":[{"award-number":["doi.org\/10.69777\/263513"]}],"id":[{"id":"10.13039\/100008240","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,1,1]]},"abstract":"<jats:p>Speech takes place in physical environments with visual and acoustic properties, yet how these elements and their interaction influence speech production is not fully understood. While a room's appearance can suggest its acoustics, it is unclear whether people adjust their speech based on this visual information. Previous research shows that higher reverberation leads to reduced speech level, but how auditory and visual information interact in this process remains limited. This study examined how audiovisual information affects speech level by immersing participants in virtual environments with varying reverberation and room visuals (hemi-anechoic room, classroom, and gymnasium) while completing speech tasks. Speech level was analyzed using generalized additive mixed-effects modeling to assess temporal changes during utterances across conditions. Results showed that visual information significantly influenced speech level, though not strictly in line with expected acoustics or perceived room size; auditory information had a stronger overall effect than visual information. Visual information had an earlier influence that diminished over time, whereas the auditory effect increased and plateaued. These findings contribute to the understanding of multisensory integration in speech control and have implications in enhancing vocal performance and supporting more naturalistic communication in virtual environments.<\/jats:p>","DOI":"10.1121\/10.0042240","type":"journal-article","created":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T13:23:20Z","timestamp":1768310600000},"page":"384-397","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":1,"title":["The temporal effects of auditory and visual immersion on speech level in virtual environments"],"prefix":"10.1121","volume":"159","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9622-9498","authenticated-orcid":false,"given":"Xinyi N.","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, \u00c9cole de Technologie Sup\u00e9rieure 1 , Montr\u00e9al, Qu\u00e9bec H3C 1K3,","place":["Canada"]},{"name":"Centre for Interdisciplinary Research in Music Media and Technology 2 , Montr\u00e9al, Qu\u00e9bec H3A 1E3,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5738-8980","authenticated-orcid":false,"given":"Arian","family":"Shamei","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, \u00c9cole de Technologie Sup\u00e9rieure 1 , Montr\u00e9al, Qu\u00e9bec H3C 1K3,","place":["Canada"]},{"name":"Centre for Interdisciplinary Research in Music Media and Technology 2 , Montr\u00e9al, Qu\u00e9bec H3A 1E3,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9945-8318","authenticated-orcid":false,"given":"Florian","family":"Grond","sequence":"additional","affiliation":[{"name":"Department of Design and Computation Arts, Concordia University 3 , Montr\u00e9al, Qu\u00e9bec H3G 1M8,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1881-3216","authenticated-orcid":false,"given":"Ingrid","family":"Verduyckt","sequence":"additional","affiliation":[{"name":"\u00c9cole d'orthophonie et d'audiologie, Universit\u00e9 de Montr\u00e9al 4 , Montr\u00e9al, Qu\u00e9bec H3N 1X7,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0460-5798","authenticated-orcid":false,"given":"Rachel E.","family":"Bouserhal","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, \u00c9cole de Technologie Sup\u00e9rieure 1 , Montr\u00e9al, Qu\u00e9bec H3C 1K3,","place":["Canada"]},{"name":"Centre for Interdisciplinary Research in Music Media and Technology 2 , Montr\u00e9al, Qu\u00e9bec H3A 1E3,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"231","published-online":{"date-parts":[[2026,1,13]]},"reference":[{"issue":"3","key":"2026011308231924900_c1","doi-asserted-by":"publisher","first-page":"1586","DOI":"10.1121\/10.0013991","article-title":"Auditory spatial analysis in reverberant multi-talker environments with congruent and incongruent audio-visual room information","volume":"152","year":"2022","journal-title":"J. Acoust. Soc. Am."},{"issue":"1","key":"2026011308231924900_c2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","article-title":"Fitting linear mixed-effects models using lme4","volume":"67","year":"2015","journal-title":"J. Stat. Soft."},{"issue":"2","key":"2026011308231924900_c3","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1121\/1.1906585","article-title":"The effect of room characteristics upon vocal intensity and rate","volume":"22","year":"1950","journal-title":"J. Acoust. Soc. Am."},{"key":"2026011308231924900_c4","first-page":"341","article-title":"Speak and unSpeak with PRAAT","volume":"5","year":"2001","journal-title":"Glot Int."},{"issue":"5","key":"2026011308231924900_c5","doi-asserted-by":"publisher","first-page":"2870","DOI":"10.1121\/1.4950812","article-title":"Effects of speech style, room acoustics, and vocal fatigue on vocal effort","volume":"139","year":"2016","journal-title":"J. Acoust. Soc. Am."},{"issue":"1","key":"2026011308231924900_c6","doi-asserted-by":"publisher","first-page":"169","DOI":"10.3813\/AAA.919043","article-title":"Evaluation of the starting point of the Lombard effect","volume":"103","year":"2017","journal-title":"Acta Acust. united Acust."},{"issue":"12","key":"2026011308231924900_c7","doi-asserted-by":"publisher","first-page":"3393","DOI":"10.1044\/2017_jslhr-s-17-0052","article-title":"Modeling speech level as a function of background noise level and talker-to-listener distance for talkers wearing hearing protection devices","volume":"60","year":"2017","journal-title":"J. Speech Lang. Hear. Res."},{"issue":"6","key":"2026011308231924900_c8","doi-asserted-by":"publisher","first-page":"1713","DOI":"10.1007\/s00221-018-5248-9","article-title":"The impact of perilaryngeal vibration on the self-perception of loudness and the Lombard effect","volume":"236","year":"2018","journal-title":"Exp. Brain Res."},{"issue":"11\/13","key":"2026011308231924900_c9","doi-asserted-by":"publisher","first-page":"1173","DOI":"10.1163\/000579511X605759","article-title":"The evolution of the Lombard effect: 100 years of psychoacoustic research","volume":"148","year":"2011","journal-title":"Behaviour"},{"key":"2026011308231924900_c10","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2023.07.026","article-title":"The influence of multisensory input on voice perception and production using immersive virtual reality","year":"2023","journal-title":"J. Voice"},{"issue":"1","key":"2026011308231924900_c11","doi-asserted-by":"publisher","first-page":"13","DOI":"10.2174\/1875934301407010013","article-title":"Bimodal interaction: The role of visual information in performing acoustic assessment in architecture","volume":"7","year":"2015","journal-title":"Ergonomics Open J."},{"key":"2026011308231924900_c12","volume-title":"An R Companion to Applied Regression","year":"2019","edition":"3"},{"issue":"5","key":"2026011308231924900_c13","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1016\/j.jcomdis.2006.06.013","article-title":"Cortical interactions underlying the production of speech sounds","volume":"39","year":"2006","journal-title":"J. Commun. Disord."},{"key":"2026011308231924900_c14","unstructured":"Lenth, R. V. (2022). \u201cemmeans: Estimated marginal means, aka least-squares means, R package version 1.7.5,\u201d https:\/\/CRAN.R-project.org\/package=emmeans (Last viewed 10\/3\/2024)."},{"issue":"4","key":"2026011308231924900_c15","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1016\/j.jvoice.2023.07.016","article-title":"Investigating the impact of visual input on voice production in virtual reality","volume":"39","year":"2025","journal-title":"J. Voice"},{"issue":"3","key":"2026011308231924900_c16","doi-asserted-by":"publisher","first-page":"1456","DOI":"10.1121\/1.5092807","article-title":"Current models of speech motor control: A control-theoretic overview of architectures and properties","volume":"145","year":"2019","journal-title":"J. Acoust. Soc. Am."},{"issue":"1","key":"2026011308231924900_c17","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1121\/1.3598429","article-title":"Equal autophonic level curves under different room acoustics conditions","volume":"130","year":"2011","journal-title":"J. Acoust. Soc. Am."},{"issue":"4","key":"2026011308231924900_c18","doi-asserted-by":"publisher","first-page":"1981","DOI":"10.1121\/1.3552881","article-title":"Vocal effort with changing talker-to-listener distance in different acoustic environments","volume":"129","year":"2011","journal-title":"J. Acoust. Soc. Am."},{"issue":"4","key":"2026011308231924900_c19","doi-asserted-by":"publisher","first-page":"2288","DOI":"10.1121\/1.2173514","article-title":"Compensation following real-time manipulation of formants in isolated vowels","volume":"119","year":"2006","journal-title":"J. Acoust. Soc. Am."},{"key":"2026011308231924900_c20","unstructured":"R Core Team (2022). \u201cR: A language and environment for statistical computing,\u201d https:\/\/www.R-project.org\/ (Last viewed 10\/3\/2024)."},{"issue":"3","key":"2026011308231924900_c21","doi-asserted-by":"publisher","first-page":"EL229","DOI":"10.1121\/1.5093642","article-title":"The percept of reverberation is not affected by visual room impression in virtual environments","volume":"145","year":"2019","journal-title":"J. Acoust. Soc. Am."},{"issue":"5","key":"2026011308231924900_c22","doi-asserted-by":"publisher","first-page":"1618","DOI":"10.1121\/1.1903486","article-title":"Auditory feedback in the regulation of voice","volume":"56","year":"1974","journal-title":"J. Acoust. Soc. Am."},{"key":"2026011308231924900_c23","doi-asserted-by":"publisher","first-page":"666152","DOI":"10.3389\/fbuil.2021.666152","article-title":"Changes of voice production in artificial acoustic environments","volume":"7","year":"2021","journal-title":"Front. Built Environ."},{"key":"2026011308231924900_c24","unstructured":"Simpson, G. L. (2024). \u201cgratia: Graceful ggplot-based graphics and other functions for GAMs fitted using mgcv, R package version 0.9.2,\u201d https:\/\/gavinsimpson.github.io\/gratia\/ (Last viewed 10\/9\/2024)."},{"issue":"4","key":"2026011308231924900_c25","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1016\/j.jvoice.2021.03.027","article-title":"Effects of sidetone amplification on vocal function during telecommunication","volume":"37","year":"2023","journal-title":"J. Voice"},{"issue":"7-8","key":"2026011308231924900_c26","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1163\/22134808-bja10082","article-title":"Relating sound and sight in simulated environments","volume":"35","year":"2022","journal-title":"Multisens. Res."},{"key":"2026011308231924900_c27","unstructured":"Tsang, K. Y.-T. (2023). \u201cThe influence of vision on the perceptual compensation for reverberation in simulated environments,\u201d Ph.D. thesis, University of New South Wales, Sydney, NSW, Australia."},{"key":"2026011308231924900_c28","unstructured":"van Rij, J., Wieling, M., Baayen, R. H., and van Rijn, H. (2022). \u201citsadug: Interpreting time series and autocorrelated data using GAMMs, R package version 2.4.1,\u201d https:\/\/jacolien.r-universe.dev\/itsadug (Last viewed 6\/30\/2022)."},{"issue":"3","key":"2026011308231924900_c29","doi-asserted-by":"publisher","first-page":"1855","DOI":"10.1121\/10.0003772","article-title":"Effects of task and language nativeness on the Lombard effect and on its onset and offset timing","volume":"149","year":"2021","journal-title":"J. Acoust. Soc. Am."},{"key":"2026011308231924900_c30","doi-asserted-by":"crossref","unstructured":"Wickham, H. (2016). \u201cggplot2,\u201d https:\/\/ggplot2.tidyverse.org (Last viewed 6\/6\/2025).","DOI":"10.1007\/978-3-319-24277-4"},{"key":"2026011308231924900_c31","unstructured":"Wickham, H., Fran\u00e7ois, R., Henry, L., M\u00fcller, K., and Vaughan, D. (2023). \u201cdplyr: A grammar of data manipulation\u201d, GitHub, https:\/\/github.com\/tidyverse\/dplyr."},{"key":"2026011308231924900_c32","volume-title":"Generalized Additive Models: An Introduction with R","year":"2017","edition":"2"},{"issue":"2","key":"2026011308231924900_c33","doi-asserted-by":"publisher","first-page":"1168","DOI":"10.1121\/1.1763952","article-title":"Compensation for pitch-shifted auditory feedback during the production of Mandarin tone sequences","volume":"116","year":"2004","journal-title":"J. Acoust. Soc. Am."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/159\/1\/384\/20870018\/384_1_10.0042240.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/159\/1\/384\/20870018\/384_1_10.0042240.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T13:23:23Z","timestamp":1768310603000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/159\/1\/384\/3377324\/The-temporal-effects-of-auditory-and-visual"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,1]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,1]]}},"URL":"https:\/\/doi.org\/10.1121\/10.0042240","relation":{},"ISSN":["1520-8524"],"issn-type":[{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,1]]},"published":{"date-parts":[[2026,1,1]]}}}