{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T16:45:52Z","timestamp":1786121152866,"version":"build-2736575974"},"reference-count":23,"publisher":"Walter de Gruyter GmbH","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Multisens. Res."],"published-print":{"date-parts":[[2026,1,21]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Seeing facial speech plays a crucial role in allowing listeners to understand a person\u2019s speech. Since the COVID pandemic\u2019s outbreak and during the pandemic, the use of facial speech became more difficult because most people routinely wore masks to prevent infection. This study investigates whether and how wearing a mask alters reliance on facial speech for audiovisual speech perception. In this cross-sectional study, we compared the task performance of Japanese young adults in audiovisual speech recognition (i.e., the McGurk effect) and lip-reading between prepandemic and postpandemic groups. For the prepandemic data, we used data from between June and July 2019 from a past study of ours; for the postpandemic data, we collected data from November 2022 to April 2023. The results showed that the amount of McGurk effect (i.e., the amount of reliance on facial speech) in the postpandemic data was comparable to that in prepandemic data. Additionally, there were no significant differences on lip-reading accuracy nor on audiovisual congruent speech recognition. The results imply that, among Japanese young adults, the perceiver\u2019s reliance on visual speech as a strategy during audiovisual speech processing did not significantly change between before and after the COVID-19 pandemic.<\/jats:p>","DOI":"10.1163\/22134808-bja10182","type":"journal-article","created":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T16:24:22Z","timestamp":1770308662000},"page":"493-504","source":"Crossref","is-referenced-by-count":0,"title":["The Effect of Mask Wearing on Lip-Reading and Audiovisual Speech Perception"],"prefix":"10.1163","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0637-7880","authenticated-orcid":true,"given":"Yuta","family":"Ujiie","sequence":"first","affiliation":[{"name":"Department of Psychology, College of Contemporary Psychology, Rikkyo University, 1-2-26 Kitano, Niiza-shi, Saitama 352-8558, Japan"},{"name":"Research Organization of Open Innovation and Collaboration, https:\/\/dx.doi.org\/12696Ritsumeikan University, 2-150 Iwakura-cho, Ibaraki, Osaka 567-8570, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6076-4828","authenticated-orcid":true,"given":"Kohske","family":"Takahashi","sequence":"additional","affiliation":[{"name":"College of Comprehensive Psychology, https:\/\/dx.doi.org\/12696Ritsumeikan University, 2-150 Iwakura-cho, Ibaraki, Osaka 567-8570, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","reference":[{"key":"R000001","series-title":"Cogn. Res. Principles Implications","first-page":"49","article-title":"Face mask type affects audiovisual speech intelligibility and subjective listening effort in young and older adults","volume":"6","author":"Brown, V.\u00a0A.","unstructured":"Brown, V.\u00a0A., Van Engen, K.\u00a0J. and Peelle, J.\u00a0E. (2021). Face mask type affects audiovisual speech intelligibility and subjective listening effort in young and older adults, Cogn. Res. Principles Implications 6, 49. DOI:10.1186\/s41235-021-00314-0."},{"key":"R000002","series-title":"Psychonom. Bull. Rev.","first-page":"992","article-title":"The McGurk effect in the time of pandemic: Age-dependent adaptation to an environmental loss of visual speech cues","volume":"28","author":"Chl\u00e1dkov\u00e1, K.","unstructured":"Chl\u00e1dkov\u00e1, K., Podlipsk\u00fd, V.\u00a0J., Nudga, N. and \u0160im\u00e1\u010dkov\u00e1, \u0160. (2021). The McGurk effect in the time of pandemic: Age-dependent adaptation to an environmental loss of visual speech cues, Psychonom. Bull. Rev. 28, 992\u20131002. DOI:10.3758\/s13423-020-01852-2."},{"key":"R000003","series-title":"Eur. J. Cogn. Psychol.","first-page":"69","article-title":"Face recognition and lip-reading in autism","volume":"3","author":"De Gelder, B.","unstructured":"De Gelder, B., Vroomen, J. and van\u00a0der Heide, L. (1991). Face recognition and lip-reading in autism, Eur. J. Cogn. Psychol. 3, 69\u201386. DOI:10.1080\/09541449108406220."},{"key":"R000004","series-title":"Sci. Rep.","article-title":"The COVID-19 pandemic masks the way people perceive faces","volume":"10","author":"Freud, E.","unstructured":"Freud, E., Stajduhar, A., Rosenbaum, R.\u00a0S., Avidan, G. and Ganel, T. (2020). The COVID-19 pandemic masks the way people perceive faces, Sci. Rep. 10, 22344. DOI:10.1038\/s41598-020-78986-9."},{"key":"R000005","series-title":"Sci. Rep.","article-title":"Language\/culture modulates brain and gaze processes in audiovisual speech perception","volume":"6","author":"Hisanaga, S.","unstructured":"Hisanaga, S., Sekiyama, K., Igasaki, T. and Murayama, N. (2016). Language\/culture modulates brain and gaze processes in audiovisual speech perception, Sci. Rep. 6, 35265. DOI:10.1038\/srep35265."},{"key":"R000006","series-title":"i-Perception","article-title":"Effects of Masks Worn to Protect Against COVID-19 on the Perception of Facial Attractiveness","volume":"12","author":"Kamatani, M.","unstructured":"Kamatani, M., Ito, M., Miyazaki, Y. and Kawahara, J.\u00a0I. (2021). Effects of Masks Worn to Protect Against COVID-19 on the Perception of Facial Attractiveness, i-Perception 12. DOI:10.1177\/20416695211027920."},{"key":"R000007","series-title":"Front. Psychol.","article-title":"Face masks impact auditory and audiovisual consonant recognition in children with and without hearing loss","volume":"13","author":"Lalonde, K.","unstructured":"Lalonde, K., Buss, E., Miller, M.\u00a0K. and Leibold, L.\u00a0J. (2022). Face masks impact auditory and audiovisual consonant recognition in children with and without hearing loss, Front. Psychol. 13, 874345. DOI:10.3389\/fpsyg.2022.874345."},{"key":"R000008","series-title":"Behav. Sci.","first-page":"951","article-title":"Habitual Mask Wearing as Part of COVID-19 Control in Japan: An Assessment Using the Self-Report Habit Index","volume":"13","author":"Li, T.","unstructured":"Li, T., Fujimoto, M., Hayashi, K., Anzai, A. and Nishiura, H. (2023). Habitual Mask Wearing as Part of COVID-19 Control in Japan: An Assessment Using the Self-Report Habit Index, Behav. Sci. 13, 951. DOI:10.3390\/bs13110951."},{"key":"R000009","series-title":"PLoS ONE","article-title":"Bayesian binding and fusion models explain illusion and enhancement effects in audiovisual speech perception","volume":"16","author":"Lindborg, A.","unstructured":"Lindborg, A. and Andersen, T.\u00a0S. (2021). Bayesian binding and fusion models explain illusion and enhancement effects in audiovisual speech perception, PLoS ONE 16, e0246986. DOI:10.1371\/journal.pone.0246986."},{"key":"R000010","series-title":"Exp. Brain Res.","first-page":"2581","article-title":"Similar frequency of the McGurk effect in large samples of native Mandarin Chinese and American English speakers","volume":"233","author":"Magnotti, J.\u00a0F.","unstructured":"Magnotti, J.\u00a0F., Basu Mallick, D., Feng, G., Zhou, B., Zhou, W. and Beauchamp, M.\u00a0S. (2015). Similar frequency of the McGurk effect in large samples of native Mandarin Chinese and American English speakers, Exp. Brain Res. 233, 2581\u20132586. DOI:10.1007\/s00221-015-4324-7."},{"key":"R000011","series-title":"Cortex","first-page":"371","article-title":"Weak observer\u2013level correlation and strong stimulus-level correlation between the McGurk effect and audiovisual speech-in-noise: A causal inference explanation","volume":"133","author":"Magnotti, J.\u00a0F.","unstructured":"Magnotti, J.\u00a0F., Dzeda, K.\u00a0B., Wegner-Clemens, K., Rennig, J. and Beauchamp, M.\u00a0S. (2020). Weak observer\u2013level correlation and strong stimulus-level correlation between the McGurk effect and audiovisual speech-in-noise: A causal inference explanation, Cortex 133, 371\u2013383. DOI:10.1016\/j.cortex.2020.10.002."},{"key":"R000012","series-title":"Nature","first-page":"746","article-title":"Hearing lips and seeing voices","volume":"264","author":"McGurk, H.","unstructured":"McGurk, H. and MacDonald, J.\u00a0W. (1976). Hearing lips and seeing voices, Nature 264, 746\u2013748. DOI:10.1038\/264746a0."},{"key":"R000013","series-title":"Jpn. Psychol. Res.","article-title":"Behind the mask: analyzing the dual influence of social norms on pandemic behavior in Japan","author":"Miura, A.","unstructured":"Miura, A., Murayama, A. and Kitamura, H. (2024). Behind the mask: analyzing the dual influence of social norms on pandemic behavior in Japan, Jpn. Psychol. Res. DOI:10.1111\/jpr.12520."},{"key":"R000014","series-title":"Curr. Direct. Psychol. Sci.","first-page":"405","article-title":"Speech perception as a multimodal phenomenon","volume":"17","author":"Rosenblum, L.\u00a0D.","unstructured":"Rosenblum, L.\u00a0D. (2008). Speech perception as a multimodal phenomenon, Curr. Direct. Psychol. Sci. 17, 405\u2013409. DOI:10.1111\/j.1467-8721.2008.00615.x."},{"key":"R000015","series-title":"Dev. Sci.","first-page":"303","article-title":"Impact of language on development of auditory-visual speech perception","volume":"11","author":"Sekiyama, K.","unstructured":"Sekiyama, K. and Burnham, D. (2008). Impact of language on development of auditory-visual speech perception, Dev. Sci. 11, 303\u2013317. DOI:10.1111\/j.1467-7687.2008.00677.x."},{"key":"R000016","series-title":"Front. Psychol.","first-page":"323","article-title":"Enhanced audiovisual integration with aging in speech perception: A heightened McGurk effect in older adults","volume":"5","author":"Sekiyama, K.","unstructured":"Sekiyama, K., Soshi, T. and Sakamoto, S. (2014). Enhanced audiovisual integration with aging in speech perception: A heightened McGurk effect in older adults, Front. Psychol. 5, 323. DOI:10.3389\/fpsyg.2014.00323."},{"key":"R000017","series-title":"J.\u00a0Acoust. Soc. Am.","first-page":"1797","article-title":"McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility","volume":"90","author":"Sekiyama, K.","unstructured":"Sekiyama, K. and Tohkura, Y. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility, J.\u00a0Acoust. Soc. Am. 90, 1797\u20131805. DOI:10.1121\/1.401660."},{"key":"R000018","series-title":"Front. Psychol.","article-title":"Susceptibility to a multisensory speech illusion in older persons is driven by perceptual processes","volume":"4","author":"Setti, A.","unstructured":"Setti, A., Burke, K.\u00a0E., Kenny, R. and Newell, F.\u00a0N. (2013). Susceptibility to a multisensory speech illusion in older persons is driven by perceptual processes, Front. Psychol. 4, Article 575. DOI:10.3389\/fpsyg.2013.00575."},{"key":"R000019","series-title":"J.\u00a0Acoust. Soc. Am.","first-page":"212","article-title":"Visual contribution to speech intelligibility in noise","volume":"26","author":"Sumby, W.\u00a0H.","unstructured":"Sumby, W.\u00a0H. and Pollack, I. (1954). Visual contribution to speech intelligibility in noise, J.\u00a0Acoust. Soc. Am. 26, 212\u2013215. DOI:10.1121\/1.1907309."},{"key":"R000020","series-title":"Front. Psychol.","article-title":"What is the McGurk effect?","volume":"5","author":"Tiippana, K.","unstructured":"Tiippana, K. (2014). What is the McGurk effect?, Front. Psychol. 5. DOI:10.3389\/fpsyg.2014.00725."},{"key":"R000021","series-title":"Brain Sci.","first-page":"1198","article-title":"Investigation of cross-language and stimulus-dependent effects on the McGurk effect with Finnish and Japanese speakers and listeners","volume":"13","author":"Tiippana, K.","unstructured":"Tiippana, K., Ujiie, Y., Peromaa, T. and Takahashi, K. (2023). Investigation of cross-language and stimulus-dependent effects on the McGurk effect with Finnish and Japanese speakers and listeners, Brain Sci. 13, 1198. DOI:10.3390\/brainsci13081198."},{"key":"R000022","series-title":"Exp. Brain Res.","first-page":"973","article-title":"Individual differences and the effect of face configuration contexts in the McGurk effect","volume":"236","author":"Ujiie, Y.","unstructured":"Ujiie, Y., Asai, T. and Wakabayashi, A. (2018). Individual differences and the effect of face configuration contexts in the McGurk effect, Exp. Brain Res. 236, 973\u2013984. DOI:10.1007\/s00221-018-5188-4."},{"key":"R000023","series-title":"Q.\u00a0J. Exp. Psychol.","first-page":"924","article-title":"Own-race faces promote integrated audiovisual speech information","volume":"75","author":"Ujiie, Y.","unstructured":"Ujiie, Y. and Takahashi, K. (2022). Own-race faces promote integrated audiovisual speech information, Q.\u00a0J. Exp. Psychol. 75, 924\u2013935. DOI:10.1177\/17470218211044480."}],"container-title":["Multisensory Research"],"original-title":[],"link":[{"URL":"https:\/\/brill.com\/view\/journals\/msr\/39\/6\/article-p493_2.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/brill.com\/downloadpdf\/journals\/msr\/39\/6\/article-p493_2.xml","content-type":"text\/html","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/brill.com\/downloadpdf\/journals\/msr\/39\/6\/article-p493_2.xml","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T03:11:43Z","timestamp":1786072303000},"score":1,"resource":{"primary":{"URL":"https:\/\/brill.com\/view\/journals\/msr\/39\/6\/article-p493_2.xml"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,21]]},"references-count":23,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.1163\/22134808-bja10182","relation":{},"ISSN":["2213-4794","2213-4808"],"issn-type":[{"value":"2213-4794","type":"print"},{"value":"2213-4808","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,21]]}}}