{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"bioRxiv"}],"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T21:18:29Z","timestamp":1792790309681,"version":"4.5.0"},"posted":{"date-parts":[[2026,9,13]]},"group-title":"Neuroscience","reference-count":61,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T00:00:00Z","timestamp":1789257600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institute on Deafness and Other Communication Disorders","award":["R01 DC019507"],"award-info":[{"award-number":["R01 DC019507"]}],"id":[{"id":"https:\/\/ror.org\/04mhx6838","id-type":"ROR","asserted-by":"crossref"}]},{"name":"National Institute on Deafness and Other Communication Disorders","award":["R01 DC013063"],"award-info":[{"award-number":["R01 DC013063"]}],"id":[{"id":"https:\/\/ror.org\/04mhx6838","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2026,9,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:p>\n                  Understanding speech requires listeners to integrate incoming input with prior linguistic and thematic knowledge to access meaning, a task greatly aided by prediction. Surprisal and related phenomena (e.g., next word prediction) tend to be associated with broad activation of language regions during listening. A major challenge for interpreting the neural correlates of surprisal is that lexical expectancies are constrained both by syntactic and semantic information. In contrast, semantic distance yields more of a pure metric of relatedness between one language constituent (e.g., word, phrase, n-gram) and another within a high-dimensional semantic space. We contrasted surprisal and semantic distance in running discourse during naturalistic audiovisual language comprehension. We analyzed fMRI scans from 20 English-speaking adults who viewed the full-length film\n                  <jats:italic>500 Days of Summer<\/jats:italic>\n                  . Our focus was on brain sensitivity to either surprisal or semantic distance as language unfolded word-by-word. To this end, we implemented a series of hierarchical voxelwise encoding models. After accounting for low-level auditory and visual features, the addition of either surprisal or semantic distance improved prediction in bilateral superior temporal gyrus (STG), left inferior frontal gyrus, and right cerebellum. Critically, both semantic distance and surprisal explained unique variation in bilateral temporal cortex after accounting for the other. These results support the notion that the brain tracks both broad probabilistic prediction as well as semantic integration. More generally, these findings extend previous work on auditory-only speech by demonstrating that surprisal and semantic distance predict meaningful neural variation even within a rich audiovisual context.\n                <\/jats:p>","DOI":"10.64898\/2026.09.09.749230","type":"posted-content","created":{"date-parts":[[2026,9,13]],"date-time":"2026-09-13T08:30:12Z","timestamp":1789288212000},"source":"Crossref","is-referenced-by-count":0,"title":["Neural tracking of surprisal and semantic distance in naturalistic movie viewing"],"prefix":"10.64898","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1042-0466","authenticated-orcid":false,"given":"Ryan M.","family":"O\u2019Leary","sequence":"first","affiliation":[{"name":"Institute for Cognitive and Brain Health, Northeastern University, 02115"},{"name":"Department of Communication Sciences and Disorders, Northeastern University, 02115"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-2327-8229","authenticated-orcid":false,"given":"Hailey C.","family":"Smith","sequence":"additional","affiliation":[{"name":"Institute for Cognitive and Brain Health, Northeastern University, 02115"},{"name":"Department of Psychology, Northeastern University, 02115"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9475-764X","authenticated-orcid":false,"given":"Emily B.","family":"Myers","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Connecticut, 06269"},{"name":"Department of Speech, Language, and Hearing Sciences, University of Connecticut, 06269"},{"name":"Institute for Brain and Cognitive Sciences, University of Connecticut, 06269"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0891-438X","authenticated-orcid":false,"given":"Jamie","family":"Reilly","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders, Temple University, 19122"},{"name":"Department of Psychology, Temple University , 19122"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9194-854X","authenticated-orcid":false,"given":"Jonathan E.","family":"Peelle","sequence":"additional","affiliation":[{"name":"Institute for Cognitive and Brain Health, Northeastern University, 02115"},{"name":"Department of Communication Sciences and Disorders, Northeastern University, 02115"},{"name":"Department of Psychology, Northeastern University, 02115"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2026091705450616000_2026.09.09.749230v1.1","first-page":"14","article-title":"Machine learning for neuroimaging with scikit-learn","volume":"8","year":"2014","journal-title":"Frontiers in Neuroinformatics"},{"issue":"1","key":"2026091705450616000_2026.09.09.749230v1.2","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1038\/s41597-020-00680-2","article-title":"A naturalistic neuroimaging database for understanding the brain using ecological stimuli","volume":"7","year":"2020","journal-title":"Scientific Data"},{"key":"2026091705450616000_2026.09.09.749230v1.3","first-page":"21895","article-title":"Scaling laws for language encoding models in fMRI","volume":"36","year":"2023","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2026091705450616000_2026.09.09.749230v1.4","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193014"},{"key":"2026091705450616000_2026.09.09.749230v1.5","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhp055"},{"key":"2026091705450616000_2026.09.09.749230v1.6","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2509.09152"},{"key":"2026091705450616000_2026.09.09.749230v1.7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.1002577"},{"issue":"2","key":"2026091705450616000_2026.09.09.749230v1.8","first-page":"1","article-title":"OpenCV","volume":"3","year":"2000","journal-title":"Dr. Dobb\u2019s Journal of Software Tools"},{"key":"2026091705450616000_2026.09.09.749230v1.9","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.72056"},{"key":"2026091705450616000_2026.09.09.749230v1.10","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2018.10.042"},{"key":"2026091705450616000_2026.09.09.749230v1.11","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2018.01.080"},{"key":"2026091705450616000_2026.09.09.749230v1.12","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0584-19.2019"},{"key":"2026091705450616000_2026.09.09.749230v1.13","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2023.105602"},{"key":"2026091705450616000_2026.09.09.749230v1.14","doi-asserted-by":"publisher","DOI":"10.3758\/BRM.41.4.977"},{"key":"2026091705450616000_2026.09.09.749230v1.15","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1492(199706\/08)10:4\/5<171::AID-NBM453>3.0.CO;2-L"},{"key":"2026091705450616000_2026.09.09.749230v1.16","doi-asserted-by":"publisher","DOI":"10.1093\/llc\/fqq018"},{"key":"2026091705450616000_2026.09.09.749230v1.17","doi-asserted-by":"crossref","unstructured":"Davis, M. H. , & Johnsrude, I. S . (2003). Hierarchical processing in spoken language comprehension. Journal of Neuroscience. https:\/\/www.jneurosci.org\/content\/23\/8\/3423.short","DOI":"10.1523\/JNEUROSCI.23-08-03423.2003"},{"key":"2026091705450616000_2026.09.09.749230v1.18","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2006.05.056"},{"key":"2026091705450616000_2026.09.09.749230v1.19","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0133402"},{"key":"2026091705450616000_2026.09.09.749230v1.20","doi-asserted-by":"publisher","DOI":"10.1016\/j.bandl.2014.10.006"},{"issue":"9","key":"2026091705450616000_2026.09.09.749230v1.21","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1080\/23273798.2017.1323109","article-title":"Word predictability and semantic similarity show distinct patterns of brain activity during language comprehension","volume":"32","year":"2017","journal-title":"Language, Cognition and Neuroscience"},{"key":"2026091705450616000_2026.09.09.749230v1.22","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2012.02.015"},{"key":"2026091705450616000_2026.09.09.749230v1.23","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2026.02.017"},{"key":"2026091705450616000_2026.09.09.749230v1.24","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-022-01026-4"},{"key":"2026091705450616000_2026.09.09.749230v1.25","doi-asserted-by":"publisher","DOI":"10.3115\/1073336.1073357"},{"key":"2026091705450616000_2026.09.09.749230v1.26","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2113"},{"key":"2026091705450616000_2026.09.09.749230v1.27","doi-asserted-by":"publisher","DOI":"10.1038\/nature17637"},{"key":"2026091705450616000_2026.09.09.749230v1.28","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.09.015"},{"key":"2026091705450616000_2026.09.09.749230v1.29","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-019-0436-x"},{"key":"2026091705450616000_2026.09.09.749230v1.30","doi-asserted-by":"publisher","DOI":"10.1037\/\/0033-295X.104.2.211"},{"key":"2026091705450616000_2026.09.09.749230v1.31","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0118-21.2021"},{"key":"2026091705450616000_2026.09.09.749230v1.32","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3203-16.2017"},{"key":"2026091705450616000_2026.09.09.749230v1.33","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2007.05.006"},{"key":"2026091705450616000_2026.09.09.749230v1.34","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2506.11338"},{"key":"2026091705450616000_2026.09.09.749230v1.35","doi-asserted-by":"publisher","DOI":"10.1038\/nrn.2016.150"},{"issue":"3","key":"2026091705450616000_2026.09.09.749230v1.36","first-page":"757","article-title":"The cerebellum is sensitive to the lexical properties of words during spoken language comprehension","volume":"5","year":"2024","journal-title":"Neurobiology of Language (Cambridge, Mass.)"},{"key":"2026091705450616000_2026.09.09.749230v1.37","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.cortex.2025.12.004","article-title":"Measuring brain sensitivity to semantic distance in spoken narrative comprehension","volume":"195","year":"2026","journal-title":"Cortex; a Journal Devoted to the Study of the Nervous System and Behavior"},{"issue":"1","key":"2026091705450616000_2026.09.09.749230v1.38","first-page":"107","article-title":"Strong prediction: Language model surprisal explains multiple N400 effects","volume":"5","year":"2024","journal-title":"Neurobiology of Language (Cambridge, Mass.)"},{"key":"2026091705450616000_2026.09.09.749230v1.39","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2264-13.2014"},{"key":"2026091705450616000_2026.09.09.749230v1.40","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.1058"},{"key":"2026091705450616000_2026.09.09.749230v1.41","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00548"},{"key":"2026091705450616000_2026.09.09.749230v1.42","first-page":"18001","volume-title":"Advances in Neural Information Processing Systems","volume":"36","year":"2023"},{"key":"2026091705450616000_2026.09.09.749230v1.43","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2277"},{"key":"2026091705450616000_2026.09.09.749230v1.44","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/d14-1162"},{"issue":"9","key":"2026091705450616000_2026.09.09.749230v1.45","doi-asserted-by":"crossref","first-page":"2578","DOI":"10.1037\/xge0001389","article-title":"Bigram semantic distance as an index of continuous semantic flow in natural language: Theory, tools, and applications","volume":"152","year":"2023","journal-title":"Journal of Experimental Psychology. General"},{"issue":"1","key":"2026091705450616000_2026.09.09.749230v1.46","doi-asserted-by":"crossref","first-page":"243","DOI":"10.3758\/s13423-024-02556-7","article-title":"What we mean when we say semantic: Toward a multidisciplinary semantic glossary","volume":"32","year":"2025","journal-title":"Psychonomic Bulletin & Review"},{"issue":"1","key":"2026091705450616000_2026.09.09.749230v1.47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0022-5371(73)80056-8","article-title":"Semantic distance and the verification of semantic relations","volume":"12","year":"1973","journal-title":"Journal of Verbal Learning and Verbal Behavior"},{"issue":"1","key":"2026091705450616000_2026.09.09.749230v1.48","doi-asserted-by":"crossref","first-page":"17838","DOI":"10.1038\/s41598-022-21782-4","article-title":"Explaining neural activity in human listeners with deep learning via natural language processing of narrative text","volume":"12","year":"2022","journal-title":"Scientific Reports"},{"issue":"117281","key":"2026091705450616000_2026.09.09.749230v1.49","first-page":"117281","article-title":"Semantics-weighted lexical surprisal modeling of naturalistic functional MRI time-series during spoken narrative listening","volume":"222","year":"2020","journal-title":"NeuroImage"},{"key":"2026091705450616000_2026.09.09.749230v1.50","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2013.02.013"},{"key":"2026091705450616000_2026.09.09.749230v1.51","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.03.061"},{"key":"2026091705450616000_2026.09.09.749230v1.52","doi-asserted-by":"publisher","DOI":"10.7554\/Elife.58077"},{"key":"2026091705450616000_2026.09.09.749230v1.53","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5069-11.2012"},{"key":"2026091705450616000_2026.09.09.749230v1.54","doi-asserted-by":"publisher","DOI":"10.1016\/j.jml.2021.104311"},{"issue":"3","key":"2026091705450616000_2026.09.09.749230v1.55","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1038\/s41562-023-01783-7","article-title":"Driving and suppressing the human language network using large language models","volume":"8","year":"2024","journal-title":"Nature Human Behaviour"},{"key":"2026091705450616000_2026.09.09.749230v1.56","doi-asserted-by":"publisher","DOI":"10.1038\/383254a0"},{"key":"2026091705450616000_2026.09.09.749230v1.57","doi-asserted-by":"publisher","DOI":"10.1162\/IMAG.a.1323"},{"key":"2026091705450616000_2026.09.09.749230v1.58","doi-asserted-by":"crossref","first-page":"23","DOI":"10.12688\/wellcomeopenres.10298.1","article-title":"Fixing the stimulus-as-fixed-effect fallacy in task fMRI","volume":"1","year":"2016","journal-title":"Wellcome Open Research"},{"key":"2026091705450616000_2026.09.09.749230v1.59","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhv075"},{"key":"2026091705450616000_2026.09.09.749230v1.60","doi-asserted-by":"crossref","unstructured":"Wolf, T. , Debut, L. , Sanh, V. , Chaumond, J. , Delangue, C. , Moi, A. , Cistac, P. , Rault, T. , Louf, R. , Funtowicz, M. , Davison, J. , Shleifer, S. , von Platen, P. , Ma, C. , Jernite, Y. , Plu, J. , Xu, C. , Le Scao, T. , Gugger, S. , \u2026 Rush, A . (2020). Transformers: State-of-the-art natural language processing. In Q. Liu & D. Schlangen (Eds.), Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations (pp. 38\u201345). Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"issue":"e1","key":"2026091705450616000_2026.09.09.749230v1.61","first-page":"e1","article-title":"The generalizability crisis","volume":"45","year":"2020","journal-title":"The Behavioral and Brain Sciences"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.64898\/2026.09.09.749230","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T12:45:18Z","timestamp":1789649118000},"score":1,"resource":{"primary":{"URL":"http:\/\/biorxiv.org\/lookup\/doi\/10.64898\/2026.09.09.749230"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,13]]},"references-count":61,"URL":"https:\/\/doi.org\/10.64898\/2026.09.09.749230","relation":{},"subject":[],"published":{"date-parts":[[2026,9,13]]},"subtype":"preprint"}}