{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T01:41:38Z","timestamp":1790559698870,"version":"4.1.0"},"reference-count":41,"publisher":"eLife Sciences Publications, Ltd","license":[{"start":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T00:00:00Z","timestamp":1619049600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T00:00:00Z","timestamp":1619049600000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T00:00:00Z","timestamp":1619049600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["elifesciences.org"],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>Learning about temporal structure is adaptive because it enables the generation of expectations. We examined how the brain uses experience in structured environments to anticipate upcoming events. During fMRI (functional magnetic resonance imaging), individuals watched a 90 s movie clip six times. Using a hidden Markov model applied to searchlights across the whole brain, we identified temporal shifts between activity patterns evoked by the first vs. repeated viewings of the movie clip. In many regions throughout the cortex, neural activity patterns for repeated viewings shifted to precede those of initial viewing by up to 15 s. This anticipation varied hierarchically in a posterior (less anticipation) to anterior (more anticipation) fashion. We also identified specific regions in which the timing of the brain\u2019s event boundaries was related to those of human-labeled event boundaries, with the timing of this relationship shifting on repeated viewings. With repeated viewing, the brain\u2019s event boundaries came to precede human-annotated boundaries by 1\u20134 s on average. Together, these results demonstrate a hierarchy of anticipatory signals in the human brain and link them to subjective experiences of events.<\/jats:p>","DOI":"10.7554\/elife.64972","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T08:05:26Z","timestamp":1619078726000},"update-policy":"https:\/\/doi.org\/10.7554\/elife.64972","source":"Crossref","is-referenced-by-count":88,"title":["Anticipation of temporally structured events in the brain"],"prefix":"10.7554","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7769-8799","authenticated-orcid":true,"given":"Caroline S","family":"Lee","sequence":"first","affiliation":[{"name":"Columbia University, Department of Psychology, New York, United States"},{"name":"Dartmouth College, Department of Psychological and Brain Sciences, Hanover, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4033-6134","authenticated-orcid":true,"given":"Mariam","family":"Aly","sequence":"additional","affiliation":[{"name":"Columbia University, Department of Psychology, New York, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3540-5019","authenticated-orcid":true,"given":"Christopher","family":"Baldassano","sequence":"additional","affiliation":[{"name":"Columbia University, Department of Psychology, New York, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4374","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"bib1","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2014.00069","article-title":"A general role for medial prefrontal cortex in event prediction","volume":"8","author":"Alexander","year":"2014","journal-title":"Frontiers in Computational Neuroscience"},{"key":"bib2","doi-asserted-by":"publisher","first-page":"2960","DOI":"10.1523\/JNEUROSCI.3730-10.2010","article-title":"Stimulus predictability reduces responses in primary visual cortex","volume":"30","author":"Alink","year":"2010","journal-title":"Journal of Neuroscience"},{"key":"bib3","doi-asserted-by":"publisher","first-page":"1345","DOI":"10.1162\/jocn_a_01308","article-title":"Learning naturalistic temporal structure in the posterior medial network","volume":"30","author":"Aly","year":"2018","journal-title":"Journal of Cognitive Neuroscience"},{"key":"bib4","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1016\/j.cortex.2015.11.024","article-title":"Repetition suppression and its contextual determinants in predictive coding","volume":"80","author":"Auksztulewicz","year":"2016","journal-title":"Cortex"},{"key":"bib5","doi-asserted-by":"publisher","first-page":"709","DOI":"10.1016\/j.neuron.2017.06.041","article-title":"Discovering event structure in continuous narrative perception and memory","volume":"95","author":"Baldassano","year":"2017","journal-title":"Neuron"},{"key":"bib6","doi-asserted-by":"publisher","first-page":"9689","DOI":"10.1523\/JNEUROSCI.0251-18.2018","article-title":"Representation of Real-World event schemas during narrative perception","volume":"38","author":"Baldassano","year":"2018","journal-title":"The Journal of Neuroscience"},{"key":"bib7","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-22632-z","article-title":"Neural integration underlying naturalistic prediction flexibly adapts to varying sensory input rate","volume":"12","author":"Baumgarten","year":"2021","journal-title":"Nature Communications"},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.1101\/786434","article-title":"Predictive representations in hippocampal and prefrontal hierarchies","volume-title":"bioRxiv","author":"Brunec","year":"2019"},{"key":"bib9","article-title":"A Reduced-Dimension fMRI shared response model","author":"Chen","year":"2015","unstructured":"Chen P-H, Chen J, Yeshurun Y, Hasson U, Haxby JV, Ramadge PJ. 2015. A Reduced-Dimension fMRI shared response model. Advances in Neural Information Processing Systems."},{"key":"bib10","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nn.4450","article-title":"Shared memories reveal shared structure in neural activity across individuals","volume":"20","author":"Chen","year":"2017","journal-title":"Nature Neuroscience"},{"key":"bib11","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1017\/S0140525X12000477","article-title":"Whatever next? predictive brains, situated agents, and the future of cognitive science","volume":"36","author":"Clark","year":"2013","journal-title":"Behavioral and Brain Sciences"},{"key":"bib12","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1006\/cbmr.1996.0014","article-title":"AFNI: software for analysis and visualization of functional magnetic resonance neuroimages","volume":"29","author":"Cox","year":"1996","journal-title":"Computers and Biomedical Research"},{"key":"bib13","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1162\/neco.1993.5.4.613","article-title":"Improving generalization for temporal difference learning: the successor representation","volume":"5","author":"Dayan","year":"1993","journal-title":"Neural Computation"},{"key":"bib14","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1016\/j.tics.2018.06.002","article-title":"How do expectations shape perception?","volume":"22","author":"de Lange","year":"2018","journal-title":"Trends in Cognitive Sciences"},{"key":"bib15","doi-asserted-by":"publisher","first-page":"3210","DOI":"10.1523\/JNEUROSCI.4458-09.2010","article-title":"Striatal prediction error modulates cortical coupling","volume":"30","author":"den Ouden","year":"2010","journal-title":"Journal of Neuroscience"},{"key":"bib16","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms15276","article-title":"Time-compressed preplay of anticipated events in human primary visual cortex","volume":"8","author":"Ekman","year":"2017","journal-title":"Nature Communications"},{"key":"bib17","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-10597-z","article-title":"Learning of distant state predictions by the orbitofrontal cortex in humans","volume":"10","author":"Elliott Wimmer","year":"2019","journal-title":"Nature Communications"},{"key":"bib18","doi-asserted-by":"publisher","DOI":"10.1101\/2021.03.01.433430","article-title":"The spatiotemporal organization of experience dictates hippocampal involvement in primary visual cortical plasticity","volume-title":"bioRxiv","author":"Finnie","year":"2021"},{"key":"bib19","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1098\/rstb.2005.1622","article-title":"A theory of cortical responses","volume":"360","author":"Friston","year":"2005","journal-title":"Philosophical Transactions of the Royal Society B: Biological Sciences"},{"key":"bib20","doi-asserted-by":"publisher","first-page":"732","DOI":"10.1038\/nn.3683","article-title":"Learned spatiotemporal sequence recognition and prediction in primary visual cortex","volume":"17","author":"Gavornik","year":"2014","journal-title":"Nature Neuroscience"},{"key":"bib21","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1016\/j.tics.2015.04.006","article-title":"Hierarchical process memory: memory as an integral component of information processing","volume":"19","author":"Hasson","year":"2015","journal-title":"Trends in Cognitive Sciences"},{"key":"bib22","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1038\/nn.4284","article-title":"Linking pattern completion in the Hippocampus to predictive coding in visual cortex","volume":"19","author":"Hindy","year":"2016","journal-title":"Nature Neuroscience"},{"key":"bib23","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/j.neuron.2012.08.011","article-title":"Slow cortical dynamics and the accumulation of information over long timescales","volume":"76","author":"Honey","year":"2012","journal-title":"Neuron"},{"key":"bib24","doi-asserted-by":"publisher","first-page":"12180","DOI":"10.1523\/JNEUROSCI.4100-15.2016","article-title":"Predicting \"When\" in Discourse Engages the Human Dorsal Auditory Stream: An fMRI Study Using Naturalistic Stories","volume":"36","author":"Kandylaki","year":"2016","journal-title":"Journal of Neuroscience"},{"key":"bib25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1000209","article-title":"A hierarchy of time-scales and the brain","volume":"4","author":"Kiebel","year":"2008","journal-title":"PLOS Computational Biology"},{"key":"bib26","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1016\/j.neuron.2012.04.034","article-title":"Less is more: expectation sharpens representations in the primary visual cortex","volume":"75","author":"Kok","year":"2012","journal-title":"Neuron"},{"key":"bib27","doi-asserted-by":"publisher","first-page":"1546","DOI":"10.1162\/jocn_a_00562","article-title":"Prior expectations evoke stimulus templates in the primary visual cortex","volume":"26","author":"Kok","year":"2014","journal-title":"Journal of Cognitive Neuroscience"},{"key":"bib28","doi-asserted-by":"publisher","first-page":"6888","DOI":"10.1523\/JNEUROSCI.0163-18.2018","article-title":"Associative prediction of visual shape in the Hippocampus","volume":"38","author":"Kok","year":"2018","journal-title":"The Journal of Neuroscience"},{"key":"bib29","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1016\/j.tics.2007.11.004","article-title":"Segmentation in the perception and memory of events","volume":"12","author":"Kurby","year":"2008","journal-title":"Trends in Cognitive Sciences"},{"key":"bib30","doi-asserted-by":"publisher","first-page":"2906","DOI":"10.1523\/JNEUROSCI.3684-10.2011","article-title":"Topographic mapping of a hierarchy of temporal receptive windows using a narrated story","volume":"31","author":"Lerner","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"bib31","doi-asserted-by":"publisher","first-page":"2433","DOI":"10.1152\/jn.00497.2013","article-title":"Temporal scaling of neural responses to compressed and dilated natural speech","volume":"111","author":"Lerner","year":"2014","journal-title":"Journal of Neurophysiology"},{"key":"bib32","doi-asserted-by":"publisher","first-page":"1219","DOI":"10.1016\/j.neubiorev.2010.12.012","article-title":"Common and distinct networks underlying reward Valence and processing stages: a meta-analysis of functional neuroimaging studies","volume":"35","author":"Liu","year":"2011","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"bib33","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1038\/s41562-018-0491-4","article-title":"Speed of time-compressed forward replay flexibly changes in human episodic memory","volume":"3","author":"Michelmann","year":"2019","journal-title":"Nature Human Behaviour"},{"key":"bib34","doi-asserted-by":"publisher","DOI":"10.1101\/2020.12.09.416438","article-title":"Moment-by-moment tracking of naturalistic learning and its underlying hippocampo-cortical interactions","volume-title":"bioRxiv","author":"Michelmann","year":"2020"},{"key":"bib35","doi-asserted-by":"publisher","DOI":"10.1101\/449470","article-title":"Predicting the future with multi-scale successor representations","volume-title":"bioRxiv","author":"Momennejad","year":"2018"},{"key":"bib36","doi-asserted-by":"publisher","DOI":"10.1111\/desc.12863","article-title":"Development of predictive responses in theory of mind brain regions","volume":"23","author":"Richardson","year":"2020","journal-title":"Developmental Science"},{"key":"bib37","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1016\/j.tics.2009.05.001","article-title":"A common role of insula in feelings, empathy and uncertainty","volume":"13","author":"Singer","year":"2009","journal-title":"Trends in Cognitive Sciences"},{"key":"bib38","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1016\/j.tics.2009.06.003","article-title":"Expectation (and attention) in visual cognition","volume":"13","author":"Summerfield","year":"2009","journal-title":"Trends in Cognitive Sciences"},{"key":"bib39","doi-asserted-by":"publisher","first-page":"2023","DOI":"10.1098\/rstb.2012.0009","article-title":"A rostro-caudal gradient of structured sequence processing in the left inferior frontal gyrus","volume":"367","author":"Udd\u00e9n","year":"2012","journal-title":"Philosophical Transactions of the Royal Society B: Biological Sciences"},{"key":"bib40","doi-asserted-by":"publisher","first-page":"1025","DOI":"10.1038\/s41593-020-0649-z","article-title":"Episodic memory retrieval success is associated with rapid replay of episode content","volume":"23","author":"Wimmer","year":"2020","journal-title":"Nature Neuroscience"},{"key":"bib41","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-21970-2","article-title":"Dynamics of fMRI patterns reflect sub-second activation sequences and reveal replay in human visual cortex","volume":"12","author":"Wittkuhn","year":"2021","journal-title":"Nature Communications"}],"container-title":["eLife"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/cdn.elifesciences.org\/articles\/64972\/elife-64972-v2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/cdn.elifesciences.org\/articles\/64972\/elife-64972-v2.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/elifesciences.org\/articles\/64972","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T21:07:37Z","timestamp":1697058457000},"score":1,"resource":{"primary":{"URL":"https:\/\/elifesciences.org\/articles\/64972"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,22]]},"references-count":41,"alternative-id":["10.7554\/eLife.64972"],"URL":"https:\/\/doi.org\/10.7554\/elife.64972","archive":["CLOCKSS"],"relation":{"references":[{"id-type":"doi","id":"10.18112\/openneuro.ds001545.v1.1.1","asserted-by":"subject"}],"has-review":[{"id-type":"doi","id":"10.7554\/eLife.64972.sa2","asserted-by":"object"},{"id-type":"doi","id":"10.7554\/eLife.64972.sa1","asserted-by":"object"}],"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.10.14.338145","asserted-by":"object"}]},"ISSN":["2050-084X"],"issn-type":[{"value":"2050-084X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,22]]},"assertion":[{"value":"single anonymised","name":"peer_review_transparency","label":"Peer review transparency","group":{"name":"peer_review_taxonomy"}},{"value":"other reviewer(s), editor","name":"peer_review_interaction","label":"Peer review interaction","group":{"name":"peer_review_taxonomy"}},{"value":"review summaries, review reports, author\/editor communication, reviewer identities reviewer opt in, editor identities","name":"peer_review_published","label":"Peer review published","group":{"name":"peer_review_taxonomy"}},{"value":"open (sign in with ORCID iD required)","name":"post_publication_commenting","label":"Post publication commenting","group":{"name":"post_publication_commenting"}}],"article-number":"e64972"}}