{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T16:12:19Z","timestamp":1787069539686,"version":"build-2736575974"},"reference-count":53,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T00:00:00Z","timestamp":1784246400000},"content-version":"vor","delay-in-days":197,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R15MH125332"],"award-info":[{"award-number":["R15MH125332"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01MH131335"],"award-info":[{"award-number":["R01MH131335"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01AG085665"],"award-info":[{"award-number":["R01AG085665"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"(NJ) Governor's Council for Medical Research and Treatment of Autism","award":["CAUT25BRP005"],"award-info":[{"award-number":["CAUT25BRP005"]}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,8,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Naturalistic stimuli, such as movies and narratives, are increasingly used in cognitive neuroscience to map cognitive and affective processes onto brain activity measured with functional MRI (fMRI). Features extracted from movies span multiple levels, from computational visual and auditory inputs to physiological signals and subjective ratings. However, the temporal alignment between these features and the blood-oxygen-level-dependent (BOLD) response varies considerably, and the commonly used canonical hemodynamic response function (HRF) with temporal derivatives may not adequately capture these delays. In this study, we analyzed three movie-watching datasets using cross-correlation and finite impulse response (FIR) deconvolution to map the unconstrained temporal dynamics of visual, auditory, pupillary, and Theory of Mind (ToM) features across the brain. Our results demonstrate that while the canonical HRF effectively captures basic sensory features, it introduces systematic misalignments for inherently delayed signals. Because physiological markers (pupil size) and subject reports (ToM) intrinsically lag the underlying neural events, standard HRF convolution overcompensates for their biological latency, introducing a redundant phase mismatch or \u201cdouble-delay.\u201d Furthermore, our unconstrained FIR models revealed distinct inter-regional temporal hierarchies across the cortex. Given the inherent collinearity of real-world stimuli, these estimated profiles capture the bundled, multi-dimensional dynamics of naturalistic processing rather than perfectly isolated feature effects. Overall, these findings highlight the necessity of flexible, reliability-tested temporal modeling to accurately map the complex processing timescales engaged during naturalistic viewing.<\/jats:p>","DOI":"10.1162\/imag.a.1331","type":"journal-article","created":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T20:01:23Z","timestamp":1784318483000},"update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":1,"title":["Beyond the canonical HRF: Flexible temporal modeling reveals unconstrained BOLD profiles during naturalistic viewing"],"prefix":"10.1162","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2422-9016","authenticated-orcid":false,"given":"Xin","family":"Di","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George B.","family":"Hanna","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3710-3500","authenticated-orcid":false,"given":"Bharat B.","family":"Biswal","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, New Jersey Institute of Technology, Newark, NJ, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2026,8,6]]},"reference":[{"key":"2026080615560370600_IMAG.a.1331-b1","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1006\/nimg.1998.0369","article-title":"The variability of human, BOLD hemodynamic responses","volume":"8","author":"Aguirre","year":"1998","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/sdata.2017.181","article-title":"An open resource for transdiagnostic research in pediatric mental health and learning disorders","volume":"4","author":"Alexander","year":"2017","journal-title":"Scientific Data"},{"key":"2026080615560370600_IMAG.a.1331-b3","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1146\/annurev.neuro.28.061604.135709","article-title":"An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance","volume":"28","author":"Aston-Jones","year":"2005","journal-title":"Annual Review of Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b4","doi-asserted-by":"crossref","first-page":"709.e5","DOI":"10.1016\/j.neuron.2017.06.041","article-title":"Discovering event structure in continuous narrative perception and memory","volume":"95","author":"Baldassano","year":"2017","journal-title":"Neuron"},{"key":"2026080615560370600_IMAG.a.1331-b5","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1002\/hbm.10153","article-title":"Functional brain mapping during free viewing of natural scenes","volume":"21","author":"Bartels","year":"2004","journal-title":"Human Brain Mapping"},{"key":"2026080615560370600_IMAG.a.1331-b6","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1093\/cercor\/bhm107","article-title":"Natural vision reveals regional specialization to local motion and to contrast-invariant, global flow in the human brain","volume":"18","author":"Bartels","year":"2008","journal-title":"Cerebral Cortex"},{"key":"2026080615560370600_IMAG.a.1331-b7","doi-asserted-by":"crossref","first-page":"4207","DOI":"10.1523\/JNEUROSCI.16-13-04207.1996","article-title":"Linear systems analysis of functional magnetic resonance imaging in human V1","volume":"16","author":"Boynton","year":"1996","journal-title":"Journal of Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b8","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1038\/s41593-018-0305-z","article-title":"Active control of arousal by a locus coeruleus GABAergic circuit","volume":"22","author":"Breton-Provencher","year":"2019","journal-title":"Nature Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b9","doi-asserted-by":"crossref","DOI":"10.1093\/cercor\/bhad448","article-title":"The significance and limited influence of cerebrovascular reactivity on age and sex effects in task- and resting-state brain activity","volume":"34","author":"Chen","year":"2024","journal-title":"Cerebral Cortex"},{"key":"2026080615560370600_IMAG.a.1331-b10","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1002\/(SICI)1097-0193(1997)5:5<329::AID-HBM1>3.0.CO;2-5","article-title":"Selective averaging of rapidly presented individual trials using fMRI","volume":"5","author":"Dale","year":"1997","journal-title":"Human Brain Mapping"},{"key":"2026080615560370600_IMAG.a.1331-b12","doi-asserted-by":"crossref","first-page":"3332","DOI":"10.1002\/hbm.25568","article-title":"Principal component analysis reveals multiple consistent responses to naturalistic stimuli in children and adults","volume":"43","author":"Di","year":"2022","journal-title":"Human Brain Mapping"},{"key":"2026080615560370600_IMAG.a.1331-b13","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/B978-0-443-19099-5.00020-9","article-title":"Chapter 14\u2014Future perspectives of functional connectivity: Advances in data acquisition and analysis","volume-title":"Functional connectivity of the human brain","author":"Di","year":"2026"},{"key":"2026080615560370600_IMAG.a.1331-b14","doi-asserted-by":"crossref","first-page":"101280","DOI":"10.1016\/j.dcn.2023.101280","article-title":"Individual differences in time-varying and stationary brain connectivity during movie watching from childhood to early adulthood: Age, sex, and behavioral associations","volume":"63","author":"Di","year":"2023","journal-title":"Developmental Cognitive Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b15","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198522294.002.0003","article-title":"Statistical methods for research workers","author":"Fisher","year":"1990"},{"key":"2026080615560370600_IMAG.a.1331-b16","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1006\/nimg.1997.0306","article-title":"Event-related fMRI: Characterizing differential responses","volume":"7","author":"Friston","year":"1998","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b17","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.neuron.2006.05.001","article-title":"The neural basis of mentalizing","volume":"50","author":"Frith","year":"2006","journal-title":"Neuron"},{"issue":"1","key":"2026080615560370600_IMAG.a.1331-b18","first-page":"e5","article-title":"CARMA: Software for continuous affect rating and media annotation","volume":"2","author":"Girard","year":"2014","journal-title":"Journal of Open Research Software"},{"key":"2026080615560370600_IMAG.a.1331-b19","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1006\/nimg.1998.0419","article-title":"Deconvolution of impulse response in event-related BOLD fMRI1","volume":"9","author":"Glover","year":"1999","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b20","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1109\/42.897811","article-title":"Modeling the hemodynamic response in fMRI using smooth FIR filters","volume":"19","author":"Goutte","year":"2000","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"2026080615560370600_IMAG.a.1331-b21","doi-asserted-by":"crossref","first-page":"1639","DOI":"10.1016\/j.neuroimage.2003.11.029","article-title":"Variation of BOLD hemodynamic responses across subjects and brain regions and their effects on statistical analyses","volume":"21","author":"Handwerker","year":"2004","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b23","doi-asserted-by":"crossref","first-page":"1634","DOI":"10.1126\/science.1089506","article-title":"Intersubject synchronization of cortical activity during natural vision","volume":"303","author":"Hasson","year":"2004","journal-title":"Science (New York, N.Y.)"},{"key":"2026080615560370600_IMAG.a.1331-b25","doi-asserted-by":"crossref","first-page":"81","DOI":"10.3389\/fnsys.2016.00081","article-title":"Decoding the semantic content of natural movies from human brain activity","volume":"10","author":"Huth","year":"2016","journal-title":"Frontiers in Systems Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b26","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.neuroimage.2015.11.025","article-title":"Localizing Pain Matrix and Theory of Mind networks with both verbal and non-verbal stimuli","volume":"126","author":"Jacoby","year":"2016","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b27","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1016\/j.tics.2020.03.005","article-title":"Pupil size as a window on neural substrates of cognition","volume":"24","author":"Joshi","year":"2020","journal-title":"Trends in Cognitive Sciences"},{"key":"2026080615560370600_IMAG.a.1331-b28","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.neuron.2015.11.028","article-title":"Relationships between pupil diameter and neuronal activity in the locus coeruleus, colliculi, and cingulate cortex","volume":"89","author":"Joshi","year":"2016","journal-title":"Neuron"},{"key":"2026080615560370600_IMAG.a.1331-b29","first-page":"5","article-title":"Inter-subject correlation of brain hemodynamic responses during watching a movie: Localization in space and frequency","volume":"4","author":"Kauppi","year":"2010","journal-title":"Frontiers in Neuroinformatics"},{"key":"2026080615560370600_IMAG.a.1331-b30","doi-asserted-by":"crossref","first-page":"233","DOI":"10.3389\/fnhum.2012.00233","article-title":"Naturalistic fMRI mapping reveals superior temporal sulcus as the hub for the distributed brain network for social perception","volume":"6","author":"Lahnakoski","year":"2012","journal-title":"Frontiers in Human Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b32","doi-asserted-by":"crossref","first-page":"170040","DOI":"10.1038\/sdata.2017.40","article-title":"A resource for assessing information processing in the developing brain using EEG and eye tracking","volume":"4","author":"Langer","year":"2017","journal-title":"Scientific Data"},{"key":"2026080615560370600_IMAG.a.1331-b33","doi-asserted-by":"crossref","first-page":"2906","DOI":"10.1523\/JNEUROSCI.3684-10.2011","article-title":"Topographic mapping of a hierarchy of temporal receptive windows using a narrated story","volume":"31","author":"Lerner","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b34","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.neuroimage.2018.06.056","article-title":"Stimulus-dependent hemodynamic response timing across the human subcortical-cortical visual pathway identified through high spatiotemporal resolution 7T fMRI","volume":"181","author":"Lewis","year":"2018","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b35","first-page":"S187","article-title":"Modeling the hemodynamic response function in fMRI: Efficiency, bias and mis-modeling","volume":"45","author":"Lindquist","year":"2009","journal-title":"NeuroImage, Mathematics in Brain Imaging"},{"key":"2026080615560370600_IMAG.a.1331-b36","doi-asserted-by":"crossref","first-page":"e84822","DOI":"10.7554\/eLife.84822","article-title":"Pupil size reflects activation of subcortical ascending arousal system nuclei during rest","volume":"12","author":"Lloyd","year":"2023","journal-title":"eLife"},{"issue":"1","key":"2026080615560370600_IMAG.a.1331-b37","doi-asserted-by":"crossref","first-page":"16","DOI":"10.5334\/joc.18","article-title":"Pupillometry: Psychology, physiology, and function","volume":"1","author":"Mathot","year":"2018","journal-title":"Journal of Cognition"},{"key":"2026080615560370600_IMAG.a.1331-b39","doi-asserted-by":"crossref","first-page":"5035.e8","DOI":"10.1016\/j.cub.2023.10.015","article-title":"Hierarchical organization of social action features along the lateral visual pathway","volume":"33","author":"McMahon","year":"2023","journal-title":"Current Biology"},{"key":"2026080615560370600_IMAG.a.1331-b40","doi-asserted-by":"crossref","first-page":"5004","DOI":"10.1038\/s41467-020-18717-w","article-title":"Movie viewing elicits rich and reliable brain state dynamics","volume":"11","author":"Meer","year":"2020","journal-title":"Nature Communications"},{"key":"2026080615560370600_IMAG.a.1331-b41","doi-asserted-by":"crossref","first-page":"4140","DOI":"10.1002\/hbm.22466","article-title":"Pupil diameter covaries with BOLD activity in human locus coeruleus","volume":"35","author":"Murphy","year":"2014","journal-title":"Human Brain Mapping"},{"key":"2026080615560370600_IMAG.a.1331-b42","first-page":"667","article-title":"Measuring shared responses across subjects using intersubject correlation","volume":"14","author":"Nastase","year":"2019","journal-title":"Social Cognitive and Affective Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b44","doi-asserted-by":"crossref","first-page":"9599","DOI":"10.1073\/pnas.1206095109","article-title":"Emotions promote social interaction by synchronizing brain activity across individuals","volume":"109","author":"Nummenmaa","year":"2012","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"2026080615560370600_IMAG.a.1331-b45","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/j.neuroimage.2014.09.060","article-title":"Data-driven HRF estimation for encoding and decoding models","volume":"104","author":"Pedregosa","year":"2015","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b46","doi-asserted-by":"crossref","first-page":"709","DOI":"10.3758\/s13415-016-0425-4","article-title":"Functional connectivity dynamics during film viewing reveal common networks for different emotional experiences","volume":"16","author":"Raz","year":"2016","journal-title":"Cognitive, Affective, & Behavioral Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-018-03399-2","article-title":"Development of the social brain from age three to twelve years","volume":"9","author":"Richardson","year":"2018","journal-title":"Nature Communications"},{"key":"2026080615560370600_IMAG.a.1331-b48","doi-asserted-by":"crossref","first-page":"675068","DOI":"10.3389\/fnhum.2021.675068","article-title":"Naturalistic stimuli in affective neuroimaging: A review","volume":"15","author":"Saarim\u00e4ki","year":"2021","journal-title":"Frontiers in Human Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b49","article-title":"Cortical language areas are coupled via a soft hierarchy of model-based linguistic features","author":"Samara","year":"2025","journal-title":"bioRxiv"},{"key":"2026080615560370600_IMAG.a.1331-b50","doi-asserted-by":"crossref","first-page":"3095","DOI":"10.1093\/cercor\/bhx179","article-title":"Local-global parcellation of the human cerebral cortex from intrinsic functional connectivity MRI","volume":"28","author":"Schaefer","year":"2018","journal-title":"Cerebral cortex (New York, N.Y.: 1991)"},{"key":"2026080615560370600_IMAG.a.1331-b51","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.neuroimage.2016.06.011","article-title":"Spontaneous pupil dilations during the resting state are associated with activation of the salience network","volume":"139","author":"Schneider","year":"2016","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b52","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1037\/bul0000303","article-title":"Toward a hierarchical model of social cognition: A neuroimaging meta-analysis and integrative review of empathy and theory of mind","volume":"147","author":"Schurz","year":"2021","journal-title":"Psychological Bulletin"},{"key":"2026080615560370600_IMAG.a.1331-b53","doi-asserted-by":"crossref","first-page":"849.e3","DOI":"10.1016\/j.neuron.2019.09.002","article-title":"The low-dimensional neural architecture of cognitive complexity is related to activity in medial thalamic nuclei","volume":"104","author":"Shine","year":"2019","journal-title":"Neuron"},{"key":"2026080615560370600_IMAG.a.1331-b54","doi-asserted-by":"crossref","first-page":"kkae021","DOI":"10.1093\/psyrad\/kkae021","article-title":"Explorations of using a convolutional neural network to understand brain activations during movie watching","volume":"4","author":"Sohn","year":"2024","journal-title":"Psychoradiology"},{"key":"2026080615560370600_IMAG.a.1331-b57","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1006\/nimg.2001.0978","article-title":"Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain","volume":"15","author":"Tzourio-Mazoyer","year":"2002","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b58","doi-asserted-by":"crossref","first-page":"100600","DOI":"10.1016\/j.dcn.2018.10.004","article-title":"Movies in the magnet: Naturalistic paradigms in developmental functional neuroimaging","volume":"36","author":"Vanderwal","year":"2019","journal-title":"Developmental Cognitive Neuroscience"},{"key":"2026080615560370600_IMAG.a.1331-b59","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.neuroimage.2018.12.012","article-title":"BOLD hemodynamic response function changes significantly with healthy aging","volume":"188","author":"West","year":"2019","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b60","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1016\/j.neuroimage.2014.11.034","article-title":"Coupling between pupil fluctuations and resting-state fMRI uncovers a slow build-up of antagonistic responses in the human cortex","volume":"106","author":"Yellin","year":"2015","journal-title":"NeuroImage"},{"key":"2026080615560370600_IMAG.a.1331-b61","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1093\/cercor\/bhn080","article-title":"The neural basis of human social values: Evidence from functional MRI","volume":"19","author":"Zahn","year":"2009","journal-title":"Cerebral Cortex"}],"container-title":["Imaging Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/imag\/article-pdf\/doi\/10.1162\/IMAG.a.1331\/2615552\/imag.a.1331.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/imag\/article-pdf\/doi\/10.1162\/IMAG.a.1331\/2615552\/imag.a.1331.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,6]],"date-time":"2026-08-06T19:56:14Z","timestamp":1786046174000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/imag\/article\/doi\/10.1162\/IMAG.a.1331\/137738\/Beyond-the-canonical-HRF-Flexible-temporal"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026]]},"references-count":53,"URL":"https:\/\/doi.org\/10.1162\/imag.a.1331","relation":{},"ISSN":["2837-6056"],"issn-type":[{"value":"2837-6056","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026]]},"published":{"date-parts":[[2026]]},"article-number":"IMAG.a.1331"}}