{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,28]],"date-time":"2026-10-28T01:07:48Z","timestamp":1793149668633,"version":"4.5.0"},"reference-count":58,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T00:00:00Z","timestamp":1652140800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neuroimaging"],"abstract":"<jats:p>Test-retest reliability of fMRI is often assessed using the intraclass correlation coefficient (ICC), a numerical representation of reliability. Reports of low reliability at the individual level may be attributed to analytical approaches and inherent bias\/error in the measures used to calculate ICC. It is unclear whether low reliability at the individual level is related to methodological decisions or if fMRI is inherently unreliable. The purpose of this study was to investigate methodological considerations when calculating ICC to improve understanding of fMRI reliability. fMRI data were collected from adolescent females (<jats:italic>N<\/jats:italic> = 23) at pre- and post-cognitive behavioral therapy. Participants completed an emotion processing task during fMRI. We calculated ICC values using contrasts and \u03b2 coefficients separately from voxelwise and network (ICA) analyses of the task-based fMRI data. For both voxelwise analysis and ICA, ICC values were higher when calculated using \u03b2 coefficients. This work provides support for the use of \u03b2 coefficients over contrasts when assessing reliability of fMRI, and the use of contrasts may underlie low reliability estimates reported in the existing literature. Continued research in this area is warranted to establish fMRI as a reliable measure to draw conclusions and utilize fMRI in clinical settings.<\/jats:p>","DOI":"10.3389\/fnimg.2022.859792","type":"journal-article","created":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T04:49:44Z","timestamp":1652158184000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Test-Retest Reliability of fMRI During an Emotion Processing Task: Investigating the Impact of Analytical Approaches on ICC Values"],"prefix":"10.3389","volume":"1","author":[{"given":"Mickela","family":"Heilicher","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin M.","family":"Crombie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Josh M.","family":"Cisler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,5,10]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"690","DOI":"10.3758\/s13415-013-0195-1","article-title":"FMRI reliability: influences of task and experimental design","volume":"13","author":"Bennett","year":"2013","journal-title":"Cogn. Affect. Behav. Neurosci."},{"key":"B2","doi-asserted-by":"publisher","first-page":"1132","DOI":"10.1176\/ajp.151.8.1132","article-title":"Initial reliability and validity of a new retrospective measure of child abuse and neglect","volume":"151","author":"Bernstein","year":"1994","journal-title":"Am. J. Psychiatry"},{"key":"B3","doi-asserted-by":"publisher","first-page":"741","DOI":"10.3233\/JAD-111970","article-title":"Long-Term test-retest reliability of resting-state networks in healthy elderly subjects and patients with amnestic mild cognitive impairment","volume":"34","author":"Blautzik","year":"2013","journal-title":"J. Alzheimers Dis."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neuroimage.2020.116601","article-title":"The empirical replicability of task-based FMRI as a function of sample size","volume":"212","author":"Bossier","year":"2020","journal-title":"NeuroImage"},{"key":"B5","doi-asserted-by":"publisher","first-page":"163","DOI":"10.3389\/fpsyt.2013.00163","article-title":"Test-Retest reliability of FMRI brain activity during memory encoding","volume":"4","author":"Brandt","year":"2013","journal-title":"Front. Psychiatry"},{"key":"B6","doi-asserted-by":"publisher","first-page":"875","DOI":"10.1016\/S0896-6273(00)80219-6","article-title":"Response and habituation of the human amygdala during visual processing of facial expression","volume":"17","author":"Breiter","year":"1996","journal-title":"Neuron"},{"key":"B7","doi-asserted-by":"publisher","first-page":"670","DOI":"10.1016\/j.neuroscience.2010.04.024","article-title":"Elevated response of human amygdala to neutral stimuli in mild post traumatic stress disorder: neural correlates of generalized emotional response","volume":"168","author":"Brunetti","year":"2010","journal-title":"Neuroscience"},{"key":"B8","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1016\/j.neuroimage.2008.12.035","article-title":"Measuring FMRI reliability with the intra-class correlation coefficient","volume":"45","author":"Caceres","year":"2009","journal-title":"NeuroImage"},{"key":"B9","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1002\/hbm.10044","article-title":"A method for making group inferences from functional mri data using independent component analysis","volume":"16","author":"Calhoun","year":"2002","journal-title":"Hum. Brain Map."},{"key":"B10","doi-asserted-by":"publisher","first-page":"833","DOI":"10.3174\/ajnr.A2894","article-title":"Investigation of long-term reproducibility of intrinsic connectivity network mapping: a resting-state FMRI study","volume":"33","author":"Chou","year":"2012","journal-title":"Am. J. Neuroradiol."},{"key":"B11","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1037\/1040-3590.6.4.284","article-title":"Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology","volume":"6","author":"Cicchetti","year":"1993","journal-title":"Psychol. Assess."},{"key":"B12","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1016\/j.bpsc.2018.08.014","article-title":"Differential roles of the salience network during prediction error encoding and facial emotion processing among female adolescent assault victims","volume":"4","author":"Cisler","year":"2019","journal-title":"Biol. Psychiatry Cogn. Neurosci. Neuroimaging"},{"key":"B13","doi-asserted-by":"publisher","first-page":"778","DOI":"10.1016\/j.nicl.2017.12.001","article-title":"Large-Scale brain organization during facial emotion processing as a function of early life trauma among adolescent girls","volume":"17","author":"Cisler","year":"2018","journal-title":"NeuroImage Clin."},{"key":"B14","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.jpsychires.2015.09.011","article-title":"Amygdala response predicts trajectory of symptom reduction during trauma-focused cognitive-behavioral therapy among adolescent girls with PTSD","volume":"71","author":"Cisler","year":"2015","journal-title":"J. Psychiatr. Res."},{"key":"B15","doi-asserted-by":"publisher","first-page":"3013","DOI":"10.1017\/S0033291716001847","article-title":"Changes in functional connectivity of the amygdala during cognitive reappraisal predict symptom reduction during trauma-focused cognitive-behavioral therapy among adolescent girls with post-traumatic stress disorder","volume":"46","author":"Cisler","year":"2016","journal-title":"Psychol. Med."},{"key":"B16","doi-asserted-by":"publisher","first-page":"8","DOI":"10.3389\/fnsys.2010.00008","article-title":"Advances and pitfalls in the analysis and interpretation of resting-state FMRI data","volume":"4","author":"Cole","year":"2010","journal-title":"Front. Syst. Neurosci."},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1101\/2020.12.11.421750","article-title":"Importance of test-retest reliability for promoting fMRI based screening and interventions in major depressive disorder","author":"Comp\u00e8re","year":"2020","journal-title":"BioRxiv [Preprint]"},{"key":"B18","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1037\/h0029382","article-title":"How we should measure \u2018change': or should we?\u201d","volume":"74","author":"Cronbach","year":"1970","journal-title":"Psychol. Bull."},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1612033113","article-title":"\u201cErratum: Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates,\u201d","author":"Eklund","year":"2016","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"B20","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1177\/0956797620916786","article-title":"What is the test-retest reliability of common task-functional MRI measures? New empirical evidence and a meta-analysis","volume":"31","author":"Elliott","year":"2020","journal-title":"Psychol. Sci."},{"key":"B21","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1016\/S0361-9230(02)00940-1","article-title":"Brain habituation during repeated exposure to fearful and neutral faces: a functional MRI study","volume":"59","author":"Fischer","year":"2003","journal-title":"Brain Res. Bull."},{"key":"B22","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1016\/j.neuroimage.2019.03.053","article-title":"Addressing the reliability fallacy in FMRI: similar group effects may arise from unreliable individual effects","volume":"195","author":"Fr\u00f6hner","year":"2019","journal-title":"NeuroImage"},{"key":"B23","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1023\/B:JOBA.0000007455.08539.94","article-title":"multidimensional assessment of emotion regulation and dysregulation: Development, factor structure, and initial validation of the difficulties in emotion regulation scale","volume":"26","author":"Gratz","year":"2004","journal-title":"J. Psychopathol. Behav. Assess."},{"key":"B24","doi-asserted-by":"publisher","first-page":"1471","DOI":"10.1016\/j.neuroimage.2012.03.027","article-title":"One-Year test-retest reliability of intrinsic connectivity network FMRI in older adults","volume":"61","author":"Guo","year":"2012","journal-title":"NeuroImage"},{"key":"B25","doi-asserted-by":"publisher","first-page":"e01192","DOI":"10.1002\/brb3.1192","article-title":"Neural responses to children's faces: test\u2013retest reliability of structural and functional MRI","volume":"9","author":"Heckendorf","year":"2019","journal-title":"Brain Behav."},{"key":"B26","doi-asserted-by":"publisher","first-page":"e0206583","DOI":"10.1371\/journal.pone.0206583","article-title":"Test-Retest reliability of task-based and resting-state blood oxygen level dependence and cerebral blood flow measures","volume":"13","author":"Holiga","year":"2018","journal-title":"PLoS ONE"},{"key":"B27","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1016\/j.neuroimage.2018.02.024","article-title":"Robust is not necessarily reliable: from within-subjects FMRI contrasts to between-subjects comparisons","volume":"173","author":"Infantolino","year":"2018","journal-title":"NeuroImage"},{"key":"B28","doi-asserted-by":"publisher","first-page":"980","DOI":"10.1097\/00004583-199707000-00021","article-title":"Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): Initial reliability and validity data","volume":"36","author":"Kaufman","year":"1997","journal-title":"J. Am. Acad. Child. Adoles."},{"key":"B29","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1037\/0022-006x.68.1.19","article-title":"Risk factors for adolescent substance abuse and dependence: Data from a national sample","volume":"68","author":"Kilpatrick","year":"2000","journal-title":"J. Consult. Clin. Psychol."},{"key":"B30","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiroprac. Med."},{"key":"B31","doi-asserted-by":"publisher","first-page":"624911","DOI":"10.3389\/fnins.2021.624911","article-title":"Test-Retest reliability of neural correlates of response inhibition and error monitoring: an FMRI study of a stop-signal task","volume":"15","author":"Korucuoglu","year":"2021","journal-title":"Front. Neurosci."},{"key":"B32","doi-asserted-by":"publisher","first-page":"116759","DOI":"10.1016\/j.neuroimage.2020.116759","article-title":"Test-Retest reliability of FMRI-measured brain activity during decision making under risk","volume":"214","author":"Korucuoglu","year":"2020","journal-title":"NeuroImage"},{"key":"B33","doi-asserted-by":"publisher","first-page":"116495","DOI":"10.1016\/j.neuroimage.2019.116495","article-title":"Test-Retest reliability of brain responses to risk-taking during the balloon analogue risk task","volume":"209","author":"Li","year":"2020","journal-title":"NeuroImage"},{"key":"B34","doi-asserted-by":"publisher","first-page":"117077","DOI":"10.1016\/j.neuroimage.2020.117077","article-title":"Visual cortical regions show sufficient test-retest reliability while salience regions are unreliable during emotional face processing","volume":"220","author":"McDermott","year":"2020","journal-title":"NeuroImage"},{"key":"B35","doi-asserted-by":"publisher","author":"McGraw","year":"1996","DOI":"10.1037\/1082-989X.1.1.30"},{"key":"B36","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1016\/j.tics.2011.08.003","article-title":"Large-Scale brain networks and psychopathology: a unifying triple network model","volume":"15","author":"Menon","year":"2011","journal-title":"Trends Cogn. Sci."},{"key":"B37","doi-asserted-by":"publisher","first-page":"506","DOI":"10.1007\/s12264-019-00455-9","article-title":"Test\u2013Retest reliability of functional magnetic resonance imaging activation for a vergence eye movement task","volume":"36","author":"Morales","year":"2020","journal-title":"Neurosci. Bull."},{"key":"B38","doi-asserted-by":"publisher","first-page":"116157","DOI":"10.1016\/j.neuroimage.2019.116157","article-title":"A decade of test-retest reliability of functional connectivity: a systematic review and meta-analysis","volume":"203","author":"Noble","year":"2019","journal-title":"NeuroImage"},{"key":"B39","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1006\/nimg.1997.0289","article-title":"Anatomic localization and quantitative analysis of gradient refocused echo-planar FMRI susceptibility artifacts","volume":"6","author":"Ojemann","year":"1997","journal-title":"NeuroImage"},{"key":"B40","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1016\/j.neuroimage.2014.09.059","article-title":"Amygdala habituation: a reliable FMRI phenotype","volume":"103","author":"Plichta","year":"2014","journal-title":"NeuroImage"},{"key":"B41","doi-asserted-by":"publisher","first-page":"1746","DOI":"10.1016\/j.neuroimage.2012.01.129","article-title":"Test-Retest reliability of evoked BOLD signals from a cognitive-emotive FMRI test battery","volume":"60","author":"Plichta","year":"2012","journal-title":"NeuroImage"},{"key":"B42","doi-asserted-by":"publisher","first-page":"320","DOI":"10.1016\/j.neuroimage.2013.08.048","article-title":"Methods to detect, characterize, and remove motion artifact in resting state fMRI","volume":"84","author":"Power","year":"2014","journal-title":"NeuroImage"},{"key":"B43","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1016\/j.neuroimage.2007.03.061","article-title":"Test-Retest reliability of FMRI activation during prosaccades and antisaccades","volume":"36","author":"Raemaekers","year":"2007","journal-title":"NeuroImage"},{"key":"B44","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1016\/S0006-3223(00)00828-3","article-title":"Exaggerated amygdala response to masked facial stimuli in posttraumatic stress disorder: a functional MRI study","volume":"47","author":"Rauch","year":"2000","journal-title":"Biol. Psychiatry"},{"key":"B45","doi-asserted-by":"publisher","first-page":"102319","DOI":"10.1016\/j.nicl.2020.102319","article-title":"Altered large-scale functional brain organization in posttraumatic stress disorder: a comprehensive review of univariate and network-level neurocircuitry models of PTSD","volume":"27","author":"Ross","year":"2020","journal-title":"NeuroImage: Clinical"},{"key":"B46","unstructured":"SalarianA.\n          32532306Intraclass Correlation Coefficient (ICC). MathWorks2016"},{"key":"B47","doi-asserted-by":"publisher","first-page":"116290","DOI":"10.1016\/j.neuroimage.2019.116290","article-title":"A set of functionally-defined brain regions with improved representation of the subcortex and cerebellum","volume":"206","author":"Seitzman","year":"2020","journal-title":"NeuroImage"},{"key":"B48","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1007\/s10802-006-9027-x","article-title":"The short mood and feelings questionnaire (SMFQ): A unidimensional item response theory and categorical data factor analysis of self-report ratings from a community sample of 7-through 11-year-old children","volume":"34","author":"Sharp","year":"2006","journal-title":"J. Abnorm. Child Psychol."},{"key":"B49","doi-asserted-by":"publisher","first-page":"17393","DOI":"10.4088\/JCP.09m05305whi","article-title":"Reliability and validity of the mini international neuropsychiatric interview for children and adolescents (MINI-KID)","volume":"71","author":"Sheehan","year":"2010","journal-title":"J. Clin. Psychiatry"},{"key":"B50","doi-asserted-by":"publisher","first-page":"1981","DOI":"10.1002\/hbm.22307","article-title":"Statistical improvements in functional magnetic resonance imaging analyses produced by censoring high-motion data points","volume":"35","author":"Siegel","year":"2014","journal-title":"Human Brain Mapp."},{"key":"B51","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/j.dcn.2015.08.003","article-title":"Short-Term test\u2013retest reliability of resting state FMRI metrics in children with and without attention-deficit\/hyperactivity disorder","volume":"15","author":"Somandepalli","year":"2015","journal-title":"Dev. Cogn. Neurosci."},{"key":"B52","doi-asserted-by":"publisher","first-page":"e49847","DOI":"10.1371\/journal.pone.0049847","article-title":"Age-Related differences in test-retest reliability in resting-state brain functional connectivity","volume":"7","author":"Song","year":"2012","journal-title":"PLoS ONE"},{"key":"B53","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1007\/s11920-004-0048-2","article-title":"The university of california at los angeles post-traumatic stress disorder reaction index","volume":"6","author":"Steinber","year":"2004","journal-title":"Curr. Psy"},{"key":"B54","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/jts.21780","article-title":"Psychometric properties of the UCLA PTSD reaction index: Part I","volume":"26","author":"Steinberg","year":"2013","journal-title":"J. Traum. Stress."},{"key":"B55","doi-asserted-by":"publisher","first-page":"2822","DOI":"10.1093\/cercor\/bhaa390","article-title":"Boost in test-retest reliability in resting state fmri with predictive modeling","volume":"31","author":"Taxali","year":"2021","journal-title":"Cereb. Cortex"},{"key":"B56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2288-1-6","article-title":"The use of percentage change from baseline as an outcome in a controlled trial is statistically inefficient: a simulation study","volume":"1","author":"Vickers","year":"2001","journal-title":"Hypertension"},{"key":"B57","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1002\/hbm.20208","article-title":"Amygdala-Prefrontal dissociation of subliminal and supraliminal fear","volume":"27","author":"Williams","year":"2006","journal-title":"Hum. Brain Mapp."},{"key":"B58","doi-asserted-by":"publisher","first-page":"5472","DOI":"10.1073\/pnas.1818430116","article-title":"Large-Scale analysis of test\u2013retest reliabilities of self-regulation measures","volume":"116","author":"Zeynep Enkavi","year":"2019","journal-title":"Proc. Natl. Acad. Sci. U.S.A."}],"container-title":["Frontiers in Neuroimaging"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnimg.2022.859792\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,5,10]],"date-time":"2022-05-10T04:49:48Z","timestamp":1652158188000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnimg.2022.859792\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,10]]},"references-count":58,"alternative-id":["10.3389\/fnimg.2022.859792"],"URL":"https:\/\/doi.org\/10.3389\/fnimg.2022.859792","relation":{},"ISSN":["2813-1193"],"issn-type":[{"value":"2813-1193","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,10]]},"article-number":"859792"}}