{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T16:11:27Z","timestamp":1779898287600,"version":"3.53.1"},"reference-count":78,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T00:00:00Z","timestamp":1727654400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neuroinform."],"abstract":"<jats:p>While a great deal of recent effort has focused on addressing a perceived reproducibility crisis within brain structural magnetic resonance imaging (MRI) and functional MRI research communities, this article argues that brain positron emission tomography (PET) research stands on even more fragile ground, lagging behind efforts to address MRI reproducibility. We begin by examining the current landscape of factors that contribute to reproducible neuroimaging data analysis, including scientific standards, analytic plan pre-registration, data and code sharing, containerized workflows, and standardized processing pipelines. We then focus on disparities in the current status of these factors between brain MRI and brain PET. To demonstrate the positive impact that further developing such reproducibility factors would have on brain PET research, we present a case study that illustrates the many challenges faced by one laboratory that attempted to reproduce a community-standard brain PET processing pipeline. We identified key areas in which the brain PET community could enhance reproducibility, including stricter reporting policies among PET dedicated journals, data repositories, containerized analysis tools, and standardized processing pipelines. Other solutions such as mandatory pre-registration, data sharing, code availability as a condition of grant funding, and online forums and standardized reporting templates, are also discussed. Bolstering these reproducibility factors within the brain PET research community has the potential to unlock the full potential of brain PET research, propelling it toward a higher-impact future.<\/jats:p>","DOI":"10.3389\/fninf.2024.1420315","type":"journal-article","created":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T04:32:43Z","timestamp":1727670763000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Reproducible brain PET data analysis: easier said than done"],"prefix":"10.3389","volume":"18","author":[{"given":"Maryam","family":"Naseri","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sreekrishna","family":"Ramakrishnapillai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Owen T.","family":"Carmichael","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,9,30]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"2771","DOI":"10.1016\/j.neuron.2022.06.018","article-title":"Neuroscience cloud analysis as a service: an open-source platform for scalable, reproducible data analysis","volume":"110","author":"Abe","year":"2022","journal-title":"Neuron"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s12021-022-09606-2","article-title":"Reporting practices for task fMRI studies","volume":"21","author":"Acar","year":"2023","journal-title":"Neuroinformatics"},{"key":"ref3","year":"2004"},{"key":"ref4","doi-asserted-by":"publisher","first-page":"83","DOI":"10.5465\/annals.2016.0011","article-title":"What you see is what you get? Enhancing methodological transparency in management research","volume":"12","author":"Aguinis","year":"2018","journal-title":"Acad. Manag. Ann."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/s12149-022-01820-x","article-title":"A review of harmonization strategies for quantitative PET","volume":"37","author":"Akamatsu","year":"2023","journal-title":"Ann. Nucl. Med."},{"key":"ref6","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1038\/d41586-019-01307-2","article-title":"Rein in the four horsemen of irreproducibility","volume":"568","author":"Bishop","year":"2019","journal-title":"Nature"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1038\/s41586-020-2314-9","article-title":"Variability in the analysis of a single neuroimaging dataset by many teams","volume":"582","author":"Botvinik-Nezer","year":"2020","journal-title":"Nature"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1038\/nrn3475","article-title":"Power failure: why small sample size undermines the reliability of neuroscience","volume":"14","author":"Button","year":"2013","journal-title":"Nat. Rev. Neurosci."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1016\/j.neuroimage.2012.07.004","article-title":"The secret lives of experiments: methods reporting in the fMRI literature","volume":"63","author":"Carp","year":"2012","journal-title":"NeuroImage"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1002\/hbm.21238","article-title":"Optimizing preprocessing and analysis pipelines for single-subject fMRI. I. Standard temporal motion and physiological noise correction methods","volume":"33","author":"Churchill","year":"2012","journal-title":"Hum. Brain Mapp."},{"key":"ref11","year":"2020"},{"key":"ref12","year":"2013"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"3758","DOI":"10.1038\/s41467-022-31347-8","article-title":"A guided multiverse study of neuroimaging analyses","volume":"13","author":"Dafflon","year":"2022","journal-title":"Nat. Commun."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"e70104","DOI":"10.1371\/journal.pone.0070104","article-title":"Potential reporting bias in fMRI studies of the brain","volume":"8","author":"David","year":"2013","journal-title":"PLoS One"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1007\/s12021-014-9235-4","article-title":"A standardized [18 F]-FDG-PET template for spatial normalization in statistical parametric mapping of dementia","volume":"12","author":"Della Rosa","year":"2014","journal-title":"Neuroinformatics"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1101\/2024.03.19.585755","article-title":"Impact of analytic decisions on test-retest reliability of individual and group estimates in functional magnetic resonance imaging: a multiverse analysis using the monetary incentive delay task","author":"Demidenko","year":"2024","journal-title":"bioRxiv"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"7900","DOI":"10.1073\/pnas.1602413113","article-title":"Cluster failure: why fMRI inferences for spatial extent have inflated false-positive rates","volume":"113","author":"Eklund","year":"2016","journal-title":"Proc. Natl. Acad. Sci."},{"key":"ref18","author":"Epskamp","year":"2016"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1038\/s41592-018-0235-4","article-title":"fMRIPrep: a robust preprocessing pipeline for functional MRI","volume":"16","author":"Esteban","year":"2019","journal-title":"Nat. Methods"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"421","DOI":"10.1111\/infa.12182","article-title":"A collaborative approach to infant research: promoting reproducibility, best practices, and theory-building","volume":"22","author":"Frank","year":"2017","journal-title":"Infancy"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"e1005209","DOI":"10.1371\/journal.pcbi.1005209","article-title":"BIDS apps: improving ease of use, accessibility, and reproducibility of neuroimaging data analysis methods","volume":"13","author":"Gorgolewski","year":"2017","journal-title":"PLoS Comput. Biol."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.44","article-title":"The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments","volume":"3","author":"Gorgolewski","year":"2016","journal-title":"Sci. Data"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"e1002506","DOI":"10.1371\/journal.pbio.1002506","article-title":"A practical guide for improving transparency and reproducibility in neuroimaging research","volume":"14","author":"Gorgolewski","year":"2016","journal-title":"PLoS Biol."},{"key":"ref24","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1016\/j.neuroimage.2016.02.042","article-title":"Different partial volume correction methods lead to different conclusions: an 18F-FDG-PET study of aging","volume":"132","author":"Greve","year":"2016","journal-title":"NeuroImage"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1016\/j.neuroimage.2012.10.001","article-title":"Good practice for conducting and reporting MEG research","volume":"65","author":"Gross","year":"2013","journal-title":"NeuroImage"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"e94412","DOI":"10.1371\/journal.pone.0094412","article-title":"The reporting of observational clinical functional magnetic resonance imaging studies: a systematic review","volume":"9","author":"Guo","year":"2014","journal-title":"PLoS One"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"22","DOI":"10.3389\/fninf.2012.00022","article-title":"Open is not enough. Let's take the next step: an integrated, community-driven computing platform for neuroscience","volume":"6","author":"Halchenko","year":"2012","journal-title":"Front. Neuroinform."},{"key":"ref28","year":"2011"},{"key":"ref29","doi-asserted-by":"publisher","first-page":"384","DOI":"10.1016\/j.neuroimage.2019.03.070","article-title":"False-positive neuroimaging: undisclosed flexibility in testing spatial hypotheses allows presenting anything as a replicated finding","volume":"195","author":"Hong","year":"2019","journal-title":"NeuroImage"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"776","DOI":"10.1002\/acn3.51048","article-title":"The A4 study: \u03b2-amyloid and cognition in 4432 cognitively unimpaired adults","volume":"7","author":"Insel","year":"2020","journal-title":"Ann. Clin. Transl. Neurol."},{"key":"ref31","doi-asserted-by":"publisher","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false","volume":"2","author":"Ioannidis","year":"2005","journal-title":"PLoS Med."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1271818","DOI":"10.3389\/fnint.2023.1271818","article-title":"Reproducibility in neuroscience","volume":"17","author":"Jadavji","year":"2023","journal-title":"Front. Integr. Neurosci."},{"key":"ref33","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1016\/j.jalz.2015.05.001","article-title":"The Alzheimer's disease neuroimaging initiative 2 PET core: 2015","volume":"11","author":"Jagust","year":"2015","journal-title":"Alzheimers Dement."},{"key":"ref34","doi-asserted-by":"publisher","first-page":"1736","DOI":"10.2967\/jnumed.114.153494","article-title":"A semiautomated method for quantification of F 18 florbetapir PET images","volume":"56","author":"Joshi","year":"2015","journal-title":"J. Nucl. Med."},{"key":"ref35","doi-asserted-by":"publisher","first-page":"100902","DOI":"10.1016\/j.dcn.2020.100902","article-title":"Opportunities for increased reproducibility and replicability of developmental neuroimaging","volume":"47","author":"Klapwijk","year":"2021","journal-title":"Dev. Cogn. Neurosci."},{"key":"ref36","doi-asserted-by":"publisher","first-page":"1576","DOI":"10.1177\/0271678X20905433","article-title":"Guidelines for the content and format of PET brain data in publications and archives: a consensus paper","volume":"40","author":"Knudsen","year":"2020","journal-title":"J. Cereb. Blood Flow Metab."},{"key":"ref37","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2024.105846","article-title":"The multiverse of data preprocessing and analysis in graph-based fMRI: a systematic literature review of analytical choices fed into a decision support tool for informed analysis","author":"Kristanto","year":"2024","journal-title":"bioRxiv"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1068\/i004ir","article-title":"I-review: sharing code","volume":"5","author":"Kubilius","year":"2014","journal-title":"i-Perception"},{"key":"ref39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/2191-219X-4-7","article-title":"Comparison of PET template-based and MRI-based image processing in the quantitative analysis of C 11-raclopride PET","volume":"4","author":"Kuhn","year":"2014","journal-title":"EJNMMI Res."},{"key":"ref40","doi-asserted-by":"publisher","first-page":"e0177459","DOI":"10.1371\/journal.pone.0177459","article-title":"Singularity: scientific containers for mobility of compute","volume":"12","author":"Kurtzer","year":"2017","journal-title":"PLoS One"},{"key":"ref41","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1016\/j.neurobiolaging.2009.07.002","article-title":"Associations between cognitive, functional, and FDG-PET measures of decline in AD and MCI","volume":"32","author":"Landau","year":"2011","journal-title":"Neurobiol. Aging"},{"key":"ref42","doi-asserted-by":"publisher","first-page":"2549","DOI":"10.1002\/mp.16753","article-title":"Multi-scale statistical deformation based co-registration of prostate MRI and post-surgical whole mount histopathology","volume":"51","author":"Li","year":"2024","journal-title":"Med. Phys."},{"key":"ref43","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1016\/S1525-5050(02)00558-9","article-title":"Now you see it, now you don\u2019t: statistical and methodological considerations in fMRI","volume":"3","author":"Loring","year":"2002","journal-title":"Epilepsy Behav."},{"key":"ref9001","doi-asserted-by":"publisher","first-page":"1498","DOI":"10.1162\/jocn.2007.19.9.1498","article-title":"Open Access Series of Imaging Studies (OASIS): cross-sectional MRI data in young, middle aged, nondemented, and demented older adults","volume":"19","author":"Marcus","year":"2007","journal-title":"J. Cogn. Neurosci"},{"key":"ref44","doi-asserted-by":"publisher","first-page":"e71774","DOI":"10.7554\/eLife.71774","article-title":"The OpenNeuro resource for sharing of neuroscience data","volume":"10","author":"Markiewicz","year":"2021","journal-title":"eLife"},{"key":"ref45","doi-asserted-by":"publisher","first-page":"2","DOI":"10.5555\/2600239.2600241","article-title":"Docker: lightweight Linux containers for consistent development and deployment","volume":"2014","author":"Merkel","year":"2014","journal-title":"Linux J."},{"key":"ref46","doi-asserted-by":"publisher","first-page":"2443","DOI":"10.1118\/1.4946814","article-title":"Improved frame-based estimation of head motion in PET brain imaging","volume":"43","author":"Mukherjee","year":"2016","journal-title":"Med. Phys."},{"key":"ref47","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1001\/jamapsychiatry.2016.2783","article-title":"Altered brain activity in unipolar depression revisited: meta-analyses of neuroimaging studies","volume":"74","author":"M\u00fcller","year":"2017","journal-title":"JAMA Psychiatry"},{"key":"ref48","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41562-016-0021","article-title":"A manifesto for reproducible science","volume":"1","author":"Munaf\u00f2","year":"2017","journal-title":"Nat. Hum. Behav."},{"key":"ref49","year":"2024"},{"key":"ref50","year":"2000"},{"key":"ref51","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1038\/nn.4500","article-title":"Best practices in data analysis and sharing in neuroimaging using MRI","volume":"20","author":"Nichols","year":"2017","journal-title":"Nat. Neurosci."},{"key":"ref52","year":"1997"},{"key":"ref53","doi-asserted-by":"publisher","first-page":"119623","DOI":"10.1016\/j.neuroimage.2022.119623","article-title":"Open and reproducible neuroimaging: from study inception to publication","volume":"263","author":"Niso","year":"","journal-title":"NeuroImage"},{"key":"ref54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/sdata.2018.110","article-title":"MEG-BIDS, the brain imaging data structure extended to magnetoencephalography","volume":"5","author":"Niso","year":"2018","journal-title":"Sci. Data"},{"key":"ref55","doi-asserted-by":"publisher","first-page":"119056","DOI":"10.1016\/j.neuroimage.2022.119056","article-title":"Good scientific practice in EEG and MEG research: progress and perspectives","volume":"257","author":"Niso","year":"","journal-title":"NeuroImage"},{"key":"ref56","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/s41597-022-01164-1","article-title":"PET-BIDS, an extension to the brain imaging data structure for positron emission tomography","volume":"9","author":"Norgaard","year":"2022","journal-title":"Sci. Data"},{"key":"ref57","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1146\/annurev-psych-020821-114157","article-title":"Replicability, robustness, and reproducibility in psychological science","volume":"73","author":"Nosek","year":"2022","journal-title":"Annu. Rev. Psychol."},{"key":"ref58","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1002\/jrsm.1408","article-title":"\u201cStatcheck\u201d: automatically detect statistical reporting inconsistencies to increase reproducibility of meta-analyses","volume":"11","author":"Nuijten","year":"2020","journal-title":"Res. Synth. Methods"},{"key":"ref60","year":"2022"},{"key":"ref61","year":"2011"},{"key":"ref62","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/j.conb.2018.04.007","article-title":"Neural data science: accelerating the experiment-analysis-theory cycle in large-scale neuroscience","volume":"50","author":"Paninski","year":"2018","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref63","doi-asserted-by":"publisher","first-page":"119306","DOI":"10.1016\/j.neuroimage.2022.119306","article-title":"Survey on open science practices in functional neuroimaging","volume":"257","author":"Paret","year":"2022","journal-title":"NeuroImage"},{"key":"ref64","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1038\/s41597-019-0104-8","article-title":"EEG-BIDS, an extension to the brain imaging data structure for electroencephalography","volume":"6","author":"Pernet","year":"2019","journal-title":"Sci. Data"},{"key":"ref65","doi-asserted-by":"publisher","first-page":"1473","DOI":"10.1038\/s41593-020-00709-0","article-title":"Issues and recommendations from the OHBM COBIDAS MEEG committee for reproducible EEG and MEG research","volume":"23","author":"Pernet","year":"2020","journal-title":"Nat. Neurosci."},{"key":"ref66","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/j.phro.2021.10.007","article-title":"A systematic review and quality of reporting checklist for repeatability and reproducibility of radiomic features","volume":"20","author":"Pfaehler","year":"2021","journal-title":"Phys. Imag. Radiat. Oncol."},{"key":"ref67","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nrn.2016.167","article-title":"Scanning the horizon: towards transparent and reproducible neuroimaging research","volume":"18","author":"Poldrack","year":"2017","journal-title":"Nat. Rev. Neurosci."},{"key":"ref68","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1146\/annurev-biodatasci-072018-021237","article-title":"Computational and informatic advances for reproducible data analysis in neuroimaging","volume":"2","author":"Poldrack","year":"","journal-title":"Ann. Rev. Biomed. Data Sci."},{"key":"ref69","doi-asserted-by":"publisher","first-page":"116357","DOI":"10.1016\/j.neuroimage.2019.116357","article-title":"Introduction to the special issue on reproducibility in neuroimaging","volume":"218","author":"Poldrack","year":"","journal-title":"Neuroimage"},{"key":"ref70","doi-asserted-by":"publisher","DOI":"10.21203\/rs.3.rs-2649734\/v1","article-title":"Neurodesk: an accessible, flexible, and portable data analysis environment for reproducible neuroimaging","author":"Renton","year":"2022","journal-title":"bioRxiv"},{"key":"ref71","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1016\/j.neuroimage.2018.08.042","article-title":"Reproducible evaluation of classification methods in Alzheimer's disease: framework and application to MRI and PET data","volume":"183","author":"Samper-Gonz\u00e1lez","year":"2018","journal-title":"NeuroImage"},{"key":"ref72","doi-asserted-by":"publisher","first-page":"990","DOI":"10.1038\/s41562-021-01142-4","article-title":"Initial evidence of research quality of registered reports compared with the standard publishing model","volume":"5","author":"Soderberg","year":"2021","journal-title":"Nat. Hum. Behav."},{"key":"ref73","doi-asserted-by":"publisher","first-page":"118721","DOI":"10.1016\/j.neuroimage.2021.118721","article-title":"Towards ARTEM-IS: design guidelines for evidence-based EEG methodology reporting tools","volume":"245","author":"Styles","year":"2021","journal-title":"NeuroImage"},{"key":"ref74","doi-asserted-by":"publisher","first-page":"2778","DOI":"10.1177\/0271678X211015101","article-title":"Reproducibility of findings in modern PET neuroimaging: insight from the NRM2018 grand challenge","volume":"41","author":"Veronese","year":"2021","journal-title":"J. Cereb. Blood Flow Metab."},{"key":"ref75","doi-asserted-by":"publisher","first-page":"2727","DOI":"10.1002\/hbm.25829","article-title":"ENIGMA HALFpipe: interactive, reproducible, and efficient analysis for resting-state and task-based fMRI data","volume":"43","author":"Waller","year":"2022","journal-title":"Hum. Brain Mapp."},{"key":"ref76","year":"2017"},{"key":"ref77","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1002\/hbm.25120","article-title":"Data sharing and privacy issues in neuroimaging research: opportunities, obstacles, challenges, and monsters under the bed","volume":"43","author":"White","year":"2022","journal-title":"Hum. Brain Mapp."},{"key":"ref78","doi-asserted-by":"publisher","first-page":"e02733","DOI":"10.1002\/cnm.2733","article-title":"Energy minimization in medical image analysis: methodologies and applications","volume":"32","author":"Zhao","year":"2016","journal-title":"Int. J. Numeric. Methods Biomed. Eng."}],"container-title":["Frontiers in Neuroinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2024.1420315\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,30]],"date-time":"2024-09-30T04:32:45Z","timestamp":1727670765000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2024.1420315\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,30]]},"references-count":78,"alternative-id":["10.3389\/fninf.2024.1420315"],"URL":"https:\/\/doi.org\/10.3389\/fninf.2024.1420315","relation":{},"ISSN":["1662-5196"],"issn-type":[{"value":"1662-5196","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,30]]},"article-number":"1420315"}}