{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T22:35:46Z","timestamp":1775514946203,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009279","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,10,8]],"date-time":"2021-10-08T00:00:00Z","timestamp":1633651200000}}],"reference-count":59,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2021,9,16]],"date-time":"2021-09-16T00:00:00Z","timestamp":1631750400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1707298"],"award-info":[{"award-number":["DMS-1707298"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["1R01MH120482-01"],"award-info":[{"award-number":["1R01MH120482-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["N66001-15-C-40401"],"award-info":[{"award-number":["N66001-15-C-40401"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006112","name":"Microsoft Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006112","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Basic Research Program of China","doi-asserted-by":"publisher","award":["2015CB351702"],"award-info":[{"award-number":["2015CB351702"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["81471740"],"award-info":[{"award-number":["81471740"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["81220108014"],"award-info":[{"award-number":["81220108014"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"China Netherlands CAS-NWO Programme","award":["153111KYSB20160020"],"award-info":[{"award-number":["153111KYSB20160020"]}]},{"name":"Beijing Municipal Science and Tech Commission","award":["Z161100002616023"],"award-info":[{"award-number":["Z161100002616023"]}]},{"name":"Beijing Municipal Science and Tech Commission","award":["Z171100000117012"],"award-info":[{"award-number":["Z171100000117012"]}]},{"name":"Start-up Funds for Leading Talents at Beijing Normal University, the Major Project of National Social Science Foundation of China","award":["20&ZD296"],"award-info":[{"award-number":["20&ZD296"]}]},{"name":"National Basic Science Data Center \u201cChinese Data-sharing Warehouse for In-vivo Imaging Brain\u201d","award":["NBSDC-DB-15"],"award-info":[{"award-number":["NBSDC-DB-15"]}]},{"name":"Guangxi Bagui Scholarship","award":["201621"],"award-info":[{"award-number":["201621"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Replicability, the ability to replicate scientific findings, is a prerequisite for scientific discovery and clinical utility. Troublingly, we are in the midst of a replicability crisis. A key to replicability is that multiple measurements of the same item (e.g., experimental sample or clinical participant) under fixed experimental constraints are relatively similar to one another. Thus, statistics that quantify the relative contributions of accidental deviations\u2014such as measurement error\u2014as compared to systematic deviations\u2014such as individual differences\u2014are critical. We demonstrate that existing replicability statistics, such as intra-class correlation coefficient and fingerprinting, fail to adequately differentiate between accidental and systematic deviations in very simple settings. We therefore propose a novel statistic, <jats:italic>discriminability<\/jats:italic>, which quantifies the degree to which an individual\u2019s samples are relatively similar to one another, without restricting the data to be univariate, Gaussian, or even Euclidean. Using this statistic, we introduce the possibility of optimizing experimental design via increasing discriminability and prove that optimizing discriminability improves performance bounds in subsequent inference tasks. In extensive simulated and real datasets (focusing on brain imaging and demonstrating on genomics), only optimizing data <jats:italic>discriminability<\/jats:italic> improves performance on all subsequent inference tasks for each dataset. We therefore suggest that designing experiments and analyses to optimize discriminability may be a crucial step in solving the replicability crisis, and more generally, mitigating accidental measurement error.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009279","type":"journal-article","created":{"date-parts":[[2021,9,16]],"date-time":"2021-09-16T17:46:50Z","timestamp":1631814410000},"page":"e1009279","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":47,"title":["Eliminating accidental deviations to minimize generalization error and maximize replicability: Applications in connectomics and genomics"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6115-719X","authenticated-orcid":true,"given":"Eric W.","family":"Bridgeford","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8421-795X","authenticated-orcid":true,"given":"Shangsi","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2786-6969","authenticated-orcid":true,"given":"Zeyi","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0065-3832","authenticated-orcid":true,"given":"Ting","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4950-1303","authenticated-orcid":true,"given":"Cameron","family":"Craddock","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6713-7402","authenticated-orcid":true,"given":"Jayanta","family":"Dey","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8915-496X","authenticated-orcid":true,"given":"Gregory","family":"Kiar","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7362-9665","authenticated-orcid":true,"given":"William","family":"Gray-Roncal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carlo","family":"Colantuoni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2510-4151","authenticated-orcid":true,"given":"Christopher","family":"Douville","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4804-5553","authenticated-orcid":true,"given":"Stephanie","family":"Noble","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0139-7201","authenticated-orcid":true,"given":"Carey E.","family":"Priebe","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brian","family":"Caffo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3532-1210","authenticated-orcid":true,"given":"Michael","family":"Milham","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9110-585X","authenticated-orcid":true,"given":"Xi-Nian","family":"Zuo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"name":"Consortium for Reliability and Reproducibility","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2487-6237","authenticated-orcid":true,"given":"Joshua T.","family":"Vogelstein","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2021,9,16]]},"reference":[{"issue":"1","key":"pcbi.1009279.ref001","doi-asserted-by":"crossref","first-page":"72","DOI":"10.2307\/1412159","article-title":"The Proof and Measurement of Association between Two Things","volume":"15","author":"C Spearman","year":"1904","journal-title":"Am J Psychol"},{"issue":"10","key":"pcbi.1009279.ref002","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1038\/nrg2825","article-title":"Tackling the widespread and critical impact of batch effects in high-throughput data","volume":"11","author":"JT Leek","year":"2010","journal-title":"Nat Rev Genet"},{"issue":"7549","key":"pcbi.1009279.ref003","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1038\/520612a","article-title":"Statistics: P values are just the tip of the iceberg","volume":"520","author":"JT Leek","year":"2015","journal-title":"Nature"},{"key":"pcbi.1009279.ref004","unstructured":"National Academies of Sciences E. Reproducibility and Replicability in Science; 2019."},{"issue":"341","key":"pcbi.1009279.ref005","doi-asserted-by":"crossref","first-page":"341ps12","DOI":"10.1126\/scitranslmed.aaf5027","article-title":"What does research reproducibility mean?","volume":"8","author":"SN Goodman","year":"2016","journal-title":"Sci Transl Med"},{"issue":"5","key":"pcbi.1009279.ref006","doi-asserted-by":"crossref","first-page":"e0216125","DOI":"10.1371\/journal.pone.0216125","article-title":"Scientific discovery in a model-centric framework: Reproducibility, innovation, and epistemic diversity","volume":"14","author":"B Devezer","year":"2019","journal-title":"PLoS One"},{"issue":"4","key":"pcbi.1009279.ref007","first-page":"1484","article-title":"Stability","volume":"19","author":"B Yu","year":"2013","journal-title":"Bernoulli"},{"issue":"8","key":"pcbi.1009279.ref008","doi-asserted-by":"crossref","first-page":"e124","DOI":"10.1371\/journal.pmed.0020124","article-title":"Why most published research findings are false","volume":"2","author":"JPA Ioannidis","year":"2005","journal-title":"PLoS Med"},{"key":"pcbi.1009279.ref009","doi-asserted-by":"crossref","unstructured":"Baker M. Over half of psychology studies fail reproducibility test. Nature Online. 2015 Aug.","DOI":"10.1038\/nature.2015.18248"},{"issue":"4","key":"pcbi.1009279.ref010","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1177\/1745691616646366","article-title":"What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science","volume":"11","author":"P Patil","year":"2016","journal-title":"Perspect Psychol Sci"},{"issue":"1","key":"pcbi.1009279.ref011","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/01973533.2015.1012991","article-title":"Editorial","volume":"37","author":"D Trafimow","year":"2015","journal-title":"Basic Appl Soc Psych"},{"issue":"sup1","key":"pcbi.1009279.ref012","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1080\/00031305.2018.1537892","article-title":"Assessing the Statistical Analyses Used in Basic and Applied Social Psychology After Their p-Value Ban","volume":"73","author":"RD Fricker","year":"2019","journal-title":"Am Stat"},{"issue":"sup1","key":"pcbi.1009279.ref013","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/00031305.2019.1583913","article-title":"Moving to a World Beyond \u201cp < 0.05\u201d","volume":"73","author":"RL Wasserstein","year":"2019","journal-title":"Am Stat"},{"key":"pcbi.1009279.ref014","doi-asserted-by":"crossref","unstructured":"Vogelstein JT. P-Values in a Post-Truth World. arXiv. 2020 Jul.","DOI":"10.31219\/osf.io\/yw6sr"},{"issue":"1","key":"pcbi.1009279.ref015","doi-asserted-by":"crossref","first-page":"93","DOI":"10.2307\/2092790","article-title":"Separating Reliability and Stability in Test-Retest Correlation","volume":"34","author":"DR Heise","year":"1969","journal-title":"Am Sociol Rev"},{"key":"pcbi.1009279.ref016","first-page":"140049","article-title":"An open science resource for establishing reliability and reproducibility in functional connectomics","author":"XN Zuo","year":"2014","journal-title":"Sci Data"},{"issue":"2","key":"pcbi.1009279.ref017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/gigascience\/giw011","article-title":"The Healthy Brain Network Serial Scanning Initiative: a resource for evaluating inter-individual differences and their reliabilities across scan conditions and sessions","volume":"6","author":"D O\u2019Connor","year":"2017","journal-title":"Gigascience"},{"issue":"8","key":"pcbi.1009279.ref018","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1038\/s41562-019-0655-x","article-title":"Harnessing reliability for neuroscience research","volume":"3","author":"XN Zuo","year":"2019","journal-title":"Nat Hum Behav"},{"key":"pcbi.1009279.ref019","author":"A Nikolaidis","year":"2019","journal-title":"Bagging Improves Reproducibility of Functional Parcellation of the Human Brain"},{"issue":"4","key":"pcbi.1009279.ref020","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1006\/nimg.2001.1034","article-title":"The quantitative evaluation of functional neuroimaging experiments: the NPAIRS data analysis framework","volume":"15","author":"SC Strother","year":"2002","journal-title":"Neuroimage"},{"issue":"7","key":"pcbi.1009279.ref021","doi-asserted-by":"crossref","first-page":"e0131520","DOI":"10.1371\/journal.pone.0131520","article-title":"An Automated, Adaptive Framework for Optimizing Preprocessing Pipelines in Task-Based Functional MRI","volume":"10","author":"NW Churchill","year":"2015","journal-title":"PLoS One"},{"issue":"10","key":"pcbi.1009279.ref022","doi-asserted-by":"crossref","first-page":"1784","DOI":"10.1109\/TBME.2004.831538","article-title":"Detection of skin cancer by classification of Raman spectra","volume":"51","author":"S Sigurdsson","year":"2004","journal-title":"IEEE Trans Biomed Eng"},{"issue":"4","key":"pcbi.1009279.ref023","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1006\/nimg.2001.1033","article-title":"The quantitative evaluation of functional neuroimaging experiments: mutual information learning curves","volume":"15","author":"U Kjems","year":"2002","journal-title":"Neuroimage"},{"key":"pcbi.1009279.ref024","doi-asserted-by":"crossref","DOI":"10.1093\/actrade\/9780198779568.001.0001","volume-title":"Measurement: A Very Short Introduction","author":"DJ Hand","year":"2016"},{"key":"pcbi.1009279.ref025","volume-title":"The Design of Experiments","author":"RA Fisher","year":"1935"},{"key":"pcbi.1009279.ref026","first-page":"115","volume-title":"Handbook of Psychology","author":"RE Kirk","year":"2012"},{"issue":"2-3","key":"pcbi.1009279.ref027","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1002\/(SICI)1097-0193(1999)8:2\/3<109::AID-HBM7>3.0.CO;2-W","article-title":"Optimal experimental design for event-related fMRI","volume":"8","author":"AM Dale","year":"1999","journal-title":"Human brain mapping"},{"issue":"7","key":"pcbi.1009279.ref028","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.1162\/0899766053723032","article-title":"Asymptotic theory of information-theoretic experimental design","volume":"17","author":"L Paninski","year":"2005","journal-title":"Neural Comput"},{"issue":"2","key":"pcbi.1009279.ref029","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1111\/j.2044-8317.1963.tb00206.x","article-title":"Theory of Generalizability: a Liberalization of Reliability Theory","volume":"16","author":"LJ Cronbach","year":"1963","journal-title":"British Journal of Statistical Psychology"},{"issue":"11","key":"pcbi.1009279.ref030","doi-asserted-by":"crossref","first-page":"5415","DOI":"10.1093\/cercor\/bhx230","article-title":"Influences on the Test-Retest Reliability of Functional Connectivity MRI and its Relationship with Behavioral Utility","volume":"27","author":"S Noble","year":"2017","journal-title":"Cereb Cortex"},{"key":"pcbi.1009279.ref031","unstructured":"Wang Z, Bridgeford E, Wang S, Vogelstein JT, Caffo B. Statistical Analysis of Data Repeatability Measures. arXiv. 2020 May. Available from: https:\/\/arxiv.org\/abs\/2005.11911v3."},{"key":"pcbi.1009279.ref032","doi-asserted-by":"crossref","first-page":"140049","DOI":"10.1038\/sdata.2014.49","article-title":"An open science resource for establishing reliability and reproducibility in functional connectomics","volume":"1","author":"XN Zuo","year":"2014","journal-title":"Scientific data"},{"issue":"1","key":"pcbi.1009279.ref033","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1002\/wics.1375","article-title":"Energy distance","volume":"8","author":"ML Rizzo","year":"2016","journal-title":"WIREs Comput Stat"},{"issue":"1-2","key":"pcbi.1009279.ref034","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000060","article-title":"Kernel Mean Embedding of Distributions: A Review and Beyond","volume":"10","author":"K Muandet","year":"2017","journal-title":"Foundations and Trends\u00ae in Machine Learning"},{"key":"pcbi.1009279.ref035","unstructured":"Shen C, Priebe CE, Vogelstein JT. The Exact Equivalence of Independence Testing and Two-Sample Testing. arXiv. 2019 Oct. Available from: https:\/\/arxiv.org\/abs\/1910.08883."},{"key":"pcbi.1009279.ref036","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.41690","article-title":"Discovering and deciphering relationships across disparate data modalities","volume":"8","author":"JT Vogelstein","year":"2019","journal-title":"Elife"},{"issue":"11","key":"pcbi.1009279.ref037","doi-asserted-by":"crossref","first-page":"1664","DOI":"10.1038\/nn.4135","article-title":"Functional connectome fingerprinting: identifying individuals using patterns of brain connectivity","volume":"18","author":"ES Finn","year":"2015","journal-title":"Nat Neurosci"},{"issue":"2","key":"pcbi.1009279.ref038","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1037\/0033-2909.86.2.420","article-title":"Intraclass correlations: uses in assessing rater reliability","volume":"86","author":"PE Shrout","year":"1979","journal-title":"Psychol Bull"},{"issue":"1","key":"pcbi.1009279.ref039","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1002\/cjs.11591","article-title":"On statistical tests of functional connectome fingerprinting","volume":"49","author":"Z Wang","year":"2021","journal-title":"Can J Stat"},{"key":"pcbi.1009279.ref040","doi-asserted-by":"crossref","DOI":"10.4135\/9781412985642","volume-title":"Reliability and Validity Assessment","author":"EG Carmines","year":"1979"},{"issue":"Mar","key":"pcbi.1009279.ref041","first-page":"723","article-title":"A Kernel Two-Sample Test","volume":"13","author":"A Gretton","year":"2012","journal-title":"Journal of Machine Learning Research"},{"issue":"3","key":"pcbi.1009279.ref042","doi-asserted-by":"crossref","first-page":"2163","DOI":"10.1016\/j.neuroimage.2009.10.080","article-title":"Reliable intrinsic connectivity networks: test\u2013retest evaluation using ICA and dual regression approach","volume":"49","author":"XN Zuo","year":"2010","journal-title":"Neuroimage"},{"issue":"10","key":"pcbi.1009279.ref043","doi-asserted-by":"crossref","first-page":"4734","DOI":"10.1073\/pnas.0911855107","article-title":"Toward discovery science of human brain function","volume":"107","author":"BB Biswal","year":"2010","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1009279.ref044","unstructured":"Sikka S, Cheung B, Khanuja R, Ghosh S, Yan C, Li Q, et al. Towards automated analysis of connectomes: The configurable pipeline for the analysis of connectomes (c-pac). In: 5th INCF Congress of Neuroinformatics, Munich, Germany. vol. 10; 2014."},{"issue":"2","key":"pcbi.1009279.ref045","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MEMB.2006.1607667","article-title":"Evaluating fMRI preprocessing pipelines","volume":"25","author":"SC Strother","year":"2006","journal-title":"IEEE Engineering in Medicine and Biology Magazine"},{"key":"pcbi.1009279.ref046","unstructured":"Kiar G, Bridgeford E, Roncal WG, (CoRR) CfR, Reproducibliity, Chandrashekhar V, et al. A High-Throughput Pipeline Identifies Robust Connectomes But Troublesome Variability. bioRxiv. 2018 Apr:188706. Available from: https:\/\/www.biorxiv.org\/content\/early\/2018\/04\/24\/188706."},{"key":"pcbi.1009279.ref047","article-title":"Towards Automated Analysis of Connectomes: The Configurable Pipeline for the Analysis of Connectomes (C-PAC)","author":"C Craddock","year":"2013","journal-title":"Frontiers in Neuroimformatics"},{"key":"pcbi.1009279.ref048","article-title":"From Distance Correlation to Multiscale Generalized Correlation","author":"C Shen","year":"2017","journal-title":"Journal of American Statistical Association"},{"issue":"4","key":"pcbi.1009279.ref049","doi-asserted-by":"crossref","first-page":"518","DOI":"10.1016\/j.stem.2016.11.005","article-title":"Analysis of Transcriptional Variability in a Large Human iPSC Library Reveals Genetic and Non-genetic Determinants of Heterogeneity","volume":"20","author":"I Carcamo-Orive","year":"2017","journal-title":"Cell Stem Cell"},{"issue":"9","key":"pcbi.1009279.ref050","doi-asserted-by":"crossref","first-page":"4858","DOI":"10.1073\/pnas.1910041117","article-title":"Assessing aneuploidy with repetitive element sequencing","volume":"117","author":"C Douville","year":"2020","journal-title":"Proc Natl Acad Sci USA"},{"key":"pcbi.1009279.ref051","volume-title":"Statistical methods for research workers","author":"RA Fisher","year":"1925"},{"issue":"9","key":"pcbi.1009279.ref052","first-page":"1","article-title":"Object-oriented Computation of Sandwich Estimators","volume":"16","author":"A Zeileis","year":"2006","journal-title":"Journal of Statistical Software, Articles"},{"issue":"8","key":"pcbi.1009279.ref053","doi-asserted-by":"crossref","first-page":"1249","DOI":"10.1016\/j.jspi.2013.03.018","article-title":"Energy statistics: A class of statistics based on distances","volume":"143","author":"GJ Sz\u00e9kely","year":"2013","journal-title":"J Stat Plan Inference"},{"issue":"2","key":"pcbi.1009279.ref054","doi-asserted-by":"crossref","first-page":"1034","DOI":"10.1214\/09-AOAS245","article-title":"Disco analysis: A nonparametric extension of analysis of variance","volume":"4","author":"ML Rizzo","year":"2010","journal-title":"The Annals of Applied Statistics"},{"issue":"1","key":"pcbi.1009279.ref055","first-page":"183","article-title":"FlashR: parallelize and scale R for machine learning using SSDs","volume":"53","author":"D Zheng","year":"2018","journal-title":"Proceedings of the 23rd"},{"key":"pcbi.1009279.ref056","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.neuroimage.2016.11.052","article-title":"Towards a consensus regarding global signal regression for resting state functional connectivity MRI","volume":"154","author":"K Murphy","year":"2017","journal-title":"Neuroimage"},{"key":"pcbi.1009279.ref057","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.neuroimage.2017.02.036","article-title":"The global signal in fMRI: Nuisance or Information?","volume":"150","author":"TT Liu","year":"2017","journal-title":"Neuroimage"},{"key":"pcbi.1009279.ref058","author":"S Panda","year":"2020","journal-title":"hyppo: A Comprehensive Multivariate Hypothesis Testing Python Package"},{"key":"pcbi.1009279.ref059","unstructured":"Bridgeford E, Shen C, Wang S, Vogelstein JT. Multiscale Generalized Correlation; 2018. Available from: https:\/\/doi.org\/10.5281\/zenodo.1246967."}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009279","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,10,8]],"date-time":"2021-10-08T00:00:00Z","timestamp":1633651200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009279","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,10]],"date-time":"2021-10-10T00:06:30Z","timestamp":1633824390000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009279"}},"subtitle":[],"editor":[{"given":"Blake A.","family":"Richards","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,9,16]]},"references-count":59,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,9,16]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009279","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1009279","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,16]]}}}