{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T04:56:03Z","timestamp":1776833763335,"version":"3.51.2"},"reference-count":20,"publisher":"Oxford University Press (OUP)","issue":"10","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2008,5,15]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: The false discovery rate (FDR) has been widely adopted to address the multiple comparisons issue in high-throughput experiments such as microarray gene-expression studies. However, while the FDR is quite useful as an approach to limit false discoveries within a single experiment, like other multiple comparison corrections it may be an inappropriate way to compare results across experiments. This article uses several examples based on gene-expression data to demonstrate the potential misinterpretations that can arise from using FDR to compare across experiments. Researchers should be aware of these pitfalls and wary of using FDR to compare experimental results. FDR should be augmented with other measures such as p-values and expression ratios. It is worth including standard error and variance information for meta-analyses and, if possible, the raw data for re-analyses. This is especially important for high-throughput studies because data are often re-used for different objectives, including comparing common elements across many experiments. No single error rate or data summary may be appropriate for all of the different objectives.<\/jats:p><jats:p>Contact: \u00a0Eugene.Kolker@seattlechildrens.org<\/jats:p>","DOI":"10.1093\/bioinformatics\/btn120","type":"journal-article","created":{"date-parts":[[2008,4,20]],"date-time":"2008-04-20T00:44:04Z","timestamp":1208652244000},"page":"1225-1228","source":"Crossref","is-referenced-by-count":34,"title":["A note on the false discovery rate and inconsistent comparisons between experiments"],"prefix":"10.1093","volume":"24","author":[{"given":"Roger","family":"Higdon","sequence":"first","affiliation":[{"name":"1 Seattle Children's Research Institute, Seattle, WA 98101, 2Departments of Biostatistics and Environmental and Occupational Health Sciences, University of Washington and 3Division of Biomedical Informatics, Department of Medical Education and Biomedical Informatics, University of Washington, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gerald","family":"van Belle","sequence":"additional","affiliation":[{"name":"1 Seattle Children's Research Institute, Seattle, WA 98101, 2Departments of Biostatistics and Environmental and Occupational Health Sciences, University of Washington and 3Division of Biomedical Informatics, Department of Medical Education and Biomedical Informatics, University of Washington, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eugene","family":"Kolker","sequence":"additional","affiliation":[{"name":"1 Seattle Children's Research Institute, Seattle, WA 98101, 2Departments of Biostatistics and Environmental and Occupational Health Sciences, University of Washington and 3Division of Biomedical Informatics, Department of Medical Education and Biomedical Informatics, University of Washington, Seattle, WA 98195, USA"},{"name":"1 Seattle Children's Research Institute, Seattle, WA 98101, 2Departments of Biostatistics and Environmental and Occupational Health Sciences, University of Washington and 3Division of Biomedical Informatics, Department of Medical Education and Biomedical Informatics, University of Washington, Seattle, WA 98195, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2008,4,19]]},"reference":[{"key":"2023020210031230200_B1","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1038\/nrg1749","article-title":"Microarray data analysis: from disarray to consolidation and consensus","volume":"7","author":"Allison","year":"2006","journal-title":"Nat. Rev. Genet"},{"key":"2023020210031230200_B2","doi-asserted-by":"crossref","first-page":"D760","DOI":"10.1093\/nar\/gkl887","article-title":"NCBI GEO: mining tens of millions of expression profiles\u2013database and tools update","volume":"35","author":"Barrett","year":"2007","journal-title":"Nucleic Acids Res"},{"key":"2023020210031230200_B3","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. Royal Stat. Soc. Ser. B"},{"key":"2023020210031230200_B4","doi-asserted-by":"crossref","first-page":"2371","DOI":"10.1534\/genetics.105.052506","article-title":"Relaxed significance criteria for linkage analysis","volume":"173","author":"Chen","year":"2006","journal-title":"Genetics"},{"key":"2023020210031230200_B5","doi-asserted-by":"crossref","first-page":"i84","DOI":"10.1093\/bioinformatics\/btg1010","article-title":"Combining multiple microarray studies and modeling interstudy variation","volume":"19","author":"Choi","year":"2003","journal-title":"Bioinformatics"},{"key":"2023020210031230200_B6","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1214\/ss\/1056397487","article-title":"Multiple hypothesis testing in microarray experiments","volume":"18","author":"Dudoit","year":"2003","journal-title":"Stat. Sci"},{"key":"2023020210031230200_B7","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1198\/016214504000000089","article-title":"Large-scale simultaneous hypothesis testing: the choice of a null hypothesis","volume":"99","author":"Efron","year":"2004","journal-title":"J. Am. Stat. Assoc"},{"key":"2023020210031230200_B8","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1111\/1467-9868.00325","article-title":"Familywise robustness criteria for multiple-comparison procedures","volume":"64","author":"Holland","year":"2002","journal-title":"J. Royal Stat. Soc. Ser. B"},{"key":"2023020210031230200_B9","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"6","author":"Holm","year":"1979","journal-title":"Scand. J. Stat"},{"key":"2023020210031230200_B10","doi-asserted-by":"crossref","first-page":"1354","DOI":"10.1074\/mcp.M600274-MCP200","article-title":"Experimental and statistical considerations to avoid false conclusions in proteomic studies using differential in-gel electrophoresis","volume":"8","author":"Karp","year":"2007","journal-title":"Mol. Cell Proteomics"},{"key":"2023020210031230200_B11","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1093\/biostatistics\/2.2.183","article-title":"Experimental design for gene expression microarrays","volume":"2","author":"Kerr","year":"2001","journal-title":"Biostatistics"},{"key":"2023020210031230200_B12","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1007\/BF01908269","article-title":"The use of the studentize range in connection with an analysis of variance","volume":"1","author":"Keuls","year":"1952","journal-title":"Euphytica"},{"key":"2023020210031230200_B13","doi-asserted-by":"crossref","first-page":"787","DOI":"10.2307\/2531110","article-title":"The appropriateness of analysis of variance and multiple-comparison procedures","volume":"39","author":"O\u2019Brien","year":"1983","journal-title":"Biometrics"},{"key":"2023020210031230200_B14","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1097\/00001648-199001000-00010","article-title":"No adjustments are needed for multiple comparisons","volume":"1","author":"Rothman","year":"1990","journal-title":"Epidemiology"},{"key":"2023020210031230200_B15","doi-asserted-by":"crossref","first-page":"Article 3, 1","DOI":"10.2202\/1544-6115.1027","article-title":"Linear models and empirical bayes methods for assessing differential expression in microarray experiments","volume":"3","author":"Smyth","year":"2004","journal-title":"Stat. Appl. Genet. Mol. Biol"},{"key":"2023020210031230200_B16","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.neuroimage.2006.06.033","article-title":"Estimation of false discovery rates for wavelet-denoised statistical parametric maps","volume":"33","author":"Srikanth","year":"2006","journal-title":"Neuroimage"},{"key":"2023020210031230200_B17","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1111\/1467-9868.00346","article-title":"A direct approach to false discovery rates","volume":"64","author":"Storey","year":"2002","journal-title":"J. Royal Stat. Soc. Ser. B"},{"key":"2023020210031230200_B18","doi-asserted-by":"crossref","first-page":"9440","DOI":"10.1073\/pnas.1530509100","article-title":"Statistical significance for genomewide studies","volume":"100","author":"Storey","year":"2003","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023020210031230200_B19","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.1111\/j.0006-341X.2003.00123.x","article-title":"Estimation of false discovery rates in multiple testing: application to gene microarray data","volume":"59","author":"Tsai","year":"2003","journal-title":"Biometrics"},{"key":"2023020210031230200_B20","doi-asserted-by":"crossref","first-page":"5116","DOI":"10.1073\/pnas.091062498","article-title":"Significance analysis of microarrays applied to the ionizing radiation response","volume":"98","author":"Tusher","year":"2001","journal-title":"Proc. Natl Acad. Sci. USA"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/10\/1225\/49046376\/bioinformatics_24_10_1225.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/10\/1225\/49046376\/bioinformatics_24_10_1225.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T20:45:06Z","timestamp":1738183506000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/24\/10\/1225\/178402"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,4,19]]},"references-count":20,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2008,5,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btn120","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2008,5,15]]},"published":{"date-parts":[[2008,4,19]]}}}