{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,29]],"date-time":"2025-03-29T19:13:45Z","timestamp":1743275625567,"version":"3.35.0"},"reference-count":19,"publisher":"Oxford University Press (OUP)","issue":"15","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":3023,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/2.0\/uk\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2008,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: Recent attempts to account for multiple testing in the analysis of microarray data have focused on controlling the false discovery rate (FDR), which is defined as the expected percentage of the number of false positive genes among the claimed significant genes. As a consequence, the accuracy of the FDR estimators will be important for correctly controlling FDR. Xie et al. found that the standard permutation method of estimating FDR is biased and proposed to delete the predicted differentially expressed (DE) genes in the estimation of FDR for one-sample comparison. However, we notice that the formula of the FDR used in their paper is incorrect. This makes the comparison results reported in their paper unconvincing. Other problems with their method include the biased estimation of FDR caused by over- or under-deletion of DE genes in the estimation of FDR and by the implicit use of an unreasonable estimator of the true proportion of equivalently expressed (EE) genes. Due to the great importance of accurate FDR estimation in microarray data analysis, it is necessary to point out such problems and propose improved methods.<\/jats:p><jats:p>Results: Our results confirm that the standard permutation method overestimates the FDR. With the correct FDR formula, we show the method of Xie et al. always gives biased estimation of FDR: it overestimates when the number of claimed significant genes is small, and underestimates when the number of claimed significant genes is large. To overcome these problems, we propose two modifications. The simulation results show that our estimator gives more accurate estimation.<\/jats:p><jats:p>Contact: \u00a0szhang3@unl.edu<\/jats:p>","DOI":"10.1093\/bioinformatics\/btn310","type":"journal-article","created":{"date-parts":[[2008,6,24]],"date-time":"2008-06-24T00:13:49Z","timestamp":1214266429000},"page":"1655-1661","source":"Crossref","is-referenced-by-count":9,"title":["On correcting the overestimation of the permutation-based false discovery rate estimator"],"prefix":"10.1093","volume":"24","author":[{"given":"Shuo","family":"Jiao","sequence":"first","affiliation":[{"name":"Department of Statistics, University of Nebraska Lincoln, Lincoln, NE 68526, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shunpu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Nebraska Lincoln, Lincoln, NE 68526, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2008,6,23]]},"reference":[{"key":"2023020210492666100_B1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a pratical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc"},{"key":"2023020210492666100_B2","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1214\/aos\/1013699998","article-title":"The control of the False discovery rate in multiple testing under dependency","volume":"29","author":"Benjamini","year":"2001","journal-title":"Ann. Stat"},{"key":"2023020210492666100_B3","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1198\/016214501753382129","article-title":"Empirical Bayes analysis of a microarray experiment","volume":"96","author":"Efron","year":"2001","journal-title":"J. Am. Stat. Assoc"},{"key":"2023020210492666100_B4","first-page":"989","article-title":"Using weighted permutation scores to detect differential gene expression with microarray data","volume":"3","author":"Guo","year":"2005","journal-title":"J. Comput. Biol"},{"key":"2023020210492666100_B5","doi-asserted-by":"crossref","first-page":"3899","DOI":"10.1002\/sim.1548","article-title":"On parametric empirical Bayes methods for comparing multiple groups using replicated gene expression profiles","volume":"22","author":"Kendziorski","year":"2003","journal-title":"Stat. Med"},{"key":"2023020210492666100_B6","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1089\/10665270050514954","article-title":"Analysis of variance for gene expression microarray data","volume":"7","author":"Kerr","year":"2000","journal-title":"J. Comput. Biol"},{"key":"2023020210492666100_B7","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1089\/106652701300099074","article-title":"On differentially variability of expression ratios: improving statistical inference about gene expression changes from microarray data","volume":"8","author":"Newton","year":"2001","journal-title":"J. Comput. Biol"},{"key":"2023020210492666100_B8","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s10142-003-0085-7","article-title":"A mixture model approach to detecting differentially expressed genes with microarray data","volume":"3","author":"Pan","year":"2003","journal-title":"Funct. Integr. Genomics"},{"key":"2023020210492666100_B9","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1093\/bioinformatics\/btg167","article-title":"On the use of permutation in the performance of a class of nonparametric methods to detect differential gene expression","volume":"19","author":"Pan","year":"2003","journal-title":"Bioinformatics"},{"key":"2023020210492666100_B10","article-title":"Multiple testing procedures: R multtest package and applications to genomics","volume":"164","author":"Pollard","year":"2004"},{"key":"2023020210492666100_B11","article-title":"Linear models and empirical bayes methods for assessing differential expression in microarray experiments","volume":"3","author":"Smyth","year":"2004","journal-title":"Stat. Appl. Gene. Mol. Biol"},{"key":"2023020210492666100_B12","doi-asserted-by":"crossref","first-page":"9440","DOI":"10.1073\/pnas.1530509100","article-title":"Statistical significance for genomewide studies","volume":"100","author":"Storey","year":"2003","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023020210492666100_B13","doi-asserted-by":"crossref","first-page":"1227","DOI":"10.1101\/gr.165101","article-title":"An efficient and robust statistical modeling approach to discover differentially expressed genes using genomic expression profiles","volume":"11","author":"Thomas","year":"2001","journal-title":"Genome Res"},{"key":"2023020210492666100_B14","doi-asserted-by":"crossref","first-page":"5116","DOI":"10.1073\/pnas.091062498","article-title":"Significant analysis of microarrays applied to the ionizing radiation response","volume":"98","author":"Tusher","year":"2001","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023020210492666100_B15","doi-asserted-by":"crossref","first-page":"4280","DOI":"10.1093\/bioinformatics\/bti685","article-title":"A note on using permutation based false discovery rate estimate to compare different analysis methods for microarray data","volume":"21","author":"Xie","year":"2005","journal-title":"Bioinformatics"},{"key":"2023020210492666100_B16","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/S0378-3758(99)00041-5","article-title":"Resampling based false discovery rate controlling multiple testing procedure for correlated test statistics","volume":"82","author":"Yekutieli","year":"1999","journal-title":"J. Stat. Plann. Inference"},{"key":"2023020210492666100_B17","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1093\/bioinformatics\/btf879","article-title":"Modified nonparametric approaches to detecting differentially expressed genes in replicated microarray experiments","volume":"19","author":"Zhao","year":"2003","journal-title":"Bioinformatics"},{"key":"2023020210492666100_B18","article-title":"An improved nonparametric approach for detecting differentially expressed genes with replicated microarray data","volume":"5","author":"Zhang","year":"2006","journal-title":"Stat. Appl. Gene. Mol. Biol"},{"key":"2023020210492666100_B19","doi-asserted-by":"crossref","first-page":"11719","DOI":"10.1073\/pnas.0404397101","article-title":"Evolutionary genomics of ecological specialization","volume":"101","author":"Zhong","year":"2004","journal-title":"Proc. Natl Acad. Sci. USA"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/15\/1655\/49049440\/bioinformatics_24_15_1655.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/15\/1655\/49049440\/bioinformatics_24_15_1655.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,30]],"date-time":"2025-01-30T20:54:31Z","timestamp":1738270471000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/24\/15\/1655\/265824"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,6,23]]},"references-count":19,"journal-issue":{"issue":"15","published-print":{"date-parts":[[2008,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btn310","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"type":"electronic","value":"1367-4811"},{"type":"print","value":"1367-4803"}],"subject":[],"published-other":{"date-parts":[[2008,8,1]]},"published":{"date-parts":[[2008,6,23]]}}}