{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T10:08:07Z","timestamp":1790935687929,"version":"4.1.0"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2005,8,8]],"date-time":"2005-08-08T00:00:00Z","timestamp":1123459200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0\/"},{"start":{"date-parts":[[2005,8,8]],"date-time":"2005-08-08T00:00:00Z","timestamp":1123459200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                        <jats:title>Background<\/jats:title>\n                        <jats:p>In the analysis of microarray data one generally produces a vector of <jats:italic>p<\/jats:italic>-values that for each gene give the likelihood of obtaining equally strong evidence of change by pure chance. The distribution of these <jats:italic>p<\/jats:italic>-values is a mixture of two components corresponding to the changed genes and the unchanged ones. The focus of this article is how to estimate the proportion unchanged and the false discovery rate (FDR) and how to make inferences based on these concepts. Six published methods for estimating the proportion unchanged genes are reviewed, two alternatives are presented, and all are tested on both simulated and real data. All estimates but one make do without any parametric assumptions concerning the distributions of the <jats:italic>p<\/jats:italic>-values. Furthermore, the estimation and use of the FDR and the closely related q-value is illustrated with examples. Five published estimates of the FDR and one new are presented and tested. Implementations in R code are available.<\/jats:p>\n                     <\/jats:sec><jats:sec>\n                        <jats:title>Results<\/jats:title>\n                        <jats:p>A simulation model based on the distribution of real microarray data plus two real data sets were used to assess the methods. The proposed alternative methods for estimating the proportion unchanged fared very well, and gave evidence of low bias and very low variance. Different methods perform well depending upon whether there are few or many regulated genes. Furthermore, the methods for estimating FDR showed a varying performance, and were sometimes misleading. The new method had a very low error.<\/jats:p>\n                     <\/jats:sec><jats:sec>\n                        <jats:title>Conclusion<\/jats:title>\n                        <jats:p>The concept of the q-value or false discovery rate is useful in practical research, despite some theoretical and practical shortcomings. However, it seems possible to challenge the performance of the published methods, and there is likely scope for further developing the estimates of the FDR. The new methods provide the scientist with more options to choose a suitable method for any particular experiment. The article advocates the use of the conjoint information regarding false positive and negative rates as well as the proportion unchanged when identifying changed genes.<\/jats:p>\n                     <\/jats:sec>","DOI":"10.1186\/1471-2105-6-199","type":"journal-article","created":{"date-parts":[[2005,8,9]],"date-time":"2005-08-09T18:14:00Z","timestamp":1123611240000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":62,"title":["A comparative review of estimates of the proportion unchanged genes and the false discovery rate"],"prefix":"10.1186","volume":"6","author":[{"given":"Per","family":"Broberg","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2005,8,8]]},"reference":[{"key":"524_CR1","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.1198\/016214501753382129","volume":"96","author":"B Efron","year":"2001","unstructured":"Efron B, Tibshirani R, Storey JD, Tusher VG: Empirical Bayes analysis of a microarray experiment. Journal of the American Statistical Association 2001, 96: 1151\u20131160. 10.1198\/016214501753382129","journal-title":"Journal of the American Statistical Association"},{"key":"524_CR2","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y: Controlling the false discovery rate : a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society B 1995, 57: 289\u2013300.","journal-title":"Journal of the Royal Statistical Society B"},{"key":"524_CR3","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1111\/1467-9868.00346","volume":"64","author":"JD Storey","year":"2001","unstructured":"Storey JD: A Direct Approach to False Discovery Rates. Journal of the Royal Statistical Society B 2001, 64: 479\u2013498. 10.1111\/1467-9868.00346","journal-title":"Journal of the Royal Statistical Society B"},{"key":"524_CR4","volume-title":"Technical report","author":"B Efron","year":"2001","unstructured":"Efron B, Storey JD, Tibshirani R: Microarrays, Empirical Bayes Methods, and False Discovery Rates. In Technical report. Volume 217. Stanford, Department of Statistics, Stanford University; 2001."},{"key":"524_CR5","doi-asserted-by":"publisher","first-page":"R41","DOI":"10.1186\/gb-2003-4-6-r41","volume":"4","author":"P Broberg","year":"2003","unstructured":"Broberg P: Statistical methods for ranking differentially expressed genes. Genome Biology 2003, 4: R41. 10.1186\/gb-2003-4-6-r41","journal-title":"Genome Biology"},{"key":"524_CR6","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1111\/j.0006-341X.2004.00228.x","volume":"60","author":"RR Delongchamp","year":"2004","unstructured":"Delongchamp RR, Bowyer JF, Chen JJ, Kodell RL: Multiple-testing strategy for analyzing cDNA array data on gene expression. Biometrics 2004, 60: 774\u2013782. 10.1111\/j.0006-341X.2004.00228.x","journal-title":"Biometrics"},{"key":"524_CR7","doi-asserted-by":"publisher","first-page":"5116","DOI":"10.1073\/pnas.091062498","volume":"98","author":"VG Tusher","year":"2001","unstructured":"Tusher VG, Tibshirani R, Chu G: Significance analysis of microarrays applied to the ionizing radiation response. PNAS 2001, 98: 5116\u20135121. 10.1073\/pnas.091062498","journal-title":"PNAS"},{"key":"524_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S0167-9473(01)00046-9","volume":"39","author":"DB Allison","year":"2002","unstructured":"Allison DB, Gadbury GL, Moonseong H, Fernandez JR, Cheol-Koo L, Prolla TA, Weindruch RA: A mixture model approach for the analysis of microarray gene expression data. Computational Statistics and Data Analysis 2002, 39: 1\u201320. 10.1016\/S0167-9473(01)00046-9","journal-title":"Computational Statistics and Data Analysis"},{"key":"524_CR9","doi-asserted-by":"publisher","first-page":"9440","DOI":"10.1073\/pnas.1530509100","volume":"100","author":"JD Storey","year":"2003","unstructured":"Storey JD, Tibshirani R: Statistical significance for genomewide studies. PNAS 2003, 100: 9440\u20139445. 10.1073\/pnas.1530509100","journal-title":"PNAS"},{"key":"524_CR10","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1093\/bioinformatics\/btg148","volume":"19","author":"S Pounds","year":"2003","unstructured":"Pounds S, Morris SW: Estimating the occurrence of false positives and false negatives in microarray studies by approximating and partitioning the empirical distribution of p-values. Bioinformatics 2003, 19: 1236\u20131242. 10.1093\/bioinformatics\/btg148","journal-title":"Bioinformatics"},{"key":"524_CR11","doi-asserted-by":"publisher","first-page":"1737","DOI":"10.1093\/bioinformatics\/bth160","volume":"20","author":"S Pounds","year":"2004","unstructured":"Pounds S, Cheng C: Improving false discovery rate estimation. Bioinformatics 2004, 20: 1737\u20131745. 10.1093\/bioinformatics\/bth160","journal-title":"Bioinformatics"},{"key":"524_CR12","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1081\/BIP-120024202","volume":"13","author":"H Hsueh","year":"2003","unstructured":"Hsueh H, Chen JJ, Kodell RL: Comparison of Methods for Estimating the Number of True Null Hypotheses in Multiplicity Testing. Journal of Biopharmaceutical Statistics 2003, 13: 675\u2013689. 10.1081\/BIP-120024202","journal-title":"Journal of Biopharmaceutical Statistics"},{"key":"524_CR13","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/TCBB.2004.24","volume":"1","author":"S Scheid","year":"2004","unstructured":"Scheid S, Spang R: A Stochastic Downhill Search Algorithm for Estimating the Local False Discovery Rate. IEEE Transactions on Computational Biology and Bioinformatics 2004, 1: 98\u2013108. 10.1109\/TCBB.2004.24","journal-title":"IEEE Transactions on Computational Biology and Bioinformatics"},{"key":"524_CR14","volume-title":"Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003)","author":"S Scheid","year":"2003","unstructured":"Scheid S, Spang R: A False Discovery Approach to Separate the Score Distributions of Induced and Non-induced Genes. In Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003). Edited by: Hornik K, Leisch F and Zeilis A. Vienna, Austria, Technische Universit\u00e4t Wien. Institut f\u00fcr Statistik; 2003."},{"key":"524_CR15","volume-title":"Testing Statistical Hypotheses","author":"EL Lehmann","year":"1953","unstructured":"Lehmann EL: Testing Statistical Hypotheses. New York, Wiley; 1953."},{"key":"524_CR16","unstructured":"R Foundation for Statistical Computing: R Development Core Team. R: A language and environment for statistical computing.[http:\/\/www.R-project.org]"},{"key":"524_CR17","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1080\/10618600.1996.10474713","volume":"5","author":"R Ihaka","year":"1996","unstructured":"Ihaka R, Gentleman R: R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics 1996, 5: 299\u2013314.","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"524_CR18","unstructured":"The Comprehensive R Archive Network[http:\/\/www.cran.r-project.org]"},{"key":"524_CR19","unstructured":"Bioconductor[http:\/\/www.bioconductor.org]"},{"key":"524_CR20","volume-title":"Statistical Analysis of Gene Expression Microarray Data","author":"YH Yang","year":"2003","unstructured":"Yang YH, Speed T: Design and analysis of comparative microarray experiments. In Statistical Analysis of Gene Expression Microarray Data. Edited by: Speed T. London, Chapman & Hall\/CRC; 2003."},{"key":"524_CR21","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1093\/biomet\/73.3.751","volume":"73","author":"R Simes","year":"1986","unstructured":"Simes R: An improved Bonferroni Procedure for Multiple Tests of Significance. Biometrika 1986, 73: 751\u2013754.","journal-title":"Biometrika"},{"key":"524_CR22","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1093\/bioinformatics\/btf877","volume":"19","author":"A Reiner","year":"2003","unstructured":"Reiner A, Yekutieli D, Benjamini Y: Identifying differentially expressed genes using false discovery rate controlling procedures. Bioinformatics 2003, 19: 368\u2013375. 10.1093\/bioinformatics\/btf877","journal-title":"Bioinformatics"},{"key":"524_CR23","doi-asserted-by":"publisher","first-page":"1071","DOI":"10.1111\/j.0006-341X.2003.00123.x","volume":"59","author":"CA Tsai","year":"2003","unstructured":"Tsai CA, Hsueh H, Chen JJ: Estimation of False Discovery Rates in Multiple Testing: Application to Gene Microarray Data. Biometrics 2003, 59: 1071\u20131081. 10.1111\/j.0006-341X.2003.00123.x","journal-title":"Biometrics"},{"key":"524_CR24","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1152\/physiolgenomics.00037.2003","volume":"16","author":"MCK Yang","year":"2003","unstructured":"Yang MCK, Yang JJ, McIndoe RA, She JX: Microarray experimental design: power and sample size considerations. Physiol Genomics 2003, 16: 24\u201328. 10.1152\/physiolgenomics.00037.2003","journal-title":"Physiol Genomics"},{"key":"524_CR25","volume-title":"Technical report","author":"B Efron","year":"2004","unstructured":"Efron B: Selection and Estimation for Large-Scale Simultaneous Inference. In Technical report. , Department of Statistics, Stanford University; 2004."},{"key":"524_CR26","doi-asserted-by":"publisher","first-page":"60","DOI":"10.3102\/10769986025001060","volume":"25","author":"Y Benjamini","year":"2000","unstructured":"Benjamini Y, Hochberg Y: On the adaptive control of the false discovery rate in multiple testing with independent statistics. Journal of Educational and Behavioural Statistics 2000, 25: 60\u201383.","journal-title":"Journal of Educational and Behavioural Statistics"},{"key":"524_CR27","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1198\/016214504000000089","volume":"99","author":"B Efron","year":"2004","unstructured":"Efron B: Large-scale simultaneous hypothesis testing : the choice of a null hypothesis. Journal of the American Statistical Association 2004, 99: 96\u2013104.","journal-title":"Journal of the American Statistical Association"},{"key":"524_CR28","doi-asserted-by":"publisher","first-page":"2431","DOI":"10.1214\/aos\/1032181161","volume":"24","author":"B Efron","year":"1996","unstructured":"Efron B, Tibshirani R: Using specially designed exponential families for density estimation. The Annals of Statistics 1996, 24: 2431\u20132461. 10.1214\/aos\/1032181161","journal-title":"The Annals of Statistics"},{"key":"524_CR29","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1186\/1471-2105-5-125","volume":"5","author":"J Aubert","year":"2004","unstructured":"Aubert J, Bar-Hen A, Daudin JJ, Robin S: Determination of the differentially expressed genes in microarray experiments using local FDR. BMC Bioinformatics 2004, 5: 125. 10.1186\/1471-2105-5-125","journal-title":"BMC Bioinformatics"},{"key":"524_CR30","volume-title":"Technical Report 2001-28, Department of Statistics, Stanford University","author":"JD Storey","year":"2001","unstructured":"Storey JD, Tibshirani R: Estimating false discovery rates under dependence, with applications to DNA microarrays. Technical Report 2001\u201328, Department of Statistics, Stanford University 2001."},{"key":"524_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/BF02595811","volume":"12","author":"YC Ge","year":"2003","unstructured":"Ge YC, Dudoit S, Speed TP: Resampling based multiple testing for microarray data analysis. Test 2003, 12: 1\u201377.","journal-title":"Test"},{"key":"524_CR32","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1126\/science.286.5439.531","volume":"286","author":"TR Golub","year":"1999","unstructured":"Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA, Bloomfield CD, Lander ES: Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring. Science 1999, 286: 531\u2013537. 10.1126\/science.286.5439.531","journal-title":"Science"},{"key":"524_CR33","unstructured":"Affymetrix web site[http:\/\/www.affymetrix.com]"},{"key":"524_CR34","doi-asserted-by":"publisher","first-page":"10143","DOI":"10.1073\/pnas.0401422101","volume":"101","author":"A Spira","year":"2004","unstructured":"Spira A, Beane J, Shah V, Liu G, Schembri F, Yang X, Palma J, Brody JS: Effects of cigarette smoke on the human airway epithelial cell transcriptome. PNAS 2004, 101: 10143\u201310148. 10.1073\/pnas.0401422101","journal-title":"PNAS"},{"key":"524_CR35","unstructured":"Gene Expression Omnibus[http:\/\/www.ncbi.nlm.nih.gov\/geo]"},{"key":"524_CR36","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1093\/biomet\/69.3.493","volume":"69","author":"T Schweder","year":"1982","unstructured":"Schweder T, Spjotvoll E: Plots of p-values to evaluate many tests simultaneously. Biometrika 1982, 69: 493\u2013502.","journal-title":"Biometrika"},{"key":"524_CR37","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4541-9","volume-title":"An Introduction to the Bootstrap","author":"B Efron","year":"1993","unstructured":"Efron B, Tibshirani R: An Introduction to the Bootstrap. London, Chapman & Hall; 1993."},{"key":"524_CR38","unstructured":"The SAG homepage[http:\/\/home.swipnet.se\/pibroberg\/expression_hemsida1.html]"},{"key":"524_CR39","unstructured":"BUM software[http:\/\/www.stjuderesearch.org\/depts\/biostats\/BUM\/index.html]"},{"key":"524_CR40","unstructured":"SPLOSH web page[http:\/\/www.stjuderesearch.org\/depts\/biostats\/documents\/splosh-code3.ssc]"},{"key":"524_CR41","doi-asserted-by":"publisher","first-page":"2694","DOI":"10.1093\/bioinformatics\/bth310","volume":"20","author":"JG Liao","year":"2004","unstructured":"Liao JG, Lin Y, Selvanayagam ZE, Shih WJ: A mixture model for estimating the local false discovery rate in DNA microarray analysis. Bioinformatics 2004, 20: 2694\u20132701. 10.1093\/bioinformatics\/bth310","journal-title":"Bioinformatics"},{"key":"524_CR42","unstructured":"localFDR web site[http:\/\/www.geocities.com\/jg_liao]"},{"key":"524_CR43","volume-title":"An Introduction to Probability Theory and Its Applications","author":"W Feller","year":"1971","unstructured":"Feller W: An Introduction to Probability Theory and Its Applications.\n                           Volume 2. Second edition. New York, John Wiley; 1971.","edition":"Second"},{"key":"524_CR44","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1214\/aoms\/1177728423","volume":"26","author":"M Ayer","year":"1955","unstructured":"Ayer M, Brunk HD, Ewing GM, Reid WT, Silverman E: An empirical distribution function for sampling with incomplete information. Annals of Mathamatical Statistics 1955, 26: 641\u2013647.","journal-title":"Annals of Mathamatical Statistics"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-6-199.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/1471-2105-6-199\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-6-199.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T12:14:18Z","timestamp":1728303258000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-6-199"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,8,8]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2005,12]]}},"alternative-id":["524"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-6-199","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,8,8]]},"assertion":[{"value":"22 December 2004","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 August 2005","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 August 2005","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"199"}}