{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T13:58:47Z","timestamp":1791899927922,"version":"4.3.4"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2007,5,22]],"date-time":"2007-05-22T00:00:00Z","timestamp":1179792000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01 HG002913"],"award-info":[{"award-number":["R01 HG002913"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2007,6,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>The Neyman\u2013Pearson lemma provides a simple procedure for optimally testing a single hypothesis when the null and alternative distributions are known. This result has played a major role in the development of significance testing strategies that are used in practice. Most of the work extending single-testing strategies to multiple tests has focused on formulating and estimating new types of significance measures, such as the false discovery rate. These methods tend to be based on p-values that are calculated from each test individually, ignoring information from the other tests. I show here that one can improve the overall performance of multiple significance tests by borrowing information across all the tests when assessing the relative significance of each one, rather than calculating p-values for each test individually. The \u2018optimal discovery procedure\u2019 is introduced, which shows how to maximize the number of expected true positive results for each fixed number of expected false positive results. The optimality that is achieved by this procedure is shown to be closely related to optimality in terms of the false discovery rate. The optimal discovery procedure motivates a new approach to testing multiple hypotheses, especially when the tests are related. As a simple example, a new simultaneous procedure for testing several normal means is defined; this is surprisingly demonstrated to outperform the optimal single-test procedure, showing that a method which is optimal for single tests may no longer be optimal for multiple tests. Connections to other concepts in statistics are discussed, including Stein's paradox, shrinkage estimation and the Bayesian approach to hypothesis testing.<\/jats:p>","DOI":"10.1111\/j.1467-9868.2007.005592.x","type":"journal-article","created":{"date-parts":[[2007,5,23]],"date-time":"2007-05-23T18:25:51Z","timestamp":1179944751000},"page":"347-368","source":"Crossref","is-referenced-by-count":120,"title":["The Optimal Discovery Procedure: A New Approach to Simultaneous Significance Testing"],"prefix":"10.1093","volume":"69","author":[{"given":"John D.","family":"Storey","sequence":"first","affiliation":[{"name":"University of Washington , Seattle , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2007,5,22]]},"reference":[{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1080\/01621459.1995.10476626","article-title":"Adapting to unknown smoothness via wavelet shrinkage","volume":"90","author":"Donoho","year":"1995","journal-title":"J. Am. Statist. Ass."},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1093\/biomet\/59.2.335","article-title":"Empirical Bayes on vector observations: an empirical Bayes approach","volume":"59","author":"Efron","year":"1972","journal-title":"Biometrika"},{"key":"2023040705373672000_","first-page":"117","article-title":"Stein's estimation rule and its competitors: an empirical Bayes approach","volume":"68","author":"Efron","year":"1973","journal-title":"J. Am. Statist. Ass."},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1198\/016214501753382129","article-title":"Empirical Bayes analysis of a microarray experiment","volume":"96","author":"Efron","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1111\/1467-9868.00347","article-title":"Operating characteristics and extensions of the false discovery rate procedure","volume":"64","author":"Genovese","year":"2002","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705373672000_","first-page":"361","volume-title":"Proc. 4th Berkeley Symp. Mathematical Statistics and Probability","author":"James","year":"1961"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-1923-9","volume-title":"Testing Statistical Hypotheses","author":"Lehmann","year":"1986"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1214\/009053605000000066","article-title":"On optimality of stepdown and stepup multiple test procedures","volume":"33","author":"Lehmann","year":"2005","journal-title":"Ann. Statist."},{"key":"2023040705373672000_","first-page":"31","article-title":"Replicated microarray data","volume":"12","author":"L\u00f6nnstedt","year":"2002","journal-title":"Statist. Sin."},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1089\/106652701300099074","article-title":"On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data","volume":"8","author":"Newton","year":"2001","journal-title":"J. Computnl Biol."},{"key":"2023040705373672000_","first-page":"289","article-title":"On the problem of the most efficient tests of statistical hypotheses","volume":"231","author":"Neyman","year":"1933","journal-title":"Phil. Trans. R. Soc."},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1146\/annurev.ps.46.020195.003021","article-title":"Multiple hypothesis testing","volume":"46","author":"Shaffer","year":"1995","journal-title":"A. Rev. Psychol."},{"key":"2023040705373672000_","first-page":"608","article-title":"Statistical discoveries and effect-size estimation","volume":"84","author":"Soric","year":"1989","journal-title":"J. Am. Statist. Ass."},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1214\/aoms\/1177692621","article-title":"Optimality of some multiple testing procedures","volume":"43","author":"Spjotvoll","year":"1972","journal-title":"Ann. Math. Statist."},{"key":"2023040705373672000_","first-page":"197","volume-title":"Proc. 3rd Berkeley Symp. Mathematical Statistics and Probability","author":"Stein","year":"1956"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1214\/aos\/1176345632","article-title":"Estimation of the mean of a multivariate Normal distribution","volume":"9","author":"Stein","year":"1981","journal-title":"Ann. Statist."},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1111\/1467-9868.00346","article-title":"A direct approach to false discovery rates","volume":"64","author":"Storey","year":"2002","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"2013","DOI":"10.1214\/aos\/1074290335","article-title":"The positive false discovery rate: a Bayesian interpretation and the q-value","volume":"31","author":"Storey","year":"2003","journal-title":"Ann. Statist."},{"key":"2023040705373672000_","author":"Storey","year":"2005"},{"key":"2023040705373672000_","author":"Storey","year":"2005"},{"key":"2023040705373672000_","doi-asserted-by":"publisher","DOI":"10.1093\/biostatistics\/kx1019","article-title":"The optimal discovery procedure for large-scale significance testing, with applications to comparative microarray experiments","author":"Storey","year":"2006","journal-title":"Biostatistics"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.1467-9868.2004.00439.x","article-title":"Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach","volume":"66","author":"Storey","year":"2004","journal-title":"J. R. Statist. Soc. B"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"9440","DOI":"10.1073\/pnas.1530509100","article-title":"Statistical significance for genome-wide studies","volume":"100","author":"Storey","year":"2003","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023040705373672000_","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1093\/biostatistics\/kxh021","article-title":"The miss rate for the analysis of gene expression data","volume":"6","author":"Taylor","year":"2005","journal-title":"Biostatistics"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1467-9868.2007.005592.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/69\/3\/347\/49795392\/jrsssb_69_3_347.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/69\/3\/347\/49795392\/jrsssb_69_3_347.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,16]],"date-time":"2025-01-16T15:32:43Z","timestamp":1737041563000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/69\/3\/347\/7109363"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,5,22]]},"references-count":25,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2007,5,22]]},"published-print":{"date-parts":[[2007,6,1]]}},"URL":"https:\/\/doi.org\/10.1111\/j.1467-9868.2007.005592.x","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2007,6]]},"published":{"date-parts":[[2007,5,22]]}}}