{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T04:39:33Z","timestamp":1769920773139,"version":"3.49.0"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2020,2,10]],"date-time":"2020-02-10T00:00:00Z","timestamp":1581292800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,9,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Multiple hypothesis testing problems arise naturally in science. This note introduces a new fast closed testing method for multiple testing which controls the familywise error rate. Controlling the familywise error rate is state-of-the-art in many important application areas and is preferred over false discovery rate control for many reasons, including that it leads to stronger reproducibility. The closure principle rejects an individual hypothesis if all global nulls of subsets containing it are rejected using some test statistics. It takes exponential time in the worst case. When the tests are symmetric and monotone, the proposed method is an exact algorithm for computing the closure, is quadratic in the number of tests, and is linear in the number of discoveries. Our framework generalizes most examples of closed testing, such as Holm\u2019s method and the Bonferroni method. As a special case of the method, we propose the Simes and higher criticism fusion test, which is powerful both for detecting a few strong signals and for detecting many moderate signals.<\/jats:p>","DOI":"10.1093\/biomet\/asz082","type":"journal-article","created":{"date-parts":[[2019,12,21]],"date-time":"2019-12-21T12:06:29Z","timestamp":1576929989000},"page":"761-768","source":"Crossref","is-referenced-by-count":9,"title":["Fast closed testing for exchangeable local tests"],"prefix":"10.1093","volume":"107","author":[{"given":"E","family":"Dobriban","sequence":"first","affiliation":[{"name":"Department of Statistics, The Wharton School, University of Pennsylvania, 3730 Walnut Street, Philadelphia, Pennsylvania 19104, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,2,10]]},"reference":[{"key":"2020081714264543500_B1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"B 57","author":"Benjamini,","year":"1995","journal-title":"J. R. Statist. Soc."},{"key":"2020081714264543500_B2","first-page":"559","article-title":"Combining independent tests of significance","volume":"49","author":"Birnbaum,","year":"1954","journal-title":"J. Am. Statist. Assoc."},{"key":"2020081714264543500_B3","doi-asserted-by":"crossref","DOI":"10.1201\/9781420010909","volume-title":"Multiple Comparisons Using R","author":"Bretz,","year":"2016"},{"key":"2020081714264543500_B4","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1002\/sim.3495","article-title":"A graphical approach to sequentially rejective multiple test procedures","volume":"28","author":"Bretz,","year":"2009","journal-title":"Statist. Med."},{"key":"2020081714264543500_B5","doi-asserted-by":"crossref","DOI":"10.1201\/9781584889854","volume-title":"Multiple Testing Problems in Pharmaceutical Statistics","author":"Dmitrienko,","year":"2009"},{"key":"2020081714264543500_B6","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1214\/009053604000000265","article-title":"Higher criticism for detecting sparse heterogeneous mixtures","volume":"32","author":"Donoho,","year":"2004","journal-title":"Ann. Statist."},{"key":"2020081714264543500_B7","doi-asserted-by":"crossref","first-page":"7900","DOI":"10.1073\/pnas.1602413113","article-title":"Cluster failure: Why fMRI inferences for spatial extent have inflated false-positive rates","volume":"113","author":"Eklund,","year":"2016","journal-title":"Proc. Nat. Acad. Sci."},{"key":"2020081714264543500_B8","doi-asserted-by":"crossref","first-page":"3782","DOI":"10.1214\/10-AOS829","article-title":"The sequential rejection principle of familywise error control","volume":"38","author":"Goeman,","year":"2010","journal-title":"Ann. Statist."},{"key":"2020081714264543500_B9","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1214\/11-STS356","article-title":"Multiple testing for exploratory research","volume":"26","author":"Goeman,","year":"2011","journal-title":"Statist. Sci."},{"key":"2020081714264543500_B10","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1002\/sim.6082","article-title":"Multiple hypothesis testing in genomics","volume":"33","author":"Goeman,","year":"2014","journal-title":"Statist. Med."},{"key":"2020081714264543500_B11","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1093\/biomet\/asu032","article-title":"A class of improved hybrid Hochberg\u2013Hommel type step-up multiple test procedures","volume":"101","author":"Gou,","year":"2014","journal-title":"Biometrika"},{"key":"2020081714264543500_B12","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/S0378-3758(98)00125-6","article-title":"Closed procedures are better and often admit a shortcut","volume":"76","author":"Grechanovsky,","year":"1999","journal-title":"J. Statist. Plan. Infer."},{"key":"2020081714264543500_B13","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1080\/19466315.2015.1004270","article-title":"Closed testing in pharmaceutical research: Historical and recent developments","volume":"7","author":"Henning,","year":"2015","journal-title":"Statist. Biopharm. Res."},{"key":"2020081714264543500_B14","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1093\/biomet\/75.4.800","article-title":"A sharper Bonferroni procedure for multiple tests of significance","volume":"75","author":"Hochberg,","year":"1988","journal-title":"Biometrika"},{"key":"2020081714264543500_B15","doi-asserted-by":"crossref","DOI":"10.1002\/9780470316672","volume-title":"Multiple Comparison Procedures","author":"Hochberg,","year":"1987"},{"key":"2020081714264543500_B16","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"6","author":"Holm,","year":"1979","journal-title":"Scand. J. Statist."},{"key":"2020081714264543500_B17","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1093\/biomet\/75.2.383","article-title":"A stagewise rejective multiple test procedure based on a modified Bonferroni test","volume":"75","author":"Hommel,","year":"1988","journal-title":"Biometrika"},{"key":"2020081714264543500_B18","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1002\/bimj.200710463","article-title":"Aesthetics and power considerations in multiple testing \u2013 a contradiction?","volume":"50","author":"Hommel,","year":"2008","journal-title":"Biomet. J."},{"key":"2020081714264543500_B19","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1111\/j.2517-6161.1996.tb02093.x","article-title":"Multiple tests of a non-hierarchical finite family of hypotheses","volume":"B 58","author":"Liu,","year":"1996","journal-title":"J. R. Statist. Soc."},{"key":"2020081714264543500_B20","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1093\/biomet\/63.3.655","article-title":"On closed testing procedures with special reference to ordered analysis of variance","volume":"63","author":"Marcus,","year":"1976","journal-title":"Biometrika"},{"key":"2020081714264543500_B21","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1002\/bimj.201700316","article-title":"Hommel\u2018s procedure in linear time","volume":"61","author":"Meijer,","year":"2019","journal-title":"Biomet. J."},{"key":"2020081714264543500_B22","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1038\/nrg3706","article-title":"Statistical power and significance testing in large-scale genetic studies","volume":"15","author":"Sham,","year":"2014","journal-title":"Nature Rev. Genet."},{"key":"2020081714264543500_B23","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1093\/biomet\/73.3.751","article-title":"An improved Bonferroni procedure for multiple tests of significance","volume":"73","author":"Simes,","year":"1986","journal-title":"Biometrika"},{"key":"2020081714264543500_B24","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1080\/10543406.2017.1378666","article-title":"Advances in $p$-value based multiple test procedures","volume":"28","author":"Tamhane,","year":"2018","journal-title":"J. Biopharm. Statist."},{"key":"2020081714264543500_B25","author":"Vovk,","year":"2019","journal-title":"Combining e-values and p-values"}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/biomet\/article-pdf\/107\/3\/761\/33658452\/asz082.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/biomet\/article-pdf\/107\/3\/761\/33658452\/asz082.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T01:05:25Z","timestamp":1722215125000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/107\/3\/761\/5732870"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,10]]},"references-count":25,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2,10]]},"published-print":{"date-parts":[[2020,9,1]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asz082","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,9]]},"published":{"date-parts":[[2020,2,10]]}}}