{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T04:48:24Z","timestamp":1795063704114,"version":"4.10.2"},"reference-count":46,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2008,12,22]],"date-time":"2008-12-22T00:00:00Z","timestamp":1229904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,4,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>The paper considers the problem of multiple testing under dependence in a compound decision theoretic framework. The observed data are assumed to be generated from an underlying two-state hidden Markov model. We propose oracle and asymptotically optimal data-driven procedures that aim to minimize the false non-discovery rate FNR subject to a constraint on the false discovery rate FDR. It is shown that the performance of a multiple-testing procedure can be substantially improved by adaptively exploiting the dependence structure among hypotheses, and hence conventional FDR procedures that ignore this structural information are inefficient. Both theoretical properties and numerical performances of the procedures proposed are investigated. It is shown that the procedures proposed control FDR at the desired level, enjoy certain optimality properties and are especially powerful in identifying clustered non-null cases. The new procedure is applied to an influenza-like illness surveillance study for detecting the timing of epidemic periods.<\/jats:p>","DOI":"10.1111\/j.1467-9868.2008.00694.x","type":"journal-article","created":{"date-parts":[[2008,12,22]],"date-time":"2008-12-22T09:48:13Z","timestamp":1229939293000},"page":"393-424","source":"Crossref","is-referenced-by-count":178,"title":["Large-Scale Multiple Testing under Dependence"],"prefix":"10.1093","volume":"71","author":[{"given":"Wenguang","family":"Sun","sequence":"first","affiliation":[{"name":"University of Pennsylvania , Philadelphia , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"T.","family":"Tony Cai","sequence":"additional","affiliation":[{"name":"University of Pennsylvania , Philadelphia , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2008,12,22]]},"reference":[{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1111\/j.2517-6161.1973.tb00975.x","article-title":"Testing transformations to normality","volume":"35","author":"Atkinson","year":"1973","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1554","DOI":"10.1214\/aoms\/1177699147","article-title":"Statistical inference for probabilistic functions of finite Markov Chains","volume":"37","author":"Baum","year":"1966","journal-title":"Ann. Math. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1214\/aoms\/1177697196","article-title":"A maximization technique occuring in the statistical analysis of probabilistic functions of Markov Chains","volume":"41","author":"Baum","year":"1970","journal-title":"Ann. Math. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1272","DOI":"10.1198\/016214507000000941","article-title":"False discovery rate for spatial signals","volume":"102","author":"Benjamini","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"60","DOI":"10.3102\/10769986025001060","article-title":"On the adaptive control of the false discovery rate in multiple testing with independent statistics","volume":"25","author":"Benjamini","year":"2000","journal-title":"J. Educ. Behav. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1214\/aos\/1013699998","article-title":"The control of false discovery rate in multiple testing under dependence","volume":"29","author":"Benjamini","year":"2001","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"199","DOI":"10.2307\/3318520","article-title":"Inference in Hidden Markov Models I: local asymptotic normality in the stationary case","volume":"2","author":"Bickel","year":"1996","journal-title":"Bernoulli"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1614","DOI":"10.1214\/aos\/1024691255","article-title":"Asymptotic normality of the maximum likelihood estimator for general hidden Markov models","volume":"26","author":"Bickel","year":"1998","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1111\/j.2517-6161.1964.tb00553.x","article-title":"An analysis of transformations (with discussion)","volume":"26","author":"Box","year":"1964","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1111\/j.0016-7363.2006.00682.x","article-title":"A new approach to account for multiple and dependent tests in local statistics of spatial association: controlling the false discovery rate","volume":"38","author":"Castro","year":"2006","journal-title":"Geogr. Anal."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/0097-8485(92)80037-Z","article-title":"Hidden Markov chains and the analysis of genome structure","volume":"16","author":"Churchill","year":"1992","journal-title":"Comput. Chem."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1111\/1467-9469.00317","article-title":"Penalized maximum likelihood estimator for normal mixtures","volume":"30","author":"Ciuperca","year":"2003","journal-title":"Scand. J. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/aos\/1176342626","article-title":"On symmetric compound decision rules for dichotomies","volume":"2","author":"Copas","year":"1974","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","volume-title":"Probability: Theory and Examples","author":"Durrett","year":"2005"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1198\/016214504000000089","article-title":"Large-scale simultaneous hypothesis testing: the choice of a null hypothesis","volume":"99","author":"Efron","year":"2004","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1198\/016214506000001211","article-title":"Correlation and large-scale simultaneous significance testing","volume":"102","author":"Efron","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1198\/016214501753382129","article-title":"Empirical Bayes analysis of a microarray experiment","volume":"96","author":"Efron","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1109\/TIT.2002.1003838","article-title":"Hidden Markov processes","volume":"48","author":"Ephraim","year":"2002","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1111\/j.1467-9469.2006.00530.x","article-title":"Some results on the control of the false discovery rate under dependence","volume":"34","author":"Farcomeni","year":"2007","journal-title":"Scand. J. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1214\/aos\/1015362191","article-title":"Multiple hypotheses testing and expected number of type I errors","volume":"30","author":"Finner","year":"2002","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1093\/biomet\/93.3.509","article-title":"False discovery control with p value weighting","volume":"93","author":"Genovese","year":"2006","journal-title":"Biometrika"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1111\/1467-9868.00347","article-title":"Operating characteristics and extensions of the false discovery rate procedure","volume":"64","author":"Genovese","year":"2002","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1214\/009053604000000283","article-title":"A stochastic process approach to false discovery control","volume":"32","author":"Genovese","year":"2004","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1214\/aos\/1176349557","article-title":"A constrained formulation of maximum-likelihood estimation for Normal mixture distributions","volume":"13","author":"Hathaway","year":"1985","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1109\/18.256497","article-title":"Strongly consistent code-based identification and order estimation for constrained finite-state model classes","volume":"39","author":"Kiefer","year":"1993","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"888","DOI":"10.1214\/aoms\/1177728066","article-title":"Consistency of the maximum-likelihood estimator in the presence of infinitely many identical parameters","volume":"27","author":"Kiefer","year":"1956","journal-title":"Ann. Math. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1501","DOI":"10.1006\/jmbi.1994.1104","article-title":"Hidden Markov models in computational biology applications to protein modeling","volume":"235","author":"Krogh","year":"1994","journal-title":"J. Molec. Biol."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/0304-4149(92)90141-C","article-title":"Maximum-likelihood estimation for hidden Markov models","volume":"40","author":"Leroux","year":"1992","journal-title":"Stochast. Processes Appl."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1167","DOI":"10.1109\/18.335958","article-title":"Order estimation and sequential universal data compression of a hidden Markov source by the method of mixtures","volume":"40","author":"Liu","year":"1994","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1080\/01621459.1996.10476984","article-title":"A smooth nonparametric estimate of a mixing distribution using mixtures of Gaussians","volume":"91","author":"Magder","year":"1996","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1093\/biostatistics\/5.2.155","article-title":"Detecting differential gene expression with a semiparametric hierarchical mixture method","volume":"5","author":"Newton","year":"2004","journal-title":"Biostatistics"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1111\/j.1467-9868.2005.00509.x","article-title":"Variance of the number of false discoveries","volume":"67","author":"Owen","year":"2005","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"34","DOI":"10.2202\/1544-6115.1157","article-title":"Correlation between gene expression levels and limitations of the empirical Bayes methodology for finding differentially expressed genes","volume":"4","author":"Qiu","year":"2005","journal-title":"Statist. Appl. Genet. Molec. Biol."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1109\/5.18626","article-title":"A tutorial on hidden Markov models and selected applications in speech recognition","volume":"77","author":"Rabiner","year":"1989","journal-title":"Proc. IEEE"},{"key":"2023032921110113800_","volume-title":"Proc. 2nd Berkeley Symp. Mathematical Statistics and Probability","author":"Robbins","year":"1951"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1214\/009053605000000778","article-title":"False discovery and false nondiscovery rates in single-step multiple testing procedures","volume":"34","author":"Sarkar","year":"2006","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1111\/1467-9868.00346","article-title":"A direct approach to false discovery rates","volume":"64","author":"Storey","year":"2002","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1111\/j.1467-9868.2007.005592.x","article-title":"The optimal discovery procedure: a new approach to simultaneous significance testing","volume":"69","author":"Storey","year":"2007","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"3463","DOI":"10.1002\/(SICI)1097-0258(19991230)18:24<3463::AID-SIM409>3.0.CO;2-I","article-title":"Monitoring epidemiologic surveillance data using hidden Markov models","volume":"18","author":"Strat","year":"1999","journal-title":"Statist. Med."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1198\/016214507000000545","article-title":"Oracle and adaptive compound decision rules for false discovery rate control","volume":"102","author":"Sun","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511802256","volume-title":"Asymptotic Statistics","author":"Van Der Vaart","year":"1998"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1214\/07--AOAS145","article-title":"A hidden spatial-temporal Markov random field model for network-based analysis of time course gene expression data","volume":"2","author":"Wei","year":"2008","journal-title":"Ann. Appl. Statist."},{"key":"2023032921110113800_","volume-title":"Applied Linear Regression","author":"Weisberg","year":"1985"},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1214\/009053607000000730","article-title":"On false discovery control under dependence","volume":"36","author":"Wu","year":"2008","journal-title":"Ann. Statist."},{"key":"2023032921110113800_","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/S0378-3758(99)00041-5","article-title":"Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics","volume":"82","author":"Yekutieli","year":"1999","journal-title":"J. Statist. Planng Inf."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1467-9868.2008.00694.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/2\/393\/49686244\/jrsssb_71_2_393.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/2\/393\/49686244\/jrsssb_71_2_393.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,6]],"date-time":"2025-02-06T09:47:09Z","timestamp":1738835229000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/71\/2\/393\/7092902"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,12,22]]},"references-count":46,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2008,12,22]]},"published-print":{"date-parts":[[2009,4,1]]}},"URL":"https:\/\/doi.org\/10.1111\/j.1467-9868.2008.00694.x","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2009,4]]},"published":{"date-parts":[[2008,12,22]]}}}