{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T06:36:43Z","timestamp":1776148603921,"version":"3.50.1"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T00:00:00Z","timestamp":1676592000000},"content-version":"vor","delay-in-days":2335,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01-GM072611-11"],"award-info":[{"award-number":["R01-GM072611-11"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01GM100474-04"],"award-info":[{"award-number":["R01GM100474-04"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1206464"],"award-info":[{"award-number":["DMS-1206464"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,9,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Large-scale multiple testing with correlated test statistics arises frequently in much scientific research. Incorporating correlation information in approximating the false discovery proportion (FDP) has attracted increasing attention in recent years. When the covariance matrix of test statistics is known, Fan and his colleagues provided an accurate approximation of the FDP under arbitrary dependence structure and some sparsity assumption. However, the covariance matrix is often unknown in many applications and such dependence information must be estimated before approximating the FDP. The estimation accuracy can greatly affect the FDP approximation. In the current paper, we study theoretically the effect of unknown dependence on the testing procedure and establish a general framework such that the FDP can be well approximated. The effects of unknown dependence on approximating the FDP are in the following two major aspects: through estimating eigenvalues or eigenvectors and through estimating marginal variances. To address the challenges in these two aspects, we firstly develop general requirements on estimates of eigenvalues and eigenvectors for a good approximation of the FDP. We then give conditions on the structures of covariance matrices that satisfy such requirements. Such dependence structures include banded or sparse covariance matrices and (conditional) sparse precision matrices. Within this framework, we also consider a special example to illustrate our method where data are sampled from an approximate factor model, which encompasses most practical situations. We provide a good approximation of the FDP via exploiting this specific dependence structure. The results are further generalized to the situation where the multivariate normality assumption is relaxed. Our results are demonstrated by simulation studies and some real data applications.<\/jats:p>","DOI":"10.1111\/rssb.12204","type":"journal-article","created":{"date-parts":[[2016,9,26]],"date-time":"2016-09-26T13:17:20Z","timestamp":1474895840000},"page":"1143-1164","source":"Crossref","is-referenced-by-count":39,"title":["Estimation of the False Discovery Proportion with Unknown Dependence"],"prefix":"10.1093","volume":"79","author":[{"given":"Jianqing","family":"Fan","sequence":"first","affiliation":[{"name":"Princeton University , USA"},{"name":"Fudan University , Shanghai , People's Republic of China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xu","family":"Han","sequence":"additional","affiliation":[{"name":"Temple University , Philadelphia , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2016,9,26]]},"reference":[{"key":"2023021801094212700_rssb12204-cit-0001","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.3982\/ECTA8968","article-title":"Eigenvalue ratio test for the number of factors","volume":"81","author":"Ahn","year":"2013","journal-title":"Econometrica"},{"key":"2023021801094212700_rssb12204-cit-0003","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1198\/016214501753208942","article-title":"Regularized wavelet approximations (with discussion)","volume":"96","author":"Antoniadis","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0002","doi-asserted-by":"crossref","first-page":"1217","DOI":"10.1080\/01621459.2014.958156","article-title":"The empirical distribution of a large number of correlated normal variables","volume":"110","author":"Azriel","year":"2015","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0004","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1111\/1468-0262.00392","article-title":"Inferential theory for factor models of large dimensions","volume":"71","author":"Bai","year":"2003","journal-title":"Econometrica"},{"key":"2023021801094212700_rssb12204-cit-0005","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Statist. Soc."},{"key":"2023021801094212700_rssb12204-cit-0006","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1214\/aos\/1013699998","article-title":"The control of the false discovery rate in multiple testing under dependency","volume":"29","author":"Benjamini","year":"2001","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0007","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/009053607000000758","article-title":"Regularized estimation of large covariance matrices","volume":"36","author":"Bickel","year":"2008","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0008","doi-asserted-by":"crossref","first-page":"2577","DOI":"10.1214\/08-AOS600","article-title":"Covariance regularization by thresholding","volume":"36","author":"Bickel","year":"2008","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0009","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1198\/jasa.2011.tm10560","article-title":"Adaptive thresholding for sparse covariance matrix estimation","volume":"106","author":"Cai","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0010","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1198\/jasa.2011.tm10155","article-title":"A constrained l1 minimization approach to sparse precision matrix estimation","volume":"106","author":"Cai","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0011","doi-asserted-by":"crossref","first-page":"1305","DOI":"10.2307\/1912276","article-title":"Arbitrage, factor structure and mean-variance analysis in large asset markets","volume":"51","author":"Chamberlain","year":"1983","journal-title":"Econometrica"},{"key":"2023021801094212700_rssb12204-cit-0012","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1214\/07-AOS557","article-title":"Robustness of multiple testing procedure against dependence","volume":"37","author":"Clarke","year":"2009","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0013","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1137\/0707001","article-title":"The rotation of eigenvectors by a perturbation III","volume":"7","author":"Davis","year":"1970","journal-title":"SIAM J. Numer. Anal."},{"key":"2023021801094212700_rssb12204-cit-0014","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1080\/01621459.2011.645777","article-title":"Cross-dimensional inference of dependent high-dimensional data","volume":"107","author":"Desai","year":"2012","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0015","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1214\/009053604000000265","article-title":"Higher criticism for detecting sparse heterogeneous mixtures","volume":"32","author":"Donoho","year":"2004","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0016","doi-asserted-by":"crossref","first-page":"2980","DOI":"10.1214\/009053606000000920","article-title":"Asymptotic minimaxity of false discovery rate thresholding for sparse exponential data","volume":"34","author":"Donoho","year":"2006","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0017","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1198\/016214506000001211","article-title":"Correlation and large-scale simultaneous significance testing","volume":"102","author":"Efron","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0018","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1198\/jasa.2010.tm09129","article-title":"Correlated Z-values and the accuracy of large-scale statistical estimates (with discussion)","volume":"105","author":"Efron","year":"2010","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0019","first-page":"2717","article-title":"Operator norm consistent estimation of large-dimensional sparse covariance matrices","volume":"36","author":"El Karoui","year":"2008","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0020","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1080\/01621459.1981.10477720","article-title":"A one-factor multivariate time series model of metropolitan wage rates","volume":"76","author":"Engle","year":"1981","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0021","doi-asserted-by":"crossref","first-page":"1019","DOI":"10.1080\/01621459.2012.720478","article-title":"Estimating false discovery proportion under arbitrary covariance dependence (with discussion)","volume":"107","author":"Fan","year":"2012","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0022","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0023","doi-asserted-by":"crossref","first-page":"3320","DOI":"10.1214\/11-AOS944","article-title":"High-dimensional covariance matrix estimation in approximate factor models","volume":"39","author":"Fan","year":"2011","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0024","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1111\/rssb.12016","article-title":"Large covariance estimation by thresholding principal orthogonal complements (with discussion)","volume":"75","author":"Fan","year":"2013","journal-title":"J. R. Statist. Soc."},{"key":"2023021801094212700_rssb12204-cit-0025","volume-title":"Partial consistency with sparse incidental parameters","author":"Fan","year":"2012"},{"key":"2023021801094212700_rssb12204-cit-0026","doi-asserted-by":"crossref","first-page":"1406","DOI":"10.1198\/jasa.2009.tm08332","article-title":"A factor model approach to multiple testing under dependence","volume":"104","author":"Friguet","year":"2009","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801094212700_rssb12204-cit-0028","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1056\/NEJM200102223440801","article-title":"Gene-expression profiles in hereditary breast cancer","volume":"344","author":"Hedenfalk","year":"2001","journal-title":"New Engl. J. Med."},{"key":"2023021801094212700_rssb12204-cit-0029","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/0024-3795(88)90223-6","article-title":"Computing a nearest symmetric positive semidefinite matrix","volume":"103","author":"Higham","year":"1988","journal-title":"Lin. Alg. Appl."},{"key":"2023021801094212700_rssb12204-cit-0030","volume-title":"Matrix Analysis","author":"Horn","year":"1990"},{"key":"2023021801094212700_rssb12204-cit-0027","volume-title":"NOVELIST estimator of large correlation and covariance matrices and their inverses","author":"Huang","year":"2015"},{"key":"2023021801094212700_rssb12204-cit-0031","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511550683","volume-title":"Multivariate t Distributions and Their Applications","author":"Kotz","year":"2004"},{"key":"2023021801094212700_rssb12204-cit-0032","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1214\/12-AOS970","article-title":"Factor modeling for high-dimensional time series: inference for the number of factors","volume":"40","author":"Lam","year":"2012","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0033","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/S0927-5398(03)00007-0","article-title":"Improved estimation of the covariance matrix of stock returns with an application to portfolio selection","volume":"10","author":"Ledoit","year":"2003","journal-title":"J. Emp. Finan."},{"key":"2023021801094212700_rssb12204-cit-00501","doi-asserted-by":"crossref","first-page":"18718","DOI":"10.1073\/pnas.0808709105","article-title":"A general framework for multiple testing dependence","volume":"105","author":"Leek","year":"2008","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023021801094212700_rssb12204-cit-0034","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1214\/13-AOS1097","article-title":"Sparse principal component analysis and iterative thresholding","volume":"41","author":"Ma","year":"2013","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0035","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1214\/08-EJS176","article-title":"Sparse permutation invariant covariance estimation","volume":"2","author":"Rothman","year":"2008","journal-title":"Electron. J. Statist."},{"key":"2023021801094212700_rssb12204-cit-0036","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1214\/aos\/1015362192","article-title":"Some results on false discovery rate in stepwise multiple testing procedures","volume":"30","author":"Sarkar","year":"2002","journal-title":"Ann. Statist."},{"key":"2023021801094212700_rssb12204-cit-0037","doi-asserted-by":"crossref","DOI":"10.2202\/1544-6115.1175","article-title":"A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics","volume":"4","author":"Schafer","year":"2005","journal-title":"Statist. Appl. Genet. Molec. Biol."},{"key":"2023021801094212700_rssb12204-cit-0038","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1093\/biomet\/asq075","article-title":"The effect of correlation in false discovery rate estimation","volume":"98","author":"Schwartzman","year":"2011","journal-title":"Biometrika"},{"key":"2023021801094212700_rssb12204-cit-0039","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1214\/aoms\/1177699066","article-title":"A bivariate t distribution","volume":"38","author":"Siddiqui","year":"1967","journal-title":"Ann. Math. Statist."},{"key":"2023021801094212700_rssb12204-cit-0040","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1111\/1467-9868.00346","article-title":"A direct approach to false discovery rates","volume":"64","author":"Storey","year":"2002","journal-title":"J. R. Statist. Soc."},{"key":"2023021801094212700_rssb12204-cit-0041","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.1467-9868.2004.00439.x","article-title":"Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach","volume":"66","author":"Storey","year":"2004","journal-title":"J. R. Statist. Soc."},{"key":"2023021801094212700_rssb12204-cit-0042","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1111\/j.1467-9868.2008.00694.x","article-title":"Large-scale multiple testing under dependence","volume":"71","author":"Sun","year":"2009","journal-title":"J. R. Statist. Soc."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12204","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12204","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12204","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12204","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/am-pdf\/10.1111\/rssb.12204","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/79\/4\/1143\/49214899\/jrsssb_79_4_1143.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/79\/4\/1143\/49214899\/jrsssb_79_4_1143.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,19]],"date-time":"2024-06-19T16:02:20Z","timestamp":1718812940000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/79\/4\/1143\/7040640"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,9,26]]},"references-count":43,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2016,9,26]]},"published-print":{"date-parts":[[2017,9,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12204","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,9]]},"published":{"date-parts":[[2016,9,26]]}}}