{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T07:03:44Z","timestamp":1792047824197,"version":"4.4.0"},"reference-count":25,"publisher":"Institute of Mathematical Statistics","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ann. Statist."],"published-print":{"date-parts":[[2008,12,1]]},"abstract":"<jats:p>Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices X of dimension n\u00d7p, where p and n are both large. Results from random matrix theory show very clearly that in this setting, standard estimators like the sample covariance matrix perform in general very poorly. In this \u201clarge n, large p\u201d setting, it is sometimes the case that practitioners are willing to assume that many elements of the population covariance matrix are equal to 0, and hence this matrix is sparse. We develop an estimator to handle this situation. The estimator is shown to be consistent in operator norm, when, for instance, we have p\u2248n as n\u2192\u221e. In other words the largest singular value of the difference between the estimator and the population covariance matrix goes to zero. This implies consistency of all the eigenvalues and consistency of eigenspaces associated to isolated eigenvalues. We also propose a notion of sparsity for matrices, that is, \u201ccompatible\u201d with spectral analysis and is independent of the ordering of the variables.<\/jats:p>","DOI":"10.1214\/07-aos559","type":"journal-article","created":{"date-parts":[[2009,1,5]],"date-time":"2009-01-05T09:20:00Z","timestamp":1231147200000},"page":"2717-2756","source":"Crossref","is-referenced-by-count":199,"title":["Operator norm consistent estimation of large-dimensional sparse covariance matrices"],"prefix":"10.1214","volume":"36","author":[{"given":"Noureddine","family":"El Karoui","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"108","reference":[{"key":"1","doi-asserted-by":"publisher","unstructured":"[1] Anderson, G. W. and Zeitouni, O. (2006). A CLT for a band matrix model. <i>Probab. Theory Related Fields<\/i> <b>134<\/b> 283\u2013338.","DOI":"10.1007\/s00440-004-0422-3"},{"key":"3","doi-asserted-by":"publisher","unstructured":"[3] Bai, Z. D. and Silverstein, J. W. (2004). CLT for linear spectral statistics of large-dimensional sample covariance matrices. <i>Ann. Probab.<\/i> <b>32<\/b> 553\u2013605.","DOI":"10.1214\/aop\/1078415845"},{"key":"4","doi-asserted-by":"publisher","unstructured":"[4] Bengtsson, T. and Furrer, R. (2007). Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants. <i>J. Multivariate Anal.<\/i> <b>98<\/b> 227\u2013255.","DOI":"10.1016\/j.jmva.2006.08.003"},{"key":"5","doi-asserted-by":"crossref","unstructured":"[5] Benjamini, Y. and Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. <i>J. Roy. Statist. Soc. Ser. B<\/i> <b>57<\/b> 289\u2013300.","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] Bickel, P. J. and Levina, E. (2007). Regularized estimation of large covariance matrices. <i>Ann. Statist.<\/i> <b>36<\/b> 199\u2013227.","DOI":"10.1214\/009053607000000758"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] Bickel, P. J. and Levina, E. (2008). Covariance regularization by thresholding. <i>Ann. Statist.<\/i> <b>36<\/b> 2577\u20132604.","DOI":"10.1214\/08-AOS600"},{"key":"9","doi-asserted-by":"publisher","unstructured":"[9] d\u2019Aspremont, A., Banerjee, O. and El Ghaoui, L. (2008). First-order methods for sparse covariance selection. <i>SIAM J. Matrix Anal. Appl.<\/i> <b>30<\/b> 56\u201366.","DOI":"10.1137\/060670985"},{"key":"10","doi-asserted-by":"publisher","unstructured":"[10] Davis, C. and Kahan, W. M. (1970). The rotation of eigenvectors by a perturbation. III. <i>SIAM J. Numer. Anal.<\/i> <b>7<\/b> 1\u201346.","DOI":"10.1137\/0707001"},{"key":"11","doi-asserted-by":"crossref","unstructured":"[11] El Karoui, N. (2007). Tracy\u2013Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices. <i>Ann. Probab.<\/i> <b>35<\/b> 663\u2013714.","DOI":"10.1214\/009117906000000917"},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] El Karoui, N. (2008). Spectrum estimation for large dimensional covariance matrices using random matrix theory. <i>Ann. Statist.<\/i> <b>36<\/b> 2757\u20132790.","DOI":"10.1214\/07-AOS581"},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] Geman, S. (1980). A limit theorem for the norm of random matrices. <i>Ann. Probab.<\/i> <b>8<\/b> 252\u2013261.","DOI":"10.1214\/aop\/1176994775"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] Haff, L. R. (1980). Empirical Bayes estimation of the multivariate normal covariance matrix. <i>Ann. Statist.<\/i> <b>8<\/b> 586\u2013597.","DOI":"10.1214\/aos\/1176345010"},{"key":"15","doi-asserted-by":"publisher","unstructured":"[15] Hoeffding, W. (1963). Probability inequalities for sums of bounded random variables. <i>J. Amer. Statist. Assoc.<\/i> <b>58<\/b> 13\u201330.","DOI":"10.2307\/2282952"},{"key":"17","doi-asserted-by":"publisher","unstructured":"[17] Huang, J. Z., Liu, N., Pourahmadi, M. and Liu, L. (2006). Covariance matrix selection and estimation via penalised normal likelihood. <i>Biometrika<\/i> <b>93<\/b> 85\u201398.","DOI":"10.1093\/biomet\/93.1.85"},{"key":"18","unstructured":"[18] James, W. and Stein, C. (1961). Estimation with quadratic loss. <i>Proc. 4th Berkeley Symp. Math. Statist. Probab.<\/i> <b>I<\/b> 361\u2013379. Univ. California Press, Berkeley."},{"key":"19","doi-asserted-by":"publisher","unstructured":"[19] Jonsson, D. (1982). Some limit theorems for the eigenvalues of a sample covariance matrix. <i>J. Multivariate Anal.<\/i> <b>12<\/b> 1\u201338.","DOI":"10.1016\/0047-259X(82)90080-X"},{"key":"20","doi-asserted-by":"publisher","unstructured":"[20] Ledoit, O. and Wolf, M. (2004). A well-conditioned estimator for large-dimensional covariance matrices. <i>J. Multivariate Anal.<\/i> <b>88<\/b> 365\u2013411.","DOI":"10.1016\/S0047-259X(03)00096-4"},{"key":"21","unstructured":"[21] Mar\u010denko, V. A. and Pastur, L. A. (1967). Distribution of eigenvalues in certain sets of random matrices. <i>Mat. Sb. (N.S.)<\/i> <b>72<\/b> 507\u2013536."},{"key":"22","doi-asserted-by":"publisher","unstructured":"[22] Silverstein, J. W. (1995). Strong convergence of the empirical distribution of eigenvalues of large-dimensional random matrices. <i>J. Multivariate Anal.<\/i> <b>55<\/b> 331\u2013339.","DOI":"10.1006\/jmva.1995.1083"},{"key":"25","doi-asserted-by":"publisher","unstructured":"[25] Wigner, E. (1955). Characteristic vectors of bordered matrices with infinite dimensions. <i>Ann. of Math.<\/i> <b>62<\/b> 548\u2013564.","DOI":"10.2307\/1970079"},{"key":"2","unstructured":"[2] Anderson, T. W. (2003). <i>An Introduction to Multivariate Statistical Analysis<\/i>, 3rd ed. Wiley, Hoboken, NJ."},{"key":"6","doi-asserted-by":"crossref","unstructured":"[6] Bhatia, R. (1997). <i>Matrix Analysis<\/i>. Springer, New York.","DOI":"10.1007\/978-1-4612-0653-8"},{"key":"16","unstructured":"[16] Horn, R. A. and Johnson, C. R. (1990). <i>Matrix Analysis<\/i>. Cambridge Univ. Press."},{"key":"23","doi-asserted-by":"crossref","unstructured":"[23] Stanley, R. P. (1997). <i>Enumerative Combinatorics<\/i>. <b>I<\/b>. Cambridge Univ. Press.","DOI":"10.1017\/CBO9780511805967"},{"key":"24","unstructured":"[24] Stewart, G. W. and Sun, J. G. (1990). <i>Matrix Perturbation Theory<\/i>. Academic Press, Boston, MA."}],"container-title":["The Annals of Statistics"],"original-title":[],"link":[{"URL":"http:\/\/projecteuclid.org\/download\/pdfview_1\/euclid.aos\/1231165183","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T23:16:13Z","timestamp":1791587773000},"score":1,"resource":{"primary":{"URL":"https:\/\/projecteuclid.org\/journals\/annals-of-statistics\/volume-36\/issue-6\/Operator-norm-consistent-estimation-of-large-dimensional-sparse-covariance-matrices\/10.1214\/07-AOS559.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,12,1]]},"references-count":25,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2008,12,1]]}},"URL":"https:\/\/doi.org\/10.1214\/07-aos559","relation":{},"ISSN":["0090-5364","2168-8966"],"issn-type":[{"value":"0090-5364","type":"print"},{"value":"2168-8966","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,12,1]]}}}