{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T21:22:20Z","timestamp":1793049740934,"version":"4.5.0"},"reference-count":39,"publisher":"Institute of Mathematical Statistics","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ann. Statist."],"published-print":{"date-parts":[[2008,12,1]]},"abstract":"<jats:p>Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely used techniques, in particular in principal component analysis (PCA). In many modern data analysis problems, statisticians are faced with large datasets where the sample size, n, is of the same order of magnitude as the number of variables p. Random matrix theory predicts that in this context, the eigenvalues of the sample covariance matrix are not good estimators of the eigenvalues of the population covariance. We propose to use a fundamental result in random matrix theory, the Mar\u010denko\u2013Pastur equation, to better estimate the eigenvalues of large dimensional covariance matrices. The Mar\u010denko\u2013Pastur equation holds in very wide generality and under weak assumptions. The estimator we obtain can be thought of as \u201cshrinking\u201d in a nonlinear fashion the eigenvalues of the sample covariance matrix to estimate the population eigenvalues. Inspired by ideas of random matrix theory, we also suggest a change of point of view when thinking about estimation of high-dimensional vectors: we do not try to estimate directly the vectors but rather a probability measure that describes them. We think this is a theoretically more fruitful way to think about these problems. Our estimator gives fast and good or very good results in extended simulations. Our algorithmic approach is based on convex optimization. We also show that the proposed estimator is consistent.<\/jats:p>","DOI":"10.1214\/07-aos581","type":"journal-article","created":{"date-parts":[[2009,1,5]],"date-time":"2009-01-05T09:20:00Z","timestamp":1231147200000},"page":"2757-2790","source":"Crossref","is-referenced-by-count":160,"title":["Spectrum estimation for large dimensional covariance matrices using random matrix theory"],"prefix":"10.1214","volume":"36","author":[{"given":"Noureddine","family":"El Karoui","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"108","reference":[{"key":"2","doi-asserted-by":"publisher","unstructured":"[2] Anderson, T. W. (1963). Asymptotic theory for principal component analysis. <i>Ann. Math. Statist.<\/i> <b>34<\/b> 122\u2013148.","DOI":"10.1214\/aoms\/1177704248"},{"key":"4","unstructured":"[4] Bai, Z. D. (1999). Methodologies in spectral analysis of large dimensional random matrices, a review (with discussion). <i>Statist. Sinica<\/i> <b>9<\/b> 611\u2013677."},{"key":"5","doi-asserted-by":"publisher","unstructured":"[5] Baik, J., Ben Arous, G. and P\u00e9ch\u00e9, S. (2005). Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices. <i>Ann. Probab.<\/i> <b>33<\/b> 1643\u20131697.","DOI":"10.1214\/009117905000000233"},{"key":"6","doi-asserted-by":"publisher","unstructured":"[6] Baik, J. and Silverstein, J. (2006). Eigenvalues of large sample covariance matrices of spiked population models. <i>J. Multivariate Anal.<\/i> <b>97<\/b> 1382\u20131408.","DOI":"10.1016\/j.jmva.2005.08.003"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] Bickel, P. J. and Levina, E. (2004). Some theory of Fisher\u2019s linear discriminant function, \u201cnaive Bayes,\u201d and some alternatives when there are many more variables than observations. <i>Bernoulli<\/i> <b>10<\/b> 989\u20131010.","DOI":"10.3150\/bj\/1106314847"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] Bickel, P. J. and Levina, E. (2007). Regularized estimation of large covariance matrices. <i>Ann. Statist.<\/i> <b>36<\/b> 199\u2013227.","DOI":"10.1214\/009053607000000758"},{"key":"11","doi-asserted-by":"publisher","unstructured":"[11] Burda, Z., G\u00f6rlich, A., Jarosz, A. and Jurkiewicz, J. (2004). Signal and noise in correlation matrix. <i>Phys. A<\/i> <b>343<\/b> 295\u2013310.","DOI":"10.1016\/j.physa.2004.05.048"},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] Burda, Z., Jurkiewicz, J. and Wac\u0142aw, B. (2005). Spectral moments of correlated Wishart matrices. <i>Phys. Rev. E<\/i> <b>71<\/b> 026111.","DOI":"10.1103\/PhysRevE.71.026111"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] Chen, S. S., Donoho, D. L. and Saunders, M. A. (1998). Atomic decomposition by basis pursuit. <i>SIAM J. Sci. Comput.<\/i> <b>20<\/b> 33\u201361.","DOI":"10.1137\/S1064827596304010"},{"key":"15","doi-asserted-by":"publisher","unstructured":"[15] Dozier, R. B. and Silverstein, J. W. (2007). On the empirical distribution of eigenvalues of large dimensional information-plus-noise-type matrices. <i>J. Multivariate Anal.<\/i> <b>98<\/b> 678\u2013694.","DOI":"10.1016\/j.jmva.2006.09.006"},{"key":"17","doi-asserted-by":"publisher","unstructured":"[17] El Karoui, N. (2007). Tracy\u2013Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices. <i>Ann. Probab.<\/i> <b>35<\/b> 663\u2013714.","DOI":"10.1214\/009117906000000917"},{"key":"18","doi-asserted-by":"publisher","unstructured":"[18] Geman, S. (1980). A limit theorem for the norm of random matrices. <i>Ann. Probab.<\/i> <b>8<\/b> 252\u2013261.","DOI":"10.1214\/aop\/1176994775"},{"key":"19","doi-asserted-by":"publisher","unstructured":"[19] Geronimo, J. S. and Hill, T. P. (2003). Necessary and sufficient condition that the limit of Stieltjes transforms is a Stieltjes transform. <i>J. Approx. Theory<\/i> <b>121<\/b> 54\u201360.","DOI":"10.1016\/S0021-9045(02)00042-4"},{"key":"20","doi-asserted-by":"crossref","unstructured":"[20] Gibbs, A. L. and Su, F. (2001). On choosing and bounding probability metrics. <i>Internat. Statist. Rev.<\/i> <b>70<\/b> 419\u2013435.","DOI":"10.1111\/j.1751-5823.2002.tb00178.x"},{"key":"24","unstructured":"[24] Hiai, F. and Petz, D. (2000). <i>The Semicircle Law, Free Random Variables and Entropy. Mathematical Surveys and Monographs<\/i> <b>77<\/b>. Amer. Math. Soc., Providence, RI."},{"key":"25","doi-asserted-by":"publisher","unstructured":"[25] Johnstone, I. (2001). On the distribution of the largest eigenvalue in principal component analysis. <i>Ann. Statist.<\/i> <b>29<\/b> 295\u2013327.","DOI":"10.1214\/aos\/1009210544"},{"key":"26","doi-asserted-by":"publisher","unstructured":"[26] Jonsson, D. (1982). Some limit theorems for the eigenvalues of a sample covariance matrix. <i>J. Multivariate Anal.<\/i> <b>12<\/b> 1\u201338.","DOI":"10.1016\/0047-259X(82)90080-X"},{"key":"27","doi-asserted-by":"crossref","unstructured":"[27] Laloux, L., Cizeau, P., Bouchaud, J.-P. and Potters, M. (1999). Noise dressing of financial correlation matrices. <i>Phys. Rev. Lett.<\/i> <b>83<\/b> 1467\u20131470.","DOI":"10.1103\/PhysRevLett.83.1467"},{"key":"29","doi-asserted-by":"publisher","unstructured":"[29] Ledoit, O. and Wolf, M. (2004). A well-conditioned estimator for large-dimensional covariance matrices. <i>J. Multivariate Anal.<\/i> <b>88<\/b> 365\u2013411.","DOI":"10.1016\/S0047-259X(03)00096-4"},{"key":"30","unstructured":"[30] Mar\u010denko, V. A. and Pastur, L. A. (1967). Distribution of eigenvalues in certain sets of random matrices. <i>Mat. Sb. (N.S.)<\/i> <b>72<\/b> 507\u2013536."},{"key":"33","unstructured":"[33] Paul, D. (2007). Asymptotics of sample eigenstructure for a large dimensional spiked covariance model. <i>Statist. Sinica<\/i> <b>17<\/b> 1617\u20131642."},{"key":"34","doi-asserted-by":"publisher","unstructured":"[34] Rao, N. R., Mingo, J., Speicher, R. and Edelman, A. (2008). Statistical eigen-inference from large Wishart matrices. <i>Ann. Statist.<\/i> <b>36<\/b> 2850\u20132885.","DOI":"10.1214\/07-AOS583"},{"key":"35","doi-asserted-by":"publisher","unstructured":"[35] Silverstein, J. W. (1995). Strong convergence of the empirical distribution of eigenvalues of large-dimensional random matrices. <i>J. Multivariate Anal.<\/i> <b>55<\/b> 331\u2013339.","DOI":"10.1006\/jmva.1995.1083"},{"key":"36","doi-asserted-by":"publisher","unstructured":"[36] Silverstein, J. W. and Bai, Z. D. (1995). On the empirical distribution of eigenvalues of a class of large-dimensional random matrices. <i>J. Multivariate Anal.<\/i> <b>54<\/b> 175\u2013192.","DOI":"10.1006\/jmva.1995.1051"},{"key":"37","doi-asserted-by":"publisher","unstructured":"[37] Wachter, K. W. (1978). The strong limits of random matrix spectra for sample matrices of independent elements. <i>Ann. Probab.<\/i> <b>6<\/b> 1\u201318.","DOI":"10.1214\/aop\/1176995607"},{"key":"38","doi-asserted-by":"publisher","unstructured":"[38] Yin, Y. Q. (1986). Limiting spectral distribution for a class of random matrices. <i>J. Multivariate Anal.<\/i> <b>20<\/b> 50\u201368.","DOI":"10.1016\/0047-259X(86)90019-9"},{"key":"39","doi-asserted-by":"publisher","unstructured":"[39] Yin, Y. Q., Bai, Z. D. and Krishnaiah, P. R. (1988). On the limit of the largest eigenvalue of the large-dimensional sample covariance matrix. <i>Probab. Theory Related Fields<\/i> <b>78<\/b> 509\u2013521.","DOI":"10.1007\/BF00353874"},{"key":"1","unstructured":"[1] Akhiezer, N. I. (1965). <i>The Classical Moment Problem and Some Related Questions in Analysis<\/i>. Hafner Publishing, New York."},{"key":"3","unstructured":"[3] Anderson, T. W. (2003). <i>An Introduction to Multivariate Statistical Analysis<\/i>, 3rd ed. Wiley, Hoboken, NJ."},{"key":"9","doi-asserted-by":"crossref","unstructured":"[9] B\u00f6ttcher, A. and Silbermann, B. (1999). <i>Introduction to Large Truncated Toeplitz Matrices<\/i>. Springer, New York.","DOI":"10.1007\/978-1-4612-1426-7"},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] Boyd, S. and Vandenberghe, L. (2004). <i>Convex Optimization<\/i>. Cambridge Univ. Press.","DOI":"10.1017\/CBO9780511804441"},{"key":"13","doi-asserted-by":"crossref","unstructured":"[13] Campbell, J., Lo, A. and MacKinlay, C. (1996). <i>The Econometrics of Financial Markets<\/i>. Princeton Univ. Press.","DOI":"10.1515\/9781400830213"},{"key":"16","unstructured":"[16] Durrett, R. (1996). <i>Probability: Theory and Examples<\/i>, 2nd ed. Duxbury Press, Belmont, CA."},{"key":"21","unstructured":"[21] Gray, R. M. (2002). Toeplitz and circulant matrices: A review. Available at http:\/\/ee.stanford.edu\/~gray\/toeplitz.pdf."},{"key":"22","doi-asserted-by":"crossref","unstructured":"[22] Grenander, U. and Szeg\u00f6, G. (1958). <i>Toeplitz Forms and Their Applications<\/i>. Univ. California Press, Berkeley.","DOI":"10.1525\/9780520355408"},{"key":"23","doi-asserted-by":"crossref","unstructured":"[23] Hastie, T., Tibshirani, R. and Friedman, J. (2001). <i>The Elements of Statistical Learning<\/i>. Springer, New York.","DOI":"10.1007\/978-0-387-21606-5"},{"key":"28","unstructured":"[28] Lax, P. D. (2002). <i>Functional Analysis<\/i>. Wiley, New York."},{"key":"31","unstructured":"[31] Mardia, K. V., Kent, J. T. and Bibby, J. M. (1979). <i>Multivariate Analysis<\/i>. Academic Press, London."},{"key":"32","unstructured":"[32] MOSEK. (2006). MOSEK Optimization Toolbox. Available at http:\/\/www.mosek.com."}],"container-title":["The Annals of Statistics"],"original-title":[],"link":[{"URL":"http:\/\/projecteuclid.org\/download\/pdfview_1\/euclid.aos\/1231165184","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T23:16:22Z","timestamp":1791587782000},"score":1,"resource":{"primary":{"URL":"https:\/\/projecteuclid.org\/journals\/annals-of-statistics\/volume-36\/issue-6\/Spectrum-estimation-for-large-dimensional-covariance-matrices-using-random-matrix\/10.1214\/07-AOS581.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,12,1]]},"references-count":39,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2008,12,1]]}},"URL":"https:\/\/doi.org\/10.1214\/07-aos581","relation":{},"ISSN":["0090-5364","2168-8966"],"issn-type":[{"value":"0090-5364","type":"print"},{"value":"2168-8966","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,12,1]]}}}