{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T22:52:45Z","timestamp":1791586365187,"version":"4.3.4"},"reference-count":29,"publisher":"Institute of Mathematical Statistics","issue":"6B","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ann. Statist."],"published-print":{"date-parts":[[2009,12,1]]},"abstract":"<jats:p>This paper studies the sparsistency and rates of convergence for estimating sparse covariance and precision matrices based on penalized likelihood with nonconvex penalty functions. Here, sparsistency refers to the property that all parameters that are zero are actually estimated as zero with probability tending to one. Depending on the case of applications, sparsity priori may occur on the covariance matrix, its inverse or its Cholesky decomposition. We study these three sparsity exploration problems under a unified framework with a general penalty function. We show that the rates of convergence for these problems under the Frobenius norm are of order (sn\u2009log\u2009pn\/n)1\/2, where sn is the number of nonzero elements, pn is the size of the covariance matrix and n is the sample size. This explicitly spells out the contribution of high-dimensionality is merely of a logarithmic factor. The conditions on the rate with which the tuning parameter \u03bbn goes to 0 have been made explicit and compared under different penalties. As a result, for the L1-penalty, to guarantee the sparsistency and optimal rate of convergence, the number of nonzero elements should be small: sn'=O(pn) at most, among O(pn2) parameters, for estimating sparse covariance or correlation matrix, sparse precision or inverse correlation matrix or sparse Cholesky factor, where sn' is the number of the nonzero elements on the off-diagonal entries. On the other hand, using the SCAD or hard-thresholding penalty functions, there is no such a restriction.<\/jats:p>","DOI":"10.1214\/09-aos720","type":"journal-article","created":{"date-parts":[[2009,10,23]],"date-time":"2009-10-23T09:12:57Z","timestamp":1256289177000},"page":"4254-4278","source":"Crossref","is-referenced-by-count":398,"title":["Sparsistency and rates of convergence in large covariance matrix estimation"],"prefix":"10.1214","volume":"37","author":[{"given":"Clifford","family":"Lam","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianqing","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"108","reference":[{"key":"10","doi-asserted-by":"publisher","unstructured":"Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. <i>J. Amer. Statist. Assoc.<\/i> <b>96<\/b> 1348\u20131360.","DOI":"10.1198\/016214501753382273"},{"key":"18","doi-asserted-by":"publisher","unstructured":"Pourahmadi, M. (1999). Joint mean-covariance models with applications to longitudinal data: Unconstrained parameterisation. <i>Biometrika<\/i> <b>86<\/b> 677\u2013690.","DOI":"10.1093\/biomet\/86.3.677"},{"key":"6","doi-asserted-by":"crossref","unstructured":"Dempster, A. P. (1972). Covariance selection. <i>Biometrics<\/i> <b>28<\/b> 157\u2013175.","DOI":"10.2307\/2528966"},{"key":"17","doi-asserted-by":"publisher","unstructured":"Meinshausen, N. and B\u00fchlmann, P. (2006). High-dimensional graphs and variable selection with the lasso. <i>Ann. Statist.<\/i> <b>34<\/b> 1436\u20131462.","DOI":"10.1214\/009053606000000281"},{"key":"20","doi-asserted-by":"publisher","unstructured":"Rothman, A. J., Bickel, P. J., Levina, E. and Zhu, J. (2008). Sparse permutation invariant covariance estimation. <i>Electron. J. Stat.<\/i> <b>2<\/b> 494\u2013515.","DOI":"10.1214\/08-EJS176"},{"key":"12","doi-asserted-by":"publisher","unstructured":"Friedman, J., Hastie, T. and Tibshirani, R. (2008). Sparse inverse covariance estimation with the graphical lasso. <i>Biostatistics<\/i> <b>9<\/b> 432\u2013441.","DOI":"10.1093\/biostatistics\/kxm045"},{"key":"11","doi-asserted-by":"publisher","unstructured":"Fan, J. and Peng, H. (2004). Nonconcave penalized likelihood with a diverging number of parameters. <i>Ann. Statist.<\/i> <b>32<\/b> 928\u2013961.","DOI":"10.1214\/009053604000000256"},{"key":"28","doi-asserted-by":"publisher","unstructured":"Zou, H. (2006). The adaptive lasso and its oracle properties. <i>J. Amer. Statist. Assoc.<\/i> <b>101<\/b> 1418\u20131429.","DOI":"10.1198\/016214506000000735"},{"key":"2","doi-asserted-by":"publisher","unstructured":"Bickel, P. J. and Levina, E. (2008a). Covariance regularization by thresholding. <i>Ann. Statist.<\/i> <b>36<\/b> 2577\u20132604.","DOI":"10.1214\/08-AOS600"},{"key":"3","doi-asserted-by":"publisher","unstructured":"Bickel, P. J. and Levina, E. (2008b). Regularized estimation of large covariance matrices. <i>Ann. Statist.<\/i> <b>36<\/b> 199\u2013227.","DOI":"10.1214\/009053607000000758"},{"key":"9","doi-asserted-by":"publisher","unstructured":"Fan, J., Feng, Y. and Wu, Y. (2009). Network exploration via the adaptive lasso and SCAD penalties. <i>Ann. Appl. Stat.<\/i> <b>3<\/b> 521\u2013541.","DOI":"10.1214\/08-AOAS215"},{"key":"21","doi-asserted-by":"publisher","unstructured":"Smith, M. and Kohn, R. (2002). Parsimonious covariance matrix estimation for longitudinal data. <i>J. Amer. Statist. Assoc.<\/i> <b>97<\/b> 1141\u20131153.","DOI":"10.1198\/016214502388618942"},{"key":"27","unstructured":"Zhao, P. and Yu, B. (2006). On model selection consistency of Lasso. <i>J. Mach. Learn. Res.<\/i> <b>7<\/b> 2541\u20132563."},{"key":"14","doi-asserted-by":"publisher","unstructured":"Huang, J., Liu, N., Pourahmadi, M. and Liu, L. (2006). Covariance matrix selection and estimation via penalised normal likelihood. <i>Biometrika<\/i> <b>93<\/b> 85\u201398.","DOI":"10.1093\/biomet\/93.1.85"},{"key":"16","doi-asserted-by":"publisher","unstructured":"Meier, L., van de Geer, S. and B\u00fchlmann, P. (2008). The group Lasso for logistic regression. <i>J. R. Stat. Soc. Ser. B Stat. Methodol.<\/i> <b>70<\/b> 53\u201371.","DOI":"10.1111\/j.1467-9868.2007.00627.x"},{"key":"5","doi-asserted-by":"publisher","unstructured":"d\u2019Aspremont, A., Banerjee, O. and El Ghaoui, L. (2008). First-order methods for sparse covariance selection. <i>SIAM J. Matrix Anal. Appl.<\/i> <b>30<\/b> 56\u201366.","DOI":"10.1137\/060670985"},{"key":"7","doi-asserted-by":"crossref","unstructured":"Diggle, P. and Verbyla, A. (1998). Nonparametric estimation of covariance structure in longitudinal data. <i>Biometrics<\/i> <b>54<\/b> 401\u2013415.","DOI":"10.2307\/3109751"},{"key":"8","doi-asserted-by":"crossref","unstructured":"El Karoui, N. (2008). Operator norm consistent estimation of a large dimensional sparse covariance matrices. <i>Ann. Statist.<\/i> <b>36<\/b> 2717\u20132756.","DOI":"10.1214\/07-AOS559"},{"key":"13","doi-asserted-by":"publisher","unstructured":"Huang, J., Horowitz, J. and Ma, S. (2008). Asymptotic properties of bridge estimators in sparse high-dimensional regression models. <i>Ann. Statist.<\/i> <b>36<\/b> 587\u2013613.","DOI":"10.1214\/009053607000000875"},{"key":"15","doi-asserted-by":"publisher","unstructured":"Levina, E., Rothman, A. J. and Zhu, J. (2008). Sparse estimation of large covariance matrices via a nested Lasso penalty. <i>Ann. Appl. Stat.<\/i> <b>2<\/b> 245\u2013263.","DOI":"10.1214\/07-AOAS139"},{"key":"19","unstructured":"Ravikumar, P., Lafferty, J., Liu, H. and Wasserman, L. (2007). Sparse additive models. In <i>Advances in Neural Information Processing Systems<\/i> <b>20<\/b>. MIT Press, Cambridge, MA."},{"key":"22","doi-asserted-by":"crossref","unstructured":"Wagaman, A. S. and Levina, E. (2008). Discovering sparse covariance structures with the Isomap. <i>J. Comput. Graph. Statist.<\/i> <b>18<\/b>. To appear.","DOI":"10.1198\/jcgs.2009.08021"},{"key":"23","doi-asserted-by":"publisher","unstructured":"Wong, F., Carter, C. and Kohn, R. (2003). Efficient estimation of covariance selection models. <i>Biometrika<\/i> <b>90<\/b> 809\u2013830.","DOI":"10.1093\/biomet\/90.4.809"},{"key":"24","doi-asserted-by":"publisher","unstructured":"Wu, W. B. and Pourahmadi, M. (2003). Nonparametric estimation of large covariance matrices of longitudinal data. <i>Biometrika<\/i> <b>94<\/b> 1\u201317.","DOI":"10.1093\/biomet\/90.4.831"},{"key":"25","doi-asserted-by":"publisher","unstructured":"Yuan, M. and Lin, Y. (2007). Model selection and estimation in the Gaussian graphical model. <i>Biometrika<\/i> <b>90<\/b> 831\u2013844.","DOI":"10.1093\/biomet\/asm018"},{"key":"29","doi-asserted-by":"publisher","unstructured":"Zou, H. and Li, R. (2008). One-step sparse estimates in nonconcave penalized likelihood models (with discussion). <i>Ann. Statist.<\/i> <b>36<\/b> 1509\u20131533.","DOI":"10.1214\/009053607000000802"},{"key":"1","unstructured":"Bai, Z. and Silverstein, J. W. (2006). <i>Spectral Analysis of Large Dimensional Random Matrices<\/i>. Science Press, Beijing."},{"key":"4","unstructured":"Cai, T., Zhang, C.-H. and Zhou, H. (2008). Optimal rates of convergence for covariance matrix estimation. Technical report, The Wharton School, Univ. Pennsylvania."},{"key":"26","unstructured":"Zhang, C. H. (2007). Penalized linear unbiased selection. Technical report 2007-003, The Statistics Dept., Rutgers Univ."}],"container-title":["The Annals of Statistics"],"original-title":[],"link":[{"URL":"http:\/\/projecteuclid.org\/download\/pdfview_1\/euclid.aos\/1256303543","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T22:27:23Z","timestamp":1791584843000},"score":1,"resource":{"primary":{"URL":"https:\/\/projecteuclid.org\/journals\/annals-of-statistics\/volume-37\/issue-6B\/Sparsistency-and-rates-of-convergence-in-large-covariance-matrix-estimation\/10.1214\/09-AOS720.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,12,1]]},"references-count":29,"journal-issue":{"issue":"6B","published-online":{"date-parts":[[2009,12,1]]}},"URL":"https:\/\/doi.org\/10.1214\/09-aos720","relation":{},"ISSN":["0090-5364","2168-8966"],"issn-type":[{"value":"0090-5364","type":"print"},{"value":"2168-8966","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,12,1]]}}}