{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T10:18:19Z","timestamp":1792059499474,"version":"4.4.0"},"reference-count":44,"publisher":"Institute of Mathematical Statistics","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ann. Statist."],"published-print":{"date-parts":[[2017,2,1]]},"abstract":"We consider the problem of uncertainty assessment for low dimensional components in high dimensional models. Specifically, we propose a novel decorrelated score function to handle the impact of high dimensional nuisance parameters. We consider both hypothesis tests and confidence regions for generic penalized M-estimators. Unlike most existing inferential methods which are tailored for individual models, our method provides a general framework for high dimensional inference and is applicable to a wide variety of applications. In particular, we apply this general framework to study five illustrative examples: linear regression, logistic regression, Poisson regression, Gaussian graphical model and additive hazards model. For hypothesis testing, we develop general theorems to characterize the limiting distributions of the decorrelated score test statistic under both null hypothesis and local alternatives. These results provide asymptotic guarantees on the type I errors and local powers. For confidence region construction, we show that the decorrelated score function can be used to construct point estimators that are asymptotically normal and semiparametrically efficient. We further generalize this framework to handle the settings of misspecified models. Thorough numerical results are provided to back up the developed theory.<\/jats:p>","DOI":"10.1214\/16-aos1448","type":"journal-article","created":{"date-parts":[[2017,2,21]],"date-time":"2017-02-21T04:01:04Z","timestamp":1487649664000},"page":"158-195","source":"Crossref","is-referenced-by-count":206,"title":["A general theory of hypothesis tests and confidence regions for sparse high dimensional models"],"prefix":"10.1214","volume":"45","author":[{"given":"Yang","family":"Ning","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Han","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"108","reference":[{"key":"15","doi-asserted-by":"publisher","unstructured":"[15] Knight, K. and Fu, W. (2000). Asymptotics for lasso-type estimators. Ann. Statist.<\/i> 28<\/b> 1356\u20131378.","DOI":"10.1214\/aos\/1015957397"},{"key":"5","doi-asserted-by":"publisher","unstructured":"[5] Bickel, P. J., Ritov, Y. and Tsybakov, A. B. (2009). Simultaneous analysis of lasso and Dantzig selector. Ann. Statist.<\/i> 37<\/b> 1705\u20131732.","DOI":"10.1214\/08-AOS620"},{"key":"6","doi-asserted-by":"publisher","unstructured":"[6] Candes, E. and Tao, T. (2007). The Dantzig selector: Statistical estimation when $p$ is much larger than $n$. Ann. Statist.<\/i> 35<\/b> 2313\u20132351.","DOI":"10.1214\/009053606000001523"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc.<\/i> 96<\/b> 1348\u20131360.","DOI":"10.1198\/016214501753382273"},{"key":"39","doi-asserted-by":"publisher","unstructured":"[39] Wasserman, L. and Roeder, K. (2009). High-dimensional variable selection. Ann. Statist.<\/i> 37<\/b> 2178\u20132201.","DOI":"10.1214\/08-AOS646"},{"key":"43","unstructured":"[43] Zhao, P. and Yu, B. (2006). On model selection consistency of Lasso. J. Mach. Learn. Res.<\/i> 7<\/b> 2541\u20132563."},{"key":"1","doi-asserted-by":"crossref","unstructured":"[1] Bach, F. (2010). Self-concordant analysis for logistic regression. Electron. J. Stat.<\/i> 4<\/b> 384\u2013414.","DOI":"10.1214\/09-EJS521"},{"key":"2","doi-asserted-by":"publisher","unstructured":"[2] Belloni, A., Chernozhukov, V. and Wang, L. (2011). Square-root Lasso: Pivotal recovery of sparse signals via conic programming. Biometrika<\/i> 98<\/b> 791\u2013806.","DOI":"10.1093\/biomet\/asr043"},{"key":"3","unstructured":"[3] Belloni, A., Chernozhukov, V. and Wei, Y. (2013). Honest confidence regions for logistic regression with a large number of controls. Preprint. Available at arXiv:1304.3969<\/a>."},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] Bickel, P. J. (1975). One-step Huber estimates in the linear model. J. Amer. Statist. Assoc.<\/i> 70<\/b> 428\u2013434.","DOI":"10.1080\/01621459.1975.10479884"},{"key":"9","unstructured":"[9] Fang, E. X., Ning, Y. and Liu, H. (2014). Testing and confidence intervals for high dimensional proportional hazards model. Preprint. Available at arXiv:1412.5158<\/a>."},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] Godambe, V. P. and Kale, B. K. (1991). Estimating functions: An overview. In Estimating Functions. Oxford Statist. Sci. Ser.<\/i> 7<\/b> 3\u201320. Oxford Univ. Press, New York.","DOI":"10.1093\/oso\/9780198522287.003.0001"},{"key":"11","doi-asserted-by":"crossref","unstructured":"[11] Godfrey, L. G. (1991). Misspecification Tests in Econometrics<\/i>: The Lagrange Multiplier Principle and Other Approaches. Econometric Society Monographs<\/i> 16<\/b>. Cambridge Univ. Press, Cambridge. Reprint of the 1988 original.","DOI":"10.1017\/CCOL0521266165"},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] Jankova, J. and van de Geer, S. (2013). Confidence intervals for high-dimensional inverse covariance estimation. Preprint. Available at arXiv:1403.6752<\/a>.","DOI":"10.1214\/15-EJS1031"},{"key":"13","unstructured":"[13] Javanmard, A. and Montanari, A. (2014). Confidence intervals and hypothesis testing for high-dimensional regression. J. Mach. Learn. Res.<\/i> 15<\/b> 2869\u20132909."},{"key":"14","doi-asserted-by":"crossref","unstructured":"[14] Javanmard, A. and Montanari, A. (2014). Hypothesis testing in high-dimensional regression under the Gaussian random design model: Asymptotic theory. IEEE Trans. Inform. Theory<\/i> 60<\/b> 6522\u20136554.","DOI":"10.1109\/TIT.2014.2343629"},{"key":"16","unstructured":"[16] Lee, J. D., Sun, D. L., Sun, Y. and Taylor, J. E. (2013). Exact inference after model selection via the Lasso. Preprint. Available at arXiv:1311.6238<\/a>."},{"key":"17","doi-asserted-by":"crossref","unstructured":"[17] Lin, D. Y. and Ying, Z. (1994). Semiparametric analysis of the additive risk model. Biometrika<\/i> 81<\/b> 61\u201371.","DOI":"10.1093\/biomet\/81.1.61"},{"key":"18","doi-asserted-by":"crossref","unstructured":"[18] Lin, W. and Lv, J. (2013). High-dimensional sparse additive hazards regression. J. Amer. Statist. Assoc.<\/i> 108<\/b> 247\u2013264.","DOI":"10.1080\/01621459.2012.746068"},{"key":"19","doi-asserted-by":"crossref","unstructured":"[19] Lindsay, B. (1982). Conditional score functions: Some optimality results. Biometrika<\/i> 69<\/b> 503\u2013512.","DOI":"10.1093\/biomet\/69.3.503"},{"key":"20","doi-asserted-by":"crossref","unstructured":"[20] Liu, W. (2013). Gaussian graphical model estimation with false discovery rate control. Ann. Statist.<\/i> 41<\/b> 2948\u20132978.","DOI":"10.1214\/13-AOS1169"},{"key":"21","unstructured":"[21] Liu, W. and Luo, X. (2012). High-dimensional sparse precision matrix estimation via sparse column inverse operator. Preprint. Available at arXiv:1203.3896<\/a>."},{"key":"22","doi-asserted-by":"crossref","unstructured":"[22] Lockhart, R., Taylor, J., Tibshirani, R. J. and Tibshirani, R. (2014). A significance test for the Lasso. Ann. Statist.<\/i> 42<\/b> 413\u2013468.","DOI":"10.1214\/13-AOS1175"},{"key":"23","doi-asserted-by":"crossref","unstructured":"[23] Martinussen, T. and Scheike, T. H. (2009). Covariate selection for the semiparametric additive risk model. Scand. J. Stat.<\/i> 36<\/b> 602\u2013619.","DOI":"10.1111\/j.1467-9469.2009.00650.x"},{"key":"24","doi-asserted-by":"crossref","unstructured":"[24] Meinshausen, N. and B\u00fchlmann, P. (2006). High-dimensional graphs and variable selection with the Lasso. Ann. Statist.<\/i> 34<\/b> 1436\u20131462.","DOI":"10.1214\/009053606000000281"},{"key":"25","doi-asserted-by":"crossref","unstructured":"[25] Meinshausen, N. and B\u00fchlmann, P. (2010). Stability selection. J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> 72<\/b> 417\u2013473.","DOI":"10.1111\/j.1467-9868.2010.00740.x"},{"key":"26","doi-asserted-by":"publisher","unstructured":"[26] Meinshausen, N., Meier, L. and B\u00fchlmann, P. (2009). $p$-values for high-dimensional regression. J. Amer. Statist. Assoc.<\/i> 104<\/b> 1671\u20131681.","DOI":"10.1198\/jasa.2009.tm08647"},{"key":"27","doi-asserted-by":"crossref","unstructured":"[27] Ning, Y. and Liu, H. (2016). Supplement to \u201cA general theory of hypothesis tests and confidence regions for sparse high dimensional models.\u201d DOI:10.1214\/16-AOS1448SUPP<\/a>.","DOI":"10.1214\/16-AOS1448SUPP"},{"key":"28","doi-asserted-by":"crossref","unstructured":"[28] Portnoy, S. (1984). Asymptotic behavior of $M$-estimators of $p$ regression parameters when $p^{2}\/n$ is large. I. Consistency. Ann. Statist.<\/i> 12<\/b> 1298\u20131309.","DOI":"10.1214\/aos\/1176346793"},{"key":"29","doi-asserted-by":"crossref","unstructured":"[29] Portnoy, S. (1985). Asymptotic behavior of $M$ estimators of $p$ regression parameters when $p^{2}\/n$ is large. II. Normal approximation. Ann. Statist.<\/i> 13<\/b> 1403\u20131417.","DOI":"10.1214\/aos\/1176349744"},{"key":"30","doi-asserted-by":"crossref","unstructured":"[30] Ren, Z., Sun, T., Zhang, C.-H. and Zhou, H. H. (2015). Asymptotic normality and optimalities in estimation of large Gaussian graphical models. Ann. Statist.<\/i> 43<\/b> 991\u20131026.","DOI":"10.1214\/14-AOS1286"},{"key":"31","unstructured":"[31] Small, C. G. and McLeish, D. L. (2011). Hilbert Space Methods in Probability and Statistical Inference<\/i> 920<\/b>. John Wiley & Sons, New York."},{"key":"32","doi-asserted-by":"publisher","unstructured":"[32] Sun, T. and Zhang, C.-H. (2012). Scaled sparse linear regression. Biometrika<\/i> 99<\/b> 879\u2013898.","DOI":"10.1093\/biomet\/ass043"},{"key":"33","doi-asserted-by":"crossref","unstructured":"[33] Tibshirani, R. (1996). Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> 58<\/b> 267\u2013288.","DOI":"10.1111\/j.2517-6161.1996.tb02080.x"},{"key":"34","doi-asserted-by":"publisher","unstructured":"[34] van de Geer, S., B\u00fchlmann, P., Ritov, Y. and Dezeure, R. (2014). On asymptotically optimal confidence regions and tests for high-dimensional models. Ann. Statist.<\/i> 42<\/b> 1166\u20131202.","DOI":"10.1214\/14-AOS1221"},{"key":"35","unstructured":"[35] Van der Vaart, A. W. (2000). Asymptotic Statistics<\/i> 3<\/b>. Cambridge Univ. Press, Cambridge."},{"key":"36","doi-asserted-by":"publisher","unstructured":"[36] Voorman, A., Shojaie, A. and Witten, D. (2014). Inference in high dimensions with the penalized score test. Preprint. Available at arXiv:1401.2678<\/a>.","DOI":"10.1093\/biomet\/ast053"},{"key":"37","doi-asserted-by":"crossref","unstructured":"[37] Wang, L., Kim, Y. and Li, R. (2013). Calibrating nonconvex penalized regression in ultra-high dimension. Ann. Statist.<\/i> 41<\/b> 2505\u20132536.","DOI":"10.1214\/13-AOS1159"},{"key":"38","doi-asserted-by":"crossref","unstructured":"[38] Wang, Z., Liu, H. and Zhang, T. (2014). Optimal computational and statistical rates of convergence for sparse nonconvex learning problems. Ann. Statist.<\/i> 42<\/b> 2164\u20132201.","DOI":"10.1214\/14-AOS1238"},{"key":"40","doi-asserted-by":"crossref","unstructured":"[40] White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica<\/i> 50<\/b> 1\u201325.","DOI":"10.2307\/1912526"},{"key":"41","doi-asserted-by":"publisher","unstructured":"[41] Zhang, C.-H. (2010). Nearly unbiased variable selection under minimax concave penalty. Ann. Statist.<\/i> 38<\/b> 894\u2013942.","DOI":"10.1214\/09-AOS729"},{"key":"42","doi-asserted-by":"publisher","unstructured":"[42] Zhang, C.-H. and Zhang, S. S. (2014). Confidence intervals for low dimensional parameters in high dimensional linear models. J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> 76<\/b> 217\u2013242.","DOI":"10.1111\/rssb.12026"},{"key":"44","doi-asserted-by":"crossref","unstructured":"[44] Zhong, P.-S., Hu, T. and Li, J. (2015). Tests for coefficients in high-dimensional additive hazard models. Scand. J. Stat.<\/i> 42<\/b> 649\u2013664.","DOI":"10.1111\/sjos.12127"},{"key":"7","doi-asserted-by":"crossref","unstructured":"[7] Cox, D. R. and Hinkley, D. V. (1979). Theoretical Statistics<\/i>. CRC Press, Boca Raton, FL.","DOI":"10.1201\/b14832"}],"container-title":["The Annals of Statistics"],"original-title":[],"link":[{"URL":"http:\/\/projecteuclid.org\/download\/pdfview_1\/euclid.aos\/1487667620","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T18:46:42Z","timestamp":1791485202000},"score":1,"resource":{"primary":{"URL":"https:\/\/projecteuclid.org\/journals\/annals-of-statistics\/volume-45\/issue-1\/A-general-theory-of-hypothesis-tests-and-confidence-regions-for\/10.1214\/16-AOS1448.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,2,1]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,2,1]]}},"URL":"https:\/\/doi.org\/10.1214\/16-aos1448","relation":{},"ISSN":["0090-5364","2168-8966"],"issn-type":[{"value":"0090-5364","type":"print"},{"value":"2168-8966","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,2,1]]}}}