{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,17]],"date-time":"2026-10-17T14:23:07Z","timestamp":1792246987020,"version":"4.4.0"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,3,11]],"date-time":"2023-03-11T00:00:00Z","timestamp":1678492800000},"content-version":"vor","delay-in-days":4170,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01-GM072611"],"award-info":[{"award-number":["R01-GM072611"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-0704337"],"award-info":[{"award-number":["DMS-0704337"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006734","name":"Princeton University","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006734","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2012,1,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Variance estimation is a fundamental problem in statistical modelling. In ultrahigh dimensional linear regression where the dimensionality is much larger than the sample size, traditional variance estimation techniques are not applicable. Recent advances in variable selection in ultrahigh dimensional linear regression make this problem accessible. One of the major problems in ultrahigh dimensional regression is the high spurious correlation between the unobserved realized noise and some of the predictors. As a result, the realized noises are actually predicted when extra irrelevant variables are selected, leading to a serious underestimate of the level of noise. We propose a two-stage refitted procedure via a data splitting technique, called refitted cross-validation, to attenuate the influence of irrelevant variables with high spurious correlations. Our asymptotic results show that the resulting procedure performs as well as the oracle estimator, which knows in advance the mean regression function. The simulation studies lend further support to our theoretical claims. The naive two-stage estimator and the plug-in one-stage estimators using the lasso and smoothly clipped absolute deviation are also studied and compared. Their performances can be improved by the refitted cross-validation method proposed.<\/jats:p>","DOI":"10.1111\/j.1467-9868.2011.01005.x","type":"journal-article","created":{"date-parts":[[2011,10,10]],"date-time":"2011-10-10T18:10:24Z","timestamp":1318270224000},"page":"37-65","source":"Crossref","is-referenced-by-count":197,"title":["Variance Estimation Using Refitted Cross-Validation in Ultrahigh Dimensional Regression"],"prefix":"10.1093","volume":"74","author":[{"given":"Jianqing","family":"Fan","sequence":"first","affiliation":[{"name":"Princeton University , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaojun","family":"Guo","sequence":"additional","affiliation":[{"name":"Chinese Academy of Sciences , Beijing , People\u2019s Republic of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ning","family":"Hao","sequence":"additional","affiliation":[{"name":"University of Arizona , Tucson , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2011,10,10]]},"reference":[{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1214\/08-AOS620","article-title":"Simultaneous analysis of lasso and dantzig selector","volume":"37","author":"Bickel","year":"2009","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1214\/07-EJS008","article-title":"Sparsity oracle inequalities for the lasso","volume":"1","author":"Bunea","year":"2007","journal-title":"Electron. J. Statist."},{"key":"2023031201052720600_","first-page":"2313","article-title":"The dantzig selector: statistical estimation when p is much larger than n (with discussion)","volume":"35","author":"Candes","year":"2007","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1198\/jasa.2011.tm10159","article-title":"Bootstrapping lasso estimators","volume":"106","author":"Chatterjee","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1214\/009053604000000067","article-title":"Least angle regression (with discussions)","volume":"32","author":"Efron","year":"2004","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1111\/j.1467-9868.2008.00674.x","article-title":"Sure independence screening for ultrahigh dimensional feature space (with discussion)","volume":"70","author":"Fan","year":"2008","journal-title":"J. R. Statist. Soc. B"},{"key":"2023031201052720600_","first-page":"101","article-title":"A selective overview of variable selection in high dimensional feature space","volume":"20","author":"Fan","year":"2010","journal-title":"Statist. Sin."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","DOI":"10.1109\/TIT.2011.2158486","article-title":"Non-concave penalized likelihood with NP-dimensionality","author":"Fan","year":"2011","journal-title":"IEEE Trans. Inform. Theor."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"928","DOI":"10.1214\/009053604000000256","article-title":"Nonconcave penalized likelihood with a diverging number of parameters","volume":"32","author":"Fan","year":"2004","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","first-page":"2013","article-title":"Ultrahigh dimensional feature selection: beyond the linear model","volume":"10","author":"Fan","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"3567","DOI":"10.1214\/10-AOS798","article-title":"Sure independence screening in generalized linear models with NP-dimensionality","volume":"38","author":"Fan","year":"2010","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"971","DOI":"10.3150\/bj\/1106314846","article-title":"Persistence in high-dimensional linear predictor selection and the virtue of overparametrization","volume":"10","author":"Greenshtein","year":"2004","journal-title":"Bernoulli"},{"key":"2023031201052720600_","article-title":"Control of the false discovery rate under arbitrary covariance dependence","author":"Han","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"1665","DOI":"10.1198\/016214508000001066","article-title":"Smoothly clipped absolute deviation on high dimensions","volume":"103","author":"Kim","year":"2008","journal-title":"J. Am. Statist. Ass."},{"key":"2023031201052720600_","first-page":"1356","article-title":"Asymptotics for lasso-type estimators","volume":"28","author":"Knight","year":"2000","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","first-page":"369","article-title":"Penalized regression, standard errors and Bayesian lassos","volume":"5","author":"Kyung","year":"2010","journal-title":"Baysn Anal."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"3498","DOI":"10.1214\/09-AOS683","article-title":"A unified approach to model selection and sparse recovery using regularized least squares","volume":"37","author":"Lv","year":"2009","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1111\/j.1467-9868.2007.00627.x","article-title":"The group lasso for logistic regression","volume":"70","author":"Meier","year":"2008","journal-title":"J. R. Statist. Soc. B"},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"1671","DOI":"10.1198\/jasa.2009.tm08647","article-title":"p-values for high-dimensional regression","volume":"104","author":"Meinshausen","year":"2009","journal-title":"J. Am. Statist. Ass."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1214\/07-AOS582","article-title":"LASSO-type recovery of sparse representations for high-dimensional data","volume":"37","author":"Meinshausen","year":"2009","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1198\/016214508000000337","article-title":"The Bayesian lasso","volume":"103","author":"Park","year":"2008","journal-title":"J. Am. Statist. Ass."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"2178","DOI":"10.1214\/08-AOS646","article-title":"High dimensional variable selection","volume":"37","author":"Wasserman","year":"2009","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-2545-2","volume-title":"Weak Convergence and Empirical Processes","author":"van der Vaart","year":"1996"},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1080\/01621459.1998.10474094","article-title":"On measuring and correcting the effects of data mining and model selection","volume":"93","author":"Ye","year":"1998","journal-title":"J. Am. Statist. Ass."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1214\/07-AOS520","article-title":"The sparsity and bias of the lasso selection in high-dimensional linear regression","volume":"36","author":"Zhang","year":"2008","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","article-title":"Principled sure independence screening for Cox models with ultra-high-dimensional covariates","author":"Zhao","year":"2010","journal-title":"Preprint"},{"key":"2023031201052720600_","first-page":"2541","article-title":"On model selection consistency of lasso","volume":"7","author":"Zhao","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"2023031201052720600_","doi-asserted-by":"crossref","first-page":"2173","DOI":"10.1214\/009053607000000127","article-title":"On the \u2018\u2018degrees of freedom\u2019\u2019 of the lasso","volume":"35","author":"Zou","year":"2007","journal-title":"Ann. Statist."},{"key":"2023031201052720600_","first-page":"1509","article-title":"One-step sparse estimates in nonconcave penalized likelihood models (with discussion)","volume":"36","author":"Zou","year":"2008","journal-title":"Ann. Statist."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1467-9868.2011.01005.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/74\/1\/37\/49509126\/jrsssb_74_1_37.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/74\/1\/37\/49509126\/jrsssb_74_1_37.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T13:20:30Z","timestamp":1713014430000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/74\/1\/37\/7074999"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,10,10]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2011,10,10]]},"published-print":{"date-parts":[[2012,1,1]]}},"URL":"https:\/\/doi.org\/10.1111\/j.1467-9868.2011.01005.x","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2012,1]]},"published":{"date-parts":[[2011,10,10]]}}}