{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T09:41:38Z","timestamp":1791452498286,"version":"4.3.3"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2020,1,20]],"date-time":"2020-01-20T00:00:00Z","timestamp":1579478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,4,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>The paper considers statistical inference for the explained variance \u03b2T\u03a3\u03b2 under the high dimensional linear model Y = X\u03b2 + \u03b5 in the semisupervised setting, where \u03b2 is the regression vector and \u03a3 is the design covariance matrix. A calibrated estimator, which efficiently integrates both labelled and unlabelled data, is proposed. It is shown that the estimator achieves the minimax optimal rate of convergence in the general semisupervised framework. The optimality result characterizes how the unlabelled data contribute to the estimation accuracy. Moreover, the limiting distribution for the proposed estimator is established and the unlabelled data have also proved useful in reducing the length of the confidence interval for the explained variance. The method proposed is extended to semisupervised inference for the unweighted quadratic functional \u2016\u03b2\u201622. The inference results obtained are then applied to a range of high dimensional statistical problems, including signal detection and global testing, prediction accuracy evaluation and confidence ball construction. The numerical improvement of incorporating the unlabelled data is demonstrated through simulation studies and an analysis of estimating heritability for a yeast segregant data set with multiple traits.<\/jats:p>","DOI":"10.1111\/rssb.12357","type":"journal-article","created":{"date-parts":[[2020,1,20]],"date-time":"2020-01-20T11:32:36Z","timestamp":1579519956000},"page":"391-419","source":"Crossref","is-referenced-by-count":48,"title":["Semisupervised Inference for Explained Variance in High Dimensional Linear Regression and its Applications"],"prefix":"10.1093","volume":"82","author":[{"given":"T.","family":"Tony Cai","sequence":"first","affiliation":[{"name":"University of Pennsylvania , Philadelphia , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zijian","family":"Guo","sequence":"additional","affiliation":[{"name":"Rutgers University , Piscataway , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,1,20]]},"reference":[{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"2533","DOI":"10.1214\/11-AOS910","article-title":"Global testing under sparse alternatives: Anova, multiple comparisons and the higher criticism","volume":"39","author":"Arias-Castro","year":"2011","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1093\/biomet\/asr043","article-title":"Square-root lasso: pivotal recovery of sparse signals via conic programming","volume":"98","author":"Belloni","year":"2011","journal-title":"Biometrika"},{"key":"2023022408363121800_","first-page":"381","article-title":"Estimating integrated squared density derivatives: sharp best order of convergence estimates","volume":"50","author":"Bickel","year":"1988","journal-title":"Sankhya"},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1705","DOI":"10.1214\/08-AOS620","article-title":"Simultaneous analysis of lasso and Dantzig selector","volume":"37","author":"Bickel","year":"2009","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1038\/nature11867","article-title":"Finding the sources of missing heritability in a yeast cross","volume":"494","author":"Bloom","year":"2013","journal-title":"Nature"},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1080\/02331888.2016.1265969","article-title":"Confidence intervals for high-dimensional linear regression: minimax rates and adaptivity","volume":"45","author":"Cai","year":"2017","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","DOI":"10.1214\/17-AOS1604","article-title":"Supplement to \u201cAccuracy assessment for high-dimensional linear regression\u201d","author":"Cai","year":"2018","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1807","DOI":"10.1214\/17-AOS1604","article-title":"Accuracy assessment for high-dimensional linear regression","volume":"46","author":"Cai","year":"2018","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1198\/jasa.2011.tm10560","article-title":"Adaptive thresholding for sparse covariance matrix estimation","volume":"106","author":"Cai","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1198\/jasa.2011.tm10155","article-title":"A constrained \u21131 minimization approach to sparse precision matrix estimation","volume":"106","author":"Cai","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"2930","DOI":"10.1214\/009053605000000147","article-title":"Nonquadratic estimators of a quadratic functional","volume":"33","author":"Cai","year":"2005","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"2298","DOI":"10.1214\/009053606000000849","article-title":"Optimal adaptive estimation of a quadratic functional","volume":"34","author":"Cai","year":"2006","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","first-page":"2313","article-title":"The Dantzig selector: statistical estimation when p is much larger than n","volume":"35","author":"Cand\u00e8s","year":"2007","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1214\/17-AOS1594","article-title":"Efficient and adaptive linear regression in semi-supervised settings","volume":"46","author":"Chakrabortty","year":"2018","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1214\/15-AOS1432","article-title":"Minimax estimation of linear and quadratic functionals on sparsity classes","volume":"45","author":"Collier","year":"2017","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/0885-064X(90)90025-9","article-title":"Minimax quadratic estimation of a quadratic functional","volume":"6","author":"Donoho","year":"1990","journal-title":"J. Complex."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1106","DOI":"10.1214\/aos\/1032526959","article-title":"On optimal adaptive estimation of a quadratic functional","volume":"24","author":"Efromovich","year":"1996","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1214\/14-AOS1221","article-title":"On asymptotically optimal confidence regions and tests for high-dimensional models","volume":"42","author":"van de Geer","year":"2014","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1111\/rssb.12264","article-title":"Semi-supervised approaches to efficient evaluation of model prediction performance","volume":"80","author":"Gronsbell","year":"2017","journal-title":"J. R. Statist. Soc."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1080\/01621459.2017.1407774","article-title":"Optimal estimation of genetic relatedness in high-dimensional linear models","volume":"114","author":"Guo","year":"2019","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1476","DOI":"10.1214\/10-EJS589","article-title":"Detection boundary in sparse regression","volume":"4","author":"Ingster","year":"2010","journal-title":"Electron. J. Statist."},{"issue":"no. 2","key":"2023022408363121800_","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0172082","article-title":"Extending the use of GWAS data by combining data from different genetic platforms","volume":"12","author":"van Iperen","year":"2017","journal-title":"PLOS One"},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1111\/rssb.12203","article-title":"Eigenprism: inference for high dimensional signal-to-noise ratios","volume":"79","author":"Janson","year":"2017","journal-title":"J. R. Statist. Soc."},{"key":"2023022408363121800_","volume-title":"A flexible framework for hypothesis testing in high-dimensions","author":"Javanmard","year":"2017"},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"6522","DOI":"10.1109\/TIT.2014.2343629","article-title":"Hypothesis testing in high-dimensional regression under the Gaussian random design model: asymptotic theory","volume":"60","author":"Javanmard","year":"2014","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023022408363121800_","first-page":"2869","article-title":"Confidence intervals and hypothesis testing for high-dimensional regression","volume":"15","author":"Javanmard","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"1302","DOI":"10.1214\/aos\/1015957395","article-title":"Adaptive estimation of a quadratic functional by model selection","volume":"28","author":"Laurent","year":"2000","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"2852","DOI":"10.1214\/13-AOS1170","article-title":"Confidence sets in sparse regression","volume":"41","author":"Nickl","year":"2013","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","volume-title":"Quasi-regression for heritability","author":"Owen","year":"2012"},{"key":"2023022408363121800_","first-page":"2241","article-title":"Restricted eigenvalue properties for correlated Gaussian designs","volume":"11","author":"Raskutti","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"2023022408363121800_","first-page":"269","article-title":"Scaled sparse linear regression","volume":"101","author":"Sun","year":"2012","journal-title":"Biometrika"},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Statist. Soc."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"3683","DOI":"10.3150\/17-BEJ975","article-title":"Adaptive estimation of high-dimensional signal-to-noise ratios.","volume":"24","author":"Verzelen","year":"2018","journal-title":"Bernoulli"},{"key":"2023022408363121800_","first-page":"3519","article-title":"Rate minimaxity of the lasso and Dantzig selector for the lq loss in lr balls","volume":"11","author":"Ye","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1214\/09-AOS729","article-title":"Nearly unbiased variable selection under minimax concave penalty","volume":"38","author":"Zhang","year":"2010","journal-title":"Ann. Statist."},{"key":"2023022408363121800_","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/rssb.12026","article-title":"Confidence intervals for low dimensional parameters in high dimensional linear models","volume":"76","author":"Zhang","year":"2014","journal-title":"J. R. Statist. Soc."},{"key":"2023022408363121800_","volume-title":"Restricted eigenvalue conditions on subgaussian random matrices","author":"Zhou","year":"2009"},{"key":"2023022408363121800_","volume-title":"A projection pursuit framework for testing general high-dimensional hypothesis","author":"Zhu","year":"2017"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12357","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/2\/391\/49320871\/jrsssb_82_2_391.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/2\/391\/49320871\/jrsssb_82_2_391.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,30]],"date-time":"2024-07-30T10:51:56Z","timestamp":1722336716000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/82\/2\/391\/7056037"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,20]]},"references-count":38,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,1,20]]},"published-print":{"date-parts":[[2020,4,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12357","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,4]]},"published":{"date-parts":[[2020,1,20]]}}}