{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T02:26:19Z","timestamp":1789093579870,"version":"build-2803163510"},"reference-count":65,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2020,5,21]],"date-time":"2020-05-21T00:00:00Z","timestamp":1590019200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,7,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Hypothesis testing in the linear regression model is a fundamental statistical problem. We consider linear regression in the high dimensional regime where the number of parameters exceeds the number of samples (p &amp;gt; n). To make informative inference, we assume that the model is approximately sparse, i.e. the effect of covariates on the response can be well approximated by conditioning on a relatively small number of covariates whose identities are unknown. We develop a framework for testing very general hypotheses regarding the model parameters. Our framework encompasses testing whether the parameter lies in a convex cone, testing the signal strength, and testing arbitrary functionals of the parameter. We show that the procedure proposed controls the type I error, and we also analyse the power of the procedure. Our numerical experiments confirm our theoretical findings and demonstrate that we control the false positive rate (type I error) near the nominal level and have high power. By duality between hypotheses testing and confidence intervals, the framework proposed can be used to obtain valid confidence intervals for various functionals of the model parameters. For linear functionals, the length of confidence intervals is shown to be minimax rate optimal.<\/jats:p>","DOI":"10.1111\/rssb.12373","type":"journal-article","created":{"date-parts":[[2020,5,21]],"date-time":"2020-05-21T10:31:35Z","timestamp":1590057095000},"page":"685-718","source":"Crossref","is-referenced-by-count":19,"title":["A Flexible Framework for Hypothesis Testing in High Dimensions"],"prefix":"10.1093","volume":"82","author":[{"given":"Adel","family":"Javanmard","sequence":"first","affiliation":[{"name":"University of Southern California , Los Angeles , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason D.","family":"Lee","sequence":"additional","affiliation":[{"name":"Princeton University \u00a0 USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,5,21]]},"reference":[{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1214\/009053606000000074","article-title":"Adapting to unknown sparsity by controlling the false discovery rate","volume":"34","author":"Abramovich","year":"2006","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"2055","DOI":"10.1214\/15-AOS1337","article-title":"Controlling the false discovery rate via knockoffs","volume":"43","author":"Barber","year":"2015","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"3422","DOI":"10.1214\/17-AOS1663","article-title":"Rocket: robust confidence intervals via Kendall\u2019s tau for transelliptical graphical models","volume":"46","author":"Barber","year":"2018","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","first-page":"944","volume-title":"Advances in Neural Information Processing Systems","author":"Bayati","year":"2013"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"2369","DOI":"10.3982\/ECTA9626","article-title":"Sparse models and methods for optimal instruments with an application to eminent domain","volume":"80","author":"Belloni","year":"2012","journal-title":"Econometrica"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"233","DOI":"10.3982\/ECTA12723","article-title":"Program evaluation and causal inference with high-dimensional data","volume":"85","author":"Belloni","year":"2017","journal-title":"Econometrica"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.1908409","article-title":"Lasso methods for Gaussian instrumental variables models","author":"Belloni","year":"2011"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1093\/restud\/rdt044","article-title":"Inference on treatment effects after selection among high-dimensional controls","volume":"81","author":"Belloni","year":"2014","journal-title":"Rev. Econ. Stud."},{"key":"2023022408364359700_","first-page":"245","volume-title":"Inference for High-dimensional Sparse Econometric Models","author":"Belloni","year":"2013"},{"key":"2023022408364359700_","first-page":"1705","article-title":"Simultaneous analysis of Lasso and Dantzig selector","volume":"37","author":"Bickel","year":"2009","journal-title":"Am. J. Math."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1214\/15-AOAS842","article-title":"Slope\u2014adaptive variable selection via convex optimization","volume":"9","author":"Bogdan","year":"2015","journal-title":"Ann. Appl. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-20192-9","volume-title":"Statistics for High-dimensional Data","author":"B\u00fchlmann","year":"2011"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1146\/annurev-statistics-022513-115545","article-title":"High-dimensional statistics with a view toward applications in biology","volume":"1","author":"B\u00fchlmann","year":"2014","journal-title":"A. Rev. Statist. Appl."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1214\/07-EJS008","article-title":"Sparsity oracle inequalities for the lasso","volume":"1","author":"Bunea","year":"2007","journal-title":"Electron. J. Statist."},{"key":"2023022408364359700_","article-title":"Individualized treatment selection: an optimal hypothesis testing approach in high-dimensional models","author":"Cai","year":"2019"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1080\/02331888.2016.1265969","article-title":"Confidence intervals for high-dimensional linear regression: minimax rates and adaptivity","volume":"45","author":"Cai","year":"2017","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1111\/rssb.12265","article-title":"Panning for gold: \u2018model-X\u2019 knockoffs for high dimensional controlled variable selection","volume":"80","author":"Cand\u00e8s","year":"2018","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364359700_","first-page":"2313","article-title":"The Dantzig selector: statistical estimation when p is much larger than n","volume":"35","author":"Cand\u00e9s","year":"2007","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1080\/01621459.2015.1010039","article-title":"Asymptotically normal and efficient estimation of covariate-adjusted Gaussian graphical model","volume":"111","author":"Chen","year":"2016","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408364359700_","volume-title":"In Proc. Wavelet Applications in Signal and Image Processing III, San Diego","author":"Chen","year":"1995"},{"key":"2023022408364359700_","volume-title":"Online debiasing for adaptively collected high-dimensional data","author":"Deshpande","year":"2019"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1093\/biomet\/ast065","article-title":"Variance estimation in high-dimensional linear models","volume":"101","author":"Dicker","year":"2014","journal-title":"Biometrika"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1111\/j.1467-9868.2011.01005.x","article-title":"Variance estimation using refitted cross-validation in ultrahigh dimensional regression","volume":"74","author":"Fan","year":"2012","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1111\/j.1467-9868.2008.00674.x","article-title":"Sure independence screening for ultrahigh dimensional feature space (with discussion)","volume":"70","author":"Fan","year":"2008","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364359700_","volume-title":"Optimal inference after model selection","author":"Fithian","year":"2014"},{"key":"2023022408364359700_","first-page":"1","article-title":"Regularization paths for generalized linear models via coordinate descent","volume":"33","author":"Friedman","year":"2010","journal-title":"J. Statist. Softwr."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"971","DOI":"10.3150\/bj\/1106314846","article-title":"Persistence in high-dimensional predictor selection and the virtue of over-parametrization","volume":"10","author":"Greenshtein","year":"2004","journal-title":"Bernoulli"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1080\/01621459.2017.1407774","article-title":"Optimal estimation of genetic relatedness in high-dimensional linear models","volume":"114","author":"Guo","year":"2019","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408364359700_","volume-title":"Selective sampling after solving a convex problem","author":"Harris","year":"2016"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1111\/rssb.12203","article-title":"Eigenprism: inference for high dimensional signal-to-noise ratios","volume":"79","author":"Janson","year":"2017","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"960","DOI":"10.1214\/16-EJS1129","article-title":"Familywise error rate control via knockoffs","volume":"10","author":"Janson","year":"2016","journal-title":"Electron. J. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1214\/19-EJS1554","article-title":"False discovery rate control via debiased lasso","volume":"13","author":"Javanmard","year":"2019","journal-title":"Electron. J. Statist."},{"key":"2023022408364359700_","first-page":"1427","volume-title":"Proc. 51st A. Allerton Conf., Monticello, June","author":"Javanmard","year":"2013"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"6522","DOI":"10.1109\/TIT.2014.2343629","article-title":"Hypothesis testing in high-dimensional regression under the Gaussian random design model: asymptotic theory","volume":"60","author":"Javanmard","year":"2014","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023022408364359700_","first-page":"2869","article-title":"Confidence intervals and hypothesis testing for high-dimensional regression","volume":"15","author":"Javanmard","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"2593","DOI":"10.1214\/17-AOS1630","article-title":"Debiasing the lasso: optimal sample size for gaussian designs","volume":"46","author":"Javanmard","year":"2018","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1093\/biomet\/50.3-4.403","article-title":"A multivariate analogue of the one-sided test","volume":"50","author":"Kudo","year":"1963","journal-title":"Biometrika"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1214\/15-AOS1371","article-title":"Exact post-selection inference, with application to the lasso","volume":"44","author":"Lee","year":"2016","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","first-page":"136","volume-title":"Advances in Neural Information Processing Systems","author":"Lee","year":"2014"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1214\/009053606000000281","article-title":"High-dimensional graphs and variable selection with the lasso","volume":"34","author":"Meinshausen","year":"2006","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"2852","DOI":"10.1214\/13-AOS1170","article-title":"Confidence sets in sparse regression","volume":"41","author":"Nickl","year":"2013","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","volume-title":"Proc. 47th A. Allerton Conf., Monticello, Sept.","author":"Raskutti","year":"2009"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"6976","DOI":"10.1109\/TIT.2011.2165799","article-title":"Minimax rates of estimation for high-dimensional linear regression over lq-balls","volume":"57","author":"Raskutti","year":"2011","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"2809","DOI":"10.1080\/03610928608829280","article-title":"Hypothesis tests for normal means constrained by linear inequalities","volume":"15","author":"Raubertas","year":"1986","journal-title":"Communs Statist. Theory Meth."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1214\/14-AOS1286","article-title":"Asymptotic normality and optimalities in estimation of large Gaussian graphical models","volume":"43","author":"Ren","year":"2015","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1214\/aos\/1176344195","article-title":"Likelihood ratio tests for order restrictions in exponential families","volume":"6","author":"Robertson","year":"1978","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/TIT.2013.2243201","article-title":"Reconstruction from anisotropic random measurements","volume":"59","author":"Rudelson","year":"2013","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.1214\/15-AOS1397","article-title":"Slope is adaptive to unknown sparsity and asymptotically minimax","volume":"44","author":"Su","year":"2016","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1093\/biomet\/ass043","article-title":"Scaled sparse linear regression","volume":"99","author":"Sun","year":"2012","journal-title":"Biometrika"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1214\/17-AOS1564","article-title":"Selective inference with a randomized response","volume":"46","author":"Tian","year":"2018","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection with the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1080\/01621459.2015.1108848","article-title":"Exact post-selection inference for sequential regression procedures","volume":"111","author":"Tibshirani","year":"2016","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1214\/14-AOS1221","article-title":"On asymptotically optimal confidence regions and tests for high-dimensional models","volume":"42","author":"Van de Geer","year":"2014","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"3683","DOI":"10.3150\/17-BEJ975","article-title":"Adaptive estimation of high-dimensional signal-to-noise ratios","volume":"24","author":"Verzelen","year":"2018","journal-title":"Bernoulli"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1038\/nrg2322","article-title":"Heritability in the genomics era\u2014concepts and misconceptions","volume":"9","author":"Visscher","year":"2008","journal-title":"Nat. Rev. Genet."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"2183","DOI":"10.1109\/TIT.2009.2016018","article-title":"Sharp thresholds for high-dimensional and noisy sparsity recovery using \u21131-constrained quadratic programming","volume":"55","author":"Wainwright","year":"2009","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023022408364359700_","first-page":"751","article-title":"Inference for high-dimensional exponential family graphical models","author":"Wang","year":"2016","journal-title":"Proc. Int. Conf. Artificial Intelligence and Statistics"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","DOI":"10.1016\/j.jmva.2019.06.004","article-title":"Rate optimal estimation and confidence intervals for high-dimensional regression with missing covariates","volume":"174","author":"Wang","year":"2019","journal-title":"J. Multiv. Anal."},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1214\/18-AOS1701","article-title":"The geometry of hypothesis testing over convex cones: generalized likelihood ratio tests and minimax radii","volume":"47","author":"Wei","year":"2019","journal-title":"Ann. Statist."},{"key":"2023022408364359700_","first-page":"3519","article-title":"Rate minimaxity of the lasso and Dantzig selector for the \u2113q loss in \u2113r balls","volume":"11","author":"Ye","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"2023022408364359700_","first-page":"2541","article-title":"On model selection consistency of Lasso","volume":"7","author":"Zhao","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"2023022408364359700_","volume-title":"A general framework for robust testing and confidence regions in high-dimensional quantile regression","author":"Zhao","year":"2014"},{"key":"2023022408364359700_","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/rssb.12026","article-title":"Confidence intervals for low dimensional parameters in high dimensional linear models","volume":"76","author":"Zhang","year":"2014","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364359700_","volume-title":"A projection pursuit framework for testing general high-dimensional hypothesis","author":"Zhu","year":"2017"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12373","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/3\/685\/49323786\/jrsssb_82_3_685.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/3\/685\/49323786\/jrsssb_82_3_685.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T04:41:14Z","timestamp":1722919274000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/82\/3\/685\/7056092"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,21]]},"references-count":65,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,5,21]]},"published-print":{"date-parts":[[2020,7,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12373","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,7]]},"published":{"date-parts":[[2020,5,21]]}}}