{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T20:06:44Z","timestamp":1792786004455,"version":"4.5.0"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T00:00:00Z","timestamp":1675209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"UK Engineering and Physical Sciences Research Council","doi-asserted-by":"crossref","award":["EP\/T01864X\/1"],"award-info":[{"award-number":["EP\/T01864X\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natural Sciences and Engineering Council of Canada"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,2,27]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter, the remaining coefficients being nuisance parameters, and seeks an optimal interest-respecting transformation, inducing sparsity on the relevant blocks of the notional Fisher information matrix. The induced sparsity is exploited through a marginal least-squares analysis for each variable, as in a factorial experiment, thereby avoiding penalization. One parameterization of the problem is found to be particularly convenient, both computationally and mathematically. In particular, it permits an analytic solution to the optimal transformation problem, facilitating theoretical analysis and comparison to other work. In contrast to regularized regression, such as the lasso and its extensions, neither adjustment for selection nor rescaling of the explanatory variables is needed, ensuring the physical interpretation of regression coefficients is retained. Recommended usage is within a broader set of inferential statements, so as to reflect uncertainty over the model as well as over the parameters. The considerations involved in extending the work to other regression models are briefly discussed.<\/jats:p>","DOI":"10.1093\/jrsssb\/qkad001","type":"journal-article","created":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T16:28:46Z","timestamp":1672849726000},"page":"149-175","source":"Crossref","is-referenced-by-count":7,"title":["On inference in high-dimensional regression"],"prefix":"10.1093","volume":"85","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9387-4628","authenticated-orcid":false,"given":"Heather S","family":"Battey","sequence":"first","affiliation":[{"name":"Department of Mathematics, Imperial College London , 180 Queen\u2019s Gate, London SW7 2AZ , UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nancy","family":"Reid","sequence":"additional","affiliation":[{"name":"Department of Statistical Sciences, University of Toronto , 700 University Ave, 9th Floor, Toronto, ON M5G 1Z5 , Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,2,1]]},"reference":[{"issue":"2215","key":"2023042719124254100_qkad001-B1","first-page":"20170631","article-title":"Large numbers of explanatory variables: A probabilistic assessment","volume":"474","author":"Battey","year":"2018","journal-title":"Proc. R. Soc. Lond. A."},{"issue":"2","key":"2023042719124254100_qkad001-B2","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1214\/12-AOS1077","article-title":"Valid post-selection inference","volume":"41","author":"Berk","year":"2013","journal-title":"The Annals of Statistics"},{"key":"2023042719124254100_qkad001-B3","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511804441","volume-title":"Convex optimization","author":"Boyd","year":"2004"},{"issue":"1","key":"2023042719124254100_qkad001-B4","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1146\/annurev-statistics-022513-115545","article-title":"High-dimensional statistics with a view toward applications in biology","volume":"1","author":"B\u00fchlmann","year":"2014","journal-title":"Annual Review of Statistics and Its Application"},{"issue":"2","key":"2023042719124254100_qkad001-B5","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1214\/aoms\/1177706618","article-title":"Some problems connected with statistical inference","volume":"29","author":"Cox","year":"1958","journal-title":"The Annals of Mathematical Statistics"},{"issue":"2","key":"2023042719124254100_qkad001-B6","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1093\/biomet\/62.2.441","article-title":"A note on data-splitting for the evaluation of significance levels","volume":"62","author":"Cox","year":"1975","journal-title":"Biometrika"},{"issue":"32","key":"2023042719124254100_qkad001-B7","doi-asserted-by":"crossref","first-page":"8592","DOI":"10.1073\/pnas.1703764114","article-title":"Large numbers of explanatory variables, a semi-descriptive analysis","volume":"114","author":"Cox","year":"2017","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"2023042719124254100_qkad001-B8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1987.tb01422.x","article-title":"Parameter orthogonality and approximate conditional inference (with discussion)","volume":"49","author":"Cox","year":"1987","journal-title":"Journal of the Royal Statistical Society. Series B"},{"key":"2023042719124254100_qkad001-B9","volume-title":"Asymptotic methods in analysis","author":"de Bruijn","year":"1981"},{"issue":"1","key":"2023042719124254100_qkad001-B10","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1111\/j.1467-9868.2011.01005.x","article-title":"Variance estimation using refitted cross-validation in ultrahigh dimensional regression","volume":"74","author":"Fan","year":"2012","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"4","key":"2023042719124254100_qkad001-B11","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1017\/S0305004100016297","article-title":"Inverse probability","volume":"26","author":"Fisher","year":"1930","journal-title":"Mathematical Proceedings of the Cambridge Philosophical Society"},{"issue":"1","key":"2023042719124254100_qkad001-B12","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1080\/00401706.1970.10488634","article-title":"Ridge regression: Biased estimation for nonorthogonal problems","volume":"12","author":"Hoerl","year":"1970","journal-title":"Technometrics"},{"key":"2023042719124254100_qkad001-B13","first-page":"2869","article-title":"Confidence intervals and hypothesis testing for high-dimensional regression","volume":"15","author":"Javanmard","year":"2014","journal-title":"Journal of Machine Learning Research"},{"key":"2023042719124254100_qkad001-B14","volume-title":"Foundations of modern probability","author":"Kallenberg","year":"1997"},{"issue":"3","key":"2023042719124254100_qkad001-B15","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1214\/15-AOS1371","article-title":"Exact post-selection inference, with application to the lasso","volume":"44","author":"Lee","year":"2016","journal-title":"The Annals of Statistics"},{"issue":"2","key":"2023042719124254100_qkad001-B16","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1214\/14-STS507","article-title":"On various confidence intervals post-model-selection","volume":"30","author":"Leeb","year":"2015","journal-title":"Statistical Science"},{"key":"2023042719124254100_qkad001-B17","author":"Leiner","year":"2021"},{"key":"2023042719124254100_qkad001-B18","author":"Lewis","year":"2022"},{"key":"2023042719124254100_qkad001-B19","author":"Li","year":"2021"},{"issue":"2","key":"2023042719124254100_qkad001-B20","first-page":"413","article-title":"A significance test for the lasso","volume":"42","author":"Lockhart","year":"2014","journal-title":"The Annals of Statistics"},{"issue":"1","key":"2023042719124254100_qkad001-B21","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1214\/16-AOS1448","article-title":"A general theory of hypothesis tests and confidence regions for sparse high dimensional models","volume":"45","author":"Ning","year":"2017","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2023042719124254100_qkad001-B22","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1017\/S0305004100030401","article-title":"A generalized inverse for matrices","volume":"51","author":"Penrose","year":"1955","journal-title":"Mathematical Proceedings of the Cambridge Philosophical Society"},{"key":"2023042719124254100_qkad001-B23","volume-title":"Limit theorems of probability theory","author":"Petrov","year":"1995"},{"key":"2023042719124254100_qkad001-B24","author":"Rasines","year":"2021"},{"issue":"2","key":"2023042719124254100_qkad001-B25","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1214\/17-AOS1564","article-title":"Selective inference with a randomized response","volume":"46","author":"Tian","year":"2018","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2023042719124254100_qkad001-B26","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1070\/RM2010v065n03ABEH004688","article-title":"An improvement of upper estimates of the constants in the Lyapunov theorem","volume":"65","author":"Tyurin","year":"2010","journal-title":"Russian Mathematical Surveys"},{"issue":"3","key":"2023042719124254100_qkad001-B27","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1214\/14-AOS1221","article-title":"On asymptotically optimal confidence regions and tests for high-dimensional models","volume":"42","author":"van de Geer","year":"2014","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2023042719124254100_qkad001-B28","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1017\/S0021859600022760","article-title":"A new method of arranging variety trials involving a large number of varieties","volume":"26","author":"Yates","year":"1936","journal-title":"The Journal of Agricultural Science"},{"issue":"1","key":"2023042719124254100_qkad001-B29","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/rssb.12026","article-title":"Confidence intervals for low dimensional parameters in high dimensional linear models","volume":"76","author":"Zhang","year":"2014","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"4","key":"2023042719124254100_qkad001-B30","doi-asserted-by":"crossref","first-page":"562","DOI":"10.1214\/20-STS815","article-title":"In defence of the indefensible: A very na\u00efve approach to high-dimensional inference","volume":"36","author":"Zhao","year":"2021","journal-title":"Statistical Science"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/85\/1\/149\/50115376\/qkad001.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/85\/1\/149\/50115376\/qkad001.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,11]],"date-time":"2024-10-11T13:12:48Z","timestamp":1728652368000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/85\/1\/149\/7018000"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,1]]},"references-count":30,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,2,1]]},"published-print":{"date-parts":[[2023,2,27]]}},"URL":"https:\/\/doi.org\/10.1093\/jrsssb\/qkad001","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,2,1]]},"published":{"date-parts":[[2023,2,1]]}}}