{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T01:32:10Z","timestamp":1770514330276,"version":"3.49.0"},"reference-count":18,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2019,5,20]],"date-time":"2019-05-20T00:00:00Z","timestamp":1558310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,9,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Consider a high-dimensional linear regression problem, where the number of covariates is larger than the number of observations and the interest is in estimating the conditional variance of the response variable given the covariates. A conditional and an unconditional framework are considered, where conditioning is with respect to the covariates, which are ancillary to the parameter of interest. In recent papers, a consistent estimator was developed in the unconditional framework when the marginal distribution of the covariates is normal with known mean and variance. In the present work, a certain Bayesian hypothesis test is formulated under the conditional framework, and it is shown that the Bayes risk is a constant. This implies that no consistent estimator exists in the conditional framework. However, when the marginal distribution of the covariates is normal, the conditional error of the above consistent estimator converges to zero, with probability converging to one. It follows that even in the conditional setting, information about the marginal distribution of an ancillary statistic may have a significant impact on statistical inference. The practical implication in the context of high-dimensional regression models is that additional observations where only the covariates are given are potentially very useful and should not be ignored. This finding is most relevant to semi-supervised learning problems where covariate information is easy to obtain.<\/jats:p>","DOI":"10.1093\/biomet\/asz015","type":"journal-article","created":{"date-parts":[[2019,3,4]],"date-time":"2019-03-04T20:11:22Z","timestamp":1551730282000},"page":"702-707","source":"Crossref","is-referenced-by-count":3,"title":["The conditionality principle in high-dimensional regression"],"prefix":"10.1093","volume":"106","author":[{"given":"D","family":"Azriel","sequence":"first","affiliation":[{"name":"Faculty of Industrial Engineering and Management, Technion - Israel Institute of Technology, Technion City, Haifa 3200003, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,5,20]]},"reference":[{"key":"2019091012234013700_B1","article-title":"Semi-supervised linear regression","author":"Azriel,","year":"2018"},{"key":"2019091012234013700_B2","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1214\/aos\/1176347602","article-title":"An ancillarity paradox which appears in multiple linear regression","volume":"18","author":"Brown,","year":"1990","journal-title":"Ann. Statist."},{"key":"2019091012234013700_B3","article-title":"Models as approximations, part I: A conspiracy of nonlinearity and random regressors in linear regression","author":"Buja,","year":"2016"},{"key":"2019091012234013700_B4","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1214\/17-AOS1594","article-title":"Efficient and adaptive linear regression in semi-supervised settings","volume":"46","author":"Chakrabortty,","year":"2018","journal-title":"Ann. Statist."},{"key":"2019091012234013700_B5","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/9780262033589.001.0001","volume-title":"Semi-Supervised Learning","author":"Chapelle,","year":"2006"},{"key":"2019091012234013700_B6","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-2887-0","volume-title":"Theoretical Statistics","author":"Cox,","year":"1974"},{"key":"2019091012234013700_B7","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1093\/biomet\/ast065","article-title":"Variance estimation in high-dimensional linear models","volume":"101","author":"Dicker,","year":"2014","journal-title":"Biometrika"},{"key":"2019091012234013700_B8","first-page":"159","article-title":"Maximum likelihood for variance estimation in high-dimensional linear models","volume":"vol. 51","author":"Dicker,","year":"2016","journal-title":"Proceedings of the 19th International Conference on Artificial Intelligence and Statistics"},{"key":"2019091012234013700_B9","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1111\/rssb.12203","article-title":"Eigenprism: Inference for high dimensional signal-to-noise ratios","volume":"79","author":"Janson,","year":"2017","journal-title":"J. R. Statist. Soc. B"},{"key":"2019091012234013700_B10","first-page":"1923","article-title":"Semi-supervised interpolation in an anticausal learning scenario","volume":"16","author":"Janzing,","year":"2015","journal-title":"J. Mach. Learn. Res."},{"key":"2019091012234013700_B11","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1214\/10-AOAS328","article-title":"Small area estimation of the homeless in Los Angeles: An application of cost-sensitive stochastic gradient boosting","volume":"4","author":"Kriegler,","year":"2010","journal-title":"Ann. Appl. Statist."},{"key":"2019091012234013700_B12","first-page":"1227","article-title":"Regression with missing X\u2019s: A review","volume":"87","author":"Little,","year":"1992","journal-title":"J. Am. Statist. Assoc."},{"key":"2019091012234013700_B13","doi-asserted-by":"crossref","first-page":"1340","DOI":"10.1080\/01621459.2000.10474344","article-title":"Conditioning, likelihood, and coherence: A review of some foundational concepts","volume":"95","author":"Robins,","year":"2000","journal-title":"J. Am. Statist. Assoc."},{"key":"2019091012234013700_B14","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1002\/(SICI)1097-0258(19970215)16:3<285::AID-SIM535>3.0.CO;2-#","article-title":"Toward a curse of dimensionality appropriate (coda) asymptotic theory for semi-parametric models","volume":"16","author":"Robins,","year":"1997","journal-title":"Statist. Med."},{"key":"2019091012234013700_B15","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1093\/biomet\/ass043","article-title":"Scaled sparse linear regression","volume":"99","author":"Sun,","year":"2012","journal-title":"Biometrika"},{"key":"2019091012234013700_B16","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani,","year":"1996","journal-title":"J. R. Statist. Soc. B"},{"key":"2019091012234013700_B17","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TBME.2009.2036000","article-title":"Accurate telemonitoring of Parkinson\u2019s disease progression by noninvasive speech tests","volume":"57","author":"Tsanas,","year":"2010","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"2019091012234013700_B18","first-page":"1239","article-title":"Semi-supervised learning","volume-title":"Academic Press Library in Signal Processing","author":"Zhou,","year":"2014"}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/biomet\/advance-article-pdf\/doi\/10.1093\/biomet\/asz015\/28694280\/asz015.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/biomet\/article-pdf\/106\/3\/702\/29133473\/asz015.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T10:43:18Z","timestamp":1721040198000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/106\/3\/702\/5491755"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,20]]},"references-count":18,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,5,20]]},"published-print":{"date-parts":[[2019,9,1]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asz015","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,9]]},"published":{"date-parts":[[2019,5,20]]}}}