{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T06:51:18Z","timestamp":1791442278242,"version":"4.3.3"},"reference-count":51,"publisher":"Cambridge University Press (CUP)","issue":"6","license":[{"start":{"date-parts":[[2021,6,4]],"date-time":"2021-06-04T00:00:00Z","timestamp":1622764800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Econom. Theory"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:p>For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional estimation techniques can be seen as variable selection that leads to a smaller set of variables (a \u201csubmodel\u201d) where classical linear regression applies. We analyze linear regression estimators resulting from model selection by proving estimation error and linear representation bounds uniformly over sets of submodels. Based on deterministic inequalities, our results provide \u201cgood\u201d rates when applied to both independent and dependent data. These results are useful in meaningfully interpreting the linear regression estimator obtained after exploring and reducing the variables and also in justifying post-model-selection inference. All results are derived under no model assumptions and are nonasymptotic in nature.\n<\/jats:p>","DOI":"10.1017\/s0266466621000219","type":"journal-article","created":{"date-parts":[[2021,6,4]],"date-time":"2021-06-04T09:03:52Z","timestamp":1622797432000},"page":"1202-1248","source":"Crossref","is-referenced-by-count":3,"title":["UNIFORM-IN-SUBMODEL BOUNDS FOR LINEAR REGRESSION IN A MODEL-FREE FRAMEWORK"],"prefix":"10.1017","volume":"39","author":[{"given":"Arun K.","family":"Kuchibhotla","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lawrence D.","family":"Brown","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Buja","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward I.","family":"George","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linda","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"56","published-online":{"date-parts":[[2021,6,4]]},"reference":[{"key":"S0266466621000219_r18","first-page":"2953","article-title":"Valid post-selection inference in model-free linear regression","volume":"48","author":"Kuchibhotla","year":"2019","journal-title":"Annals of Statistics"},{"key":"S0266466621000219_r28","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOS1018"},{"key":"S0266466621000219_r40","doi-asserted-by":"publisher","DOI":"10.1007\/BF00533707"},{"key":"S0266466621000219_r38","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316481"},{"key":"S0266466621000219_r35","unstructured":"Rinaldo, A. , Wasserman, L. , G\u2019Sell, M. , Lei, J. , & Tibshirani, R. (2019) Bootstrapping and sample splitting for high-dimensional, assumption-free inference. Annals of Statistics 47(6), 3438\u20133469."},{"key":"S0266466621000219_r41","doi-asserted-by":"publisher","DOI":"10.1007\/s10959-010-0338-z"},{"key":"S0266466621000219_r43","first-page":"2855","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Wei","year":"2017"},{"key":"S0266466621000219_r44","doi-asserted-by":"publisher","DOI":"10.2307\/1912934"},{"key":"S0266466621000219_r46","volume-title":"Asymptotic Theory for Econometricians","author":"White","year":"2001"},{"key":"S0266466621000219_r29","doi-asserted-by":"publisher","DOI":"10.3150\/14-BEJ645"},{"key":"S0266466621000219_r48","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-14104-1_7"},{"key":"S0266466621000219_r50","doi-asserted-by":"publisher","DOI":"10.1214\/16-AOS1512"},{"key":"S0266466621000219_r12","first-page":"774","volume-title":"Proceedings of the 30th International Conference on Machine Learning","volume":"28","author":"Chen","year":"2013"},{"key":"S0266466621000219_r24","doi-asserted-by":"publisher","DOI":"10.1017\/S0266466606060038"},{"key":"S0266466621000219_r47","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0506715102"},{"key":"S0266466621000219_r34","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2011.2165799"},{"key":"S0266466621000219_r42","doi-asserted-by":"publisher","DOI":"10.1017\/9781108231596"},{"key":"S0266466621000219_r4","first-page":"440","article-title":"Uniformly valid confidence intervals post-model-selection","volume":"48","author":"Bachoc","year":"2019b","journal-title":"Annals of Statistics"},{"key":"S0266466621000219_r15","unstructured":"Giessing, A. (2018) On high-dimensional misspecified quantile regression. PhD thesis, University of Michigan."},{"key":"S0266466621000219_r13","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0537-1"},{"key":"S0266466621000219_r36","doi-asserted-by":"publisher","DOI":"10.1007\/s10959-008-0155-9"},{"key":"S0266466621000219_r9","doi-asserted-by":"publisher","DOI":"10.1214\/11-AIHP454"},{"key":"S0266466621000219_r45","doi-asserted-by":"publisher","DOI":"10.2307\/2526245"},{"key":"S0266466621000219_r49","doi-asserted-by":"publisher","DOI":"10.1214\/16-EJS1108"},{"key":"S0266466621000219_r25","doi-asserted-by":"publisher","DOI":"10.1017\/S0266466608080158"},{"key":"S0266466621000219_r23","doi-asserted-by":"publisher","DOI":"10.1214\/009053606000000821"},{"key":"S0266466621000219_r3","doi-asserted-by":"publisher","DOI":"10.1214\/18-AOS1721"},{"key":"S0266466621000219_r32","doi-asserted-by":"crossref","unstructured":"Pollard, D. (1990). Empirical Processes: Theory and Applications. NSF-CBMS Regional Conference Series in Probability and Statistics, vol. 2. Institute of Mathematical Statistics and American Statistical Association.","DOI":"10.1214\/cbms\/1462061091"},{"key":"S0266466621000219_r37","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-7152(99)00146-7"},{"key":"S0266466621000219_r17","unstructured":"Kuchibhotla, A.K. (2018). Deterministic inequalities for smooth M-estimators. Preprint, arXiv:1809.05172."},{"key":"S0266466621000219_r21","doi-asserted-by":"publisher","DOI":"10.3150\/20-BEJ1233"},{"key":"S0266466621000219_r51","unstructured":"Zhang, X. & Cheng, G. (2014) Bootstrapping high dimensional time series. Preprint, arXiv:1406.1037."},{"key":"S0266466621000219_r26","doi-asserted-by":"publisher","DOI":"10.1017\/S026646660999051X"},{"key":"S0266466621000219_r27","first-page":"1257","article-title":"Probability and moment inequalities under dependence","volume":"23","author":"Liu","year":"2013","journal-title":"Statistica Sinica"},{"key":"S0266466621000219_r6","unstructured":"Belloni, A. , Chernozhukov, V. , Chetverikov, D. , Hansen, C. , Kato, K. (2018) High-dimensional econometrics and regularized GMM. Technical report, Centre for Microdata Methods and Practice, Institute for Fiscal Studies."},{"key":"S0266466621000219_r1","doi-asserted-by":"publisher","DOI":"10.1214\/EJP.v13-521"},{"key":"S0266466621000219_r2","doi-asserted-by":"publisher","DOI":"10.1214\/18-EJS1490"},{"key":"S0266466621000219_r7","first-page":"523","article-title":"Models as approximations, part I: A conspiracy of random regressors and model deviations against classical inference in regression","volume":"34","author":"Buja","year":"2019","journal-title":"Statistical Science"},{"key":"S0266466621000219_r16","doi-asserted-by":"publisher","DOI":"10.1214\/17-AOS1630"},{"key":"S0266466621000219_r5","doi-asserted-by":"publisher","DOI":"10.3150\/11-BEJ410"},{"key":"S0266466621000219_r22","doi-asserted-by":"publisher","DOI":"10.1017\/S0266466605050036"},{"key":"S0266466621000219_r20","unstructured":"Kuchibhotla, A.K. & Chakrabortty, A. (2020) Moving beyond sub-Gaussianity in high-dimensional statistics: Applications in covariance estimation and linear regression. Preprint, arXiv:1804.02605."},{"key":"S0266466621000219_r10","unstructured":"Catoni, O. & Giulini, I. (2017) Dimension-free PAC-Bayesian bounds for matrices, vectors, and linear least squares regression. Preprint, arXiv:1712.02747."},{"key":"S0266466621000219_r19","unstructured":"Kuchibhotla, A.K. , Brown, L.D. , Buja, A. , George, E.I. , & Zhao, L. (2018) A model free perspective for linear regression: Uniform-in-model bounds for post selection inference. Preprint, arXiv:1802.05801v1."},{"key":"S0266466621000219_r30","doi-asserted-by":"publisher","DOI":"10.1201\/b11551"},{"key":"S0266466621000219_r31","doi-asserted-by":"publisher","DOI":"10.1002\/cpa.21442"},{"key":"S0266466621000219_r33","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-03486-6"},{"key":"S0266466621000219_r14","unstructured":"Foygel, R. & Srebro, N. (2011) Fast-rate and optimistic-rate error bounds for L1-regularized regression. Preprint, arXiv:1108.0373."},{"key":"S0266466621000219_r39","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2545-2"},{"key":"S0266466621000219_r8","doi-asserted-by":"publisher","DOI":"10.1214\/12-AOS999"},{"key":"S0266466621000219_r11","unstructured":"Chakrabortty, A. , Nandy, P. , & Li, H. (2021) Inference for individual mediation effects and interventional effects in sparse high-dimensional causal graphical models. Preprint, arXiv:1809.10652."}],"container-title":["Econometric Theory"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S0266466621000219","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T13:46:11Z","timestamp":1702561571000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S0266466621000219\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,4]]},"references-count":51,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["S0266466621000219"],"URL":"https:\/\/doi.org\/10.1017\/s0266466621000219","relation":{},"ISSN":["0266-4666","1469-4360"],"issn-type":[{"value":"0266-4666","type":"print"},{"value":"1469-4360","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,4]]}}}