{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T04:56:48Z","timestamp":1791521808479,"version":"4.3.4"},"reference-count":25,"publisher":"Institute of Mathematical Statistics","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Statist. Sci."],"published-print":{"date-parts":[[2019,11,1]]},"abstract":"<jats:p>We develop a model-free theory of general types of parametric regression for i.i.d. observations. The theory replaces the parameters of parametric models with statistical functionals, to be called \u201cregression functionals,\u201d defined on large nonparametric classes of joint ${x\\textrm{-}y}$ distributions, without assuming a correct model. Parametric models are reduced to heuristics to suggest plausible objective functions. An example of a regression functional is the vector of slopes of linear equations fitted by OLS to largely arbitrary ${x\\textrm{-}y}$ distributions, without assuming a linear model (see Part I). More generally, regression functionals can be defined by minimizing objective functions, solving estimating equations, or with ad hoc constructions. In this framework, it is possible to achieve the following: (1) define a notion of \u201cwell-specification\u201d for regression functionals that replaces the notion of correct specification of models, (2) propose a well-specification diagnostic for regression functionals based on reweighting distributions and data, (3) decompose sampling variability of regression functionals into two sources, one due to the conditional response distribution and another due to the regressor distribution interacting with misspecification, both of order $N^{-1\/2}$, (4) exhibit plug-in\/sandwich estimators of standard error as limit cases of ${x\\textrm{-}y}$ bootstrap estimators, and (5) provide theoretical heuristics to indicate that ${x\\textrm{-}y}$ bootstrap standard errors may generally be preferred over sandwich estimators.<\/jats:p>","DOI":"10.1214\/18-sts694","type":"journal-article","created":{"date-parts":[[2020,1,8]],"date-time":"2020-01-08T04:00:36Z","timestamp":1578456036000},"page":"545-565","source":"Crossref","is-referenced-by-count":33,"title":["Models as Approximations II: A Model-Free Theory of Parametric Regression"],"prefix":"10.1214","volume":"34","author":[{"given":"Andreas","family":"Buja","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lawrence","family":"Brown","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arun Kumar","family":"Kuchibhotla","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Berk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward","family":"George","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Linda","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"108","reference":[{"key":"17","doi-asserted-by":"publisher","unstructured":"Liang, K. Y. and Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. <i>Biometrika<\/i> <b>73<\/b> 13\u201322.","DOI":"10.1093\/biomet\/73.1.13"},{"key":"23","doi-asserted-by":"publisher","unstructured":"Tukey, J. W. (1962). The future of data analysis. <i>Ann. Math. Stat.<\/i> <b>33<\/b> 1\u201367.","DOI":"10.1214\/aoms\/1177704711"},{"key":"4","doi-asserted-by":"publisher","unstructured":"Breiman, L. (1996). Bagging predictors. <i>Mach. Learn.<\/i> <b>24<\/b> 123\u2013140.","DOI":"10.1214\/aos\/1032181158"},{"key":"14","doi-asserted-by":"publisher","unstructured":"Huber, P. J. (1964). Robust estimation of a location parameter. <i>Ann. Math. Stat.<\/i> <b>35<\/b> 73\u2013101.","DOI":"10.1214\/aoms\/1177703732"},{"key":"13","doi-asserted-by":"publisher","unstructured":"Hausman, J. A. (1978). Specification tests in econometrics. <i>Econometrica<\/i> <b>46<\/b> 1251\u20131271.","DOI":"10.2307\/1913827"},{"key":"11","doi-asserted-by":"publisher","unstructured":"Hansen, L. P. (1982). Large sample properties of generalized method of moments estimators. <i>Econometrica<\/i> <b>50<\/b> 1029\u20131054.","DOI":"10.2307\/1912775"},{"key":"7","doi-asserted-by":"crossref","unstructured":"Efron, B. and Tibshirani, R. J. (1993). <i>An Introduction to the Bootstrap. Monographs on Statistics and Applied Probability<\/i> <b>57<\/b>. CRC Press, New York.","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"12","unstructured":"Hastie, T. J. and Tibshirani, R. J. (1990). <i>Generalized Additive Models. Monographs on Statistics and Applied Probability<\/i> <b>43<\/b>. CRC Press, London."},{"key":"2","doi-asserted-by":"publisher","unstructured":"Berk, R., Brown, L., Buja, A., Zhang, K. and Zhao, L. (2013). Valid post-selection inference. <i>Ann. Statist.<\/i> <b>41<\/b> 802\u2013837.","DOI":"10.1214\/12-AOS1077"},{"key":"25","doi-asserted-by":"publisher","unstructured":"White, H. (1982). Maximum likelihood estimation of misspecified models. <i>Econometrica<\/i> <b>50<\/b> 1\u201325.","DOI":"10.2307\/1912526"},{"key":"20","doi-asserted-by":"publisher","unstructured":"Politis, D. N. and Romano, J. P. (1994). Large sample confidence regions based on subsamples under minimal assumptions. <i>Ann. Statist.<\/i> <b>22<\/b> 2031\u20132050.","DOI":"10.1214\/aos\/1176325770"},{"key":"18","doi-asserted-by":"crossref","unstructured":"Pearl, J. (2009). <i>Causality<\/i>: <i>Models<\/i>, <i>Reasoning<\/i>, <i>and Inference<\/i>, 2nd ed. Cambridge Univ. Press, Cambridge.","DOI":"10.1017\/CBO9780511803161"},{"key":"15","unstructured":"Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. In <i>Proc. Fifth Berkeley Sympos. Math. Statist. and Probability<\/i> (<i>Berkeley<\/i>, <i>Calif.<\/i>, 1965<i>\/<\/i>66), <i>Vol. I<\/i>: <i>Statistics<\/i> 221\u2013233. Univ. California Press, Berkeley, CA."},{"key":"9","doi-asserted-by":"crossref","unstructured":"Hall, P. (1992). <i>The Bootstrap and Edgeworth Expansion. Springer Series in Statistics<\/i>. Springer, New York.","DOI":"10.1007\/978-1-4612-4384-7"},{"key":"10","unstructured":"Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J. and Stahel, W. A. (1986). <i>Robust Statistics<\/i>: <i>The Approach Based on Influence Functions. Wiley Series in Probability and Mathematical Statistics<\/i>: <i>Probability and Mathematical Statistics<\/i>. Wiley, New York."},{"key":"22","doi-asserted-by":"crossref","unstructured":"Rieder, H. (1994). <i>Robust Asymptotic Statistics. Springer Series in Statistics<\/i>. Springer, New York.","DOI":"10.1007\/978-1-4684-0624-5"},{"key":"19","doi-asserted-by":"publisher","unstructured":"Peters, J., B\u00fchlmann, P. and Meinshausen, N. (2016). Causal inference by using invariant prediction: Identification and confidence intervals. <i>J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> <b>78<\/b> 947\u20131012.","DOI":"10.1111\/rssb.12167"},{"key":"24","doi-asserted-by":"publisher","unstructured":"White, H. (1980). Using least squares to approximate unknown regression functions. <i>Internat. Econom. Rev.<\/i> <b>21<\/b> 149\u2013170.","DOI":"10.2307\/2526245"},{"key":"3","unstructured":"Bickel, P. J., G\u00f6tze, F. and van Zwet, W. R. (1997). Resampling fewer than $n$ observations: Gains, losses, and remedies for losses. <i>Statist. Sinica<\/i> <b>7<\/b> 1\u201331."},{"key":"8","doi-asserted-by":"crossref","unstructured":"Gelman, A. and Park, D. K. (2009). Splitting a predictor at the upper quarter or third and the lower quarter or third. <i>Amer. Statist.<\/i> <b>63<\/b> 1\u20138.","DOI":"10.1198\/tast.2009.0001"},{"key":"1","doi-asserted-by":"crossref","unstructured":"Berk, R., Kriegler, B. and Ylvisaker, D. (2008). Counting the homeless in Los Angeles county. In <i>Probability and Statistics<\/i>: <i>Essays in Honor of David A. Freedman<\/i> (D. Nolan and S. Speed, eds.). <i>Inst. Math. Stat.<\/i> (<i>IMS<\/i>) <i>Collect.<\/i> <b>2<\/b> 127\u2013141. IMS, Beachwood, OH.","DOI":"10.1214\/193940307000000428"},{"key":"5","unstructured":"Buja, A. and Stuetzle, W. (2001,2016). Smoothing effects of bagging: Von Mises expansions of bagged statistical functionals. Available at <a href=\"arXiv:1612.02528\">arXiv:1612.02528<\/a>."},{"key":"6","doi-asserted-by":"crossref","unstructured":"Buja, A., Brown, L., Kuchibhotla, A. K., Berk, R., George, E. and Zhao, L. (2019). Supplement to \u201cModels as Approximations II: A Model-Free Theory of Parametric Regression.\u201d <a href=\"10.1214\/18-STS694SUPP\">10.1214\/18-STS694SUPP<\/a>.","DOI":"10.1214\/18-STS694"},{"key":"16","unstructured":"Kuchibhotla, A. K., Brown, L. D. and Buja, A. (2018). Model-free study of ordinary least squares linear regression. Available at <a href=\"arXiv:1809.10538\">arXiv:1809.10538<\/a>."},{"key":"21","unstructured":"R Development Core Team (2008). R: A Language and Environment for Statistical Computing. <i>R Foundation for Statistical Computing<\/i>, Vienna, Austria. Available at <a href=\"http:\/\/www.R-project.org\">http:\/\/www.R-project.org<\/a>."}],"container-title":["Statistical Science"],"original-title":[],"link":[{"URL":"https:\/\/projecteuclid.org\/download\/pdfview_1\/euclid.ss\/1578474017","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T16:25:45Z","timestamp":1791476745000},"score":1,"resource":{"primary":{"URL":"https:\/\/projecteuclid.org\/journals\/statistical-science\/volume-34\/issue-4\/Models-as-Approximations-II--A-Model-Free-Theory-of\/10.1214\/18-STS694.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,1]]},"references-count":25,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,11,1]]}},"URL":"https:\/\/doi.org\/10.1214\/18-sts694","relation":{},"ISSN":["0883-4237","2168-8745"],"issn-type":[{"value":"0883-4237","type":"print"},{"value":"2168-8745","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,1]]}}}