{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T09:31:10Z","timestamp":1776936670338,"version":"3.51.4"},"reference-count":40,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2021,1,31]],"date-time":"2021-01-31T00:00:00Z","timestamp":1612051200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,2,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Model selection is crucial both to high-dimensional learning and to inference for contemporary big data applications in pinpointing the best set of covariates among a sequence of candidate interpretable models. Most existing work implicitly assumes that the models are correctly specified or have fixed dimensionality, yet both model misspecification and high dimensionality are prevalent in practice. In this paper, we exploit the framework of model selection principles under the misspecified generalized linear models presented in Lv &amp; Liu (2014), and investigate the asymptotic expansion of the posterior model probability in the setting of high-dimensional misspecified models. With a natural choice of prior probabilities that encourages interpretability and incorporates the Kullback\u2013Leibler divergence, we suggest using the high-dimensional generalized Bayesian information criterion with prior probability for large-scale model selection with misspecification. Our new information criterion characterizes the impacts of both model misspecification and high dimensionality on model selection. We further establish the consistency of covariance contrast matrix estimation and the model selection consistency of the new information criterion in ultrahigh dimensions under some mild regularity conditions. Our numerical studies demonstrate that the proposed method enjoys improved model selection consistency over its main competitors.<\/jats:p>","DOI":"10.1093\/biomet\/asab005","type":"journal-article","created":{"date-parts":[[2021,1,21]],"date-time":"2021-01-21T20:18:10Z","timestamp":1611260290000},"page":"123-136","source":"Crossref","is-referenced-by-count":7,"title":["Large-scale model selection in misspecified generalized linear models"],"prefix":"10.1093","volume":"109","author":[{"given":"Emre","family":"Demirkaya","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Feng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pallavi","family":"Basu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinchi","family":"Lv","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,1,31]]},"reference":[{"key":"2022020204422895400_B1","first-page":"267","article-title":"Information theory and an extension of the maximum likelihood principle","volume-title":"Second International Symposium on Information Theory","author":"Akaike,","year":"1973"},{"key":"2022020204422895400_B2","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"Akaike,","year":"1974","journal-title":"IEEE Trans. Auto. Contr."},{"key":"2022020204422895400_B3","doi-asserted-by":"crossref","first-page":"2055","DOI":"10.1214\/15-AOS1337","article-title":"Controlling the false discovery rate via knockoffs","volume":"43","author":"Barber,","year":"2015","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B4","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/BF02294361","article-title":"Model selection and Akaike\u2019s information criterion (AIC): The general theory and its analytical extensions","volume":"52","author":"Bozdogan,","year":"1987","journal-title":"Psychometrika"},{"key":"2022020204422895400_B5","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-20192-9","volume-title":"Statistics for High-Dimensional Data: Methods, Theory and Applications","author":"B\u00fchlmann,","year":"2011"},{"key":"2022020204422895400_B6","doi-asserted-by":"crossref","first-page":"1449","DOI":"10.1214\/15-EJS1041","article-title":"High-dimensional inference in misspecified linear models","volume":"9","author":"B\u00fchlmann,","year":"2015","journal-title":"Electron. J. Statist."},{"key":"2022020204422895400_B7","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1111\/rssb.12265","article-title":"Panning for gold: \u2018Model-X\u2019 knockoffs for high dimensional controlled variable selection","volume":"80","author":"Cand\u00e8s,","year":"2018","journal-title":"J. R. Statist. Soc. B"},{"key":"2022020204422895400_B8","doi-asserted-by":"crossref","first-page":"1986","DOI":"10.1214\/15-AOS1334","article-title":"Bayesian linear regression with sparse priors","volume":"43","author":"Castillo,","year":"2015","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B9","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1093\/biomet\/asn034","article-title":"Extended Bayesian information criteria for model selection with large model spaces","volume":"95","author":"Chen,","year":"2008","journal-title":"Biometrika"},{"key":"2022020204422895400_B10","doi-asserted-by":"crossref","first-page":"197","DOI":"10.4310\/SII.2011.v4.n2.a14","article-title":"Subset ARMA selection via the adaptive lasso","volume":"4","author":"Chen,","year":"2011","journal-title":"Statist. Interface"},{"key":"2022020204422895400_B11","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1111\/j.1467-9868.2010.00753.x","article-title":"Maximum likelihood estimation of a multi-dimensional log-concave density (with Discussion)","volume":"72","author":"Cule,","year":"2010","journal-title":"J. R. Statist. Soc. B"},{"key":"2022020204422895400_B12","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.ecosta.2017.04.003","article-title":"Model comparison for generalized linear models with dependent observations","volume":"5","author":"Eguchi,","year":"2017","journal-title":"Economet. Statist."},{"key":"2022020204422895400_B13","doi-asserted-by":"crossref","first-page":"2605","DOI":"10.1214\/07-AOS504","article-title":"High-dimensional classification using features annealed independence rules","volume":"36","author":"Fan,","year":"2008","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B14","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1111\/j.1467-9868.2008.00674.x","article-title":"Sure independence screening for ultrahigh dimensional feature space (with Discussion)","volume":"70","author":"Fan,","year":"2008","journal-title":"J. R. Statist. Soc. B"},{"key":"2022020204422895400_B15","first-page":"101","article-title":"A selective overview of variable selection in high dimensional feature space","volume":"20","author":"Fan,","year":"2010","journal-title":"Statist. Sinica"},{"key":"2022020204422895400_B16","doi-asserted-by":"publisher","DOI":"10.1002\/9781118445112.stat08043","article-title":"Sure independence screening","author":"Fan,","year":"2018","journal-title":"Wiley StatsRef"},{"key":"2022020204422895400_B17","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1080\/01621459.2018.1546589","article-title":"RANK: Large-scale inference with graphical nonlinear knockoffs","volume":"115","author":"Fan,","year":"2020","journal-title":"J. Am. Statist. Assoc."},{"key":"2022020204422895400_B18","first-page":"1","article-title":"Nonuniformity of p-values can occur early in diverging dimensions","volume":"20","author":"Fan,","year":"2019","journal-title":"J. Mach. Learn. Res."},{"key":"2022020204422895400_B19","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1111\/rssb.12001","article-title":"Tuning parameter selection in high dimensional penalized likelihood","volume":"75","author":"Fan,","year":"2013","journal-title":"J. R. Statist. Soc. B"},{"key":"2022020204422895400_B20","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1093\/biomet\/asz077","article-title":"On the marginal likelihood and cross-validation","volume":"107","author":"Fong,","year":"2020","journal-title":"Biometrika"},{"key":"2022020204422895400_B21","doi-asserted-by":"crossref","first-page":"1947","DOI":"10.1214\/aos\/1176325766","article-title":"The risk inflation criterion for multiple regression","volume":"22","author":"Foster,","year":"1994","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B22","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1080\/01621459.2000.10474336","article-title":"The variable selection problem","volume":"95","author":"George,","year":"2000","journal-title":"J. Am. Statist. Assoc."},{"key":"2022020204422895400_B23","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1007\/BF01203164","article-title":"Akaike\u2019s information criterion and Kullback-Leibler loss for histogram density estimation","volume":"85","author":"Hall,","year":"1990","journal-title":"Prob. Theory Rel. Fields"},{"key":"2022020204422895400_B24","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1214\/18-AOS1706","article-title":"On model selection from a finite family of possibly misspecified time series models","volume":"47","author":"Hsu,","year":"2019","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B25","doi-asserted-by":"crossref","first-page":"1238","DOI":"10.1214\/009053606000001550","article-title":"Accumulated prediction errors, information criteria and optimal forecasting for autoregressive time series","volume":"35","author":"Ing,","year":"2007","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B26","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1093\/biomet\/83.4.875","article-title":"Generalised information criteria in model selection","volume":"83","author":"Konishi,","year":"1996","journal-title":"Biometrika"},{"key":"2022020204422895400_B27","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kullback,","year":"1951","journal-title":"Ann. Math. Statist."},{"key":"2022020204422895400_B28","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198522195.001.0001","volume-title":"Graphical Models","author":"Lauritzen,","year":"1996"},{"key":"2022020204422895400_B29","doi-asserted-by":"crossref","first-page":"2074","DOI":"10.1214\/11-AOS899","article-title":"Parametric or nonparametric? A parametricness index for model selection","volume":"39","author":"Liu,","year":"2011","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B30","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1111\/rssb.12023","article-title":"Model selection principles in misspecified models","volume":"76","author":"Lv,","year":"2014","journal-title":"J. R. Statist. Soc. B"},{"key":"2022020204422895400_B31","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-3242-6","volume-title":"Generalized Linear Models","author":"McCullagh,","year":"1989"},{"key":"2022020204422895400_B32","doi-asserted-by":"crossref","first-page":"2537","DOI":"10.1214\/16-EJS1179","article-title":"AIC for the lasso in generalized linear models","volume":"10","author":"Ninomiya,","year":"2016","journal-title":"Electron. J. Statist."},{"key":"2022020204422895400_B33","volume-title":"Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference","author":"Pearl,","year":"2014"},{"key":"2022020204422895400_B34","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1080\/10485252.2013.767338","article-title":"The connection between cross-validation and Akaike information criterion in a semiparametric family","volume":"25","author":"Peng,","year":"2013","journal-title":"J. Nonparam. Statist."},{"key":"2022020204422895400_B35","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the dimension of a model","volume":"6","author":"Schwarz,","year":"1978","journal-title":"Ann. Statist."},{"key":"2022020204422895400_B36","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/rssb.12234","article-title":"Goodness-of-fit tests for high dimensional linear models","volume":"80","author":"Shah,","year":"2018","journal-title":"J. R. Statist. Soc. B"},{"key":"2022020204422895400_B37","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1111\/j.2517-6161.1977.tb01603.x","article-title":"An asymptotic equivalence of choice of model by cross-validation and Akaike\u2019s criterion","volume":"39","author":"Stone,","year":"1977","journal-title":"J. R. Statist. Soc. B"},{"key":"2022020204422895400_B38","first-page":"47","article-title":"Weak consistency of modified versions of Bayesian information criterion in a sparse linear regression","volume":"32","author":"Szulc,","year":"2012","journal-title":"Prob. Math. Statist."},{"key":"2022020204422895400_B39","first-page":"12","article-title":"The distribution of information statistics and the criterion of goodness of fit of models","volume":"153","author":"Takeuchi,","year":"1976","journal-title":"Math. Sci."},{"key":"2022020204422895400_B40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/1912526","article-title":"Maximum likelihood estimation of misspecified models","volume":"50","author":"White,","year":"1982","journal-title":"Econometrica"}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/biomet\/advance-article-pdf\/doi\/10.1093\/biomet\/asab005\/40327482\/asab005.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/109\/1\/123\/42362020\/asab005.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/biomet\/article-pdf\/109\/1\/123\/42362020\/asab005.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T20:27:14Z","timestamp":1724358434000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/109\/1\/123\/6124351"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,31]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1,31]]},"published-print":{"date-parts":[[2022,2,1]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asab005","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,3,1]]},"published":{"date-parts":[[2021,1,31]]}}}