{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T09:20:34Z","timestamp":1790414434751,"version":"4.1.0"},"reference-count":44,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T00:00:00Z","timestamp":1677196800000},"content-version":"vor","delay-in-days":1015,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,7,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>We propose a family of tests to assess the goodness of fit of a high dimensional generalized linear model. Our framework is flexible and may be used to construct an omnibus test or directed against testing specific non-linearities and interaction effects, or for testing the significance of groups of variables. The methodology is based on extracting left-over signal in the residuals from an initial fit of a generalized linear model. This can be achieved by predicting this signal from the residuals by using modern powerful regression or machine learning methods such as random forests or boosted trees. Under the null hypothesis that the generalized linear model is correct, no signal is left in the residuals and our test statistic has a Gaussian limiting distribution, translating to asymptotic control of type I error. Under a local alternative, we establish a guarantee on the power of the test. We illustrate the effectiveness of the methodology on simulated and real data examples by testing goodness of fit in logistic regression models. Software implementing the methodology is available in the R package GRPtests.<\/jats:p>","DOI":"10.1111\/rssb.12371","type":"journal-article","created":{"date-parts":[[2020,5,15]],"date-time":"2020-05-15T04:03:30Z","timestamp":1589515410000},"page":"773-795","source":"Crossref","is-referenced-by-count":36,"title":["Goodness-of-fit Testing in High Dimensional Generalized Linear Models"],"prefix":"10.1093","volume":"82","author":[{"given":"Jana","family":"Jankov\u00e1","sequence":"first","affiliation":[{"name":"University of Cambridge \u00a0 UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rajen D.","family":"Shah","sequence":"additional","affiliation":[{"name":"University of Cambridge \u00a0 UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"B\u00fchlmann","sequence":"additional","affiliation":[{"name":"Eidgen\u00f6ssische Technische Hochschule Z\u00fcrich \u00a0 Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard J.","family":"Samworth","sequence":"additional","affiliation":[{"name":"University of Cambridge \u00a0 UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,5,15]]},"reference":[{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1093\/restud\/rdt044","article-title":"Inference on treatment effects after selection among high-dimensional controls","volume":"81","author":"Belloni","year":"2014","journal-title":"Rev. Econ. Stud."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1093\/biomet\/asr043","article-title":"Square-root Lasso: pivotal recovery of sparse signals via conic programming","volume":"98","author":"Belloni","year":"2011","journal-title":"Biometrika"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-20192-9","volume-title":"Statistics for High-dimensional Data","author":"B\u00fchlmann","year":"2011"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1080\/02331888.2016.1265969","article-title":"Confidence intervals for high-dimensional linear regression: minimax rates and adaptivity","volume":"45","author":"Cai","year":"2017","journal-title":"Ann. Statist."},{"key":"2023022408364201900_","first-page":"785","volume-title":"Proc. 22nd Int. Conf. Knowledge Discovery and Data Mining","author":"Chen","year":"2016"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"C1","DOI":"10.1111\/ectj.12097","article-title":"Double\/debiased machine learning for treatment and structural parameters","volume":"21","author":"Chernozhukov","year":"2018","journal-title":"Econmetr. J."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"2786","DOI":"10.1214\/13-AOS1161","article-title":"Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors","volume":"41","author":"Chernozhukov","year":"2013","journal-title":"Ann. Statist."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1146\/annurev-economics-012315-015826","article-title":"Valid post-selection and post-regularization inference: an elementary, general approach","volume":"7","author":"Chernozhukov","year":"2015","journal-title":"A. Rev. Econ."},{"key":"2023022408364201900_","volume-title":"On cross-validated Lasso","author":"Chetverikov","year":"2016"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1214\/15-STS527","article-title":"High-dimensional inference: confidence intervals, p-values and R-software hdi","volume":"30","author":"Dezeure","year":"2015","journal-title":"Statist. Sci."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1007\/s11749-017-0554-2","article-title":"High-dimensional simultaneous inference with the bootstrap","volume":"26","author":"Dezeure","year":"2017","journal-title":"TEST"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1111\/j.2517-6161.1996.tb02086.x","article-title":"On assessing goodness of fit of generalized linear models to sparse data","volume":"58","author":"Farrington","year":"1996","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364201900_","volume-title":"Experiments with a new boosting algorithm","author":"Freund","year":"1996"},{"key":"2023022408364201900_","first-page":"1","article-title":"Regularization paths for generalized linear models via coordinate descent","volume":"33","author":"Friedman","year":"2010","journal-title":"J. Statist. Softwr."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1214\/14-AOS1221","article-title":"On asymptotically optimal confidence regions and tests for high-dimensional models","volume":"42","author":"van de Geer","year":"2014","journal-title":"Ann. Statist."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1093\/bioinformatics\/btg382","article-title":"A global test for groups of genes: testing association with a clinical outcome","volume":"20","author":"Goeman","year":"2004","journal-title":"Bioinformatics"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"2723","DOI":"10.1002\/sim.1200","article-title":"Goodness-of-fit processes for logistic regression: simulation results","volume":"21","author":"Hosmer","year":"2002","journal-title":"Statist. Med."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1002\/(SICI)1097-0258(19970515)16:9<965::AID-SIM509>3.0.CO;2-O","article-title":"A comparison of goodness-of-fit tests for the logistic regression model","volume":"16","author":"Hosmer","year":"1997","journal-title":"Statist. Med."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1080\/03610928008827941","article-title":"A goodness-of-fit test for the multiple logistic regression model","volume":"80","author":"Hosmer","year":"1980","journal-title":"Communs Statist."},{"key":"2023022408364201900_","article-title":"GRPtests: goodness-of-fit tests in high-dimensional GLMs","volume-title":"R Package Version 0.1.0","author":"Jankov\u00e1","year":"2019"},{"key":"2023022408364201900_","volume-title":"A flexible framework for hypothesis testing in high-dimensions","author":"Javanmard","year":"2017"},{"key":"2023022408364201900_","first-page":"2869","article-title":"Confidence intervals and hypothesis testing for high-dimensional regression","volume":"15","author":"Javanmard","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2023022408364201900_","article-title":"MKmisc: miscellaneous functions from M. Kohl","volume-title":"R Package Version 1.2.","author":"Kohl","year":"2018"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"1267","DOI":"10.2307\/2532385","article-title":"A goodness-of-fit test for binary regression models, based on smoothing methods","volume":"47","author":"Le Cessie","year":"1991","journal-title":"Biometrics"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1093\/oxfordjournals.aje.a113284","article-title":"A review of goodness of fit statistics for use in the development of logistic regression models","volume":"115","author":"Lemeshow","year":"1982","journal-title":"Am. J. Epidem."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.0006-341X.2002.00001.x","article-title":"Model-checking techniques based on cumulative residuals","volume":"58","author":"Lin","year":"2002","journal-title":"Biometrics"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-3242-6","volume-title":"Generalized Linear Models","author":"McCullagh","year":"1989"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1111\/j.1467-9868.2010.00740.x","article-title":"Stability selection (with discussion)","volume":"72","author":"Meinshausen","year":"2010","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"1671","DOI":"10.1198\/jasa.2009.tm08647","article-title":"p-values for high-dimensional regression","volume":"104","author":"Meinshausen","year":"2009","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"2299","DOI":"10.1214\/16-AOS1483","article-title":"A likelihood ratio framework for high dimensional semiparametric regression","volume":"45","author":"Ning","year":"2017","journal-title":"Ann. Statist."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1080\/01621459.1992.10476271","article-title":"Normal goodness-of-fit tests for multinomial models with large degrees of freedom","volume":"87","author":"Osius","year":"1992","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1111\/j.1467-9868.2007.00607.x","article-title":"L1-regularization path algorithm for generalized linear models","volume":"69","author":"Park","year":"2007","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/rssb.12234","article-title":"Goodness-of-fit tests for high dimensional linear models","volume":"80","author":"Shah","year":"2018","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1111\/j.1467-9868.2011.01034.x","article-title":"Variable selection with error control: another look at stability selection","volume":"75","author":"Shah","year":"2013","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1038\/nm1556","article-title":"Airway epithelial gene expression in the diagnostic evaluation of smokers with suspect lung cancer","volume":"13","author":"Spira","year":"2007","journal-title":"Nat. Med."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1080\/01621459.1991.10475059","article-title":"A lack-of-fit test for the mean function in a generalized linear model","volume":"86","author":"Su","year":"1991","journal-title":"J. Am. Statist. Ass."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1093\/biomet\/ass043","article-title":"Scaled sparse linear regression","volume":"99","author":"Sun","year":"2012","journal-title":"Biometrika"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1093\/biomet\/67.1.250","article-title":"A note on a goodness-of-fit test for the logistic regression model","volume":"67","author":"Tsiatis","year":"1980","journal-title":"Biometrika"},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"2178","DOI":"10.1214\/08-AOS646","article-title":"High dimensional variable selection","volume":"37","author":"Wasserman","year":"2009","journal-title":"Ann. Statist."},{"key":"2023022408364201900_","first-page":"1261","article-title":"Jackknife, bootstrap and other resampling methods in regression analysis","volume":"14","author":"Wu","year":"1986","journal-title":"Ann. Statist."},{"key":"2023022408364201900_","article-title":"Confidence intervals for high-dimensional Cox models","author":"Yu","year":"2020","journal-title":"Statist. Sin."},{"key":"2023022408364201900_","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/rssb.12026","article-title":"Confidence intervals for low dimensional parameters in high dimensional linear models","volume":"76","author":"Zhang","year":"2014","journal-title":"J. R. Statist. Soc."},{"key":"2023022408364201900_","article-title":"A projection pursuit framework for testing general high-dimensional hypothesis","author":"Zhu","year":"2017"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12371","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/3\/773\/49323989\/jrsssb_82_3_773.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/82\/3\/773\/49323989\/jrsssb_82_3_773.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,5]],"date-time":"2024-08-05T17:28:02Z","timestamp":1722878882000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/82\/3\/773\/7056078"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,15]]},"references-count":44,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,5,15]]},"published-print":{"date-parts":[[2020,7,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12371","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,7]]},"published":{"date-parts":[[2020,5,15]]}}}