{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T01:14:23Z","timestamp":1790644463317,"version":"4.1.0"},"reference-count":39,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T00:00:00Z","timestamp":1677196800000},"content-version":"vor","delay-in-days":550,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"name":"Spanish Government grants Europa Excelencia","award":["EUR2020-112096"],"award-info":[{"award-number":["EUR2020-112096"]}]},{"name":"Spanish Government grants Europa Excelencia","award":["RYC-2015-18544"],"award-info":[{"award-number":["RYC-2015-18544"]}]},{"name":"Spanish Government grants Europa Excelencia","award":["PGC2018-101643-B-I00"],"award-info":[{"award-number":["PGC2018-101643-B-I00"]}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R01 CA158113DMS-01"],"award-info":[{"award-number":["R01 CA158113DMS-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We propose the approximate Laplace approximation (ALA) to evaluate integrated likelihoods, a bottleneck in Bayesian model selection. The Laplace approximation (LA) is a popular tool that speeds up such computation and equips strong model selection properties. However, when the sample size is large or one considers many models the cost of the required optimizations becomes impractical. ALA reduces the cost to that of solving a least-squares problem for each model. Further, it enables efficient computation across models such as sharing pre-computed sufficient statistics and certain operations in matrix decompositions. We prove that in generalized (possibly non-linear) models ALA achieves a strong form of model selection consistency for a suitably-defined optimal model, at the same functional rates as exact computation. We consider fixed- and high-dimensional problems, group and hierarchical constraints, and the possibility that all models are misspecified. We also obtain ALA rates for Gaussian regression under non-local priors, an important example where the LA can be costly and does not consistently estimate the integrated likelihood. Our examples include non-linear regression, logistic, Poisson and survival models. We implement the methodology in the R package mombf.<\/jats:p>","DOI":"10.1111\/rssb.12466","type":"journal-article","created":{"date-parts":[[2021,8,23]],"date-time":"2021-08-23T13:23:52Z","timestamp":1629725032000},"page":"853-879","source":"Crossref","is-referenced-by-count":20,"title":["Approximate Laplace Approximations for Scalable Model Selection"],"prefix":"10.1093","volume":"83","author":[{"given":"David","family":"Rossell","sequence":"first","affiliation":[{"name":"Universitat Pompeu Fabra , Barcelona , Spain"},{"name":"Data Science Center, Barcelona Graduate School of Economics , Barcelona , Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oriol","family":"Abril","sequence":"additional","affiliation":[{"name":"Universitat Pompeu Fabra , Barcelona , Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anirban","family":"Bhattacharya","sequence":"additional","affiliation":[{"name":"Statistics, Texas A&M Univesrsity , Texas , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,8,23]]},"reference":[{"key":"2023022408372684300_","volume-title":"Adaptive regression and model selection in data mining problems","author":"Bakin","year":"1999"},{"issue":"3","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1214\/009053604000000238","article-title":"Optimal predictive model selection","volume":"32","author":"Barbieri","year":"2004","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"1111","DOI":"10.1214\/13-AOS1096","article-title":"A lasso for hierarchical interactions","volume":"41","author":"Bien","year":"2013","journal-title":"Annals of Statistics"},{"key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s11222-013-9424-2","article-title":"Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictors","volume":"25","author":"Breheny","year":"2015","journal-title":"Statistics and Computing"},{"issue":"1","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1214\/12-BA703","article-title":"Scalable variational inference for Bayesian variable selection in regression, and its accuracy in genetic association studies","volume":"7","author":"Carbonetto","year":"2012","journal-title":"Bayesian Analysis"},{"issue":"5","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"1986","DOI":"10.1214\/15-AOS1334","article-title":"Bayesian linear regression with sparse priors","volume":"43","author":"Castillo","year":"2015","journal-title":"The Annals of Statistics"},{"key":"2023022408372684300_","volume-title":"The trouble with Bayes factors","author":"Dawid","year":"1999"},{"key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"Journal of the American Statistical Association"},{"key":"2023022408372684300_","volume-title":"Integrated public use microdata series, current population survey: Version 7.0 [dataset]","author":"Flood","year":"2020"},{"issue":"1","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1093\/biomet\/asaa055","article-title":"In search of lost (mixing) time: adaptive Markov chain monte carlo schemes for Bayesian variable selection with very large p","volume":"108","author":"Griffin","year":"2020","journal-title":"Biometrika"},{"key":"2023022408372684300_","first-page":"1","article-title":"Asymptotics for minimisers of convex processes","volume-title":"arXiv, 1107.3806","author":"Hjort","year":"2011"},{"key":"2023022408372684300_","first-page":"1","article-title":"A variational algorithm for Bayesian variable selection","volume-title":"arXiv","author":"Huang","year":"2016"},{"issue":"4","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"1716","DOI":"10.1214\/13-AOS1123","article-title":"Uniformly most powerful Bayesian tests","volume":"41","author":"Johnson","year":"2013","journal-title":"Annals of Statistics"},{"key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1111\/j.1467-9868.2009.00730.x","article-title":"On the use of non-local prior densities for default Bayesian hypothesis tests","volume":"72","author":"Johnson","year":"2010","journal-title":"Journal of the Royal Statistical Society B"},{"issue":"498","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1080\/01621459.2012.682536","article-title":"Bayesian model selection in high-dimensional settings","volume":"24","author":"Johnson","year":"2012","journal-title":"Journal of the American Statistical Association"},{"issue":"2","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1023\/A:1007665907178","article-title":"An introduction to variational methods for graphical models","volume":"37","author":"Jordan","year":"1999","journal-title":"Machine Learning"},{"key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1016\/j.jmva.2007.01.013","article-title":"From moments of sum to moments of product","volume":"99","author":"Kan","year":"2008","journal-title":"Journal of Multivariate Analalysis"},{"key":"2023022408372684300_","first-page":"473","article-title":"The validity of posterior expansions based on Laplace's method","volume":"7","author":"Kass","year":"1990","journal-title":"Bayesian and Likelihood Methods in Statistics and Econometrics"},{"key":"2023022408372684300_","volume-title":"A family of algorithms for approximate Bayesian inference","author":"Minka","year":"2001"},{"key":"2023022408372684300_","volume-title":"Aspects of multivariate statistical theory","author":"Muirhead","year":"2009"},{"issue":"2","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"789","DOI":"10.1214\/14-AOS1207","article-title":"Bayesian variable selection with shrinking and diffusing priors","volume":"42","author":"Narisetty","year":"2014","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1177\/0962280217739522","article-title":"Variable selection for accelerated lifetime models with synthesized estimation techniques","volume":"28","author":"Rahaman-Khan","year":"2019","journal-title":"Statistical Methods in Medical Research"},{"key":"2023022408372684300_","first-page":"1","article-title":"A framework for posterior consistency in model selection","volume-title":"arXiv","author":"Rossell","year":"2018"},{"issue":"524","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"1742","DOI":"10.1080\/01621459.2017.1371025","article-title":"Tractable bayesian variable selection: Beyond normality","volume":"113","author":"Rossell","year":"2018","journal-title":"Journal of the American Statistical Association"},{"key":"2023022408372684300_","first-page":"1","article-title":"Additive Bayesian variable selection under censoring and misspecification","volume-title":"arXiv","author":"Rossell","year":"2019"},{"key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1080\/01621459.2015.1130634","article-title":"Non-local priors for high-dimensional estimation","volume":"112","author":"Rossell","year":"2017","journal-title":"Journal of the American Statistical Association"},{"issue":"2","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1111\/j.1467-9868.2008.00700.x","article-title":"Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations","volume":"71","author":"Rue","year":"2009","journal-title":"Journal of the Royal Statistical Society B"},{"issue":"2","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"3986","DOI":"10.1214\/16-EJS1218","article-title":"Improved Laplace approximation for marginal likelihoods","volume":"10","author":"Ruli","year":"2016","journal-title":"Electronic Journal of Statistics"},{"issue":"2","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1007\/s11222-011-9299-z","article-title":"Sequential Monte Carlo on large binary sampling spaces","volume":"23","author":"Sch\u00e4fer","year":"2013","journal-title":"Statistics and Computing"},{"issue":"500","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1080\/01621459.2012.737742","article-title":"Spike-and-slab priors for function selection in structured additive regression models","volume":"107","author":"Scheipl","year":"2012","journal-title":"Journal of the American Statistical Association"},{"key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the dimension of a model","volume":"6","author":"Schwarz","year":"1978","journal-title":"Annals of Statistics"},{"issue":"7","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"2144","DOI":"10.1016\/j.jspi.2005.08.031","article-title":"An exploration of aspects of Bayesian multiple testing","volume":"136","author":"Scott","year":"2006","journal-title":"Journal of Statistical Planning and Inference"},{"issue":"2","key":"2023022408372684300_","first-page":"1053","article-title":"Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings","volume":"28","author":"Shin","year":"2018","journal-title":"Statistica Sinica"},{"issue":"1","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1111\/j.2517-6161.1986.tb01394.x","article-title":"Existence of maximum likelihood estimates in regression models for grouped and ungrouped data","volume":"48","author":"Silvapulle","year":"1986","journal-title":"Journal of the Royal Statistical Society B"},{"issue":"5","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v039.i05","article-title":"Regularization paths for Cox's proportional hazards model via coordinate descent","volume":"39","author":"Simon","year":"2011","journal-title":"Journal of Statistical Software"},{"key":"2023022408372684300_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511802256","volume-title":"Asymptotic statistics","author":"van der Vaart","year":"1998"},{"issue":"6","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"2497","DOI":"10.1214\/15-AOS1417","article-title":"On the computational complexity of highdimensional Bayesian variable selection","volume":"44","author":"Yang","year":"2016","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1111\/rssb.12316","article-title":"Scalable importance tempering and Bayesian variable selection","volume":"81","author":"Zanella","year":"2019","journal-title":"Journal of the Royal Statistical Society B"},{"issue":"2","key":"2023022408372684300_","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1214\/09-AOS729","article-title":"Nearly unbiased variable selection under minimax concave penalty","volume":"38","author":"Zhang","year":"2010","journal-title":"The Annals of Statistics"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12466","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12466","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/83\/4\/853\/49321208\/jrsssb_83_4_853.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/83\/4\/853\/49321208\/jrsssb_83_4_853.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,7]],"date-time":"2024-09-07T03:02:29Z","timestamp":1725678149000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/83\/4\/853\/7056067"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,23]]},"references-count":39,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,8,23]]},"published-print":{"date-parts":[[2021,9,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12466","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,9]]},"published":{"date-parts":[[2021,8,23]]}}}