{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T10:22:46Z","timestamp":1774261366761,"version":"3.50.1"},"reference-count":53,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T00:00:00Z","timestamp":1676592000000},"content-version":"vor","delay-in-days":2988,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1106494"],"award-info":[{"award-number":["DMS-1106494"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1317131"],"award-info":[{"award-number":["DMS-1317131"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,11,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>We propose a Bayesian variable selection approach for ultrahigh dimensional linear regression based on the strategy of split and merge. The approach proposed consists of two stages: split the ultrahigh dimensional data set into a number of lower dimensional subsets and select relevant variables from each of the subsets, and aggregate the variables selected from each subset and then select relevant variables from the aggregated data set. Since the approach proposed has an embarrassingly parallel structure, it can be easily implemented in a parallel architecture and applied to big data problems with millions or more of explanatory variables. Under mild conditions, we show that the approach proposed is consistent, i.e. the true explanatory variables can be correctly identified by the approach as the sample size becomes large. Extensive comparisons of the approach proposed have been made with penalized likelihood approaches, such as the lasso, elastic net, sure independence screening and iterative sure independence screening. The numerical results show that the approach proposed generally outperforms penalized likelihood approaches: the models selected by the approach tend to be more sparse and closer to the true model.<\/jats:p>","DOI":"10.1111\/rssb.12095","type":"journal-article","created":{"date-parts":[[2014,12,13]],"date-time":"2014-12-13T05:23:20Z","timestamp":1418448200000},"page":"947-972","source":"Crossref","is-referenced-by-count":49,"title":["A Split-and-Merge Bayesian Variable Selection Approach for Ultrahigh Dimensional Regression"],"prefix":"10.1093","volume":"77","author":[{"given":"Qifan","family":"Song","sequence":"first","affiliation":[{"name":"Purdue University , West Lafayette , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Faming","family":"Liang","sequence":"additional","affiliation":[{"name":"University of Florida , Gainesville , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2014,12,13]]},"reference":[{"key":"2023021801091568500_rssb12095-cit-0001","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1214\/009053604000000238","article-title":"Optimal predictive model selection","volume":"32","author":"Barbieri","year":"2004","journal-title":"Ann. Statist."},{"key":"2023021801091568500_rssb12095-cit-0002","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1214\/aoms\/1177699597","article-title":"Limiting behaviour of posterior distributions when the model is incorrect","volume":"37","author":"Berk","year":"1966","journal-title":"Ann. Math. Statist."},{"key":"2023021801091568500_rssb12095-cit-0003","doi-asserted-by":"crossref","first-page":"989","DOI":"10.3150\/bj\/1106314847","article-title":"Some thoery for Fisher's linear discriminant function, \u2018naive Bayes', and some alternatives when there are many more variable than observations","volume":"10","author":"Bickel","year":"2004","journal-title":"Bernoulli"},{"key":"2023021801091568500_rssb12095-cit-0004","doi-asserted-by":"crossref","first-page":"1610","DOI":"10.1080\/01621459.2012.716344","article-title":"Consistent high-dimensional Bayesian variable selection via penalized credible regions","volume":"107","author":"Bondell","year":"2012","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0005","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pgen.1003657","article-title":"GUESS-ing polygenic associations with multiple phenotypes using a GPU-based evolutionary stochastic search algorithm","volume":"9","author":"Bottolo","year":"2013","journal-title":"PLOS Genet."},{"key":"2023021801091568500_rssb12095-cit-0006","first-page":"583","article-title":"Evolutionary stochastic search for Bayesian model exploration","volume":"5","author":"Bottolo","year":"2010","journal-title":"Baysn Anal."},{"key":"2023021801091568500_rssb12095-cit-0007","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000016","article-title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","volume":"3","author":"Boyd","year":"2010","journal-title":"Found. Trends Mach. Learn."},{"key":"2023021801091568500_rssb12095-cit-0008","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1111\/1467-9868.00354","article-title":"A model selection approach for the identification of quantitative trait loci in experimental crosses","volume":"64","author":"Broman","year":"2002","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801091568500_rssb12095-cit-0009","first-page":"73","volume-title":"J. Mach. Learn. Res","author":"Carvalho","year":"2009"},{"key":"2023021801091568500_rssb12095-cit-0010","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1093\/biomet\/asq017","article-title":"The horseshoe estimator for sparse signals","volume":"97","author":"Carvalho","year":"2010","journal-title":"Biometrika"},{"key":"2023021801091568500_rssb12095-cit-0011","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1093\/biomet\/asn034","article-title":"Extended Bayesian information criteria for model selection with large model spaces","volume":"95","author":"Chen","year":"2008","journal-title":"Biometrika"},{"key":"2023021801091568500_rssb12095-cit-0012","first-page":"169","article-title":"Bayesian asymptotics with misspecified models","volume":"23","author":"De Blasi","year":"2013","journal-title":"Statist. Sin."},{"key":"2023021801091568500_rssb12095-cit-0013","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1038\/ng2026","article-title":"Direct quantitative trait locus mapping of mammalian metabolic phenotypes in diabetic and normoglycemic rat models","volume":"39","author":"Dumas","year":"2007","journal-title":"Nat. Genet."},{"key":"2023021801091568500_rssb12095-cit-0014","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0015","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1111\/j.1467-9868.2008.00674.x","article-title":"Sure independence screening for ultrahigh dimensional feature space (with discussion)","volume":"70","author":"Fan","year":"2008","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801091568500_rssb12095-cit-0016","doi-asserted-by":"crossref","first-page":"3567","DOI":"10.1214\/10-AOS798","article-title":"Sure independence screening in generalized linear model with NP-dimensionality","volume":"38","author":"Fan","year":"2010","journal-title":"Ann. Statist."},{"key":"2023021801091568500_rssb12095-cit-0017","first-page":"1","article-title":"Regularization paths for generalized linear models via coordinate descent","volume":"33","author":"Friedman","year":"2010","journal-title":"J. Statist. Softwr."},{"key":"2023021801091568500_rssb12095-cit-0018","doi-asserted-by":"crossref","first-page":"1780","DOI":"10.1214\/11-AOAS455","article-title":"Bayesian variable selection regression for genome-wide association studies and other large-scale problems","volume":"5","author":"Guan","year":"2011","journal-title":"Ann. Appl. Statist."},{"key":"2023021801091568500_rssb12095-cit-0019","first-page":"1641","article-title":"An information matrix prior for Bayesian analysis in generalized linear models with high dimensional data","volume":"19","author":"Gupta","year":"2009","journal-title":"Statist. Sin."},{"key":"2023021801091568500_rssb12095-cit-0020","doi-asserted-by":"crossref","first-page":"223","DOI":"10.2307\/3318737","article-title":"An adaptive Metropolis algorithm","volume":"7","author":"Haario","year":"2001","journal-title":"Bernoulli"},{"key":"2023021801091568500_rssb12095-cit-0021","volume-title":"Bayesian variable selection for high dimensional generalized linear models","author":"Jiang","year":"2005"},{"key":"2023021801091568500_rssb12095-cit-0022","doi-asserted-by":"crossref","first-page":"1487","DOI":"10.1214\/009053607000000019","article-title":"Bayesian variable selection for high dimensional generalized linear models: convergence rate of the fitted densities","volume":"35","author":"Jiang","year":"2007","journal-title":"Ann. Statist."},{"key":"2023021801091568500_rssb12095-cit-0023","first-page":"1","article-title":"On numerical aspects of Bayesian model selection in high and ultrahigh-dimensional settings","volume":"7","author":"Johnson","year":"2012","journal-title":"Baysn Anal."},{"key":"2023021801091568500_rssb12095-cit-0024","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1080\/01621459.2012.682536","article-title":"Bayesian model selection in high-dimensional settings","volume":"107","author":"Johnson","year":"2012","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0025","first-page":"186","article-title":"Genome-wide pharmacogenetic investigation of a hepatic adverse event without clinical signs of immunopathology suggests an underlying immune pathogenesis","volume":"8","author":"Kindmark","year":"2008","journal-title":"Pharmgenom. J."},{"key":"2023021801091568500_rssb12095-cit-0026","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1214\/009053606000000029","article-title":"Misspecification in infinite-dimensional Bayesian statistics","volume":"34","author":"Kleijn","year":"2006","journal-title":"Ann. Statist."},{"key":"2023021801091568500_rssb12095-cit-0027","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1080\/01621459.2014.881153","article-title":"Bayes variable selection in semiparametric linear models","volume":"109","author":"Kundu","year":"2014","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0028","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pgen.0020006","article-title":"Combined expression trait correlations and expression quantitative trait locus mapping","volume":"2","author":"Lan","year":"2006","journal-title":"PLOS Genet."},{"key":"2023021801091568500_rssb12095-cit-0029","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1198\/jcgs.2010.10039","article-title":"On the utility of graphics cards to perform massively parallel simulation of advanced Monte Carlo methods","volume":"19","author":"Lee","year":"2010","journal-title":"J. Computnl Graph. Statist."},{"key":"2023021801091568500_rssb12095-cit-0030","doi-asserted-by":"crossref","first-page":"1202","DOI":"10.1198\/jasa.2010.tm08177","article-title":"Bayesian variable selection in structured High-Dimensional covariate spaces with application in genomics","volume":"105","author":"Li","year":"2010","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0031","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1016\/j.spl.2008.10.007","article-title":"On the use of SAMC for Monte Carlo intergration","volume":"79","author":"Liang","year":"2009","journal-title":"Statist. Probab. Lett."},{"key":"2023021801091568500_rssb12095-cit-0032","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1198\/016214506000001202","article-title":"Stochastic approximation in Monte Carlo computation","volume":"102","author":"Liang","year":"2007","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0033","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1198\/016214507000001337","article-title":"Mixture of g priors for Bayesian variable selection","volume":"103","author":"Liang","year":"2008","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0034","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1080\/01621459.2012.761942","article-title":"Bayesian subset modeling for high dimensional generalized linear models","volume":"108","author":"Liang","year":"2013","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0035","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1093\/biomet\/asn036","article-title":"Estimating FDR under general dependence using stochastic approximation","volume":"95","author":"Liang","year":"2008","journal-title":"Biometrika"},{"key":"2023021801091568500_rssb12095-cit-0036","doi-asserted-by":"crossref","first-page":"73","DOI":"10.4310\/SII.2011.v4.n1.a8","article-title":"Aggregated estimation equation estimation","volume":"4","author":"Lin","year":"2011","journal-title":"Statist. Interf."},{"key":"2023021801091568500_rssb12095-cit-0037","volume-title":"Divide-and-conquer matrix factorization","author":"Mackey","year":"2012"},{"key":"2023021801091568500_rssb12095-cit-0038","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1080\/01621459.1994.10476894","article-title":"Model selection and accounting for model uncertainty in graphical models using Occam's windows","volume":"89","author":"Madigan","year":"1994","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0039","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.csda.2006.12.019","article-title":"Relaxed Lasso","volume":"52","author":"Meinshausen","year":"2007","journal-title":"Computnl Statist. Data Anal."},{"key":"2023021801091568500_rssb12095-cit-0040","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1198\/016214508000000337","article-title":"The Bayesian Lasso","volume":"103","author":"Park","year":"2008","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0041","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1111\/j.1467-9868.2011.01015.x","article-title":"Local shrinkage rules, L\u00e9vy processes and regularized regression","volume":"74","author":"Polson","year":"2012","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801091568500_rssb12095-cit-0042","doi-asserted-by":"crossref","first-page":"2587","DOI":"10.1214\/10-AOS792","article-title":"Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem","volume":"38","author":"Scott","year":"2010","journal-title":"Ann. Statist."},{"key":"2023021801091568500_rssb12095-cit-0043","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1214\/09-EJS485","article-title":"Dynamics of Bayesian updating with dependent data and misspecified models","volume":"3","author":"Shalizi","year":"2009","journal-title":"Electron. J. Statist."},{"key":"2023021801091568500_rssb12095-cit-0044","doi-asserted-by":"crossref","DOI":"10.1239\/aap\/1418396243","article-title":"Weak convergence rates of population versus single-chain stochastic approximation MCMC algorithms","author":"Song","year":"2014","journal-title":"Adv. Appl. Probab."},{"key":"2023021801091568500_rssb12095-cit-0045","volume-title":"Finite sample posterior concentration in high-dimensional regression","author":"Strawn","year":"2012"},{"key":"2023021801091568500_rssb12095-cit-0046","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1198\/jcgs.2010.10016","article-title":"Understanding GPU programming for statistical computation: studies in massively parallel massive mixtures","volume":"19","author":"Suchard","year":"2010","journal-title":"J. Computnl Graph. Statist."},{"key":"2023021801091568500_rssb12095-cit-0047","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801091568500_rssb12095-cit-0048","volume-title":"Bayesian model uncertainty and prior choice with applications to genetic association studies","author":"Wilson","year":"2010"},{"key":"2023021801091568500_rssb12095-cit-0049","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1109\/TKDE.2008.186","article-title":"Compression and aggregation for logistic regression analysis in data cubes","volume":"21","author":"Xi","year":"2009","journal-title":"IEEE Trans. Knowl. Data Engng"},{"key":"2023021801091568500_rssb12095-cit-0050","first-page":"233","volume-title":"Bayesian Inference and Decision Techniques: Essays in Honor of Bruno de Finetti","author":"Zellner","year":"1986"},{"key":"2023021801091568500_rssb12095-cit-0051","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1214\/09-AOS729","article-title":"Nearly unbiased variable selection under minimax concave penalty","volume":"38","author":"Zhang","year":"2010","journal-title":"Ann. Statist."},{"key":"2023021801091568500_rssb12095-cit-0052","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1198\/016214506000000735","article-title":"The adaptive lasso and its oracle properties","volume":"101","author":"Zou","year":"2006","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801091568500_rssb12095-cit-0053","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J. R. Statist. Soc. B"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12095","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12095","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12095","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/77\/5\/947\/49234865\/jrsssb_77_5_947.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/77\/5\/947\/49234865\/jrsssb_77_5_947.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,5]],"date-time":"2024-06-05T21:38:15Z","timestamp":1717623495000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/77\/5\/947\/7040600"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,12,13]]},"references-count":53,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2014,12,13]]},"published-print":{"date-parts":[[2015,11,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12095","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2015,11]]},"published":{"date-parts":[[2014,12,13]]}}}