{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T03:44:06Z","timestamp":1790653446767,"version":"4.1.0"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,2,20]],"date-time":"2023-02-20T00:00:00Z","timestamp":1676851200000},"content-version":"vor","delay-in-days":1613,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1712870"],"award-info":[{"award-number":["DMS-1712870"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000005","name":"Department of Defense","doi-asserted-by":"publisher","award":["SOT-FSU-FATs-16-06"],"award-info":[{"award-number":["SOT-FSU-FATs-16-06"]}],"id":[{"id":"10.13039\/100000005","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,11,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Ensembles of decision trees are a useful tool for obtaining flexible estimates of regression functions. Examples of these methods include gradient-boosted decision trees, random forests and Bayesian classification and regression trees. Two potential shortcomings of tree ensembles are their lack of smoothness and their vulnerability to the curse of dimensionality. We show that these issues can be overcome by instead considering sparsity inducing soft decision trees in which the decisions are treated as probabilistic. We implement this in the context of the Bayesian additive regression trees framework and illustrate its promising performance through testing on benchmark data sets. We provide strong theoretical support for our methodology by showing that the posterior distribution concentrates at the minimax rate (up to a logarithmic factor) for sparse functions and functions with additive structures in the high dimensional regime where the dimensionality of the covariate space is allowed to grow nearly exponentially in the sample size. Our method also adapts to the unknown smoothness and sparsity levels, and can be implemented by making minimal modifications to existing Bayesian additive regression tree algorithms.<\/jats:p>","DOI":"10.1111\/rssb.12293","type":"journal-article","created":{"date-parts":[[2018,9,22]],"date-time":"2018-09-22T12:43:06Z","timestamp":1537620186000},"page":"1087-1110","source":"Crossref","is-referenced-by-count":109,"title":["Bayesian Regression Tree Ensembles that Adapt to Smoothness and Sparsity"],"prefix":"10.1093","volume":"80","author":[{"given":"Antonio R.","family":"Linero","sequence":"first","affiliation":[{"name":"Florida State University , Tallahassee , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun","family":"Yang","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana\u2013Champaign , Champaign , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2018,9,21]]},"reference":[{"key":"2023022101111082200_","doi-asserted-by":"publisher","DOI":"10.1109\/JSTP.2018.2848230","article-title":"Bayesian nonparametric causal inference: information rates and learning algorithms","volume-title":"IEEE J. Selectd Top. Signal Process.","author":"Alaa","year":"2018"},{"key":"2023022101111082200_","volume-title":"Branching Processes","author":"Athreya","year":"2004"},{"key":"2023022101111082200_","article-title":"Bayesian fractional posteriors","volume-title":"Ann. Statist.","author":"Bhattacharya","year":"2016"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"1750","DOI":"10.1214\/14-AOAS755","article-title":"Variable selection for BART: an application to gene regulation","volume":"8","author":"Bleich","year":"2014","journal-title":"Ann. Appl. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1214\/09-AOAS285","article-title":"Bart: Bayesian additive regression trees","volume":"4","author":"Chipman","year":"2010","journal-title":"Ann. Appl. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"3300","DOI":"10.1214\/10-AOS811","article-title":"Adaptive nonparametric Bayesian inference using location-scale mixture priors","volume":"38","author":"De Jonge","year":"2010","journal-title":"Ann. Statist."},{"key":"2023022101111082200_","article-title":"Automated versus do-it-yourself methods for causal inference: lessons learned from a data analysis competition.","author":"Dorie","year":"2017"},{"key":"2023022101111082200_","first-page":"771","article-title":"A short introduction to boosting","volume":"14","author":"Freund","year":"1999","journal-title":"J. Jpn. Soc. Artif. Intell."},{"key":"2023022101111082200_","first-page":"1","article-title":"Multivariate adaptive regression splines","volume":"19","author":"Friedman","year":"1991","journal-title":"Ann. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1214\/aos\/1016218228","article-title":"Convergence rates of posterior distributions","volume":"28","author":"Ghosal","year":"2000","journal-title":"Ann. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1214\/aos\/1013203452","article-title":"Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities","volume":"29","author":"Ghosal","year":"2001","journal-title":"Ann. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1214\/009053606000001172","article-title":"Convergence rates of posterior distributions for noniid observations","volume":"35","author":"Ghosal","year":"2007","journal-title":"Ann. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1214\/009053606000001271","article-title":"Posterior convergence rates of Dirichlet mixtures at smooth densities","volume":"35","author":"Ghosal","year":"2007","journal-title":"Ann. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","DOI":"10.1017\/9781139029834","volume-title":"Fundamentals of Nonparametric Bayesian Inference","author":"Ghosal","year":"2017"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1093\/biomet\/82.4.711","article-title":"Reversible jump Markov chain Monte Carlo computation and Bayesian model determination","volume":"82","author":"Green","year":"1995","journal-title":"Biometrika"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/978-3-642-34106-9_16","volume-title":"In Proc. Int. Conf. Algorithmic Learning Theory","author":"Gr\u00fcnwald","year":"2012"},{"key":"2023022101111082200_","volume-title":"A Distribution-free Theory of Nonparametric Regression","author":"Gy\u00f6rfi","year":"2006"},{"key":"2023022101111082200_","volume-title":"Bayesian regression tree models for causal inference: regularization, confounding, and heterogeneous effects","author":"Hahn","year":"2017"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The Elements of Statistical Learning","author":"Hastie","year":"2009"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1198\/jcgs.2010.08162","article-title":"Bayesian nonparametric modeling for causal inference","volume":"20","author":"Hill","year":"2011","journal-title":"J. Computnl Graph. Statist."},{"key":"2023022101111082200_","volume-title":"Atlantic Causal Inference Conference Competition results","author":"Hill","year":"2016"},{"key":"2023022101111082200_","first-page":"1819","volume-title":"In Proc. Int. Conf. Pattern Recognition","author":"Irsoy","year":"2012"},{"key":"2023022101111082200_","first-page":"1","article-title":"bartMachine: machine learning with Bayesian additive regression trees","volume":"70","author":"Kapelner","year":"2016","journal-title":"J. Statist. Softwr."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1080\/07408170600897502","article-title":"Visualizable and interpretable regression models with good prediction power","volume":"39","author":"Kim","year":"2007","journal-title":"IIE Trans."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1080\/01621459.2016.1264957","article-title":"Bayesian regression trees for high-dimensional prediction and variable selection","volume":"113","author":"Linero","year":"2018","journal-title":"J. Am. Statist. Ass."},{"key":"2023022101111082200_","article-title":"Robust Bayesian inference via coarsening","author":"Miller","year":"2018","journal-title":"J. Am. Statist. Ass."},{"key":"2023022101111082200_","volume-title":"Log-linear Bayesian additive regression trees for categorical and count responses","author":"Murray","year":"2017"},{"key":"2023022101111082200_","volume-title":"Posterior concentration for Bayesian regression trees and their ensembles","author":"Rockova","year":"2017"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1093\/biomet\/ast015","article-title":"Adaptive Bayesian multivariate density estimation with Dirichlet mixtures","volume":"100","author":"Shen","year":"2013","journal-title":"Biometrika"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"2741","DOI":"10.1002\/sim.6893","article-title":"Nonparametric survival analysis using Bayesian additive regression trees (BART)","volume":"35","author":"Sparapani","year":"2016","journal-title":"Statist. Med"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","article-title":"Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC","volume":"27","author":"Vehtari","year":"2017","journal-title":"Statist. Comput."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1111\/1467-9868.00314","article-title":"On Bayesian consistency","volume":"63","author":"Walker","year":"2001","journal-title":"J. R. Statist. Soc."},{"key":"2023022101111082200_","first-page":"867","article-title":"A widely applicable Bayesian information criterion","volume":"14","author":"Watanabe","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"2023022101111082200_","volume-title":"Minimax optimal Bayesian aggregation","author":"Yang","year":"2014"},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1214\/14-AOS1289","article-title":"Minimax-optimal nonparametric regression in high dimensions","volume":"43","author":"Yang","year":"2015","journal-title":"Ann. Statist."},{"key":"2023022101111082200_","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1111\/j.1467-9868.2005.00532.x","article-title":"Model selection and estimation in regression with grouped variables","volume":"68","author":"Yuan","year":"2006","journal-title":"J. R. Statist. Soc."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12293","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12293","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12293","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/am-pdf\/10.1111\/rssb.12293","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/80\/5\/1087\/49270333\/jrsssb_80_5_1087.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/80\/5\/1087\/49270333\/jrsssb_80_5_1087.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,5]],"date-time":"2023-09-05T09:31:59Z","timestamp":1693906319000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/80\/5\/1087\/7048381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,9,21]]},"references-count":37,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2018,9,21]]},"published-print":{"date-parts":[[2018,11,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12293","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,11]]},"published":{"date-parts":[[2018,9,21]]}}}