{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T11:45:59Z","timestamp":1769168759155,"version":"3.49.0"},"reference-count":63,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,7,28]],"date-time":"2023-07-28T00:00:00Z","timestamp":1690502400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"name":"University of Florida Informatics Institute SEED Fund","award":["UFII-SEED-2022: L.L.D."],"award-info":[{"award-number":["UFII-SEED-2022: L.L.D."]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,2,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The l1-regularisation is very popular in high-dimensional statistics\u2014it changes a combinatorial problem of choosing which subset of the parameter is zero, into a simple continuous optimisation. Using a continuous prior concentrated near zero, the Bayesian counterparts are successful in quantifying the uncertainty in the variable selection problems; nevertheless, the lack of exact zeros makes it difficult for broader problems such as change-point detection and rank selection. Inspired by the duality of the l1-regularisation as a constraint onto an l1-ball, we propose a new prior by projecting a continuous distribution onto the l1-ball. This creates a positive probability on the ball boundary, which contains both continuous elements and exact zeros. Unlike the spike-and-slab prior, this l1-ball projection is continuous and differentiable almost surely, making the posterior estimation amenable to the Hamiltonian Monte Carlo algorithm. We examine the properties, such as the volume change due to the projection, the connection to the combinatorial prior, the minimax concentration rate in the linear problem. We demonstrate the usefulness of exact zeros that simplify the combinatorial problems, such as the change-point detection in time series, the dimension selection of mixture models, and the low-rank plus-sparse change detection in medical images.<\/jats:p>","DOI":"10.1093\/jrsssb\/qkad076","type":"journal-article","created":{"date-parts":[[2023,7,15]],"date-time":"2023-07-15T04:38:34Z","timestamp":1689395914000},"page":"1538-1560","source":"Crossref","is-referenced-by-count":6,"title":["Bayesian inference with the<i>l<\/i>1-ball prior: solving combinatorial problems with exact zeros"],"prefix":"10.1093","volume":"85","author":[{"given":"Maoran","family":"Xu","sequence":"first","affiliation":[{"name":"Department of Statistical Science, Duke University , Durham, NC , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leo L","family":"Duan","sequence":"additional","affiliation":[{"name":"Department of Statistics, University of Florida , Gainesville, FL , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,7,28]]},"reference":[{"issue":"2","key":"2024020300390814300_qkad076-B1","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1080\/03081088508817681","article-title":"Eigenvalues of the Laplacian of a graph","volume":"18","author":"Anderson","year":"1985","journal-title":"Linear and Multilinear Algebra"},{"issue":"1","key":"2024020300390814300_qkad076-B2","first-page":"119","article-title":"Generalized double Pareto shrinkage","volume":"23","author":"Armagan","year":"2013","journal-title":"Statistica Sinica"},{"issue":"2","key":"2024020300390814300_qkad076-B3","first-page":"843","article-title":"On the beta prime prior for scale parameters in high-dimensional Bayesian regression models","volume":"31","author":"Bai","year":"2019","journal-title":"Statistica Sinica"},{"key":"2024020300390814300_qkad076-B4","author":"Banerjee","year":"2013"},{"key":"2024020300390814300_qkad076-B5","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611974997","volume-title":"First-order methods in optimization","author":"Beck","year":"2017"},{"issue":"4","key":"2024020300390814300_qkad076-B6","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1093\/biomet\/asw042","article-title":"Fast sampling with Gaussian scale mixture priors in high-dimensional regression","volume":"103","author":"Bhattacharya","year":"2016","journal-title":"Biometrika"},{"issue":"2","key":"2024020300390814300_qkad076-B7","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1093\/biomet\/asr013","article-title":"Sparse Bayesian infinite factor models","volume":"98","author":"Bhattacharya","year":"2011","journal-title":"Biometrika"},{"issue":"512","key":"2024020300390814300_qkad076-B8","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1080\/01621459.2014.960967","article-title":"Dirichlet-Laplace priors for optimal shrinkage","volume":"110","author":"Bhattacharya","year":"2015","journal-title":"Journal of the American Statistical Association"},{"issue":"500","key":"2024020300390814300_qkad076-B9","doi-asserted-by":"crossref","first-page":"1610","DOI":"10.1080\/01621459.2012.716344","article-title":"Consistent high-dimensional Bayesian variable selection via penalized credible regions","volume":"107","author":"Bondell","year":"2012","journal-title":"Journal of the American Statistical Association"},{"key":"2024020300390814300_qkad076-B10","volume-title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","author":"Boyd","year":"2011"},{"issue":"3","key":"2024020300390814300_qkad076-B11","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1214\/aos\/1176344209","article-title":"Bayesian confidence bands for a distribution function","volume":"6","author":"Breth","year":"1978","journal-title":"The Annals of Statistics"},{"key":"2024020300390814300_qkad076-B12","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-20192-9","volume-title":"Statistics for high-dimensional data: Methods, theory and applications","author":"B\u00fchlmann","year":"2011"},{"issue":"2","key":"2024020300390814300_qkad076-B13","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1093\/biomet\/asq017","article-title":"The horseshoe estimator for sparse signals","volume":"97","author":"Carvalho","year":"2010","journal-title":"Biometrika"},{"issue":"4","key":"2024020300390814300_qkad076-B14","doi-asserted-by":"crossref","first-page":"2069","DOI":"10.1214\/12-AOS1029","article-title":"Needles and straw in a haystack: Posterior concentration for possibly sparse sequences","volume":"40","author":"Castillo","year":"2012","journal-title":"The Annals of Statistics"},{"issue":"1","key":"2024020300390814300_qkad076-B15","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1137\/S003614450037906X","article-title":"Atomic decomposition by basis pursuit","volume":"43","author":"Chen","year":"2001","journal-title":"SIAM Review"},{"issue":"2","key":"2024020300390814300_qkad076-B16","first-page":"2292","article-title":"Sinkhorn distances: Lightspeed computation of optimal transport","volume":"26","author":"Cuturi","year":"2013","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2024020300390814300_qkad076-B17","author":"Duchi","year":"2008"},{"issue":"2","key":"2024020300390814300_qkad076-B18","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1214\/009053604000000067","article-title":"Least angle regression","volume":"32","author":"Efron","year":"2004","journal-title":"The Annals of Statistics"},{"issue":"2","key":"2024020300390814300_qkad076-B19","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1111\/rssb.12168","article-title":"High dimensional semiparametric latent graphical model for mixed data","volume":"79","author":"Fan","year":"2017","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2024020300390814300_qkad076-B20","volume-title":"Geometric measure theory","author":"Federer","year":"2014"},{"issue":"17","key":"2024020300390814300_qkad076-B21","first-page":"203","article-title":"Stochastic search variable selection","volume":"68","author":"George","year":"1995","journal-title":"Markov Chain Monte Carlo in Practice"},{"issue":"7","key":"2024020300390814300_qkad076-B22","doi-asserted-by":"crossref","first-page":"2612","DOI":"10.1088\/1361-6560\/aa5d40","article-title":"Low-dose dynamic myocardial perfusion CT image reconstruction using pre-contrast normal-dose CT scan induced structure tensor total variation regularization","volume":"62","author":"Gong","year":"2017","journal-title":"Physics in Medicine & Biology"},{"issue":"483","key":"2024020300390814300_qkad076-B23","doi-asserted-by":"crossref","first-page":"1119","DOI":"10.1198\/016214508000000689","article-title":"Bayesian treed Gaussian process models with an application to computer modeling","volume":"103","author":"Gramacy","year":"2008","journal-title":"Journal of the American Statistical Association"},{"key":"2024020300390814300_qkad076-B24","author":"Grave","year":"2011"},{"key":"2024020300390814300_qkad076-B25","author":"Griffin","year":"2019"},{"issue":"3","key":"2024020300390814300_qkad076-B26","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1093\/biostatistics\/kxi020","article-title":"A transformation approach for incorporating monotone or unimodal constraints","volume":"6","author":"Gunn","year":"2005","journal-title":"Biostatistics"},{"issue":"509","key":"2024020300390814300_qkad076-B27","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1080\/01621459.2014.993077","article-title":"Decoupling shrinkage and selection in Bayesian linear models: A posterior summary perspective","volume":"110","author":"Hahn","year":"2015","journal-title":"Journal of the American Statistical Association"},{"issue":"3","key":"2024020300390814300_qkad076-B28","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.csda.2017.06.007","article-title":"Lasso, fractional norm and structured sparse estimation using a Hadamard product parametrization","volume":"115","author":"Hoff","year":"2017","journal-title":"Computational Statistics & Data Analysis"},{"issue":"9","key":"2024020300390814300_qkad076-B29","doi-asserted-by":"crossref","first-page":"2117","DOI":"10.1109\/TPAMI.2012.271","article-title":"Fast and accurate matrix completion via truncated nuclear norm regularization","volume":"35","author":"Hu","year":"2012","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"2","key":"2024020300390814300_qkad076-B30","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1214\/009053604000001147","article-title":"Spike and slab variable selection: Frequentist and Bayesian strategies","volume":"33","author":"Ishwaran","year":"2005","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2024020300390814300_qkad076-B31","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1214\/07-BA219","article-title":"Splitting and merging components of a nonconjugate Dirichlet process mixture model","volume":"2","author":"Jain","year":"2007","journal-title":"Bayesian Analysis"},{"issue":"3","key":"2024020300390814300_qkad076-B32","first-page":"1","article-title":"Monte Carlo simulation on the Stiefel manifold via polar expansion","volume":"30","author":"Jauch","year":"2020","journal-title":"Journal of Computational and Graphical Statistics"},{"issue":"4","key":"2024020300390814300_qkad076-B33","doi-asserted-by":"crossref","first-page":"1082","DOI":"10.1111\/rssb.12501","article-title":"Testing for a change in mean after changepoint detection","volume":"84","author":"Jewell","year":"2022","journal-title":"Journal of the Royal Statistical Society: Series B: Statistical Methodology"},{"issue":"3","key":"2024020300390814300_qkad076-B34","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1162\/0033553041502153","article-title":"Do voters affect or elect policies? Evidence from the US house","volume":"119","author":"Lee","year":"2004","journal-title":"The Quarterly Journal of Economics"},{"key":"2024020300390814300_qkad076-B35","volume-title":"Posterior probabilities of alternative linear models","author":"Lempers","year":"1971"},{"issue":"3","key":"2024020300390814300_qkad076-B36","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.csda.2016.10.008","article-title":"Variable selection using shrinkage priors","volume":"107","author":"Li","year":"2017","journal-title":"Computational Statistics & Data Analysis"},{"issue":"2","key":"2024020300390814300_qkad076-B37","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1093\/biomet\/ast063","article-title":"Bayesian monotone regression using Gaussian process projection","volume":"101","author":"Lin","year":"2014","journal-title":"Biometrika"},{"key":"2024020300390814300_qkad076-B38","author":"Lindsten","year":"2011"},{"issue":"3","key":"2024020300390814300_qkad076-B39","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1214\/009053606000000281","article-title":"High-dimensional graphs and variable selection with the lasso","volume":"34","author":"Meinshausen","year":"2006","journal-title":"The Annals of Statistics"},{"issue":"1","key":"2024020300390814300_qkad076-B40","doi-asserted-by":"crossref","DOI":"10.1515\/demo-2022-0150","article-title":"Consistency of mixture models with a prior on the number of components","volume":"11","author":"Miller","year":"2022","journal-title":"Dependence Modeling"},{"issue":"1","key":"2024020300390814300_qkad076-B41","first-page":"3333","article-title":"Inconsistency of Pitman-Yor process mixtures for the number of components","volume":"15","author":"Miller","year":"2014","journal-title":"Journal of Machine Learning Research"},{"issue":"521","key":"2024020300390814300_qkad076-B42","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1080\/01621459.2016.1255636","article-title":"Mixture models with a prior on the number of components","volume":"113","author":"Miller","year":"2018","journal-title":"Journal of the American Statistical Association"},{"issue":"404","key":"2024020300390814300_qkad076-B43","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1080\/01621459.1988.10478694","article-title":"Bayesian variable selection in linear regression","volume":"83","author":"Mitchell","year":"1988","journal-title":"Journal of the American Statistical Association"},{"key":"2024020300390814300_qkad076-B44","author":"Neal","year":"2011"},{"issue":"2","key":"2024020300390814300_qkad076-B45","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1093\/biomet\/asz083","article-title":"Discontinuous Hamiltonian Monte Carlo for discrete parameters and discontinuous likelihoods","volume":"107","author":"Nishimura","year":"2020","journal-title":"Biometrika"},{"issue":"3","key":"2024020300390814300_qkad076-B46","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1002\/mrm.25240","article-title":"Low-rank plus sparse matrix decomposition for accelerated dynamic MRI with separation of background and dynamic components","volume":"73","author":"Otazo","year":"2015","journal-title":"Magnetic Resonance in Medicine"},{"key":"2024020300390814300_qkad076-B47","author":"Pakman","year":"2013"},{"issue":"482","key":"2024020300390814300_qkad076-B48","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1198\/016214508000000337","article-title":"The Bayesian lasso","volume":"103","author":"Park","year":"2008","journal-title":"Journal of the American Statistical Association"},{"issue":"4","key":"2024020300390814300_qkad076-B49","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1111\/rssb.12130","article-title":"Mixtures, envelopes and hierarchical duality","volume":"78","author":"Polson","year":"2016","journal-title":"Journal of the Royal Statistical Society: Series B: Statistical Methodology"},{"issue":"521","key":"2024020300390814300_qkad076-B50","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1080\/01621459.2016.1260469","article-title":"The spike-and-slab lasso","volume":"113","author":"Ro\u010dkov\u00e1","year":"2018","journal-title":"Journal of the American Statistical Association"},{"key":"2024020300390814300_qkad076-B51","author":"Sen","year":"2018"},{"issue":"3","key":"2024020300390814300_qkad076-B52","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1093\/biomet\/asq038","article-title":"Penalized likelihood methods for estimation of sparse high-dimensional directed acyclic graphs","volume":"97","author":"Shojaie","year":"2010","journal-title":"Biometrika"},{"issue":"2","key":"2024020300390814300_qkad076-B53","doi-asserted-by":"crossref","first-page":"2324","DOI":"10.1214\/15-EJS1074","article-title":"Statistical properties of convex clustering","volume":"9","author":"Tan","year":"2015","journal-title":"Electronic Journal of Statistics"},{"issue":"398","key":"2024020300390814300_qkad076-B54","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1080\/01621459.1987.10478458","article-title":"The calculation of posterior distributions by data augmentation","volume":"82","author":"Tanner","year":"1987","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2024020300390814300_qkad076-B55","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"1","key":"2024020300390814300_qkad076-B56","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1111\/j.1467-9868.2005.00490.x","article-title":"Sparsity and smoothness via the fused lasso","volume":"67","author":"Tibshirani","year":"2005","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"3","key":"2024020300390814300_qkad076-B57","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1214\/11-AOS878","article-title":"The solution path of the generalized lasso","volume":"39","author":"Tibshirani","year":"2011","journal-title":"The Annals of Statistics"},{"key":"2024020300390814300_qkad076-B58","doi-asserted-by":"crossref","DOI":"10.1017\/9781108231596","volume-title":"High-dimensional probability: An introduction with applications in data science","author":"Vershynin","year":"2018"},{"issue":"2","key":"2024020300390814300_qkad076-B59","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1111\/rssb.12407","article-title":"Iterative alpha expansion for estimating gradient-sparse signals from linear measurements","volume":"83","author":"Xu","year":"2021","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"1","key":"2024020300390814300_qkad076-B60","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1111\/j.1467-9868.2005.00532.x","article-title":"Model selection and estimation in regression with grouped variables","volume":"68","author":"Yuan","year":"2006","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"1","key":"2024020300390814300_qkad076-B61","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1093\/biomet\/ast059","article-title":"Sparse precision matrix estimation via lasso penalized D-trace loss","volume":"101","author":"Zhang","year":"2014","journal-title":"Biometrika"},{"issue":"2","key":"2024020300390814300_qkad076-B62","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"2","key":"2024020300390814300_qkad076-B63","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1198\/106186006X113430","article-title":"Sparse principal component analysis","volume":"15","author":"Zou","year":"2006","journal-title":"Journal of Computational and Graphical Statistics"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/85\/5\/1538\/56555374\/qkad076.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/85\/5\/1538\/56555374\/qkad076.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T06:17:53Z","timestamp":1729750673000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/85\/5\/1538\/7233309"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,28]]},"references-count":63,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,7,28]]},"published-print":{"date-parts":[[2024,2,2]]}},"URL":"https:\/\/doi.org\/10.1093\/jrsssb\/qkad076","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,11]]},"published":{"date-parts":[[2023,7,28]]}}}