{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:22:26Z","timestamp":1787016146904,"version":"build-2736575974"},"reference-count":65,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T00:00:00Z","timestamp":1676592000000},"content-version":"vor","delay-in-days":2671,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"US National Science Foundation","doi-asserted-by":"publisher","award":["DMS-1255187"],"award-info":[{"award-number":["DMS-1255187"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,9,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:p>We develop a connection between mixture and envelope representations of objective functions that arise frequently in statistics. We refer to this connection by using the term \u2018hierarchical duality\u2019. Our results suggest an interesting and previously underexploited relationship between marginalization and profiling, or equivalently between the Fenchel\u2013Moreau theorem for convex functions and the Bernstein\u2013Widder theorem for Laplace transforms. We give several different sets of conditions under which such a duality result obtains. We then extend existing work on envelope representations in several ways, including novel generalizations to variance\u2013mean models and to multivariate Gaussian location models. This turns out to provide an elegant missing data interpretation of the proximal gradient method, which is a widely used algorithm in machine learning. We show several statistical applications in which the framework proposed leads to easily implemented algorithms, including a robust version of the fused lasso, non-linear quantile regression via trend filtering and the binomial fused double-Pareto model. Code for the examples is available on GitHub at https:\/\/github.com\/jgscott\/hierduals.<\/jats:p>","DOI":"10.1111\/rssb.12130","type":"journal-article","created":{"date-parts":[[2015,10,27]],"date-time":"2015-10-27T00:51:53Z","timestamp":1445907113000},"page":"701-727","source":"Crossref","is-referenced-by-count":13,"title":["Mixtures, Envelopes and Hierarchical Duality"],"prefix":"10.1093","volume":"78","author":[{"given":"Nicholas G.","family":"Polson","sequence":"first","affiliation":[{"name":"University of Chicago \u00a0 USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James G.","family":"Scott","sequence":"additional","affiliation":[{"name":"University of Texas at Austin \u00a0 USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2015,10,26]]},"reference":[{"key":"2023021801095671800_rssb12130-cit-0001","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1111\/j.2517-6161.1974.tb00989.x","article-title":"Scale mixtures of normal distributions","volume":"36","author":"Andrews","year":"1974","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801095671800_rssb12130-cit-0002","first-page":"17","article-title":"Variational bridge regression","volume":"5","author":"Armagan","year":"2009","journal-title":"J. Mach. Learn. Res. Wrkshp Case Proc."},{"key":"2023021801095671800_rssb12130-cit-0003","first-page":"119","article-title":"Generalized double Pareto shrinkage","volume":"23","author":"Armagan","year":"2013","journal-title":"Statist. Sin."},{"key":"2023021801095671800_rssb12130-cit-0004","volume-title":"glmgen: fast generalized lasso solver","author":"Arnold","year":"2014"},{"key":"2023021801095671800_rssb12130-cit-0005","doi-asserted-by":"crossref","first-page":"3423","DOI":"10.1093\/bioinformatics\/bth419","article-title":"Gene selection using a two-level hierarchical Bayesian model","volume":"20","author":"Bae","year":"2004","journal-title":"Bioinformatics"},{"key":"2023021801095671800_rssb12130-cit-0006","first-page":"151","article-title":"Hyperbolic distributions and distributions on hyperbolae","volume":"5","author":"Barndorff-Nielsen","year":"1978","journal-title":"Scand. J. Statist."},{"key":"2023021801095671800_rssb12130-cit-0007","doi-asserted-by":"crossref","first-page":"145","DOI":"10.2307\/1402598","article-title":"Normal variance-mean mixtures and z distributions","volume":"50","author":"Barndorff-Nielsen","year":"1982","journal-title":"Int. Statist. Rev."},{"key":"2023021801095671800_rssb12130-cit-0008","first-page":"385","article-title":"The case for objective Bayesian analysis","volume":"1","author":"Berger","year":"2006","journal-title":"Baysn Anal."},{"key":"2023021801095671800_rssb12130-cit-0009","volume-title":"Bayesian shrinkage","author":"Bhattacharya","year":"2012"},{"key":"2023021801095671800_rssb12130-cit-0010","volume-title":"Harmonic Analysis and the Theory of Probability","author":"Bochner","year":"1960"},{"key":"2023021801095671800_rssb12130-cit-0011","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1214\/10-AOS869","article-title":"Asymptotic Bayes-optimality under sparsity of some multiple testing procedures","volume":"39","author":"Bogdan","year":"2011","journal-title":"Ann. Statist."},{"key":"2023021801095671800_rssb12130-cit-0012","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511804441","volume-title":"Convex Optimization","author":"Boyd","year":"2004"},{"key":"2023021801095671800_rssb12130-cit-0013","first-page":"88","volume-title":"Proc. 25th Int. Conf. Mach. Learn.","author":"Caron","year":"2008"},{"key":"2023021801095671800_rssb12130-cit-0014","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1093\/biomet\/asq017","article-title":"The horseshoe estimator for sparse signals","volume":"97","author":"Carvalho","year":"2010","journal-title":"Biometrika"},{"key":"2023021801095671800_rssb12130-cit-0015","volume-title":"Fixed-point Algorithms for Inverse Problems in Science and Engineering","author":"Combettes","year":"2011"},{"key":"2023021801095671800_rssb12130-cit-0016","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1007\/978-1-4612-2618-5_29","volume-title":"Statistical Decision Theory and Related Topics","author":"Dasgupta","year":"1994"},{"key":"2023021801095671800_rssb12130-cit-0017","first-page":"111","article-title":"Asymptotic properties of Bayes risk for the horseshoe prior","volume":"8","author":"Datta","year":"2013","journal-title":"Baysn Anal."},{"key":"2023021801095671800_rssb12130-cit-0018","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","article-title":"Maximum likelihood from incomplete data via the EM algorithm (with discussion)","volume":"39","author":"Dempster","year":"1977","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801095671800_rssb12130-cit-0020","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1214\/009053604000000067","article-title":"Least angle regression","volume":"32","author":"Efron","year":"2004","journal-title":"Ann. Statist."},{"key":"2023021801095671800_rssb12130-cit-0019","first-page":"130","article-title":"Limiting the risk of Bayes and empirical Bayes\u2014part ii: the empirical Bayes case","volume":"67","author":"Efron","year":"1972","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801095671800_rssb12130-cit-0021","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801095671800_rssb12130-cit-0022","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1109\/TPAMI.2003.1227989","article-title":"Adaptive sparseness for supervised learning","volume":"25","author":"Figueiredo","year":"2003","journal-title":"IEEE Trans. Pattn Anal. Mach. Intell."},{"key":"2023021801095671800_rssb12130-cit-0023","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1109\/TIP.2003.814255","article-title":"An EM algorithm for wavelet-based image restoration","volume":"12","author":"Figueiredo","year":"2003","journal-title":"IEEE Trans. Im. Process."},{"key":"2023021801095671800_rssb12130-cit-0024","first-page":"1","article-title":"Regularization paths for generalized linear models via coordinate descent","volume":"33","author":"Friedman","year":"2010","journal-title":"J. Statist. Softwr"},{"key":"2023021801095671800_rssb12130-cit-0025","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1109\/34.120331","article-title":"Constrained restoration and the recovery of discontinuities","volume":"14","author":"Geman","year":"1992","journal-title":"IEEE Trans. Pattn Anal. Mach. Intell."},{"key":"2023021801095671800_rssb12130-cit-0026","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1109\/83.392335","article-title":"Nonlinear image recovery with half-quadratic regularization","volume":"4","author":"Geman","year":"1995","journal-title":"IEEE Trans. Im. Process."},{"key":"2023021801095671800_rssb12130-cit-0027","first-page":"567","article-title":"Simulation-based regularized logistic regression","volume":"7","author":"Gramacy","year":"2012","journal-title":"Baysn Anal."},{"key":"2023021801095671800_rssb12130-cit-0028","volume-title":"Technical Report","author":"Griffin","year":"2005"},{"key":"2023021801095671800_rssb12130-cit-0029","first-page":"171","article-title":"Inference with normal-gamma prior distributions in regression problems","volume":"5","author":"Griffin","year":"2010","journal-title":"Baysn Anal."},{"key":"2023021801095671800_rssb12130-cit-0030","volume-title":"Technical Report","author":"Hahn","year":"2013"},{"key":"2023021801095671800_rssb12130-cit-0031","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1093\/biomet\/asp047","article-title":"Bayesian lasso regression","volume":"96","author":"Hans","year":"2009","journal-title":"Biometrika"},{"key":"2023021801095671800_rssb12130-cit-0032","doi-asserted-by":"crossref","first-page":"1383","DOI":"10.1198\/jasa.2011.tm09241","article-title":"Elastic net regression modeling with the orthant normal prior","volume":"106","author":"Hans","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801095671800_rssb12130-cit-0033","volume-title":"The Convolution Transform","author":"Hirschman","year":"1995"},{"key":"2023021801095671800_rssb12130-cit-0034","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1023\/A:1008932416310","article-title":"Bayesian parameter estimation via variational methods","volume":"10","author":"Jaakkola","year":"2000","journal-title":"Statist. Comput."},{"key":"2023021801095671800_rssb12130-cit-0035","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1080\/10618600.2012.681238","article-title":"A dynamic programming algorithm for the fused lasso and l-0 segmentation","volume":"22","author":"Johnson","year":"2013","journal-title":"J. Computnl Graph. Statist."},{"key":"2023021801095671800_rssb12130-cit-0037","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1137\/070690274","article-title":"l1 trend filtering","volume":"51","author":"Kim","year":"2009","journal-title":"SIAM Rev."},{"key":"2023021801095671800_rssb12130-cit-0036","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1109\/JSTSP.2007.910971","article-title":"An interior-point method for large-scale regularized least squares","volume":"1","author":"Kim","year":"2007","journal-title":"IEEE J. Selectd Top. Sign. Process."},{"key":"2023021801095671800_rssb12130-cit-0038","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511754098","volume-title":"Quantile Regression","author":"Koenker","year":"2005"},{"key":"2023021801095671800_rssb12130-cit-0039","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.jeconom.2007.05.017","article-title":"Sparse estimators and the oracle property, or the return of Hodges' estimator","volume":"142","author":"Leeb","year":"2008","journal-title":"J. Econmetr."},{"key":"2023021801095671800_rssb12130-cit-0040","first-page":"533","article-title":"Bayesian regularized quantile regression","volume":"5","author":"Li","year":"2010","journal-title":"Baysn Anal."},{"key":"2023021801095671800_rssb12130-cit-0041","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1198\/jasa.2011.tm09738","article-title":"Sparsenet: coordinate descent with non-convex penalties","volume":"106","author":"Mazumder","year":"2011","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801095671800_rssb12130-cit-0042","volume-title":"Bayesian Statistics 8","author":"Muller","year":"2006"},{"key":"2023021801095671800_rssb12130-cit-0043","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1093\/biomet\/63.2.329","article-title":"On posterior joint and marginal modes","volume":"63","author":"O'Hagan","year":"1976","journal-title":"Biometrika"},{"key":"2023021801095671800_rssb12130-cit-0044","first-page":"1059","volume-title":"Advances in Neural Information Processing Systems","author":"Palmer","year":"2006"},{"key":"2023021801095671800_rssb12130-cit-00501","first-page":"123","article-title":"Proximal algorithms","volume":"1","author":"Parikh","year":"2014","journal-title":"Foundns Trends Optimizn"},{"key":"2023021801095671800_rssb12130-cit-0045","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1198\/016214508000000337","article-title":"The Bayesian lasso","volume":"103","author":"Park","year":"2008","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801095671800_rssb12130-cit-0048","first-page":"1","article-title":"Data augmentation for support vector machines (with discussion)","volume":"6","author":"Polson","year":"2011","journal-title":"Baysn Anal."},{"key":"2023021801095671800_rssb12130-cit-0046","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1111\/j.1467-9868.2011.01015.x","article-title":"Local shrinkage rules, L\u00e9vy processes and regularized regression","volume":"74","author":"Polson","year":"2012","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801095671800_rssb12130-cit-0047","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1093\/biomet\/ass081","article-title":"Data augmentation for non-Gaussian regression models using variance-mean mixtures","volume":"100","author":"Polson","year":"2013","journal-title":"Biometrika"},{"key":"2023021801095671800_rssb12130-cit-0049","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1080\/01621459.2013.829001","article-title":"Bayesian inference for logistic models using Polya-Gamma latent variables","volume":"108","author":"Polson","year":"2013","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801095671800_rssb12130-cit-0050","doi-asserted-by":"crossref","first-page":"713","DOI":"10.1111\/rssb.12042","article-title":"The Bayesian bridge","volume":"76","author":"Polson","year":"2014","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801095671800_rssb12130-cit-0051","volume-title":"Technical Report","author":"Ramdas","year":"2014"},{"key":"2023021801095671800_rssb12130-cit-0052","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-02431-3","volume-title":"Variational Analysis","author":"Rockafellar","year":"1998"},{"key":"2023021801095671800_rssb12130-cit-0053","doi-asserted-by":"crossref","first-page":"2144","DOI":"10.1016\/j.jspi.2005.08.031","article-title":"An exploration of aspects of Bayesian multiple testing","volume":"136","author":"Scott","year":"2006","journal-title":"J. Statist. Planng Inf."},{"key":"2023021801095671800_rssb12130-cit-0054","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1214\/13-EJS795","article-title":"Hierarchical Bayes, maximum a posteriori estimators, and minimax concave penalized likelihood estimation","volume":"7","author":"Strawderman","year":"2013","journal-title":"Electron. J. Statist."},{"key":"2023021801095671800_rssb12130-cit-0055","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1080\/01621459.2012.734168","article-title":"Multinomial inverse regression for text analysis","volume":"108","author":"Taddy","year":"2013","journal-title":"J. Am. Statist. Ass."},{"key":"2023021801095671800_rssb12130-cit-0056","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1214\/13-AOS1189","article-title":"Adaptive piecewise polynomial estimation via trend filtering","volume":"42","author":"Tibshirani","year":"2014","journal-title":"Ann. Statist."},{"key":"2023021801095671800_rssb12130-cit-0057","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1111\/j.1467-9868.2005.00490.x","article-title":"Sparsity and smoothness via the fused lasso","volume":"67","author":"Tibshirani","year":"2005","journal-title":"J. R. Statist. Soc. B"},{"key":"2023021801095671800_rssb12130-cit-0058","first-page":"211","article-title":"Sparse Bayesian learning and the relevance vector machine","volume":"1","author":"Tipping","year":"2001","journal-title":"J. Mach. Learn. Res."},{"key":"2023021801095671800_rssb12130-cit-0059","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000001","article-title":"Graphical models, exponential families, and variational inference","volume":"1","author":"Wainwright","year":"2008","journal-title":"Found. Trends Mach. Learn."},{"key":"2023021801095671800_rssb12130-cit-0060","volume-title":"The Laplace Transform","author":"Widder","year":"1946"},{"key":"2023021801095671800_rssb12130-cit-0061","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1214\/09-AOS729","article-title":"Nearly unbiased variable selection under minimax concave penalty","volume":"38","author":"Zhang","year":"2010","journal-title":"Ann. Statist."},{"key":"2023021801095671800_rssb12130-cit-0062","first-page":"1027","volume-title":"Proc. 27th Conf. Artificial Intelligence","author":"Zhang","year":"2013"},{"key":"2023021801095671800_rssb12130-cit-0063","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1214\/10-STS336","article-title":"Graphics processing units and high-dimensional optimization","volume":"25","author":"Zhou","year":"2010","journal-title":"Statist. Sci."},{"key":"2023021801095671800_rssb12130-cit-0064","first-page":"1509","article-title":"One-step sparse estimates in nonconcave penalized likelihood models","volume":"36","author":"Zou","year":"2008","journal-title":"Ann. Statist."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12130","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12130","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12130","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/78\/4\/701\/49232368\/jrsssb_78_4_701.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/78\/4\/701\/49232368\/jrsssb_78_4_701.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,11]],"date-time":"2024-06-11T21:33:55Z","timestamp":1718141635000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/78\/4\/701\/7040674"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,10,26]]},"references-count":65,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,10,26]]},"published-print":{"date-parts":[[2016,9,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12130","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2016,9]]},"published":{"date-parts":[[2015,10,26]]}}}