{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T14:19:01Z","timestamp":1793110741120,"version":"4.5.0"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2020,3,7]],"date-time":"2020-03-07T00:00:00Z","timestamp":1583539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Hamiltonian Monte Carlo has emerged as a standard tool for posterior computation. In this article we present an extension that can efficiently explore target distributions with discontinuous densities. Our extension in particular enables efficient sampling from ordinal parameters through the embedding of probability mass functions into continuous spaces. We motivate our approach through a theory of discontinuous Hamiltonian dynamics and develop a corresponding numerical solver. The proposed solver is the first of its kind, with a remarkable ability to exactly preserve the Hamiltonian. We apply our algorithm to challenging posterior inference problems to demonstrate its wide applicability and competitive performance.<\/jats:p>","DOI":"10.1093\/biomet\/asz083","type":"journal-article","created":{"date-parts":[[2019,12,26]],"date-time":"2019-12-26T12:07:50Z","timestamp":1577362070000},"page":"365-380","source":"Crossref","is-referenced-by-count":36,"title":["Discontinuous Hamiltonian Monte Carlo for discrete parameters and discontinuous likelihoods"],"prefix":"10.1093","volume":"107","author":[{"given":"Akihiko","family":"Nishimura","sequence":"first","affiliation":[{"name":"Department of Biomathematics, University of California - Los Angeles, 695 Charles E. Young Dr. S., Los Angeles, California 90095, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David B","family":"Dunson","sequence":"additional","affiliation":[{"name":"Department of Statistical Science, Duke University, Box 90251, Durham, North Carolina 27708, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianfeng","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Duke University, Box 90320, Durham, North Carolina 27708, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,3,7]]},"reference":[{"key":"2021031104175143300_B1","first-page":"3007","author":"Afshar,","year":"2015","journal-title":"Proc. 28th Int. Conf. on Neural Information Processing Systems"},{"key":"2021031104175143300_B2","first-page":"1","author":"Ambrosio,","year":"2008","journal-title":"Calculus of Variations and Nonlinear Partial Differential Equations"},{"key":"2021031104175143300_B3","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1007\/s11222-008-9110-y","article-title":"A tutorial on adaptive MCMC","volume":"18","author":"Andrieu,","year":"2008","journal-title":"Statist. Comp."},{"key":"2021031104175143300_B4","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1080\/01621459.2012.682538","article-title":"Objective priors for discrete parameter spaces","volume":"107","author":"Berger,","year":"2012","journal-title":"J. Am. Statist. Assoc."},{"key":"2021031104175143300_B5","doi-asserted-by":"crossref","first-page":"1501","DOI":"10.3150\/12-BEJ414","article-title":"Optimal tuning of the hybrid Monte Carlo algorithm","volume":"19","author":"Beskos,","year":"2013","journal-title":"Bernoulli"},{"key":"2021031104175143300_B6","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1111\/rssb.12158","article-title":"A general framework for updating belief distributions","volume":"78","author":"Bissiri,","year":"2016","journal-title":"J. R. Statist. Soc."},{"key":"2021031104175143300_B7","doi-asserted-by":"crossref","first-page":"2159","DOI":"10.1214\/16-AAP1255","article-title":"Randomized Hamiltonian Monte Carlo","volume":"27","author":"Bou-Rabee,","year":"2017","journal-title":"Ann. Appl. Prob."},{"key":"2021031104175143300_B8","article-title":"The Stan math library: Reverse-mode automatic differentiation in C++","author":"Carpenter,","year":"2015"},{"key":"2021031104175143300_B9","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/S0304-4076(97)00115-2","article-title":"Estimation and comparison of multiple change-point models","volume":"86","author":"Chib,","year":"1998","journal-title":"J. Economet."},{"key":"2021031104175143300_B10","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1214\/16-STS581","article-title":"Leave Pima indians alone: Binary regression as a benchmark for Bayesian computation","volume":"32","author":"Chopin,","year":"2017","journal-title":"Statist. Sci."},{"key":"2021031104175143300_B11","first-page":"1009","volume":"70","author":"Dinh,","year":"2017","journal-title":"Proc. 34th Int. Conf. on Machine Learning"},{"key":"2021031104175143300_B12","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/0370-2693(87)91197-X","article-title":"Hybrid Monte Carlo","volume":"195","author":"Duane,","year":"1987","journal-title":"Phys. Lett. B"},{"key":"2021031104175143300_B13","article-title":"On the convergence of Hamiltonian Monte Carlo","author":"Durmus,","year":"2019"},{"key":"2021031104175143300_B14","doi-asserted-by":"crossref","first-page":"174108","DOI":"10.1063\/1.4874000","article-title":"Compressible generalized hybrid Monte Carlo","volume":"140","author":"Fang,","year":"2014","journal-title":"J. Chem. Phys."},{"key":"2021031104175143300_B15","doi-asserted-by":"crossref","DOI":"10.1201\/b16018","author":"Gelman,","year":"2013","journal-title":"Bayesian Data Analysis"},{"key":"2021031104175143300_B16","doi-asserted-by":"crossref","first-page":"530","DOI":"10.3102\/1076998615606113","article-title":"Stan: A probabilistic programming language for Bayesian inference and optimization","volume":"40","author":"Gelman,","year":"2015","journal-title":"J. Educ. Behav. Sci."},{"key":"2021031104175143300_B17","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1093\/oso\/9780198523567.003.0038","article-title":"Efficient Metropolis jumping rules","volume":"5","author":"Gelman,","year":"1996","journal-title":"Bayesian Statist."},{"key":"2021031104175143300_B18","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1201\/b10905-2","author":"Geyer,","year":"2011","journal-title":"Handbook of Markov Chain Monte Carlo"},{"key":"2021031104175143300_B19","doi-asserted-by":"crossref","DOI":"10.1137\/1.9780898717761","author":"Griewank,","year":"2008","journal-title":"Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation"},{"key":"2021031104175143300_B20","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1023\/A:1008880707168","article-title":"A guided walk Metropolis algorithm","volume":"8","author":"Gustafson,","year":"1998","journal-title":"Statist. Comp."},{"key":"2021031104175143300_B21","doi-asserted-by":"crossref","first-page":"223","DOI":"10.2307\/3318737","article-title":"An adaptive Metropolis algorithm","volume":"7","author":"Haario,","year":"2001","journal-title":"Bernoulli"},{"key":"2021031104175143300_B22","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1007\/BF02789703","article-title":"Componentwise adaptation for high-dimensional MCMC","volume":"20","author":"Haario,","year":"2005","journal-title":"Comp. Statist."},{"key":"2021031104175143300_B23","author":"Hairer,","year":"2006","journal-title":"Geometric Numerical Integration. Structure-Preserving Algorithms for Ordinary Differential Equations"},{"key":"2021031104175143300_B24","author":"Hirsch,","year":"1974","journal-title":"Differential Equations, Dynamical Systems, and Linear Algebra"},{"key":"2021031104175143300_B25","first-page":"1593","article-title":"The no-U-turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo","volume":"15","author":"Hoffman,","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2021031104175143300_B26","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1214\/13-STS423","article-title":"Component-wise Markov chain Monte Carlo: Uniform and geometric ergodicity under mixing and composition","volume":"28","author":"Johnson,","year":"2013","journal-title":"Statist. Sci."},{"key":"2021031104175143300_B27","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1093\/biomet\/52.1-2.225","article-title":"Explicit estimates from capture\u2013recapture data with both death and immigration-stochastic model","volume":"52","author":"Jolly,","year":"1965","journal-title":"Biometrika"},{"key":"2021031104175143300_B28","author":"Kruschke,","year":"2014","journal-title":"Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan"},{"key":"2021031104175143300_B29","article-title":"On the geometric ergodicity of Hamiltonian Monte Carlo","author":"Livingstone,","year":"2018"},{"key":"2021031104175143300_B30","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1093\/biomet\/asz013","article-title":"Kinetic energy choice in Hamiltonian\/hybrid Monte Carlo","volume":"106","author":"Livingstone,","year":"2019","journal-title":"Biometrika"},{"key":"2021031104175143300_B31","first-page":"1236","volume":"54","author":"Lu,","year":"2017","journal-title":"Proc. 20th Int. Conf. on Artificial Intelligence and Statistics"},{"key":"2021031104175143300_B32","doi-asserted-by":"crossref","first-page":"3049","DOI":"10.1002\/sim.3680","article-title":"The BUGS project: Evolution, critique and future directions","volume":"28","author":"Lunn,","year":"2009","journal-title":"Statist. Med."},{"key":"2021031104175143300_B33","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1017\/S0962492902000053","article-title":"Splitting methods","volume":"11","author":"McLachlan,","year":"2002","journal-title":"Acta Numerica"},{"key":"2021031104175143300_B34","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1063\/1.1699114","article-title":"Equation of state calculations by fast computing machines","volume":"21","author":"Metropolis,","year":"1953","journal-title":"J. Chem. Phys."},{"key":"2021031104175143300_B35","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1111\/2041-210X.12681","article-title":"Faster estimation of Bayesian models in ecology using Hamiltonian Monte Carlo","volume":"8","author":"Monnahan,","year":"2017","journal-title":"Meth. Ecol. Evol."},{"key":"2021031104175143300_B36","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1080\/07350015.2012.747847","article-title":"Bayesian analysis of latent threshold dynamic models","volume":"31","author":"Nakajima,","year":"2013","journal-title":"J. Bus. Econ. Statist."},{"key":"2021031104175143300_B37","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-0745-0","author":"Neal,","year":"1996","journal-title":"Bayesian Learning for Neural Networks"},{"key":"2021031104175143300_B38","author":"Neal,","year":"2010","journal-title":"Handbook of Markov Chain Monte Carlo"},{"key":"2021031104175143300_B39","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1111\/j.0006-341X.2004.00184.x","article-title":"Bayesian isotonic regression and trend analysis","volume":"60","author":"Neelon,","year":"2004","journal-title":"Biometrics"},{"key":"2021031104175143300_B40","first-page":"2490","author":"Pakman,","year":"2013","journal-title":"Proc. 26th Int. Conf. on Neural Information Processing Systems"},{"key":"2021031104175143300_B41","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1214\/aoap\/1034625254","article-title":"Weak convergence and optimal scaling of random walk Metropolis algorithms","volume":"7","author":"Roberts,","year":"1997","journal-title":"Ann. Appl. Prob."},{"key":"2021031104175143300_B42","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1198\/jcgs.2009.06134","article-title":"Examples of adaptive MCMC","volume":"18","author":"Roberts,","year":"2009","journal-title":"J. Comp. Graph. Statist."},{"key":"2021031104175143300_B43","doi-asserted-by":"crossref","first-page":"e55","DOI":"10.7717\/peerj-cs.55","article-title":"Probabilistic programming in Python using PyMC3","volume":"2","author":"Salvatier,","year":"2016","journal-title":"PeerJ Comp. Sci."},{"key":"2021031104175143300_B44","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1214\/ss\/1009212521","article-title":"Estimating animal abundance: Review III","volume":"14","author":"Schwarz,","year":"1999","journal-title":"Statist. Sci."},{"key":"2021031104175143300_B45","author":"Seber,","year":"1982","journal-title":"The Estimation of Animal Abundance"},{"key":"2021031104175143300_B46","volume-title":"Stan Modeling Language Users Guide and Reference Manual, Version 2.14.0","year":"2016"},{"key":"2021031104175143300_B47","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1137\/S0036144599360110","article-title":"Rigid-body dynamics with friction and impact","volume":"42","author":"Stewart,","year":"2000","journal-title":"SIAM Rev."},{"key":"2021031104175143300_B48","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1214\/17-BA1084","article-title":"Designing simple and efficient Markov chain Monte Carlo proposal kernels","volume":"13","author":"Thawornwattana,","year":"2018","journal-title":"Bayesian Anal."},{"key":"2021031104175143300_B49","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1046\/j.1365-2710.2002.00430.x","article-title":"Segmented regression analysis of interrupted time series studies in medication use research","volume":"27","author":"Wagner,","year":"2002","journal-title":"J. Clin. Pharm. Therap."},{"key":"2021031104175143300_B50","first-page":"3194","article-title":"Continuous relaxations for discrete Hamiltonian Monte Carlo","author":"Zhang,","year":"2012","journal-title":"Proc. 25th Int. Conf. on Neural Information Processing Systems"},{"key":"2021031104175143300_B51","first-page":"1741","volume":"29","author":"Zhang,","year":"2016","journal-title":"Advances in Neural Information Processing Systems"}],"container-title":["Biometrika"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/biomet\/article-pdf\/107\/2\/365\/33218134\/asz083.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/biomet\/article-pdf\/107\/2\/365\/33218134\/asz083.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T05:19:30Z","timestamp":1722230370000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/biomet\/article\/107\/2\/365\/5799014"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,7]]},"references-count":51,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,3,7]]},"published-print":{"date-parts":[[2020,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/biomet\/asz083","relation":{},"ISSN":["0006-3444","1464-3510"],"issn-type":[{"value":"0006-3444","type":"print"},{"value":"1464-3510","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,6]]},"published":{"date-parts":[[2020,3,7]]}}}