{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:33:47Z","timestamp":1750221227707,"version":"3.41.0"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T00:00:00Z","timestamp":1748217600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T00:00:00Z","timestamp":1748217600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"University of Stavanger & Stavanger University Hospital"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>We propose a generic approach for numerically efficient simulation from analytically intractable distributions with constrained support. Our approach relies upon Generalized Randomized Hamiltonian Monte Carlo (GRHMC) processes and combines these with a randomized transition kernel that appropriately adjusts the Hamiltonian flow at the boundary of the constrained domain, ensuring that it remains within the domain. The numerical implementation of this constrained GRHMC process exploits the sparsity of the randomized transition kernel and the specific structure of the constraints so that the proposed approach is numerically accurate, computationally fast and operational even in high-dimensional applications. We illustrate this approach with posterior distributions of several Bayesian models with challenging parameter domain constraints in applications to real-word data sets. Building on the capability of GRHMC processes to efficiently explore otherwise challenging and high-dimensional posteriors, the proposed method expands the set of Bayesian models that can be analyzed by using the standard Markov-Chain Monte-Carlo (MCMC) methodology, As such, it can advance the development and use of Bayesian models with useful constrained priors, which are difficult to handle with existing methods. The article is accompanied by an R-package (<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/torekleppe\/pdmphmc\" ext-link-type=\"uri\">https:\/\/github.com\/torekleppe\/pdmphmc<\/jats:ext-link>), which allows for automatically implementing GRHMC processes for arbitrary target distributions and domain constraints.<\/jats:p>","DOI":"10.1007\/s11222-025-10637-3","type":"journal-article","created":{"date-parts":[[2025,5,26]],"date-time":"2025-05-26T20:01:42Z","timestamp":1748289702000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Numerical Generalized Randomized HMC processes for restricted domains"],"prefix":"10.1007","volume":"35","author":[{"given":"Tore Selland","family":"Kleppe","sequence":"first","affiliation":[]},{"given":"Roman","family":"Liesenfeld","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,5,26]]},"reference":[{"issue":"2","key":"10637_CR1","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1093\/jjfinec\/nbaa018","volume":"20","author":"R Agrawal","year":"2020","unstructured":"Agrawal, R., Roy, U., Uhler, C.: Covariance Matrix Estimation under Total Positivity for Portfolio Selection*. Journal of Financial Econometrics 20(2), 367\u2013389 (2020)","journal-title":"Journal of Financial Econometrics"},{"issue":"422","key":"10637_CR2","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1080\/01621459.1993.10476321","volume":"88","author":"JH Albert","year":"1993","unstructured":"Albert, J.H., Chib, S.: Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association 88(422), 669\u2013679 (1993)","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"10637_CR3","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1063\/1.3573613","volume":"1305","author":"M Betancourt","year":"2011","unstructured":"Betancourt, M.: Nested Sampling with Constrained Hamiltonian Monte Carlo. AIP Conference Proceedings 1305(1), 165\u2013172 (2011)","journal-title":"AIP Conference Proceedings"},{"key":"10637_CR4","doi-asserted-by":"crossref","unstructured":"Bierkens, J., Bouchard-C\u00f4t\u00e9, A., Doucet, A., Duncan, A.B., Fearnhead, P., Lienart, T., Roberts, G., Vollmer, S.J.: Piecewise deterministic Markov processes for scalable Monte Carlo on restricted domains. Statistics & Probability Letters 136, 148\u2013154 (2018). The role of Statistics in the era of big data","DOI":"10.1016\/j.spl.2018.02.021"},{"key":"10637_CR5","unstructured":"Bierkens, J., Grazzi, S., Roberts, G., Schauer, M.: Methods and applications of pdmp samplers with boundary conditions (2023). arXiv:2303.08023"},{"issue":"4","key":"10637_CR6","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/0893-9659(89)90079-7","volume":"2","author":"P Bogacki","year":"1989","unstructured":"Bogacki, P., Shampine, L.: A 3(2) pair of Runge - Kutta formulas. Applied Mathematics Letters 2(4), 321\u2013325 (1989)","journal-title":"Applied Mathematics Letters"},{"issue":"2","key":"10637_CR7","doi-asserted-by":"publisher","first-page":"916","DOI":"10.1214\/21-AIHP1197","volume":"58","author":"N Bou-Rabee","year":"2022","unstructured":"Bou-Rabee, N., Eberle, A.: Couplings for Andersen dynamics. Annales de l\u2019Institut Henri Poincar\u00e9, Probabilit\u00e9s et Statistiques 58(2), 916\u2013944 (2022)","journal-title":"Annales de l\u2019Institut Henri Poincar\u00e9, Probabilit\u00e9s et Statistiques"},{"issue":"4","key":"10637_CR8","doi-asserted-by":"publisher","first-page":"2159","DOI":"10.1214\/16-AAP1255","volume":"27","author":"N Bou-Rabee","year":"2017","unstructured":"Bou-Rabee, N., Sanz-Serna, J.M.: Randomized Hamiltonian Monte Carlo. Ann. Appl. Probab. 27(4), 2159\u20132194 (2017)","journal-title":"Ann. Appl. Probab."},{"issue":"4","key":"10637_CR9","doi-asserted-by":"publisher","first-page":"434","DOI":"10.1080\/10618600.1998.10474787","volume":"7","author":"SP Brooks","year":"1998","unstructured":"Brooks, S.P., Gelman, A.: General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics 7(4), 434\u2013455 (1998)","journal-title":"Journal of Computational and Graphical Statistics"},{"issue":"1","key":"10637_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v076.i01","volume":"76","author":"B Carpenter","year":"2017","unstructured":"Carpenter, B., Gelman, A., Hoffman, M., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., Riddell, A.: Stan: A probabilistic programming language. Journal of Statistical Software 76(1), 1\u201332 (2017)","journal-title":"Journal of Statistical Software"},{"issue":"7","key":"10637_CR11","doi-asserted-by":"publisher","first-page":"2026","DOI":"10.1016\/j.jbankfin.2012.03.008","volume":"36","author":"A Carriero","year":"2012","unstructured":"Carriero, A., Kapetanios, G., Marcellino, M.: Forecasting government bond yields with large Bayesian vector autoregressions. Journal of Banking & Finance 36(7), 2026\u20132047 (2012)","journal-title":"Journal of Banking & Finance"},{"key":"10637_CR12","unstructured":"Chevallier, A., Power, S., Wang, A.\u00a0Q., Fearnhead, P.: Pdmp Monte Carlo methods for piecewise-smooth densities (2021). arXiv:2111.05859"},{"issue":"1","key":"10637_CR13","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1214\/16-STS581","volume":"32","author":"N Chopin","year":"2017","unstructured":"Chopin, N., Ridgway, J.: Leave Pima Indians Alone: Binary Regression as a Benchmark for Bayesian Computation. Statistical Science 32(1), 64\u201387 (2017)","journal-title":"Statistical Science"},{"key":"10637_CR14","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4483-2","volume-title":"Markov models and optimization","author":"MHA Davis","year":"1993","unstructured":"Davis, M.H.A.: Markov models and optimization. Chapman & Hall, London (1993)"},{"issue":"12","key":"10637_CR15","doi-asserted-by":"publisher","first-page":"937","DOI":"10.1016\/0898-1221(87)90066-6","volume":"13","author":"J Dormand","year":"1987","unstructured":"Dormand, J., Prince, P.: Runge-Kutta-Nystrom triples. Computers & Mathematics with Applications 13(12), 937\u2013949 (1987)","journal-title":"Computers & Mathematics with Applications"},{"issue":"3","key":"10637_CR16","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1214\/18-STS648","volume":"33","author":"P Fearnhead","year":"2018","unstructured":"Fearnhead, P., Bierkens, J., Pollock, M., Roberts, G.O.: Piecewise deterministic Markov processes for continuous-time monte carlo. Statist. Sci. 33(3), 386\u2013412 (2018)","journal-title":"Statist. Sci."},{"issue":"4","key":"10637_CR17","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1214\/ss\/1177011136","volume":"7","author":"A Gelman","year":"1992","unstructured":"Gelman, A., Rubin, D.B.: Inference from iterative simulation using multiple sequences. Statistical Science 7(4), 457\u2013472 (1992)","journal-title":"Statistical Science"},{"issue":"4","key":"10637_CR18","first-page":"473","volume":"7","author":"CJ Geyer","year":"1992","unstructured":"Geyer, C.J.: Practical Markov chain Monte Carlo. Statistical Science 7(4), 473\u2013483 (1992)","journal-title":"Statistical Science"},{"issue":"3","key":"10637_CR19","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1214\/12-BA719","volume":"7","author":"RB Gramacy","year":"2012","unstructured":"Gramacy, R.B., Polson, N.G.: Simulation-based Regularized Logistic Regression. Bayesian Analysis 7(3), 567\u2013590 (2012)","journal-title":"Bayesian Analysis"},{"key":"10637_CR20","unstructured":"Hairer, E., N\u00f8rsett, S.\u00a0P., Wanner, G.: Solving Ordinary Differential Equations I (2nd Revised. Ed.): Nonstiff Problems. Berlin, Heidelberg: Springer-Verlag (1993)"},{"key":"10637_CR21","unstructured":"Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning. Springer. Corrected 12th printing (2017)"},{"key":"10637_CR22","unstructured":"Hindmarsh, A.\u00a0C.: Odepack, a systematized collection of ODE solvers. In R.\u00a0Stepleman (Ed.), Scientific Computing. Applications of Mathematics and Computing to the Physical Sciences, pp. 55\u201364. Amsterdam: IMACS \/ North-Holland (1983)"},{"issue":"2","key":"10637_CR23","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1109\/MCI.2022.3155327","volume":"17","author":"LV Jospin","year":"2022","unstructured":"Jospin, L.V., Laga, H., Boussaid, F., Buntine, W., Bennamoun, M.: Hands-on Bayesian neural networks - a tutorial for deep learning users. IEEE Computational Intelligence Magazine 17(2), 29\u201348 (2022)","journal-title":"IEEE Computational Intelligence Magazine"},{"issue":"3","key":"10637_CR24","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1080\/10618600.2019.1584901","volume":"28","author":"TS Kleppe","year":"2019","unstructured":"Kleppe, T.S.: Dynamically rescaled Hamiltonian Monte Carlo for Bayesian hierarchical models. Journal of Computational and Graphical Statistics 28(3), 493\u2013507 (2019)","journal-title":"Journal of Computational and Graphical Statistics"},{"issue":"4","key":"10637_CR25","doi-asserted-by":"publisher","first-page":"1238","DOI":"10.1080\/10618600.2022.2066679","volume":"31","author":"TS Kleppe","year":"2022","unstructured":"Kleppe, T.S.: Connecting the dots: Numerical randomized Hamiltonian Monte Carlo with state-dependent event rates. Journal of Computational and Graphical Statistics 31(4), 1238\u20131253 (2022)","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"10637_CR26","doi-asserted-by":"crossref","unstructured":"Kleppe, T.\u00a0S.: Log-density gradient covariance and automatic metric tensors for Riemann manifold Monte Carlo methods. Scandinavian Journal of Statistics. Forthcoming (2024)","DOI":"10.1111\/sjos.12705"},{"key":"10637_CR27","unstructured":"Kook, Y., Lee, Y.\u00a0T., Shen, R., Vempala, S.\u00a0S.: Sampling with riemannian Hamiltonian Monte Carlo in a constrained space. In Proceedings of the 36th International Conference on Neural Information Processing Systems, NIPS \u201922, Red Hook, NY, USA. Curran Associates Inc (2022)"},{"issue":"7","key":"10637_CR28","doi-asserted-by":"publisher","first-page":"1126","DOI":"10.1016\/j.jedc.2011.02.001","volume":"35","author":"G Koop","year":"2011","unstructured":"Koop, G., Potter, S.M.: Time varying vars with inequality restrictions. Journal of Economic Dynamics and Control 35(7), 1126\u20131138 (2011)","journal-title":"Journal of Economic Dynamics and Control"},{"issue":"4","key":"10637_CR29","doi-asserted-by":"publisher","first-page":"1835","DOI":"10.1214\/17-AOS1668","volume":"47","author":"S Lauritzen","year":"2019","unstructured":"Lauritzen, S., Uhler, C., Zwiernik, P.: Maximum likelihood estimation in Gaussian models under total positivity. The Annals of Statistics 47(4), 1835\u20131863 (2019)","journal-title":"The Annals of Statistics"},{"issue":"4","key":"10637_CR30","doi-asserted-by":"publisher","first-page":"110","DOI":"10.3905\/jpm.2004.110","volume":"30","author":"O Ledoit","year":"2004","unstructured":"Ledoit, O., Wolf, M.: Honey, i shrunk the sample covariance matrix. The Journal of Portfolio Management 30(4), 110\u2013119 (2004)","journal-title":"The Journal of Portfolio Management"},{"key":"10637_CR31","unstructured":"Leimkuhler, B., Sharma, A., Tretyakov, M.\u00a0V.: Numerical integrators for confined langevin dynamics (2024). arXiv:2404.16584"},{"key":"10637_CR32","first-page":"35","volume-title":"Spatial Econometrics: Qualitative and Limited Dependent Variables, Volume 37 of Advances in Econometrics","author":"R Liesenfeld","year":"2017","unstructured":"Liesenfeld, R., Richard, J.-F., Vogler, J.: Likelihood evaluation of high-dimensional spatial latent gaussian models with non-gaussian response variables. In: Baltagi, B.H., LeSage, J.P., Pace, R. (eds.) Spatial Econometrics: Qualitative and Limited Dependent Variables, Volume 37 of Advances in Econometrics, pp. 35\u201377. Emerald (2017)"},{"key":"10637_CR33","unstructured":"L\u00fctkepohl, H.: New Introduction to Multiple Time Series Analysis. Springer. Corrected 2nd printing (2007)"},{"issue":"1","key":"10637_CR34","first-page":"77","volume":"7","author":"H Markowitz","year":"1952","unstructured":"Markowitz, H.: Portfolio selection. The Journal of Finance 7(1), 77\u201391 (1952)","journal-title":"The Journal of Finance"},{"issue":"4","key":"10637_CR35","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1002\/jae.1220","volume":"27","author":"E Moench","year":"2012","unstructured":"Moench, E.: Term structure surprises: the predictive content of curvature, level, and slope. Journal of Applied Econometrics 27(4), 574\u2013602 (2012)","journal-title":"Journal of Applied Econometrics"},{"issue":"2","key":"10637_CR36","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1093\/biomet\/asz083","volume":"107","author":"A Nishimura","year":"2020","unstructured":"Nishimura, A., Dunson, D.B., Lu, J.: Discontinuous Hamiltonian Monte Carlo for discrete parameters and discontinuous likelihoods. Biometrika 107(2), 365\u2013380 (2020)","journal-title":"Biometrika"},{"issue":"2","key":"10637_CR37","doi-asserted-by":"publisher","first-page":"518","DOI":"10.1080\/10618600.2013.788448","volume":"23","author":"A Pakman","year":"2014","unstructured":"Pakman, A., Paninski, L.: Exact Hamiltonian Monte Carlo for truncated multivariate Gaussians. Journal of Computational and Graphical Statistics 23(2), 518\u2013542 (2014)","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"10637_CR38","volume-title":"Numerical Recipes: The Art of Scientific Computing","author":"WH Press","year":"2007","unstructured":"Press, W.H., Teukolsky, S.A., Vetterling, W.T., Flannery, B.P.: Numerical Recipes: The Art of Scientific Computing, 3rd edn. Cambridge University Press (2007)","edition":"3"},{"key":"10637_CR39","doi-asserted-by":"crossref","unstructured":"Reh, L., Kr\u00fcger, F., Liesenfeld, R.: Predicting the global minimum variance portfolio. Journal of Business & Economic Statistics, 440\u2013452. forthcoming (2023)","DOI":"10.1080\/07350015.2022.2035226"},{"key":"10637_CR40","volume-title":"Pattern Recognition and Neural Networks","author":"BD Ripley","year":"1986","unstructured":"Ripley, B.D.: Pattern Recognition and Neural Networks. Cambridge University Press (1986)"},{"issue":"1","key":"10637_CR41","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1017\/S0022109000002192","volume":"42","author":"L Sarno","year":"2007","unstructured":"Sarno, L., Thornton, D.L., Valente, G.: The empirical failure of the expectations hypothesis of the term structure of bond yields. Journal of Financial and Quantitative Analysis 42(1), 81\u2013100 (2007)","journal-title":"Journal of Financial and Quantitative Analysis"},{"issue":"1","key":"10637_CR42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1137\/S1064827594276424","volume":"18","author":"LF Shampine","year":"1997","unstructured":"Shampine, L.F., Reichelt, M.W.: The MATLAB ODE suite. SIAM Journal on Scientific Computing 18(1), 1\u201322 (1997)","journal-title":"SIAM Journal on Scientific Computing"},{"issue":"9","key":"10637_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v033.i09","volume":"33","author":"K Soetaert","year":"2010","unstructured":"Soetaert, K., Petzoldt, T., Setzer, R.W.: Solving differential equations in R: Package deSolve. Journal of Statistical Software 33(9), 1\u201325 (2010)","journal-title":"Journal of Statistical Software"},{"issue":"5","key":"10637_CR44","doi-asserted-by":"publisher","first-page":"1076","DOI":"10.1016\/S0022-5347(17)41175-X","volume":"141","author":"TA Stamey","year":"1989","unstructured":"Stamey, T.A., Kabalin, J.N., Mcneal, J.E., Johnstone, I.M., Freiha, F., Redwine, E.A., Yang, N.: Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate. ii. radical prostatectomy treated patients. The Journal of Urology 141(5), 1076\u20131083 (1989)","journal-title":"The Journal of Urology"},{"key":"10637_CR45","unstructured":"Stan Development Team: RStan: the R interface to Stan. R package version 2(26), 23 (2023)"},{"issue":"1","key":"10637_CR46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/aoap\/1027961031","volume":"8","author":"L Tierney","year":"1998","unstructured":"Tierney, L.: A note on Metropolis-Hastings kernels for general state spaces. The Annals of Applied Probability 8(1), 1\u20139 (1998)","journal-title":"The Annals of Applied Probability"},{"key":"10637_CR47","doi-asserted-by":"crossref","unstructured":"Tran, J.\u00a0H., Kleppe, T.\u00a0S.: Tuning diagonal scale matrices for HMC (2024). arXiv:2403.07495","DOI":"10.1007\/s11222-024-10494-6"},{"issue":"2","key":"10637_CR48","doi-asserted-by":"publisher","first-page":"667","DOI":"10.1214\/20-BA1221","volume":"16","author":"A Vehtari","year":"2021","unstructured":"Vehtari, A., Gelman, A., Simpson, D., Carpenter, B., B\u00fcrkner, P.-C.: Rank-Normalization, Folding, and Localization: An Improved $$\\widehat{R}$$ for Assessing Convergence of MCMC (with Discussion). Bayesian Analysis 16(2), 667\u2013718 (2021)","journal-title":"Bayesian Analysis"},{"key":"10637_CR49","unstructured":"Wu, C. Robert, C.\u00a0P.: Generalized bouncy particle sampler (2017). arXiv:1706.04781"}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-025-10637-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-025-10637-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-025-10637-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:04:22Z","timestamp":1750212262000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-025-10637-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,26]]},"references-count":49,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["10637"],"URL":"https:\/\/doi.org\/10.1007\/s11222-025-10637-3","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"type":"print","value":"0960-3174"},{"type":"electronic","value":"1573-1375"}],"subject":[],"published":{"date-parts":[[2025,5,26]]},"assertion":[{"value":"31 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 May 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"107"}}