{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:35:35Z","timestamp":1760236535571,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T00:00:00Z","timestamp":1638230400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Markov chain Monte Carlo (MCMC) techniques are usually used to infer model parameters when closed-form inference is not feasible, with one of the simplest MCMC methods being the random walk Metropolis\u2013Hastings (MH) algorithm. The MH algorithm suffers from random walk behaviour, which results in inefficient exploration of the target posterior distribution. This method has been improved upon, with algorithms such as Metropolis Adjusted Langevin Monte Carlo (MALA) and Hamiltonian Monte Carlo being examples of popular modifications to MH. In this work, we revisit the MH algorithm to reduce the autocorrelations in the generated samples without adding significant computational time. We present the: (1) Stochastic Volatility Metropolis\u2013Hastings (SVMH) algorithm, which is based on using a random scaling matrix in the MH algorithm, and (2) Locally Scaled Metropolis\u2013Hastings (LSMH) algorithm, in which the scaled matrix depends on the local geometry of the target distribution. For both these algorithms, the proposal distribution is still Gaussian centred at the current state. The empirical results show that these minor additions to the MH algorithm significantly improve the effective sample rates and predictive performance over the vanilla MH method. The SVMH algorithm produces similar effective sample sizes to the LSMH method, with SVMH outperforming LSMH on an execution time normalised effective sample size basis. The performance of the proposed methods is also compared to the MALA and the current state-of-art method being the No-U-Turn sampler (NUTS). The analysis is performed using a simulation study based on Neal\u2019s funnel and multivariate Gaussian distributions and using real world data modeled using jump diffusion processes and Bayesian logistic regression. Although both MALA and NUTS outperform the proposed algorithms on an effective sample size basis, the SVMH algorithm has similar or better predictive performance when compared to MALA and NUTS across the various targets. In addition, the SVMH algorithm outperforms the other MCMC algorithms on a normalised effective sample size basis on the jump diffusion processes datasets. These results indicate the overall usefulness of the proposed algorithms.<\/jats:p>","DOI":"10.3390\/a14120351","type":"journal-article","created":{"date-parts":[[2021,11,30]],"date-time":"2021-11-30T20:29:27Z","timestamp":1638304167000},"page":"351","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Locally Scaled and Stochastic Volatility Metropolis\u2013 Hastings Algorithms"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2832-3584","authenticated-orcid":false,"given":"Wilson Tsakane","family":"Mongwe","sequence":"first","affiliation":[{"name":"School of Electrical Engineering, University of Johannesburg, Auckland Park, Johannesburg 2000, South Africa"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7337-9176","authenticated-orcid":false,"given":"Rendani","family":"Mbuvha","sequence":"additional","affiliation":[{"name":"School of Statistics and Actuarial Science, University of Witwatersrand, Johannesburg 2000, South Africa"}]},{"given":"Tshilidzi","family":"Marwala","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, University of Johannesburg, Auckland Park, Johannesburg 2000, South Africa"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,30]]},"reference":[{"key":"ref_1","unstructured":"Neal, R.M. (1993). Bayesian learning via stochastic dynamics. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_2","unstructured":"Neal, R.M. (2021, November 27). MCMC Using Hamiltonian Dynamics. Available online: https:\/\/arxiv.org\/pdf\/1206.1901.pdf%20http:\/\/arxiv.org\/abs\/1206.1901."},{"key":"ref_3","unstructured":"Neal, R.M. (2012). Bayesian Learning for Neural Networks, Springer Science & Business Media."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1111\/j.1467-9868.2010.00765.x","article-title":"Riemann manifold langevin and hamiltonian monte carlo methods","volume":"73","author":"Girolami","year":"2011","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_5","unstructured":"Radivojevi\u0107, T., and Akhmatskaya, E. (2017). Mix & Match Hamiltonian Monte Carlo. arXiv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"49857","DOI":"10.1109\/ACCESS.2021.3069196","article-title":"Antithetic Magnetic and Shadow Hamiltonian Monte Carlo","volume":"9","author":"Mongwe","year":"2021","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mongwe, W.T., Mbuvha, R., and Marwala, T. (2021). Antithetic Riemannian Manifold And Quantum-Inspired Hamiltonian Monte Carlo. arXiv.","DOI":"10.1371\/journal.pone.0258277"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mbuvha, R., and Marwala, T. (2020). Bayesian inference of COVID-19 spreading rates in South Africa. PLoS ONE, 15.","DOI":"10.1101\/2020.04.28.20083873"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"108009","DOI":"10.1109\/ACCESS.2021.3101810","article-title":"Magnetic Hamiltonian Monte Carlo With Partial Momentum Refreshment","volume":"9","author":"Mongwe","year":"2021","journal-title":"IEEE Access"},{"key":"ref_10","unstructured":"Mbuvha, R. (2021). Parameter Inference Using Probabilistic Techniques. [Ph.D. Thesis, University Of Johannesburg]."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"100108","DOI":"10.1016\/j.egyai.2021.100108","article-title":"Separable Shadow Hamiltonian Hybrid Monte Carlo for Bayesian Neural Network Inference in wind speed forecasting","volume":"6","author":"Mbuvha","year":"2021","journal-title":"Energy AI"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1093\/biomet\/57.1.97","article-title":"Monte Carlo sampling methods using Markov chains and their applications","volume":"57","author":"Hastings","year":"1970","journal-title":"Biometrika"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1023\/A:1023562417138","article-title":"Langevin diffusions and Metropolis-Hastings algorithms","volume":"4","author":"Roberts","year":"2002","journal-title":"Methodol. Comput. Appl. Probab."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/0370-2693(87)91197-X","article-title":"Hybrid monte carlo","volume":"195","author":"Duane","year":"1987","journal-title":"Phys. Lett. B"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"174106","DOI":"10.1063\/1.3253687","article-title":"A separable shadow Hamiltonian hybrid Monte Carlo method","volume":"131","author":"Sweet","year":"2009","journal-title":"J. Chem. Phys."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"138598","DOI":"10.1109\/ACCESS.2021.3118728","article-title":"Adaptively Setting the Path Length for Separable Shadow Hamiltonian Hybrid Monte Carlo","volume":"9","author":"Mongwe","year":"2021","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"151235","DOI":"10.1109\/ACCESS.2021.3126812","article-title":"Utilising Partial Momentum Refreshment in Separable Shadow Hamiltonian Hybrid Monte Carlo","volume":"9","author":"Mongwe","year":"2021","journal-title":"IEEE Access"},{"key":"ref_18","unstructured":"Tripuraneni, N., Rowland, M., Ghahramani, Z., and Turner, R. (2017, January 6\u201311). Magnetic hamiltonian monte carlo. Proceedings of the International Conference on Machine Learning (PMLR), Sydney, Australia."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mongwe, W.T., Mbuvha, R., and Marwala, T. (2021). Quantum-Inspired Magnetic Hamiltonian Monte Carlo. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0258277"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"152993","DOI":"10.1109\/ACCESS.2021.3127931","article-title":"Adaptive Magnetic Hamiltonian Monte Carlo","volume":"9","author":"Mongwe","year":"2021","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6094","DOI":"10.1016\/j.spa.2020.05.004","article-title":"Optimal scaling of random-walk metropolis algorithms on general target distributions","volume":"130","author":"Yang","year":"2020","journal-title":"Stoch. Process. Their Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1214\/ss\/1015346320","article-title":"Optimal scaling for various Metropolis-Hastings algorithms","volume":"16","author":"Roberts","year":"2001","journal-title":"Stat. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1214\/20-AAP1612","article-title":"Counterexamples for optimal scaling of Metropolis\u2013Hastings chains with rough target densities","volume":"31","author":"Vogrinc","year":"2021","journal-title":"Ann. Appl. Probab."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/s11222-014-9510-0","article-title":"Particle Metropolis\u2013Hastings using gradient and Hessian information","volume":"25","author":"Dahlin","year":"2015","journal-title":"Stat. Comput."},{"key":"ref_25","unstructured":"Liu, Z., and Zhang, Z. (2019). Quantum-Inspired Hamiltonian Monte Carlo for Bayesian Sampling. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/0304-405X(76)90022-2","article-title":"Option pricing when underlying stock returns are discontinuous","volume":"3","author":"Merton","year":"1976","journal-title":"J. Financ. Econ."},{"key":"ref_27","unstructured":"Levy, D., Hoffman, M.D., and Sohl-Dickstein, J. (2017). Generalizing hamiltonian monte carlo with neural networks. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yan, G., and Hanson, F.B. (2006, January 14\u201316). Option pricing for a stochastic-volatility jump-diffusion model with log-uniform jump-amplitudes. Proceedings of the 2006 American Control Conference, Minneapolis, MN, USA.","DOI":"10.1109\/ACC.2007.4283124"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Brooks, S., Gelman, A., Jones, G., and Meng, X.L. (2011). Handbook of Markov Chain Monte Carlo, CRC Press.","DOI":"10.1201\/b10905"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Betancourt, M. (2017). A conceptual introduction to Hamiltonian Monte Carlo. arXiv.","DOI":"10.3150\/16-BEJ810"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"31595","DOI":"10.1109\/ACCESS.2020.2972611","article-title":"Neural Langevin Dynamical Sampling","volume":"8","author":"Gu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_32","first-page":"1593","article-title":"The No-U-turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo","volume":"15","author":"Hoffman","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_33","unstructured":"Afshar, H.M., Oliveira, R., and Cripps, S. (2021, January 13\u201315). Non-Volume Preserving Hamiltonian Monte Carlo and No-U-TurnSamplers. Proceedings of the International Conference on Artificial Intelligence and Statistics (PMLR), Virtual Conference."},{"key":"ref_34","unstructured":"Betancourt, M.J. (2013). Generalizing the no-U-turn sampler to Riemannian manifolds. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Betancourt, M. (2013, January 28\u201330). A general metric for Riemannian manifold Hamiltonian Monte Carlo. Proceedings of the International Conference on Geometric Science of Information, Paris, France.","DOI":"10.1007\/978-3-642-40020-9_35"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1093\/biomet\/asz002","article-title":"Multivariate output analysis for Markov chain Monte Carlo","volume":"106","author":"Vats","year":"2019","journal-title":"Biometrika"},{"key":"ref_37","unstructured":"Hoffman, M.D., and Gelman, A. (2011). The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1007\/s11222-008-9110-y","article-title":"A tutorial on adaptive MCMC","volume":"18","author":"Andrieu","year":"2008","journal-title":"Stat. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1214\/aos\/1056562461","article-title":"Slice sampling","volume":"31","author":"Neal","year":"2003","journal-title":"Ann. Stat."},{"key":"ref_40","first-page":"2","article-title":"Hamiltonian Monte Carlo for hierarchical models","volume":"Volume 79","author":"Betancourt","year":"2015","journal-title":"Current Trends in Bayesian Methodology with Applications"},{"key":"ref_41","unstructured":"Heide, C., Roosta, F., Hodgkinson, L., and Kroese, D. (2021, January 13\u201315). Shadow Manifold Hamiltonian Monte Carlo. Proceedings of the International Conference on Artificial Intelligence and Statistics (PMLR), Virtual Conference."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1080\/713665670","article-title":"Empirical properties of asset returns: Stylized facts and statistical issues","volume":"1","author":"Cont","year":"2001","journal-title":"Quant. Financ."},{"key":"ref_43","unstructured":"Mongwe, W.T. (2015). Analysis of Equity and Interest Rate Returns in South Africa under the Context of Jump Diffusion Processes. [Master\u2019s Thesis, University of Cape Town]."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.jeconom.2020.07.006","article-title":"Closed-form implied volatility surfaces for stochastic volatility models with jumps","volume":"222","author":"Li","year":"2021","journal-title":"J. Econom."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"123100","DOI":"10.1016\/j.physa.2019.123100","article-title":"Pricing options under simultaneous stochastic volatility and jumps: A simple closed-form formula without numerical\/computational methods","volume":"540","author":"Alghalith","year":"2020","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1450045","DOI":"10.1142\/S0219024914500459","article-title":"The Heston stochastic-local volatility model: Efficient Monte Carlo simulation","volume":"17","author":"Grzelak","year":"2014","journal-title":"Int. J. Theor. Appl. Financ."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1086\/294980","article-title":"A compound events model for security prices","volume":"40","author":"Press","year":"1967","journal-title":"J. Bus."},{"key":"ref_48","unstructured":"(2021, August 15). Google-Finance. Google Finance. Available online: https:\/\/www.google.com\/finance\/."},{"key":"ref_49","unstructured":"Michie, D., Spiegelhalter, D.J., Taylor, C.C., and Campbell, J. (1995). Machine Learning, Neural and Statistical Classification, Ellis Horwood."},{"key":"ref_50","first-page":"74","article-title":"A Survey of Automated Financial Statement Fraud Detection with Relevance to the South African Context","volume":"32","author":"Mongwe","year":"2020","journal-title":"South Afr. Comput. J."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Mongwe, W.T., and Malan, K.M. (2020, January 1\u20134). The Efficacy of Financial Ratios for Fraud Detection Using Self Organising Maps. Proceedings of the 2020 IEEE Symposium Series on Computational Intelligence (SSCI), Canberra, Australia.","DOI":"10.1109\/SSCI47803.2020.9308602"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/14\/12\/351\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:38:03Z","timestamp":1760168283000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/14\/12\/351"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,30]]},"references-count":51,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["a14120351"],"URL":"https:\/\/doi.org\/10.3390\/a14120351","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2021,11,30]]}}}