{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T09:24:44Z","timestamp":1760606684953,"version":"3.37.3"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T00:00:00Z","timestamp":1656288000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T00:00:00Z","timestamp":1656288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["765710"],"award-info":[{"award-number":["765710"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["EXC-2094-390783311"],"award-info":[{"award-number":["EXC-2094-390783311"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Efficient sampling of many-dimensional and multimodal density functions is a task of great interest in many research fields. We describe an algorithm that allows parallelizing inherently serial Markov chain Monte Carlo (MCMC) sampling by partitioning the space of the function parameters into multiple subspaces and sampling each of them independently. The samples of the different subspaces are then reweighted by their integral values and stitched back together. This approach allows reducing sampling wall-clock time by parallel operation. It also improves sampling of multimodal target densities and results in less correlated samples. Finally, the approach yields an estimate of the integral of the target density function.<\/jats:p>","DOI":"10.1007\/s11222-022-10116-z","type":"journal-article","created":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T06:03:05Z","timestamp":1656309785000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Parallelizing MCMC sampling via space partitioning"],"prefix":"10.1007","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4320-6431","authenticated-orcid":false,"given":"Vasyl","family":"Hafych","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6354-5209","authenticated-orcid":false,"given":"Philipp","family":"Eller","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4200-5905","authenticated-orcid":false,"given":"Oliver","family":"Schulz","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0244-5129","authenticated-orcid":false,"given":"Allen","family":"Caldwel","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,6,27]]},"reference":[{"issue":"3","key":"10116_CR1","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1111\/j.1467-9868.2009.00736.x","volume":"72","author":"C Andrieu","year":"2010","unstructured":"Andrieu, C., Doucet, A., Holenstein, R.: Particle markov chain monte carlo methods. J. of the Royal Stat. Society: Ser. B (Statistical Methodology) 72(3), 269\u2013342 (2010)","journal-title":"J. of the Royal Stat. Society: Ser. B (Statistical Methodology)"},{"key":"10116_CR2","unstructured":"Basse, G., Smith, A., Pillai, N.: Parallel Markov chain Monte Carlo via spectral clustering. Artificial intelligence and statistics. 1318\u20131327 (2016)"},{"issue":"3","key":"10116_CR3","doi-asserted-by":"publisher","first-page":"758","DOI":"10.1016\/j.spa.2011.11.004","volume":"122","author":"M B\u00e9edard","year":"2012","unstructured":"B\u00e9edard, M., Douc, R., Moulines, E.: Scaling analysis of multiple-try MCMC methods. Stochastic Process. and their Appl. 122(3), 758\u2013786 (2012)","journal-title":"Stochastic Process. and their Appl."},{"issue":"4","key":"10116_CR4","doi-asserted-by":"publisher","first-page":"A1556","DOI":"10.1137\/130932740","volume":"36","author":"S Blanes","year":"2014","unstructured":"Blanes, S., Casas, F., Sanz-Serna, J.M.: Numerical integrators for the Hybrid Monte Carlo method. SIAM J. on Scientific Comput. 36(4), A1556\u2013A1580 (2014)","journal-title":"SIAM J. on Scientific Comput."},{"issue":"24","key":"10116_CR5","doi-asserted-by":"publisher","first-page":"2050142","DOI":"10.1142\/S0217751X20501420","volume":"35","author":"A Caldwell","year":"2020","unstructured":"Caldwell, A., et al.: Integration with an adaptive harmonic mean algorithm. International J. of Modern Phys. A 35(24), 2050142 (2020)","journal-title":"International J. of Modern Phys. A"},{"issue":"1","key":"10116_CR6","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/s10596-012-9313-3","volume":"17","author":"JN Carter","year":"2013","unstructured":"Carter, J.N., White, D.A.: History matching on the Imperial College fault model using parallel tempering. Comput. Geosciences 17(1), 43\u201365 (2013)","journal-title":"Comput. Geosciences"},{"issue":"1","key":"10116_CR7","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1214\/009053606000001154","volume":"35","author":"R Douc","year":"2007","unstructured":"Douc, R., et al.: Convergence of adaptive mixtures of importance sampling schemes. The Annals of Stat. 35(1), 420\u2013448 (2007)","journal-title":"The Annals of Stat."},{"issue":"2","key":"10116_CR8","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1016\/0370-2693(87)91197-X","volume":"195","author":"S Duane","year":"1987","unstructured":"Duane, S., et al.: Hybrid monte carlo. Phys. letters B 195(2), 216\u2013222 (1987)","journal-title":"Phys. letters B"},{"issue":"3","key":"10116_CR9","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1111\/j.1467-9574.2011.00515.x","volume":"66","author":"N Friel","year":"2012","unstructured":"Friel, N., Wyse, J.: Estimating the evidence\u2013a review. Statistica Neerlandica 66(3), 288\u2013308 (2012)","journal-title":"Statistica Neerlandica"},{"issue":"410","key":"10116_CR10","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1080\/01621459.1990.10476213","volume":"85","author":"AE Gelfand","year":"1990","unstructured":"Gelfand, A.E., Smith, A.F.M.: Sampling-based approaches to calculating marginal densities. J. of the Am. stat. assoc. 85(410), 398\u2013409 (1990)","journal-title":"J. of the Am. stat. assoc."},{"key":"10116_CR11","doi-asserted-by":"crossref","unstructured":"Gelman, A., Meng, X.-L.: Simulating normalizing constants: From importance sampling to bridge sampling to path sampling. Statistical science 163\u2013185 (1998)","DOI":"10.1214\/ss\/1028905934"},{"issue":"4","key":"10116_CR12","first-page":"457","volume":"7","author":"A Gelman","year":"1992","unstructured":"Gelman, A., Rubin, D.B.: Inference from iterative simulation using multiple sequences. Stat. sci. 7(4), 457\u2013472 (1992)","journal-title":"Stat. sci."},{"key":"10116_CR13","doi-asserted-by":"crossref","unstructured":"Geyer, C.J.: Markov chain Monte Carlo maximum likelihood. In: (1991)","DOI":"10.1214\/ss\/1177011137"},{"key":"10116_CR14","doi-asserted-by":"crossref","unstructured":"Geyer, C.J.: Practical markov chain monte carlo. In: Statistical science 473\u2013483 (1992)","DOI":"10.1214\/ss\/1177011137"},{"issue":"2","key":"10116_CR15","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1016\/j.cpc.2005.01.010","volume":"168","author":"T Hahn","year":"2005","unstructured":"Hahn, T.: Cuba\u2014a library for multidimensional numerical integration. Computer Phys. Commun. 168(2), 78\u201395 (2005)","journal-title":"Computer Phys. Commun."},{"key":"10116_CR16","unstructured":"Hallgren, J., Koski, T.: Decomposition sampling applied to parallelization of Metropolis-Hastings. In: (2014). arXiv preprint arXiv:1402.2828"},{"issue":"1","key":"10116_CR17","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1007\/s42952-019-00001-3","volume":"49","author":"M Kim","year":"2020","unstructured":"Kim, M., Lee, J.: Hamiltonian Markov chain Monte Carlo for partitioned sample spaces with application to Bayesian deep neural nets. J. of the Korean Stat. Soc. 49(1), 139\u2013160 (2020)","journal-title":"J. of the Korean Stat. Soc."},{"issue":"319","key":"10116_CR18","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1080\/01621459.1967.10500904","volume":"62","author":"J Klotz","year":"1967","unstructured":"Klotz, J.: Asymptotic efficiency of the two sample Kolmogorov-Smirnov test. J. of the Am. Stat. Assoc. 62(319), 932\u2013938 (1967)","journal-title":"J. of the Am. Stat. Assoc."},{"key":"10116_CR19","doi-asserted-by":"crossref","unstructured":"Laloy, E., Vrugt, JA: High-dimensional posterior exploration of hydrologic models using multiple-try DREAM (ZS) and high-performance computing. Water Resources Research 48(1), (2012)","DOI":"10.1029\/2011WR010608"},{"key":"10116_CR20","doi-asserted-by":"crossref","unstructured":"Leimkuhler, B., Reich, S.: Simulating hamiltonian dynamics, vol. 14. Cambridge university press (2004)","DOI":"10.1017\/CBO9780511614118"},{"issue":"449","key":"10116_CR21","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1080\/01621459.2000.10473908","volume":"95","author":"JS Liu","year":"2000","unstructured":"Liu, J.S., Liang, F., Wong, W.H.: The multiple-try method and local optimization in Metropolis sampling. J. of the Am. Stat. Assoc. 95(449), 121\u2013134 (2000)","journal-title":"J. of the Am. Stat. Assoc."},{"issue":"2","key":"10116_CR22","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","volume":"28","author":"S Lloyd","year":"1982","unstructured":"Lloyd, S.: Least squares quantization in PCM. IEEE trans. on information theory 28(2), 129\u2013137 (1982)","journal-title":"IEEE trans. on information theory"},{"key":"10116_CR23","unstructured":"Lopez-Paz, D., Oquab, M.: Revisiting classifier two-sample tests. In: (2016). arXiv preprint arXiv:1610.06545"},{"issue":"6","key":"10116_CR24","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1209\/0295-5075\/19\/6\/002","volume":"19","author":"E Marinari","year":"1992","unstructured":"Marinari, E., Parisi, G.: Simulated tempering: A new Monte Carlo scheme. EPL (Europhysics Letters) 19(6), 451 (1992)","journal-title":"EPL (Europhysics Letters)"},{"key":"10116_CR25","unstructured":"Meng, X.-L., Wong, W.H.: Simulating ratios of normalizing constants via a simple identity: A theoretical exploration. Statistica Sinica 831\u2013860 (1996)"},{"issue":"429","key":"10116_CR26","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1080\/01621459.1995.10476507","volume":"90","author":"P Mykland","year":"1995","unstructured":"Mykland, P., Tierney, L., Yu, B.: Regeneration in Markov chain samplers. J. of the Am. Stat. Assoc. 90(429), 233\u2013241 (1995)","journal-title":"J. of the Am. Stat. Assoc."},{"key":"10116_CR27","unstructured":"Nampally, A., Ramakrishnan, C.R.: Adaptive MCMC-based inference in probabilistic logic programs. In: (2014). arXiv preprint arXiv:1403.6036"},{"issue":"4","key":"10116_CR28","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1007\/BF00143556","volume":"6","author":"RM Neal","year":"1996","unstructured":"Neal, R.M.: Sampling from multimodal distributions using tempered transitions. Stat. and comput. 6(4), 353\u2013366 (1996)","journal-title":"Stat. and comput."},{"key":"10116_CR29","unstructured":"Neiswanger, W., Wang, C., Xing, E.: Asymptotically exact, embarrassingly parallel MCMC. In: (2013). arXiv preprint arXiv:1311.4780"},{"issue":"5","key":"10116_CR30","doi-asserted-by":"publisher","first-page":"e1435","DOI":"10.1002\/wics.1435","volume":"10","author":"CP Robert","year":"2018","unstructured":"Robert, C.P., et al.: Accelerating MCMC algorithms. Wiley Interdisciplinary Reviews: Comput. Stat. 10(5), e1435 (2018)","journal-title":"Wiley Interdisciplinary Reviews: Comput. Stat."},{"issue":"3","key":"10116_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s42979-021-00626-4","volume":"2","author":"O Schulz","year":"2021","unstructured":"Schulz, O., et al.: BAT. jl: A Julia-Based Tool for Bayesian Inference. SN Computer Sci. 2(3), 1\u201317 (2021)","journal-title":"SN Computer Sci."},{"issue":"2","key":"10116_CR32","first-page":"78","volume":"11","author":"SL Scott","year":"2016","unstructured":"Scott, S.L., et al.: Bayes and big data: The consensus Monte Carlo algorithm. International J. of Management Sci. and Eng. Mana 11(2), 78\u201388 (2016)","journal-title":"International J. of Management Sci. and Eng. Mana"},{"key":"10116_CR33","unstructured":"The MIT License. https:\/\/opensource.org\/licenses\/MIT. Accessed: 2020-07-23"},{"key":"10116_CR34","unstructured":"VanDerwerken, D.N., Schmidler, S.C.: Parallel markov chain monte carlo. In: (2013). arXiv preprint arXiv:1312.7479"},{"key":"10116_CR35","unstructured":"Wang, X., Dunson, D.B.: Parallelizing MCMC via Weierstrass sampler. In: (2013). arXiv preprint arXiv:1312.4605"},{"issue":"6","key":"10116_CR36","doi-asserted-by":"publisher","first-page":"02B602","DOI":"10.1063\/1.3305244","volume":"132","author":"Y Xie","year":"2010","unstructured":"Xie, Y., Zhou, J., Jiang, S.: Parallel tempering Monte Carlo simulations of lysozyme orientation on charged surfaces. The J. of chemical phys. 132(6), 02B602 (2010)","journal-title":"The J. of chemical phys."}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-022-10116-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-022-10116-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-022-10116-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T19:21:37Z","timestamp":1661455297000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-022-10116-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,27]]},"references-count":36,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10116"],"URL":"https:\/\/doi.org\/10.1007\/s11222-022-10116-z","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"type":"print","value":"0960-3174"},{"type":"electronic","value":"1573-1375"}],"subject":[],"published":{"date-parts":[[2022,6,27]]},"assertion":[{"value":"12 May 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 June 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This research was supported by the European Union\u2019s Framework Programme for Research and Innovation Horizon 2020 (2014-2020) under the Marie Sklodowska-Curie Grant Agreement No.765710 and the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany\u2019s Excellence Strategy - EXC-2094 - 390783311.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Funding"}},{"value":"The authors declare that they have no conflict of interest.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}},{"value":"The source code of BAT.jl is available at  and under DOI\u00a010.5281\/zenodo.2587213, as well as via the Julia package management system. BAT.jl is published under the MIT open-source license\u00a0(The MIT License ).","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code Availability"}},{"value":"The datasets synthetically generated by the the method described in the paper was used.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Data Availability"}}],"article-number":"56"}}