{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T05:32:38Z","timestamp":1780464758907,"version":"3.54.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T00:00:00Z","timestamp":1750118400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T00:00:00Z","timestamp":1750118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001774","name":"University of Sydney","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001774","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2025,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>A primary challenge in Bayesian analysis lies in computing the posterior distribution of model parameters, especially for models with a large number of parameters or intractable likelihoods. Often, the focus is on a subset of parameters, with the remainder regarded as nuisance parameters introduced for computational convenience. This complexity necessitates refined computational methods. Variational Bayesian inference (VB) has emerged as a powerful solution, enhancing computational efficiency by recasting inference as an optimization problem within a family of tractable distributions. However, common VB techniques sometimes fall short, especially for models with nuisance parameters or intractable likelihoods. After identifying characteristics of suboptimal VB methods, we build upon the Hybrid Variational Bayes (HVB) approach introduced by Loaiza-Maya et\u00a0al. (2022) and develop an extended and unified HVB framework designed to achieve more precise Bayesian inference in such scenarios. Through theoretical exploration and a series of illustrative examples, our approach demonstrates notable improvements over traditional VB methods.<\/jats:p>","DOI":"10.1007\/s11222-025-10654-2","type":"journal-article","created":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T07:09:51Z","timestamp":1750144191000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Variational Bayesian inference for models with nuisance parameters and an intractable likelihood"],"prefix":"10.1007","volume":"35","author":[{"given":"Y. H. Paco","family":"Tseng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minh-Ngoc","family":"Tran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Kohn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,6,17]]},"reference":[{"issue":"1","key":"10654_CR1","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1111\/j.2517-6161.1974.tb00989.x","volume":"36","author":"DF Andrews","year":"1974","unstructured":"Andrews, D.F., Mallows, C.L.: Scale mixtures of normal distributions. Journal of the Royal Statistical Society: Series B (Methodological) 36(1), 99\u2013102 (1974)","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"key":"10654_CR2","doi-asserted-by":"crossref","unstructured":"Berger, J.\u00a0O., Liseo, B., Wolpert, R.L.: Integrated likelihood methods for eliminating nuisance parameters. Statistical science, pages 1\u201322 (1999)","DOI":"10.1214\/ss\/1009211804"},{"issue":"6","key":"10654_CR3","first-page":"55","volume":"27","author":"D Blei","year":"2010","unstructured":"Blei, D., Carin, L., Dunson, D.: Probabilistic topic models. IEEE signal processing magazine 27(6), 55\u201365 (2010)","journal-title":"IEEE signal processing magazine"},{"issue":"518","key":"10654_CR4","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1080\/01621459.2017.1285773","volume":"112","author":"DM Blei","year":"2017","unstructured":"Blei, D.M., Kucukelbir, A., McAuliffe, J.D.: Variational inference: A review for statisticians. Journal of the American statistical Association 112(518), 859\u2013877 (2017)","journal-title":"Journal of the American statistical Association"},{"key":"10654_CR5","volume-title":"An introduction to sequential Monte Carlo,","author":"N Chopin","year":"2020","unstructured":"Chopin, N., Papaspiliopoulos, O.: An introduction to sequential Monte Carlo, vol. 4. Springer (2020)"},{"key":"10654_CR6","unstructured":"Coquelin, P.-A., Deguest, R., Munos, R.: Sensitivity analysis in hmms with application to likelihood maximization. Advances in Neural Information Processing Systems, 22 (2009)"},{"key":"10654_CR7","doi-asserted-by":"publisher","DOI":"10.1201\/b16331","volume-title":"Nonlinear time series: Theory, methods and applications with R examples","author":"R Douc","year":"2014","unstructured":"Douc, R., Moulines, E., Stoffer, D.: Nonlinear time series: Theory, methods and applications with R examples. CRC Press (2014)"},{"key":"10654_CR8","volume-title":"Time Series Analysis by State Space Methods","author":"J Durbin","year":"2001","unstructured":"Durbin, J., Koopman, S.J.: Time Series Analysis by State Space Methods. Oxford University Press (2001)"},{"key":"10654_CR9","doi-asserted-by":"publisher","DOI":"10.1201\/b16018","volume-title":"Bayesian data analysis","author":"A Gelman","year":"2013","unstructured":"Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A., Rubin, D.B.: Bayesian data analysis. CRC Press (2013)"},{"key":"10654_CR10","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511790942","volume-title":"Data analysis using regression and multilevel\/hierarchical models","author":"A Gelman","year":"2006","unstructured":"Gelman, A., Hill, J.: Data analysis using regression and multilevel\/hierarchical models. Cambridge University Press (2006)"},{"key":"10654_CR11","unstructured":"Gunawan, D., Tran, M.-N., and Kohn, R.: Fast inference for intractable likelihood problems using variational bayes. arXiv preprint arXiv:1705.06679 (2017)"},{"key":"10654_CR12","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007665907178","volume":"37","author":"M Jordan","year":"1999","unstructured":"Jordan, M., Ghahramani, Z., Jaakkola, T., Saul, L.K.: An introduction to variational methods for graphical models. Machine Learning 37, 183233 (1999)","journal-title":"Machine Learning"},{"issue":"3","key":"10654_CR13","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1111\/1467-937X.00050","volume":"65","author":"S Kim","year":"1998","unstructured":"Kim, S., Shephard, N., Chib, S.: Stochastic volatility: likelihood inference and comparison with ARCH models. The review of economic studies 65(3), 361\u2013393 (1998)","journal-title":"The review of economic studies"},{"key":"10654_CR14","unstructured":"Kingma, D.\u00a0P., Welling, M.: (2013). Auto-encoding variational Bayes. arXiv preprint arXiv:1312.6114"},{"issue":"2","key":"10654_CR15","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1016\/j.jeconom.2021.05.002","volume":"230","author":"R Loaiza-Maya","year":"2022","unstructured":"Loaiza-Maya, R., Smith, M.S., Nott, D.J., Danaher, P.J.: Fast and accurate variational inference for models with many latent variables. Journal of Econometrics 230(2), 339\u2013362 (2022)","journal-title":"Journal of Econometrics"},{"key":"10654_CR16","doi-asserted-by":"crossref","unstructured":"McCulloch, C.E., Neuhaus, J.M. (2014). Generalized Linear Mixed Models. John Wiley & Sons, Ltd","DOI":"10.1002\/9781118445112.stat07540"},{"issue":"247","key":"10654_CR17","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1080\/01621459.1949.10483310","volume":"44","author":"N Metropolis","year":"1949","unstructured":"Metropolis, N., Ulam, S.: The Monte Carlo method. Journal of the American statistical association 44(247), 335\u2013341 (1949)","journal-title":"Journal of the American statistical association"},{"issue":"1","key":"10654_CR18","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1214\/14-EJS910","volume":"8","author":"SE Neville","year":"2014","unstructured":"Neville, S.E., Ormerod, J.T., Wand, M.P.: Mean field variational Bayes for continuous sparse signal shrinkage: Pitfalls and remedies. Electron. J. Statist. 8(1), 1113\u20131151 (2014)","journal-title":"Electron. J. Statist."},{"issue":"3","key":"10654_CR19","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1080\/10618600.2017.1390472","volume":"27","author":"VM-H Ong","year":"2018","unstructured":"Ong, V.M.-H., Nott, D.J., Smith, M.S.: Gaussian variational approximation with a factor covariance structure. Journal of Computational and Graphical Statistics 27(3), 465\u2013478 (2018)","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"10654_CR20","unstructured":"Paisley, J., Blei, D., Jordan, M.: Variational Bayesian inference with stochastic search. arXiv preprint arXiv:1206.6430 (2012)"},{"issue":"482","key":"10654_CR21","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1198\/016214508000000337","volume":"103","author":"T Park","year":"2008","unstructured":"Park, T., Casella, G.: The Bayesian lasso. Journal of the American Statistical Association 103(482), 681\u2013686 (2008)","journal-title":"Journal of the American Statistical Association"},{"issue":"2","key":"10654_CR22","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1016\/j.jeconom.2012.06.004","volume":"171","author":"MK Pitt","year":"2012","unstructured":"Pitt, M.K., dos Santos Silva, R., Giordani, P., Kohn, R.: On some properties of Markov chain Monte Carlo simulation methods based on the particle filter. Journal of Econometrics 171(2), 134\u2013151 (2012)","journal-title":"Journal of Econometrics"},{"key":"10654_CR23","unstructured":"Reserve Bank of Australia. Historical data. https:\/\/www.rba.gov.au\/statistics\/historical-data.html#exchange-rates [Accessed: (2024-02-16)] (2024)"},{"issue":"3","key":"10654_CR24","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1093\/biomet\/asx031","volume":"104","author":"C Sherlock","year":"2017","unstructured":"Sherlock, C., Thiery, A.H., Lee, A.: Pseudo-marginal Metropolis-Hastings sampling using averages of unbiased estimators. Biometrika 104(3), 727\u2013734 (2017)","journal-title":"Biometrika"},{"key":"10654_CR25","volume-title":"Time Series Analysis: Theory and Practice, page 203226","author":"SJ Taylor","year":"1982","unstructured":"Taylor, S.J.: Financial returns modelled by the product of two stochastic processes a study of daily sugar prices 1961\u201379. In: Anderson, O.D. (ed.) Time Series Analysis: Theory and Practice, page 203226. North-Holland, Amsterdam (1982)"},{"key":"10654_CR26","unstructured":"Tran, M.-N., Nguyen, T.-N., Dao, V.-H.: A practical tutorial on variational Bayes. arXiv preprint arXiv:2103.01327 (2021)"},{"issue":"4","key":"10654_CR27","doi-asserted-by":"publisher","first-page":"873","DOI":"10.1080\/10618600.2017.1330205","volume":"26","author":"M-N Tran","year":"2017","unstructured":"Tran, M.-N., Nott, D.J., Kohn, R.: Variational Bayes with intractable likelihood. Journal of Computational and Graphical Statistics 26(4), 873\u2013882 (2017)","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"10654_CR28","doi-asserted-by":"crossref","unstructured":"Wainwright, M.\u00a0J., Jordan, M.\u00a0I., et\u00a0al.: Graphical models, exponential families, and variational inference. Foundations and Trends\u00ae in Machine Learning, 1(1\u20132):1\u2013305 (2008)","DOI":"10.1561\/2200000001"},{"key":"10654_CR29","doi-asserted-by":"crossref","unstructured":"Wand, M.P., Ormerod, J.T., Padoan, S.A., Frhwirth, R.: Mean field variational Bayes for elaborate distributions. Bayesian Anal. 6(4), 847\u2013900 (2011)","DOI":"10.1214\/11-BA631"},{"key":"10654_CR30","first-page":"351","volume-title":"Advances in Neural Information Processing Systems","author":"S Waterhouse","year":"1996","unstructured":"Waterhouse, S., MacKay, D., Robinson, T.: Bayesian methods for mixtures of experts. In: Touretzky, M.C.M.D.S., Hasselmo, M.E. (eds.) Advances in Neural Information Processing Systems, pp. 351\u2013357. MIT Press (1996)"},{"key":"10654_CR31","doi-asserted-by":"crossref","unstructured":"Zhang, C., B\u00fctepage, J., Kjellstr\u00f6m, H., Mandt, S.: Advances in variational inference. IEEE transactions on pattern analysis and machine intelligence 41(8), 2008\u20132026 (2018)","DOI":"10.1109\/TPAMI.2018.2889774"}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-025-10654-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-025-10654-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-025-10654-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,6]],"date-time":"2025-09-06T19:52:59Z","timestamp":1757188379000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-025-10654-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,17]]},"references-count":31,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,10]]}},"alternative-id":["10654"],"URL":"https:\/\/doi.org\/10.1007\/s11222-025-10654-2","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-4487816\/v1","asserted-by":"object"}]},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,17]]},"assertion":[{"value":"28 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 June 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"131"}}