{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T15:45:07Z","timestamp":1768405507293,"version":"3.49.0"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2025,2,25]],"date-time":"2025-02-25T00:00:00Z","timestamp":1740441600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,2,25]],"date-time":"2025-02-25T00:00:00Z","timestamp":1740441600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006692","name":"Universit\u00e0 degli Studi di Torino","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006692","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Inference for high-dimensional hidden Markov models is challenging due to the exponential-in-dimension computational cost of calculating the likelihood. To address this issue, we introduce an innovative composite likelihood approach called \u201cSimulation Based Composite Likelihood\u201d (SimBa-CL). With SimBa-CL, we approximate the likelihood by the product of its marginals, which we estimate using Monte Carlo sampling. In a similar vein to approximate Bayesian computation (ABC), SimBa-CL requires multiple simulations from the model, but, in contrast to ABC, it provides a likelihood approximation that guides the optimization of the parameters. Leveraging automatic differentiation libraries, it is simple to calculate gradients and Hessians to not only speed up optimization but also to build approximate confidence sets. We present extensive empirical results which validate our theory and demonstrate its advantage over SMC, and apply SimBa-CL to real-world Aphtovirus data.<\/jats:p>","DOI":"10.1007\/s11222-025-10584-z","type":"journal-article","created":{"date-parts":[[2025,2,25]],"date-time":"2025-02-25T16:11:16Z","timestamp":1740499876000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Simulation based composite likelihood"],"prefix":"10.1007","volume":"35","author":[{"given":"Lorenzo","family":"Rimella","sequence":"first","affiliation":[]},{"given":"Chris","family":"Jewell","sequence":"additional","affiliation":[]},{"given":"Paul","family":"Fearnhead","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,2,25]]},"reference":[{"key":"10584_CR1","unstructured":"Blundell, C., Cornebise, J., Kavukcuoglu, K., Wierstra, D.: Weight uncertainty in neural network. In: Bach, F., Blei, D. (eds.) Proceedings of the 32nd international conference on machine learning. proceedings of machine learning research, vol. 37, pp. 1613\u20131622. PMLR, Lille, France (2015). https:\/\/proceedings.mlr.press\/v37\/blundell15.html"},{"key":"10584_CR2","volume-title":"An Introduction to Sequential Monte Carlo","author":"N Chopin","year":"2020","unstructured":"Chopin, N., Papaspiliopoulos, O., et al.: An Introduction to Sequential Monte Carlo, vol. 4. Springer, Berlin (2020)"},{"issue":"1","key":"10584_CR3","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.jtbi.2004.03.006","volume":"229","author":"G Chowell","year":"2004","unstructured":"Chowell, G., Hengartner, N.W., Castillo-Chavez, C., Fenimore, P.W., Hyman, J.M.: The basic reproductive number of Ebola and the effects of public health measures: the cases of Congo and Uganda. J. Theor. Biol. 229(1), 119\u2013126 (2004)","journal-title":"J. Theor. Biol."},{"key":"10584_CR4","doi-asserted-by":"crossref","unstructured":"Cocker, D., Chidziwisano, K., Mphasa, M., Mwapasa, T., Lewis, J.M., Rowlingson, B., Sammarro, M., Bakali, W., Salifu, C., Zuza, A., et\u00a0al.: Investigating one health risks for human colonisation with extended spectrum beta-lactamase producing E. coli and K. pneumoniae in Malawian households: a longitudinal cohort study. Lancet Microbe (2023)","DOI":"10.1101\/2022.08.16.22278508"},{"key":"10584_CR5","doi-asserted-by":"publisher","unstructured":"Cocker, D., Sammarro, M., Chidziwisano, K., Elviss, N., Jacob, S., Kajumbula, H., Mugisha, L., Musoke, D., Musicha, P., Roberts, A., Rowlingson, B., Singer, A., Byrne, R., Edwards, T., Lester, R., Wilson, C., Hollihead, B., Thomson, N., Jewell, C., Morse, T., Feasey, N.: Drivers of Resistance in Uganda and Malawi (DRUM): a protocol for the evaluation of One-Health drivers of Extended Spectrum Beta Lactamase (ESBL) resistance in Low-Middle Income Countries (LMICs). Wellcome Open Res. 7, 55 (2023). https:\/\/doi.org\/10.12688\/wellcomeopenres.17581","DOI":"10.12688\/wellcomeopenres.17581"},{"key":"10584_CR6","unstructured":"Directive of the Council of the European Union: COUNCIL DIRECTIVE 200385EC of 29 September 2003 on Community measures for the control of foot-and-mouth disease repealing Directive 85511EEC and Decisions 89531EEC and 91665EEC and amending Directive 9246EEC, Official Journal of the European Union (2003)"},{"key":"10584_CR7","doi-asserted-by":"crossref","unstructured":"Duffield, S., Power, S., Rimella, L.: A state-space perspective on modelling and inference for online skill rating. arXiv preprint arXiv:2308.02414 (2023)","DOI":"10.1093\/jrsssc\/qlae035"},{"key":"10584_CR8","doi-asserted-by":"crossref","unstructured":"Fearnhead, P., Prangle, D.: Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation. J. R. Stat. Soc. Ser. B Stat Methodol. 74(3), 419\u2013474 (2012)","DOI":"10.1111\/j.1467-9868.2011.01010.x"},{"issue":"4","key":"10584_CR9","doi-asserted-by":"publisher","first-page":"918","DOI":"10.1080\/10618600.2017.1328365","volume":"26","author":"J Fintzi","year":"2017","unstructured":"Fintzi, J., Cui, X., Wakefield, J., Minin, V.N.: Efficient data augmentation for fitting stochastic epidemic models to prevalence data. J. Comput. Graph. Stat. 26(4), 918\u2013929 (2017)","journal-title":"J. Comput. Graph. Stat."},{"issue":"1","key":"10584_CR10","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1111\/2041-210X.13801","volume":"14","author":"R Glennie","year":"2023","unstructured":"Glennie, R., Adam, T., Leos-Barajas, V., Michelot, T., Photopoulou, T., McClintock, B.T.: Hidden Markov models: Pitfalls and opportunities in ecology. Methods Ecol. Evol. 14(1), 43\u201356 (2023)","journal-title":"Methods Ecol. Evol."},{"issue":"4","key":"10584_CR11","doi-asserted-by":"publisher","first-page":"1208","DOI":"10.1214\/aoms\/1177705693","volume":"31","author":"VP Godambe","year":"1960","unstructured":"Godambe, V.P.: An optimum property of regular maximum likelihood estimation. Ann. Math. Stat. 31(4), 1208\u20131211 (1960)","journal-title":"Ann. Math. Stat."},{"key":"10584_CR12","volume-title":"Statistical Theory of Extreme Values and Some Practical Applications: A Series of Lectures","author":"EJ Gumbel","year":"1954","unstructured":"Gumbel, E.J.: Statistical Theory of Extreme Values and Some Practical Applications: A Series of Lectures, vol. 33. US Government Printing Office, New York (1954)"},{"key":"10584_CR13","doi-asserted-by":"crossref","unstructured":"Herbrich, R., Minka, T., Graepel, T.: TrueSkill: A Bayesian Skill Rating System. Advances in neural information processing systems 19 (2006)","DOI":"10.7551\/mitpress\/7503.003.0076"},{"key":"10584_CR14","unstructured":"Jang, E., Gu, S., Poole, B.: Categorical reparameterization with gumbel-softmax. arXiv preprint arXiv:1611.01144 (2016)"},{"key":"10584_CR15","unstructured":"Jewell, C., Brown, J., Keeling, M., Green, L., Roberts, G., : Bayesian epidemic risk prediction-knowledge transfer and usability at all levels. In: Society for veterinary epidemiology and preventive medicine. Proceedings of a Meeting Held in Madrid, Spain, 20-22 March 2013, pp. 127\u2013142 (2013). Society for Veterinary Epidemiology and Preventive Medicine"},{"key":"10584_CR16","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1214\/09-BA417","volume":"4","author":"CP Jewell","year":"2009","unstructured":"Jewell, C.P., Kypraios, T., Neal, P., Roberts, G.O.: Bayesian analysis for emerging infectious diseases. Bayesian Anal. 4, 465\u2013496 (2009)","journal-title":"Bayesian Anal."},{"key":"10584_CR17","unstructured":"Ju, N., Heng, J., Jacob, P.E.: Sequential monte carlo algorithms for agent-based models of disease transmission. arXiv preprint arXiv:2101.12156 (2021)"},{"key":"10584_CR18","doi-asserted-by":"publisher","DOI":"10.2307\/j.ctvcm4gk0","volume-title":"Modeling Infectious Diseases in Humans and Animals","author":"MJ Keeling","year":"2011","unstructured":"Keeling, M.J., Rohani, P.: Modeling Infectious Diseases in Humans and Animals. Princeton University Press, Princeton (2011)"},{"key":"10584_CR19","unstructured":"Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)"},{"issue":"4","key":"10584_CR20","doi-asserted-by":"publisher","first-page":"1170","DOI":"10.1111\/j.1541-0420.2006.00609.x","volume":"62","author":"PE Lekone","year":"2006","unstructured":"Lekone, P.E., Finkenst\u00e4dt, B.F.: Statistical inference in a stochastic epidemic SEIR model with control intervention: Ebola as a case study. Biometrics 62(4), 1170\u20131177 (2006)","journal-title":"Biometrics"},{"key":"10584_CR21","unstructured":"Maddison, C.J., Mnih, A., Teh, Y.W.: The concrete distribution: A continuous relaxation of discrete random variables. arXiv preprint arXiv:1611.00712 (2016)"},{"key":"10584_CR22","doi-asserted-by":"publisher","first-page":"2809","DOI":"10.1214\/14-AAP1061","volume":"25","author":"P Rebeschini","year":"2015","unstructured":"Rebeschini, P., Van Handel, R.: Can local particle filters beat the curse of dimensionality? Ann. Appl. Probab. 25, 2809\u20132866 (2015)","journal-title":"Ann. Appl. Probab."},{"key":"10584_CR23","unstructured":"Rimella, L., Whiteley, N., Jewell, C., Fearnhead, P., Whitehouse, M.: Scalable calibration for partially observed individual-based epidemic models through categorical approximations. arXiv preprint arXiv:2501.03950 (2025)"},{"issue":"1","key":"10584_CR24","first-page":"134","volume":"23","author":"L Rimella","year":"2022","unstructured":"Rimella, L., Whiteley, N.: Exploiting locality in high-dimensional factorial hidden Markov models. J. Mach. Learn. Res. 23(1), 134\u2013167 (2022)","journal-title":"J. Mach. Learn. Res."},{"key":"10584_CR25","doi-asserted-by":"publisher","unstructured":"Rimella, L., Alderton, S., Sammarro, M., Rowlingson, B., Cocker, D., Feasey, N., Fearnhead, P., Jewell, C.: Inference on extended-spectrum beta-lactamase Escherichia coli and Klebsiella pneumoniae data through SMC2. J. R. Stat. Soc. Ser. C Appl. Stat. (2023). https:\/\/doi.org\/10.1093\/jrsssc\/qlad055","DOI":"10.1093\/jrsssc\/qlad055"},{"key":"10584_CR26","doi-asserted-by":"publisher","DOI":"10.5705\/ss.202022.0198","author":"L Rimella","year":"2023","unstructured":"Rimella, L., Jewell, C., Fearnhead, P.: Approximating optimal SMC proposal distributions in individual-based epidemic models. Stat. Sin. (2023). https:\/\/doi.org\/10.5705\/ss.202022.0198","journal-title":"Stat. Sin."},{"issue":"3","key":"10584_CR27","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1088\/0034-4885\/70\/3\/R03","volume":"70","author":"E Samanidou","year":"2007","unstructured":"Samanidou, E., Zschischang, E., Stauffer, D., Lux, T.: Agent-based models of financial markets. Rep. Prog. Phys. 70(3), 409 (2007)","journal-title":"Rep. Prog. Phys."},{"issue":"457","key":"10584_CR28","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1198\/016214502753479464","volume":"97","author":"SL Scott","year":"2002","unstructured":"Scott, S.L.: Bayesian methods for hidden Markov models: recursive computing in the 21st century. J. Am. Stat. Assoc. 97(457), 337\u2013351 (2002)","journal-title":"J. Am. Stat. Assoc."},{"issue":"18","key":"10584_CR29","doi-asserted-by":"publisher","first-page":"5643","DOI":"10.1073\/pnas.1412908112","volume":"112","author":"R Silva","year":"2015","unstructured":"Silva, R., Kang, S.M., Airoldi, E.M.: Predicting traffic volumes and estimating the effects of shocks in massive transportation systems. Proc. Natl. Acad. Sci. 112(18), 5643\u20135648 (2015)","journal-title":"Proc. Natl. Acad. Sci."},{"issue":"2","key":"10584_CR30","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1016\/j.ijforecast.2011.01.004","volume":"28","author":"E \u0160trumbelj","year":"2012","unstructured":"\u0160trumbelj, E., Vra\u010dar, P.: Simulating a basketball match with a homogeneous Markov model and forecasting the outcome. Int. J. Forecast. 28(2), 532\u2013542 (2012). https:\/\/doi.org\/10.1016\/j.ijforecast.2011.01.004","journal-title":"Int. J. Forecast."},{"issue":"2","key":"10584_CR31","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1080\/10618600.2019.1654880","volume":"29","author":"P Touloupou","year":"2020","unstructured":"Touloupou, P., Finkenst\u00e4dt, B., Spencer, S.E.: Scalable Bayesian inference for coupled hidden Markov and semi-Markov models. J. Comput. Graph. Stat. 29(2), 238\u2013249 (2020)","journal-title":"J. Comput. Graph. Stat."},{"key":"10584_CR32","unstructured":"UK National Audit Office: Report by the Comptroller and auditor general: The 2001 outbreak of foot and mouth disease (2022). https:\/\/www.nao.org.uk\/reports\/the-2001-outbreak-of-foot-and-mouth-disease"},{"key":"10584_CR33","unstructured":"Varin, C., Reid, N., Firth, D.: An overview of composite likelihood methods. Stat. Sin. 5\u201342 (2011)"},{"issue":"1","key":"10584_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10182-008-0060-7","volume":"92","author":"C Varin","year":"2008","unstructured":"Varin, C.: On composite marginal likelihoods. Asta Adv. Stat. Anal. 92(1), 1\u201328 (2008)","journal-title":"Asta Adv. Stat. Anal."},{"key":"10584_CR35","doi-asserted-by":"publisher","unstructured":"Whitehouse, M., Whiteley, N., Rimella, L.: Consistent and fast inference in compartmental models of epidemics using Poisson Approximate Likelihoods. J. R. Stat. Soc. Ser. B Stat. Methodol. (2023). https:\/\/doi.org\/10.1093\/jrsssb\/qkad065","DOI":"10.1093\/jrsssb\/qkad065"},{"issue":"1","key":"10584_CR36","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1214\/13-AOS1167","volume":"42","author":"N Whiteley","year":"2014","unstructured":"Whiteley, N., Lee, A.: Twisted particle filters. Ann. Stat. 42(1), 115\u2013141 (2014). https:\/\/doi.org\/10.1214\/13-AOS1167","journal-title":"Ann. Stat."},{"key":"10584_CR37","doi-asserted-by":"crossref","unstructured":"Wilkinson, D.J.: Stochastic Modelling for Systems Biology. CRC Press, New York (2018)","DOI":"10.1201\/9781351000918"},{"key":"10584_CR38","unstructured":"Zeiler, M.D.: Adadelta: an adaptive learning rate method. arXiv preprint arXiv:1212.5701 (2012)"}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-025-10584-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-025-10584-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-025-10584-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,28]],"date-time":"2025-05-28T05:04:35Z","timestamp":1748408675000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-025-10584-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,25]]},"references-count":38,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["10584"],"URL":"https:\/\/doi.org\/10.1007\/s11222-025-10584-z","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,25]]},"assertion":[{"value":"17 July 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 February 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"58"}}