{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T06:42:27Z","timestamp":1773297747264,"version":"3.50.1"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,10,7]],"date-time":"2022-10-07T00:00:00Z","timestamp":1665100800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,7]],"date-time":"2022-10-07T00:00:00Z","timestamp":1665100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002954","name":"Universit\u00e0 degli Studi di Milano - Bicocca","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002954","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"published-print":{"date-parts":[[2023,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Maximum likelihood estimation of discrete latent variable (DLV) models is usually performed by the expectation-maximization (EM) algorithm. A well-known drawback is related to the multimodality of the log-likelihood function so that the estimation algorithm can converge to a local maximum, not corresponding to the global one. We propose a tempered EM algorithm to explore the parameter space adequately for two main classes of DLV models, namely latent class and hidden Markov. We compare the proposal with the standard EM algorithm by an extensive Monte Carlo simulation study, evaluating both the ability to reach the global maximum and the computational time. We show the results of the analysis of discrete and continuous cross-sectional and longitudinal data referring to some applications of interest. All the results provide supporting evidence that the proposal outperforms the standard EM algorithm, and it significantly improves the chance to reach the global maximum. The advantage is relevant even considering the overall computing time.<\/jats:p>","DOI":"10.1007\/s00180-022-01276-7","type":"journal-article","created":{"date-parts":[[2022,10,7]],"date-time":"2022-10-07T06:18:51Z","timestamp":1665123531000},"page":"1391-1424","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Tempered expectation-maximization algorithm for the estimation of discrete latent variable models"],"prefix":"10.1007","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8156-470X","authenticated-orcid":false,"given":"Luca","family":"Brusa","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Francesco","family":"Bartolucci","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fulvia","family":"Pennoni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,10,7]]},"reference":[{"key":"1276_CR1","volume-title":"Monte Carlo methods","author":"A Barbu","year":"2013","unstructured":"Barbu A, Zhu S (2013) Monte Carlo methods. Springer, Singapore"},{"key":"1276_CR2","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1016\/j.csda.2013.05.018","volume":"71","author":"F Bartolucci","year":"2014","unstructured":"Bartolucci F, Bacci S, Gnaldi M (2014) MultiLCIRT: an R package for multidimensional latent class item response models. Comput Stat Data Anal 71:971\u2013985","journal-title":"Comput Stat Data Anal"},{"key":"1276_CR3","volume-title":"Latent Markov models for longitudinal data","author":"F Bartolucci","year":"2013","unstructured":"Bartolucci F, Farcomeni A, Pennoni F (2013) Latent Markov models for longitudinal data. Chapman and Hall\/CRC, Boca Raton"},{"key":"1276_CR4","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1007\/s11749-014-0381-7","volume":"23","author":"F Bartolucci","year":"2014","unstructured":"Bartolucci F, Farcomeni A, Pennoni F (2014) Latent Markov models: A review of a general framework for the analysis of longitudinal data with covariates. TEST 23:433\u2013486","journal-title":"TEST"},{"key":"1276_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v081.i04","volume":"81","author":"F Bartolucci","year":"2017","unstructured":"Bartolucci F, Pandolfi S, Pennoni F (2017) LMest: an R package for latent Markov models for longitudinal categorical data. J Stat Softw 81:1\u201338","journal-title":"J Stat Softw"},{"key":"1276_CR6","first-page":"1","volume":"6","author":"F Bartolucci","year":"2022","unstructured":"Bartolucci F, Pandolfi S, Pennoni F (2022) Discrete latent variable models. Annu Rev Stat Appl 6:1\u201331","journal-title":"Annu Rev Stat Appl"},{"key":"1276_CR7","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1111\/j.1467-985X.2006.00440.x","volume":"170","author":"F Bartolucci","year":"2007","unstructured":"Bartolucci F, Pennoni F, Francis B (2007) A latent Markov model for detecting patterns of criminal activity. J R Stat Soc Ser A Stat Soc 170:114\u2013132","journal-title":"J R Stat Soc Ser A Stat Soc"},{"key":"1276_CR8","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1214\/aoms\/1177697196","volume":"41","author":"L Baum","year":"1970","unstructured":"Baum L, Petrie T, Soules G, Weiss N (1970) A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann Math Stat 41:164\u2013171","journal-title":"Ann Math Stat"},{"key":"1276_CR9","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1111\/j.2517-6161.1964.tb00553.x","volume":"26","author":"GE Box","year":"1964","unstructured":"Box GE, Cox DR (1964) An analysis of transformations. J R Stat Soc Ser B Stat Methodol 26:211\u2013243","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"key":"1276_CR10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","volume":"39","author":"A Dempster","year":"1977","unstructured":"Dempster A, Laird N, Rubin D (1977) Maximum likelihood from incomplete data via the EM algorithm (with discussion). J R Stat Soc Ser B Stat Methodol 39:1\u201338","journal-title":"J R Stat Soc Ser B Stat Methodol"},{"key":"1276_CR11","doi-asserted-by":"publisher","first-page":"3910","DOI":"10.1039\/b509983h","volume":"7","author":"DJ Earl","year":"2005","unstructured":"Earl DJ, Deem MW (2005) Parallel tempering: theory, applications, and new perspectives. Phys Chem Chem Phys 7:3910\u20133916","journal-title":"Phys Chem Chem Phys"},{"key":"1276_CR12","doi-asserted-by":"crossref","unstructured":"Everitt BS, Landau S, Leese M, Stahl D (2011) Cluster analysis, 5th edn. Wiley, New York","DOI":"10.1002\/9780470977811"},{"key":"1276_CR13","doi-asserted-by":"publisher","first-page":"1754","DOI":"10.1063\/1.477812","volume":"110","author":"M Falcioni","year":"1999","unstructured":"Falcioni M, Deem M (1999) A biased Monte Carlo scheme for zeolite structure solution. J Chem Phys 110:1754\u20131766","journal-title":"J Chem Phys"},{"key":"1276_CR14","unstructured":"Geyer CJ (1991) Markov chain Monte Carlo maximum likelihood. In: Computing science and statistics, proceedings of the 23rd symposium on the interface, computing science and statistics. Interface Foundation of North America, pp 156\u2013163"},{"key":"1276_CR15","doi-asserted-by":"publisher","first-page":"909","DOI":"10.1080\/01621459.1995.10476590","volume":"90","author":"CJ Geyer","year":"1995","unstructured":"Geyer CJ, Thompson EA (1995) Annealing Markov chain Monte Carlo with applications to ancestral inference. J Am Stat Assoc 90:909\u2013920","journal-title":"J Am Stat Assoc"},{"key":"1276_CR16","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1093\/biomet\/61.2.215","volume":"61","author":"L Goodman","year":"1974","unstructured":"Goodman L (1974) Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 61:215\u2013231","journal-title":"Biometrika"},{"key":"1276_CR17","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1093\/biomet\/57.1.97","volume":"57","author":"WK Hastings","year":"1970","unstructured":"Hastings WK (1970) Monte Carlo sampling methods using Markov chains and their application. Biometrika 57:97\u2013109","journal-title":"Biometrika"},{"key":"1276_CR18","unstructured":"Hofmann CJ (1999) Probabilistic latent semantic analysis. In: Proceedings of the fifteenth conference on uncertainty in artificial intelligence, UAI\u201999. Morgan Kaufmann Publisher Inc., San Francisco, CA, USA, pp 289\u2013296"},{"key":"1276_CR19","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1023\/A:1009769707641","volume":"2","author":"Z Huang","year":"1998","unstructured":"Huang Z (1998) Extensions to the $$k$$-means algorithm for clustering large data sets with categorical values. Data Min Knowl Discov 2:283\u2013304","journal-title":"Data Min Knowl Discov"},{"key":"1276_CR20","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1126\/science.220.4598.671","volume":"220","author":"S Kirkpatrick","year":"1983","unstructured":"Kirkpatrick S, Gelatt C, Vecchi M (1983) Optimization by simulated annealing. Science 220:671\u2013680","journal-title":"Science"},{"key":"1276_CR21","doi-asserted-by":"publisher","first-page":"78","DOI":"10.3390\/a15030078","volume":"15","author":"T Lartigue","year":"2022","unstructured":"Lartigue T, Durrleman S, Allassonni\u00e8re S (2022) Deterministic approximate EM algorithm; application to the Riemann approximation EM and the tempered EM. Algorithms 15:78","journal-title":"Algorithms"},{"key":"1276_CR22","volume-title":"Latent structure analysis","author":"P Lazarsfeld","year":"1968","unstructured":"Lazarsfeld P, Henry N (1968) Latent structure analysis. Houghton Mifflin, Boston"},{"key":"1276_CR23","doi-asserted-by":"publisher","first-page":"545","DOI":"10.2307\/2532308","volume":"48","author":"B Leroux","year":"1992","unstructured":"Leroux B, Puterman M (1992) Maximum-penalized-likelihood estimation for independent and Markov-dependent mixture models. Biometrics 48:545\u2013558","journal-title":"Biometrics"},{"key":"1276_CR24","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1080\/01621459.1991.10475008","volume":"86","author":"B Lindsay","year":"1991","unstructured":"Lindsay B, Clogg C, Grego J (1991) Semiparametric estimation in the Rasch model and related exponential response models, including a simple latent class model for item analysis. J Am Stat Assoc 86:96\u2013107","journal-title":"J Am Stat Assoc"},{"key":"1276_CR25","unstructured":"MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the fifth berkeley symposium on mathematical statistics and probability, UAI\u201999. University of California Press, Berkeley, CA, USA, pp 281\u2013297"},{"key":"1276_CR26","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1111\/insr.12436","volume":"89","author":"A Maruotti","year":"2021","unstructured":"Maruotti A, Punzo A (2021) Initialization of hidden Markov and semi-hidden Markov: a critical evaluation of several strategies. Int Stat Rev 89:447\u2013480","journal-title":"Int Stat Rev"},{"key":"1276_CR27","volume-title":"Mixture models: inference and applications to clustering","author":"G McLachlan","year":"1988","unstructured":"McLachlan G, Basford K (1988) Mixture models: inference and applications to clustering. Marcel Dekker, New York"},{"key":"1276_CR28","doi-asserted-by":"publisher","DOI":"10.1002\/9780470191613","volume-title":"The EM algorithm and extensions","author":"G McLachlan","year":"2008","unstructured":"McLachlan G, Krishnan T (2008) The EM algorithm and extensions, 2nd edn. Wiley, Hoboken","edition":"2"},{"key":"1276_CR29","doi-asserted-by":"publisher","first-page":"1087","DOI":"10.1063\/1.1699114","volume":"21","author":"N Metropolis","year":"1953","unstructured":"Metropolis N, Rosenbluth A, Rosenbluth M, Teller A-H, Teller E (1953) Equation of state calculations by fast computing machines. J Chem Phys 21:1087\u20131092","journal-title":"J Chem Phys"},{"key":"1276_CR30","unstructured":"Pandolfi S, Bartolucci F, Pennoni F (2021) Maximum likelihood estimation of hidden Markov models for continuous longitudinal data with missing responses and dropout. arXiv:2106.15948, 1\u201336"},{"key":"1276_CR31","volume-title":"Issues on the estimation of latent variable and latent class models","author":"F Pennoni","year":"2014","unstructured":"Pennoni F (2014) Issues on the estimation of latent variable and latent class models. Scholar\u2019s Press, Saarbrucken"},{"key":"1276_CR32","doi-asserted-by":"publisher","first-page":"1344","DOI":"10.1109\/TPAMI.2005.162","volume":"27","author":"F Pernkopf","year":"2005","unstructured":"Pernkopf F, Bouchaffra D (2005) Genetic-based em algorithm for learning gaussian mixture models. IEEE Trans Pattern Anal Mach Intell 27:1344\u20131348","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"1276_CR33","volume-title":"R: a language and environment for statistical computing","author":"R Core Team","year":"2022","unstructured":"R Core Team (2022) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria"},{"key":"1276_CR34","unstructured":"Research Development and Statistics Directorate (1998) The offenders index: codebook. https:\/\/homeoffice.gov.ukrdspdfsoicodes.pdf"},{"key":"1276_CR35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/wics.1435","volume":"10","author":"C Robert","year":"2018","unstructured":"Robert C, Elvira V, Tawn N, Wu C (2018) Accelerating MCMC algorithms. Wiley Interdiscip Rev Comput Stat 10:1\u201314","journal-title":"Wiley Interdiscip Rev Comput Stat"},{"key":"1276_CR36","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1093\/gji\/ggt342","volume":"196","author":"M Sambridge","year":"2014","unstructured":"Sambridge M (2014) A parallel tempering algorithm for probabilistic sampling and multimodal optimization. Geophys J Int 196:357\u2013374","journal-title":"Geophys J Int"},{"key":"1276_CR37","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1214\/aos\/1176344136","volume":"6","author":"G Schwarz","year":"1978","unstructured":"Schwarz G (1978) Estimating the dimension of a model. Ann Stat 6:461\u2013464","journal-title":"Ann Stat"},{"key":"1276_CR38","unstructured":"The World Bank Group (2018). Data catalog: World development indicators. https:\/\/datacatalog.worldbank.orgdatasetworld-development-indicators"},{"key":"1276_CR39","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1016\/S0893-6080(97)00133-0","volume":"11","author":"N Ueda","year":"1998","unstructured":"Ueda N, Nakano R (1998) Deterministic annealing EM algorithm. Neural Netw 11:271\u2013282","journal-title":"Neural Netw"},{"key":"1276_CR40","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1162\/neco.1994.6.2.334","volume":"6","author":"A Yuille","year":"1994","unstructured":"Yuille A, Stolorz P, Utans J (1994) Statistical physics, mixture of distributions, and the EM algorithm. Neural Comput 6:334\u2013340","journal-title":"Neural Comput"},{"key":"1276_CR41","doi-asserted-by":"publisher","first-page":"612","DOI":"10.1111\/j.1467-9469.2009.00681.x","volume":"37","author":"H Zhou","year":"2010","unstructured":"Zhou H, Lange K (2010) On the bumpy road to the dominant mode. Scand J Stat 37:612\u2013631","journal-title":"Scand J Stat"},{"key":"1276_CR42","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1111\/j.1600-0447.1983.tb09716.x","volume":"67","author":"A Zigmond","year":"1983","unstructured":"Zigmond A, Snaith R (1983) The hospital anxiety and depression scale. Acta Psychiatr Scand 67:361\u201370","journal-title":"Acta Psychiatr Scand"},{"key":"1276_CR43","doi-asserted-by":"publisher","first-page":"1917","DOI":"10.1029\/91WR01403","volume":"27","author":"W Zucchini","year":"1991","unstructured":"Zucchini W, Guttorp P (1991) A hidden Markov model for space-time precipitation. Water Resour Res 27:1917\u20131923","journal-title":"Water Resour Res"},{"key":"1276_CR44","volume-title":"Hidden Markov models for time series: an introduction using R","author":"W Zucchini","year":"2016","unstructured":"Zucchini W, MacDonald I, Langrock R (2016) Hidden Markov models for time series: an introduction using R, 2nd edn. Chapman & Hall\/CRC, Boca Raton","edition":"2"}],"updated-by":[{"DOI":"10.1007\/s00180-022-01321-5","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,1,17]],"date-time":"2023-01-17T00:00:00Z","timestamp":1673913600000}}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01276-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00180-022-01276-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-022-01276-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,5]],"date-time":"2024-10-05T09:10:57Z","timestamp":1728119457000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00180-022-01276-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,7]]},"references-count":44,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,9]]}},"alternative-id":["1276"],"URL":"https:\/\/doi.org\/10.1007\/s00180-022-01276-7","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s00180-022-01321-5","asserted-by":"object"}]},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"value":"0943-4062","type":"print"},{"value":"1613-9658","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,7]]},"assertion":[{"value":"12 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 August 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 October 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 January 2023","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s00180-022-01321-5","URL":"https:\/\/doi.org\/10.1007\/s00180-022-01321-5","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}}]}}