{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T13:56:25Z","timestamp":1782222985448,"version":"3.54.5"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2024,1,10]],"date-time":"2024-01-10T00:00:00Z","timestamp":1704844800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,1,10]],"date-time":"2024-01-10T00:00:00Z","timestamp":1704844800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002954","name":"Universit\u00e0 degli Studi di Milano - Bicocca","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002954","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We propose an evolutionary optimization method for maximum likelihood and approximate maximum likelihood estimation of discrete latent variable models. The proposal is based on modified versions of the expectation\u2013maximization (EM) and variational EM (VEM) algorithms, which are based on the genetic approach and allow us to accurately explore the parameter space, reducing the chance to be trapped into one of the multiple local maxima of the log-likelihood function. Their performance is examined through an extensive Monte Carlo simulation study where they are employed to estimate latent class, hidden Markov, and stochastic block models and compared with the standard EM and VEM algorithms. We observe a significant increase in the chance to reach global maximum of the target function and a high accuracy of the estimated parameters for each model. Applications focused on the analysis of cross-sectional, longitudinal, and network data are proposed to illustrate and compare the algorithms.<\/jats:p>","DOI":"10.1007\/s11222-023-10358-5","type":"journal-article","created":{"date-parts":[[2024,1,10]],"date-time":"2024-01-10T07:02:26Z","timestamp":1704870146000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Maximum likelihood estimation for discrete latent variable models via evolutionary algorithms"],"prefix":"10.1007","volume":"34","author":[{"given":"Luca","family":"Brusa","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fulvia","family":"Pennoni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Francesco","family":"Bartolucci","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,1,10]]},"reference":[{"key":"10358_CR1","doi-asserted-by":"publisher","first-page":"987","DOI":"10.1016\/j.patrec.2013.02.008","volume":"34","author":"JL Andrews","year":"2013","unstructured":"Andrews, J.L., McNicholas, P.D.: Using evolutionary algorithms for model-based clustering. Pattern Recognit. Lett. 34, 987\u2013992 (2013)","journal-title":"Pattern Recognit. Lett."},{"key":"10358_CR2","volume-title":"Evolutionary Computation for Modeling and Optimization","author":"D Ashlock","year":"2004","unstructured":"Ashlock, D.: Evolutionary Computation for Modeling and Optimization. Springer, New York (2004)"},{"key":"10358_CR3","doi-asserted-by":"publisher","DOI":"10.1093\/oso\/9780195099713.001.0001","volume-title":"Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms","author":"T B\u00e4ck","year":"1996","unstructured":"B\u00e4ck, T.: Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms. Oxford University Press, New York (1996)"},{"key":"10358_CR4","doi-asserted-by":"crossref","unstructured":"B\u00e4ck, T., Schwefel, H.P.: Evolutionary computation: an overview. In: Proceedings of IEEE International Conference on Evolutionary Computation, pp. 20\u201329. IEEE (1996)","DOI":"10.1109\/ICEC.1996.542329"},{"key":"10358_CR5","doi-asserted-by":"crossref","unstructured":"Bartolucci, F., Pandolfi, S., Pennoni, F.: LMest: an R package for latent Markov models for longitudinal categorical data. J. Stat. Softw. 81, 1\u201338 (2017)","DOI":"10.18637\/jss.v081.i04"},{"key":"10358_CR6","volume-title":"Latent Markov Models for Longitudinal Data","author":"F Bartolucci","year":"2013","unstructured":"Bartolucci, F., Farcomeni, A., Pennoni, F.: Latent Markov Models for Longitudinal Data. Chapman & Hall\/CRC, Boca Raton (2013)"},{"key":"10358_CR7","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1007\/s11749-014-0381-7","volume":"23","author":"F Bartolucci","year":"2014","unstructured":"Bartolucci, F., Farcomeni, A., Pennoni, F.: Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates. TEST 23, 433\u201365 (2014)","journal-title":"TEST"},{"key":"10358_CR8","first-page":"1","volume":"6","author":"F Bartolucci","year":"2022","unstructured":"Bartolucci, F., Pandolfi, S., Pennoni, F.: Discrete latent variable models. Annu. Rev. Stat. Appl. 6, 1\u201331 (2022)","journal-title":"Annu. Rev. Stat. Appl."},{"key":"10358_CR9","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1111\/j.1467-985X.2006.00440.x","volume":"170","author":"F Bartolucci","year":"2007","unstructured":"Bartolucci, F., Pennoni, F., Francis, B.: A latent Markov model for detecting patterns of criminal activity. J. R. Stat. Soc. Ser. A Stat. Soc. 170, 114\u2013132 (2007)","journal-title":"J. R. Stat. Soc. Ser. A Stat. Soc."},{"key":"10358_CR10","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1214\/aoms\/1177697196","volume":"41","author":"LE Baum","year":"1970","unstructured":"Baum, L.E., Petrie, T., Soules, G., Weiss, N.: A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Stat. 41, 164\u2013171 (1970)","journal-title":"Ann. Math. Stat."},{"key":"10358_CR11","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/BF03372103","volume":"19","author":"A Berchtold","year":"2004","unstructured":"Berchtold, A.: Optimization of mixture models: comparison of different strategies. Comput. Stat. 19, 385\u2013406 (2004)","journal-title":"Comput. Stat."},{"key":"10358_CR12","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1109\/34.865189","volume":"22","author":"C Biernacki","year":"2000","unstructured":"Biernacki, C., Celeux, G., Govaert, G.: Assessing a mixture model for clustering with the integrated completed likelihood. IEEE Trans. Pattern Anal. Mach. Intell. 22, 719\u2013725 (2000)","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"10358_CR13","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1111\/j.2517-6161.1964.tb00553.x","volume":"26","author":"GEP Box","year":"1964","unstructured":"Box, G.E.P., Cox, D.R.: An analysis of transformations. J. R. Stat. Soc. Series. B Stat. Methodol. 26, 211\u2013243 (1964)","journal-title":"J. R. Stat. Soc. Series. B Stat. Methodol."},{"key":"10358_CR14","doi-asserted-by":"publisher","first-page":"1391","DOI":"10.1007\/s00180-022-01276-7","volume":"38","author":"L Brusa","year":"2023","unstructured":"Brusa, L., Bartolucci, F., Pennoni, F.: Tempered expectation-maximization algorithm for the estimation of discrete latent variable models. Comput. Stat. 38, 1391\u20131424 (2023)","journal-title":"Comput. Stat."},{"key":"10358_CR15","volume-title":"Latent Class and Latent Transition Analysis: With Applications in the Social, Behavioral, and Health Sciences","author":"LM Collins","year":"2010","unstructured":"Collins, L.M., Lanza, S.T.: Latent Class and Latent Transition Analysis: With Applications in the Social, Behavioral, and Health Sciences. Wiley, New York (2010)"},{"key":"10358_CR16","first-page":"1","volume":"1695","author":"G Csardi","year":"2006","unstructured":"Csardi, G., Nepusz, T.: The igraph software package for complex network research. InterJournal Complex Syst. 1695, 1\u20139 (2006)","journal-title":"InterJournal Complex Syst."},{"key":"10358_CR17","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1007\/s11222-007-9046-7","volume":"18","author":"JJ Daudin","year":"2008","unstructured":"Daudin, J.J., Picard, F., Robin, S.: A mixture model for random graphs. Stat. Comput. 18, 173\u2013183 (2008)","journal-title":"Stat. Comput."},{"key":"10358_CR18","volume-title":"Multi-Objective Optimization Using Evolutionary Algorithms","author":"K Deb","year":"2001","unstructured":"Deb, K.: Multi-Objective Optimization Using Evolutionary Algorithms. Wiley, Chichester (2001)"},{"key":"10358_CR19","doi-asserted-by":"crossref","unstructured":"Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm (with discussion). J. R. Stat. Soc. Ser. B Stat. Methodol. 39, 1\u201338 (1977)","DOI":"10.1111\/j.2517-6161.1977.tb01600.x"},{"key":"10358_CR20","unstructured":"Development, R., Directorate, S.: The offenders index: Codebook (1998). http:\/\/doc.ukdataservice.ac.uk\/doc\/3935\/mrdoc\/pdf\/a3935cab.pdf"},{"key":"10358_CR21","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1093\/biomet\/61.2.215","volume":"61","author":"LA Goodman","year":"1974","unstructured":"Goodman, L.A.: Exploratory latent structure analysis using both identifiable and unidentifiable models. Biometrika 61, 215\u2013231 (1974)","journal-title":"Biometrika"},{"key":"10358_CR22","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/0378-8733(83)90021-7","volume":"5","author":"PW Holland","year":"1983","unstructured":"Holland, P.W., Laskey, K.B., Leinhardt, S.: Stochastic blockmodels: first steps. Soc. Netw. 5, 109\u2013137 (1983)","journal-title":"Soc. Netw."},{"key":"10358_CR23","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1109\/TSMCC.2008.2007252","volume":"39","author":"ER Hruschka","year":"2009","unstructured":"Hruschka, E.R., Campello, R.J.G.B., Freitas, A.A., Ponce, Leon F., de Carvalho, A.C.: A survey of evolutionary algorithms for clustering. IEEE Trans. Syst. Man Cybern. 39, 133\u2013155 (2009)","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"10358_CR24","unstructured":"Johnston, L.D., Bachman, J.G., O\u2019Malley, P.M., Schulenberg, J.E., Miech, R.A.: Monitoring the future: A continuing study of American youth (12th-Grade Survey), 2014. Inter-university Consortium for Political and Social Research (2017). https:\/\/www.icpsr.umich.edu\/web\/NAHDAP\/studies\/36263\/"},{"key":"10358_CR25","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1023\/A:1007665907178","volume":"37","author":"MI Jordan","year":"1999","unstructured":"Jordan, M.I., Ghahramani, Z., Jaakkola, T.S., Saul, L.K.: An introduction to variational methods for graphical models. Mach. Learn. 37, 183\u2013233 (1999)","journal-title":"Mach. Learn."},{"key":"10358_CR26","unstructured":"Kampo, R.S.: Evolutionary Algorithms for Model-Based Clustering. PhD thesis, McMaster University, Hamilton, Ontario, Canada (2021)"},{"key":"10358_CR27","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1214\/aoms\/1177729694","volume":"22","author":"S Kullback","year":"1951","unstructured":"Kullback, S., Leibler, R.A.: On information and sufficiency. Ann. Math. Stat. 22, 79\u201386 (1951)","journal-title":"Ann. Math. Stat."},{"key":"10358_CR28","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1080\/10705510701575602","volume":"14","author":"ST Lanza","year":"2007","unstructured":"Lanza, S.T., Collins, L.M., Lemmon, D.R., Schafer, J.L.: Proc lca: a sas procedure for latent class analysis. Struct. Equ. Model. 14, 671\u2013694 (2007)","journal-title":"Struct. Equ. Model."},{"key":"10358_CR29","volume-title":"Latent Structure Analysis","author":"PF Lazarsfeld","year":"1968","unstructured":"Lazarsfeld, P.F., Henry, N.W.: Latent Structure Analysis. Houghton Mifflin, Boston (1968)"},{"key":"10358_CR30","doi-asserted-by":"crossref","unstructured":"Lindsay, B., Clogg, C.C., Grego, J.: Semiparametric estimation in the Rasch model and related exponential response models, including a simple latent class model for item analysis. J. Am. Stat. Assoc. 86, 96\u2013107 (1991)","DOI":"10.1080\/01621459.1991.10475008"},{"key":"10358_CR31","doi-asserted-by":"crossref","unstructured":"Maruotti, A., Punzo, A.: Initialization of hidden Markov and semi-hidden Markov: A critical evaluation of several strategies. Int. Stat. Rev. 89, 447\u2013480 (2021)","DOI":"10.1111\/insr.12436"},{"key":"10358_CR32","doi-asserted-by":"crossref","unstructured":"McLachlan G, Peel D.: Finite Mixture Models. Wiley, New York (2000)","DOI":"10.1002\/0471721182"},{"key":"10358_CR33","doi-asserted-by":"crossref","unstructured":"McNicholas, S.M., McNicholas, P.D., Ashlock, D.A.: An evolutionary algorithm with crossover and mutation for model-based clustering. J. Classif. 38, 264\u2013279 (2021)","DOI":"10.1007\/s00357-020-09371-4"},{"key":"10358_CR34","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-04131-4","volume-title":"How to Solve It: Modern Heuristics","author":"Z Michalewicz","year":"2000","unstructured":"Michalewicz, Z., Fogel, D.B.: How to Solve It: Modern Heuristics. Springer, Berlin (2000)"},{"key":"10358_CR35","doi-asserted-by":"publisher","first-page":"1077","DOI":"10.1198\/016214501753208735","volume":"96","author":"K Nowicki","year":"2001","unstructured":"Nowicki, K., Snijders, T.A.B.: Estimation and prediction for stochastic blockstructures. J. Am. Stat. Assoc. 96, 1077\u20131087 (2001)","journal-title":"J. Am. Stat. Assoc."},{"key":"10358_CR36","unstructured":"Pennoni, F.: Issues on the Estimation of Latent Variable and Latent Class Models. Scholar\u2019s Press, Saarbr\u00fccken (2014)"},{"key":"10358_CR37","doi-asserted-by":"crossref","unstructured":"Pennoni, F., Bartolucci, F., Forte, G., Ametrano, F.: Exploring the dependencies among main cryptocurrency log-returns: a hidden Markov model. Econ. Notes 51(1), e12193 (2022)","DOI":"10.1111\/ecno.12193"},{"key":"10358_CR38","doi-asserted-by":"crossref","unstructured":"Pernkopf, F., Bouchaffra, D.: Genetic-based EM algorithm for learning Gaussian mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 27, 1344\u20131348 (2005)","DOI":"10.1109\/TPAMI.2005.162"},{"key":"10358_CR39","unstructured":"Ritchie, H., Roser, M., Rosado, P.: Energy. Our World in Data (2022). https:\/\/ourworldindata.org\/energy"},{"key":"10358_CR40","doi-asserted-by":"crossref","unstructured":"Scrucca, L.: GA: A package for genetic algorithms in R. J. Stat. Soft. 53, 1\u201337 (2013)","DOI":"10.18637\/jss.v053.i04"},{"key":"10358_CR41","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1214\/aos\/1176344136","volume":"6","author":"G Schwarz","year":"1978","unstructured":"Schwarz, G.: Estimating the dimension of a model. Ann. Stat. 6, 461\u2013464 (1978)","journal-title":"Ann. Stat."},{"key":"10358_CR42","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1007\/s003579900004","volume":"14","author":"TAB Snijders","year":"1997","unstructured":"Snijders, T.A.B., Nowicki, K.: Estimation and prediction for stochastic blockmodels for graphs with latent block structure. J. Classif. 14, 75\u2013100 (1997)","journal-title":"J. Classif."},{"key":"10358_CR43","unstructured":"Team, R. C: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2023). http:\/\/www.R-project.org\/"},{"key":"10358_CR44","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1109\/TIT.1967.1054010","volume":"13","author":"AJ Viterbi","year":"1967","unstructured":"Viterbi, A.J.: Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Trans. Inf. Theory 13, 260\u2013269 (1967)","journal-title":"IEEE Trans. Inf. Theory"},{"key":"10358_CR45","first-page":"9","volume":"53","author":"LR Welch","year":"2003","unstructured":"Welch, L.R.: Hidden Markov models and the Baum\u2013Welch algorithm. IEEE Inform. Theory Soc. Newsl. 53, 9\u201313 (2003)","journal-title":"IEEE Inform. Theory Soc. Newsl."},{"key":"10358_CR46","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1086\/jar.33.4.3629752","volume":"33","author":"WW Zachary","year":"1977","unstructured":"Zachary, W.W.: An information flow model for conflict and fission in small groups. J. Anthropol. Res. 33, 452\u2013473 (1977)","journal-title":"J. Anthropol. Res."},{"key":"10358_CR47","doi-asserted-by":"crossref","unstructured":"Zucchini, W., MacDonald, I.L., Langrock, R.: Hidden Markov Models for Time Series: An Introduction using R, 2nd edn. Chapman & Hall\/CRC, Boca Raton (2016)","DOI":"10.1201\/b20790"}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-023-10358-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-023-10358-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-023-10358-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,7]],"date-time":"2024-11-07T20:18:33Z","timestamp":1731010713000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-023-10358-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,10]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["10358"],"URL":"https:\/\/doi.org\/10.1007\/s11222-023-10358-5","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,10]]},"assertion":[{"value":"14 July 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 January 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"62"}}