{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:54:18Z","timestamp":1760234058864,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T00:00:00Z","timestamp":1616544000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003329","name":"Ministerio de Econom\u00eda y Competitividad","doi-asserted-by":"publisher","award":["TIN2016-8056-R"],"award-info":[{"award-number":["TIN2016-8056-R"]}],"id":[{"id":"10.13039\/501100003329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003359","name":"Generalitat Valenciana","doi-asserted-by":"publisher","award":["ACIF\/2018\/219"],"award-info":[{"award-number":["ACIF\/2018\/219"]}],"id":[{"id":"10.13039\/501100003359","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The presence of unaccounted heterogeneity in simultaneous equation models (SEMs) is frequently problematic in many real-life applications. Under the usual assumption of homogeneity, the model can be seriously misspecified, and it can potentially induce an important bias in the parameter estimates. This paper focuses on SEMs in which data are heterogeneous and tend to form clustering structures in the endogenous-variable dataset. Because the identification of different clusters is not straightforward, a two-step strategy that first forms groups among the endogenous observations and then uses the standard simultaneous equation scheme is provided. Methodologically, the proposed approach is based on a variational Bayes learning algorithm and does not need to be executed for varying numbers of groups in order to identify the one that adequately fits the data. We describe the statistical theory, evaluate the performance of the suggested algorithm by using simulated data, and apply the two-step method to a macroeconomic problem.<\/jats:p>","DOI":"10.3390\/e23040384","type":"journal-article","created":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T15:42:19Z","timestamp":1616600539000},"page":"384","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Estimating Simultaneous Equation Models through an Entropy-Based Incremental Variational Bayes Learning Algorithm"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8912-7101","authenticated-orcid":false,"given":"Roc\u00edo","family":"Hern\u00e1ndez-Sanjaime","sequence":"first","affiliation":[{"name":"Center of Operations Research, Miguel Hern\u00e1ndez University, 03202 Elche, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5857-9540","authenticated-orcid":false,"given":"Mart\u00edn","family":"Gonz\u00e1lez","sequence":"additional","affiliation":[{"name":"Center of Operations Research, Miguel Hern\u00e1ndez University, 03202 Elche, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3775-2623","authenticated-orcid":false,"given":"Antonio","family":"Pe\u00f1alver","sequence":"additional","affiliation":[{"name":"Center of Operations Research, Miguel Hern\u00e1ndez University, 03202 Elche, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6496-4018","authenticated-orcid":false,"given":"Jose J.","family":"L\u00f3pez-Esp\u00edn","sequence":"additional","affiliation":[{"name":"Center of Operations Research, Miguel Hern\u00e1ndez University, 03202 Elche, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,24]]},"reference":[{"key":"ref_1","first-page":"391","article-title":"Specification and estimation of simultaneous equation models","volume":"1","author":"Hausman","year":"1983","journal-title":"Handb. Econom."},{"key":"ref_2","unstructured":"Klein, L.R. (1950). Economic Fluctuations in the United States, 1921\u20131941, John Wiley & Sons, Inc."},{"key":"ref_3","unstructured":"Dornbusch, R., and Fischer, S. (1984). Macroeconomics, Little, Brown. [3rd ed.]."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"King, T.M. (2003). Using simultaneous equation modeling for defining complex phenotypes. BMC Genet. BioMed Cent., 4.","DOI":"10.1186\/1471-2156-4-S1-S10"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1080\/000368400425107","article-title":"Female earnings and the divorce rate: A simultaneous equations model","volume":"32","author":"Ressler","year":"2000","journal-title":"Appl. Econ."},{"key":"ref_6","first-page":"821","article-title":"Tests for parameter instability and structural change with unknown change point","volume":"61","author":"Andrews","year":"1993","journal-title":"Econom. J. Econom. Soc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"47","DOI":"10.2307\/2998540","article-title":"Estimating and testing linear models with multiple structural changes","volume":"66","author":"Bai","year":"1998","journal-title":"Econometrica"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/0167-7152(88)90118-6","article-title":"Estimating the number of change-points via Schwarz\u2019criterion","volume":"6","author":"Yao","year":"1988","journal-title":"Stat. Probab. Lett."},{"key":"ref_9","first-page":"497","article-title":"On segmented multivariate regression","volume":"7","author":"Liu","year":"1997","journal-title":"Stat. Sin."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.spl.2004.10.037","article-title":"Information criterion for Gaussian change-point model","volume":"72","author":"Ninomiya","year":"2005","journal-title":"Stat. Probab. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/manc.12017","article-title":"Inference on structural breaks using information criteria","volume":"81","author":"Hall","year":"2013","journal-title":"Manch. Sch."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.1080\/01621459.1970.10481147","article-title":"Piecewise regression","volume":"65","author":"McZgee","year":"1970","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1007\/BF01520609","article-title":"Discontinuities in the surface structure of alcohol-water mixtures","volume":"230","author":"Dunicz","year":"1969","journal-title":"Kolloid-Z. Z. Polymere"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"634","DOI":"10.2307\/2527862","article-title":"Some hypotheses concerning two phase regression lines","volume":"17","author":"Sprent","year":"1961","journal-title":"Biometrics"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1016\/j.asr.2015.09.007","article-title":"Study of structural break points in global and hemispheric temperature series by piecewise regression","volume":"56","author":"Werner","year":"2015","journal-title":"Adv. Space Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1007\/BF02296397","article-title":"Latent variable modeling in heterogeneous populations","volume":"54","year":"1989","journal-title":"Psychometrika"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1177\/002224298905300403","article-title":"Effects of supervisory behavior: The role of individual differences among salespeople","volume":"53","author":"Kohli","year":"1989","journal-title":"J. Mark."},{"key":"ref_18","first-page":"149","article-title":"Extending the concept of consumer satisfaction","volume":"4","author":"Day","year":"1977","journal-title":"ACR N. Am. Adv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1287\/mksc.16.1.39","article-title":"Finite-mixture structural equation models for response-based segmentation and unobserved heterogeneity","volume":"16","author":"Jedidi","year":"1997","journal-title":"Mark. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/BF02291366","article-title":"Simultaneous factor analysis in several populations","volume":"36","year":"1971","journal-title":"Psychometrika"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1111\/j.2044-8317.1974.tb00543.x","article-title":"A general method for studying differences in factor means and factor structure between groups","volume":"27","year":"1974","journal-title":"Br. J. Math. Stat. Psychol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/s003579900002","article-title":"STEMM: A general finite mixture structural equation model","volume":"14","author":"Jedidi","year":"1997","journal-title":"J. Classif."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1080\/10705519609540044","article-title":"On estimating finite mixtures of multivariate regression and simultaneous equation models","volume":"3","author":"Jedidi","year":"1996","journal-title":"Struct. Equ. Model. A Multidiscip. J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"419","DOI":"10.2307\/2981826","article-title":"Statistical modelling of data on teaching styles","volume":"144","author":"Aitkin","year":"1981","journal-title":"J. R. Stat. Soc. Ser. A Gen."},{"key":"ref_25","unstructured":"McLachlan, G.J., and Basford, K.E. (1988). Mixture models. Inference and applications to clustering. Statistics: Textbooks and Monographs, Dekker."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.neuroimage.2012.10.065","article-title":"Statistical analysis of longitudinal neuroimage data with linear mixed effects models","volume":"66","author":"Greve","year":"2013","journal-title":"NeuroImage"},{"key":"ref_27","unstructured":"McLachlan, G. (2004). Discriminant Analysis and Statistical Pattern Recognition, John Wiley and Sons."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"267","DOI":"10.2307\/2347949","article-title":"On using principal components before separating a mixture of two multivariate normal distributions","volume":"32","author":"Chang","year":"1983","journal-title":"Appl. Stat."},{"key":"ref_29","unstructured":"Damodar, N. (2004). Basic Econometrics, The Mc-Graw Hill."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dhrymes, P.J. (1974). Econometrics: Statistical Foundations and Applications, Springer.","DOI":"10.1007\/978-1-4613-9383-2"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1093\/biomet\/76.2.297","article-title":"Regression and time series model selection in small samples","volume":"76","author":"Hurvich","year":"1989","journal-title":"Biometrika"},{"key":"ref_32","unstructured":"Gorobets, A.A. (2021, March 24). The Optimal Prediction Simultaneous Equations Selection; Technical Report; 2004. Available online: https:\/\/repub.eur.nl\/pub\/1839."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/34.824819","article-title":"Statistical Pattern Recognition: A Review","volume":"22","author":"Jain","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","unstructured":"Box, G.E., and Tiao, G.C. (2011). Bayesian Inference in Statistical Analysis, John Wiley and Sons."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2685","DOI":"10.1162\/089976600300014890","article-title":"The Bayesian Evidence Scheme for Regularizing Probability-Density Estimating Neural Networks","volume":"12","author":"Husmeier","year":"2000","journal-title":"Neural Comput."},{"key":"ref_36","unstructured":"Jordan, M.I. (1999). Introduction to Monte Carlo Methods, MIT Press. Learning in Graphical Models."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1109\/TSMCB.2006.872273","article-title":"Variational Learning for Gaussian Mixtures","volume":"36","author":"Nasios","year":"2006","journal-title":"IEEE Trans. Syst. Man Cybern. Part B Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"534","DOI":"10.1109\/TNNLS.2011.2177670","article-title":"Entropy-Based Incremental Variational Bayes Learning of Gaussian Mixtures","volume":"23","author":"Escolano","year":"2012","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_39","unstructured":"Corduneau, A., and Bishop, C. (2001). Variational Bayesian Model Selection for Mixture Distributions, Morgan Kaufmann."},{"key":"ref_40","unstructured":"Ghahramani, Z., and Beal, M.J. (2000). Variational Inference for Bayesian Mixtures of Factor Analysers. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1756","DOI":"10.1109\/TNN.2009.2030190","article-title":"Learning gaussian mixture models with entropy-based criteria","volume":"20","author":"Escolano","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2153","DOI":"10.1214\/07-AOS539","article-title":"A class of r\u00e9nyi information estimators for multi-dimensional densities","volume":"36","author":"Leonenko","year":"2008","journal-title":"Ann. Stat."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1109\/TNN.2006.891114","article-title":"Unsupervised Learning of Gaussian Mixtures Based on Variational Component Splitting","volume":"18","author":"Constantinopoulos","year":"2007","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/s11222-006-5338-6","article-title":"Multivariate mixtures of normals with unknown number of components","volume":"16","author":"Dellaportas","year":"2006","journal-title":"Stat. Comput."},{"key":"ref_45","unstructured":"Mardia, K., Kent, J., and Bibby, J. (1979). Multivariate analysis. Probability and Mathematical Statistics, Academic Press Inc."},{"key":"ref_46","unstructured":"Greene, W.H. (2003). Econometric Analysis, Pearson Education India."},{"key":"ref_47","unstructured":"Carnero, B.S., Seri\u00f1\u00e1n, P.R., and Garc\u00eda, M.M. (2002). El Modelo Klein I y los ciclos econ\u00f3micos [Klein\u2019s Model I and economic cycles]. Rev. Econ. Cycles, 4, Available online: https:\/\/www.researchgate.net\/profile\/Basilio-Sanz\/publication\/24121320_El_Modelo_Klein_I_y_los_Ciclos_Economicos\/links\/02e7e52bc9ddd79aa2000000\/El-Modelo-Klein-I-y-los-Ciclos-Economicos.pdf."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/4\/384\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:40:34Z","timestamp":1760161234000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/4\/384"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,24]]},"references-count":47,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["e23040384"],"URL":"https:\/\/doi.org\/10.3390\/e23040384","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,3,24]]}}}