{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T08:10:21Z","timestamp":1773821421118,"version":"3.50.1"},"reference-count":52,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,10,22]],"date-time":"2022-10-22T00:00:00Z","timestamp":1666396800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Development and Investments of the Hellenic Republic","award":["5047900"],"award-info":[{"award-number":["5047900"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>A causality analysis aims at estimating the interactions of the observed variables and subsequently the connectivity structure of the observed dynamical system or stochastic process. The partial mutual information from mixed embedding (PMIME) is found appropriate for the causality analysis of continuous-valued time series, even of high dimension, as it applies a dimension reduction by selecting the most relevant lag variables of all the observed variables to the response, using conditional mutual information (CMI). The presence of lag components of the driving variable in this vector implies a direct causal (driving-response) effect. In this study, the PMIME is appropriately adapted to discrete-valued multivariate time series, called the discrete PMIME (DPMIME). An appropriate estimation of the discrete probability distributions and CMI for discrete variables is implemented in the DPMIME. Further, the asymptotic distribution of the estimated CMI is derived, allowing for a parametric significance test for the CMI in the DPMIME, whereas for the PMIME, there is no parametric test for the CMI and the test is performed using resampling. Monte Carlo simulations are performed using different generating systems of discrete-valued time series. The simulation suggests that the parametric significance test for the CMI in the progressive algorithm of the DPMIME is compared favorably to the corresponding resampling significance test, and the accuracy of the DPMIME in the estimation of direct causality converges with the time-series length to the accuracy of the PMIME. Further, the DPMIME is used to investigate whether the global financial crisis has an effect on the causality network of the financial world market.<\/jats:p>","DOI":"10.3390\/e24111505","type":"journal-article","created":{"date-parts":[[2022,10,24]],"date-time":"2022-10-24T02:31:03Z","timestamp":1666578663000},"page":"1505","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Adaptation of Partial Mutual Information from Mixed Embedding to Discrete-Valued Time Series"],"prefix":"10.3390","volume":"24","author":[{"given":"Maria","family":"Papapetrou","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}]},{"given":"Elsa","family":"Siggiridou","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5337-5688","authenticated-orcid":false,"given":"Dimitris","family":"Kugiumtzis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Siggiridou, E., Koutlis, C., Tsimpiris, A., and Kugiumtzis, D. (2019). Evaluation of Granger causality measures for constructing networks from multivariate time series. Entropy, 21.","DOI":"10.3390\/e21111080"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1016\/j.jfineco.2011.12.010","article-title":"Econometric measures of connectedness and systemic risk in the finance and insurance sectors","volume":"104","author":"Billio","year":"2012","journal-title":"J. Financ. Econ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1109\/JPROC.2015.2476824","article-title":"Wiener-Granger Causality in network physiology with applications to cardiovascular control and neuroscience","volume":"104","author":"Porta","year":"2016","journal-title":"Proc. IEEE"},{"key":"ref_4","first-page":"1","article-title":"Statistical physics approaches to the complex earth system","volume":"896","author":"Fan","year":"2021","journal-title":"Phys. Rep. Rev. Sect. Phys. Lett."},{"key":"ref_5","unstructured":"Fieguth, P. (2017). An Introduction to Complex Systems: Society, Ecology and Nonlinear Dynamics, Springer."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Thurner, S., Hanel, R., and Klimek, P. (2018). Introduction to the Theory of Complex Systems, Oxford University Press.","DOI":"10.1093\/oso\/9780198821939.001.0001"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1111\/j.2517-6161.1985.tb01383.x","article-title":"A model for high order Markov chains","volume":"47","author":"Raftery","year":"1985","journal-title":"J. R. Stat. Soc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1111\/sjos.12087","article-title":"A new model for multivariate Markov chains","volume":"41","author":"Nicolau","year":"2014","journal-title":"Scand. J. Stat."},{"key":"ref_9","unstructured":"Zhou, G., and Ye, X. (2017, January 23\u201326). High-order interacting multiple model filter based on mixture transition distribution. Proceedings of the International Conference on Radar Systems, Belfast, Ireland."},{"key":"ref_10","unstructured":"Tank, A., Fox, E., and Shojaie, A. (2017). Granger causality networks for categorical time series. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1137\/20M133097X","article-title":"The convex mixture distribution: Granger causality for categorical time aeries","volume":"3","author":"Tank","year":"2021","journal-title":"SIAM J. Math. Data Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1146\/annurev-statistics-040120-010930","article-title":"Granger Causality: A review and recent advances","volume":"9","author":"Shojaie","year":"2022","journal-title":"Annu. Rev. Stat. Its Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1430","DOI":"10.1198\/jasa.2009.tm08270","article-title":"Poisson autoregression","volume":"104","author":"Fokianos","year":"2009","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.3150\/10-BEJ313","article-title":"Absolute regularity and ergodicity of Poisson count processes","volume":"17","author":"Neumann","year":"2011","journal-title":"Bernoulli"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1093\/biomet\/asp029","article-title":"A negative binomial model for time series of counts","volume":"96","author":"Davis","year":"2009","journal-title":"Biometrika"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1080\/00949655.2013.823612","article-title":"On count time series prediction","volume":"82","author":"Christou","year":"2015","journal-title":"J. Stat. Comput. Simul."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.csda.2012.06.003","article-title":"Statistical analysis of discrete-valued time series using categorical ARMA models","volume":"57","author":"Song","year":"2013","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1002\/for.2426","article-title":"Bayesian forecasting for time series of categorical data","volume":"36","author":"Angers","year":"2017","journal-title":"J. Forecast."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.csda.2013.05.019","article-title":"Some properties of multivariate INAR(1) processes","volume":"67","author":"Pedeli","year":"2013","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1177\/1471082X15584701","article-title":"Thinning-based models in the analysis of integer-valued time series: A review","volume":"15","author":"Scotto","year":"2015","journal-title":"Stat. Model."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Budhathoki, K., and Vreeken, J. (2018, January 3\u20135). Causal inference on event sequences. Proceedings of the SIAM International Conference on Data Mining, San Diego, CA, USA.","DOI":"10.1137\/1.9781611975321.7"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_23","first-page":"20190094","article-title":"Coupling in complex systems as information transfer across time scales","volume":"377","year":"2019","journal-title":"Philos. Trans. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1016\/j.physa.2012.12.017","article-title":"Markov chain order estimation with conditional mutual information","volume":"392","author":"Papapetrou","year":"2013","journal-title":"Phys. A"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3076","DOI":"10.1016\/j.jspi.2009.02.009","article-title":"Time series analysis of categorical data using auto-mutual information","volume":"139","author":"Biswas","year":"2009","journal-title":"J. Stat. Plan. Inference"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"158101","DOI":"10.1103\/PhysRevLett.100.158101","article-title":"Symbolic transfer entropy","volume":"100","author":"Staniek","year":"2008","journal-title":"Phys. Rev. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1140\/epjst\/e2013-01849-4","article-title":"Partial transfer entropy on rank vectors","volume":"222","author":"Kugiumtzis","year":"2013","journal-title":"Eur. Phys. J. Spec. Top."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Amig\u00f3, J. (2010). Permutation Complexity in Dynamical Systems Ordinal Patterns, Permutation Entropy and All That, Springer Science & Business.","DOI":"10.1007\/978-3-642-04084-9"},{"key":"ref_29","first-page":"20190777","article-title":"Using symbolic networks to analyse dynamical properties of disease outbreaks","volume":"476","author":"Buldu","year":"2020","journal-title":"Proc. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"107381","DOI":"10.1016\/j.csda.2021.107381","article-title":"Non-parametric analysis of serial dependence in time series using ordinal patterns","volume":"168","author":"Weiss","year":"2022","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1126\/sciadv.aau4996","article-title":"Detecting and quantifying causal associations in large nonlinear time series datasets","volume":"5","author":"Runge","year":"2019","journal-title":"Sci. Adv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"016207","DOI":"10.1103\/PhysRevE.82.016207","article-title":"Non-uniform state space reconstruction and coupling detection","volume":"82","author":"Vlachos","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"062918","DOI":"10.1103\/PhysRevE.87.062918","article-title":"Direct-Coupling Information Measure from Nonuniform Embedding","volume":"87","author":"Kugiumtzis","year":"2013","journal-title":"Phys. Rev. E"},{"key":"ref_34","unstructured":"Cover, T., and Thomas, J. (1991). Elements of Information Theory, John Wiley and Sons."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"041903","DOI":"10.1103\/PhysRevE.65.041903","article-title":"Performance of different synchronization measures in real data: A case study on electroencephalographic signals","volume":"65","author":"Kraskov","year":"2002","journal-title":"Phys. Rev. E"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physrep.2018.06.001","article-title":"Surrogate data for hypothesis testing of physical systems","volume":"748","author":"Lancaster","year":"2018","journal-title":"Phys. Rep."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1007\/s004770100083","article-title":"A distribution free plotting position","volume":"15","author":"Yu","year":"2001","journal-title":"Stoch. Environ. Res. Risk Assess."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.simpat.2015.11.002","article-title":"Markov chain order estimation with parametric significance tests of conditional mutual information","volume":"61","author":"Papapetrou","year":"2016","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_39","first-page":"1102","article-title":"An approximation to the distribution of finite sample size mutual information estimates","volume":"2","author":"Goebel","year":"2005","journal-title":"IEEE Int. Conf. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/0005-2795(75)90109-9","article-title":"Comparison of the predicted and observed secondary structure of T4 Phage Lysozyme","volume":"405","author":"Matthews","year":"1975","journal-title":"Biochim. Biophys. Acta"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1214\/ss\/1042727943","article-title":"The mixture transition distribution model for high-order Markov chains and non-Gaussian time series","volume":"17","author":"Berchtold","year":"2002","journal-title":"Stat. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"84","DOI":"10.32614\/RJ-2017-036","article-title":"Discrete Time Markov Chains with R","volume":"9","author":"Spedicato","year":"2017","journal-title":"R J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"492","DOI":"10.1016\/j.laa.2007.05.021","article-title":"Higher-order multivariate Markov chains and their applications","volume":"428","author":"Ching","year":"2008","journal-title":"Linear Algebra Its Appl."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Ching, W., Huang, X., Ng, M., and Siu, T. (2013). Markov Chains: Models, Algorithms and Applications, Springer Nature.","DOI":"10.1007\/978-1-4614-6312-2"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1063\/1.165871","article-title":"Periodic orbits in coupled henon maps: Lyapunov and multifractal analysis","volume":"2","author":"Politi","year":"1992","journal-title":"Chaos"},{"key":"ref_46","first-page":"37","article-title":"Direct or indirect? Graphical models for neural oscillators","volume":"99","author":"Schelter","year":"2006","journal-title":"J. Physiol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1080\/01621459.1984.10477110","article-title":"Measures of conditional linear dependence and feedback between time series","volume":"79","author":"Geweke","year":"1984","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.jneumeth.2008.04.011","article-title":"Partial Granger causality\u2014Eliminating exogenous inputs and latent variables","volume":"172","author":"Guo","year":"2008","journal-title":"J. Neurosci. Methods"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1250222","DOI":"10.1142\/S0218127412502227","article-title":"Detection of direct causal effects and application in the analysis of electroencephalograms from patients with epilepsy","volume":"22","author":"Papana","year":"2012","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"5370","DOI":"10.1080\/00036846.2017.1307932","article-title":"The business cycle, labor market transitions by age, and the Great Recession","volume":"49","author":"Xu","year":"2017","journal-title":"Appl. Econ."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"093120","DOI":"10.1063\/1.4963175","article-title":"Discrimination of coupling structures using causality networks from multivariate time series","volume":"26","author":"Koutlis","year":"2016","journal-title":"Chaos"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/11\/1505\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:00:42Z","timestamp":1760144442000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/11\/1505"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,22]]},"references-count":52,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["e24111505"],"URL":"https:\/\/doi.org\/10.3390\/e24111505","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,22]]}}}