{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T01:03:27Z","timestamp":1772154207583,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T00:00:00Z","timestamp":1684195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"EPSRC","award":["EP\/W036770\/1"],"award-info":[{"award-number":["EP\/W036770\/1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The quantification of causality is vital for understanding various important phenomena in nature and laboratories, such as brain networks, environmental dynamics, and pathologies. The two most widely used methods for measuring causality are Granger Causality (GC) and Transfer Entropy (TE), which rely on measuring the improvement in the prediction of one process based on the knowledge of another process at an earlier time. However, they have their own limitations, e.g., in applications to nonlinear, non-stationary data, or non-parametric models. In this study, we propose an alternative approach to quantify causality through information geometry that overcomes such limitations. Specifically, based on the information rate that measures the rate of change of the time-dependent distribution, we develop a model-free approach called information rate causality that captures the occurrence of the causality based on the change in the distribution of one process caused by another. This measurement is suitable for analyzing numerically generated non-stationary, nonlinear data. The latter are generated by simulating different types of discrete autoregressive models which contain linear and nonlinear interactions in unidirectional and bidirectional time-series signals. Our results show that information rate causalitycan capture the coupling of both linear and nonlinear data better than GC and TE in the several examples explored in the paper.<\/jats:p>","DOI":"10.3390\/e25050806","type":"journal-article","created":{"date-parts":[[2023,5,17]],"date-time":"2023-05-17T02:04:05Z","timestamp":1684289045000},"page":"806","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Causality Analysis with Information Geometry: A Comparison"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9093-3271","authenticated-orcid":false,"given":"Heng Jie","family":"Choong","sequence":"first","affiliation":[{"name":"Centre for Fluid and Complex Systems, Coventry University, Coventry CV1 5FB, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5607-6635","authenticated-orcid":false,"given":"Eun-jin","family":"Kim","sequence":"additional","affiliation":[{"name":"Centre for Fluid and Complex Systems, Coventry University, Coventry CV1 5FB, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9176-6674","authenticated-orcid":false,"given":"Fei","family":"He","sequence":"additional","affiliation":[{"name":"Centre for Computational Science and Mathematical Modelling, Coventry University, Coventry CV1 5FB, UK"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1016\/j.isci.2019.07.043","article-title":"An Algorithmic Information Calculus for Causal Discovery and Reprogramming Systems","volume":"19","author":"Zenil","year":"2019","journal-title":"iScience"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1038\/s42256-018-0005-0","article-title":"Causal deconvolution by algorithmic generative models","volume":"1","author":"Zenil","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e1449","DOI":"10.1002\/widm.1449","article-title":"Methods and tools for causal discovery and causal inference","volume":"12","author":"Nogueira","year":"2022","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"012308","DOI":"10.1103\/PhysRevE.96.012308","article-title":"Low-algorithmic-complexity entropy-deceiving graphs","volume":"96","author":"Zenil","year":"2017","journal-title":"Phys. Rev. E"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Danks, D., and Davis, I. (2023). Causal inference in cognitive neuroscience. WIRES Cogn. Sci., e1650.","DOI":"10.1002\/wcs.1650"},{"key":"ref_6","first-page":"424","article-title":"Investigating Causal Relations by Econometric Models and Cross-spectral Methods","volume":"37","author":"Granger","year":"1969","journal-title":"Econom. J. Econom. Soc."},{"key":"ref_7","first-page":"1","article-title":"A Survey of Learning Causality with Data: Problems and Methods","volume":"53","author":"Guo","year":"2020","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1038\/40332","article-title":"Evidence for human influence on climate from hemispheric temperature relations","volume":"388","author":"Kaufmann","year":"1997","journal-title":"Nature"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1162\/003465304323023651","article-title":"Nonparametric Estimation of Average Treatment Effects under Exogeneity: A Review*","volume":"86","author":"Imbens","year":"2004","journal-title":"Rev. Econ. Stat."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1097\/ALN.0000000000003398","article-title":"Granger causality of the electroencephalogram reveals abrupt global loss of cortical information flow during propofol-induced loss of responsiveness","volume":"133","author":"Pullon","year":"2020","journal-title":"Anesthesiology"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.jneumeth.2012.09.019","article-title":"A new NARX-based Granger linear and nonlinear casual influence detection method with applications to EEG data","volume":"212","author":"Zhao","year":"2013","journal-title":"J. Neurosci. Methods"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5648","DOI":"10.1175\/JCLI-D-11-00387.1","article-title":"Causal discovery for climate research using graphical models","volume":"25","author":"Deng","year":"2012","journal-title":"J. Clim."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1080\/01621459.1999.10473858","article-title":"Causal Effects in Nonexperimental Studies: Reevaluating the Evaluation of Training Programs","volume":"94","author":"Dehejia","year":"1999","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1007\/s11063-016-9506-1","article-title":"Directed Connectivity Analysis of Functional Brain Networks during Cognitive Activity Using Transfer Entropy","volume":"45","author":"Shovon","year":"2017","journal-title":"Neural Process. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/j.compbiomed.2019.04.038","article-title":"Synchronous analysis of brain regions based on multi-scale permutation transfer entropy","volume":"109","author":"Gao","year":"2019","journal-title":"Comput. Biol. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3293","DOI":"10.1523\/JNEUROSCI.4399-14.2015","article-title":"Granger causality analysis in neuroscience and neuroimaging","volume":"35","author":"Seth","year":"2015","journal-title":"J. Neurosci."},{"key":"ref_17","unstructured":"Ding, M., Chen, Y., and Bressler, S.L. (2006). Handbook of Time Series Analysis: Recent Theoretical Developments and Applications, John Wiley & Sons."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lima, V., Dellajustina, F.J., Shimoura, R.O., Girardi-Schappo, M., Kamiji, N.L., Pena, R.F., and Roque, A.C. (2020). Granger causality in the frequency domain: Derivation and applications. Rev. Bras. Ensino Fis., 42.","DOI":"10.1590\/1806-9126-rbef-2020-0007"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"023011","DOI":"10.1088\/0029-5515\/54\/2\/023011","article-title":"Causality detection and turbulence in fusion plasmas","volume":"54","author":"Birkenmeier","year":"2014","journal-title":"Nucl. Fusion"},{"key":"ref_20","unstructured":"Sigtermans, D. (2020). Is Information Theory Inherently a Theory of Causation?. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1016\/j.neuroimage.2010.02.059","article-title":"Wiener-Granger Causality: A well established methodology","volume":"58","author":"Bressler","year":"2011","journal-title":"Neuroimage"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1080\/01621459.1982.10477803","article-title":"Measurement of Linear Dependence and Feedback Between Multiple Time Series Measurement of Linear Dependence and Feedback Betwveen Multiple Time Series","volume":"77","author":"Geweke","year":"1982","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1080\/01621459.1984.10477110","article-title":"Measures of Conditional Linear Dependence and Feedback Between Time Series","volume":"79","author":"Geweke","year":"1984","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"018701","DOI":"10.1103\/PhysRevLett.100.018701","article-title":"Estimating granger causality from fourier and wavelet transforms of time series data","volume":"100","author":"Dhamala","year":"2008","journal-title":"Phys. Rev. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.neuroimage.2008.02.020","article-title":"Analyzing information flow in brain networks with nonparametric Granger causality","volume":"41","author":"Dhamala","year":"2008","journal-title":"NeuroImage"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/1753-4631-3-2","article-title":"Everything you wanted to ask about EEG but were afraid to get the right answer","volume":"3","author":"Klonowski","year":"2009","journal-title":"Nonlinear Biomed. Phys."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.neuroscience.2020.12.001","article-title":"Nonlinear System Identification of Neural Systems from Neurophysiological Signals","volume":"458","author":"He","year":"2021","journal-title":"Neuroscience"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring Information Transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"238701","DOI":"10.1103\/PhysRevLett.103.238701","article-title":"Granger causality and transfer entropy Are equivalent for gaussian variables","volume":"103","author":"Barnett","year":"2009","journal-title":"Phys. Rev. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kim, E.J., and Guel-Cortez, A.J. (2021). Causal information rate. Entropy, 23.","DOI":"10.3390\/e23081087"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"93406","DOI":"10.1088\/1742-5468\/ac21d6","article-title":"Information geometry and non-equilibrium thermodynamic relations in the over-damped stochastic processes","volume":"2021","author":"Kim","year":"2021","journal-title":"J. Stat. Mech. Theory Exp."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kim, E.j. (2021). Information geometry, fluctuations, non-equilibrium thermodynamics, and geodesics in complex systems. Entropy, 23.","DOI":"10.3390\/e23111393"},{"key":"ref_33","first-page":"021056","article-title":"Stochastic Time Evolution, Information Geometry, and the Cram\u00e9r-Rao Bound","volume":"10","author":"Ito","year":"2020","journal-title":"Phys. Rev. X"},{"key":"ref_34","unstructured":"O\u2019donnell, R.T., Korb, K.B., and Allison, L. (2021). Causal KL: Evaluating Causal Discovery. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1137\/0123044","article-title":"The Factorization of Matricial Spectral Densities","volume":"23","author":"Wilson","year":"1972","journal-title":"SIAM J. Appl. Math."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1086\/664628","article-title":"Causality and persistence in ecological systems: A nonparametric spectral Granger causality approach","volume":"179","author":"Detto","year":"2012","journal-title":"Am. Nat."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"438","DOI":"10.3390\/e17010438","article-title":"A recipe for the estimation of information flow in a dynamical system","volume":"17","author":"Gencaga","year":"2015","journal-title":"Entropy"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sahann, R., Muller, T., and Schmidt, J. (2021, January 24\u201329). Histogram binning revisited with a focus on human perception. Proceedings of the 2021 IEEE Visualization Conference (VIS), New Orleans, LA, USA.","DOI":"10.1109\/VIS49827.2021.9623301"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1080\/01621459.1985.10477163","article-title":"Oversmoothed nonparametric density estimates","volume":"80","author":"Terrell","year":"1985","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Schelter, B., Winterhalder, M., and Timmer, J. (2006). Handbook of Time Series Analysis, Wiley-VCH Verlag GmbH & Co KGaA.","DOI":"10.1002\/9783527609970"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1002\/j.1538-7305.1948.tb00917.x","article-title":"A Mathematical Theory of Communication PART III: MATHEMATICAL PRELIMINARIES","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"107595","DOI":"10.1016\/j.aim.2021.107595","article-title":"The metric property of the quantum Jensen-Shannon divergence","volume":"380","author":"Virosztek","year":"2021","journal-title":"Adv. Math."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"052311","DOI":"10.1103\/PhysRevA.79.052311","article-title":"Properties of classical and quantum Jensen-Shannon divergence","volume":"79","year":"2009","journal-title":"Phys. Rev. A\u2014At. Mol. Opt. Phys."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/5\/806\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:36:26Z","timestamp":1760124986000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/5\/806"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,16]]},"references-count":44,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["e25050806"],"URL":"https:\/\/doi.org\/10.3390\/e25050806","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,16]]}}}