{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T11:36:36Z","timestamp":1761824196357,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,3,30]],"date-time":"2020-03-30T00:00:00Z","timestamp":1585526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000183","name":"Army Research Office","doi-asserted-by":"publisher","award":["W911NF16-1-0081"],"award-info":[{"award-number":["W911NF16-1-0081"]}],"id":[{"id":"10.13039\/100000183","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["1"],"award-info":[{"award-number":["1"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Causal inference is perhaps one of the most fundamental concepts in science, beginning originally from the works of some of the ancient philosophers, through today, but also weaved strongly in current work from statisticians, machine learning experts, and scientists from many other fields. This paper takes the perspective of information flow, which includes the Nobel prize winning work on Granger-causality, and the recently highly popular transfer entropy, these being probabilistic in nature. Our main contribution will be to develop analysis tools that will allow a geometric interpretation of information flow as a causal inference indicated by positive transfer entropy. We will describe the effective dimensionality of an underlying manifold as projected into the outcome space that summarizes information flow. Therefore, contrasting the probabilistic and geometric perspectives, we will introduce a new measure of causal inference based on the fractal correlation dimension conditionally applied to competing explanations of future forecasts, which we will write     G e o  C  y \u2192 x      . This avoids some of the boundedness issues that we show exist for the transfer entropy,     T  y \u2192 x     . We will highlight our discussions with data developed from synthetic models of successively more complex nature: these include the H\u00e9non map example, and finally a real physiological example relating breathing and heart rate function.<\/jats:p>","DOI":"10.3390\/e22040396","type":"journal-article","created":{"date-parts":[[2020,3,31]],"date-time":"2020-03-31T13:27:19Z","timestamp":1585661239000},"page":"396","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["On Geometry of Information Flow for Causal Inference"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7721-8735","authenticated-orcid":false,"given":"Sudam","family":"Surasinghe","sequence":"first","affiliation":[{"name":"Department of Mathematics, Clarkson University, Potsdam, NY 13699, USA"}]},{"given":"Erik M.","family":"Bollt","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Clarkson Center for Complex Systems Science (C3S2), Clarkson University, Potsdam, NY 13699, USA"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1093\/mind\/LXXXII.328.617","article-title":"\u201cAristotle\u2019s Physics, Books I and II\u201d, Translated with Introduction and Notes by W. Charlton","volume":"82","author":"Williams","year":"1973","journal-title":"Mind"},{"key":"ref_2","unstructured":"Zalta, E.N. (2019). Aristotle on Causality. The Stanford Encyclopedia of Philosophy, Metaphysics Research Lab, Stanford University. [Spring 2019 ed.]."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/aristotelian\/13.1.1","article-title":"I.\u2014On the Notion of Cause","volume":"13","author":"Russell","year":"1913","journal-title":"Proc. Aristot. Soc."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"075309","DOI":"10.1063\/1.5031109","article-title":"Open or closed? Information flow decided by transfer operators and forecastability quality metric","volume":"28","author":"Bollt","year":"2018","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.0347-0520.2004.00361.x","article-title":"The Nobel Memorial Prize for Clive W. J. Granger","volume":"106","author":"Hendry","year":"2004","journal-title":"Scand. J. Econ."},{"key":"ref_6","unstructured":"Wiener, N. (1956). The theory of prediction. Mathematics for the Engineer, McGraw-Hill."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring Information Transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bollt, E., and Santitissadeekorn, N. (2013). Applied and Computational Measurable Dynamics, Society for Industrial and Applied Mathematics.","DOI":"10.1137\/1.9781611972641"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"238701","DOI":"10.1103\/PhysRevLett.103.238701","article-title":"Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables","volume":"103","author":"Barnett","year":"2009","journal-title":"Phys. Rev. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1126\/science.1227079","article-title":"Detecting Causality in Complex Ecosystems","volume":"338","author":"Sugihara","year":"2012","journal-title":"Science"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.physd.2013.07.001","article-title":"Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings","volume":"267","author":"Sun","year":"2014","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1137\/140956166","article-title":"Causal Network Inference by Optimal Causation Entropy","volume":"14","author":"Sun","year":"2015","journal-title":"SIAM J. Appl. Dyn. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"075201","DOI":"10.1063\/1.5046848","article-title":"Introduction to Focus Issue: Causation inference and information flow in dynamical systems: Theory and applications","volume":"28","author":"Bollt","year":"2018","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-019-10105-3","article-title":"Inferring causation from time series in Earth system sciences","volume":"10","author":"Runge","year":"2019","journal-title":"Nat. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1109\/TMBMC.2016.2632099","article-title":"Inference of causal information flow in collective animal behavior","volume":"2","author":"Lord","year":"2016","journal-title":"IEEE Trans. Mol. Biol. Multi-Scale Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"011008","DOI":"10.1115\/1.4034126","article-title":"Causation entropy identifies sparsity structure for parameter estimation of dynamic systems","volume":"12","author":"Kim","year":"2017","journal-title":"J. Comput. Nonlinear Dyn."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"AlMomani, A.A.R., Sun, J., and Bollt, E. (2019). How Entropic Regression Beats the Outliers Problem in Nonlinear System Identification. arXiv.","DOI":"10.1063\/1.5133386"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"116312","DOI":"10.1063\/1.4967920","article-title":"Information-theoretical noninvasive damage detection in bridge structures","volume":"26","author":"Sun","year":"2016","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Collins, J., Hall, N., and Paul, L. (2004). Two Concepts of Causation. Causation and Counterfactuals, MIT Press.","DOI":"10.7551\/mitpress\/1752.001.0001"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Corfield, D., and Williamson, J. (2001). Bayesianism and Causality, or, Why I Am Only a Half-Bayesian. Foundations of Bayesianism, Kluwer Academic Publishers.","DOI":"10.1007\/978-94-017-1586-7"},{"key":"ref_21","first-page":"1","article-title":"Linking Granger Causality and the Pearl Causal Model with Settable Systems","volume":"12","author":"White","year":"2011","journal-title":"JMRL Workshop Conf. Proc."},{"key":"ref_22","first-page":"1759","article-title":"Settable Systems: An Extension of Pearl\u2019s Causal Model with Optimization, Equilibrium, and Learning","volume":"10","author":"White","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bollt, E. (2012). Synchronization as a process of sharing and transferring information. Int. J. Bifurc. Chaos, 22.","DOI":"10.1142\/S0218127412502616"},{"key":"ref_24","unstructured":"Lasota, A., and Mackey, M. (2013). Chaos, Fractals, and Noise: Stochastic Aspects of Dynamics, Springer."},{"key":"ref_25","first-page":"28","article-title":"Information and information stability of random variables and processes","volume":"133","author":"Pinsker","year":"1960","journal-title":"Dokl. Akad. Nauk SSSR"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Boucheron, S., Lugosi, G., and Massart, P. (2013). Concentration Inequalities: A Nonasymptotic Theory of Independence, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199535255.001.0001"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1007\/BF01053745","article-title":"Embedology","volume":"65","author":"Sauer","year":"1991","journal-title":"Stat. Phys."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1017\/S0143385797086252","article-title":"Are the dimensions of a set and its image equal under typical smooth functions?","volume":"17","author":"Sauer","year":"1997","journal-title":"Ergod. Theory Dyn. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/0167-2789(83)90298-1","article-title":"Measuring the strangeness of strange attractors","volume":"9","author":"Grassberger","year":"1983","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1103\/PhysRevLett.50.346","article-title":"Characterization of Strange Attractors","volume":"50","author":"Grassberger","year":"1983","journal-title":"Phys. Rev. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/0375-9601(83)90753-3","article-title":"Generalized dimensions of strange attractors","volume":"97","author":"Grassberger","year":"1983","journal-title":"Phys. Lett. A"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_33","unstructured":"Rigney, D., Goldberger, A., Ocasio, W., Ichimaru, Y., Moody, G., and Mark, R. (1993). Multi-channel physiological data: Description and analysis. Time Series Prediction: Forecasting the Future and Understanding the Past, Addison-Wesley."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1046\/j.1440-1819.1999.00527.x","article-title":"Development of the polysomnographic database on CD-ROM","volume":"53","author":"Ichimaru","year":"1999","journal-title":"Psychiatry Clin. Neurosci."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/4\/396\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:13:36Z","timestamp":1760174016000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/4\/396"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,30]]},"references-count":34,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["e22040396"],"URL":"https:\/\/doi.org\/10.3390\/e22040396","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2020,3,30]]}}}