{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T11:51:16Z","timestamp":1775217076575,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,28]],"date-time":"2021-05-28T00:00:00Z","timestamp":1622160000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Causality analysis is an important problem lying at the heart of science, and is of particular importance in data science and machine learning. An endeavor during the past 16 years viewing causality as a real physical notion so as to formulate it from first principles, however, seems to have gone unnoticed. This study introduces to the community this line of work, with a long-due generalization of the information flow-based bivariate time series causal inference to multivariate series, based on the recent advance in theoretical development. The resulting formula is transparent, and can be implemented as a computationally very efficient algorithm for application. It can be normalized and tested for statistical significance. Different from the previous work along this line where only information flows are estimated, here an algorithm is also implemented to quantify the influence of a unit to itself. While this forms a challenge in some causal inferences, here it comes naturally, and hence the identification of self-loops in a causal graph is fulfilled automatically as the causalities along edges are inferred. To demonstrate the power of the approach, presented here are two applications in extreme situations. The first is a network of multivariate processes buried in heavy noises (with the noise-to-signal ratio exceeding 100), and the second a network with nearly synchronized chaotic oscillators. In both graphs, confounding processes exist. While it seems to be a challenge to reconstruct from given series these causal graphs, an easy application of the algorithm immediately reveals the desideratum. Particularly, the confounding processes have been accurately differentiated. Considering the surge of interest in the community, this study is very timely.<\/jats:p>","DOI":"10.3390\/e23060679","type":"journal-article","created":{"date-parts":[[2021,5,28]],"date-time":"2021-05-28T11:33:20Z","timestamp":1622201600000},"page":"679","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":69,"title":["Normalized Multivariate Time Series Causality Analysis and Causal Graph Reconstruction"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8472-3211","authenticated-orcid":false,"given":"X. San","family":"Liang","sequence":"first","affiliation":[{"name":"Nanjing Institute of Meteorology, Nanjing 210044, China"},{"name":"Shanghai Qizhi (Andrew C. Yao) Institute, Shanghai 200030, China"},{"name":"China Institute for Advanced Study, Central University of Finance and Economics, Beijing 100081, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,28]]},"reference":[{"key":"ref_1","unstructured":"Sch\u00f6lkopf, B., Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., and Mooij, J.M. (July, January 26). On causal and anticausal learning. Proceedings of the 29th International Conference on Machine Learning (ICML), Edinburgh, Scotland, UK."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pearl, J. (2009). Causality: Models, Reasoning, and Inference, 2nd ed, Cambridge University Press.","DOI":"10.1017\/CBO9780511803161"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1177\/089443939100900106","article-title":"An algorithm for fast recovery of sparse causal graphs","volume":"9","author":"Spirtes","year":"1991","journal-title":"Soc. Sci. Comput. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"046211","DOI":"10.1103\/PhysRevE.63.046211","article-title":"Synchronization as adjustment of information rates: Detection from bivariate time series","volume":"63","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"244101","DOI":"10.1103\/PhysRevLett.95.244101","article-title":"Information transfer between dynamical system components","volume":"95","author":"Liang","year":"2005","journal-title":"Phys. Rev. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s11023-008-9096-4","article-title":"Detection of unfaithfulness and robust causal inference","volume":"18","author":"Zhang","year":"2008","journal-title":"Minds Mach."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3133","DOI":"10.1214\/09-AOS685","article-title":"Estimating high-dimensional intervention effects from observation data","volume":"37","author":"Maathuis","year":"2009","journal-title":"Ann. Stat."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"051122","DOI":"10.1103\/PhysRevE.83.051122","article-title":"Momentary information transfer as a coupling measure of time series","volume":"83","author":"Pompe","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.artint.2012.01.002","article-title":"Information-geometric approach to inferring causal dierctions","volume":"182","author":"Janzing","year":"2012","journal-title":"Artif. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1126\/science.1227079","article-title":"Detecting causality in complex ecosystems","volume":"338","author":"Sugihara","year":"2012","journal-title":"Science"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.physd.2013.07.001","article-title":"Causation entropy identifies indirect influences, dominance of neighbors, and anticipatory couplings","volume":"267","author":"Sun","year":"2014","journal-title":"Physica D"},{"key":"ref_13","unstructured":"Peters, J., Janzing, D., and Sch\u00f6lkopf, B. (2017). Elements of Causal Inference: Foundations and Learning Algorithms, The MIT Press."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/s40535-016-0018-x","article-title":"Causal discovery and inference: Concepts and recent methodological advances","volume":"3","author":"Spirtes","year":"2016","journal-title":"Appl. Inform."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"424","DOI":"10.2307\/1912791","article-title":"Investigating causal relations by econometric models and cross-spectral methods","volume":"37","author":"Granger","year":"1969","journal-title":"Econometrica"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"052201","DOI":"10.1103\/PhysRevE.94.052201","article-title":"Information flow and causality as rigorous notions ab initio","volume":"94","author":"Liang","year":"2016","journal-title":"Phys. Rev. E"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"031113","DOI":"10.1103\/PhysRevE.78.031113","article-title":"Information flow within stochastic dynamical systems","volume":"78","author":"Liang","year":"2008","journal-title":"Phys. Rev. E"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"052150","DOI":"10.1103\/PhysRevE.90.052150","article-title":"Unraveling the cause-effect relation between time series","volume":"90","author":"Liang","year":"2014","journal-title":"Phys. Rev. E"},{"key":"ref_19","first-page":"2162","article-title":"Counterfactual analyses with graphical models based on local independence","volume":"40","year":"2012","journal-title":"Ann. Stat."},{"key":"ref_20","unstructured":"Mooij, J.M., Janzing, D., Heskes, T., and Sch\u00f6lkopf, B. (2013, January 11\u201315). From ordinary differential equations to structural causal models: The deterministic case. Proceedings of the 29th Annual Conference on Uncertainty in Artificial Intelligence, Bellevue, WA, USA."},{"key":"ref_21","unstructured":"Mogensen, S.W., Malinksky, D., and Hansen, N.R. (2018, January 6\u201310). Causal learning for partially observed stochastic dynamical systems. Proceedings of the 34th Conference on Uncertainty in Artificial Intelligence (UAI), Monterey, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"013115","DOI":"10.1063\/5.0023419","article-title":"A generalized permutation entropy for noisy dynamics and random processes","volume":"31","author":"Dale","year":"2021","journal-title":"Chaos"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"075311","DOI":"10.1063\/1.5010253","article-title":"Information flow with respect to relative entropy","volume":"28","author":"Liang","year":"2018","journal-title":"Chaos"},{"key":"ref_24","unstructured":"Berkeley, G. (1710). A Treatise Concerning the Principles of Human Knowledge, Aaron Rhames."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liang, X.S., and Yang, X.-Q. (2021). A note on causation versus correlation in an extreme situation. Entropy, 23.","DOI":"10.3390\/e23030316"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"12870","DOI":"10.1103\/PhysRevLett.107.128701","article-title":"Distinguishing anticipation from causality: Anticipatory bias in the estimation of information flow","volume":"107","author":"Hahs","year":"2011","journal-title":"Phys. Rev. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"21691","DOI":"10.1038\/srep21691","article-title":"On the causal structure between CO2 and global temperature","volume":"6","author":"Stips","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"7521","DOI":"10.1175\/JCLI-D-18-0881.1","article-title":"A time-varying causality formalism based on the Liang-Kleeman information flow for analyzing directed interactions in nonstationary climate systems","volume":"32","author":"Hagan","year":"2019","journal-title":"J. Clim."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Vannitsem, S., Dalaiden, Q., and Goosse, H. (2019). Testing for dynamical dependence\u2014Application to the surface mass balance over Antarctica. Geophys. Res. Lett.","DOI":"10.5194\/egusphere-egu2020-11492"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"419","DOI":"10.3389\/fnhum.2019.00419","article-title":"Dirupted information flow in resting-state in adolescents with sports related concussion","volume":"13","author":"Hristopulos","year":"2019","journal-title":"Front. Hum. Neurosci."},{"key":"ref_31","unstructured":"Garthwaite, P.H., Jolliffe, I.T., and Jones, B. (1995). Statistical Inference, Prentice-Hall."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"022126","DOI":"10.1103\/PhysRevE.92.022126","article-title":"Normalizing the causality between time series","volume":"92","author":"Liang","year":"2015","journal-title":"Phys. Rev. E"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"075307","DOI":"10.1063\/1.5019944","article-title":"Causality, dynamical systems and the arrow of time","volume":"28","author":"Jakubfk","year":"2018","journal-title":"Chaos"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/6\/679\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:39Z","timestamp":1760162979000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/6\/679"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,28]]},"references-count":33,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["e23060679"],"URL":"https:\/\/doi.org\/10.3390\/e23060679","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,28]]}}}