{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T07:14:51Z","timestamp":1776323691231,"version":"3.50.1"},"reference-count":62,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2017,8,8]],"date-time":"2017-08-08T00:00:00Z","timestamp":1502150400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms, constituting the frameworks known as interaction information decomposition and partial information decomposition, can thus be analytically obtained for different time scales from the parameters of the VAR model that fits the processes. We report the application of the proposed methodology firstly to benchmark Gaussian systems, showing that this class of systems may generate patterns of information decomposition characterized by prevalently redundant or synergistic information transfer persisting across multiple time scales or even by the alternating prevalence of redundant and synergistic source interaction depending on the time scale. Then, we apply our method to an important topic in neuroscience, i.e., the detection of causal interactions in human epilepsy networks, for which we show the relevance of partial information decomposition to the detection of multiscale information transfer spreading from the seizure onset zone.<\/jats:p>","DOI":"10.3390\/e19080408","type":"journal-article","created":{"date-parts":[[2017,8,8]],"date-time":"2017-08-08T10:28:08Z","timestamp":1502188088000},"page":"408","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":87,"title":["Multiscale Information Decomposition: Exact Computation for Multivariate Gaussian Processes"],"prefix":"10.3390","volume":"19","author":[{"given":"Luca","family":"Faes","sequence":"first","affiliation":[{"name":"Bruno Kessler Foundation, 38123 Trento, Italy"},{"name":"BIOtech, Department of Industrial Engineering, University of Trento, 38123 Trento, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9803-0122","authenticated-orcid":false,"given":"Daniele","family":"Marinazzo","sequence":"additional","affiliation":[{"name":"Data Analysis Department, Ghent University, 9000 Ghent, Belgium"}]},{"given":"Sebastiano","family":"Stramaglia","sequence":"additional","affiliation":[{"name":"Dipartimento di Fisica, Universit\u00e1 degli Studi Aldo Moro, 70126 Bari, Italy"},{"name":"Istituto Nazionale di Fisica Nucleare, 70126 Sezione di Bari, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2017,8,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lizier, J.T., Prokopenko, M., and Zomaya, A.Y. (2014). A framework for the local information dynamics of distributed computation in complex systems. Guided Self-Organization: Inception, Springer.","DOI":"10.1007\/978-3-642-53734-9_5"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1063\/1.166092","article-title":"Approximate entropy (ApEn) as a complexity measure","volume":"5","author":"Pincus","year":"1995","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.ins.2012.04.016","article-title":"Local measures of information storage in complex distributed computation","volume":"208","author":"Lizier","year":"2012","journal-title":"Inf. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wibral, M., Lizier, J.T., V\u00f6gler, S., Priesemann, V., and Galuske, R. (2014). Local active information storage as a tool to understand distributed neural information processing. Front. Neuroinform., 8.","DOI":"10.3389\/fninf.2014.00001"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wibral, M., Vicente, R., and Lizier, J.T. (2014). Directed Information Measures in Neuroscience, Springer.","DOI":"10.1007\/978-3-642-54474-3"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"037109","DOI":"10.1063\/1.3486801","article-title":"Information modification and particle collisions in distributed computation","volume":"20","author":"Lizier","year":"2010","journal-title":"Chaos Interdiscip. J. Nonlinear Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wibral, M., Lizier, J.T., and Priesemann, V. (2015). Bits from brains for biologically inspired computing. Front. Robot. Artif. Intell., 2.","DOI":"10.3389\/frobt.2015.00005"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1162\/artl_a_00040","article-title":"Information dynamics in small-world Boolean networks","volume":"17","author":"Lizier","year":"2011","journal-title":"Artif. Life"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.pbiomolbio.2010.11.006","article-title":"Transfer entropy in magnetoencephalographic data: Quantifying information flow in cortical and cerebellar networks","volume":"105","author":"Wibral","year":"2011","journal-title":"Prog. Biophys. Mol. Biol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2023","DOI":"10.3390\/e15062023","article-title":"Reliability of inference of directed climate networks using conditional mutual information","volume":"15","author":"Hlinka","year":"2013","journal-title":"Entropy"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"177203","DOI":"10.1103\/PhysRevLett.111.177203","article-title":"Information flow in a kinetic Ising model peaks in the disordered phase","volume":"111","author":"Barnett","year":"2013","journal-title":"Phys. Rev. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Marinazzo, D., Pellicoro, M., Wu, G., Angelini, L., Cort\u00e9s, J.M., and Stramaglia, S. (2014). Information transfer and criticality in the ising model on the human connectome. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0093616"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"105005","DOI":"10.1088\/1367-2630\/16\/10\/105005","article-title":"Information dynamics of brain\u2013heart physiological networks during sleep","volume":"16","author":"Faes","year":"2014","journal-title":"New J. Phys."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"277","DOI":"10.3390\/e17010277","article-title":"Information decomposition in bivariate systems: Theory and application to cardiorespiratory dynamics","volume":"17","author":"Faes","year":"2015","journal-title":"Entropy"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Porta, A., Faes, L., Nollo, G., Bari, V., Marchi, A., de Maria, B., Takahashi, A.C., and Catai, A.M. (2015). Conditional self-entropy and conditional joint transfer entropy in heart period variability during graded postural challenge. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0132851"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Faes, L., Porta, A., Nollo, G., and Javorka, M. (2017). Information Decomposition in Multivariate Systems: Definitions, Implementation and Application to Cardiovascular Networks. Entropy, 19.","DOI":"10.3390\/e19010005"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wollstadt, P., Sellers, K.K., Rudelt, L., Priesemann, V., Hutt, A., Fr\u00f6hlich, F., and Wibral, M. (2017). Breakdown of local information processing may underlie isoflurane anesthesia effects. PLoS Comput. Biol., 13.","DOI":"10.1371\/journal.pcbi.1005511"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"11539","DOI":"10.1523\/JNEUROSCI.23-37-11539.2003","article-title":"Synergy, redundancy, and independence in population codes","volume":"23","author":"Schneidman","year":"2003","journal-title":"J. Neurosci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"066211","DOI":"10.1103\/PhysRevE.86.066211","article-title":"Expanding the transfer entropy to identify information circuits in complex systems","volume":"86","author":"Stramaglia","year":"2012","journal-title":"Phys. Rev. E"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"105003","DOI":"10.1088\/1367-2630\/16\/10\/105003","article-title":"Synergy and redundancy in the Granger causal analysis of dynamical networks","volume":"16","author":"Stramaglia","year":"2014","journal-title":"New J. Phys."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2518","DOI":"10.1109\/TBME.2016.2559578","article-title":"Synergetic and Redundant Information Flow Detected by Unnormalized Granger Causality: Application to Resting State fMRI","volume":"63","author":"Stramaglia","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1109\/TIT.1954.1057469","article-title":"Multivariate information transmission","volume":"4","author":"McGill","year":"1954","journal-title":"Trans. IRE Prof. Group Inf. Theory"},{"key":"ref_24","unstructured":"Bell, A.J. (2003, January 1\u20134). The co-information lattice. Proceedings of the Fourth International Symposium on Independent Component Analysis and Blind Signal Separation (ICA), Nara, Japan."},{"key":"ref_25","unstructured":"Williams, P.L., and Beer, R.D. (arXiv, 2010). Nonnegative decomposition of multivariate information, arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"012130","DOI":"10.1103\/PhysRevE.87.012130","article-title":"Bivariate measure of redundant information","volume":"87","author":"Harder","year":"2013","journal-title":"Phys. Rev. E"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1985","DOI":"10.3390\/e16041985","article-title":"Intersection information based on common randomness","volume":"16","author":"Griffith","year":"2014","journal-title":"Entropy"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Quax, R., Har-Shemesh, O., and Sloot, P.M.A. (2017). Quantifying Synergistic Information Using Intermediate Stochastic Variables. Entropy, 19.","DOI":"10.3390\/e19020085"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.3390\/e16042161","article-title":"Quantifying unique information","volume":"16","author":"Bertschinger","year":"2014","journal-title":"Entropy"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1152\/jn.00559.2007","article-title":"Correcting for the sampling bias problem in spike train information measures","volume":"98","author":"Panzeri","year":"2007","journal-title":"J. Neurophysiol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Faes, L., and Porta, A. (2014). Conditional entropy-based evaluation of information dynamics in physiological systems. Directed Information Measures in Neuroscience, Springer.","DOI":"10.1007\/978-3-642-54474-3_3"},{"key":"ref_32","first-page":"9","article-title":"Sample estimate of the entropy of a random vector","volume":"23","author":"Kozachenko","year":"1987","journal-title":"Probl. Peredachi Inf."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"016207","DOI":"10.1103\/PhysRevE.82.016207","article-title":"Nonuniform state-space reconstruction and coupling detection","volume":"82","author":"Vlachos","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"303601","DOI":"10.1155\/2012\/303601","article-title":"Causal information approach to partial conditioning in multivariate data sets","volume":"2012","author":"Marinazzo","year":"2012","journal-title":"Comput. Math. Methods Med."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"032904","DOI":"10.1103\/PhysRevE.91.032904","article-title":"Estimating the decomposition of predictive information in multivariate systems","volume":"91","author":"Faes","year":"2015","journal-title":"Phys. Rev. E"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"052802","DOI":"10.1103\/PhysRevE.91.052802","article-title":"Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems","volume":"91","author":"Barrett","year":"2015","journal-title":"Phys. Rev. E"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"041907","DOI":"10.1103\/PhysRevE.81.041907","article-title":"Multivariate Granger causality and generalized variance","volume":"81","author":"Barrett","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_38","unstructured":"Porta, A., Bari, V., de Maria, B., Takahashi, A.C., Guzzetti, S., Colombo, R., Catai, A.M., Raimondi, F., and Faes, L. (2017). Quantifying Net Synergy\/Redundancy of Spontaneous Variability Regulation via Predictability and Transfer Entropy Decomposition Frameworks. IEEE Trans. Biomed. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1038\/20924","article-title":"Multifractality in human heartbeat dynamics","volume":"399","author":"Ivanov","year":"1999","journal-title":"Nature"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"241","DOI":"10.3390\/e13010241","article-title":"Wavelet-based multi-scale entropy analysis of complex rainfall time series","volume":"13","author":"Chou","year":"2011","journal-title":"Entropy"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1350006","DOI":"10.1142\/S012918311350006X","article-title":"Multiscale entropy analysis of traffic time series","volume":"24","author":"Wang","year":"2013","journal-title":"Int. J. Mod. Phys. C"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"068102","DOI":"10.1103\/PhysRevLett.89.068102","article-title":"Multiscale entropy analysis of complex physiologic time series","volume":"89","author":"Costa","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2202","DOI":"10.1109\/TBME.2009.2021986","article-title":"Refined multiscale entropy: Application to 24-h holter recordings of heart period variability in healthy and aortic stenosis subjects","volume":"56","author":"Valencia","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"040101","DOI":"10.1103\/PhysRevE.91.040101","article-title":"Granger causality for state-space models","volume":"91","author":"Barnett","year":"2015","journal-title":"Phys. Rev. E"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1162\/NECO_a_00828","article-title":"State-space analysis of Granger-Geweke causality measures with application to fMRI","volume":"28","author":"Solo","year":"2016","journal-title":"Neural Comput."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1016\/j.neuroimage.2009.12.050","article-title":"The effect of filtering on Granger causality based multivariate causality measures","volume":"50","author":"Florin","year":"2010","journal-title":"Neuroimage"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.jneumeth.2016.10.016","article-title":"Detectability of Granger causality for subsampled continuous-time neurophysiological processes","volume":"275","author":"Barnett","year":"2017","journal-title":"J. Neurosci. Methods"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Faes, L., Montalto, A., Stramaglia, S., Nollo, G., and Marinazzo, D. (arXiv, 2016). Multiscale Analysis of Information Dynamics for Linear Multivariate Processes, arXiv.","DOI":"10.1109\/EMBC.2016.7591969"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Faes, L., Nollo, G., Stramaglia, S., and Marinazzo, D. (arXiv, 2017). Multiscale Granger causality, arXiv.","DOI":"10.1103\/PhysRevE.96.042150"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/07474939108800194","article-title":"State space modeling of multiple time series","volume":"10","author":"Aoki","year":"1991","journal-title":"Econom. Rev."},{"key":"ref_51","unstructured":"Oppenheim, A.V., and Schafer, R.W. (1975). Digital Signal Processing, Prentice-Hall."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Hannan, E.J., and Deistler, M. (2012). The Statistical Theory of Linear Systems, Society for Industrial and Applied Mathematics.","DOI":"10.1137\/1.9781611972191"},{"key":"ref_53","unstructured":"Aoki, M. (2013). State Space Modeling of Time Series, Springer Science & Business Media."},{"key":"ref_54","unstructured":"(2017, May 05). Earth System Research Laboratory. Available online: http:\/\/math.bu.edu\/people\/kolaczyk\/datasets.html."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.eplepsyres.2008.02.002","article-title":"Emergent network topology at seizure onset in humans","volume":"79","author":"Kramer","year":"2008","journal-title":"Epilepsy Res."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1238","DOI":"10.1136\/jnnp-2011-301944","article-title":"Large scale brain models of epilepsy: Dynamics meets connectomics","volume":"83","author":"Richardson","year":"2012","journal-title":"J. Neurol Neurosurg. Psychiatry"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"34824","DOI":"10.1038\/srep34824","article-title":"Weighted and directed interactions in evolving large-scale epileptic brain networks","volume":"6","author":"Dickten","year":"2016","journal-title":"Sci. Rep."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1111\/j.1467-9892.2009.00631.x","article-title":"Computationally efficient methods for two multivariate fractionally integrated models","volume":"30","author":"Sela","year":"2009","journal-title":"J. Time Ser. Anal."},{"key":"ref_59","first-page":"1032","article-title":"Non-gaussian state\u2014Space modeling of nonstationary time series","volume":"82","author":"Kitagawa","year":"1987","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"5263","DOI":"10.3390\/e16105263","article-title":"Cross-scale interactions and information transfer","volume":"16","year":"2014","journal-title":"Entropy"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"036207","DOI":"10.1103\/PhysRevE.83.036207","article-title":"Reducing the bias of causality measures","volume":"83","author":"Papana","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1109\/TBME.2016.2600160","article-title":"Are Nonlinear Model-Free Conditional Entropy Approaches for the Assessment of Cardiac Control Complexity Superior to the Linear Model-Based One?","volume":"64","author":"Porta","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/8\/408\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:41:44Z","timestamp":1760208104000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/19\/8\/408"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,8]]},"references-count":62,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2017,8]]}},"alternative-id":["e19080408"],"URL":"https:\/\/doi.org\/10.3390\/e19080408","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,8,8]]}}}