{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T23:57:32Z","timestamp":1772323052939,"version":"3.50.1"},"reference-count":23,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2013,8,7]],"date-time":"2013-08-07T00:00:00Z","timestamp":1375833600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The transfer entropy has proven a useful measure of coupling among components of a dynamical system. This measure effectively captures the influence of one system component on the transition probabilities (dynamics) of another. The original motivation for the measure was to quantify such relationships among signals collected from a nonlinear system. However, we have found the transfer entropy to also be a useful concept in describing linear coupling among system components. In this work we derive the analytical transfer entropy for the response of coupled, second order linear systems driven with a Gaussian random process. The resulting expression is a function of the auto- and cross-correlation functions associated with the system response for different degrees-of-freedom. We show clearly that the interpretation of the transfer entropy as a measure of \"information flow\" is not always valid. In fact, in certain instances the \"flow\" can appear to switch directions simply by altering the degree of linear coupling. A safer way to view the transfer entropy is as a measure of the ability of a given system component to predict the dynamics of another.<\/jats:p>","DOI":"10.3390\/e15083276","type":"journal-article","created":{"date-parts":[[2013,8,7]],"date-time":"2013-08-07T11:46:51Z","timestamp":1375876011000},"page":"3186-3204","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Linearized Transfer Entropy for Continuous Second Order Systems"],"prefix":"10.3390","volume":"15","author":[{"given":"Jonathan","family":"Nichols","sequence":"first","affiliation":[{"name":"Naval Research Laboratory, Optical Sciences Division, Washington DC 20375, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frank","family":"Bucholtz","sequence":"additional","affiliation":[{"name":"Naval Research Laboratory, Optical Sciences Division, Washington DC 20375, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joe","family":"Michalowicz","sequence":"additional","affiliation":[{"name":"Naval Research Laboratory, Optical Science Division, Washington DC 20375, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2013,8,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0167-2789(02)00432-3","article-title":"Information transfer in continuous processes","volume":"166","author":"Kaiser","year":"2002","journal-title":"Phys. D: Nonlinear Phenom."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.ecolmodel.2007.05.016","article-title":"Application of information theory methods to food web reconstruction","volume":"208","author":"Moniz","year":"2007","journal-title":"Ecol. Model."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/TCST.2006.883234","article-title":"Finding the direction of disturbance propagation in a chemical process using transfer entropy","volume":"15","author":"Bauer","year":"2007","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1140\/epjb\/e2002-00379-2","article-title":"Analysing the information flow between financial time series: An improved estimator for transfer entropy","volume":"30","author":"Marschinski","year":"2002","journal-title":"Eur. Phys. J. B"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1016\/j.probengmech.2006.02.003","article-title":"Examining structural dynamics using information flow","volume":"21","author":"Nichols","year":"2006","journal-title":"Probab. Eng. Mech."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1088\/0964-1726\/15\/2\/023","article-title":"Detecting impact damage in experimental composite structures: An information-theoretic approach","volume":"15","author":"Nichols","year":"2006","journal-title":"Smart Mater. Struct."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s10867-007-9047-y","article-title":"Mapping the information landscape: Discerning peaks and valleys for ecological monitoring","volume":"33","author":"Moniz","year":"2007","journal-title":"J. Biol. Phys."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s10827-010-0262-3","article-title":"Transfer entropy-a model-free measure of effective connectivity for the neurosciences","volume":"30","author":"Vicente","year":"2001","journal-title":"J. Comput. Neurosci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.pbiomolbio.2010.11.006","article-title":"Transfer entropy in magnetoencephalographic data: Quantifying information flow in cortical and cerebellar networks","volume":"105","author":"Wibral","year":"2011","journal-title":"Progr. Biophys. Mol. Biol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.jneumeth.2009.07.014","article-title":"Confounding effects of indirect connections on causality estimation","volume":"184","author":"Vakorin","year":"2009","journal-title":"J. Neurosci. Method."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"238701","DOI":"10.1103\/PhysRevLett.103.238701","article-title":"Granger causality and transfer entropy are equivalent for gaussian variables","volume":"103","author":"Barnett","year":"2009","journal-title":"Phys. Rev. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"056211","DOI":"10.1103\/PhysRevE.75.056211","article-title":"Directionality of coupling from bivariate time series: How to avoid false causalities and missed connections","volume":"75","author":"Palus","year":"2007","journal-title":"Phys. Rev. E"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1016\/S1053-8119(03)00202-7","article-title":"Dynamic causal modelling","volume":"19","author":"Friston","year":"2003","journal-title":"NeuroImage"},{"key":"ref_15","unstructured":"Greenberg, M.D. (1988). Advanced Engineering Mathematics, Prentice-Hall, Inc."},{"key":"ref_16","unstructured":"Bendat, J.S., and Piersol, A.G. (2000). Random Data Analysis and Measurement Procedures, Wiley & Sons. [3rd ed.]."},{"key":"ref_17","unstructured":"Kay, S.M. (1993). Fundamentals of Statistical Signal Processing: Volume I, Estimation Theory, Prentice Hall."},{"key":"ref_18","unstructured":"Meirovitch, L. (1985). Introduction to Dynamics and Control, Wiley & Sons.. [1st ed.]."},{"key":"ref_19","unstructured":"Crandall, S.H., and Mark, W.D. (1963). Random Vibration in Mechanical Systems, Academic Press."},{"key":"ref_20","unstructured":"Benaroya, H. (1998). Mechanical Vibration: Analysis, Uncertainties, and Control, Prentice Hall."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3879","DOI":"10.1109\/TSP.2009.2024267","article-title":"The bispectrum and bicoherence for quadratically nonlinear systems subject to non-gaussian inputs","volume":"57","author":"Nichols","year":"2009","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1073\/pnas.17.2.656","article-title":"Proof of the ergodic theorem","volume":"17","author":"Birkhoff","year":"1931","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"128701","DOI":"10.1103\/PhysRevLett.107.128701","article-title":"Distinguishing Anticipation from Causality: Anticipatory Bias in the Estimation of Information Flow","volume":"107","author":"Hahs","year":"2011","journal-title":"Phys. Rev. Lett."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/15\/8\/3186\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:48:29Z","timestamp":1760219309000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/15\/8\/3186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,8,7]]},"references-count":23,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2013,8]]}},"alternative-id":["e15083276"],"URL":"https:\/\/doi.org\/10.3390\/e15083276","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,8,7]]}}}