{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T19:57:05Z","timestamp":1777060625008,"version":"3.51.4"},"reference-count":32,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2015,4,2]],"date-time":"2015-04-02T00:00:00Z","timestamp":1427932800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Finding interdependency relations between time series provides valuable knowledge about the processes that generated the signals. Information theory sets a natural framework for important classes of statistical dependencies. However, a reliable estimation from information-theoretic functionals is hampered when the dependency to be assessed is brief or evolves in time. Here, we show that these limitations can be partly alleviated when we have access to an ensemble of independent repetitions of the time series. In particular, we gear a data-efficient estimator of probability densities to make use of the full structure of trial-based measures. By doing so, we can obtain time-resolved estimates for a family of entropy combinations (including mutual information, transfer entropy and their conditional counterparts), which are more accurate than the simple average of individual estimates over trials. We show with simulated and real data generated by coupled electronic circuits that the proposed approach allows one to recover the time-resolved dynamics of the coupling between different subsystems.<\/jats:p>","DOI":"10.3390\/e17041958","type":"journal-article","created":{"date-parts":[[2015,4,7]],"date-time":"2015-04-07T03:47:46Z","timestamp":1428378466000},"page":"1958-1970","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Assessing Coupling Dynamics from an Ensemble of Time Series"],"prefix":"10.3390","volume":"17","author":[{"given":"Germ\u00e1n","family":"G\u00f3mez-Herrero","sequence":"first","affiliation":[{"name":"Netherlands Institute for Neuroscience, Meibergdreef 47, Amsterdam 1105 BA, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Wu","sequence":"additional","affiliation":[{"name":"Lab of Neurophysics and Neurophysiology, Hefei National Laboratory for Physical Sciences at the Microscale, University of Science and Technology of China, 96 JinZhai Rd., Hefei 230026, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kalle","family":"Rutanen","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Tampere University of Technology, Korkeakoulunkatu 10, Tampere FI-33720, Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miguel","family":"Soriano","sequence":"additional","affiliation":[{"name":"Instituto de Fisica Interdisciplinar y Sistemas Complejos (CSIC-UIB), Campus Universitat de les Illes Balears E-07122 Palma de Mallorca, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gordon","family":"Pipa","sequence":"additional","affiliation":[{"name":"Institut f\u00fcr Kognitionswissenschaft, University of Osnabr\u00fcck, Albrechtstrasse 28, Osnabr\u00fcck 49076, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raul","family":"Vicente","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, University of Tartu, J. Liivi 2, Tartu 50409, Estonia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,4,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1038\/338334a0","article-title":"Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties","volume":"338","author":"Gray","year":"1989","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1126\/science.1062226","article-title":"Noisy clockwork: Time series analysis of population fluctuations in animals","volume":"293","author":"Bjornstad","year":"2001","journal-title":"Science"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Granger, C., and Hatanaka, M. (1964). Spectral Analysis of Economic Time Series, Princeton University Press.","DOI":"10.1515\/9781400875528"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/j.neuroimage.2011.03.058","article-title":"Effective connectivity: Influence, causality and biophysical modeling","volume":"58","author":"Roebroeck","year":"2011","journal-title":"Neuroimage"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"424","DOI":"10.2307\/1912791","article-title":"Investigating causal relations by econometric models and cross-spectral methods","volume":"37","author":"Granger","year":"1969","journal-title":"Econometrica"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.pneurobio.2005.10.003","article-title":"Nonlinear multivariate analysis of neurophysiological signals","volume":"77","author":"Pereda","year":"2005","journal-title":"Prog. Neurobio."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cover, T., and Thomas, J. (2006). Elements of Information Theory, Wiley.","DOI":"10.1002\/047174882X"},{"key":"ref_8","unstructured":"Wiener, N. (1956). Modern Mathematics for Engineers, McGraw-Hill."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e32466","DOI":"10.1371\/journal.pone.0032466","article-title":"When two become one: the limits of causality analysis of brain dynamics","volume":"7","author":"Chicharro","year":"2012","journal-title":"PLoS One"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wibral, M., Vicente, R., and Lizier, J.T. (2014). Directed Information Measures in Neuroscience, Springer.","DOI":"10.1007\/978-3-642-54474-3"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wibral, M., Vicente, R., and Lizier, J.T. (2014). Directed Information Measures in Neuroscience, Springer.","DOI":"10.1007\/978-3-642-54474-3"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lizier, J.T. (2013). The Local Information Dynamics of Distributed Computation in Complex Systems, Springer.","DOI":"10.1007\/978-3-642-32952-4"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Kantz, H., and Schreiber, T. (2004). Nonlinear Time Series Analysis, Cambridge University Press. [2nd].","DOI":"10.1017\/CBO9780511755798"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/S0019-9958(78)90026-8","article-title":"A Definition of Conditional Mutual Information for Arbitrary Ensembles","volume":"38","author":"Wyner","year":"1978","journal-title":"Inf. Control"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"204101","DOI":"10.1103\/PhysRevLett.99.204101","article-title":"Partial mutual information for coupling analysis of multivariate time series","volume":"99","author":"Frenzel","year":"2007","journal-title":"Phys. Rev. Lett"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"026222","DOI":"10.1103\/PhysRevE.72.026222","article-title":"Assessing causality from multivariate time series","volume":"72","author":"Verdes","year":"2005","journal-title":"Phys. Rev. E"},{"key":"ref_18","unstructured":"G\u00f3mez-Herrero, G. (2010). [Ph.D. thesis, Department of Signal Processing, Tampere University of Technology]."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"056201","DOI":"10.1103\/PhysRevE.65.056201","article-title":"Markov models from data by simple nonlinear time series predictors in delay embedding spaces","volume":"65","author":"Ragwitz","year":"2002","journal-title":"Phys. Rev. E"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"051903","DOI":"10.1103\/PhysRevE.66.051903","article-title":"Binless strategies for estimation of information from neural data","volume":"66","author":"Victor","year":"2002","journal-title":"Phys. Rev. E"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wibral, M., Vicente, R., and Lizier, J.T. (2014). Directed Information Measures in Neuroscience, Springer.","DOI":"10.1007\/978-3-642-54474-3"},{"key":"ref_22","first-page":"9","article-title":"Sample Estimate of the Entropy of a Random Vector","volume":"23","author":"Kozachenko","year":"1987","journal-title":"Problemy Peredachi Informatsii"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"011914","DOI":"10.1103\/PhysRevE.70.011914","article-title":"Synchronization measures of bursting data: application to the electrocorticogram of an auditory event-related experiment","volume":"70","author":"Kramer","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0167-2789(97)00118-8","article-title":"Practical method for determining the minimum embedding dimension of a scalar time series","volume":"110","author":"Cao","year":"1997","journal-title":"Physica D"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"e55809","DOI":"10.1371\/journal.pone.0055809","article-title":"Measuring information-transfer delays","volume":"8","author":"Wibral","year":"2013","journal-title":"PLoS One"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e102833","DOI":"10.1371\/journal.pone.0102833","article-title":"Efficient transfer entropy analysis of non-stationary neural time series","volume":"9","author":"Wollstadt","year":"2014","journal-title":"PLoS One"},{"key":"ref_28","unstructured":"Pesarin, F. (2001). Multivariate Permutation Tests, John Wiley and Sons."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0167-2789(02)00432-3","article-title":"Information transfer in continuous processes","volume":"166","author":"Kaiser","year":"2002","journal-title":"Physica D"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1935","DOI":"10.1142\/S0218127404010357","article-title":"Phase space reconstruction and nonlinear predictions for stationary and nonstationary Markovian processes","volume":"14","author":"Kantz","year":"2004","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_31","unstructured":"Rutanen, K. Available online: http:\/\/www.tut.fi\/tim."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1186\/1471-2202-12-119","article-title":"TRENTOOL: A Matlab open source toolbox to analyse information flow in time series data with transfer entropy","volume":"12","author":"Lindner","year":"2011","journal-title":"BMC Neurosci."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/4\/1958\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:44:16Z","timestamp":1760215456000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/4\/1958"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,2]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,4]]}},"alternative-id":["e17041958"],"URL":"https:\/\/doi.org\/10.3390\/e17041958","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,4,2]]}}}