{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T11:45:14Z","timestamp":1790768714231,"version":"4.1.0"},"reference-count":58,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2015,4,21]],"date-time":"2015-04-21T00:00:00Z","timestamp":1429574400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Interdependencies of stochastically interacting units are usually quantified by the Kullback-Leibler divergence of a stationary joint probability distribution on the set of all configurations from the corresponding factorized distribution. This is a spatial approach which does not describe the intrinsically temporal aspects of interaction. In the present paper, the setting is extended to a dynamical version where temporal interdependencies are also captured by using information geometry of Markov chain manifolds.<\/jats:p>","DOI":"10.3390\/e17042432","type":"journal-article","created":{"date-parts":[[2015,4,22]],"date-time":"2015-04-22T04:41:53Z","timestamp":1429677713000},"page":"2432-2458","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":64,"title":["Information Geometry on Complexity and Stochastic Interaction"],"prefix":"10.3390","volume":"17","author":[{"given":"Nihat","family":"Ay","sequence":"first","affiliation":[{"name":"Max Planck Institute for Mathematics in the Sciences, Inselstra\u00dfe 22, 04103 Leipzig, Germany"},{"name":"Faculty of Mathematics and Computer Science, University of Leipzig, PF 100920, 04009 Leipzig, Germany"},{"name":"Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501, USA\u00a0"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,4,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1037\/h0054663","article-title":"Informational aspects of visual perception","volume":"61","author":"Attneave","year":"1954","journal-title":"Psychol. Rev."},{"key":"ref_3","unstructured":"Barlow, H.B. (1961). Possible principles underlying the transformation of sensory messages. Sens. Commun., 217\u2013234."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1515\/znc-1981-9-1040","article-title":"A simple coding procedure enhances a neuron\u2019s information capacity","volume":"36","author":"Laughlin","year":"1981","journal-title":"Z. Naturforsch."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/2.36","article-title":"Self-organization in a perceptual network","volume":"21","author":"Linsker","year":"1988","journal-title":"Computer"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1098\/rspb.1977.0085","article-title":"Functional Architecture of Macaque Monkey Visual Cortex (Ferrier lecture)","volume":"198","author":"Hubel","year":"1977","journal-title":"Proc. R. Soc. Lond. B"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1038\/scientificamerican0979-150","article-title":"Brain Mechanisms of Vision","volume":"241","author":"Hubel","year":"1979","journal-title":"Sci. Am."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1162\/neco.1995.7.6.1129","article-title":"An information-maximization approach to blind separation and blind deconvolution","volume":"7","author":"Bell","year":"1995","journal-title":"Neural Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"5033","DOI":"10.1073\/pnas.91.11.5033","article-title":"A measure for brain complexity: Relating functional segregation and integration in the nervous system","volume":"91","author":"Tononi","year":"1994","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tononi, G., and Sporns, O. (2003). Measuring information integration. BMC Neurosci., 4.","DOI":"10.1186\/1471-2202-4-31"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tononi, G. (2004). An information integration theory of consciousness. BMC Neurosci., 5.","DOI":"10.1186\/1471-2202-5-42"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1000091","DOI":"10.1371\/journal.pcbi.1000091","article-title":"Integrated Information in Discrete Dynamical Systems: Motivation and Theoretical Framework","volume":"4","author":"Balduzzi","year":"2008","journal-title":"PLoS Comp. Biol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"216","DOI":"10.2307\/25470707","article-title":"Consciousness as Integrated Information: A Provisional Manifesto","volume":"215","author":"Tononi","year":"2008","journal-title":"Biol. Bull."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1001052","DOI":"10.1371\/journal.pcbi.1001052","article-title":"Practical Measures of Integrated Information for Time-Series Data","volume":"7","author":"Barrett","year":"2011","journal-title":"PLoS Comp. Biol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"e1002236","DOI":"10.1371\/journal.pcbi.1002236","article-title":"Integrated Information Increases with Fitness in the Evolution of Animats","volume":"7","author":"Edlund","year":"2011","journal-title":"PLoS Comp. Biol."},{"key":"ref_16","unstructured":"Ay, N. MPI MiS Preprint, 95\/2001. Available online: http:\/\/www.mis.mpg.de\/publications\/preprints\/2001\/prepr2001-95.html."},{"key":"ref_17","unstructured":"Amari, S.I., and Nagaoka, H. (2000). Methods of Information Geometry; Translations of Mathematical Monographs, AMS and Oxford University Press."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1701","DOI":"10.1109\/18.930911","article-title":"Information Geometry on Hierarchy of Probability Distributions","volume":"47","author":"Amari","year":"2001","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/BF02289159","article-title":"Multivariate information transmission","volume":"19","author":"McGill","year":"1954","journal-title":"Psychometrika"},{"key":"ref_20","unstructured":"Kolchinsky, A., and Rocha, L.M. Prediction and Modularity in Dynamical Systems."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Arsiwalla, X.D., and Verschure, P.F.M.J. (2013, January 4\u20139). Integrated Information for Large Complex Networks, Dallas, TX, USA.","DOI":"10.1109\/IJCNN.2013.6706794"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1162\/089976698300017746","article-title":"Natural gradient works efficiently in learning","volume":"10","author":"Amari","year":"1998","journal-title":"Neural Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2959","DOI":"10.1162\/089976602760805368","article-title":"Locality of global stochastic interaction in directed acyclic networks","volume":"14","author":"Ay","year":"2002","journal-title":"Neural Comput."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1483","DOI":"10.1016\/S0893-6080(03)00190-4","article-title":"Dynamical Properties of Strongly Interacting Markov Chains","volume":"16","author":"Ay","year":"2003","journal-title":"Neural Netw."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2258","DOI":"10.1162\/0899766054615671","article-title":"Finite state automata resulting from temporal information maximization and a temporal learning rule","volume":"17","author":"Wennekers","year":"2005","journal-title":"Neural Comput."},{"key":"ref_26","unstructured":"Ay, N., Mont\u00fafar, G., and Rauh, J. (2011, January 9\u201313). Selection Criteria for Neuromanifolds of Stochastic Dynamics, Hokkaido, Japan."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ay, N. (2015). Geometric Design Principles for Brains of Embodied Agents, Santa Fe Institute.","DOI":"10.1007\/s13218-015-0382-z"},{"key":"ref_28","first-page":"461","article-title":"Temporal infomax leads to almost deterministic dynamical systems","volume":"52-4","author":"Wennekers","year":"2003","journal-title":"Neurocomputing"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/S0925-2312(02)00862-7","article-title":"Temporal Infomax on Markov chains with input leads to finite state automata","volume":"52-4","author":"Wennekers","year":"2003","journal-title":"Neurocomputing"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s12064-003-0034-y","article-title":"Spatial and temporal stochastic interaction in neuronal assemblies","volume":"122","author":"Wennekers","year":"2003","journal-title":"Theory Biosci"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1016\/j.neucom.2004.10.033","article-title":"Stochastic interaction in associative nets","volume":"65","author":"Wennekers","year":"2005","journal-title":"Neurocomputing"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1016\/j.neucom.2005.12.075","article-title":"A temporal learning rule in recurrent systems supports high spatio-temporal stochastic interactions","volume":"69","author":"Wennekers","year":"2006","journal-title":"Neurocomputing"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1016\/j.biosystems.2006.04.017","article-title":"High-resolution multiple-unit EEG in cat auditory cortex reveals large spatio-temporal stochastic interactions","volume":"89","author":"Wennekers","year":"2007","journal-title":"Biosystems"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1142\/S0219525908001465","article-title":"Information Flows in Causal Networks","volume":"11","author":"Ay","year":"2008","journal-title":"Adv. Complex Syst."},{"key":"ref_36","first-page":"93","article-title":"Geometric robustness theory and biological networks","volume":"2","author":"Ay","year":"2007","journal-title":"Theory Biosci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1016\/j.dam.2008.06.032","article-title":"A Refinement of the Common Cause Principle","volume":"157","author":"Ay","year":"2009","journal-title":"Discret. Appl. Math."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2304","DOI":"10.3390\/e17042304","article-title":"Information-theoretic inference of common ancestors","volume":"17","author":"Steudel","year":"2015","journal-title":"Entropy"},{"key":"ref_39","first-page":"284","article-title":"Discriminating between causal structures in Bayesian Networks via partial observations","volume":"50","author":"Moritz","year":"2014","journal-title":"Kybernetika"},{"key":"ref_40","unstructured":"Pearl, J. (2000). Causality: Models, Reasoning and Inference, Cambridge University Press."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2324","DOI":"10.1214\/13-AOS1145","article-title":"Quantifying causal influences","volume":"41","author":"Janzing","year":"2013","journal-title":"Ann. Stat."},{"key":"ref_42","first-page":"517","article-title":"Maximizing Multi-Information","volume":"42","author":"Ay","year":"2007","journal-title":"Kybernetika"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"037103","DOI":"10.1063\/1.3638446","article-title":"A Geometric Approach to Complexity","volume":"21","author":"Ay","year":"2011","journal-title":"Chaos"},{"key":"ref_44","unstructured":"Ay, N., Olbrich, E., Bertschinger, N., and Jost, J. (2006, January 25\u201329). A Unifying Framework for Complexity Measures of Finite Systems, Oxford University, Oxford, UK."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1111\/j.1749-6632.2011.06422.x","article-title":"The Use of Information Theory in Evolutionary Biology","volume":"1256","author":"Adami","year":"2012","journal-title":"Ann. NY Acad. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1140\/epjb\/e2008-00175-0","article-title":"Predictive information and explorative behavior of autonomous robots","volume":"63","author":"Ay","year":"2008","journal-title":"Eur. Phys. J. B"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1177\/1059712310375314","article-title":"Higher coordination with less control\u2014A result of information maximisation in the sensorimotor loop","volume":"18","author":"Zahedi","year":"2010","journal-title":"Adapt. Behav."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ay, N., Bernigau, H., Der, R., and Prokopenko, M. (2011). Information driven self-organization: The dynamical system approach to autonomous robot behavior. Theory Biosci.","DOI":"10.1007\/s12064-011-0137-9"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"026201","DOI":"10.1103\/PhysRevE.79.026201","article-title":"Complexity Measures from Interaction Structures","volume":"79","author":"Kahle","year":"2009","journal-title":"Phys. Rev. E"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1140\/epjb\/e2008-00134-9","article-title":"How should complexity scale with system size?","volume":"63","author":"Olbrich","year":"2008","journal-title":"Eur. Phys. J. B"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Amari, S.I. (1985). Differential-Geometric Methods in Statistics (Lecture Notes in Statistics), Springer.","DOI":"10.1007\/978-1-4612-5056-2"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_53","first-page":"146","article-title":"I-divergence geometry of probability distributions and minimization problems","volume":"3","year":"1975","journal-title":"Ann. Probab."},{"key":"ref_54","first-page":"329","article-title":"On topological properties of f-divergence","volume":"2","year":"1967","journal-title":"Stud. Sci. Math. Hungar."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1214\/aop\/1020107773","article-title":"An Information-Geometric Approach to a Theory of Pragmatic Structuring","volume":"30","author":"Ay","year":"2002","journal-title":"Ann. Probab."},{"key":"ref_56","first-page":"81","article-title":"Information and the accuracy attainable in the estimation of statistical parameters","volume":"37","author":"Rao","year":"1945","journal-title":"Bull. Calcutta Math. Soc."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Hofbauer, J., and Sigmund, K. (1998). Evolutionary Games and Population Dynamics, Cambridge University Press.","DOI":"10.1017\/CBO9781139173179"},{"key":"ref_58","unstructured":"Cover, T.M., and Thomas, J.A. (1991). Elements of Information Theory, Wiley-Interscience."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/4\/2432\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:45:05Z","timestamp":1760215505000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/4\/2432"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,21]]},"references-count":58,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,4]]}},"alternative-id":["e17042432"],"URL":"https:\/\/doi.org\/10.3390\/e17042432","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,4,21]]}}}