{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:28:13Z","timestamp":1760243293977,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2014,7,23]],"date-time":"2014-07-23T00:00:00Z","timestamp":1406073600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We consider the graph representation of the stochastic model with n binary variables, and develop an information theoretical framework to measure the degree of statistical association existing between subsystems as well as the ones represented by each edge of the graph representation. Besides, we consider the novel measures of complexity with respect to the system decompositionability, by introducing the geometric product of Kullback\u2013Leibler (KL-) divergence. The novel complexity measures satisfy the boundary condition of vanishing at the limit of completely random and ordered state, and also with the existence of independent subsystem of any size. Such complexity measures based on the geometric means are relevant to the heterogeneity of dependencies between subsystems, and the amount of information propagation shared entirely in the system.<\/jats:p>","DOI":"10.3390\/e16074132","type":"journal-article","created":{"date-parts":[[2014,7,23]],"date-time":"2014-07-23T11:03:10Z","timestamp":1406113390000},"page":"4132-4167","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Network Decomposition and Complexity Measures: An Information Geometrical Approach"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7519-3084","authenticated-orcid":false,"given":"Masatoshi","family":"Funabashi","sequence":"first","affiliation":[{"name":"Sony Computer Science Laboratories, inc. Takanawa muse bldg. 3F, 3-14-13, Higashi Gotanda, Shinagawa-ku, Tokyo 141-0022, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2014,7,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.physrep.2005.10.009","article-title":"Complex Networks: Structure and Dynamics","volume":"424","author":"Boccalettia","year":"2006","journal-title":"Phys. Rep"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1038\/35065725","article-title":"Exploring Complex Networks","volume":"410","author":"Strogatz","year":"2001","journal-title":"Nature"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wasserman, S., and Faust, K. (1994). Social Network Analysis, Cambridge University Press.","DOI":"10.1017\/CBO9780511815478"},{"key":"ref_4","first-page":"161","article-title":"Complex Network","volume":"207","author":"Funabashi","year":"2009","journal-title":"Studies in Computational Intelligence"},{"key":"ref_5","unstructured":"Badii, R., and Politi, A. (2008). Complexity: Hierarchical Structures and Scaling in Physics, Cambridge University Press."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1109\/TIT.1976.1055501","article-title":"On the Complexity of Finite Sequences","volume":"22","author":"Lempel","year":"1976","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Li, M., and Vitanyi, P. (1997). An Introduction to Kolmogorov Complexity and Its Applications, Springer. [2nd ed].","DOI":"10.1007\/978-1-4757-2606-0"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley.","DOI":"10.1002\/047174882X"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1007\/BF01886523","article-title":"On the Nature and Origin of Complexity in Discrete, Homogeneous, Locally-Interacting Systems","volume":"16","author":"Bennett","year":"1986","journal-title":"Found. Phys"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1007\/BF00668821","article-title":"Toward a Quantitative Theory of Self-Generated Complexity","volume":"25","author":"Grassberger","year":"1986","journal-title":"Int. J. Theor. Phys"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1063\/1.1530990","article-title":"Regularities Unseen Randomness Observed: The Entropy Convergence Hierarchy","volume":"15","author":"Crutchfield","year":"2003","journal-title":"Chaos"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1103\/PhysRevLett.63.105","article-title":"Inferring Statistical Complexity","volume":"63","author":"Crutchfield","year":"1989","journal-title":"Phys. Rev. Lett"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/0167-2789(95)00041-2","article-title":"Generalized Redundancies for Time Series Analysis","volume":"84","author":"Prichard","year":"1995","journal-title":"Physica D"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1701","DOI":"10.1109\/18.930911","article-title":"Information Geometry on Hierarchy of Probability Distributions","volume":"47","author":"Amari","year":"2001","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_15","unstructured":"Ay, N., Olbrich, E., Bertschinger, N., and Jost, J. (2006). A Unifying Framework for Complexity Measures of Finite Systems, Santa Fe Institute. Report 06-08-028."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"T273","DOI":"10.1088\/0951-7715\/21\/12\/T03","article-title":"Nonlinearity in Complexity Science","volume":"21","author":"MacKay","year":"2008","journal-title":"Nonlinearity"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5033","DOI":"10.1073\/pnas.91.11.5033","article-title":"A Measure for Brain Complexity: Relating Functional Segregation and Integration in the Nervous System","volume":"91","author":"Tononi","year":"1994","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/S0375-9601(97)00855-4","article-title":"Measures of statistical complexity: Why?","volume":"238","author":"Feldman","year":"1998","journal-title":"Phys. Lett. A"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2269","DOI":"10.1162\/08997660260293238","article-title":"Information-Geometric Measure for Neural Spikes","volume":"14","author":"Nakahara","year":"2002","journal-title":"Neural Comput"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1140\/epjb\/e2008-00134-9","article-title":"How Should Complexity Scale with System Size?","volume":"63","author":"Olbrich","year":"2008","journal-title":"Eur. Phys. J. B"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/S0375-9601(97)00855-4","article-title":"Measures of Statistical Complexity: Why?","volume":"238","author":"Feldman","year":"1998","journal-title":"Phys. Lett. A"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/0375-9601(95)00867-5","article-title":"A Statistical Measure of Complexity","volume":"209","author":"Mancini","year":"1995","journal-title":"Phys. Lett. A"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hodge, W., and Pedoe, D. (1994). Methods of Algebraic Geometry, Cambridge Mathematical Library, Cambridge University Press.","DOI":"10.1017\/CBO9780511623899"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.physd.2013.07.003","article-title":"Moment-closure Approximations for Discrete Adaptive Networks","volume":"267","author":"Demirel","year":"2014","journal-title":"Physica D"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Fraser, G. (2006). The New Physics for the Twenty-First Century, Cambridge University Press.","DOI":"10.1017\/CBO9781139644228"},{"key":"ref_26","unstructured":"Scott, J. (2000). Social Network Analysis: A Handbook, SAGE Publications Ltd."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Geier, F., Timmer, J., and Fleck, C. (2007). Reconstructing Gene-Regulatory Networks from Time Series, Knock-Out Data, and Prior Knowledge. BMC Syst. Biol, 1.","DOI":"10.1186\/1752-0509-1-11"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1038\/nn1228","article-title":"Multiple Neural Spike Train Data Analysis: State-of-the-Art and Future Challenges","volume":"7","author":"Brown","year":"2004","journal-title":"Nat. Neurosci"},{"key":"ref_29","unstructured":"Yee, T.W. (1993). The Analysis of Binary Data in Quantitative Plant Ecology, Ph.D. Thesis, The University of Auckland, New Zealand."},{"key":"ref_30","unstructured":"Stanford Large Network Dataset Collection. Available online: http:\/\/snap.stanford.edu\/data\/."},{"key":"ref_31","unstructured":"BioGRID. Available online: http:\/\/thebiogrid.org\/."},{"key":"ref_32","unstructured":"Neuroscience Information Framework. Available online: http:\/\/www.neuinfo.org\/."},{"key":"ref_33","unstructured":"Global Biodiversity Information Facility. Available online: http:\/\/www.gbif.org\/."},{"key":"ref_34","unstructured":"UCI Network Data Repository. Available online: http:\/\/networkdata.ics.uci.edu\/index.php."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1073\/pnas.62.4.1056","article-title":"On Population Growth in a Randomly Varying Environment","volume":"62","author":"Lewontin","year":"1969","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/BF02270833","article-title":"Individual Adaptations in Stochastic Environments","volume":"5","author":"Yoshimura","year":"1969","journal-title":"Evol. Ecol"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"046111","DOI":"10.1103\/PhysRevE.84.046111","article-title":"Evolutionary Dynamics on Stochastic Evolving Networks for Multiple-Strategy Games","volume":"84","author":"Wu","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"016104","DOI":"10.1103\/PhysRevE.78.016104","article-title":"Coevolutionary Dynamics of Opinions and Networks: From Diversity to Uniformity","volume":"78","author":"Fu","year":"2008","journal-title":"Phys. Rev. E"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"208701","DOI":"10.1103\/PhysRevLett.96.208701","article-title":"Epidemic Dynamics on an Adaptive Network","volume":"96","author":"Gross","year":"2006","journal-title":"Phys. Rev. Lett"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/BF01016429","article-title":"Possible Generalization of Boltzmann-Gibbs Statistics","volume":"52","author":"Tsallis","year":"1988","journal-title":"J. Stat. Phys"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1165","DOI":"10.1038\/ni1535","article-title":"Immunology in natura: Clinical, Epidemiological and Evolutionary Genetics of Infectious Diseases","volume":"8","author":"Alcais","year":"2007","journal-title":"Nat. Immunol"},{"key":"ref_42","unstructured":"Hardy, G., Littlewood, J., and Polya, G. (1967). Inequalities, Cambridge University Press. Chapter 3."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2882","DOI":"10.1109\/TIT.2009.2018176","article-title":"Sided and symmetrized Bregman centroids","volume":"55","author":"Nielsen","year":"2009","journal-title":"IEEE Trans. Inf. Theory"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/7\/4132\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:13:59Z","timestamp":1760217239000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/7\/4132"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,7,23]]},"references-count":43,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2014,7]]}},"alternative-id":["e16074132"],"URL":"https:\/\/doi.org\/10.3390\/e16074132","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2014,7,23]]}}}