{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:00:18Z","timestamp":1760241618565,"version":"build-2065373602"},"reference-count":59,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2018,6,25]],"date-time":"2018-06-25T00:00:00Z","timestamp":1529884800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Spanish Government","award":["TIN2016-75866-C3-3-R"],"award-info":[{"award-number":["TIN2016-75866-C3-3-R"]}]},{"name":"Catalan Government","award":["2017-SGR-1101"],"award-info":[{"award-number":["2017-SGR-1101"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Brain networks are widely used models to understand the topology and organization of the brain. These networks can be represented by a graph, where nodes correspond to brain regions and edges to structural or functional connections. Several measures have been proposed to describe the topological features of these networks, but unfortunately, it is still unclear which measures give the best representation of the brain. In this paper, we propose a new set of measures based on information theory. Our approach interprets the brain network as a stochastic process where impulses are modeled as a random walk on the graph nodes. This new interpretation provides a solid theoretical framework from which several global and local measures are derived. Global measures provide quantitative values for the whole brain network characterization and include entropy, mutual information, and erasure mutual information. The latter is a new measure based on mutual information and erasure entropy. On the other hand, local measures are based on different decompositions of the global measures and provide different properties of the nodes. Local measures include entropic surprise, mutual surprise, mutual predictability, and erasure surprise. The proposed approach is evaluated using synthetic model networks and structural and functional human networks at different scales. Results demonstrate that the global measures can characterize new properties of the topology of a brain network and, in addition, for a given number of nodes, an optimal number of edges is found for small-world networks. Local measures show different properties of the nodes such as the uncertainty associated to the node, or the uniqueness of the path that the node belongs. Finally, the consistency of the results across healthy subjects demonstrates the robustness of the proposed measures.<\/jats:p>","DOI":"10.3390\/e20070491","type":"journal-article","created":{"date-parts":[[2018,6,25]],"date-time":"2018-06-25T11:03:25Z","timestamp":1529924605000},"page":"491","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Novel Brain Complexity Measures Based on Information Theory"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9217-5438","authenticated-orcid":false,"given":"Ester","family":"Bonmati","sequence":"first","affiliation":[{"name":"Graphics and Imaging Laboratory, University of Girona, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9648-0624","authenticated-orcid":false,"given":"Anton","family":"Bardera","sequence":"additional","affiliation":[{"name":"Graphics and Imaging Laboratory, University of Girona, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6512-7588","authenticated-orcid":false,"given":"Miquel","family":"Feixas","sequence":"additional","affiliation":[{"name":"Graphics and Imaging Laboratory, University of Girona, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0001-8193","authenticated-orcid":false,"given":"Imma","family":"Boada","sequence":"additional","affiliation":[{"name":"Graphics and Imaging Laboratory, University of Girona, 17003 Girona, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,6,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sporns, O., Tononi, G., and K\u00f6tter, R. (2005). The human connectome: A structural description of the human brain. PLoS Comput. Biol., 1.","DOI":"10.1371\/journal.pcbi.0010042"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/cercor\/1.1.1","article-title":"Distributed hierarchical processing in the primate cerebral cortex","volume":"1","author":"Felleman","year":"1991","journal-title":"Cereb. Cortex"},{"key":"ref_3","unstructured":"Hagmann, P. (2005). From Diffusion MRI to Brain Connectomics. [Ph.D. Thesis, \u00c9cole polytechnique f\u00e9d\u00e9rale de Lausanne (EPFL)]."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hagmann, P., Kurant, M., Gigandet, X., Thiran, P., Wedeen, V.J., Meuli, R., and Thiran, J.P. (2007). Mapping human whole-brain structural networks with diffusion MRI. PLoS ONE, 2.","DOI":"10.1371\/journal.pone.0000597"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.jneumeth.2010.01.014","article-title":"MR connectomics: Principles and challenges","volume":"194","author":"Hagmann","year":"2010","journal-title":"J. Neurosci. Methods"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.neuroimage.2013.03.023","article-title":"The human connectome: Origins and challenges","volume":"80","author":"Sporns","year":"2013","journal-title":"NeuroImage"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1146\/annurev-clinpsy-040510-143934","article-title":"Brain graphs: Graphical models of the human brain connectome","volume":"7","author":"Bullmore","year":"2011","journal-title":"Ann. Rev. Clin. Psychol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1111\/j.1749-6632.2010.05888.x","article-title":"The human connectome: A complex network","volume":"1224","author":"Sporns","year":"2011","journal-title":"Ann. New York Acad. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.media.2013.01.003","article-title":"A blind deconvolution approach to recover effective connectivity brain networks from resting state fMRI data","volume":"17","author":"Wu","year":"2013","journal-title":"Med. Image Anal."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1038\/nrn893","article-title":"The anatomical basis of functional localization in the cortex","volume":"3","author":"Passingham","year":"2002","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1016\/j.neuroimage.2011.05.025","article-title":"A tutorial in connectome analysis: Topological and spatial features of brain networks","volume":"57","author":"Kaiser","year":"2011","journal-title":"NeuroImage"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.1016\/j.neuroimage.2009.10.003","article-title":"Complex network measures of brain connectivity: Uses and interpretations","volume":"52","author":"Rubinov","year":"2010","journal-title":"NeuroImage"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/1753-4631-1-3","article-title":"Graph theoretical analysis of complex networks in the brain","volume":"1","author":"Stam","year":"2007","journal-title":"Nonlinear Biomed. Phys."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1038\/30918","article-title":"Collective dynamics of \u2019small-world\u2019 networks","volume":"393","author":"Watts","year":"1998","journal-title":"Nature"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"198701","DOI":"10.1103\/PhysRevLett.87.198701","article-title":"Efficient behavior of small-world networks","volume":"87","author":"Latora","year":"2001","journal-title":"Phys. Rev. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1137\/S003614450342480","article-title":"The structure and function of complex networks","volume":"45","author":"Newman","year":"2003","journal-title":"SIAM"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"066133","DOI":"10.1103\/PhysRevE.69.066133","article-title":"Fast algorithm for detecting community structure in networks","volume":"69","author":"Newman","year":"2003","journal-title":"Phys. Rev. E"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1038\/nrn2575","article-title":"Complex brain networks: Graph theoretical analysis of structural and functional systems","volume":"10","author":"Bullmore","year":"2009","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.neuroimage.2013.04.031","article-title":"Why data coherence and quality is critical for understanding interareal cortical networks","volume":"80","author":"Kennedy","year":"2013","journal-title":"NeuroImage"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1038\/nphys209","article-title":"Detecting rich-club ordering in complex networks","volume":"2","author":"Colizza","year":"2006","journal-title":"Nat. Phys."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Harriger, L., van den Heuvel, M.P., and Sporns, O. (2012). Rich club organization of macaque cerebral cortex and its role in network communication. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0046497"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"11372","DOI":"10.1073\/pnas.1203593109","article-title":"High-cost, high-capacity backbone for global brain communication","volume":"109","author":"Kahn","year":"2012","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.tics.2004.07.008","article-title":"Organization, development and function of complex brain networks","volume":"8","author":"Sporns","year":"2004","journal-title":"Trends Cognit. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5033","DOI":"10.1073\/pnas.91.11.5033","article-title":"A measure for brain complexity: Relating functional segregation and integration in the nervous system","volume":"91","author":"Tononi","year":"1994","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1016\/j.media.2008.02.002","article-title":"Regions, systems, and the brain: Hierarchical measures of functional integration in fMRI","volume":"12","author":"Marrelec","year":"2008","journal-title":"Med. Image Anal."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kitazono, J., Kanai, R., and Oizumi, M. (2018). Efficient algorithms for searching the minimum information partition in integrated information theory. Entropy, 20.","DOI":"10.3390\/e20030173"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/S1364-6613(98)01259-5","article-title":"Complexity and coherency: Integrating information in the brain","volume":"2","author":"Tononi","year":"1998","journal-title":"Trends Cognit. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1016\/S0893-6080(00)00053-8","article-title":"Connectivity and complexity: The relationship between neuroanatomy and brain dynamics","volume":"13","author":"Sporns","year":"2000","journal-title":"Neural Netw."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3422","DOI":"10.1073\/pnas.93.8.3422","article-title":"A complexity measure for selective matching of signals by the brain","volume":"93","author":"Tononi","year":"1996","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1006\/nimg.1997.0313","article-title":"Functional clustering: Identifying strongly interactive brain regions in neuroimaging data","volume":"7","author":"Tononi","year":"1998","journal-title":"NeuroImage"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"13763","DOI":"10.1073\/pnas.231499798","article-title":"Degeneracy and complexity in biological systems","volume":"98","author":"Edelman","year":"2001","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3257","DOI":"10.1073\/pnas.96.6.3257","article-title":"Measures of degeneracy and redundancy in biological networks","volume":"96","author":"Tononi","year":"1999","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2382","DOI":"10.1093\/brain\/awu132","article-title":"The hubs of the human connectome are generally implicated in the anatomy of brain disorders","volume":"137","author":"Crossley","year":"2014","journal-title":"Brain"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.neuroimage.2013.04.084","article-title":"Comparing connectomes across subjects and populations at different scales","volume":"80","author":"Meskaldji","year":"2013","journal-title":"NeuroImage"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1016\/j.euroneuro.2010.03.008","article-title":"Exploring the brain network: A review on resting-state fMRI functional connectivity","volume":"20","author":"Pol","year":"2010","journal-title":"Eur. Neuropsychopharmacol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.neuroimage.2013.03.035","article-title":"Measuring network\u2019s entropy in ADHD: A new approach to investigate neuropsychiatric disorders","volume":"77","author":"Sato","year":"2013","journal-title":"NeuroImage"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"20130520","DOI":"10.1098\/rstb.2013.0520","article-title":"Complex network theory and the brain","volume":"369","author":"Papo","year":"2014","journal-title":"Phil. Trans. R. Soc. B"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.cmpb.2017.07.012","article-title":"Brain parcellation based on information theory","volume":"151","author":"Bonmati","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley.","DOI":"10.1002\/047174882X"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Yeung, R.W. (2002). A First Course in Information Theory, Springer Science & Business Media.","DOI":"10.1007\/978-1-4419-8608-5"},{"key":"ref_41","unstructured":"Feldman, D.P., and Crutchfield, J.P. (1998). Discovering Noncritical Organization: Statistical Mechanical, Information Theoreticand Computational Views of Patterns in One-Dimensional Spin Systems, Santa Fe Institute. Working Paper 98-04-026."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/0167-2789(83)90127-6","article-title":"Symbolic dynamics of noisy chaos","volume":"7","author":"Crutchfield","year":"1983","journal-title":"Physica D"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1007\/BF00668821","article-title":"Toward a quantitative theory of self-generated complexity","volume":"25","author":"Grassberger","year":"1986","journal-title":"Int. J. Theor. Phys."},{"key":"ref_44","unstructured":"Shaw, R. (1984). The Dripping Faucet as a Model Chaotic System, Aerial Press."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2852","DOI":"10.1103\/PhysRevA.33.2852","article-title":"Entropy decay as a measure of stochasticity in chaotic systems","volume":"33","year":"1986","journal-title":"Phys. Rev. A"},{"key":"ref_46","unstructured":"Feldman, D.P. (1997). A Brief Introduction to: Information Theory, Excess Entropy and Computational Mechanics, Department of Physics, University of California. Lecture notes."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"5030","DOI":"10.1109\/TIT.2008.929968","article-title":"The information lost in erasures","volume":"54","author":"Weissman","year":"2008","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"051104","DOI":"10.1103\/PhysRevE.67.051104","article-title":"Structural information in two-dimensional patterns: Entropy convergence and excess entropy","volume":"67","author":"Feldman","year":"2003","journal-title":"Phys. Rev. E"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1088\/0954-898X_10_4_303","article-title":"How to measure the information gained from one symbol","volume":"10","author":"DeWeese","year":"1999","journal-title":"Network Comput. Neural Syst."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"426","DOI":"10.1016\/j.neuroimage.2013.04.087","article-title":"Graph analysis of the human connectome: Promise, progress, and pitfalls","volume":"80","author":"Fornito","year":"2013","journal-title":"NeuroImage"},{"key":"ref_51","first-page":"305","article-title":"Test-retest reliability of graph theory measures of structural brain connectivity","volume":"Volume 7512","author":"Ayache","year":"2012","journal-title":"Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.neuroimage.2015.02.001","article-title":"Predicting functional connectivity from structural connectivity via computational models using MRI: An extensive comparison study","volume":"111","author":"Rudrauf","year":"2015","journal-title":"NeuroImage"},{"key":"ref_53","first-page":"e699v1","article-title":"Multimodal imaging brain connectivity analysis toolbox (MIBCA)","volume":"2","author":"Ferreira","year":"2014","journal-title":"PeerJ PrePrints"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1016\/j.jneumeth.2011.09.031","article-title":"Mapping the human connectome at multiple scales with diffusion spectrum MRI","volume":"203","author":"Cammoun","year":"2012","journal-title":"J. Neurosci. Methods"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"2222","DOI":"10.1016\/j.neuroimage.2012.02.018","article-title":"The Human Connectome Project: A data acquisition perspective","volume":"62","author":"Essen","year":"2012","journal-title":"NeuroImage"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.neuroimage.2013.04.127","article-title":"The minimal preprocessing pipelines for the Human Connectome Project","volume":"80","author":"Glasser","year":"2013","journal-title":"NeuroImage"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.1016\/j.neuroimage.2015.04.046","article-title":"ConnectomeDB\u2014Sharing human brain connectivity data","volume":"124","author":"Hodge","year":"2016","journal-title":"NeuroImage"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1016\/j.ejro.2016.06.002","article-title":"Fiber tracking: A qualitative and quantitative comparison between four different software tools on the reconstruction of major white matter tracts","volume":"3","author":"Christidi","year":"2016","journal-title":"Eur. J. Radiol. Open"},{"key":"ref_59","unstructured":"Dai, D., and He, H. (2011, January 26\u201330). VisualConnectome: Toolbox for brain network visualization and analysis. Proceedings of the Organization on human Brain Mapping, 2011, Qu\u00e9bec City, QC, Canada."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/7\/491\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:10:03Z","timestamp":1760195403000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/7\/491"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,25]]},"references-count":59,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2018,7]]}},"alternative-id":["e20070491"],"URL":"https:\/\/doi.org\/10.3390\/e20070491","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2018,6,25]]}}}