{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:51:16Z","timestamp":1760237476864,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,5,21]],"date-time":"2020-05-21T00:00:00Z","timestamp":1590019200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["AA007462","AA022268","AA022821","AA023786","AA007611"],"award-info":[{"award-number":["AA007462","AA022268","AA022821","AA023786","AA007611"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Information theory is a powerful tool for analyzing complex systems. In many areas of neuroscience, it is now possible to gather data from large ensembles of neural variables (e.g., data from many neurons, genes, or voxels). The individual variables can be analyzed with information theory to provide estimates of information shared between variables (forming a network between variables), or between neural variables and other variables (e.g., behavior or sensory stimuli). However, it can be difficult to (1) evaluate if the ensemble is significantly different from what would be expected in a purely noisy system and (2) determine if two ensembles are different. Herein, we introduce relatively simple methods to address these problems by analyzing ensembles of information sources. We demonstrate how an ensemble built of mutual information connections can be compared to null surrogate data to determine if the ensemble is significantly different from noise. Next, we show how two ensembles can be compared using a randomization process to determine if the sources in one contain more information than the other. All code necessary to carry out these analyses and demonstrations are provided.<\/jats:p>","DOI":"10.3390\/e22050580","type":"journal-article","created":{"date-parts":[[2020,5,21]],"date-time":"2020-05-21T11:31:18Z","timestamp":1590060678000},"page":"580","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Method to Present and Analyze Ensembles of Information Sources"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7127-4418","authenticated-orcid":false,"given":"Nicholas M.","family":"Timme","sequence":"first","affiliation":[{"name":"Department of Psychology, Indiana University\u2014Purdue University Indianapolis, Indianapolis, IN 46202, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Linsenbardt","sequence":"additional","affiliation":[{"name":"Department of Neurosciences, University of New Mexico School of Medicine, Albuquerque, NM 87131, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher C.","family":"Lapish","sequence":"additional","affiliation":[{"name":"Department of Psychology, Indiana University\u2014Purdue University Indianapolis, Indianapolis, IN 46202, USA"},{"name":"Stark Neuroscience Research Institute, Indiana University\u2014Purdue University Indianapolis, Indianapolis, IN 46202, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,21]]},"reference":[{"key":"ref_1","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley-Interscience."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1500","DOI":"10.1038\/nn.3776","article-title":"Dimensionality reduction for large-scale neural recordings","volume":"17","author":"Cunningham","year":"2014","journal-title":"Nat. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3764","DOI":"10.1523\/JNEUROSCI.2728-16.2017","article-title":"Locomotion Enhances Neural Encoding of Visual Stimuli in Mouse V1","volume":"37","author":"Dadarlat","year":"2017","journal-title":"J. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3945","DOI":"10.1093\/cercor\/bhw200","article-title":"Cortical Entropy, Mutual Information and Scale-Free Dynamics in Waking Mice","volume":"26","author":"Fagerholm","year":"2016","journal-title":"Cereb. Cortex"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ito, S., Hansen, M.E., Heiland, R., Lumsdaine, A., Litke, A.M., and Beggs, J.M. (2011). Extending Transfer Entropy Improves Identification of Effective Connectivity in a Spiking Cortical Network Model. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0027431"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1523\/JNEUROSCI.2177-15.2016","article-title":"Rich-Club Organization in Effective Connectivity among Cortical Neurons","volume":"36","author":"Nigam","year":"2016","journal-title":"J. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1797","DOI":"10.1152\/jn.1998.79.4.1797","article-title":"Information about spatial view in an ensemble of primate hippocampal cells","volume":"79","author":"Rolls","year":"1998","journal-title":"J. Neurophysiol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Timme, N., Ito, S., Myroshnychenko, M., Yeh, F.-C., Hiolski, E., Hottowy, P., and Beggs, J.M. (2014). Multiplex Networks of Cortical and Hippocampal Neurons Revealed at Different Timescales. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0115764"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Timme, N.M., Ito, S., Myroshnychenko, M., Nigam, S., Shimono, M., Yeh, F.-C., Hottowy, P., Litke, A.M., and Beggs, J.M. (2016). High-Degree Neurons Feed Cortical Computations. PLoS Comput. Biol., 12.","DOI":"10.1371\/journal.pcbi.1004858"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1007\/s00429-009-0208-6","article-title":"Greater than the sum of its parts: A review of studies combining structural connectivity and resting-state functional connectivity","volume":"213","author":"Damoiseaux","year":"2009","journal-title":"Anat. Embryol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1073\/pnas.0135058100","article-title":"Functional connectivity in the resting brain: A network analysis of the default mode hypothesis","volume":"100","author":"Greicius","year":"2002","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1038\/nrn2575","article-title":"Complex brain networks: Graph theoretical analysis of structural and functional systems","volume":"10","author":"Bullmore","year":"2009","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1038\/nrn2578","article-title":"Extracting information from neuronal populations: Information theory and decoding approaches","volume":"10","author":"Quiroga","year":"2009","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1162\/netn_a_00092","article-title":"Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing","volume":"3","author":"Novelli","year":"2019","journal-title":"Netw. Neurosci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1059","DOI":"10.1016\/j.neuroimage.2009.10.003","article-title":"Complex network measures of brain connectivity: Uses and interpretations","volume":"52","author":"Rubinov","year":"2010","journal-title":"Neurolmage"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1064","DOI":"10.1152\/jn.00559.2007","article-title":"Correcting for the Sampling Bias Problem in Spike Train Information Measures","volume":"98","author":"Panzeri","year":"2007","journal-title":"J. Neurophysiol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1162\/neco.1995.7.2.399","article-title":"The Upward Bias in Measures of Information Derived from Limited Data Samples","volume":"7","author":"Treves","year":"1995","journal-title":"Neural Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1162\/089976603321780272","article-title":"Estimation of Entropy and Mutual Information","volume":"15","author":"Paninski","year":"2003","journal-title":"Neural Comput."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Victor, J.D. (2002). Binless strategies for estimation of information from neural data. Phys. Rev. E, 66.","DOI":"10.1103\/PhysRevE.66.051903"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/frobt.2015.00005","article-title":"Bits from Brains for Biologically Inspired Computing","volume":"2","author":"Wibral","year":"2015","journal-title":"Front. Robot. AI"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lindner, M., Vicente, R., Priesemann, V., and Wibral, M. (2011). Tretnool: A Matlab open source toolbox to analyse information flow in time series data with transfer entropy. BMC Neurosci., 12.","DOI":"10.1186\/1471-2202-12-119"},{"key":"ref_22","unstructured":"Timme, N.M. (2020, May 20). GitHub: Information Theory Ensemble Analysis. Available online: https:\/\/github.com\/nmtimme\/Information-Theory-Ensemble-Analysis."},{"key":"ref_23","unstructured":"Timme, N.M. (2020, May 20). Personal Website. Available online: www.nicholastimme.com."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Linsenbardt, D.N., Timme, N.M., and Lapish, C.C. (2019). Encoding of the Intent to Drink Alcohol by the Prefrontal Cortex Is Blunted in Rats with a Family History of Excessive Drinking. Eneuro, 6.","DOI":"10.1101\/490664"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Sys. Tech. J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring Information Transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_27","unstructured":"Williams, P.L., and Beer, R.D. (2010). Nonnegative Decomposition of Multivariate Information. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s10827-013-0458-4","article-title":"Synergy, redundancy, and multivariate information measures: An experimentalist\u2019s perspective","volume":"36","author":"Timme","year":"2013","journal-title":"J. Comput. Neurosci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"258701","DOI":"10.1103\/PhysRevLett.108.258701","article-title":"Escaping the Curse of Dimensionality in Estimating Multivariate Transfer Entropy","volume":"108","author":"Runge","year":"2012","journal-title":"Phys. Rev. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Montalto, A., Faes, L., and Marinazzo, D. (2014). Mute: A Matlab Toolbox to Compare Established and Novel Estimators of the Multivariate Transfer Entropy. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0109462"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wollstadt, P., Lizier, J.T., Vicente, R., Finn, C., Mart\u00ednez-Zarzuela, M., Mediano, P.A., Novelli, L., and Wibral, M. (2019). IDTxl: The Information Dynamics Toolkit xl: A Python package for the efficient analysis of multivariate information dynamics in networks. J. Open Source Softw., 4.","DOI":"10.21105\/joss.01081"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/5\/580\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:30:57Z","timestamp":1760175057000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/5\/580"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,21]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["e22050580"],"URL":"https:\/\/doi.org\/10.3390\/e22050580","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2020,5,21]]}}}