{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T21:32:05Z","timestamp":1770067925193,"version":"3.49.0"},"reference-count":20,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Redundancy is a central yet persistently ambiguous concept in multivariate information theory. Across the literature, the same term is used to describe fundamentally distinct phenomena. Operational redundancy concerns how different inputs relate to the prediction of output states, while informational redundancy concerns content overlap among inputs relevant to an output. These notions are routinely conflated in decompositions of mutual information, leading to incompatible definitions, contradictory interpretations, and apparent paradoxes\u2014particularly when inputs are statistically independent. We argue that the difficulty in defining redundancy is not primarily technical, but conceptual: the field has not converged on what redundancy is meant to signify. We formalize this distinction by identifying two classes of redundancy. Operational redundancy encompasses task-relative properties and covers conditions when inputs are sufficient or substitutable for prediction. Informational redundancy concerns shared content among inputs, grounded in mutual information between them. Using functional examples and biased input ensembles, we demonstrate the practical distinction between these classes: inputs with no informational overlap can exhibit operational redundancy, while partial observation can induce statistical correlations that create content overlap without reflecting the underlying functional structure. We conclude by proposing a clear separation of these concepts and outlining minimal commitments for each. This separation clarifies why redundancy remains elusive, why no single measure can satisfy all intuitions, and how future work can proceed without redefining information itself.<\/jats:p>","DOI":"10.3390\/e28020167","type":"journal-article","created":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T09:48:08Z","timestamp":1770025688000},"page":"167","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["What Is Redundancy?"],"prefix":"10.3390","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9123-4317","authenticated-orcid":false,"given":"Clifford","family":"Bohm","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Michigan State University, East Lansing, MI 48824, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2915-9504","authenticated-orcid":false,"given":"Christoph","family":"Adami","sequence":"additional","affiliation":[{"name":"Department of Microbiology, Genetics, and Immunology, Michigan State University, East Lansing, MI 48824, USA"},{"name":"Program in Evolution, Ecology, and Behavior, Michigan State University, East Lansing, MI 48824, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4872-1961","authenticated-orcid":false,"given":"Arend","family":"Hintze","sequence":"additional","affiliation":[{"name":"Department for MicroData Analytics, Dalarna University, 791 88 Falun, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/BF02289159","article-title":"Multivariate information transmission","volume":"19","author":"McGill","year":"1954","journal-title":"Psychometrika"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1147\/rd.41.0066","article-title":"Information theoretical analysis of multivariate correlation","volume":"4","author":"Watanabe","year":"1960","journal-title":"IBM J. Res. Dev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"032149","DOI":"10.1103\/PhysRevE.103.032149","article-title":"Introducing a differentiable measure of pointwise shared information","volume":"103","author":"Makkeh","year":"2021","journal-title":"Phys. Rev. E"},{"key":"ref_4","unstructured":"Williams, P.L., and Beer, R.D. (2010). Nonnegative decomposition of multivariate information. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Prokopenko, M. (2014). Quantifying synergistic mutual information. Guided Self-Organization: Inception, Springer.","DOI":"10.1007\/978-3-642-53734-9"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Finn, C., and Lizier, J.T. (2018). Pointwise partial information decomposition using the specificity and ambiguity lattices. Entropy, 20.","DOI":"10.3390\/e20040297"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kolchinsky, A. (2024). Partial Information Decomposition: Redundancy as Information Bottleneck. Entropy, 26.","DOI":"10.3390\/e26070546"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.3390\/e16042161","article-title":"Quantifying unique information","volume":"16","author":"Bertschinger","year":"2014","journal-title":"Entropy"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1985","DOI":"10.3390\/e16041985","article-title":"Intersection information based on common randomness","volume":"16","author":"Griffith","year":"2014","journal-title":"Entropy"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"032305","DOI":"10.1103\/PhysRevE.100.032305","article-title":"Quantifying high-order interdependencies via multivariate extensions of the mutual information","volume":"100","author":"Rosas","year":"2019","journal-title":"Phys. Rev. E"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bohm, C., Kirkpatrick, D., Cao, V., and Adami, C. (2022). Information Fragmentation, Encryption and Information Flow in Complex Biological Networks. Entropy, 24.","DOI":"10.3390\/e24050735"},{"key":"ref_12","first-page":"149","article-title":"Common information is much less than mutual information","volume":"2","year":"1973","journal-title":"Probl. Control Inf. Theory"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1109\/TIT.1975.1055346","article-title":"The common information of two dependent random variables","volume":"21","author":"Wyner","year":"1975","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_14","unstructured":"Tishby, N., Pereira, F.C., and Bialek, W. (2000). The information bottleneck method. Proceedings of the 37th Annual Allerton Conference on Communication, Control, and Computing, University of Illinois."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1007\/BF00531932","article-title":"On the foundations of combinatorial theory I: Theory of M\u00f6bius functions","volume":"2","author":"Rota","year":"1964","journal-title":"Z. Wahrscheinlichkeitstheorie Verwandte Geb."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kay, J.W., Schulz, J.M., and Phillips, W.A. (2022). A Comparison of Partial Information Decompositions Using Data from Real and Simulated Layer 5b Pyramidal Cells. Entropy, 24.","DOI":"10.3390\/e24081021"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kay, J.W., and Ince, R.A.A. (2018). Exact Partial Information Decompositions for Gaussian Systems Based on Dependency Constraints. Entropy, 20.","DOI":"10.3390\/e20040240"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pica, G., Piasini, E., Chicharro, D., and Panzeri, S. (2017). Invariant components of synergy, redundancy, and unique information among three variables. Entropy, 19.","DOI":"10.3390\/e19090451"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"012130","DOI":"10.1103\/PhysRevE.87.012130","article-title":"A bivariate measure of redundant information","volume":"87","author":"Harder","year":"2013","journal-title":"Phys. Rev. E"},{"key":"ref_20","unstructured":"Bohm, C., Ragusa, V.R., Hintze, A., and Adami, C. (2025). Functional Information Decomposition: A First-Principles Approach to Analyzing Functional Relationships. arXiv."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/2\/167\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T09:49:53Z","timestamp":1770025793000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/2\/167"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,1]]},"references-count":20,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,2]]}},"alternative-id":["e28020167"],"URL":"https:\/\/doi.org\/10.3390\/e28020167","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,1]]}}}