{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T01:26:40Z","timestamp":1772587600214,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2018,4,23]],"date-time":"2018-04-23T00:00:00Z","timestamp":1524441600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["DE160100630"],"award-info":[{"award-number":["DE160100630"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001655","name":"Deutscher Akademischer Austauschdienst","doi-asserted-by":"publisher","award":["57216857"],"award-info":[{"award-number":["57216857"]}],"id":[{"id":"10.13039\/501100001655","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universities Australia","award":["180136"],"award-info":[{"award-number":["180136"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The formulation of the Partial Information Decomposition (PID) framework by Williams and Beer in 2010 attracted a significant amount of attention to the problem of defining redundant (or shared), unique and synergistic (or complementary) components of mutual information that a set of source variables provides about a target. This attention resulted in a number of measures proposed to capture these concepts, theoretical investigations into such measures, and applications to empirical data (in particular to datasets from neuroscience). In this Special Issue on \u201cInformation Decomposition of Target Effects from Multi-Source Interactions\u201d at Entropy, we have gathered current work on such information decomposition approaches from many of the leading research groups in the field. We begin our editorial by providing the reader with a review of previous information decomposition research, including an overview of the variety of measures proposed, how they have been interpreted and applied to empirical investigations. We then introduce the articles included in the special issue one by one, providing a similar categorisation of these articles into: i. proposals of new measures; ii. theoretical investigations into properties and interpretations of such approaches, and iii. applications of these measures in empirical studies. We finish by providing an outlook on the future of the field.<\/jats:p>","DOI":"10.3390\/e20040307","type":"journal-article","created":{"date-parts":[[2018,4,24]],"date-time":"2018-04-24T04:44:48Z","timestamp":1524545088000},"page":"307","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":127,"title":["Information Decomposition of Target Effects from Multi-Source Interactions: Perspectives on Previous, Current and Future Work"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9910-8972","authenticated-orcid":false,"given":"Joseph","family":"Lizier","sequence":"first","affiliation":[{"name":"Complex Systems Research Group and Centre for Complex Systems, Faculty of Engineering &amp; IT, The University of Sydney, NSW 2006, Australia"}]},{"given":"Nils","family":"Bertschinger","sequence":"additional","affiliation":[{"name":"Frankfurt Institute of Advanced Studies (FIAS) and Goethe University, 60438 Frankfurt am Main, Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5258-6590","authenticated-orcid":false,"given":"J\u00fcrgen","family":"Jost","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Mathematics in the Sciences, Inselstra\u00dfe 22, 04103 Leipzig, Germany"},{"name":"Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8010-5862","authenticated-orcid":false,"given":"Michael","family":"Wibral","sequence":"additional","affiliation":[{"name":"MEG Unit, Brain Imaging Center, Goethe University, 60528 Frankfurt, Germany"},{"name":"Max Planck Institute for Dynamics and Self-Organization, 37077 G\u00f6ttingen, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2018,4,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_2","unstructured":"Cover, T.M., and Thomas, J.A. (2012). Elements of Information Theory, John Wiley & Sons."},{"key":"ref_3","unstructured":"MacKay, D. (2003). Information Theory, Inference and Learning Algorithms, Cambridge University Press."},{"key":"ref_4","unstructured":"Williams, P.L., and Beer, R.D. (2018, April 21). Nonnegative decomposition of multivariate information. Available online: https:\/\/arxiv.org\/abs\/1004.2515."},{"key":"ref_5","unstructured":"Williams, P.L., and Beer, R.D. Decomposing Multivariate Information. Privately communicated."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"11539","DOI":"10.1523\/JNEUROSCI.23-37-11539.2003","article-title":"Synergy, redundancy, and independence in population codes","volume":"23","author":"Schneidman","year":"2003","journal-title":"J. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lizier, J.T., Flecker, B., and Williams, P.L. (2013, January 16\u201319). Towards a Synergy-Based Approach to Measuring Information Modification. Proceedings of the 2013 IEEE Symposium on Artificial Life (IEEE ALIFE), Singapore.","DOI":"10.1109\/ALIFE.2013.6602430"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Bertschinger, N., Rauh, J., Olbrich, E., and Jost, J. (2012, January 3\u20137). Shared Information\u2014New Insights and Problems in Decomposing Information in Complex Systems. Proceedings of the European Conference on Complex Systems 2012, Brussels, Belgium.","DOI":"10.1007\/978-3-319-00395-5_35"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"012130","DOI":"10.1103\/PhysRevE.87.012130","article-title":"Bivariate measure of redundant information","volume":"87","author":"Harder","year":"2013","journal-title":"Phys. Rev. E"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/978-3-642-53734-9_6","article-title":"Quantifying Synergistic Mutual Information","volume":"Volume 9","author":"Prokopenko","year":"2014","journal-title":"Guided Self-Organization: Inception"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wibral, M., Lizier, J.T., and Priesemann, V. (2015). Bits from brains for biologically inspired computing. Front. Robot. AI, 2.","DOI":"10.3389\/frobt.2015.00005"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.3390\/e16042161","article-title":"Quantifying unique information","volume":"16","author":"Bertschinger","year":"2014","journal-title":"Entropy"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Rauh, J., Bertschinger, N., Olbrich, E., and Jost, J. (July, January 29). Reconsidering Unique Information: Towards a Multivariate Information Decomposition. Proceedings of the 2014 IEEE International Symposium on Information Theory (ISIT), Honolulu, HI, USA.","DOI":"10.1109\/ISIT.2014.6875230"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3501","DOI":"10.3390\/e17053501","article-title":"Information decomposition and synergy","volume":"17","author":"Olbrich","year":"2015","journal-title":"Entropy"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"35","DOI":"10.3389\/frobt.2015.00035","article-title":"Hierarchical Quantification of Synergy in Channels","volume":"2","author":"Perrone","year":"2016","journal-title":"Front. Robot. AI"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Rosas, F., Ntranos, V., Ellison, C.J., Pollin, S., and Verhelst, M. (2016). Understanding interdependency through complex information sharing. Entropy, 18.","DOI":"10.3390\/e18020038"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1985","DOI":"10.3390\/e16041985","article-title":"Intersection information based on common randomness","volume":"16","author":"Griffith","year":"2014","journal-title":"Entropy"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4644","DOI":"10.3390\/e17074644","article-title":"Quantifying redundant information in predicting a target random variable","volume":"17","author":"Griffith","year":"2015","journal-title":"Entropy"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Quax, R., Har-Shemesh, O., and Sloot, P. (2017). Quantifying Synergistic Information Using Intermediate Stochastic Variables. Entropy, 19.","DOI":"10.3390\/e19020085"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"052802","DOI":"10.1103\/PhysRevE.91.052802","article-title":"Exploration of synergistic and redundant information sharing in static and dynamical Gaussian systems","volume":"91","author":"Barrett","year":"2015","journal-title":"Phys. Rev. E"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/j.gene.2016.05.029","article-title":"Construction of synergy networks from gene expression data related to disease","volume":"590","author":"Chatterjee","year":"2016","journal-title":"Gene"},{"key":"ref_22","unstructured":"Williams, P.L., and Beer, R.D. (2018, April 21). Generalized Measures of Information Transfer. Available online: https:\/\/arxiv.org\/abs\/1102.1507."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"037104","DOI":"10.1063\/1.3638449","article-title":"Partial information decomposition as a spatiotemporal filter","volume":"21","author":"Flecker","year":"2011","journal-title":"Chaos"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1004858","article-title":"High-Degree Neurons Feed Cortical Computations","volume":"12","author":"Timme","year":"2016","journal-title":"PLoS Comput. Biol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s10827-013-0458-4","article-title":"Synergy, redundancy, and multivariate information measures: an experimentalist\u2019s perspective","volume":"36","author":"Timme","year":"2014","journal-title":"J. Comput. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"105003","DOI":"10.1088\/1367-2630\/16\/10\/105003","article-title":"Synergy and redundancy in the Granger causal analysis of dynamical networks","volume":"16","author":"Stramaglia","year":"2014","journal-title":"New J. Phys."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.bandc.2015.09.004","article-title":"Partial information decomposition as a unified approach to the specification of neural goal functions","volume":"112","author":"Wibral","year":"2017","journal-title":"Brain Cogn."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/2.36","article-title":"Self-organisation in a perceptual network","volume":"21","author":"Linsker","year":"1988","journal-title":"IEEE Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"052422","DOI":"10.1103\/PhysRevE.93.052422","article-title":"Redundancy in information transmission in a two-step cascade","volume":"93","author":"Biswas","year":"2016","journal-title":"Phys. Rev. E"},{"key":"ref_30","unstructured":"Frey, S., Williams, P.L., and Albino, D.K. (2018, April 21). Information encryption in the expert management of strategic uncertainty. Available online: https:\/\/arxiv.org\/abs\/1605.04233."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rauh, J., Banerjee, P.K., Olbrich, E., Jost, J., and Bertschinger, N. (2017). On Extractable Shared Information. Entropy, 19.","DOI":"10.3390\/e19070328"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Rauh, J., Banerjee, P.K., Olbrich, E., Jost, J., Bertschinger, N., and Wolpert, D. (2017). Coarse-Graining and the Blackwell Order. Entropy, 19.","DOI":"10.3390\/e19100527"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ince, R. (2017). Measuring Multivariate Redundant Information with Pointwise Common Change in Surprisal. Entropy, 19.","DOI":"10.3390\/e19070318"},{"key":"ref_34","unstructured":"Ince, R.A.A. (2018, April 21). The Partial Entropy Decomposition: Decomposing multivariate entropy and mutual information via pointwise common surprisal. Available online: https:\/\/arxiv.org\/abs\/1702.01591."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Finn, C., and Lizier, J.T. (2018). Pointwise Partial Information Decomposition Using the Specificity and Ambiguity Lattices. Entropy, 20.","DOI":"10.3390\/e20040297"},{"key":"ref_36","unstructured":"Finn, C., and Lizier, J.T. (2018, April 21). Probability Mass Exclusions and the Directed Components of Pointwise Mutual Information. Available online: https:\/\/arxiv.org\/abs\/1801.09223."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"James, R.G., and Crutchfield, J.P. (2017). Multivariate dependence beyond shannon information. Entropy, 19.","DOI":"10.3390\/e19100531"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Pica, G., Piasini, E., Chicharro, D., and Panzeri, S. (2017). Invariant components of synergy, redundancy, and unique information among three variables. Entropy, 19.","DOI":"10.3390\/e19090451"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Rauh, J. (2017). Secret sharing and shared information. Entropy, 19.","DOI":"10.3390\/e19110601"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Faes, L., Marinazzo, D., and Stramaglia, S. (2017). Multiscale information decomposition: exact computation for multivariate Gaussian processes. Entropy, 19.","DOI":"10.3390\/e19080408"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Makkeh, A., Theis, D.O., and Vicente, R. (2017). Bivariate Partial Information Decomposition: The Optimization Perspective. Entropy, 19.","DOI":"10.3390\/e19100530"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kay, J.W., Ince, R.A., Dering, B., and Phillips, W.A. (2017). Partial and Entropic Information Decompositions of a Neuronal Modulatory Interaction. Entropy, 19.","DOI":"10.3390\/e19110560"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wibral, M., Finn, C., Wollstadt, P., Lizier, J.T., and Priesemann, V. (2017). Quantifying Information Modification in Developing Neural Networks via Partial Information Decomposition. Entropy, 19.","DOI":"10.3390\/e19090494"},{"key":"ref_44","unstructured":"Wollstadt, P., Lizier, J.T., Finn, C., Martinz-Zarzuela, M., Vicente, R., Lindner, M., Martinez-Mediano, P., and Wibral, M. (2017, August 25). The Information Dynamics Toolkit, IDTxl. Available online: https:\/\/github.com\/pwollstadt\/IDTxl."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Tax, T., Mediano, P.A., and Shanahan, M. (2017). The partial information decomposition of generative neural network models. Entropy, 19.","DOI":"10.3390\/e19090474"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Ghazi-Zahedi, K., Langer, C., and Ay, N. (2017). Morphological computation: Synergy of body and brain. Entropy, 19.","DOI":"10.3390\/e19090456"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Maity, A.K., Chaudhury, P., and Banik, S.K. (2017). Information theoretical study of cross-talk mediated signal transduction in MAPK pathways. Entropy, 19.","DOI":"10.3390\/e19090469"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Sootla, S., Theis, D., and Vicente, R. (2017). Analyzing Information Distribution in Complex Systems. Entropy, 19.","DOI":"10.3390\/e19120636"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/4\/307\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:01:46Z","timestamp":1760194906000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/4\/307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,23]]},"references-count":48,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2018,4]]}},"alternative-id":["e20040307"],"URL":"https:\/\/doi.org\/10.3390\/e20040307","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,23]]}}}