{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T10:33:33Z","timestamp":1782729213402,"version":"3.54.5"},"reference-count":21,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2015,5,14]],"date-time":"2015-05-14T00:00:00Z","timestamp":1431561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Seventh Framework Programme","award":["318723"],"award-info":[{"award-number":["318723"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>An information-theoretic perspective on coarse-graining is presented. It starts with an information characterization of configurations at the micro-level using a local information quantity that has a spatial average equal to a microscopic entropy. With a reversible micro dynamics, this entropy is conserved. In the micro-macro transition, it is shown how this local information quantity is transformed into a macroscopic entropy, as the local states are aggregated into macroscopic concentration variables. The information loss in this transition is identified, and the connection to the irreversibility of the macro dynamics and the second law of thermodynamics is discussed. This is then connected to a process of further coarse-graining towards higher characteristic length scales in the context of chemical reaction-diffusion dynamics capable of pattern formation. On these higher levels of coarse-graining, information flows across length scales and across space are defined. These flows obey a continuity equation for information, and they are connected to the thermodynamic constraints of the system, via an outflow of information from macroscopic to microscopic levels in the form of entropy production, as well as an inflow of information, from an external free energy source, if a spatial chemical pattern is to be maintained.<\/jats:p>","DOI":"10.3390\/e17053332","type":"journal-article","created":{"date-parts":[[2015,5,15]],"date-time":"2015-05-15T07:57:02Z","timestamp":1431676622000},"page":"3332-3351","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["An Information-Theoretic Perspective on Coarse-Graining, Including the Transition from Micro to Macro"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8577-9775","authenticated-orcid":false,"given":"Kristian","family":"Lindgren","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,5,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4794","DOI":"10.1103\/PhysRevA.38.4794","article-title":"Microscopic and macroscopic entropy","volume":"38","author":"Lindgren","year":"1988","journal-title":"Phys. Rev. A"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"524","DOI":"10.3390\/e15020524","article-title":"On thermodynamic interpretation of transfer entropy","volume":"15","author":"Prokopenko","year":"2013","journal-title":"Entropy"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Prokopenko, M., and Lizier, J.T. (2014). Transfer entropy and transient limits of computation. Sci. Rep., 4.","DOI":"10.1038\/srep05394"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1088\/0031-8949\/35\/3\/026","article-title":"Structural information in self-organizing systems","volume":"35","author":"Eriksson","year":"1987","journal-title":"Phys. Scr."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Pollack, J., Bedau, M.A., Husbands, P., Watson, R.A., and Ikegami, T. (2004). Flows of information in spatially extended chemical dynamics. Artificial Life IX: Proceedings of the Ninth International Conference on the Simulation and Synthesis of Living Systems, The MIT Press.","DOI":"10.7551\/mitpress\/1429.001.0001"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Gray, R.M. (2009). Probability, Random Processes, and Ergodic Properties, Springer.","DOI":"10.1007\/978-1-4419-1090-5"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1002\/j.1538-7305.1948.tb00917.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s00220-007-0192-8","article-title":"Continuity of information transport in surjective cellular automata","volume":"272","author":"Helvik","year":"2007","journal-title":"Commun. Math. Phys."},{"key":"ref_10","first-page":"529","article-title":"Correlations and random information in cellular automata","volume":"1","author":"Lindgren","year":"1987","journal-title":"Complex Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1007\/s10955-014-0972-4","article-title":"Expressing the entropy of lattice systems as sums of conditional entropies","volume":"155","author":"Helvik","year":"2014","journal-title":"J. Stat. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"037109","DOI":"10.1063\/1.3486801","article-title":"Information modification and particle collisions in distributed computation","volume":"20","author":"Lizier","year":"2010","journal-title":"Chaos: Interdiscip. J. Nonlinear Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On Information and Sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"051104","DOI":"10.1103\/PhysRevE.67.051104","article-title":"Structural information in two-dimensional patterns: Entropy convergence and excess entropy","volume":"67","author":"Feldman","year":"2003","journal-title":"Phys. Rev. E"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1007\/BF00668821","article-title":"Toward a quantitative theory of self-generated complexity","volume":"25","author":"Grassberger","year":"1986","journal-title":"Int. J. Theor. Phys."},{"key":"ref_16","first-page":"409","article-title":"Complexity measures and cellular automata","volume":"2","author":"Lindgren","year":"1988","journal-title":"Complex Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1103\/PhysRevLett.56.1505","article-title":"Lattice-gas automata for the Navier-Stokes equation","volume":"56","author":"Pomeau","year":"1986","journal-title":"Phys. Rev. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1103\/PhysRevE.60.264","article-title":"A thermodynamically reversible generalization of Diffusion Limited Aggregation","volume":"60","author":"Margolus","year":"1999","journal-title":"Phys. Rev. E"},{"key":"ref_19","unstructured":"Lindgren, K. (2014). Information Theory for Complex Systems\u2014An information Perspective on Complexity in Dynamical Systems, Physics, and Chemistry, Chalmers University of Technolgy."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1126\/science.261.5118.192","article-title":"Pattern formation by interacting chemical fronts","volume":"261","author":"Lee","year":"1993","journal-title":"Science"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1126\/science.261.5118.189","article-title":"in a Simple System","volume":"261","author":"Pearson","year":"1993","journal-title":"Science"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/5\/3332\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:46:18Z","timestamp":1760215578000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/5\/3332"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,5,14]]},"references-count":21,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2015,5]]}},"alternative-id":["e17053332"],"URL":"https:\/\/doi.org\/10.3390\/e17053332","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,5,14]]}}}