{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,17]],"date-time":"2026-05-17T10:46:04Z","timestamp":1779014764841,"version":"3.51.4"},"reference-count":63,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2012,10,31]],"date-time":"2012-10-31T00:00:00Z","timestamp":1351641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>This paper describes a free energy principle that tries to explain the ability of biological systems to resist a natural tendency to disorder. It appeals to circular causality of the sort found in synergetic formulations of self-organization (e.g., the slaving principle) and models of coupled dynamical systems, using nonlinear Fokker Planck equations. Here, circular causality is induced by separating the states of a random dynamical system into external and internal states, where external states are subject to random fluctuations and internal states are not. This reduces the problem to finding some (deterministic) dynamics of the internal states that ensure the system visits a limited number of external states; in other words, the measure of its (random) attracting set, or the Shannon entropy of the external states is small. We motivate a solution using a principle of least action based on variational free energy (from statistical physics) and establish the conditions under which it is formally equivalent to the information bottleneck method. This approach has proved useful in understanding the functional architecture of the brain. The generality of variational free energy minimisation and corresponding information theoretic formulations may speak to interesting applications beyond the neurosciences; e.g., in molecular or evolutionary biology.<\/jats:p>","DOI":"10.3390\/e14112100","type":"journal-article","created":{"date-parts":[[2012,10,31]],"date-time":"2012-10-31T11:59:41Z","timestamp":1351684781000},"page":"2100-2121","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":258,"title":["A Free Energy Principle for Biological Systems"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7984-8909","authenticated-orcid":false,"given":"Friston","family":"Karl","sequence":"first","affiliation":[{"name":"The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, Queen Square, London, WC1N 3BG, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2012,10,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2409","DOI":"10.1162\/089976601753195969","article-title":"Predictability, complexity, and learning","volume":"13","author":"Bialek","year":"2001","journal-title":"Neural Computat."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free-energy principle: a unified brain theory?","volume":"11","author":"Friston","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1098\/rstb.2005.1622","article-title":"A theory of cortical responses","volume":"360","author":"Friston","year":"2005","journal-title":"Philos. Trans. R. Soc. Lond B Biol. Sci."},{"key":"ref_4","unstructured":"Helmholtz, H. (1962). Treatise on Physiological Optics, Dover Publications. [3rd ed.]."},{"key":"ref_5","first-page":"179","article-title":"Perceptual illusions and brain models","volume":"171","author":"Gregory","year":"1968","journal-title":"Proc. R. Soc. Lond. B"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1162\/neco.1995.7.5.889","article-title":"The Helmholtz machine","volume":"7","author":"Dayan","year":"1995","journal-title":"Neural Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1016\/j.tins.2004.10.007","article-title":"The Bayesian brain: the role of uncertainty in neural coding and computation","volume":"27","author":"Knill","year":"2004","journal-title":"Trends Neurosci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.tics.2006.05.002","article-title":"Vision as Bayesian inference: analysis by synthesis?","volume":"10","author":"Yuille","year":"2006","journal-title":"Trends Cogn. Sci."},{"key":"ref_9","unstructured":"Beal, M.J. (2003). Variational Algorithms for Approximate Bayesian Inference. [Ph.D. Thesis, University College London]."},{"key":"ref_10","unstructured":"Feynman, R.P. (1972). Statistical Mechanics, Reading MA."},{"key":"ref_11","unstructured":"Hinton, G.E., and van Camp, D. (, January July). Keeping neural networks simple by minimizing the description length of weights. Proceedings of the Sixth Annual Conference on Computational Learning Theory, Santa Cruz, NY, USA."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1049\/el:19950331","article-title":"Free-energy minimisation algorithm for decoding and cryptoanalysis","volume":"31","author":"MacKay","year":"1995","journal-title":"Electron. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.neuroimage.2006.08.035","article-title":"Variational free energy and the Laplace approximation","volume":"34","author":"Friston","year":"2007","journal-title":"Neuroimage"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1038\/4580","article-title":"Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects","volume":"2","author":"Rao","year":"1999","journal-title":"Nat. Neurosci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1613\/jair.3062","article-title":"A Minimum Relative Entropy Principle for Learning and Acting","volume":"38","author":"Ortega","year":"2010","journal-title":"J. Artif. Intell. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.jphysparis.2006.10.001","article-title":"A free energy principle for the brain","volume":"100","author":"Friston","year":"2006","journal-title":"J. Physiol. Paris."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1080\/00221309.1947.9918144","article-title":"Principles of the self-organizing dynamic system","volume":"37","author":"Ashby","year":"1947","journal-title":"J. Gen. Psychol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.1016\/j.neunet.2009.07.023","article-title":"Cortical circuits for perceptual inference","volume":"22","author":"Friston","year":"2009","journal-title":"Neural. Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20","DOI":"10.3389\/neuro.11.020.2009","article-title":"Perception and hierarchical dynamics","volume":"3","author":"Kiebel","year":"2009","journal-title":"Front. Neuroinform."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"215","DOI":"10.3389\/fnhum.2010.00215","article-title":"Attention, uncertainty, and free-energy","volume":"4","author":"Feldman","year":"2010","journal-title":"Front. Hum. Neurosci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/s00422-010-0364-z","article-title":"Action and behavior: a free-energy formulation","volume":"102","author":"Friston","year":"2010","journal-title":"Biol. Cybern."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s00422-011-0424-z","article-title":"Action understanding and active inference","volume":"104","author":"Friston","year":"2011","journal-title":"Biol. Cybern."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Friston, K., and Ao, P. (2012). Free-energy, value and attractors. Comput. Math. Methods Med., 937860.","DOI":"10.1155\/2012\/937860"},{"key":"ref_24","unstructured":"Ortega, P.A., and Braun, D.A. (2012). Thermodynamics as a theory of decision-making with information processing costs. ArXiv:1204.6481v1."},{"key":"ref_25","unstructured":"Charles, C. (1974). Lectures on the Phenomena Common to Animals and Plants, Thomas Pub Ltd."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kauffman, S. (1993). The Origins of Order: Self-Organization and Selection in Evolution, Oxford University Press.","DOI":"10.1093\/oso\/9780195079517.001.0001"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Maturana, H.R., and Reidel, V.F. (1980). Autopoiesis and Cognition, Springer.","DOI":"10.1007\/978-94-009-8947-4"},{"key":"ref_28","unstructured":"Nicolis, G., and Prigogine, I. (1977). Self-Organization in Non-Equilibrium Systems, John Wiley."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.bpc.2004.12.001","article-title":"Thermodynamics of stoichiometric biochemical networks in living systems far from equilibrium","volume":"114","author":"Qian","year":"2005","journal-title":"Biophys. Chem."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.newideapsych.2006.09.002","article-title":"Intentionality in non-equilibrium systems? The functional aspects of self-organised pattern formation","volume":"25","author":"Tschacher","year":"2007","journal-title":"New Ideas Psychol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1080\/00207727008920220","article-title":"Every Good Regulator of a system must be a model of that system","volume":"1","author":"Conant","year":"1970","journal-title":"Int. J. Systems Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1103\/PhysRev.106.620","article-title":"Information Theory and Statistical Mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Phys. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1007\/BF01193705","article-title":"Attractors for random dynamical systems","volume":"100","author":"Crauel","year":"1994","journal-title":"Probab. Theory Rel."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/BF02219225","article-title":"Random attractors","volume":"9","author":"Crauel","year":"1997","journal-title":"J. Dyn. Differ. Equ."},{"key":"ref_35","unstructured":"Arnold, L. (2003). Random Dynamical Systems (Springer Monographs in Mathematics), Springer-Verlag."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1126\/science.1155564","article-title":"Neuroscience. Transient dynamics for neural processing","volume":"321","author":"Rabinovich","year":"2008","journal-title":"Science"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/S0076-6879(09)67005-1","article-title":"Entropy demystified: the \"thermo\"-dynamics of stochastically fluctuating systems","volume":"467","author":"Qian","year":"2009","journal-title":"Methods Enzymol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5235","DOI":"10.1021\/jp055592s","article-title":"Low-dimensional manifolds in reaction-diffusion equations. 1. Fundamental aspects","volume":"110","author":"Davis","year":"2006","journal-title":"J. Phys. Chem. A."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1088\/0253-6102\/49\/5\/01","article-title":"Emerging of Stochastic Dynamical Equalities and Steady State Thermodynamics","volume":"49","author":"Ao","year":"2008","journal-title":"Commun. Theor. Phys."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1007\/s00285-010-0349-5","article-title":"Persistence in fluctuating environments","volume":"62","author":"Schreiber","year":"2011","journal-title":"J. Math. Biol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1175\/1520-0469(1963)020<0130:DNF>2.0.CO;2","article-title":"Deterministic nonperiodic flow","volume":"20","author":"Lorenz","year":"1963","journal-title":"J. Atmos. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/BF00198909","article-title":"A theoretical model of phase transitions in the human brain","volume":"71","author":"Jirsa","year":"1994","journal-title":"Biol. Cybern."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1017\/S0140525X01000097","article-title":"Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems","volume":"24","author":"Tsuda","year":"2001","journal-title":"Behav. Brain Sci."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Hu, A., Xu, Z., and Guo, L. (2010). The existence of generalized synchronization of chaotic systems in complex networks. Chaos, 013112.","DOI":"10.1063\/1.3309017"},{"key":"ref_45","first-page":"1064","article-title":"On the theory of superconductivity","volume":"20","author":"Ginzburg","year":"1950","journal-title":"Zh. Eksp. Teor. Fiz."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Haken, H. (1983). Synergetics: An introduction. Nonequilibrium Phase Transition and Self-Organisation in Physics, Chemistry and Biology, Springer Verlag. [3rd ed.].","DOI":"10.1007\/978-3-642-88338-5"},{"key":"ref_47","unstructured":"Frank, T.D. (2005). Nonlinear Fokker-Planck Equations: Fundamentals and Applications (Springer Series in Synergetics), Springer. [1st ed.]."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"190","DOI":"10.3389\/fnhum.2010.00190","article-title":"Generative models of cortical oscillations: neurobiological implications of the Kuramoto model","volume":"4","author":"Breakspear","year":"2010","journal-title":"Front. Hum. Neurosci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"28","DOI":"10.3390\/info1010028","article-title":"A Paradigm Shift in Biology?","volume":"1","author":"Auletta","year":"2010","journal-title":"Information"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"80","DOI":"10.3389\/fnsys.2011.00080","article-title":"Free energy and dendritic self-organization","volume":"5","author":"Kiebel","year":"2011","journal-title":"Front. Syst. Neurosci."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/BF02505989","article-title":"Global random attractors are uniquely determined by attracting deterministic compact sets","volume":"4","author":"Crauel","year":"1999","journal-title":"Ann. Mat. Pura Appl."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1073\/pnas.17.2.656","article-title":"Proof of the ergodic theorem","volume":"17","author":"Birkhoff","year":"1931","journal-title":"Proc. Natl. Acad. Sci. USA."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"063101","DOI":"10.1088\/0953-8984\/22\/6\/063101","article-title":"Applications of the principle of maximum entropy: from physics to ecology","volume":"22","author":"Banavar","year":"2010","journal-title":"J. Phys. Condens. Matter"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On Information and Sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1038\/335311a0","article-title":"The functional logic of cortical connections","volume":"335","author":"Zeki","year":"1988","journal-title":"Nature"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1162\/089976698300017818","article-title":"Probabilistic interpretation of population code","volume":"10","author":"Zemel","year":"1998","journal-title":"Neural Computat."},{"key":"ref_57","unstructured":"Tishby, N., Pereira, F.C., and Bialek, W. (, January September). The Information Bottleneck method. Proceedings of The 37th Annual Allerton Conference on Communication, Control, and Computing, Monticello, IL, USA."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Friston, K., Stephan, K., Li, B., and Daunizeau, J. (2010). Generalised Filtering. Math. Probl. Eng., 621670.","DOI":"10.1155\/2010\/621670"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/BF00198477","article-title":"On the computational architecture of the neocortex. II","volume":"66","author":"Mumford","year":"1992","journal-title":"Biol. Cybern."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.1098\/rstb.2008.0300","article-title":"Predictive coding under the free-energy principle","volume":"364","author":"Friston","year":"2009","journal-title":"Phil. Trans. R. Soc. B"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"9541","DOI":"10.1073\/pnas.0501865102","article-title":"The application of statistical physics to evolutionary biology","volume":"102","author":"Sella","year":"2005","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_62","unstructured":"Accord de diff\u00e9rentes lois de la nature qui avaient jusqu'ici paru incompatibles. Avaiable online: https:\/\/fr.wikisource.org\/wiki\/Accord_de_diff%C3%A9rentes_loix_de_la_nature_qui_avoient_jusqu%E2%80%99ici_paru_incompatibles\/."},{"key":"ref_63","unstructured":"Le lois de mouvement et du repos, d\u00e9duites d'un principe de m\u00e9taphysique. Avaiable online: http:\/\/fr.wikisource.org\/wiki\/Les_Loix_du_mouvement_et_du_repos_d%C3%A9duites_d%E2%80%99un_principe_metaphysique\/."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/11\/2100\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:53:12Z","timestamp":1760219592000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/11\/2100"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,10,31]]},"references-count":63,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2012,11]]}},"alternative-id":["e14112100"],"URL":"https:\/\/doi.org\/10.3390\/e14112100","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,10,31]]}}}