{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T01:38:11Z","timestamp":1792028291031,"version":"4.4.0"},"reference-count":86,"publisher":"Springer Science and Business Media LLC","issue":"5-6","license":[{"start":{"date-parts":[[2019,9,27]],"date-time":"2019-09-27T00:00:00Z","timestamp":1569542400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,9,27]],"date-time":"2019-09-27T00:00:00Z","timestamp":1569542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000833","name":"Rosetrees Trust","doi-asserted-by":"publisher","award":["173346"],"award-info":[{"award-number":["173346"]}],"id":[{"id":"10.13039\/501100000833","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["088130\/Z\/09\/Z"],"award-info":[{"award-number":["088130\/Z\/09\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Biol Cybern"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Active inference is an approach to understanding behaviour that rests upon the idea that the brain uses an internal generative model to predict incoming sensory data. The fit between this model and data may be improved in two ways. The brain could optimise probabilistic beliefs about the variables in the generative model (i.e. perceptual inference). Alternatively, by acting on the world, it could change the sensory data, such that they are more consistent with the model. This implies a common objective function (variational free energy) for action and perception that scores the fit between an internal model and the world. We compare two free energy functionals for active inference in the framework of Markov decision processes. One of these is a functional of beliefs (i.e. probability distributions) about states and policies, but a function of observations, while the second is a functional of beliefs about all three. In the former (\n                    <jats:italic>expected<\/jats:italic>\n                    free energy), prior beliefs about outcomes are not part of the generative model (because they are absorbed into the prior over policies). Conversely, in the second (\n                    <jats:italic>generalised<\/jats:italic>\n                    free energy), priors over outcomes become an explicit component of the generative model. When using the free energy function, which is blind to future observations, we equip the generative model with a prior over policies that ensure preferred (i.e. priors over) outcomes are realised. In other words, if we expect to encounter a particular kind of outcome, this lends plausibility to those policies for which this outcome is a consequence. In addition, this formulation ensures that selected policies minimise uncertainty about future outcomes by minimising the free energy expected in the future. When using the free energy functional\u2014that effectively treats future observations as hidden states\u2014we show that policies are inferred or selected that realise prior preferences by minimising the free energy of future expectations. Interestingly, the form of posterior beliefs about policies (and associated belief updating) turns out to be identical under both formulations, but the quantities used to compute them are not.\n                  <\/jats:p>","DOI":"10.1007\/s00422-019-00805-w","type":"journal-article","created":{"date-parts":[[2019,9,27]],"date-time":"2019-09-27T10:02:44Z","timestamp":1569578564000},"page":"495-513","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":195,"title":["Generalised free energy and active inference"],"prefix":"10.1007","volume":"113","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5108-5743","authenticated-orcid":false,"given":"Thomas","family":"Parr","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karl J.","family":"Friston","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,9,27]]},"reference":[{"key":"805_CR1","unstructured":"Attias H (2003) Planning by probabilistic inference. In: Proceedings of the 9th international workshop on artificial intelligence and statistics"},{"key":"805_CR2","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1016\/j.cognition.2009.07.005","volume":"113","author":"CL Baker","year":"2009","unstructured":"Baker CL, Saxe R, Tenenbaum JB (2009) Action understanding as inverse planning. Cognition 113:329\u2013349. \nhttps:\/\/doi.org\/10.1016\/j.cognition.2009.07.005","journal-title":"Cognition"},{"key":"805_CR3","first-page":"217","volume-title":"Sensory communication","author":"H Barlow","year":"1961","unstructured":"Barlow H (1961) Possible principles underlying the transformations of sensory messages. In: Rosenblith W (ed) Sensory communication. MIT Press, Cambridge, pp 217\u2013234"},{"key":"805_CR4","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1068\/p030123","volume":"3","author":"HB Barlow","year":"1974","unstructured":"Barlow HB (1974) Inductive inference, coding, perception, and language. Perception 3:123\u2013134","journal-title":"Perception"},{"key":"805_CR5","volume-title":"Variational algorithms for approximate Bayesian inference","author":"MJ Beal","year":"2003","unstructured":"Beal MJ (2003) Variational algorithms for approximate Bayesian inference. University of London, London"},{"key":"805_CR6","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1162\/cpsy_a_00022","volume":"2","author":"D Benrimoh","year":"2018","unstructured":"Benrimoh D, Parr T, Vincent P, Adams RA, Friston K (2018) Active inference and auditory hallucinations computational psychiatry 2:183\u2013204. \nhttps:\/\/doi.org\/10.1162\/cpsy_a_00022","journal-title":"Active inference and auditory hallucinations computational psychiatry"},{"key":"805_CR7","doi-asserted-by":"publisher","first-page":"485","DOI":"10.1016\/j.tics.2012.08.006","volume":"16","author":"M Botvinick","year":"2012","unstructured":"Botvinick M, Toussaint M (2012) Planning as inference. Trends Cognit Sci 16:485\u2013488","journal-title":"Trends Cognit Sci"},{"key":"805_CR8","doi-asserted-by":"publisher","first-page":"43","DOI":"10.3389\/fpsyg.2012.00043","volume":"3","author":"H Brown","year":"2012","unstructured":"Brown H, Friston KJ (2012) Free-energy and illusions: the Cornsweet effect. Front Psychol 3:43. \nhttps:\/\/doi.org\/10.3389\/fpsyg.2012.00043","journal-title":"Front Psychol"},{"key":"805_CR9","doi-asserted-by":"publisher","DOI":"10.1007\/s11229-016-1239-1","author":"J Bruineberg","year":"2016","unstructured":"Bruineberg J, Kiverstein J, Rietveld E (2016) The anticipating brain is not a scientist: the free-energy principle from an ecological-enactive perspective. Synthese. \nhttps:\/\/doi.org\/10.1007\/s11229-016-1239-1","journal-title":"Synthese"},{"key":"805_CR10","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.jtbi.2018.07.002","volume":"455","author":"J Bruineberg","year":"2018","unstructured":"Bruineberg J, Rietveld E, Parr T, van Maanen L, Friston KJ (2018) Free-energy minimization in joint agent-environment systems: a niche construction perspective. J Theor Biol 455:161\u2013178. \nhttps:\/\/doi.org\/10.1016\/j.jtbi.2018.07.002","journal-title":"J Theor Biol"},{"key":"805_CR11","doi-asserted-by":"publisher","first-page":"e1002280","DOI":"10.1371\/journal.pcbi.1002280","volume":"7","author":"J Daunizeau","year":"2011","unstructured":"Daunizeau J, Preuschoff K, Friston K, Stephan K (2011) Optimizing experimental design for comparing models of brain function. PLOS Comput Biol 7:e1002280. \nhttps:\/\/doi.org\/10.1371\/journal.pcbi.1002280","journal-title":"PLOS Comput Biol"},{"key":"805_CR12","doi-asserted-by":"crossref","unstructured":"Dauwels J (2007) On variational message passing on factor graphs. In: IEEE international symposium on information theory, ISIT 2007. IEEE, pp 2546\u20132550","DOI":"10.1109\/ISIT.2007.4557602"},{"key":"805_CR13","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1162\/neco.1995.7.5.889","volume":"7","author":"P Dayan","year":"1995","unstructured":"Dayan P, Hinton GE, Neal RM, Zemel RS (1995) The Helmholtz machine. Neural Comput 7:889\u2013904","journal-title":"Neural Comput"},{"key":"805_CR14","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1109\/34.982896","volume":"24","author":"J Denzler","year":"2002","unstructured":"Denzler J, Brown CM (2002) Information theoretic sensor data selection for active object recognition and state estimation. IEEE Trans Pattern Anal Mach Intell 24:145\u2013157. \nhttps:\/\/doi.org\/10.1109\/34.982896","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"805_CR15","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/978-94-011-3460-6_3","volume-title":"Maximum entropy and Bayesian methods: Laramie, Wyoming, 1990","author":"MA El-Gamal","year":"1991","unstructured":"El-Gamal MA (1991) The role of priors in active bayesian learning in the sequential statistical decision framework. In: Grandy WT, Schick LH (eds) Maximum entropy and Bayesian methods: Laramie, Wyoming, 1990. Springer Netherlands, Dordrecht, pp 33\u201338. \nhttps:\/\/doi.org\/10.1007\/978-94-011-3460-6_3"},{"key":"805_CR16","doi-asserted-by":"publisher","first-page":"643","DOI":"10.2307\/1884324","volume":"75","author":"D Ellsberg","year":"1961","unstructured":"Ellsberg D (1961) Risk, ambiguity, and the savage axioms. Q J Econ 75:643\u2013669. \nhttps:\/\/doi.org\/10.2307\/1884324","journal-title":"Q J Econ"},{"key":"805_CR17","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2014.00457","author":"T FitzGerald","year":"2014","unstructured":"FitzGerald T, Dolan R, Friston K (2014) Model averaging, optimal inference, and habit formation. Front Hum Neurosci. \nhttps:\/\/doi.org\/10.3389\/fnhum.2014.00457","journal-title":"Front Hum Neurosci"},{"key":"805_CR18","doi-asserted-by":"publisher","first-page":"136","DOI":"10.3389\/fncom.2015.00136","volume":"9","author":"TH FitzGerald","year":"2015","unstructured":"FitzGerald TH, Dolan RJ, Friston K (2015a) Dopamine, reward learning, and active inference. Front Comput Neurosci 9:136. \nhttps:\/\/doi.org\/10.3389\/fncom.2015.00136","journal-title":"Front Comput Neurosci"},{"key":"805_CR19","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1016\/j.neuroimage.2014.12.015","volume":"107","author":"TH FitzGerald","year":"2015","unstructured":"FitzGerald TH, Moran RJ, Friston KJ, Dolan RJ (2015b) Precision and neuronal dynamics in the human posterior parietal cortex during evidence accumulation. Neuroimage 107:219\u2013228. \nhttps:\/\/doi.org\/10.1016\/j.neuroimage.2014.12.015","journal-title":"Neuroimage"},{"key":"805_CR20","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1162\/neco_a_00699","volume":"27","author":"TH FitzGerald","year":"2015","unstructured":"FitzGerald TH, Schwartenbeck P, Moutoussis M, Dolan RJ, Friston K (2015c) Active inference, evidence accumulation, and the urn task. Neural Comput 27:306\u2013328. \nhttps:\/\/doi.org\/10.1162\/neco_a_00699","journal-title":"Neural Comput"},{"key":"805_CR21","doi-asserted-by":"publisher","first-page":"1325","DOI":"10.1016\/j.neunet.2003.06.005","volume":"16","author":"K Friston","year":"2003","unstructured":"Friston K (2003) Learning and inference in the brain. Neural Netw 16:1325\u20131352. \nhttps:\/\/doi.org\/10.1016\/j.neunet.2003.06.005","journal-title":"Neural Netw"},{"key":"805_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2016.05.001","author":"K Friston","year":"2016","unstructured":"Friston K, Buzsaki G (2016) The functional anatomy of time: what and when in the brain. Trends Cognit Sci. \nhttps:\/\/doi.org\/10.1016\/j.tics.2016.05.001","journal-title":"Trends Cognit Sci"},{"key":"805_CR23","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.jphysparis.2006.10.001","volume":"100","author":"K Friston","year":"2006","unstructured":"Friston K, Kilner J, Harrison L (2006) A free energy principle for the brain. J Physiol-Paris 100:70\u201387. \nhttps:\/\/doi.org\/10.1016\/j.jphysparis.2006.10.001","journal-title":"J Physiol-Paris"},{"key":"805_CR24","doi-asserted-by":"publisher","first-page":"11","DOI":"10.3389\/fnbot.2012.00011","volume":"6","author":"K Friston","year":"2012","unstructured":"Friston K, Adams R, Montague R (2012a) What is value\u2014accumulated reward or evidence? Front Neurorobotics 6:11. \nhttps:\/\/doi.org\/10.3389\/fnbot.2012.00011","journal-title":"Front Neurorobotics"},{"key":"805_CR25","doi-asserted-by":"publisher","first-page":"151","DOI":"10.3389\/fpsyg.2012.00151","volume":"3","author":"K Friston","year":"2012","unstructured":"Friston K, Adams RA, Perrinet L, Breakspear M (2012b) Perceptions as hypotheses: saccades as experiments. Front Psychol 3:151. \nhttps:\/\/doi.org\/10.3389\/fpsyg.2012.00151","journal-title":"Front Psychol"},{"key":"805_CR26","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1007\/s00422-012-0512-8","volume":"106","author":"K Friston","year":"2012","unstructured":"Friston K, Samothrakis S, Montague R (2012c) Active inference and agency: optimal control without cost functions. Biol Cybernet 106:523\u2013541. \nhttps:\/\/doi.org\/10.1007\/s00422-012-0512-8","journal-title":"Biol Cybernet"},{"key":"805_CR27","doi-asserted-by":"publisher","first-page":"20130481","DOI":"10.1098\/rstb.2013.0481","volume":"369","author":"K Friston","year":"2014","unstructured":"Friston K, Schwartenbeck P, FitzGerald T, Moutoussis M, Behrens T, Dolan RJ (2014) The anatomy of choice: dopamine and decision-making. Philos Trans R Soc B Biol Sci 369:20130481. \nhttps:\/\/doi.org\/10.1098\/rstb.2013.0481","journal-title":"Philos Trans R Soc B Biol Sci"},{"key":"805_CR28","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1080\/17588928.2015.1020053","volume":"6","author":"K Friston","year":"2015","unstructured":"Friston K, Rigoli F, Ognibene D, Mathys C, Fitzgerald T, Pezzulo G (2015) Active inference and epistemic value. Cognit Neurosci 6:187\u2013214. \nhttps:\/\/doi.org\/10.1080\/17588928.2015.1020053","journal-title":"Cognit Neurosci"},{"key":"805_CR29","doi-asserted-by":"publisher","first-page":"862","DOI":"10.1016\/j.neubiorev.2016.06.022","volume":"68","author":"K Friston","year":"2016","unstructured":"Friston K, FitzGerald T, Rigoli F, Schwartenbeck P, O\u2019Doherty J, Pezzulo G (2016) Active inference and learning. Neurosci Biobehav Rev 68:862\u2013879. \nhttps:\/\/doi.org\/10.1016\/j.neubiorev.2016.06.022","journal-title":"Neurosci Biobehav Rev"},{"key":"805_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/NECO_a_00912","volume":"29","author":"K Friston","year":"2017","unstructured":"Friston K, FitzGerald T, Rigoli F, Schwartenbeck P, Pezzulo G (2017a) Active inference: a process theory. Neural Comput 29:1\u201349. \nhttps:\/\/doi.org\/10.1162\/NECO_a_00912","journal-title":"Neural Comput"},{"issue":"10","key":"805_CR31","doi-asserted-by":"publisher","first-page":"2633","DOI":"10.1162\/neco_a_00999","volume":"29","author":"KJ Friston","year":"2017","unstructured":"Friston KJ, Lin M, Frith CD, Pezzulo G, Hobson JA, Ondobaka S (2017b) Active inference, curiosity and insight. Neural Comput 29(10):2633\u20132683","journal-title":"Neural Comput"},{"key":"805_CR32","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1162\/NETN_a_00018","volume":"1","author":"KJ Friston","year":"2017","unstructured":"Friston KJ, Parr T, de Vries B (2017c) The graphical brain: belief propagation and active inference. Netw Neurosci 1:381\u2013414. \nhttps:\/\/doi.org\/10.1162\/NETN_a_00018","journal-title":"Netw Neurosci"},{"key":"805_CR33","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1016\/j.neubiorev.2017.04.009","volume":"77","author":"KJ Friston","year":"2017","unstructured":"Friston KJ, Rosch R, Parr T, Price C, Bowman H (2017d) Deep temporal models and active inference. Neurosci Biobehav Rev 77:388\u2013402. \nhttps:\/\/doi.org\/10.1016\/j.neubiorev.2017.04.009","journal-title":"Neurosci Biobehav Rev"},{"key":"805_CR34","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1006\/jeth.2001.2815","volume":"102","author":"P Ghirardato","year":"2002","unstructured":"Ghirardato P, Marinacci M (2002) Ambiguity made precise: a comparative foundation. J Econ Theory 102:251\u2013289. \nhttps:\/\/doi.org\/10.1006\/jeth.2001.2815","journal-title":"J Econ Theory"},{"key":"805_CR35","doi-asserted-by":"publisher","DOI":"10.4324\/9780203493564","volume-title":"The Cognitive Psychology of Planning","author":"Robin Morris","year":"2004","unstructured":"Gilhooly (2005) Working memory and planning, 1st edn. In: Morris R, Ward G (eds) The cognitive psychology of planning. Psychology Press, London, 256 p. \nhttps:\/\/doi.org\/10.4324\/9780203493564"},{"key":"805_CR36","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1098\/rstb.1980.0090","volume":"290","author":"RL Gregory","year":"1980","unstructured":"Gregory RL (1980) Perceptions as hypotheses. Philos Trans R Soc Lond B Biol Sci 290:181","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"key":"805_CR37","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1152\/physrev.2000.80.3.953","volume":"80","author":"O Hikosaka","year":"2000","unstructured":"Hikosaka O, Takikawa Y, Kawagoe R (2000) Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80:953","journal-title":"Physiol Rev"},{"key":"805_CR38","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1111\/nous.12062","volume":"50","author":"J Hohwy","year":"2016","unstructured":"Hohwy J (2016) The self-evidencing brain. No\u00fbs 50:259\u2013285. \nhttps:\/\/doi.org\/10.1111\/nous.12062","journal-title":"No\u00fbs"},{"key":"805_CR39","unstructured":"Huggins JH, Tenenbaum JB (2015) Risk and regret of hierarchical Bayesian learners. Paper presented at the Proceedings of the 32nd international conference on international conference on machine learning\u2014Volume 37, Lille, France"},{"key":"805_CR40","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1162\/0891201041850894","volume":"30","author":"R Hwa","year":"2004","unstructured":"Hwa R (2004) Sample selection for statistical parsing. Comput Linguist 30:253\u2013276","journal-title":"Comput Linguist"},{"key":"805_CR41","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-018-0753-2","author":"R Kaplan","year":"2018","unstructured":"Kaplan R, Friston KJ (2018) Planning and navigation as active inference. Biol Cybernet. \nhttps:\/\/doi.org\/10.1007\/s00422-018-0753-2","journal-title":"Biol Cybernet"},{"key":"805_CR42","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/s10994-012-5278-7","volume":"87","author":"HJ Kappen","year":"2012","unstructured":"Kappen HJ, Gomez Y, Opper M (2012) Optimal control as a graphical model inference problem. Mach Learn 87:159\u2013182","journal-title":"Mach Learn"},{"key":"805_CR43","volume-title":"Optimizing sensing: theory and applications","author":"A Krause","year":"2008","unstructured":"Krause A (2008) Optimizing sensing: theory and applications. Carnegie Mellon University, Pittsburgh"},{"key":"805_CR44","unstructured":"Lewis DD, Gale WA (1994) A sequential algorithm for training text classifiers. In: Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval. Springer-Verlag New York, Inc., pp 3\u201312"},{"key":"805_CR45","doi-asserted-by":"publisher","first-page":"986","DOI":"10.1214\/aoms\/1177728069","volume":"27","author":"DV Lindley","year":"1956","unstructured":"Lindley DV (1956) On a measure of the information provided by an experiment. Ann Math Stat 27:986\u20131005. \nhttps:\/\/doi.org\/10.1214\/aoms\/1177728069","journal-title":"Ann Math Stat"},{"key":"805_CR46","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1146\/annurev.ne.13.030190.001353","volume":"13","author":"R Linsker","year":"1990","unstructured":"Linsker R (1990) Perceptual neural organization: some approaches based on network models and information theory. Annu Rev Neurosci 13:257\u2013281","journal-title":"Annu Rev Neurosci"},{"key":"805_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1098\/rsif.2013.0069","volume":"10","author":"K Lloyd","year":"2013","unstructured":"Lloyd K, Leslie DS (2013) Context-dependent decision-making: a simple Bayesian model. J R Soc Interface 10:1. \nhttps:\/\/doi.org\/10.1098\/rsif.2013.0069","journal-title":"J R Soc Interface"},{"key":"805_CR48","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1162\/neco.1992.4.4.590","volume":"4","author":"DJC MacKay","year":"1992","unstructured":"MacKay DJC (1992) Information-based objective functions for active data selection. Neural Comput 4:590\u2013604. \nhttps:\/\/doi.org\/10.1162\/neco.1992.4.4.590","journal-title":"Neural Comput"},{"key":"805_CR49","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1017\/S0140525X09990975","volume":"32","author":"RT McKay","year":"2010","unstructured":"McKay RT, Dennett DC (2010) The evolution of misbelief. Behav Brain Sci 32:493\u2013510. \nhttps:\/\/doi.org\/10.1017\/S0140525X09990975","journal-title":"Behav Brain Sci"},{"key":"805_CR50","doi-asserted-by":"publisher","DOI":"10.3389\/fncom.2016.00056","author":"MB Mirza","year":"2016","unstructured":"Mirza MB, Adams RA, Mathys CD, Friston KJ (2016) Scene construction, visual foraging, and active inference. Front Comput Neurosci. \nhttps:\/\/doi.org\/10.3389\/fncom.2016.00056","journal-title":"Front Comput Neurosci"},{"key":"805_CR51","volume-title":"Variational principles","author":"BL Moiseiwitsch","year":"2013","unstructured":"Moiseiwitsch BL (2013) Variational principles. Dover Publications, Mineola"},{"key":"805_CR52","doi-asserted-by":"publisher","first-page":"160","DOI":"10.3389\/fnhum.2014.00160","volume":"8","author":"M Moutoussis","year":"2014","unstructured":"Moutoussis M, Trujillo-Barreto NJ, El-Deredy W, Dolan RJ, Friston KJ (2014) A formal model of interpersonal inference. Front Hum Neurosci 8:160. \nhttps:\/\/doi.org\/10.3389\/fnhum.2014.00160","journal-title":"Front Hum Neurosci"},{"key":"805_CR53","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1152\/jn.1987.57.1.162","volume":"57","author":"L Optican","year":"1987","unstructured":"Optican L, Richmond BJ (1987) Temporal encoding of two-dimensional patterns by single units in primate inferior cortex. II Information theoretic analysis. J Neurophysiol 57:132\u2013146","journal-title":"J Neurophysiol"},{"key":"805_CR54","first-page":"475","volume":"38","author":"PA Ortega","year":"2010","unstructured":"Ortega PA, Braun DA (2010) A minimum relative entropy principle for learning and acting. J Artif Int Res 38:475\u2013511","journal-title":"J Artif Int Res"},{"key":"805_CR55","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhx316","author":"T Parr","year":"2017","unstructured":"Parr T, Friston KJ (2017a) The computational anatomy of visual neglect. Cereb Cortex. \nhttps:\/\/doi.org\/10.1093\/cercor\/bhx316","journal-title":"Cereb Cortex"},{"key":"805_CR56","doi-asserted-by":"publisher","first-page":"20170376","DOI":"10.1098\/rsif.2017.0376","volume":"14","author":"T Parr","year":"2017","unstructured":"Parr T, Friston KJ (2017b) Uncertainty, epistemics and active inference. J R Soc Interface 14:20170376","journal-title":"J R Soc Interface"},{"key":"805_CR57","doi-asserted-by":"publisher","first-page":"14678","DOI":"10.1038\/s41598-017-15249-0","volume":"7","author":"T Parr","year":"2017","unstructured":"Parr T, Friston KJ (2017c) Working memory, attention, and salience in active inference. Sci Rep 7:14678. \nhttps:\/\/doi.org\/10.1038\/s41598-017-15249-0","journal-title":"Sci Rep"},{"key":"805_CR58","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/neco_a_01102","volume":"30","author":"T Parr","year":"2018","unstructured":"Parr T, Friston KJ (2018) The discrete and continuous brain: from decisions to movement\u2014and back again. Neural Comput 30:1\u201310","journal-title":"Neural Comput"},{"key":"805_CR59","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-019-05240-0","author":"T Parr","year":"2019","unstructured":"Parr T, Friston KJ (2019) The computational pharmacology of oculomotion. Psychopharmacology. \nhttps:\/\/doi.org\/10.1007\/s00213-019-05240-0","journal-title":"Psychopharmacology"},{"key":"805_CR60","doi-asserted-by":"publisher","DOI":"10.3389\/fnint.2018.00039","author":"T Parr","year":"2018","unstructured":"Parr T, Benrimoh D, Vincent P, Friston K (2018a) Precision and false perceptual inference. Front Integr Neurosci. \nhttps:\/\/doi.org\/10.3389\/fnint.2018.00039","journal-title":"Front Integr Neurosci"},{"key":"805_CR61","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2018.00061","author":"T Parr","year":"2018","unstructured":"Parr T, Rees G, Friston KJ (2018b) Computational neuropsychology and Bayesian inference. Front Hum Neurosci. \nhttps:\/\/doi.org\/10.3389\/fnhum.2018.00061","journal-title":"Front Hum Neurosci"},{"key":"805_CR62","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhz118","author":"T Parr","year":"2019","unstructured":"Parr T, Rikhye RV, Halassa MM, Friston KJ (2019) Prefrontal computation as active inference. Cereb Cortex. \nhttps:\/\/doi.org\/10.1093\/cercor\/bhz118","journal-title":"Cereb Cortex"},{"key":"805_CR63","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1007\/978-94-017-1735-9_12","volume-title":"Quantified representation of uncertainty and imprecision","author":"J Pearl","year":"1998","unstructured":"Pearl J (1998) Graphical models for probabilistic and causal reasoning. In: Smets P (ed) Quantified representation of uncertainty and imprecision. Springer Netherlands, Dordrecht, pp 367\u2013389. \nhttps:\/\/doi.org\/10.1007\/978-94-017-1735-9_12"},{"key":"805_CR64","volume-title":"Probabilistic reasoning in intelligent systems: networks of plausible inference","author":"J Pearl","year":"2014","unstructured":"Pearl J (2014) Probabilistic reasoning in intelligent systems: networks of plausible inference. Elsevier, Amsterdam"},{"key":"805_CR65","doi-asserted-by":"publisher","DOI":"10.1162\/cpsy_a_00016","author":"A Prosser","year":"2018","unstructured":"Prosser A, Friston KJ, Bakker N, Parr T (2018) A Bayesian account of psychopathy: a model of lacks remorse and self-aggrandizing. Comput Psychiatry. \nhttps:\/\/doi.org\/10.1162\/cpsy_a_00016","journal-title":"Comput Psychiatry"},{"key":"805_CR66","unstructured":"Rasmussen CE, Ghahramani Z (2001) Occam's razor, advances in neural information processing systems 13.  In: Leen TK, Dietterich TG, Tresp V (eds) Proceedings from the conference, neural information processing systems. \nhttps:\/\/papers.nips.cc\/book\/advances-in-neural-information-processing-systems-13-2000"},{"key":"805_CR67","doi-asserted-by":"crossref","unstructured":"Sales AC, Friston KJ, Jones MW, Pickering AE, Moran RJ (2018) Locus Coeruleus tracking of prediction errors optimises cognitive flexibility: an Active Inference model bioRxiv:340620","DOI":"10.1101\/340620"},{"key":"805_CR68","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.nlm.2013.12.008","volume":"117","author":"DL Schacter","year":"2015","unstructured":"Schacter DL, Benoit RG, De Brigard F, Szpunar KK (2015) Episodic future thinking and episodic counterfactual thinking: intersections between memory and decisions. Neurobiol Learn Mem 117:14\u201321. \nhttps:\/\/doi.org\/10.1016\/j.nlm.2013.12.008","journal-title":"Neurobiol Learn Mem"},{"key":"805_CR69","doi-asserted-by":"publisher","first-page":"3434","DOI":"10.1093\/cercor\/bhu159","volume":"25","author":"P Schwartenbeck","year":"2015","unstructured":"Schwartenbeck P, FitzGerald TH, Mathys C, Dolan R, Friston K (2015a) The dopaminergic midbrain encodes the expected certainty about desired outcomes. Cereb Cortex 25:3434\u20133445. \nhttps:\/\/doi.org\/10.1093\/cercor\/bhu159","journal-title":"Cereb Cortex"},{"key":"805_CR70","doi-asserted-by":"publisher","first-page":"16575","DOI":"10.1038\/srep16575","volume":"5","author":"P Schwartenbeck","year":"2015","unstructured":"Schwartenbeck P, FitzGerald TH, Mathys C, Dolan R, Kronbichler M, Friston K (2015b) Evidence for surprise minimization over value maximization in choice behavior. Sci Rep 5:16575. \nhttps:\/\/doi.org\/10.1038\/srep16575","journal-title":"Sci Rep"},{"key":"805_CR71","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.mehy.2014.12.007","volume":"84","author":"P Schwartenbeck","year":"2015","unstructured":"Schwartenbeck P, FitzGerald TH, Mathys C, Dolan R, Wurst F, Kronbichler M, Friston K (2015c) Optimal inference with suboptimal models: addiction and active Bayesian inference. Med Hypotheses 84:109\u2013117. \nhttps:\/\/doi.org\/10.1016\/j.mehy.2014.12.007","journal-title":"Med Hypotheses"},{"key":"805_CR72","first-page":"11","volume-title":"Active learning literature survey","author":"B Settles","year":"2010","unstructured":"Settles B (2010) Active learning literature survey, vol 52. University of Wisconsin, Madison, p 11"},{"key":"805_CR73","doi-asserted-by":"publisher","first-page":"R941","DOI":"10.1016\/j.cub.2011.10.030","volume":"21","author":"T Sharot","year":"2011","unstructured":"Sharot T (2011) The optimism bias. Curr Biol 21:R941\u2013R945. \nhttps:\/\/doi.org\/10.1016\/j.cub.2011.10.030","journal-title":"Curr Biol"},{"key":"805_CR74","doi-asserted-by":"publisher","first-page":"1477","DOI":"10.1016\/j.cub.2012.05.053","volume":"22","author":"T Sharot","year":"2012","unstructured":"Sharot T, Guitart-Masip M, Korn Christoph W, Chowdhury R, Dolan Raymond J (2012) How dopamine enhances an optimism bias in humans. Curr Biol 22:1477\u20131481. \nhttps:\/\/doi.org\/10.1016\/j.cub.2012.05.053","journal-title":"Curr Biol"},{"key":"805_CR75","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1080\/02664768700000020","volume":"14","author":"MC Shewry","year":"1987","unstructured":"Shewry MC, Wynn HP (1987) Maximum entropy sampling. J Appl Stat 14:165\u2013170. \nhttps:\/\/doi.org\/10.1080\/02664768700000020","journal-title":"J Appl Stat"},{"key":"805_CR76","unstructured":"Strens MJA (2000) A Bayesian framework for reinforcement learning. Paper presented at the proceedings of the seventeenth international conference on machine learning"},{"key":"805_CR77","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"1998","unstructured":"Sutton RS, Barto AG (1998) Reinforcement learning: an introduction, vol 1. MIT Press, Cambridge"},{"key":"805_CR78","doi-asserted-by":"crossref","unstructured":"Todorov E (2008) General duality between optimal control and estimation. In: IEEE conference on decision and control","DOI":"10.1109\/CDC.2008.4739438"},{"key":"805_CR79","doi-asserted-by":"crossref","unstructured":"Verma D, Rao RP (2006) Planning and acting in uncertain environments using probabilistic inference. In: 2006 IEEE\/RSJ international conference on intelligent robots and systems. IEEE, pp 2382\u20132387","DOI":"10.1109\/IROS.2006.281675"},{"key":"805_CR80","doi-asserted-by":"publisher","first-page":"e1007126","DOI":"10.1371\/journal.pcbi.1007126","volume":"15","author":"P Vincent","year":"2019","unstructured":"Vincent P, Parr T, Benrimoh D, Friston KJ (2019) With an eye on uncertainty: Modelling pupillary responses to environmental volatility. PLOS Comput Biol 15:e1007126. \nhttps:\/\/doi.org\/10.1371\/journal.pcbi.1007126","journal-title":"PLOS Comput Biol"},{"key":"805_CR81","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1214\/aoms\/1177730345","volume":"4","author":"A Wald","year":"1947","unstructured":"Wald A (1947) An essentially complete class of admissible decision functions. Ann Math Stat 4:549\u2013555. \nhttps:\/\/doi.org\/10.1214\/aoms\/1177730345","journal-title":"Ann Math Stat"},{"key":"805_CR82","unstructured":"Winn JM (2004) Variational message passing and its applications. Citeseer"},{"key":"805_CR83","first-page":"661","volume":"6","author":"J Winn","year":"2005","unstructured":"Winn J, Bishop CM (2005) Variational message passing. J Mach Learn Res 6:661\u2013694","journal-title":"J Mach Learn Res"},{"key":"805_CR84","doi-asserted-by":"publisher","first-page":"e12215","DOI":"10.7554\/elife.12215","volume":"5","author":"SC-H Yang","year":"2016","unstructured":"Yang SC-H, Lengyel M, Wolpert DM (2016a) Active sensing in the categorization of visual patterns. eLife 5:e12215. \nhttps:\/\/doi.org\/10.7554\/elife.12215","journal-title":"eLife"},{"key":"805_CR85","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.cobeha.2016.06.009","volume":"11","author":"SC-H Yang","year":"2016","unstructured":"Yang SC-H, Wolpert DM, Lengyel M (2016b) Theoretical perspectives on active sensing. Curr Opin Behav Sci 11:100\u2013108. \nhttps:\/\/doi.org\/10.1016\/j.cobeha.2016.06.009","journal-title":"Curr Opin Behav Sci"},{"key":"805_CR86","doi-asserted-by":"publisher","first-page":"2282","DOI":"10.1109\/TIT.2005.850085","volume":"51","author":"JS Yedidia","year":"2005","unstructured":"Yedidia JS, Freeman WT, Weiss Y (2005) Constructing free-energy approximations and generalized belief propagation algorithms. IEEE Trans Inf Theory 51:2282\u20132312","journal-title":"IEEE Trans Inf Theory"}],"container-title":["Biological Cybernetics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00422-019-00805-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s00422-019-00805-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s00422-019-00805-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,9,25]],"date-time":"2020-09-25T19:45:10Z","timestamp":1601063110000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s00422-019-00805-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,27]]},"references-count":86,"journal-issue":{"issue":"5-6","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["805"],"URL":"https:\/\/doi.org\/10.1007\/s00422-019-00805-w","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/304782","asserted-by":"object"}]},"ISSN":["0340-1200","1432-0770"],"issn-type":[{"value":"0340-1200","type":"print"},{"value":"1432-0770","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,27]]},"assertion":[{"value":"4 July 2017","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 September 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}