{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:33:21Z","timestamp":1760243601189,"version":"build-2065373602"},"reference-count":61,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2012,4,20]],"date-time":"2012-04-20T00:00:00Z","timestamp":1334880000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>It has been proposed that the general function of the brain is inference, which corresponds quantitatively to the minimization of uncertainty (or the maximization of information). However, there has been a lack of clarity about exactly what this means. Efforts to quantify information have been in agreement that it depends on probabilities (through Shannon entropy), but there has long been a dispute about the definition of probabilities themselves. The \u201cfrequentist\u201d view is that probabilities are (or can be) essentially equivalent to frequencies, and that they are therefore properties of a physical system, independent of any observer of the system. E.T. Jaynes developed the alternate \u201cBayesian\u201d definition, in which probabilities are always conditional on a state of knowledge through the rules of logic, as expressed in the maximum entropy principle. In doing so, Jaynes and others provided the objective means for deriving probabilities, as well as a unified account of information and logic (knowledge and reason). However, neuroscience literature virtually never specifies any definition of probability, nor does it acknowledge any dispute concerning the definition. Although there has recently been tremendous interest in Bayesian approaches to the brain, even in the Bayesian literature it is common to find probabilities that are purported to come directly and unconditionally from frequencies. As a result, scientists have mistakenly attributed their own information to the neural systems they study. Here I argue that the adoption of a strictly Jaynesian approach will prevent such errors and will provide us with the philosophical and mathematical framework that is needed to understand the general function of the brain. Accordingly, our challenge becomes the identification of the biophysical basis of Jaynesian information and logic. I begin to address this issue by suggesting how we might identify a probability distribution over states of one physical system (an \u201cobject\u201d) conditional only on the biophysical state of another physical system (an \u201cobserver\u201d). The primary purpose in doing so is not to characterize information and inference in exquisite, quantitative detail, but to be as clear and precise as possible about what it means to perform inference and how the biophysics of the brain could achieve this goal.<\/jats:p>","DOI":"10.3390\/info3020175","type":"journal-article","created":{"date-parts":[[2012,4,20]],"date-time":"2012-04-20T11:01:48Z","timestamp":1334919708000},"page":"175-203","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Beyond Bayes: On the Need for a Unified and Jaynesian Definition of Probability and Information within Neuroscience"],"prefix":"10.3390","volume":"3","author":[{"given":"Christopher D.","family":"Fiorillo","sequence":"first","affiliation":[{"name":"Department of Bio and Brain Engineering, KAIST, Daejeon 305-701, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2012,4,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_2","unstructured":"Kandel, E.R., Schwartz, J.H., and Jessel, T.M. (2000). Principles of Neural Science, McGraw-Hill. [4th]."},{"key":"ref_3","unstructured":"Dayan, P., and Abbott, L.F. (2001). Theoretical Neuroscience, MIT Press."},{"key":"ref_4","unstructured":"Yantis, S. (2001). Treatise on Physiological Optics, 1896; Reprinted in Visual Perception, Psychology Press."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"e3298","DOI":"10.1371\/journal.pone.0003298","article-title":"Towards a general theory of neural computation based on prediction by single neurons","volume":"3","author":"Fiorillo","year":"2008","journal-title":"PLoS One"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free energy principle: A unified brain theory?","volume":"11","author":"Friston","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1098\/rstb.1980.0090","article-title":"Perceptions as hypotheses","volume":"290","author":"Gregory","year":"1980","journal-title":"Philos. Trans. R. Soc. Lond. B"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1880","DOI":"10.1126\/science.7569931","article-title":"An internal model for sensorimotor integration","volume":"269","author":"Wolpert","year":"1995","journal-title":"Science"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Knill, D.C., and Richards, R.W. (1996). Perception as Bayesian Inference, Cambridge University Press.","DOI":"10.1017\/CBO9780511984037"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1599","DOI":"10.1126\/science.275.5306.1599","article-title":"Language acquisition and use: Learning and applying probabilistic constraints","volume":"275","author":"Seidenberg","year":"1997","journal-title":"Science"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1098\/rstb.1997.0095","article-title":"Knowledge in perception and illusion","volume":"352","author":"Gregory","year":"1997","journal-title":"Philos. Trans. R. Soc. Lond. B"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1038\/nn0602-858","article-title":"Motion illusions as optimal percepts","volume":"5","author":"Weiss","year":"2002","journal-title":"Nat. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/415429a","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"Ernst","year":"2002","journal-title":"Nature"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Rao, R.P.N., Olshausen, B.A., and Lewicki, M.S. (2002). Probabilistic Models of the Brain: Perception and Neural Function, MIT Press.","DOI":"10.7551\/mitpress\/5583.001.0001"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1038\/nn1059","article-title":"A statistical explanation of visual space","volume":"6","author":"Yang","year":"2003","journal-title":"Nat. Neurosci."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Purves, D., and Lotto, R.B. (2003). Why We See What We Do: An Empirical Theory of Vision, Sinauer Associates Inc.","DOI":"10.1511\/2002.9.236"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1038\/nature01439","article-title":"Optimal transsaccadic integration explains distorted spatial perception","volume":"422","author":"Niemeier","year":"2003","journal-title":"Nature"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1038\/nn1026","article-title":"A motor learning strategy reflects neural circuitry for limb control","volume":"6","author":"Singh","year":"2003","journal-title":"Nat. Neurosci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1038\/nature02169","article-title":"Bayesian integration in sensorimotor learning","volume":"427","author":"Kording","year":"2004","journal-title":"Nature"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4188","DOI":"10.1523\/JNEUROSCI.4747-05.2006","article-title":"Why does the brain predict sensory consequences of oculomotor commands? Optimal integration of the predicted and the actual sensory feedback","volume":"26","author":"Vaziri","year":"2006","journal-title":"J. Neurosci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"866","DOI":"10.1016\/j.jtbi.2006.01.017","article-title":"Comparison of Bayesian and empirical ranking approaches to visual perception","volume":"241","author":"Howe","year":"2006","journal-title":"J. Theor. Biol."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Oaksford, M., and Chater, N. (2007). Bayesian Rationality: The Probabilistic Approach to Human Reasoning, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780198524496.001.0001"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1017\/S0140525X09000284","article-title":"Precis of bayesian rationality: The probabilistic approach to human reasoning","volume":"32","author":"Oaksford","year":"2009","journal-title":"Behav. Brain Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e15554","DOI":"10.1371\/journal.pone.0015554","article-title":"Observing the observer (I): meta-Bayesian models of learning and decision making","volume":"5","author":"Daunizeau","year":"2010","journal-title":"PLoS One"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"15588","DOI":"10.1073\/pnas.1012178108","article-title":"Understanding vision in wholly empirical terms","volume":"108","author":"Purves","year":"2011","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_26","unstructured":"Purves, D., and Lotto, R.B. (2011). Why We See What We Do Redux, Sinauer Associates Inc."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1038\/35039062","article-title":"Information processing with population codes","volume":"1","author":"Pouget","year":"2000","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1038\/90541","article-title":"Efficient computation and cue integration with noisy population codes","volume":"4","author":"Deneve","year":"2001","journal-title":"Nat. Neurosci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1038\/nn1790","article-title":"Bayesian inference with probabilistic population codes","volume":"9","author":"Ma","year":"2006","journal-title":"Nat. Neurosci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1038\/nn1691","article-title":"Optimal representations of sensory information by neural populations","volume":"9","author":"Jazayeri","year":"2006","journal-title":"Nat. Neurosci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1016\/j.neuron.2008.09.021","article-title":"Probabilistic population codes for Bayesian decision making","volume":"60","author":"Beck","year":"2008","journal-title":"Neuron"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1162\/neco.2008.20.1.91","article-title":"Bayesian spiking neurons I: Inference","volume":"20","author":"Deneve","year":"2008","journal-title":"Neural Comput."},{"key":"ref_33","unstructured":"Rieke, F., Warland, D., de Ruyter van Steveninck, R.R., and Bialek, W. (1997). Spikes: Exploring the Neural Code, MIT Press."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1103\/PhysRev.106.620","article-title":"Information theory and statistical mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Phys. Rev."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Jaynes, E.T. (2003). Probability Theory: The Logic of Science, Cambridge University Press.","DOI":"10.1017\/CBO9780511790423"},{"key":"ref_36","unstructured":"Laplace, P.S. (1819). Essai Philosophique sur les Probabiliti\u00e9s, Courier Imprimeur."},{"key":"ref_37","unstructured":"Feller, W. (1950). An Introduction to Probability Theory and its Applications, Wiley."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1038\/350371a0","article-title":"Bayesian reasoning in science","volume":"350","author":"Howson","year":"1991","journal-title":"Nature"},{"key":"ref_39","unstructured":"Rosenblith, W.A. (1961). Sensory Communication, MIT Press."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1038\/379642a0","article-title":"The rate of information transfer at graded potential synapses","volume":"379","author":"Laughlin","year":"1996","journal-title":"Nature"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1016\/S0896-6273(00)80335-9","article-title":"The efficiency of sensory information coding by mechanoreceptor neurons","volume":"18","author":"Juusola","year":"1997","journal-title":"Neuron"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1016\/S0896-6273(00)81205-2","article-title":"Adaptive rescaling maximizes information transmission","volume":"26","author":"Brenner","year":"2000","journal-title":"Neuron"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1038\/35090500","article-title":"Efficiency and ambiguity in an adaptive neural code","volume":"412","author":"Fairhall","year":"2001","journal-title":"Nature"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1146\/annurev.neuro.24.1.1193","article-title":"Natural image statistics and neural representation","volume":"24","author":"Simoncelli","year":"2001","journal-title":"Ann. Rev. Neurosci."},{"key":"ref_45","unstructured":"Mishara, A., Corlett, P., Fletcher, P., and Schwartz, M. (2012). The Bayesian Self and Its Disruption in Psychosis. In Phenomenological Neuropsychiatry: How Patient Experience Bridges Clinic with Clinical Neuroscience, Springer-Verlag. in press."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Fiorillo, C.D. (2010). A neurocentric approach to bayesian inference. Nat. Rev. Neurosci.","DOI":"10.1038\/nrn2787-c1"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Friston, K. (2010). Is the free-energy principle neurocentric?. Nat. Rev. Neurosci.","DOI":"10.1038\/nrn2787-c2"},{"key":"ref_48","unstructured":"MacKay, D.J.C. (2003). Information Theory, Inference, and Learning Algorithms, Cambridge University Press."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Trappenberg, T.P. (2010). Fundamentals of Computational Neuroscience, 2nd ed, Oxford University Press.","DOI":"10.1093\/oso\/9780199568413.001.0001"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3801","DOI":"10.1098\/rstb.2008.0152","article-title":"Explicit neural signals reflecting reward uncertainty","volume":"363","author":"Schultz","year":"2008","journal-title":"Philos. Trans. R. Soc. B"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.neuron.2005.04.026","article-title":"Uncertainty, neuromodulation, and attention","volume":"46","author":"Yu","year":"2006","journal-title":"Neuron"},{"key":"ref_52","unstructured":"Zurek, W.H. (1990). Complexity, Entropy, and the Physics of Information, Addison-Wesley. (Revised and extended version available online: http:\/\/bayes.wustl.edu\/etj\/node1.html)."},{"key":"ref_53","unstructured":"Hille, B. (2001). Ionic Channels of Excitable Membranes,3rd ed., Sinauer Associates Inc."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"3870","DOI":"10.1523\/JNEUROSCI.18-10-03870.1998","article-title":"The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding","volume":"18","author":"Shadlen","year":"1998","journal-title":"J. Neurosci."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1038\/nature09086","article-title":"Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex","volume":"466","author":"London","year":"2010","journal-title":"Nature"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3390\/info3010001","article-title":"Self-organized complexity and Coherent Infomax from the viewpoint of Jaynes\u2019s probability theory","volume":"3","author":"Phillips","year":"2012","journal-title":"Information"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1007\/s11538-010-9564-x","article-title":"Coherent Infomax as a computational goal for neural systems","volume":"73","author":"Kay","year":"2011","journal-title":"Bull. Math. Biol."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"10749","DOI":"10.1073\/pnas.90.22.10749","article-title":"Simple models for reading neural population codes","volume":"90","author":"Seung","year":"1993","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"2790","DOI":"10.1152\/jn.1996.76.4.2790","article-title":"Probability density estimation for the interpretation of neural population codes","volume":"76","author":"Sanger","year":"1996","journal-title":"J. Neurophysiol."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1016\/j.tins.2004.10.007","article-title":"The Bayesian brain: The role of uncertainty in neural coding and computation","volume":"27","author":"Knill","year":"2004","journal-title":"Trends Neurosci."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Simeonov, P.L., Smith, L.S., and Ehresmann, A.C. (2012). Integral Biomathics: Tracing the Road to Reality, Springer-Verlag.","DOI":"10.1007\/978-3-642-28111-2"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/3\/2\/175\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:49:55Z","timestamp":1760219395000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/3\/2\/175"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,4,20]]},"references-count":61,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2012,6]]}},"alternative-id":["info3020175"],"URL":"https:\/\/doi.org\/10.3390\/info3020175","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2012,4,20]]}}}