{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:32:21Z","timestamp":1760243541372,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2012,1,4]],"date-time":"2012-01-04T00:00:00Z","timestamp":1325635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>This paper discusses concepts of self-organized complexity and the theory of Coherent Infomax in the light of Jaynes\u2019s probability theory. Coherent Infomax, shows, in principle, how adaptively self-organized complexity can be preserved and improved by using probabilistic inference that is context-sensitive. It argues that neural systems do this by combining local reliability with flexible, holistic, context-sensitivity. Jaynes argued that the logic of probabilistic inference shows it to be based upon Bayesian and Maximum Entropy methods or special cases of them. He presented his probability theory as the logic of science; here it is considered as the logic of life. It is concluded that the theory of Coherent Infomax specifies a general objective for probabilistic inference, and that contextual interactions in neural systems perform functions required of the scientist within Jaynes\u2019s theory.<\/jats:p>","DOI":"10.3390\/info3010001","type":"journal-article","created":{"date-parts":[[2012,1,4]],"date-time":"2012-01-04T17:44:06Z","timestamp":1325699046000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Self-Organized Complexity and Coherent Infomax from the Viewpoint of Jaynes\u2019s Probability Theory"],"prefix":"10.3390","volume":"3","author":[{"given":"William A.","family":"Phillips","sequence":"first","affiliation":[{"name":"Department of Psychology, University of Stirling, Stirling FK9 4LA, UK"},{"name":"Frankfurt Institute of Advanced Studies, Frankfurt, 60438, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2012,1,4]]},"reference":[{"key":"ref_1","unstructured":"Bretthorst, G.L. (2003). Probability Theory: The Logic of Science, Cambridge University Press."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Engel, C., and Singer, W. (2008). Better than Conscious? , MIT Press.","DOI":"10.7551\/mitpress\/9780262195805.001.0001"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1088\/0954-898X_6_2_005","article-title":"The discovery of structure by multi-stream networks of local processors with contextual guidance","volume":"6","author":"Phillips","year":"1995","journal-title":"Netw. Comput. Neural Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/S0893-6080(97)00110-X","article-title":"Contextually guided unsupervised learning using local multivariate binary processors","volume":"11","author":"Kay","year":"1998","journal-title":"Neural Network."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1162\/neco.1997.9.4.895","article-title":"Activation functions, computational goals and learning rules for local processors with contextual guidance","volume":"9","author":"Kay","year":"1997","journal-title":"Neural Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1007\/s11538-010-9564-x","article-title":"Coherent Infomax as a computational goal for neural systems","volume":"73","author":"Kay","year":"2011","journal-title":"Bull. Math. Biol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1623","DOI":"10.4249\/scholarpedia.1623","article-title":"Complexity","volume":"2","author":"Sporns","year":"2007","journal-title":"Scholarpedia"},{"key":"ref_8","unstructured":"Rakic, P., and Singer, W. (1988). Neurobiology of Neocortex, John Wiley & Sons."},{"key":"ref_9","unstructured":"Rolston, H. (2010). Three Big Bangs: Matter-Energy, Life, Mind, Columbia University Press."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"von der Malsburg, C., Phillips, W.A., and Singer, W. (2010). Dynamic Coordination in the Brain: From Neurons to Mind, MIT Press.","DOI":"10.7551\/mitpress\/9780262014717.001.0001"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1038\/nrn2787","article-title":"The free-energy principle: A unified brain theory?","volume":"11","author":"Friston","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Finger, S. (1994). Origins of Neuroscience, Oxford University Press.","DOI":"10.1093\/oso\/9780195065039.001.0001"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1017\/S0140525X9700160X","article-title":"In search of common foundations for cortical computation","volume":"20","author":"Phillips","year":"1997","journal-title":"Behav. Brain Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"von der Malsburg, C., Phillips, W.A., and Singer, W. (2010). Dynamic Coordination in the Brain: From Neurons to Mind, MIT Press.","DOI":"10.7551\/mitpress\/9780262014717.001.0001"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1017\/S0140525X03000025","article-title":"Convergence of biological and psychological perspectives on cognitive coordination in schizophrenia","volume":"26","author":"Phillips","year":"2003","journal-title":"Behav. Brain Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1038\/355161a0","article-title":"A self-organizing neural network that discovers surfaces in random-dot stereograms","volume":"335","author":"Becker","year":"1992","journal-title":"Nature"},{"key":"ref_17","first-page":"041925","article-title":"Past-future information bottleneck in dynamical systems","volume":"79","author":"Creutzig","year":"2009","journal-title":"Phys. Rev."},{"key":"ref_18","unstructured":"Kelso, J.A.S. (1995). Dynamic Patterns: The Self-Organization of Brain and Behavior, MIT Press."},{"key":"ref_19","first-page":"1","article-title":"Learning with two sites of synaptic integration","volume":"11","year":"2000","journal-title":"Netw. Comput. Neural Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1177\/107385840100700512","article-title":"Gain modulation in the central nervous system: Where behavior, neurophysiology, and computation meet","volume":"7","author":"Salinas","year":"2001","journal-title":"Neuroscientist"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1016\/j.visres.2008.03.009","article-title":"Predictive-coding as a model of biased competition in visual attention","volume":"48","author":"Spratling","year":"2008","journal-title":"Vis. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1080\/13506280500168562","article-title":"A feedback model of perceptual learning and categorisation","volume":"13","author":"Spratling","year":"2006","journal-title":"Vis. Cogn."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/S1364-6613(98)01259-5","article-title":"Complexity and coherency: Integrating information in the brain","volume":"2","author":"Tononi","year":"1998","journal-title":"Trends Cogn. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e3298","DOI":"10.1371\/journal.pone.0003298","article-title":"Towards a general theory of neural computation based on prediction by single neurons","volume":"3","author":"Fiorillo","year":"2008","journal-title":"PLoS One"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1038\/nrn2787-c1","article-title":"A neurocentric approach to Bayesian inference","volume":"11","author":"Fiorillo","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fougere, P.H. (1990). Maximum Entropy and Bayesian Methods, Kluwer Academic Publishers.","DOI":"10.1007\/978-94-009-0683-9"},{"key":"ref_27","unstructured":"Levine, R.D., and Tribus, M. (1979). The Maximum Entropy Formalism, MIT Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1103\/PhysRev.106.620","article-title":"Information theory and statistical mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Phys. Rev."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1103\/PhysRev.108.171","article-title":"Information theory and statistical mechanics. II","volume":"108","author":"Jaynes","year":"1957","journal-title":"Phys. Rev."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s11229-007-9237-y","article-title":"Free-energy and the brain","volume":"159","author":"Friston","year":"2007","journal-title":"Synthese"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bellman, R.E. (1961). Adaptive Control Processes, Princeton University Press.","DOI":"10.1515\/9781400874668"},{"key":"ref_32","unstructured":"Rosenblith, W.A. (1961). Sensory Communication, MIT Press."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/2.36","article-title":"Self-organization in a perceptual network","volume":"21","author":"Linsker","year":"1988","journal-title":"Computer"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/0004-3702(92)90043-W","article-title":"From local to global consistency","volume":"55","author":"Dechter","year":"1992","journal-title":"Artif. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1038\/nrn2864","article-title":"Neuronal arithmetic","volume":"11","author":"Silver","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_36","first-page":"39","article-title":"A maximum entropy approach to natural language processing","volume":"22","author":"Berger","year":"1996","journal-title":"Comput. Linguist."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2322","DOI":"10.1093\/bioinformatics\/btm332","article-title":"Context-sensitive data integration and prediction of biological networks","volume":"23","author":"Myers","year":"2007","journal-title":"Bioinformatics"},{"key":"ref_38","first-page":"605","article-title":"New techniques for disambiguation in natural language and their application to biological text","volume":"5","author":"Ginter","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1017\/S0140525X09000284","article-title":"Bayesian rationality: The probabilistic approach to human reasoning","volume":"32","author":"Oaksford","year":"2009","journal-title":"Behav. Brain Sci."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1016\/j.tins.2004.10.007","article-title":"The Bayesian Brain: The role of uncertainty in neural coding and computation","volume":"27","author":"Knill","year":"2004","journal-title":"Trends Neurosci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1017\/S0140525X10003134","article-title":"Bayesian fundamentalism or enlightenment? On the explanatory status and theoretical contributions of Bayesian models to cognition","volume":"34","author":"Jones","year":"2011","journal-title":"Behav. Brain Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1038\/374227a0","article-title":"The major evolutionary transitions","volume":"374","author":"Smith","year":"1995","journal-title":"Nature"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Simeonov, P.L., Smith, L.S., and Ehresmann, A.C. (2011). Integral Biomathics: Tracing the Road to Reality, Springer.","DOI":"10.1007\/978-3-642-28111-2"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1017\/S0140525X04000184","article-title":"Hallucinations in schizophrenia, sensory impairment, and brain disease: A unifying model","volume":"27","author":"Berhendt","year":"2004","journal-title":"Behav. Brain Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1017\/S0140525X04380180","article-title":"Belief in the primacy of fantasy is misleading and unnecessary","volume":"27","author":"Phillips","year":"2004","journal-title":"Behav. Brain Sci."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Fiorillo, C.D. (2012). Beyond Bayes: On the need for a unified and Jaynesian definition of probability and information within neuroscience. Information, submitted for publication.","DOI":"10.3390\/info3020175"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/3\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:48:21Z","timestamp":1760219301000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/3\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,1,4]]},"references-count":46,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2012,3]]}},"alternative-id":["info3010001"],"URL":"https:\/\/doi.org\/10.3390\/info3010001","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2012,1,4]]}}}