{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:19:34Z","timestamp":1760239174479,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T00:00:00Z","timestamp":1603065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Seeking goals carried out by agents with a level of competency requires an \u201cunderstanding\u201d of the structure of their world. While abstract formal descriptions of a world structure in terms of geometric axioms can be formulated in principle, it is not likely that this is the representation that is actually employed by biological organisms or that should be used by biologically plausible models. Instead, we operate by the assumption that biological organisms are constrained in their information processing capacities, which in the past has led to a number of insightful hypotheses and models for biologically plausible behaviour generation. Here we use this approach to study various types of spatial categorizations that emerge through such informational constraints imposed on embodied agents. We will see that geometrically-rich spatial representations emerge when agents employ a trade-off between the minimisation of the Shannon information used to describe locations within the environment and the reduction of the location error generated by the resulting approximate spatial description. In addition, agents do not always need to construct these representations from the ground up, but they can obtain them by refining less precise spatial descriptions constructed previously. Importantly, we find that these can be optimal at both steps of refinement, as guaranteed by the successive refinement principle from information theory. Finally, clusters induced by these spatial representations via the information bottleneck method are able to reflect the environment\u2019s topology without relying on an explicit geometric description of the environment\u2019s structure. Our findings suggest that the fundamental geometric notions possessed by natural agents do not need to be part of their a priori knowledge but could emerge as a byproduct of the pressure to process information parsimoniously.<\/jats:p>","DOI":"10.3390\/e22101179","type":"journal-article","created":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T20:44:41Z","timestamp":1603140281000},"page":"1179","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Space Emerges from What We Know\u2014Spatial Categorisations Induced by Information Constraints"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0114-3041","authenticated-orcid":false,"given":"Nicola","family":"Catenacci Volpi","sequence":"first","affiliation":[{"name":"School of Engineering and Computer Science, University of Hertfordshire, Hatfield AL109AB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3233-5847","authenticated-orcid":false,"given":"Daniel","family":"Polani","sequence":"additional","affiliation":[{"name":"School of Engineering and Computer Science, University of Hertfordshire, Hatfield AL109AB, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/18.75242","article-title":"Successive Refinement of Information","volume":"37","author":"Equitz","year":"1991","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/S0004-3702(00)00017-5","article-title":"Spatial semantic hierarchy","volume":"119","author":"Kuipers","year":"2000","journal-title":"Artif. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1016\/S0959-4388(00)00237-3","article-title":"Energy as a constraint on the coding and processing of sensory information","volume":"11","author":"Laughlin","year":"2001","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"307","DOI":"10.2976\/1.3171566","article-title":"Information: Currency of Life?","volume":"3","author":"Polani","year":"2009","journal-title":"HFSP J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"20190295","DOI":"10.1098\/rsif.2019.0295","article-title":"Magnetoreception in birds","volume":"16","author":"Wiltschko","year":"2019","journal-title":"J. R. Soc. Interface"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.jtbi.2003.07.003","article-title":"Positional entropy during pigeon homing II: Navigational interpretation of Bayesian latent state models","volume":"227","author":"Guilford","year":"2004","journal-title":"J. Theor. Biol."},{"key":"ref_7","first-page":"443","article-title":"Nautical Cartography and Traditional Navigation in Oceania","volume":"Volume 2","author":"Woodward","year":"1998","journal-title":"Cartography in the Traditional African, American, Arctic, Australian, and Pacific Societies"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1017\/S0140525X01000115","article-title":"A sensorimotor account of vision and visual consciousness","volume":"24","year":"2001","journal-title":"Behav. Brain Sci."},{"key":"ref_9","unstructured":"Philipona, D., O\u2019Regan, J.K., Nadal, J.P., and Coenen, O.J. (2004, January 13\u201318). Perception of the structure of the physical world using unknown multimodal sensors and effectors. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Terekhov, A.V., and O\u2019Regan, J.K. (2016). Space as an invention of active agents. Front. Robot. AI, 3.","DOI":"10.3389\/frobt.2016.00004"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.neunet.2018.06.001","article-title":"Discovering space\u2014Grounding spatial topology and metric regularity in a naive agent\u2019s sensorimotor experience","volume":"105","author":"Gas","year":"2018","journal-title":"Neural Netw."},{"key":"ref_12","unstructured":"Von Uexk\u00fcll, J. (1956). Streifz\u00fcge Durch die Umwelten von Tieren und Menschen, Rowohlt."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Haun, A., and Tononi, G. (2019). Why does space feel theway it does? Towards a principled account of spatial experience. Entropy, 21.","DOI":"10.3390\/e21121160"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1038\/381425a0","article-title":"Geometric determinants of the place fields of hippocampal neurons","volume":"381","author":"Burgess","year":"1996","journal-title":"Nature"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1162\/089976698300017908","article-title":"The Role of the Hippocampus in Solving the Morris Water Maze","volume":"10","author":"Redish","year":"1998","journal-title":"Neural Comput."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Gustafson, N.J., and Daw, N.D. (2011). Grid cells, place cells, and geodesic generalization for spatial reinforcement learning. PLoS Comput. Biol., 7.","DOI":"10.1371\/journal.pcbi.1002235"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1162\/neco.1993.5.4.613","article-title":"Improving Generalization for Temporal Difference Learning: The Successor Representation","volume":"5","author":"Dayan","year":"1993","journal-title":"Neural Comput."},{"key":"ref_18","unstructured":"Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.D., and Weinberger, K.Q. (2014). Design Principles of the Hippocampal Cognitive Map. Advances in Neural Information Processing Systems 27, Curran Associates, Inc."},{"key":"ref_19","unstructured":"Rocha, L.M., Bedau, M., Floreano, D., Goldstone, R., Vespignani, A., and Yaeger, L. (2006). Relevant Information in Optimized Persistence vs. Progeny Strategies. Artificial Life X, The MIT Press."},{"key":"ref_20","unstructured":"Kappen, B., Gomez, V., and Opper, M. (2009). Optimal control as a graphical model inference problem. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1613\/jair.3062","article-title":"A Minimum Relative Entropy Principle for Learning and Acting","volume":"38","author":"Braun","year":"2010","journal-title":"J. Artif. Intell. Res."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cutsuridis, V., Hussain, A., and Taylor, J. (2011). Information Theory of Decisions and Actions. Perception-Action Cycle: Models, Architecture and Hardware, Springer.","DOI":"10.1007\/978-1-4419-1452-1"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ortega, P.A., and Braun, D.A. (2013). Thermodynamics as a theory of decision-making with information-processing costs. Proc. R. Soc. A, 469.","DOI":"10.1098\/rspa.2012.0683"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3389\/frobt.2015.00027","article-title":"Bounded Rationality, Abstraction, and Hierarchical Decision-Making: An Information-Theoretic Optimality Principle","volume":"2","author":"Genewein","year":"2015","journal-title":"Front. Robot. AI"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1038\/236","article-title":"The metabolic cost of neural information","volume":"1","author":"Laughlin","year":"1998","journal-title":"Nat. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.tics.2009.04.005","article-title":"The free-energy principle: A rough guide to the brain?","volume":"13","author":"Friston","year":"2009","journal-title":"Trends Cogn. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Berger, T. (2003). Rate-distortion theory. Wiley Encyclopedia of Telecommunications, John Wiley & Sons, Inc.","DOI":"10.1002\/0471219282.eot142"},{"key":"ref_28","unstructured":"Tishby, N., Pereira, F.C., and Bialek, W. (2000). The information bottleneck method. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_30","unstructured":"Cover, T.M., and Thomas, J.A. (2012). Elements of Information Theory, John Wiley & Sons, Inc."},{"key":"ref_31","first-page":"1","article-title":"Coding theorems for a discrete source with a fidelity criterion","volume":"4","author":"Shannon","year":"1959","journal-title":"IRE Nat. Conv. Rec."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/TIT.1972.1054753","article-title":"An algorithm for computing the capacity of arbitrary discrete memoryless channels","volume":"18","author":"Arimoto","year":"1972","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TIT.1972.1054855","article-title":"Computation of channel capacity and rate-distortion functions","volume":"18","author":"Blahut","year":"1972","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2696","DOI":"10.1016\/j.tcs.2010.04.006","article-title":"Learning and generalization with the information bottleneck","volume":"411","author":"Shamir","year":"2010","journal-title":"Theor. Comput. Sci."},{"key":"ref_35","unstructured":"Slonim, N., and Tishby, N. (2000, January 5\u20138). Agglomerative information bottleneck. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1038\/46737","article-title":"The origins of insect metamorphosis","volume":"401","author":"Truman","year":"1999","journal-title":"Nature"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1016\/j.neuroimage.2018.10.019","article-title":"First-year development of modules and hubs in infant brain functional networks","volume":"185","author":"Wen","year":"2019","journal-title":"Neuroimage"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"van Dijk, S., and Polani, D. (2013). Informational Constraints-Driven Organization in Goal-Directed Behavior. Adv. Complex Syst., 16.","DOI":"10.1142\/S0219525913500161"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1179\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:24:10Z","timestamp":1760178250000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1179"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,19]]},"references-count":38,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["e22101179"],"URL":"https:\/\/doi.org\/10.3390\/e22101179","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2020,10,19]]}}}