{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T05:10:35Z","timestamp":1772773835851,"version":"3.50.1"},"reference-count":58,"publisher":"Public Library of Science (PLoS)","issue":"5","license":[{"start":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T00:00:00Z","timestamp":1747008000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["952215"],"award-info":[{"award-number":["952215"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["820213"],"award-info":[{"award-number":["820213"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100031478","name":"Next Generation EU","doi-asserted-by":"crossref","award":["IR0000011\u2013EBRAINS-Italy"],"award-info":[{"award-number":["IR0000011\u2013EBRAINS-Italy"]}],"id":[{"id":"10.13039\/100031478","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100031478","name":"Next generation EU","doi-asserted-by":"crossref","award":["PE0000013-FAIR"],"award-info":[{"award-number":["PE0000013-FAIR"]}],"id":[{"id":"10.13039\/100031478","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100031478","name":"Next generation EU","doi-asserted-by":"crossref","award":["PE0000006-MNESYS"],"award-info":[{"award-number":["PE0000006-MNESYS"]}],"id":[{"id":"10.13039\/100031478","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100021856","name":"Ministero dell'Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["P20224FESY"],"award-info":[{"award-number":["P20224FESY"]}],"id":[{"id":"10.13039\/501100021856","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Living organisms rely on internal models of the world to act adaptively. These models, because of resource limitations, cannot encode every detail and hence need to compress information. From a cognitive standpoint, information compression can manifest as a distortion of latent representations, resulting in the emergence of representations that may not accurately reflect the external world or its geometry. Rate-distortion theory formalizes the optimal way to compress information while minimizing such distortions, by considering factors such as capacity limitations, the frequency and the utility of stimuli. However, while this theory explains why the above factors distort latent representations, it does not specify which specific distortions they produce. To address this question, here we investigate how rate-distortion trade-offs shape the latent representations of images in generative models, specifically Beta Variational Autoencoders (<jats:inline-formula id=\"pcbi.1012952.e001\"><jats:alternatives><jats:graphic xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" id=\"pcbi.1012952.e001g\" mimetype=\"image\" position=\"anchor\" xlink:href=\"info:doi\/10.1371\/journal.pcbi.1012952.e001\" xlink:type=\"simple\"\/><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\" id=\"M1\"><mml:mrow><mml:mi>\u03b2<\/mml:mi><\/mml:mrow><\/mml:math><\/jats:alternatives><\/jats:inline-formula>-VAEs), under varying constraints of model capacity, data distributions, and task objectives. By systematically exploring these factors, we identify three primary distortions in latent representations: prototypization, specialization, and orthogonalization. These distortions emerge as signatures of information compression, reflecting the model\u2019s adaptation to capacity limitations, data imbalances, and task demands. Additionally, our findings demonstrate that these distortions can coexist, giving rise to a rich landscape of latent spaces, whose geometry could differ significantly across generative models subject to different constraints. Our findings contribute to explain how the normative constraints of rate-distortion theory shape the geometry of latent representations of generative models of artificial systems and living organisms.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012952","type":"journal-article","created":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T17:29:08Z","timestamp":1747070948000},"page":"e1012952","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":3,"title":["The geometry of efficient codes: How rate-distortion trade-offs distort the latent representations of generative models"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-4531-5486","authenticated-orcid":true,"given":"Leo","family":"D\u2019Amato","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-6665-1419","authenticated-orcid":true,"given":"Gian","family":"Luca Lancia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6813-8282","authenticated-orcid":true,"given":"Giovanni","family":"Pezzulo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2025,5,12]]},"reference":[{"issue":"17","key":"pcbi.1012952.ref001","doi-asserted-by":"crossref","DOI":"10.1016\/j.cub.2022.06.090","article-title":"Predictive maps in rats and humans for spatial navigation","volume":"32","author":"W De Cothi","year":"2022","journal-title":"Curr Biol"},{"issue":"11","key":"pcbi.1012952.ref002","doi-asserted-by":"crossref","first-page":"1504","DOI":"10.1038\/nn.4656","article-title":"The cognitive map in humans: spatial navigation and beyond","volume":"20","author":"RA Epstein","year":"2017","journal-title":"Nat Neurosci"},{"issue":"1","key":"pcbi.1012952.ref003","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1038\/236","article-title":"The metabolic cost of neural information","volume":"1","author":"SB Laughlin","year":"1998","journal-title":"Nat Neurosci"},{"issue":"01","key":"pcbi.1012952.ref004","first-page":"217","article-title":"Possible principles underlying the transformation of sensory messages. Sens Commun","volume":"1","author":"HB Barlow","year":"1961"},{"issue":"6583","key":"pcbi.1012952.ref005","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1038\/381607a0","article-title":"Emergence of simple-cell receptive field properties by learning a sparse code for natural images","volume":"381","author":"BA Olshausen","year":"1996","journal-title":"Nature"},{"issue":"5","key":"pcbi.1012952.ref006","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1037\/rev0000197","article-title":"Efficient data compression in perception and perceptual memory","volume":"127","author":"CJ Bates","year":"2020","journal-title":"Psychol Rev"},{"issue":"3","key":"pcbi.1012952.ref007","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1037\/h0054663","article-title":"Some informational aspects of visual perception","volume":"61","author":"F Attneave","year":"1954","journal-title":"Psychol Rev"},{"key":"pcbi.1012952.ref008","doi-asserted-by":"crossref","first-page":"458","DOI":"10.1007\/978-3-642-80885-2_27","article-title":"Redundancy and perception.","volume-title":"Physics and mathematics of the nervous system: Proceedings of a summer school organized by the International Centre for Theoretical Physics, Trieste, and the Institute for Information Sciences, University of T\u00fcbingen, held at Trieste","author":"H Barlow","year":"1974"},{"key":"pcbi.1012952.ref009","article-title":"Rate-distortion theory of neural coding and its implications for working memory","volume":"12","author":"AMV Jakob","year":"2023","journal-title":"Elife"},{"key":"pcbi.1012952.ref010","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1146\/annurev.ne.18.030195.001205","article-title":"Neural mechanisms of selective visual attention","volume":"18","author":"R Desimone","year":"1995","journal-title":"Annu Rev Neurosci"},{"issue":"4","key":"pcbi.1012952.ref011","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1037\/a0016797","article-title":"Compression in visual working memory: using statistical regularities to form more efficient memory representations","volume":"138","author":"TF Brady","year":"2009","journal-title":"J Exp Psychol Gen"},{"issue":"3","key":"pcbi.1012952.ref012","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cognition.2011.11.003","article-title":"What\u2019s magic about magic numbers? Chunking and data compression in short-term memory","volume":"122","author":"F Mathy","year":"2012","journal-title":"Cognition"},{"issue":"1","key":"pcbi.1012952.ref013","doi-asserted-by":"crossref","first-page":"16162","DOI":"10.1038\/s41598-018-34282-1","article-title":"Strategic allocation of working memory resource","volume":"8","author":"AH Yoo","year":"2018","journal-title":"Sci Rep"},{"issue":"1","key":"pcbi.1012952.ref014","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1111\/j.1467-8306.1989.tb00253.x","article-title":"Cognitive maps: encoding and decoding information","volume":"79","author":"R Lloyd","year":"1989","journal-title":"Annals of the Association of American Geographers"},{"issue":"2","key":"pcbi.1012952.ref015","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/0016-7185(92)90011-R","article-title":"Distortions in cognitive maps","volume":"23","author":"B Tversky","year":"1992","journal-title":"Geoforum"},{"key":"pcbi.1012952.ref016","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.cobeha.2021.02.015","article-title":"Resource-rational decision making","volume":"41","author":"R Bhui","year":"2021","journal-title":"Current Opinion in Behavioral Sciences"},{"issue":"2","key":"pcbi.1012952.ref017","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1111\/tops.12086","article-title":"Computational rationality: linking mechanism and behavior through bounded utility maximization","volume":"6","author":"RL Lewis","year":"2014","journal-title":"Top Cogn Sci"},{"issue":"6245","key":"pcbi.1012952.ref018","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1126\/science.aac6076","article-title":"Computational rationality: A converging paradigm for intelligence in brains, minds, and machines","volume":"349","author":"SJ Gershman","year":"2015","journal-title":"Science"},{"issue":"2","key":"pcbi.1012952.ref019","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/tops.12142","article-title":"Rational use of cognitive resources: levels of analysis between the computational and the algorithmic","volume":"7","author":"TL Griffiths","year":"2015","journal-title":"Top Cogn Sci"},{"key":"pcbi.1012952.ref020","author":"N Tishby","year":"2000"},{"key":"pcbi.1012952.ref021","doi-asserted-by":"crossref","first-page":"7900","DOI":"10.1038\/ncomms8900","article-title":"Optimal speed estimation in natural image movies predicts human performance","volume":"6","author":"J Burge","year":"2015","journal-title":"Nat Commun"},{"key":"pcbi.1012952.ref022","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.jenvp.2017.12.004","article-title":"Geometrical distortions in geographical cognitive maps","volume":"55","author":"M Costa","year":"2018","journal-title":"J Environ Psychol"},{"issue":"2","key":"pcbi.1012952.ref023","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2002232118","article-title":"Optimal utility and probability functions for agents with finite computational precision","volume":"118","author":"K Juechems","year":"2021","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"1","key":"pcbi.1012952.ref024","doi-asserted-by":"crossref","first-page":"3366","DOI":"10.1038\/s41467-019-11298-3","article-title":"Error-correcting dynamics in visual working memory","volume":"10","author":"MF Panichello","year":"2019","journal-title":"Nat Commun"},{"key":"pcbi.1012952.ref025","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.32055","article-title":"Adaptive coding for dynamic sensory inference","volume":"7","author":"WF M\u0142ynarski","year":"2018","journal-title":"Elife"},{"issue":"23","key":"pcbi.1012952.ref026","article-title":"Goal-seeking compresses neural codes for space in the human hippocampus and orbitofrontal cortex","volume":"111","author":"PS Muhle-Karbe","year":"2023","journal-title":"Neuron"},{"issue":"7","key":"pcbi.1012952.ref027","doi-asserted-by":"crossref","first-page":"1135","DOI":"10.1038\/s41562-023-01584-y","article-title":"Sensory perception relies on fitness-maximizing codes","volume":"7","author":"J Schaffner","year":"2023","journal-title":"Nat Hum Behav"},{"issue":"15","key":"pcbi.1012952.ref028","doi-asserted-by":"crossref","DOI":"10.1126\/sciadv.abd5363","article-title":"How usefulness shapes neural representations during goal-directed behavior","volume":"7","author":"G Castegnetti","year":"2021","journal-title":"Sci Adv"},{"issue":"1","key":"pcbi.1012952.ref029","doi-asserted-by":"crossref","first-page":"2128","DOI":"10.1038\/s41467-020-15989-0","article-title":"Attention amplifies neural representations of changes in sensory input at the expense of perceptual accuracy","volume":"11","author":"V Mehrpour","year":"2020","journal-title":"Nat Commun"},{"key":"pcbi.1012952.ref030","first-page":"2021","article-title":"Visuomotor association orthogonalizes visual cortical population codes","author":"SW Failor","year":"2021","journal-title":"bioRxiv"},{"key":"pcbi.1012952.ref031","first-page":"1","article-title":"Coding theorems for a discrete source with a fidelity criterion. IRE Nat Conv Rec","volume":"4","author":"CE Shannon","year":"1959"},{"issue":"4","key":"pcbi.1012952.ref032","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1037\/a0029856","article-title":"An ideal observer analysis of visual working memory","volume":"119","author":"CR Sims","year":"2012","journal-title":"Psychol Rev"},{"issue":"3","key":"pcbi.1012952.ref033","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1167\/15.3.2","article-title":"The cost of misremembering: Inferring the loss function in visual working memory","volume":"15","author":"CR Sims","year":"2015","journal-title":"J Vis"},{"issue":"10","key":"pcbi.1012952.ref034","article-title":"Optimal forgetting: Semantic compression of episodic memories","volume":"16","author":"DG Nagy","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1012952.ref035","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.cognition.2016.03.020","article-title":"Rate-distortion theory and human perception","volume":"152","author":"CR Sims","year":"2016","journal-title":"Cognition"},{"issue":"6389","key":"pcbi.1012952.ref036","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1126\/science.aaq1118","article-title":"Efficient coding explains the universal law of generalization in human perception","volume":"360","author":"CR Sims","year":"2018","journal-title":"Science"},{"issue":"3","key":"pcbi.1012952.ref037","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1016\/S0304-3932(03)00029-1","article-title":"Implications of rational inattention","volume":"50","author":"CA Sims","year":"2003","journal-title":"Journal of Monetary Economics"},{"issue":"2","key":"pcbi.1012952.ref038","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1167\/19.2.11","article-title":"Adaptive allocation of human visual working memory capacity during statistical and categorical learning","volume":"19","author":"CJ Bates","year":"2019","journal-title":"J Vis"},{"issue":"5","key":"pcbi.1012952.ref039","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1167\/jov.21.5.3","article-title":"Optimal attentional allocation in the presence of capacity constraints in uncued and cued visual search","volume":"21","author":"CJ Bates","year":"2021","journal-title":"J Vis"},{"key":"pcbi.1012952.ref040","doi-asserted-by":"crossref","first-page":"104394","DOI":"10.1016\/j.cognition.2020.104394","article-title":"Origin of perseveration in the trade-off between reward and complexity","volume":"204","author":"SJ Gershman","year":"2020","journal-title":"Cognition"},{"key":"pcbi.1012952.ref041","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/bs.plm.2021.02.004","article-title":"Policy compression: An information bottleneck in action selection","volume-title":"Psychology of Learning and Motivation","author":"L Lai","year":"2021"},{"key":"pcbi.1012952.ref042","unstructured":"Higgins I, Matthey L, Pal A, Burgess C, Glorot X, Botvinick M. Beta-vae: learning basic visual concepts with a constrained variational framework. ICLR. 2017;3."},{"key":"pcbi.1012952.ref043","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1007\/s10472-021-09728-4","article-title":"Interpreting rate-distortion of variational autoencoder and using model uncertainty for anomaly detection","volume":"90","author":"S Park","year":"2021","journal-title":"Ann Math Artif Intell"},{"key":"pcbi.1012952.ref044","article-title":"Understanding disentangling in -VAE","author":"CP Burgess","year":"2018","journal-title":"arXiv"},{"issue":"6631","key":"pcbi.1012952.ref045","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1038\/387401a0","article-title":"Task difficulty and the specificity of perceptual learning","volume":"387","author":"M Ahissar","year":"1997","journal-title":"Nature"},{"key":"pcbi.1012952.ref046","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.cobeha.2016.06.003","article-title":"Searching for principles of brain computation","volume":"11","author":"W Maass","year":"2016","journal-title":"Current Opinion in Behavioral Sciences"},{"issue":"3","key":"pcbi.1012952.ref047","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1038\/nn.4244","article-title":"Using goal-driven deep learning models to understand sensory cortex","volume":"19","author":"DLK Yamins","year":"2016","journal-title":"Nat Neurosci"},{"key":"pcbi.1012952.ref048","first-page":"808","volume-title":"Conditional deep hierarchical variational autoencoder for voice conversion. In: 2021 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC","author":"K Akuzawa","year":"2021"},{"key":"pcbi.1012952.ref049","article-title":"Separability and geometry of object manifolds in deep neural networks","author":"U Cohen","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1012952.ref050","first-page":"21562","article-title":"Exploring the latent space of autoencoders with interventional assays","volume":"35","author":"F Leeb","year":"2022","journal-title":"Adv Neural Inf Process Syst"},{"issue":"6","key":"pcbi.1012952.ref051","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","article-title":"The MNIST database of handwritten digit images for machine learning research [Best of the Web]","volume":"29","author":"Deng Li","year":"2012","journal-title":"IEEE Signal Process Mag"},{"key":"pcbi.1012952.ref052","volume-title":"dSprites: disentanglement testing Sprites dataset","author":"L Matthey","year":"2017"},{"key":"pcbi.1012952.ref053","first-page":"601","article-title":"Information theory of decisions and actions.","volume-title":"Perception-action cycle: models, architectures, and hardware","author":"N Tishby","year":"2010"},{"issue":"1","key":"pcbi.1012952.ref054","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1010829","article-title":"Humans account for cognitive costs when finding shortcuts: An information-theoretic analysis of navigation","volume":"19","author":"GL Lancia","year":"2023","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pcbi.1012952.ref055","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1111\/nyas.15118","article-title":"Neural representation in active inference: Using generative models to interact with-and understand-the lived world","volume":"1534","author":"G Pezzulo","year":"2024","journal-title":"Ann N Y Acad Sci"},{"issue":"5","key":"pcbi.1012952.ref056","doi-asserted-by":"crossref","first-page":"307","DOI":"10.2976\/1.3171566","article-title":"Information: currency of life?","volume":"3","author":"D Polani","year":"2009","journal-title":"HFSP J"},{"key":"pcbi.1012952.ref057","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-24647-0_3","article-title":"Trading value and information in MDPs.","volume-title":"Decision making with imperfect decision makers. intelligent systems reference library","author":"J Rubin","year":"2012"},{"key":"pcbi.1012952.ref058","volume-title":"Modern multidimensional scaling: theory and applications","author":"I Borg","year":"2005"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012952","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,12]],"date-time":"2025-05-12T17:29:26Z","timestamp":1747070966000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012952"}},"subtitle":[],"editor":[{"given":"Tatyana O.","family":"Sharpee","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2025,5,12]]},"references-count":58,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5,12]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012952","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,12]]}}}