{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T06:11:41Z","timestamp":1772172701933,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1008743","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T00:00:00Z","timestamp":1616025600000}}],"reference-count":60,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"US National Science Foundation, through the, Center for the Physics of Biological Function","award":["PHY\u20131734030"],"award-info":[{"award-number":["PHY\u20131734030"]}]},{"DOI":"10.13039\/100000083","name":"Directorate for Computer and Information Science and Engineering","doi-asserted-by":"crossref","award":["1652617"],"award-info":[{"award-number":["1652617"]}],"id":[{"id":"10.13039\/100000083","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R01EB026943-01"],"award-info":[{"award-number":["R01EB026943-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"France Chicago Center","award":["FACCTS grant"],"award-info":[{"award-number":["FACCTS grant"]}]},{"name":"France Chicago Center","award":["FACCTS grant"],"award-info":[{"award-number":["FACCTS grant"]}]},{"name":"France Chicago Center","award":["FACCTS grant"],"award-info":[{"award-number":["FACCTS grant"]}]},{"name":"France Chicago Center","award":["FACCTS grant"],"award-info":[{"award-number":["FACCTS grant"]}]},{"DOI":"10.13039\/501100004794","name":"Centre National de la Recherche Scientifique","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004794","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004794","name":"Centre National de la Recherche Scientifique","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004794","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004794","name":"Centre National de la Recherche Scientifique","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004794","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"crossref","award":["724208"],"award-info":[{"award-number":["724208"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["724208"],"award-info":[{"award-number":["724208"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Responding to stimuli requires that organisms encode information about the external world. Not all parts of the input are important for behavior, and resource limitations demand that signals be compressed. Prediction of the future input is widely beneficial in many biological systems. We compute the trade-offs between representing the past faithfully and predicting the future using the information bottleneck approach, for input dynamics with different levels of complexity. For motion prediction, we show that, depending on the parameters in the input dynamics, velocity or position information is more useful for accurate prediction. We show which motion representations are easiest to re-use for accurate prediction in other motion contexts, and identify and quantify those with the highest transferability. For non-Markovian dynamics, we explore the role of long-term memory in shaping the internal representation. Lastly, we show that prediction in evolutionary population dynamics is linked to clustering allele frequencies into non-overlapping memories.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1008743","type":"journal-article","created":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T13:38:24Z","timestamp":1615210704000},"page":"e1008743","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":12,"title":["Optimal prediction with resource constraints using the information bottleneck"],"prefix":"10.1371","volume":"17","author":[{"given":"Vedant","family":"Sachdeva","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5456-9361","authenticated-orcid":true,"given":"Thierry","family":"Mora","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2686-5702","authenticated-orcid":true,"given":"Aleksandra M.","family":"Walczak","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6211-6293","authenticated-orcid":true,"given":"Stephanie E.","family":"Palmer","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"pcbi.1008743.ref001","doi-asserted-by":"crossref","unstructured":"Barlow HB. Possible Principles Underlying the Transformation of Sensory Messages. In: Sensory communication. MIT Press; 2012.","DOI":"10.7551\/mitpress\/9780262518420.003.0013"},{"key":"pcbi.1008743.ref002","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1515\/znc-1981-9-1040","article-title":"A Simple Coding Procedure Enhances a Neuron\u2019s Information Capacity","volume":"36","author":"SB Laughlin","year":"1981","journal-title":"Zeitschrift f\u00fcr Naturforschung C"},{"issue":"6566","key":"pcbi.1008743.ref003","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1038\/379642a0","article-title":"The rate of information transfer at graded-potential synapses","volume":"379","author":"RR de Ruyter van Steveninck","year":"1996","journal-title":"Nature"},{"issue":"6583","key":"pcbi.1008743.ref004","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1038\/381607a0","article-title":"Emergence of simple-cell receptive field properties by learning a sparse code for natural images","volume":"381","author":"BA Olshausen","year":"1996","journal-title":"Nature"},{"issue":"11","key":"pcbi.1008743.ref005","doi-asserted-by":"crossref","first-page":"2409","DOI":"10.1162\/089976601753195969","article-title":"Predictability, Complexity, and Learning","volume":"13","author":"W Bialek","year":"2001","journal-title":"Neural Computation"},{"issue":"7","key":"pcbi.1008743.ref006","doi-asserted-by":"crossref","first-page":"1434","DOI":"10.1364\/JOSAA.20.001434","article-title":"Hierarchical Bayesian inference in the visual cortex","volume":"20","author":"TS Lee","year":"2003","journal-title":"J Opt Soc Am A"},{"issue":"4","key":"pcbi.1008743.ref007","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1162\/neco.1997.9.4.721","article-title":"Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex","volume":"9","author":"RPN Rao","year":"1997","journal-title":"Neural Computation"},{"issue":"1205","key":"pcbi.1008743.ref008","first-page":"427","article-title":"Predictive coding: a fresh view of inhibition in the retina","volume":"216","author":"MV Srinivasan","year":"1982","journal-title":"Proceedings of the Royal Society of London Series B Biological Sciences"},{"issue":"1","key":"pcbi.1008743.ref009","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1038\/4580","article-title":"Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects","volume":"2","author":"RPN Rao","year":"1999","journal-title":"Nature Neuroscience"},{"issue":"22","key":"pcbi.1008743.ref010","doi-asserted-by":"crossref","first-page":"6908","DOI":"10.1073\/pnas.1506855112","article-title":"Predictive information in a sensory population","volume":"112","author":"SE Palmer","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"pcbi.1008743.ref011","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.neuron.2011.08.010","article-title":"Olfactory Predictive Codes and Stimulus Templates in Piriform Cortex","volume":"72","author":"C Zelano","year":"2011","journal-title":"Neuron"},{"issue":"18","key":"pcbi.1008743.ref012","doi-asserted-by":"crossref","first-page":"8815","DOI":"10.1073\/pnas.1812810116","article-title":"How a well-adapting immune system remembers","volume":"116","author":"A Mayer","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"pcbi.1008743.ref013","doi-asserted-by":"crossref","first-page":"3573","DOI":"10.1038\/s41467-019-11405-4","article-title":"Past\u2013future information bottleneck for sampling molecular reaction coordinate simultaneously with thermodynamics and kinetics","volume":"10","author":"Y Wang","year":"2019","journal-title":"Nature Communications"},{"key":"pcbi.1008743.ref014","unstructured":"Tishby N, Pereira FC, Bialek W. The Information Bottleneck Method; 1999. p. 368\u2013377."},{"key":"pcbi.1008743.ref015","unstructured":"Alemi AA. Variational Predictive Information Bottleneck; 2019."},{"key":"pcbi.1008743.ref016","unstructured":"Chechik G, Globerson A, Tishby N, Weiss Y. Information Bottleneck for Gaussian Variables. In: Thrun S, Saul LK, Sch\u00f6lkopf B, editors. Advances in Neural Information Processing Systems 16. MIT Press; 2004. p. 1213\u20131220. Available from: http:\/\/papers.nips.cc\/paper\/2457-information-bottleneck-for-gaussian-variables.pdf."},{"key":"pcbi.1008743.ref017","unstructured":"Friedman, N, Mosenzon, O, Slonim, N, Tishby, N. Multivariate Information Bottleneck arXiv. 2013; 1301.2270."},{"key":"pcbi.1008743.ref018","unstructured":"Slonim, N. The Information Bottleneck: Theory and Applications. 2002."},{"key":"pcbi.1008743.ref019","volume-title":"vol. 13 of Springer Series in Synergetics","author":"CW Gardiner","year":"2004","edition":"3"},{"key":"pcbi.1008743.ref020","unstructured":"Van Kampen NG. Stochastic Processes in Physics and Chemistry. North-Holland Personal Library. Elsevier Science; 1992. Available from: https:\/\/books.google.com\/books?id=3e7XbMoJzmoC."},{"issue":"2","key":"pcbi.1008743.ref021","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/S0006-3495(77)85544-6","article-title":"Physics of chemoreception","volume":"20","author":"HC Berg","year":"1977","journal-title":"Biophysical Journal"},{"key":"pcbi.1008743.ref022","unstructured":"Bialek W. Biophysics: Searching for Principles. Princeton University Press; 2012. Available from: https:\/\/books.google.com\/books?id=5In_FKA2rmUC."},{"key":"pcbi.1008743.ref023","unstructured":"Beaudry NJ, Renner R. An intuitive proof of the data processing inequality; 2011."},{"issue":"5","key":"pcbi.1008743.ref024","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1073\/pnas.1710779115","article-title":"Learning to make external sensory stimulus predictions using internal correlations in populations of neurons","volume":"115","author":"AJ Sederberg","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"5","key":"pcbi.1008743.ref025","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1007\/s10955-015-1439-y","article-title":"Optimal Prediction in the Retina and Natural Motion Statistics","volume":"162","author":"JM Salisbury","year":"2016","journal-title":"Journal of Statistical Physics"},{"issue":"12","key":"pcbi.1008743.ref026","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1073\/pnas.31.12.382","article-title":"The Differential Equation of the Distribution of Gene Frequencies","volume":"31","author":"S Wright","year":"1945","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"1","key":"pcbi.1008743.ref027","first-page":"e30","article-title":"Statistical Inference in the Wright-Fisher Model Using Allele Frequency Data","volume":"66","author":"P Tataru","year":"2017","journal-title":"Systematic biology"},{"issue":"19","key":"pcbi.1008743.ref028","doi-asserted-by":"crossref","first-page":"5950","DOI":"10.1073\/pnas.1421827112","article-title":"How a well-adapted immune system is organized","volume":"112","author":"A Mayer","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1008743.ref029","doi-asserted-by":"crossref","first-page":"041103","DOI":"10.1103\/PhysRevE.83.041103","article-title":"Harmonic oscillator in heat bath: Exact simulation of time-lapse-recorded data and exact analytical benchmark statistics","volume":"83","author":"SF N\u00f8rrelykke","year":"2011","journal-title":"Phys Rev E"},{"key":"pcbi.1008743.ref030","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1103\/PhysRevLett.73.814","article-title":"Statistics of natural images: Scaling in the woods","volume":"73","author":"DL Ruderman","year":"1994","journal-title":"Physical Review Letters"},{"issue":"1","key":"pcbi.1008743.ref031","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/S0167-2789(00)00174-3","article-title":"Fractal time and 1\/f spectra in dynamic images and human vision","volume":"148","author":"VA Billock","year":"2001","journal-title":"Physica D: Nonlinear Phenomena"},{"issue":"23","key":"pcbi.1008743.ref032","doi-asserted-by":"crossref","first-page":"3385","DOI":"10.1016\/S0042-6989(97)00008-4","article-title":"Origins of scaling in natural images","volume":"37","author":"DL Ruderman","year":"1997","journal-title":"Vision Research"},{"issue":"2","key":"pcbi.1008743.ref033","doi-asserted-by":"crossref","first-page":"023301","DOI":"10.1063\/1.4863478","article-title":"Correlation functions for the fractional generalized Langevin equation in the presence of internal and external noise","volume":"55","author":"T Sandev","year":"2014","journal-title":"Journal of Mathematical Physics"},{"key":"pcbi.1008743.ref034","unstructured":"Mainardi F, Pironi P. The Fractional Langevin Equation: Brownian Motion Revisited; 2008."},{"key":"pcbi.1008743.ref035","doi-asserted-by":"crossref","first-page":"021103","DOI":"10.1103\/PhysRevE.81.021103","article-title":"Fractional Brownian motion and motion governed by the fractional Langevin equation in confined geometries","volume":"81","author":"JH Jeon","year":"2010","journal-title":"Phys Rev E"},{"issue":"7490","key":"pcbi.1008743.ref036","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1038\/nature13087","article-title":"A predictive fitness model for influenza","volume":"507","author":"M \u0141uksza","year":"2014","journal-title":"Nature"},{"issue":"4","key":"pcbi.1008743.ref037","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/j.chom.2018.03.012","article-title":"Mapping the Evolutionary Potential of RNA Viruses","volume":"23","author":"PT Dolan","year":"2018","journal-title":"Cell Host & Microbe"},{"issue":"4","key":"pcbi.1008743.ref038","doi-asserted-by":"crossref","first-page":"785","DOI":"10.1016\/j.cell.2015.01.027","article-title":"Manipulating the selection forces during affinity maturation to generate cross-reactive HIV antibodies","volume":"160","author":"S Wang","year":"2015","journal-title":"Cell"},{"key":"pcbi.1008743.ref039","doi-asserted-by":"crossref","unstructured":"Sachdeva V, Husain K, Sheng J, Wang S, Murugan A. Tuning environmental timescales to evolve and maintain generalists; 2019.","DOI":"10.1073\/pnas.1914586117"},{"key":"pcbi.1008743.ref040","doi-asserted-by":"crossref","unstructured":"Nourmohammad A, Eksin C. Optimal evolutionary control for artificial selection on molecular phenotypes; 2019.","DOI":"10.1101\/2019.12.27.889592"},{"issue":"11","key":"pcbi.1008743.ref041","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.ppat.1006702","article-title":"Estimating virus effective population size and selection without neutral markers","volume":"13","author":"E Rousseau","year":"2017","journal-title":"PLOS Pathogens"},{"issue":"1","key":"pcbi.1008743.ref042","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1073\/pnas.1711114115","article-title":"Toward a unified theory of efficient, predictive, and sparse coding","volume":"115","author":"M Chalk","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1008743.ref043","first-page":"1","article-title":"Gaussian Lower Bound for the Information Bottleneck Limit","volume":"18","author":"A Painsky","year":"2018","journal-title":"Journal of Machine Learning Research"},{"issue":"12","key":"pcbi.1008743.ref044","doi-asserted-by":"crossref","DOI":"10.3390\/e21121181","article-title":"Nonlinear Information Bottleneck","volume":"21","author":"A Kolchinsky","year":"2019","journal-title":"Entropy"},{"issue":"2","key":"pcbi.1008743.ref045","doi-asserted-by":"crossref","first-page":"177","DOI":"10.2307\/3211856","article-title":"Diffusion Models in Population Genetics","volume":"1","author":"M Kimura","year":"1964","journal-title":"Journal of Applied Probability"},{"issue":"1","key":"pcbi.1008743.ref046","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/TIT.1972.1054753","article-title":"An algorithm for computing the capacity of arbitrary discrete memoryless channels","volume":"18","author":"S Arimoto","year":"1972","journal-title":"IEEE Transactions on Information Theory"},{"key":"pcbi.1008743.ref047","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TIT.1972.1054855","article-title":"Computation of channel capacity and rate-distortion functions","volume":"18","author":"RE Blahut","year":"1972","journal-title":"IEEE Trans Inform Theory"},{"key":"pcbi.1008743.ref048","doi-asserted-by":"crossref","unstructured":"Murphy K, Weaver C. Janeway\u2019s Immunobiology. CRC Press; 2016. Available from: https:\/\/books.google.com\/books?id=GmPLCwAAQBAJ.","DOI":"10.1201\/9781315533247"},{"key":"pcbi.1008743.ref049","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1111\/j.1600-065X.1989.tb00025.x","article-title":"Immune Network Theory","volume":"110","author":"A. S Perelson","year":"1989","journal-title":"Immunological Reviews"},{"key":"pcbi.1008743.ref050","first-page":"1","article-title":"Evolution of molecular phenotypes under stabilizing selection","volume":"01","author":"A Nourmohammad","year":"2013","journal-title":"Journal of Statistical Mechanics: Theory and Experiment"},{"issue":"10","key":"pcbi.1008743.ref051","doi-asserted-by":"crossref","first-page":"924","DOI":"10.3390\/e21100924","article-title":"Learnability for the Information Bottleneck","volume":"21","author":"T Wu","year":"2019","journal-title":"Entropy"},{"key":"pcbi.1008743.ref052","unstructured":"Wu T, Fischer I. Phase Transitions for the Information Bottleneck in Representation Learning. In: International Conference on Learning Representations; 2020. Available from: https:\/\/openreview.net\/forum?id=HJloElBYvB."},{"issue":"Series D","key":"pcbi.1008743.ref053","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"RE Kalman","year":"1960","journal-title":"Transactions of the ASME\u2013Journal of Basic Engineering"},{"issue":"5","key":"pcbi.1008743.ref054","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1016\/j.cels.2019.08.008","article-title":"Kalman-like Self-Tuned Sensitivity in Biophysical Sensing","volume":"9","author":"K Husain","year":"2019","journal-title":"Cell Systems"},{"key":"pcbi.1008743.ref055","doi-asserted-by":"crossref","first-page":"041905","DOI":"10.1103\/PhysRevE.81.041905","article-title":"Optimizing information flow in small genetic networks. II. Feed-forward interactions","volume":"81","author":"AM Walczak","year":"2010","journal-title":"Phys Rev E"},{"key":"pcbi.1008743.ref056","doi-asserted-by":"crossref","first-page":"138101","DOI":"10.1103\/PhysRevLett.103.138101","article-title":"Neural Population Coding Is Optimized by Discrete Tuning Curves","volume":"103","author":"AP Nikitin","year":"2009","journal-title":"Phys Rev Lett"},{"issue":"3","key":"pcbi.1008743.ref057","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/S0019-9958(71)90346-9","article-title":"The information capacity of amplitude- and variance-constrained scalar gaussian channels","volume":"18","author":"JG Smith","year":"1971","journal-title":"Information and Control"},{"issue":"5","key":"pcbi.1008743.ref058","doi-asserted-by":"crossref","first-page":"e96333","DOI":"10.1371\/journal.pone.0096333","article-title":"Profiling of olfactory receptor gene expression in whole human olfactory mucosa","volume":"9","author":"C Verbeurgt","year":"2014","journal-title":"PloS one"},{"issue":"suppl_1","key":"pcbi.1008743.ref059","first-page":"D291","article-title":"SuperScent?a database of flavors and scents","volume":"37","author":"M Dunkel","year":"2008","journal-title":"Nucleic Acids Research"},{"key":"pcbi.1008743.ref060","unstructured":"Alemi AA, Fischer I, Dillon JV, Murphy K. Deep Variational Information Bottleneck; 2016."}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1008743","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T00:00:00Z","timestamp":1616025600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008743","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,18]],"date-time":"2021-03-18T14:12:03Z","timestamp":1616076723000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008743"}},"subtitle":[],"editor":[{"given":"Aldo A","family":"Faisal","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":60,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,3,8]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1008743","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.04.29.069179","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,8]]}}}