{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T21:19:15Z","timestamp":1769721555198,"version":"3.49.0"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011897","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T00:00:00Z","timestamp":1711324800000}}],"reference-count":59,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:00:00Z","timestamp":1710288000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001700","name":"Ministry of Education, Culture, Sports, Science, and Technology (MEXT) of Japan","doi-asserted-by":"crossref","award":["20H00123"],"award-info":[{"award-number":["20H00123"]}],"id":[{"id":"10.13039\/501100001700","id-type":"DOI","asserted-by":"crossref"}]},{"name":"MIC","award":["JPMI00316"],"award-info":[{"award-number":["JPMI00316"]}]},{"DOI":"10.13039\/501100009708","name":"Novo Nordisk Fonden","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100009708","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Various animals, including humans, have been suggested to perform Bayesian inferences to handle noisy, time-varying external information. In performing Bayesian inference by the brain, the prior distribution must be acquired and represented by sampling noisy external inputs. However, the mechanism by which neural activities represent such distributions has not yet been elucidated. Our findings reveal that networks with modular structures, composed of fast and slow modules, are adept at representing this prior distribution, enabling more accurate Bayesian inferences. Specifically, the modular network that consists of a main module connected with input and output layers and a sub-module with slower neural activity connected only with the main module outperformed networks with uniform time scales. Prior information was represented specifically by the slow sub-module, which could integrate observed signals over an appropriate period and represent input means and variances. Accordingly, the neural network could effectively predict the time-varying inputs. Furthermore, by training the time scales of neurons starting from networks with uniform time scales and without modular structure, the above slow-fast modular network structure and the division of roles in which prior knowledge is selectively represented in the slow sub-modules spontaneously emerged. These results explain how the prior distribution for Bayesian inference is represented in the brain, provide insight into the relevance of modular structure with time scale hierarchy to information processing, and elucidate the significance of brain areas with slower time scales.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1011897","type":"journal-article","created":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T17:46:02Z","timestamp":1710351962000},"page":"e1011897","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":5,"title":["Bayesian inference is facilitated by modular neural networks with different time scales"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5138-0179","authenticated-orcid":true,"given":"Kohei","family":"Ichikawa","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6400-8587","authenticated-orcid":true,"given":"Kunihiko","family":"Kaneko","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2024,3,13]]},"reference":[{"issue":"9","key":"pcbi.1011897.ref001","doi-asserted-by":"crossref","first-page":"2450","DOI":"10.1162\/neco_a_00991","article-title":"Implementing a Bayes Filter in a Neural Circuit: The Case of Unknown Stimulus Dynamics","volume":"29","author":"S Sokoloski","year":"2017","journal-title":"Neural Computation"},{"issue":"12","key":"pcbi.1011897.ref002","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1016\/j.tins.2004.10.007","article-title":"The Bayesian brain: the role of uncertainty in neural coding and computation","volume":"27","author":"DC Knill","year":"2004","journal-title":"Trends in Neurosciences"},{"issue":"30","key":"pcbi.1011897.ref003","doi-asserted-by":"crossref","first-page":"12491","DOI":"10.1073\/pnas.1101430108","article-title":"Bayesian sampling in visual perception","volume":"108","author":"R Moreno-Bote","year":"2011","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"4","key":"pcbi.1011897.ref004","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1016\/j.conb.2009.06.008","article-title":"Multisensory integration: psychophysics, neurophysiology, and computation","volume":"19","author":"DE Angelaki","year":"2009","journal-title":"Current Opinion in Neurobiology"},{"issue":"3","key":"pcbi.1011897.ref005","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1016\/j.neuron.2016.03.020","article-title":"Perceptual Decision-Making as Probabilistic Inference by Neural Sampling","volume":"90","author":"RM Haefner","year":"2016","journal-title":"Neuron"},{"issue":"6870","key":"pcbi.1011897.ref006","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/415429a","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"MO Ernst","year":"2002","journal-title":"Nature"},{"issue":"6728","key":"pcbi.1011897.ref007","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1038\/19303","article-title":"Humans use internal models to estimate gravity and linear acceleration","volume":"398","author":"DM Merfeld","year":"1999","journal-title":"Nature"},{"key":"pcbi.1011897.ref008","volume-title":"Bayesian Brain: Probabilistic Approaches to Neural Coding","author":"K Doya","year":"2007"},{"issue":"2","key":"pcbi.1011897.ref009","doi-asserted-by":"crossref","first-page":"1230","DOI":"10.1016\/j.neuroimage.2011.10.004","article-title":"The history of the future of the Bayesian brain","volume":"62","author":"K Friston","year":"2012","journal-title":"NeuroImage"},{"issue":"9","key":"pcbi.1011897.ref010","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1038\/nn.3495","article-title":"Probabilistic brains: knowns and unknowns","volume":"16","author":"A Pouget","year":"2013","journal-title":"Nature Neuroscience"},{"issue":"43","key":"pcbi.1011897.ref011","doi-asserted-by":"crossref","first-page":"15310","DOI":"10.1523\/JNEUROSCI.1706-11.2011","article-title":"Marginalization in Neural Circuits with Divisive Normalization","volume":"31","author":"JM Beck","year":"2011","journal-title":"Journal of Neuroscience"},{"issue":"6","key":"pcbi.1011897.ref012","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1038\/nn0602-508","article-title":"Illusions, perception and Bayes","volume":"5","author":"WS Geisler","year":"2002","journal-title":"Nature Neuroscience"},{"issue":"15","key":"pcbi.1011897.ref013","doi-asserted-by":"crossref","first-page":"8391","DOI":"10.1073\/pnas.1918143117","article-title":"Humans incorporate trial-to-trial working memory uncertainty into rewarded decisions","volume":"117","author":"M Honig","year":"2020","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1011897.ref014","volume-title":"Advances in Neural Information Processing Systems","author":"J Chung","year":"2015"},{"issue":"11","key":"pcbi.1011897.ref015","doi-asserted-by":"crossref","first-page":"2025","DOI":"10.1162\/neco_a_01228","article-title":"A Novel Predictive-Coding-Inspired Variational RNN Model for Online Prediction and Recognition","volume":"31","author":"A Ahmadi","year":"2019","journal-title":"Neural Computation"},{"issue":"1","key":"pcbi.1011897.ref016","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1038\/s41467-017-00181-8","article-title":"Efficient probabilistic inference in generic neural networks trained with non-probabilistic feedback","volume":"8","author":"AE Orhan","year":"2017","journal-title":"Nature Communications"},{"issue":"1","key":"pcbi.1011897.ref017","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1038\/s41598-020-79366-z","article-title":"Population codes of prior knowledge learned through environmental regularities","volume":"11","author":"SC Quax","year":"2021","journal-title":"Scientific Reports"},{"issue":"18","key":"pcbi.1011897.ref018","doi-asserted-by":"crossref","first-page":"1641","DOI":"10.1016\/j.cub.2012.07.010","article-title":"Differential Representations of Prior and Likelihood Uncertainty in the Human Brain","volume":"22","author":"I Vilares","year":"2012","journal-title":"Current Biology"},{"issue":"30","key":"pcbi.1011897.ref019","doi-asserted-by":"crossref","first-page":"7817","DOI":"10.1523\/JNEUROSCI.0659-16.2016","article-title":"A Probability Distribution over Latent Causes, in the Orbitofrontal Cortex","volume":"36","author":"SCY Chan","year":"2016","journal-title":"Journal of Neuroscience"},{"issue":"26","key":"pcbi.1011897.ref020","doi-asserted-by":"crossref","first-page":"10887","DOI":"10.1523\/JNEUROSCI.5829-12.2013","article-title":"The Human Brain Encodes Event Frequencies While Forming Subjective Beliefs","volume":"33","author":"M d\u2019Acremont","year":"2013","journal-title":"Journal of Neuroscience"},{"issue":"12","key":"pcbi.1011897.ref021","doi-asserted-by":"crossref","first-page":"1661","DOI":"10.1038\/nn.3862","article-title":"A hierarchy of intrinsic timescales across primate cortex","volume":"17","author":"JD Murray","year":"2014","journal-title":"Nature Neuroscience"},{"key":"pcbi.1011897.ref022","doi-asserted-by":"crossref","DOI":"10.3389\/fncir.2020.615626","article-title":"A Diversity of Intrinsic Timescales Underlie Neural Computations","volume":"14","author":"SE Cavanagh","year":"2020","journal-title":"Frontiers in Neural Circuits"},{"issue":"1","key":"pcbi.1011897.ref023","doi-asserted-by":"crossref","first-page":"970","DOI":"10.1038\/s42003-021-02483-6","article-title":"The brain and its time: intrinsic neural timescales are key for input processing","volume":"4","author":"M Golesorkhi","year":"2021","journal-title":"Communications Biology"},{"issue":"2","key":"pcbi.1011897.ref024","doi-asserted-by":"crossref","DOI":"10.1523\/ENEURO.0316-21.2022","article-title":"Linking Brain Structure, Activity, and Cognitive Function through Computation","volume":"9","author":"K Amunts","year":"2022","journal-title":"eNeuro"},{"issue":"3","key":"pcbi.1011897.ref025","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1016\/j.neuron.2018.07.003","article-title":"Linking Connectivity, Dynamics, and Computations in Low-Rank Recurrent Neural Networks","volume":"99","author":"F Mastrogiuseppe","year":"2018","journal-title":"Neuron"},{"issue":"1","key":"pcbi.1011897.ref026","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1146\/annurev-neuro-092619-094115","article-title":"Computation Through Neural Population Dynamics","volume":"43","author":"S Vyas","year":"2020","journal-title":"Annual Review of Neuroscience"},{"issue":"6","key":"pcbi.1011897.ref027","doi-asserted-by":"crossref","first-page":"1572","DOI":"10.1162\/neco_a_01381","article-title":"Shaping Dynamics With Multiple Populations in Low-Rank Recurrent Networks","volume":"33","author":"M Beiran","year":"2021","journal-title":"Neural Computation"},{"key":"pcbi.1011897.ref028","doi-asserted-by":"crossref","DOI":"10.3389\/fphys.2013.00086","article-title":"Time scales in cognitive neuroscience","volume":"4","author":"D Papo","year":"2013","journal-title":"Frontiers in Physiology"},{"key":"pcbi.1011897.ref029","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.conb.2017.06.003","article-title":"Recurrent neural networks as versatile tools of neuroscience research","volume":"46","author":"O Barak","year":"2017","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1011897.ref030","unstructured":"Nair V, Hinton GE. Rectified Linear Units Improve Restricted Boltzmann Machines. In: F\u00fcrnkranz J, Joachims T, editors. ICML. Omnipress; 2010. p. 807\u2013814. Available from: http:\/\/dblp.uni-trier.de\/db\/conf\/icml\/icml2010.html#NairH10."},{"issue":"11","key":"pcbi.1011897.ref031","doi-asserted-by":"crossref","first-page":"1432","DOI":"10.1038\/nn1790","article-title":"Bayesian inference with probabilistic population codes","volume":"9","author":"WJ Ma","year":"2006","journal-title":"Nature Neuroscience"},{"issue":"3","key":"pcbi.1011897.ref032","doi-asserted-by":"crossref","first-page":"804","DOI":"10.1162\/neco_a_01477","article-title":"Dynamical Mechanism of Sampling-Based Probabilistic Inference Under Probabilistic Population Codes","volume":"34","author":"K Ichikawa","year":"2022","journal-title":"Neural Computation"},{"issue":"1","key":"pcbi.1011897.ref033","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s004220050411","article-title":"Orientation tuning curves: empirical description and estimation of parameters","volume":"78","author":"NV Swindale","year":"1998","journal-title":"Biological Cybernetics"},{"key":"pcbi.1011897.ref034","first-page":"318","volume-title":"Learning Internal Representations by Error Propagation","author":"DE Rumelhart","year":"1986"},{"issue":"10","key":"pcbi.1011897.ref035","doi-asserted-by":"crossref","first-page":"1550","DOI":"10.1109\/5.58337","article-title":"Backpropagation through time: what it does and how to do it","volume":"78","author":"PJ Werbos","year":"1990","journal-title":"Proceedings of the IEEE"},{"key":"pcbi.1011897.ref036","unstructured":"Kingma DP, Ba J. Adam: A Method for Stochastic Optimization; 2014. Available from: http:\/\/arxiv.org\/abs\/1412.6980."},{"key":"pcbi.1011897.ref037","volume-title":"Pattern Recognition and Machine Learning","author":"CM Bishop","year":"2006"},{"key":"pcbi.1011897.ref038","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1038\/nature12742","article-title":"Context-dependent computation by recurrent dynamics in prefrontal cortex","volume":"503","author":"V Mante","year":"2013","journal-title":"Nature"},{"key":"pcbi.1011897.ref039","doi-asserted-by":"crossref","first-page":"033193","DOI":"10.1103\/PhysRevResearch.3.033193","article-title":"Short-term memory by transient oscillatory dynamics in recurrent neural networks","volume":"3","author":"K Ichikawa","year":"2021","journal-title":"Phys Rev Research"},{"issue":"3","key":"pcbi.1011897.ref040","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1017\/S0305004100030401","article-title":"A generalized inverse for matrices","volume":"51","author":"R Penrose","year":"1955","journal-title":"Mathematical Proceedings of the Cambridge Philosophical Society"},{"issue":"1","key":"pcbi.1011897.ref041","doi-asserted-by":"crossref","first-page":"5791","DOI":"10.1038\/s41467-021-26022-3","article-title":"Neural heterogeneity promotes robust learning","volume":"12","author":"N Perez-Nieves","year":"2021","journal-title":"Nature Communications"},{"issue":"2","key":"pcbi.1011897.ref042","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1038\/s41593-018-0310-2","article-title":"Task representations in neural networks trained to perform many cognitive tasks","volume":"22","author":"GR Yang","year":"2019","journal-title":"Nature Neuroscience"},{"issue":"6","key":"pcbi.1011897.ref043","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1016\/j.cub.2021.01.068","article-title":"Prefrontal cortex represents heuristics that shape choice bias and its integration into future behavior","volume":"31","author":"G Mochol","year":"2021","journal-title":"Current Biology"},{"issue":"11","key":"pcbi.1011897.ref044","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1000220","article-title":"Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment","volume":"4","author":"Y Yamashita","year":"2008","journal-title":"PLOS Computational Biology"},{"key":"pcbi.1011897.ref045","doi-asserted-by":"crossref","DOI":"10.3389\/fncom.2021.743537","article-title":"Multiple-Timescale Neural Networks: Generation of History-Dependent Sequences and Inference Through Autonomous Bifurcations","volume":"15","author":"T Kurikawa","year":"2021","journal-title":"Frontiers in Computational Neuroscience"},{"key":"pcbi.1011897.ref046","doi-asserted-by":"crossref","first-page":"L032014","DOI":"10.1103\/PhysRevResearch.4.L032014","article-title":"Reservoir computing with diverse timescales for prediction of multiscale dynamics","volume":"4","author":"G Tanaka","year":"2022","journal-title":"Phys Rev Research"},{"issue":"1","key":"pcbi.1011897.ref047","doi-asserted-by":"crossref","first-page":"013137","DOI":"10.1063\/5.0019116","article-title":"Functional differentiations in evolutionary reservoir computing networks","volume":"31","author":"Y Yamaguti","year":"2021","journal-title":"Chaos: An Interdisciplinary Journal of Nonlinear Science"},{"key":"pcbi.1011897.ref048","unstructured":"Bengio Y, Lee D, Bornschein J, Lin Z. Towards Biologically Plausible Deep Learning. ArXiv. 2015;abs\/1502.04156."},{"issue":"1","key":"pcbi.1011897.ref049","doi-asserted-by":"crossref","first-page":"13276","DOI":"10.1038\/ncomms13276","article-title":"Random synaptic feedback weights support error backpropagation for deep learning","volume":"7","author":"TP Lillicrap","year":"2016","journal-title":"Nature Communications"},{"issue":"11","key":"pcbi.1011897.ref050","doi-asserted-by":"crossref","first-page":"1761","DOI":"10.1038\/s41593-019-0520-2","article-title":"A deep learning framework for neuroscience","volume":"22","author":"BA Richards","year":"2019","journal-title":"Nature Neuroscience"},{"issue":"6","key":"pcbi.1011897.ref051","doi-asserted-by":"crossref","first-page":"1048","DOI":"10.1016\/j.neuron.2020.09.005","article-title":"Artificial Neural Networks for Neuroscientists: A Primer","volume":"107","author":"GR Yang","year":"2020","journal-title":"Neuron"},{"key":"pcbi.1011897.ref052","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1016\/j.pneurobio.2013.02.002","article-title":"From fixed points to chaos: Three models of delayed discrimination","volume":"103","author":"O Barak","year":"2013","journal-title":"Progress in Neurobiology"},{"key":"pcbi.1011897.ref053","unstructured":"Cueva CJ, Wei XX. Emergence of grid-like representations by training recurrent neural networks to perform spatial localization. In: International Conference on Learning Representations; 2018. Available from: https:\/\/openreview.net\/forum?id=B17JTOe0-."},{"issue":"3","key":"pcbi.1011897.ref054","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1038\/nn.4244","article-title":"Using goal-driven deep learning models to understand sensory cortex","volume":"19","author":"DLK Yamins","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"6","key":"pcbi.1011897.ref055","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1016\/j.neuron.2019.07.003","article-title":"Convergent Temperature Representations in Artificial and Biological Neural Networks","volume":"103","author":"M Haesemeyer","year":"2019","journal-title":"Neuron"},{"issue":"7705","key":"pcbi.1011897.ref056","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/s41586-018-0102-6","article-title":"Vector-based navigation using grid-like representations in artificial agents","volume":"557","author":"A Banino","year":"2018","journal-title":"Nature"},{"issue":"6","key":"pcbi.1011897.ref057","doi-asserted-by":"crossref","first-page":"783","DOI":"10.1038\/s41593-022-01088-4","article-title":"The role of population structure in computations through neural dynamics","volume":"25","author":"A Dubreuil","year":"2022","journal-title":"Nature Neuroscience"},{"issue":"2","key":"pcbi.1011897.ref058","first-page":"129","article-title":"The emergence of modularity in biological systems","volume":"8","author":"DM Lorenz","year":"2011","journal-title":"Physics of Life Reviews"},{"issue":"39","key":"pcbi.1011897.ref059","doi-asserted-by":"crossref","first-page":"13773","DOI":"10.1073\/pnas.0503610102","article-title":"Spontaneous evolution of modularity and network motifs","volume":"102","author":"N Kashtan","year":"2005","journal-title":"Proceedings of the National Academy of Sciences"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011897","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T00:00:00Z","timestamp":1711324800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011897","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,25]],"date-time":"2024-03-25T17:47:10Z","timestamp":1711388830000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011897"}},"subtitle":[],"editor":[{"given":"Thomas","family":"Serre","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,3,13]]},"references-count":59,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3,13]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011897","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1011897","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,13]]}}}