{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:56:42Z","timestamp":1760241402685,"version":"build-2065373602"},"reference-count":65,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2018,2,1]],"date-time":"2018-02-01T00:00:00Z","timestamp":1517443200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31771147","91232715"],"award-info":[{"award-number":["31771147","91232715"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Open Research Fund of the State Key Laboratory of Cognitive Neuroscience and Learning","award":["CNLZD1404"],"award-info":[{"award-number":["CNLZD1404"]}]},{"DOI":"10.13039\/501100009592","name":"Beijing Municipal Science and Technology Commission","doi-asserted-by":"publisher","award":["Z151100000915070"],"award-info":[{"award-number":["Z151100000915070"]}],"id":[{"id":"10.13039\/501100009592","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["CRCNS program NS090645"],"award-info":[{"award-number":["CRCNS program NS090645"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Coherent neuronal activity is believed to underlie the transfer and processing of information in the brain. Coherent activity in the form of synchronous firing and oscillations has been measured in many brain regions and has been correlated with enhanced feature processing and other sensory and cognitive functions. In the theoretical context, synfire chains and the transfer of transient activity packets in feedforward networks have been appealed to in order to describe coherent spiking and information transfer. Recently, it has been demonstrated that the classical synfire chain architecture, with the addition of suitably timed gating currents, can support the graded transfer of mean firing rates in feedforward networks (called synfire-gated synfire chains\u2014SGSCs). Here we study information propagation in SGSCs by examining mutual information as a function of layer number in a feedforward network. We explore the effects of gating and noise on information transfer in synfire chains and demonstrate that asymptotically, two main regions exist in parameter space where information may be propagated and its propagation is controlled by pulse-gating: a large region where binary codes may be propagated, and a smaller region near a cusp in parameter space that supports graded propagation across many layers.<\/jats:p>","DOI":"10.3390\/e20020102","type":"journal-article","created":{"date-parts":[[2018,2,2]],"date-time":"2018-02-02T04:20:50Z","timestamp":1517545250000},"page":"102","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Mutual Information and Information Gating in Synfire Chains"],"prefix":"10.3390","volume":"20","author":[{"given":"Zhuocheng","family":"Xiao","sequence":"first","affiliation":[{"name":"Department of Mathematics, University of Arizona, Tucson, AZ 85721, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Binxu","family":"Wang","sequence":"additional","affiliation":[{"name":"Center for Bioinformatics, National Laboratory of Protein Engineering and Plant Genetic Engineering, School of Life Sciences, Peking University, Beijing 100871, China"},{"name":"Yuanpei School, Peking University, Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Sornborger","sequence":"additional","affiliation":[{"name":"Information Sciences, CCS-3, Los Alamos National Laboratory, Los Alamos, NM 87545, USA"},{"name":"Department of Mathematics, University of California, Davis, CA 95616, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louis","family":"Tao","sequence":"additional","affiliation":[{"name":"Center for Bioinformatics, National Laboratory of Protein Engineering and Plant Genetic Engineering, School of Life Sciences, Peking University, Beijing 100871, China"},{"name":"Center for Quantitative Biology, Peking University, Beijing 100871, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1038\/338334a0","article-title":"Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties","volume":"338","author":"Gray","year":"1989","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2467","DOI":"10.1152\/jn.1996.75.6.2467","article-title":"Oscillatory firing and interneuronal correlations in squirrel monkey striate cortex","volume":"66","author":"Livingstone","year":"1996","journal-title":"J. Neurophysiol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1523\/JNEUROSCI.15-01-00047.1995","article-title":"Gamma (40\u2013100 Hz) oscillation in the hippocampus of the behaving rat","volume":"15","author":"Bragin","year":"1995","journal-title":"J. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2715","DOI":"10.1152\/jn.2002.87.6.2715","article-title":"Stimulus-related gamma oscillations in primate auditory cortex","volume":"87","author":"Brosch","year":"2002","journal-title":"J. Neurophysiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1523\/JNEUROSCI.5228-04.2006","article-title":"Tactile spatial attention enhances gamma-band activity in somatosensory cortex and reduces low-frequency activity in parieto-occipital areas","volume":"26","author":"Bauer","year":"2006","journal-title":"J. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1038\/nn890","article-title":"Temporal structure in neuronal activity during working memory in macaque parietal cortex","volume":"5","author":"Pesaran","year":"2002","journal-title":"Nat. Neurosci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1038\/nature07991","article-title":"Parvalbumin neurons and gamma rhythms enhance cortical circuit performance","volume":"459","author":"Sohal","year":"2009","journal-title":"Nature"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1038\/nn.2305","article-title":"Coherent gamma oscillations couple the amygdala and striatum during learning","volume":"12","author":"Popescu","year":"2009","journal-title":"Nat. Neurosci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1162\/neco.1996.8.6.1185","article-title":"Temporal precision of spike trains in extrastriate cortex of the behaving macaque monkey","volume":"8","author":"Bair","year":"1996","journal-title":"Neural Comput."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1038\/nature06105","article-title":"Temporal precision in the neural code and the timescales of natural vision","volume":"449","author":"Butts","year":"2007","journal-title":"Nature"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"E2726","DOI":"10.1073\/pnas.1210929109","article-title":"Frequency-invariant temporal ordering of interneuronal discharges during hippocampal oscillations in awake mice","volume":"109","author":"Varga","year":"2012","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1038\/nn1056","article-title":"Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro","volume":"6","author":"Reyes","year":"2003","journal-title":"Nat. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1126\/science.1183108","article-title":"Synchrony of thalamocortical inputs maximizes cortical reliability","volume":"328","author":"Wang","year":"2010","journal-title":"Science"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1007\/s10827-015-0570-8","article-title":"A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding","volume":"39","author":"Sornborger","year":"2015","journal-title":"J. Comput. Neurosci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, Z., Sornborger, A., and Tao, L. (2016). Graded, dynamically routable information processing with synfire-gated synfire chains. PLoS Comput. Biol., 12.","DOI":"10.1371\/journal.pcbi.1004979"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Shao, Y., Sornborger, A., and Tao, L. (2016, January 6\u20139). A pulse-gated, predictive neural circuit. Proceedings of the 50th Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA.","DOI":"10.1109\/ACSSC.2016.7869530"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"052308","DOI":"10.1103\/PhysRevE.96.052308","article-title":"Cusps enable line attractors for neural computation","volume":"96","author":"Xiao","year":"2017","journal-title":"Phys. Rev. E"},{"key":"ref_18","first-page":"83","article-title":"Role of the cortical neuron: Integrator or coincidence detector?","volume":"18","author":"Abeles","year":"1982","journal-title":"Isr. J. Med. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1016\/S0166-2236(96)80019-1","article-title":"Integrator or coincidence detector? The role of the cortical neuron revisited","volume":"19","author":"Engel","year":"1996","journal-title":"Trends Neurosci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/j.tics.2005.08.011","article-title":"A mechanism for cognitive dynamics: Neuronal communication through neuronal coherence","volume":"9","author":"Fries","year":"2005","journal-title":"Trends Cogn. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/990101","article-title":"Stable propagation of synchronous spiking in cortical neural networks","volume":"402","author":"Diesmann","year":"1999","journal-title":"Nature"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1023\/B:JCNS.0000025686.47117.67","article-title":"High frequency stimulation of the subthalamic nucleus eliminates pathological thalamic rhythmicity in a computational model","volume":"16","author":"Rubin","year":"2004","journal-title":"J. Comput. Neurosci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1956","DOI":"10.1523\/JNEUROSCI.22-05-01956.2002","article-title":"Fast propagation of firing rates through layered networks of noisy neurons","volume":"22","author":"Turrigiano","year":"2002","journal-title":"J. Neurosci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1162\/089976602753633358","article-title":"Stable propagation of activity pulses in populations of spiking neurons","volume":"14","author":"Kistler","year":"2002","journal-title":"Neural Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3006","DOI":"10.1523\/JNEUROSCI.23-07-03006.2003","article-title":"On the transmission of rate code in long feedforward networks with excitatory-inhibitory balance","volume":"23","author":"Litvak","year":"2003","journal-title":"J. Neurosci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5268","DOI":"10.1523\/JNEUROSCI.2542-07.2008","article-title":"Conditions for propagating synchronous spiking and asynchronous firing rates in a cortical network model","volume":"28","author":"Kumar","year":"2008","journal-title":"J. Neurosci."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Nemenman, I., Lewen, G.D., Bialek, W., and de Ruyter van Steveninck, R.R. (2008). Neural coding of natural stimuli: Information at sub-millisecond resolution. PLoS Comput. Biol., 4.","DOI":"10.1371\/journal.pcbi.1000025"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2545","DOI":"10.1073\/pnas.1500643112","article-title":"Feedback stabilizes propagation of synchronous spiking in cortical neural networks","volume":"112","author":"Moldakarimov","year":"2015","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1038\/nrn2886","article-title":"Spiking activity propagation in neuronal networks: Reconciling different perspectives on neural coding","volume":"11","author":"Kumar","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1162\/NECO_a_00915","article-title":"Analytical calculation of mutual information between weakly coupled poisson-spiking neurons in models of dynamically gated communication","volume":"29","author":"Cannon","year":"2017","journal-title":"Neural Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Cover, T., and Thomas, J. (2006). Elements of Information Theory, Wiley. [2nd ed.].","DOI":"10.1002\/047174882X"},{"key":"ref_33","unstructured":"Rieke, F., Warland, D., de Ruyter van Steveninck, R., and Bialek, W. (1997). Spikes: Exploring the Neural Code, The MIT Press."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1162\/089976603321780272","article-title":"Estimation of entropy and mutual information","volume":"15","author":"Paninski","year":"2003","journal-title":"Neural Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"051903","DOI":"10.1103\/PhysRevE.66.051903","article-title":"Binless strategies for estimation of information from neural data","volume":"66","author":"Victor","year":"2002","journal-title":"Phys. Rev. E Stat. Nonlinear Soft Matter Phys."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"056111","DOI":"10.1103\/PhysRevE.69.056111","article-title":"Entropy and information in neural spike trains: progress on the sampling problem","volume":"69","author":"Nemenman","year":"2004","journal-title":"Phys. Rev. E Stat. Nonlinear Soft Matter Phys."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"DiLorenzo, P., and Victor, J. (2013). Binless Estimation of Mutual Information in Metric Spaces. Spike Timing: Mechanisms and Function, CRC Press. Chapter 5.","DOI":"10.1201\/b14859"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1152\/jn.00380.2014","article-title":"Extracting information in spike time patterns with wavelets and information theory","volume":"113","author":"Panzeri","year":"2015","journal-title":"J. Neurophysiol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1177\/1073858412445487","article-title":"The functional benefits of criticality in the cortex","volume":"19","author":"Shew","year":"2013","journal-title":"Neuroscientist"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1523\/JNEUROSCI.4637-10.2011","article-title":"Information capacity and transmission are maximized in balanced cortical networks with neuronal avalanches","volume":"31","author":"Shew","year":"2011","journal-title":"J. Neurosci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1162\/neco.1995.7.6.1129","article-title":"An information-maximization approach to blind separation and blind deconvolution","volume":"7","author":"Bell","year":"1995","journal-title":"Neural Comput."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3327","DOI":"10.1016\/S0042-6989(97)00121-1","article-title":"The \u201cindependent components\u201d of natural scenes are edge filters","volume":"37","author":"Bell","year":"1997","journal-title":"Vis. Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1740","DOI":"10.1162\/NECO_a_00292","article-title":"Fisher and Shannon information in finite neural populations","volume":"24","author":"Yarrow","year":"2012","journal-title":"Neural Comput."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1038\/nrn2578","article-title":"Extracting information from neuronal populations: Information theory and decoding approaches","volume":"10","author":"Quiroga","year":"2009","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1038\/nrn2575","article-title":"Complex brain networks: Graph theoretical analysis of structural and functional systems","volume":"10","author":"Bullmore","year":"2009","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1126\/science.1055465","article-title":"Modulation of oscillatory neuronal synchronization by selective visual attention","volume":"291","author":"Fries","year":"2001","journal-title":"Science"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1038\/35086012","article-title":"Correlated neuronal activity and the flow of neural information","volume":"2","author":"Salinas","year":"2001","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/S0896-6273(02)01169-8","article-title":"Mechanisms of gamma oscillations in the hippocampus of the behaving rat","volume":"37","author":"Csicsvari","year":"2003","journal-title":"Neuron"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1609","DOI":"10.1126\/science.1139597","article-title":"Modulation of neuronal interactions through neuronal synchronization","volume":"316","author":"Womelsdorf","year":"2007","journal-title":"Science"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1038\/nature08573","article-title":"Frequency of gamma oscillations routes flow of information in the hippocampus","volume":"462","author":"Colgin","year":"2009","journal-title":"Nature"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1038\/nrn4026","article-title":"Packet-based communication in the cortex","volume":"16","author":"Luczak","year":"2015","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1038\/nrn1686","article-title":"The cortex as a central pattern generator","volume":"6","author":"Yuste","year":"2005","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1152\/jn.1965.28.2.229","article-title":"Receptive fields and functional architecture in two non striate visual areas (18 and 19) of the cat","volume":"28","author":"Hubel","year":"1965","journal-title":"J. Neurophysiol."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"7940","DOI":"10.1523\/JNEUROSCI.23-21-07940.2003","article-title":"Binary coding in auditory cortex","volume":"23","author":"DeWeese","year":"2003","journal-title":"J. Neurosci."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.conb.2004.07.007","article-title":"Sparse coding of sensory inputs","volume":"14","author":"Olshausen","year":"2004","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Hrom\u00e1dka, T., DeWeese, M., and Zador, A. (2008). Sparse representation of sounds in the unanesthetized auditory cortex. PLoS Biol., 6.","DOI":"10.1371\/journal.pbio.0060016"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"2861","DOI":"10.1162\/neco_a_01005","article-title":"Rat Prefrontal Cortex Inactivations during Decision Making Are Explained by Bistable Attractor Dynamics","volume":"29","author":"Piet","year":"2017","journal-title":"Neural Comput."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1196","DOI":"10.1093\/cercor\/bhg100","article-title":"Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex","volume":"13","author":"Brody","year":"2003","journal-title":"Cereb. Cortex"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"13339","DOI":"10.1073\/pnas.93.23.13339","article-title":"How the brain keeps the eyes still","volume":"93","author":"Seung","year":"1996","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1038\/nn893","article-title":"Model for a robust neural integrator","volume":"5","author":"Koulakov","year":"2002","journal-title":"Nat. Neurosci."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1016\/j.neuron.2008.12.012","article-title":"Memory without feedback in a neural network","volume":"61","author":"Goldman","year":"2008","journal-title":"Neuron"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/S0959-4388(03)00050-3","article-title":"Basic mechanisms for graded persistent activity: Discrete attractors, continuous attractors, and dynamic representations","volume":"13","author":"Brody","year":"2003","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1016\/j.conb.2004.10.017","article-title":"Persistent neural activity: Prevalence and mechanisms","volume":"14","author":"Major","year":"2004","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1038\/nn1877","article-title":"Functional dissection of circuitry in a neural integrator","volume":"10","author":"Aksay","year":"2007","journal-title":"Nat. Neurosci."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1038\/nature12742","article-title":"Context-dependent computation by recurrent dynamics in prefrontal cortex","volume":"503","author":"Mante","year":"2013","journal-title":"Nature"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/2\/102\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:53:29Z","timestamp":1760194409000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/2\/102"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,1]]},"references-count":65,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2018,2]]}},"alternative-id":["e20020102"],"URL":"https:\/\/doi.org\/10.3390\/e20020102","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2018,2,1]]}}}