{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T17:03:11Z","timestamp":1775926991474,"version":"3.50.1"},"reference-count":106,"publisher":"MIT Press","issue":"5","license":[{"start":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T00:00:00Z","timestamp":1713916800000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,4,23]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Deep feedforward and recurrent neural networks have become successful functional models of the brain, but they neglect obvious biological details such as spikes and Dale\u2019s law. Here we argue that these details are crucial in order to understand how real neural circuits operate. Towards this aim, we put forth a new framework for spike-based computation in low-rank excitatory-inhibitory spiking networks. By considering populations with rank-1 connectivity, we cast each neuron\u2019s spiking threshold as a boundary in a low-dimensional input-output space. We then show how the combined thresholds of a population of inhibitory neurons form a stable boundary in this space, and those of a population of excitatory neurons form an unstable boundary. Combining the two boundaries results in a rank-2 excitatory-inhibitory (EI) network with inhibition-stabilized dynamics at the intersection of the two boundaries. The computation of the resulting networks can be understood as the difference of two convex functions and is thereby capable of approximating arbitrary non-linear input-output mappings. We demonstrate several properties of these networks, including noise suppression and amplification, irregular activity and synaptic balance, as well as how they relate to rate network dynamics in the limit that the boundary becomes soft. Finally, while our work focuses on small networks (5-50 neurons), we discuss potential avenues for scaling up to much larger networks. Overall, our work proposes a new perspective on spiking networks that may serve as a starting point for a mechanistic understanding of biological spike-based computation.<\/jats:p>","DOI":"10.1162\/neco_a_01658","type":"journal-article","created":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T23:22:50Z","timestamp":1714000970000},"page":"803-857","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":17,"title":["Approximating Nonlinear Functions With Latent Boundaries in Low-Rank Excitatory-Inhibitory Spiking Networks"],"prefix":"10.1162","volume":"36","author":[{"given":"William F.","family":"Podlaski","sequence":"first","affiliation":[{"name":"Champalimaud Neuroscience Programme, Champalimaud Foundation, 1400-038 Lisbon, Portugal william.podlaski@research.fchampalimaud.org"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian K.","family":"Machens","sequence":"additional","affiliation":[{"name":"Champalimaud Neuroscience Programme, Champalimaud Foundation, 1400-038 Lisbon, Portugal christian.machens@neuro.fchampalimaud.org"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2024,4,23]]},"reference":[{"issue":"3","key":"2024042423224122100_bib1","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1038\/nn.4241","article-title":"Building functional networks of spiking model neurons","volume":"19","author":"Abbott","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"21","key":"2024042423224122100_bib2","doi-asserted-by":"publisher","first-page":"3373","DOI":"10.1016\/j.neuron.2021.07.031","article-title":"What is the dynamical regime of cerebral cortex?","volume":"109","author":"Ahmadian","year":"2021","journal-title":"Neuron"},{"issue":"8","key":"2024042423224122100_bib3","doi-asserted-by":"publisher","first-page":"1994","DOI":"10.1162\/NECO_a_00472","article-title":"Analysis of the stabilized supralinear network","volume":"25","author":"Ahmadian","year":"2013","journal-title":"Neural Computation"},{"key":"2024042423224122100_bib4","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11320","article-title":"Learning nonlinear dynamics in efficient, balanced spiking networks using local plasticity rules","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Alemi","year":"2018"},{"issue":"3","key":"2024042423224122100_bib5","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1093\/cercor\/7.3.237","article-title":"Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex","volume":"7","author":"Amit","year":"1997","journal-title":"Cerebral Cortex"},{"key":"2024042423224122100_bib6","first-page":"136","article-title":"OptNet: Differentiable optimization as a layer in neural networks","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Amos","year":"2017"},{"issue":"8\u20139","key":"2024042423224122100_bib7","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1080\/02331931003770411","article-title":"On difference convexity of locally Lipschitz functions","volume":"60","author":"Ba\u010d\u00e1k","year":"2011","journal-title":"Optimization"},{"issue":"9","key":"2024042423224122100_bib8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1008192","article-title":"Nonlinear stimulus representations in neural circuits with approximate excitatory-inhibitory balance","volume":"16","author":"Baker","year":"2020","journal-title":"PLOS Computational Biology"},{"key":"2024042423224122100_bib9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.conb.2017.06.003","article-title":"Recurrent neural networks as versatile tools of neuroscience research","volume":"46","author":"Barak","year":"2017","journal-title":"Current Opinion in Neurobiology"},{"key":"2024042423224122100_bib10","article-title":"Firing rate predictions in optimal balanced networks","volume-title":"Advances in neural information processing systems","author":"Barrett","year":"2013"},{"key":"2024042423224122100_bib11","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.12454","article-title":"Optimal compensation for neuron loss","volume":"5","author":"Barrett","year":"2016","journal-title":"eLife"},{"key":"2024042423224122100_bib12","article-title":"Long short-term memory and learning-to-learn in networks of spiking neurons","volume-title":"Advances in neural information processing systems","author":"Bellec","year":"2018"},{"issue":"15","key":"2024042423224122100_bib13","doi-asserted-by":"crossref","first-page":"3037","DOI":"10.1113\/JP282755","article-title":"How to incorporate biological insights into network models and why it matters","volume":"601","author":"Bern\u00e1ez Tim\u00f3n","year":"2022","journal-title":"Journal of Physiology"},{"issue":"11","key":"2024042423224122100_bib14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003258","article-title":"Predictive coding of dynamical variables in balanced spiking networks","volume":"9","author":"Boerlin","year":"2013","journal-title":"PLOS Computational Biology"},{"key":"2024042423224122100_bib15","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511804441","volume-title":"Convex optimization","author":"Boyd","year":"2004"},{"issue":"3","key":"2024042423224122100_bib16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1007692","article-title":"Learning to represent signals spike by spike","volume":"16","author":"Brendel","year":"2020","journal-title":"PLOS Computational Biology"},{"key":"2024042423224122100_bib17","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1023\/A:1008925309027","article-title":"Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons","volume":"8","author":"Brunel","year":"2000","journal-title":"Journal of Computational Neuroscience"},{"key":"2024042423224122100_bib18","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.73276","article-title":"The geometry of robustness in spiking neural networks","volume":"11","author":"Calaim","year":"2022","journal-title":"eLife"},{"key":"2024042423224122100_bib19","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.13824","article-title":"Neural oscillations as a signature of efficient coding in the presence of synaptic delays","volume":"5","author":"Chalk","year":"2016","journal-title":"eLife"},{"key":"2024042423224122100_bib20","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/j.conb.2021.10.010","article-title":"Neural population geometry: An approach for understanding biological and artificial neural networks","volume":"70","author":"Chung","year":"2021","journal-title":"Current Opinion in Neurobiology"},{"issue":"8","key":"2024042423224122100_bib21","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1011315","article-title":"Geometry of population activity in spiking networks with low-rank structure","volume":"19","author":"Cime\u0161a","year":"2023","journal-title":"PLOS Computational Biology"},{"key":"2024042423224122100_bib22","author":"Cornford","year":"2021","journal-title":"Proceedings of the 9th International Conference on Learning Representations"},{"issue":"11","key":"2024042423224122100_bib23","doi-asserted-by":"publisher","first-page":"1500","DOI":"10.1038\/nn.3776","article-title":"Dimensionality reduction for large-scale neural recordings","volume":"17","author":"Cunningham","year":"2014","journal-title":"Nature Neuroscience"},{"key":"2024042423224122100_bib24","volume-title":"Theoretical neuroscience: Computational and mathematical modeling of neural systems","author":"Dayan","year":"2005"},{"issue":"3","key":"2024042423224122100_bib25","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1038\/nn.4243","article-title":"Efficient codes and balanced networks","volume":"19","author":"Den\u00e8ve","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"5","key":"2024042423224122100_bib26","doi-asserted-by":"crossref","DOI":"10.1016\/j.neuron.2022.12.007","article-title":"The centrality of population-level factors to network computation is demonstrated by a versatile approach for training spiking networks","volume":"3","author":"DePasquale","year":"2023","journal-title":"Neuron"},{"issue":"6","key":"2024042423224122100_bib27","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1038\/s41593-022-01088-4","article-title":"The role of population structure in computations through neural dynamics","volume":"25","author":"Dubreuil","year":"2022","journal-title":"Nature Neuroscience"},{"issue":"2","key":"2024042423224122100_bib28","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1098\/rsnr.1976.0015","article-title":"From electrical to chemical transmission in the central nervous system: The closing address of the Sir Henry Dale Centennial Symposium Cambridge, 19 September 1975","volume":"30","author":"Eccles","year":"1976","journal-title":"Notes and Records of the Royal Society of London"},{"issue":"6","key":"2024042423224122100_bib29","doi-asserted-by":"publisher","first-page":"1276","DOI":"10.1162\/0899766053630332","article-title":"A unified approach to building and controlling spiking attractor networks","volume":"17","author":"Eliasmith","year":"2005","journal-title":"Neural Computation"},{"key":"2024042423224122100_bib30","volume-title":"Neural engineering: Computation, representation, and dynamics in neurobiological systems","author":"Eliasmith","year":"2003"},{"key":"2024042423224122100_bib31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.conb.2013.09.009","article-title":"The use and abuse of large-scale brain models","volume":"25","author":"Eliasmith","year":"2014","journal-title":"Current Opinion in Neurobiology"},{"issue":"9","key":"2024042423224122100_bib32","doi-asserted-by":"publisher","first-page":"2057","DOI":"10.1162\/089976602320264015","article-title":"Dynamics of the firing probability of noisy integrate-and-fire neurons","volume":"14","author":"Fourcaud","year":"2002","journal-title":"Neural Computation"},{"issue":"1","key":"2024042423224122100_bib33","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.neuron.2007.09.012","article-title":"Perisomatic inhibition","volume":"56","author":"Freund","year":"2007","journal-title":"Neuron"},{"key":"2024042423224122100_bib34","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/j.conb.2016.01.010","article-title":"Why neurons mix: High dimensionality for higher cognition","volume":"37","author":"Fusi","year":"2016","journal-title":"Current Opinion in Neurobiology"},{"issue":"5","key":"2024042423224122100_bib35","doi-asserted-by":"publisher","first-page":"978","DOI":"10.1016\/j.neuron.2017.05.025","article-title":"Neural manifolds for the control of movement","volume":"94","author":"Gallego","year":"2017","journal-title":"Neuron"},{"key":"2024042423224122100_bib36","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781107447615","volume-title":"Neuronal dynamics: From single neurons to networks and models of cognition","author":"Gerstner","year":"2014"},{"issue":"8","key":"2024042423224122100_bib37","first-page":"3988","article-title":"Deep declarative networks","volume":"44","author":"Gould","year":"2021","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2024042423224122100_bib38","author":"Haber","year":"2022","journal-title":"36th Conference on Neural Information Processing Systems"},{"issue":"17","key":"2024042423224122100_bib39","doi-asserted-by":"publisher","first-page":"4535","DOI":"10.1523\/JNEUROSCI.5297-05.2006","article-title":"Neocortical network activity in vivo is generated through a dynamic balance of excitation and inhibition","volume":"26","author":"Haider","year":"2006","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"2024042423224122100_bib40","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1523\/JNEUROSCI.3455-12.2013","article-title":"Short-term plasticity explains irregular persistent activity in working memory tasks","volume":"33","author":"Hansel","year":"2013","journal-title":"Journal of Neuroscience"},{"issue":"12","key":"2024042423224122100_bib41","doi-asserted-by":"publisher","first-page":"5118","DOI":"10.1523\/JNEUROSCI.22-12-05118.2002","article-title":"How noise contributes to contrast invariance of orientation tuning in cat visual cortex","volume":"22","author":"Hansel","year":"2002","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"2024042423224122100_bib42","doi-asserted-by":"publisher","first-page":"707","DOI":"10.2140\/pjm.1959.9.707","article-title":"On functions representable as a difference of convex functions","volume":"9","author":"Hartman","year":"1959","journal-title":"Pacific Journal of Mathematics"},{"issue":"4","key":"2024042423224122100_bib43","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1016\/j.neuron.2018.04.017","article-title":"The dynamical regime of sensory cortex: Stable dynamics around a single stimulus-tuned attractor account for patterns of noise variability","volume":"98","author":"Hennequin","year":"2018","journal-title":"Neuron"},{"issue":"6","key":"2024042423224122100_bib44","doi-asserted-by":"publisher","first-page":"1394","DOI":"10.1016\/j.neuron.2014.04.045","article-title":"Optimal control of transient dynamics in balanced networks supports generation of complex movements","volume":"82","author":"Hennequin","year":"2014","journal-title":"Neuron"},{"key":"2024042423224122100_bib45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1023\/A:1021765131316","article-title":"DC programming: Overview","volume":"103","author":"Horst","year":"1999","journal-title":"Journal of Optimization Theory and Applications"},{"issue":"2","key":"2024042423224122100_bib46","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1016\/j.neuron.2018.11.034","article-title":"Circuit models of low-dimensional shared variability in cortical networks","volume":"101","author":"Huang","year":"2019","journal-title":"Neuron"},{"key":"2024042423224122100_bib47","author":"Hunsberger","year":"2015","journal-title":"Spiking deep networks with LIF neurons."},{"issue":"8","key":"2024042423224122100_bib48","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0220547","article-title":"Training dynamically balanced excitatory-inhibitory networks","volume":"14","author":"Ingrosso","year":"2019","journal-title":"PLOS One"},{"key":"2024042423224122100_bib49","volume-title":"Dynamical systems in neuroscience","author":"Izhikevich","year":"2007"},{"key":"2024042423224122100_bib50","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.conb.2021.08.002","article-title":"Interpreting neural computations by examining intrinsic and embedding dimensionality of neural activity","volume":"70","author":"Jazayeri","year":"2021","journal-title":"Current Opinion in Neurobiology"},{"key":"2024042423224122100_bib51","first-page":"16677","article-title":"Predictive coding in balanced neural networks with noise, chaos and delays","volume-title":"Advances in neural information processing systems","author":"Kadmon","year":"2020"},{"key":"2024042423224122100_bib52","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.conb.2019.09.001","article-title":"Neuroscience out of control: Control-theoretic perspectives on neural circuit dynamics","volume":"58","author":"Kao","year":"2019","journal-title":"Current Opinion in Neurobiology"},{"key":"2024042423224122100_bib53","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1016\/j.conb.2019.09.004","article-title":"Decoding and encoding (de)mixed population responses","volume":"58","author":"Keemink","year":"2019","journal-title":"Current Opinion in Neurobiology"},{"issue":"5","key":"2024042423224122100_bib54","doi-asserted-by":"publisher","first-page":"1199","DOI":"10.1162\/neco_a_01379","article-title":"Training spiking neural networks in the strong coupling regime","volume":"33","author":"Kim","year":"2021","journal-title":"Neural Computation"},{"key":"2024042423224122100_bib55","first-page":"20607","article-title":"Biologically plausible solutions for spiking networks with efficient coding","volume-title":"Advances in neural information processing systems","author":"Koren","year":"2022"},{"issue":"1","key":"2024042423224122100_bib56","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1080\/02331938708843210","article-title":"Piecewise affine functions as a difference of two convex functions","volume":"18","author":"Kripfganz","year":"1987","journal-title":"Optimization"},{"issue":"12","key":"2024042423224122100_bib57","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005258","article-title":"Encoding in balanced networks: Revisiting spike patterns and chaos in stimulus-driven systems","volume":"12","author":"Lajoie","year":"2016","journal-title":"PLOS Computational Biology"},{"issue":"12","key":"2024042423224122100_bib58","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1006309","article-title":"Coherent chaos in a recurrent neural network with structured connectivity","volume":"14","author":"Landau","year":"2018","journal-title":"PLOS Computational Biology"},{"issue":"2","key":"2024042423224122100_bib59","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevResearch.3.023171","article-title":"Macroscopic fluctuations emerge in balanced networks with incomplete recurrent alignment","volume":"3","author":"Landau","year":"2021","journal-title":"Physical Review Research"},{"key":"2024042423224122100_bib60","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1038\/s41583-023-00693-x","article-title":"A unifying perspective on neural manifolds and circuits for cognition","volume":"24","author":"Langdon","year":"2023","journal-title":"Nature Reviews Neuroscience"},{"key":"2024042423224122100_bib61","author":"Li","year":"2023","journal-title":"37th Conference on Neural Information Processing Systems"},{"key":"2024042423224122100_bib62","first-page":"4894","article-title":"Minimax dynamics of optimally balanced spiking networks of excitatory and inhibitory neurons","volume-title":"Advances in neural information processing systems","author":"Li","year":"2020"},{"issue":"10","key":"2024042423224122100_bib63","doi-asserted-by":"publisher","first-page":"2017","DOI":"10.1162\/jocn_a_01544","article-title":"Convolutional neural networks as a model of the visual system: Past, present, and future","volume":"33","author":"Lindsay","year":"2021","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2024042423224122100_bib64","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1007\/s11081-015-9294-x","article-title":"Variations and extension of the convex\u2013concave procedure","volume":"17","author":"Lipp","year":"2016","journal-title":"Optimization and Engineering"},{"key":"2024042423224122100_bib65","first-page":"8824","article-title":"Understanding spiking networks through convex optimization","volume-title":"Advances in neural information processing systems","author":"Mancoo","year":"2020"},{"issue":"1","key":"2024042423224122100_bib66","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/cercor\/4.1.1","article-title":"A brief history of the \u201cfeature detector.\u201d","volume":"4","author":"Martin","year":"1994","journal-title":"Cerebral Cortex"},{"key":"2024042423224122100_bib67","first-page":"22018","article-title":"Natural gradient enables fast sampling in spiking neural networks","volume-title":"Advances in neural information processing systems","author":"Masset","year":"2022"},{"issue":"3","key":"2024042423224122100_bib68","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1016\/j.neuron.2018.07.003","article-title":"Linking connectivity, dynamics, and computations in low-rank recurrent neural networks","volume":"99","author":"Mastrogiuseppe","year":"2018","journal-title":"Neuron"},{"key":"2024042423224122100_bib69","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1007\/BFb0121142","article-title":"On the expressibility of piecewise-linear continuous functions as the difference of two piecewise-linear convex functions","volume-title":"Quasidifferential calculus","author":"Melzer","year":"1986"},{"key":"2024042423224122100_bib70","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.20899","article-title":"Biologically plausible learning in recurrent neural networks reproduces neural dynamics observed during cognitive tasks","volume":"6","author":"Miconi","year":"2017","journal-title":"eLife"},{"issue":"50","key":"2024042423224122100_bib71","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2021925118","article-title":"Local dendritic balance enables learning of efficient representations in networks of spiking neurons","volume":"118","author":"Mikulasch","year":"2021","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2","key":"2024042423224122100_bib72","doi-asserted-by":"publisher","first-page":"653","DOI":"10.1152\/jn.00425.2001","article-title":"Neural noise can explain expansive, power-law nonlinearities in neural response functions","volume":"87","author":"Miller","year":"2002","journal-title":"Journal of Neurophysiology"},{"key":"2024042423224122100_bib73","doi-asserted-by":"publisher","DOI":"10.24072\/pcjournal.69","article-title":"Nonlinear computations in spiking neural networks through multiplicative synapses","volume":"1","author":"Nardin","year":"2021","journal-title":"Peer Community Journal"},{"issue":"6","key":"2024042423224122100_bib74","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1109\/MSP.2019.2931595","article-title":"Surrogate gradient learning in spiking neural networks: Bringing the power of gradient-based optimization to spiking neural networks","volume":"36","author":"Neftci","year":"2019","journal-title":"IEEE Signal Processing Magazine"},{"issue":"14","key":"2024042423224122100_bib75","doi-asserted-by":"publisher","first-page":"R656","DOI":"10.1016\/j.cub.2016.05.029","article-title":"Dimensionality reduction in neuroscience","volume":"26","author":"Pang","year":"2016","journal-title":"Current Biology"},{"issue":"6","key":"2024042423224122100_bib76","doi-asserted-by":"publisher","first-page":"1473","DOI":"10.1162\/neco.2008.07-06-295","article-title":"Solving the problem of negative synaptic weights in cortical models","volume":"20","author":"Parisien","year":"2008","journal-title":"Neural Computation"},{"issue":"5965","key":"2024042423224122100_bib77","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1126\/science.1179850","article-title":"The asynchronous state in cortical circuits","volume":"327","author":"Renart","year":"2010","journal-title":"Science"},{"issue":"1","key":"2024042423224122100_bib78","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/neco.2007.19.1.1","article-title":"Mean-driven and fluctuation-driven persistent activity in recurrent networks","volume":"19","author":"Renart","year":"2007","journal-title":"Neural Computation"},{"key":"2024042423224122100_bib79","doi-asserted-by":"crossref","DOI":"10.1515\/9781400873173","volume-title":"Convex analysis","author":"Rockafellar","year":"1970"},{"issue":"1","key":"2024042423224122100_bib80","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1038\/nn.4433","article-title":"The spatial structure of correlated neuronal variability","volume":"20","author":"Rosenbaum","year":"2017","journal-title":"Nature Neuroscience"},{"issue":"9","key":"2024042423224122100_bib81","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.0030141","article-title":"A balanced memory network","volume":"3","author":"Roudi","year":"2007","journal-title":"PLOS Computational Biology"},{"issue":"2","key":"2024042423224122100_bib82","doi-asserted-by":"publisher","first-page":"402","DOI":"10.1016\/j.neuron.2014.12.026","article-title":"The stabilized supralinear network: A unifying circuit motif underlying multi-input integration in sensory cortex","volume":"85","author":"Rubin","year":"2015","journal-title":"Neuron"},{"issue":"11","key":"2024042423224122100_bib83","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1008261","article-title":"Poisson balanced spiking networks","volume":"16","author":"Rull\u00e1n Bux\u00f3","year":"2020","journal-title":"PLOS Computational Biology"},{"issue":"1","key":"2024042423224122100_bib84","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1038\/s41583-020-00390-z","article-title":"Inhibitory stabilization and cortical computation","volume":"22","author":"Sadeh","year":"2021","journal-title":"Nature Reviews Neuroscience"},{"key":"2024042423224122100_bib85","author":"Safavi","year":"2023","journal-title":"Signatures of criticality in efficient coding networks"},{"key":"2024042423224122100_bib86","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.conb.2019.02.002","article-title":"Towards the neural population doctrine","volume":"55","author":"Saxena","year":"2019","journal-title":"Current Opinion in Neurobiology"},{"issue":"28","key":"2024042423224122100_bib87","doi-asserted-by":"publisher","first-page":"10112","DOI":"10.1523\/JNEUROSCI.4951-14.2015","article-title":"Constructing precisely computing networks with biophysical spiking neurons","volume":"35","author":"Schwemmer","year":"2015","journal-title":"Journal of Neuroscience"},{"issue":"5","key":"2024042423224122100_bib88","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2022.3163926","article-title":"Spiking control systems","volume":"110","author":"Sepulchre","year":"2022","journal-title":"Proceedings of the IEEE"},{"key":"2024042423224122100_bib89","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1146\/annurev-control-053018-023708","article-title":"Control across scales by positive and negative feedback","volume":"2","author":"Sepulchre","year":"2019","journal-title":"Annual Review of Control, Robotics, and Autonomous Systems"},{"issue":"23","key":"2024042423224122100_bib90","doi-asserted-by":"publisher","first-page":"13339","DOI":"10.1073\/pnas.93.23.13339","article-title":"How the brain keeps the eyes still","volume":"93","author":"Seung","year":"1996","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"2024042423224122100_bib91","article-title":"Minimax and Hamiltonian dynamics of excitatory-inhibitory networks","volume-title":"Advances in neural information processing systems","author":"Seung","year":"1997"},{"issue":"10","key":"2024042423224122100_bib92","doi-asserted-by":"publisher","first-page":"3870","DOI":"10.1523\/JNEUROSCI.18-10-03870.1998","article-title":"The variable discharge of cortical neurons: Implications for connectivity, computation, and information coding","volume":"18","author":"Shadlen","year":"1998","journal-title":"Journal of Neuroscience"},{"issue":"1","key":"2024042423224122100_bib93","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1010855","article-title":"Relating local connectivity and global dynamics in recurrent excitatory-inhibitory networks","volume":"19","author":"Shao","year":"2023","journal-title":"PLOS Computational Biology"},{"key":"2024042423224122100_bib94","first-page":"8895","article-title":"Piecewise linear re- gression via a difference of convex functions","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Siahkamari","year":"2020"},{"key":"2024042423224122100_bib95","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2023.3320251","author":"Slijkhuis","year":"","journal-title":"IEEE Transactions on Cognitive and Developmental Systems"},{"issue":"1","key":"2024042423224122100_bib96","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1523\/JNEUROSCI.13-01-00334.1993","article-title":"The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs","volume":"13","author":"Softky","year":"1993","journal-title":"Journal of Neuroscience"},{"issue":"2","key":"2024042423224122100_bib97","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1004792","article-title":"Training excitatory-inhibitory recurrent neural networks for cognitive tasks: A simple and flexible framework","volume":"12","author":"Song","year":"2016","journal-title":"PLOS Computational Biology"},{"key":"2024042423224122100_bib98","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.conb.2014.01.008","article-title":"Neural circuits as computational dynamical systems","volume":"25","author":"Sussillo","year":"2014","journal-title":"Current Opinion in Neurobiology"},{"issue":"6","key":"2024042423224122100_bib99","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004895","article-title":"Learning universal computations with spikes","volume":"12","author":"Thalmeier","year":"2016","journal-title":"PLOS Computational Biology"},{"issue":"5293","key":"2024042423224122100_bib100","doi-asserted-by":"publisher","first-page":"1724","DOI":"10.1126\/science.274.5293.1724","article-title":"Chaos in neuronal networks with balanced excitatory and inhibitory activity","volume":"274","author":"Van Vreeswijk","year":"1996","journal-title":"Science"},{"issue":"46","key":"2024042423224122100_bib101","doi-asserted-by":"publisher","first-page":"10786","DOI":"10.1523\/JNEUROSCI.3508-05.2005","article-title":"Signal propagation and logic gating in networks of integrate-and-fire neurons","volume":"25","author":"Vogels","year":"2005","journal-title":"Journal of Neuroscience"},{"key":"2024042423224122100_bib102","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1146\/annurev-neuro-092619-094115","article-title":"Computation through neural population dynamics","volume":"43","author":"Vyas","year":"2020","journal-title":"Annual Review of Neuroscience"},{"issue":"1","key":"2024042423224122100_bib103","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S0006-3495(72)86068-5","article-title":"Excitatory and inhibitory interactions in localized populations of model neurons","volume":"12","author":"Wilson","year":"1972","journal-title":"Biophysical Journal"},{"issue":"3","key":"2024042423224122100_bib104","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1038\/nn.4244","article-title":"Using goal-driven deep learning models to understand sensory cortex","volume":"19","author":"Yamins","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"4","key":"2024042423224122100_bib105","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1162\/08997660360581958","article-title":"The concave-convex procedure","volume":"15","author":"Yuille","year":"2003","journal-title":"Neural Computation"},{"issue":"4","key":"2024042423224122100_bib106","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1162\/neco_a_01367","article-title":"The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks","volume":"33","author":"Zenke","year":"2021","journal-title":"Neural Computation"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/36\/5\/803\/2366854\/neco_a_01658.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/36\/5\/803\/2366854\/neco_a_01658.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T23:23:09Z","timestamp":1714000989000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/36\/5\/803\/120324\/Approximating-Nonlinear-Functions-With-Latent"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,23]]},"references-count":106,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,4,23]]},"published-print":{"date-parts":[[2024,4,23]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01658","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,5]]},"published":{"date-parts":[[2024,4,23]]}}}