{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T08:55:55Z","timestamp":1765356955533},"reference-count":51,"publisher":"MIT Press - Journals","issue":"9","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,19]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Cortical pyramidal neurons receive inputs from multiple distinct neural populations and integrate these inputs in separate dendritic compartments. We explore the possibility that cortical microcircuits implement canonical correlation analysis (CCA), an unsupervised learning method that projects the inputs onto a common subspace so as to maximize the correlations between the projections. To this end, we seek a multichannel CCA algorithm that can be implemented in a biologically plausible neural network. For biological plausibility, we require that the network operates in the online setting and its synaptic update rules are local. Starting from a novel CCA objective function, we derive an online optimization algorithm whose optimization steps can be implemented in a single-layer neural network with multicompartmental neurons and local non-Hebbian learning rules. We also derive an extension of our online CCA algorithm with adaptive output rank and output whitening. Interestingly, the extension maps onto a neural network whose neural architecture and synaptic updates resemble neural circuitry and non-Hebbian plasticity observed in the cortex.<\/jats:p>","DOI":"10.1162\/neco_a_01414","type":"journal-article","created":{"date-parts":[[2021,6,30]],"date-time":"2021-06-30T21:34:23Z","timestamp":1625088863000},"page":"2309-2352","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":9,"title":["A Biologically Plausible Neural Network for Multichannel Canonical Correlation Analysis"],"prefix":"10.1162","volume":"33","author":[{"given":"David","family":"Lipshutz","sequence":"first","affiliation":[{"name":"Center for Computational Neuroscience, Flatiron Institute, New York, NY 10010, U.S.A. dlipshutz@flatironinstitute.org"}]},{"given":"Yanis","family":"Bahroun","sequence":"additional","affiliation":[{"name":"Center for Computational Neuroscience, Flatiron Institute, New York, NY 10010, U.S.A. ybahroun@flatironinstitute.org"}]},{"given":"Siavash","family":"Golkar","sequence":"additional","affiliation":[{"name":"Center for Computational Neuroscience, Flatiron Institute, New York, NY 10010, U.S.A. sgolkar@flatironinstitute.org"}]},{"given":"Anirvan M.","family":"Sengupta","sequence":"additional","affiliation":[{"name":"Center for Computational Neuroscience, Flatiron Institute, New York, NY 10010, U.S.A., and Department of Physics and Astronomy, Rutgers University, Piscataway, NJ 08854 U.S.A. anirvans@physics.rutgers.edu"}]},{"given":"Dmitri B.","family":"Chklovskii","sequence":"additional","affiliation":[{"name":"Center for Computational Neuroscience, Flatiron Institute, New York, NY 10010, U.S.A., and Neuroscience Institute, NYU Medical Center, New York, NY 10016, U.S.A. dchklovskii@flatironinstitute.org"}]}],"member":"281","published-online":{"date-parts":[[2021,8,19]]},"reference":[{"key":"2021121723254225500_B1","first-page":"4775","volume-title":"Advances in neural information processing systems, 30","author":"Arora","year":"2017"},{"key":"2021121723254225500_B2","article-title":"A convergence analysis of gradient descent for deep linear neural networks.","author":"Arora","year":"2019","journal-title":"Proceedings of the International Conference on Learning Representations"},{"key":"2021121723254225500_B3","author":"Bach","year":"2005","journal-title":"A probabilistic interpretation of canonical correlation analysis"},{"key":"2021121723254225500_B4","first-page":"7016","volume-title":"Advances in neural information processing systems","author":"Bhatia","year":"2018"},{"issue":"8","key":"2021121723254225500_B5","doi-asserted-by":"crossref","DOI":"10.1038\/nn.4062","article-title":"Conjunctive input processing drives feature selectivity in hippocampal CA1 neurons","volume":"18","author":"Bittner","year":"2015","journal-title":"Nature Neuroscience"},{"issue":"6355","key":"2021121723254225500_B6","doi-asserted-by":"crossref","first-page":"1033","DOI":"10.1126\/science.aan3846","article-title":"Behavioral time scale synaptic plasticity underlies CA1 place fields","volume":"357","author":"Bittner","year":"2017","journal-title":"Science"},{"issue":"5","key":"2021121723254225500_B7","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/S0167-6911(97)90015-3","article-title":"Stochastic approximation with two time scales","volume":"29","author":"Borkar","year":"1997","journal-title":"Systems and Control Letters"},{"key":"2021121723254225500_B8","author":"Borkar","year":"2009","journal-title":"Stochastic approximation: A dynamical systems viewpoint"},{"key":"2021121723254225500_B9","author":"Cox","year":"2000","journal-title":"Multidimensional scaling"},{"issue":"5965","key":"2021121723254225500_B10","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1126\/science.1179867","article-title":"Decorrelated neuronal firing in cortical microcircuits","volume":"327","author":"Ecker","year":"2010","journal-title":"Science"},{"issue":"7525","key":"2021121723254225500_B11","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1038\/nature13664","article-title":"Sensory-evoked LTP driven by dendritic plateau potentials in vivo","volume":"515","author":"Gambino","year":"2014","journal-title":"Nature"},{"issue":"6473","key":"2021121723254225500_B12","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1126\/science.aax6239","article-title":"Dendritic action potentials and computation in human layer 2\/3 cortical neurons","volume":"367","author":"Gidon","year":"2020","journal-title":"Science"},{"issue":"6895","key":"2021121723254225500_B13","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1038\/nature00854","article-title":"Dendritic spikes as a mechanism for cooperative long-term potentiation","volume":"418","author":"Golding","year":"2002","journal-title":"Nature"},{"key":"2021121723254225500_B14","first-page":"7283","volume-title":"Advances in neural information processing systems","author":"Golkar","year":"2020"},{"issue":"2","key":"2021121723254225500_B15","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/j.neunet.2003.07.002","article-title":"A canonical correlation neural network for multicollinearity and functional data","volume":"17","author":"Gou","year":"2004","journal-title":"Neural Networks"},{"key":"2021121723254225500_B16","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.22901","article-title":"Towards deep learning with segregated dendrites","volume":"6","author":"Guerguiev","year":"2017","journal-title":"eLife"},{"issue":"1","key":"2021121723254225500_B17","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-33513-9","article-title":"Dendritic processing of spontaneous neuronal sequences for single-trial learning","volume":"8","author":"Haga","year":"2018","journal-title":"Scientific Reports"},{"issue":"1","key":"2021121723254225500_B18","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1016\/j.geb.2011.05.014","article-title":"Multiple equilibria and limit cycles in evolutionary games with logit dynamics","volume":"74","author":"Hommes","year":"2012","journal-title":"Games and Economic Behavior"},{"issue":"3\u20134","key":"2021121723254225500_B19","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1093\/biomet\/28.3-4.321","article-title":"Relations between two sets of variates","volume":"28","author":"Hotelling","year":"1936","journal-title":"Biometrika"},{"issue":"13","key":"2021121723254225500_B20","doi-asserted-by":"crossref","first-page":"5475","DOI":"10.1523\/JNEUROSCI.4188-12.2013","article-title":"Inhibitory interneurons decorrelate excitatory cells to drive sparse code formation in a spiking model of V1","volume":"33","author":"King","year":"2013","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"2021121723254225500_B21","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1023\/A:1013776130161","article-title":"Supervised and unsupervised learning with two sites of synaptic integration","volume":"11","author":"K\u00f6rding","year":"2001","journal-title":"Journal of Computational Neuroscience"},{"issue":"10","key":"2021121723254225500_B22","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1016\/S0893-6080(99)00075-1","article-title":"A neural implementation of canonical correlation analysis","volume":"12","author":"Lai","year":"1999","journal-title":"Neural Networks"},{"issue":"3","key":"2021121723254225500_B23","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.tins.2012.11.006","article-title":"A cellular mechanism for cortical associations: An organizing principle for the cerebral cortex","volume":"36","author":"Larkum","year":"2013","journal-title":"Trends in Neurosciences"},{"issue":"5941","key":"2021121723254225500_B24","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1126\/science.1171958","article-title":"Synaptic integration in tuft dendrites of layer 5 pyramidal neurons: A new unifying principle","volume":"325","author":"Larkum","year":"2009","journal-title":"Science"},{"issue":"6725","key":"2021121723254225500_B25","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1038\/18686","article-title":"A new cellular mechanism for coupling inputs arriving at different cortical layers","volume":"398","author":"Larkum","year":"1999","journal-title":"Nature"},{"key":"2021121723254225500_B26","article-title":"On gradient descent ascent for nonconvex-concave minimax problems.","author":"Lin","year":"2020","journal-title":"Proceedings of the International Conference on Machine Learning"},{"key":"2021121723254225500_B27","first-page":"14986","volume-title":"Advances in neural information processing systems","author":"Lipshutz","year":"2020"},{"key":"2021121723254225500_B28","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1146\/annurev-neuro-090919-022842","article-title":"Synaptic plasticity forms and functions.","volume":"43","author":"Magee","year":"2020","journal-title":"Annual Review of Neuroscience"},{"key":"2021121723254225500_B29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1146\/annurev-neuro-062111-150343","article-title":"Active properties of neocortical pyramidal neuron dendrites","volume":"36","author":"Major","year":"2013","journal-title":"Annual Review of Neuroscience"},{"key":"2021121723254225500_B30","first-page":"2703","article-title":"Cycles in adversarial regularized learning.","author":"Mertikopoulos","year":"2018","journal-title":"Proceedings of the Twenty-Ninth Annual ACM-SIAM Symposium on Discrete Algorithms"},{"key":"2021121723254225500_B31","author":"Milstein","year":"2020","journal-title":"Bidirectional synaptic plasticity rapidly modifies hippocampal representations independent of correlated activity"},{"issue":"6","key":"2021121723254225500_B32","doi-asserted-by":"crossref","first-page":"1087","DOI":"10.1016\/j.neuron.2012.04.021","article-title":"Odor representations in olfactory cortex: Distributed rate coding and decorrelated population activity","volume":"74","author":"Miura","year":"2012","journal-title":"Neuron"},{"issue":"3","key":"2021121723254225500_B33","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1007\/BF00275687","article-title":"Simplified neuron model as a principal component analyzer","volume":"15","author":"Oja","year":"1982","journal-title":"Journal of Mathematical Biology"},{"key":"2021121723254225500_B34","first-page":"2269","volume-title":"Advances in neural information processing systems","author":"Pehlevan","year":"2015"},{"issue":"7","key":"2021121723254225500_B35","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1162\/NECO_a_00745","article-title":"A Hebbian\/anti-Hebbian neural network for linear subspace learning: A derivation from multidimensional scaling of streaming data","volume":"27","author":"Pehlevan","year":"2015","journal-title":"Neural Computation"},{"issue":"1","key":"2021121723254225500_B36","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1162\/neco_a_01018","article-title":"Why do similarity matching objectives lead to Hebbian\/anti-Hebbian networks?","volume":"30","author":"Pehlevan","year":"2018","journal-title":"Neural Computation"},{"issue":"55","key":"2021121723254225500_B37","article-title":"Neurons as canonical correlation analyzers.","volume":"15","author":"Pehlevan","year":"2020","journal-title":"Frontiers in Computational Neuroscience"},{"issue":"5\u20136","key":"2021121723254225500_B38","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1016\/S0893-6080(03)00112-6","article-title":"A network for recursive extraction of canonical coordinates","volume":"16","author":"Pezeshki","year":"2003","journal-title":"Neural Networks"},{"key":"2021121723254225500_B39","first-page":"86","article-title":"A Hebbian\/anti-Hebbian network which optimizes information capacity by orthonormalizing the principal subspace.","author":"Plumbley","year":"1993","journal-title":"Proceedings of the 1993 Third International Conference on Artificial Neural Networks"},{"issue":"5","key":"2021121723254225500_B40","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/MSP.2020.3003851","article-title":"Nonconvex min-max optimization: Applications, challenges, and recent theoretical advances","volume":"37","author":"Razaviyayn","year":"2020","journal-title":"IEEE Signal Processing Magazine"},{"key":"2021121723254225500_B41","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.conb.2018.08.003","article-title":"Dendritic solutions to the credit assignment problem","volume":"54","author":"Richards","year":"2019","journal-title":"Current Opinion in Neurobiology"},{"key":"2021121723254225500_B42","first-page":"8721","volume-title":"Advances in neural information processing systems","author":"Sacramento","year":"2018"},{"issue":"2","key":"2021121723254225500_B43","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.neuron.2006.06.017","article-title":"A cooperative switch determines the sign of synaptic plasticity in distal dendrites of neocortical pyramidal neurons","volume":"51","author":"Sj\u00f6str\u00f6m","year":"2006","journal-title":"Neuron"},{"key":"2021121723254225500_B44","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1145\/1180639.1180727","article-title":"The challenge problem for automated detection of 101 semantic concepts in multimedia.","author":"Snoek","year":"2006","journal-title":"Proceedings of the 14th ACM International Conference on Multimedia"},{"issue":"1","key":"2021121723254225500_B45","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.neuron.2009.03.007","article-title":"Pathway interactions and synaptic plasticity in the dendritic tuft regions of CA1 pyramidal neurons","volume":"62","author":"Takahashi","year":"2009","journal-title":"Neuron"},{"issue":"1","key":"2021121723254225500_B46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms10289","article-title":"Coordinated activation of distinct Ca2+ sources and metabotropic glutamate receptors encodes Hebbian synaptic plasticity","volume":"7","author":"Tigaret","year":"2016","journal-title":"Nature Communications"},{"issue":"3","key":"2021121723254225500_B47","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1016\/j.neuron.2013.11.030","article-title":"Learning by the dendritic prediction of somatic spiking","volume":"81","author":"Urbanczik","year":"2014","journal-title":"Neuron"},{"key":"2021121723254225500_B48","author":"Velu","year":"2013","journal-title":"Multivariate reduced-rank regression: Theory and applications"},{"issue":"1","key":"2021121723254225500_B49","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.neunet.2006.09.011","article-title":"A learning algorithm for adaptive canonical correlation analysis of several data sets","volume":"20","author":"V\u00eda","year":"2007","journal-title":"Neural Networks"},{"issue":"3","key":"2021121723254225500_B50","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1038\/s41593-019-0576-z","article-title":"Whitening of odor representations by the wiring diagram of the olfactory bulb","volume":"23","author":"Wanner","year":"2020","journal-title":"Nature Neuroscience"},{"key":"2021121723254225500_B51","first-page":"675","volume-title":"Advances in neural information processing systems","author":"Williams","year":"2001"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/33\/9\/2309\/1978152\/neco_a_01414.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/33\/9\/2309\/1978152\/neco_a_01414.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,17]],"date-time":"2021-12-17T23:27:10Z","timestamp":1639783630000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/33\/9\/2309\/102622\/A-Biologically-Plausible-Neural-Network-for"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,19]]},"references-count":51,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,8,19]]},"published-print":{"date-parts":[[2021,8,19]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01414","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,9]]},"published":{"date-parts":[[2021,8,19]]}}}