{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T08:41:38Z","timestamp":1775896898237,"version":"3.50.1"},"reference-count":48,"publisher":"MIT Press","issue":"12","license":[{"start":{"date-parts":[[2024,2,6]],"date-time":"2024-02-06T00:00:00Z","timestamp":1707177600000},"content-version":"vor","delay-in-days":36,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100006377","name":"Purdue University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006377","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NIH CTSI Indiana State Department of Health","award":["20000703"],"award-info":[{"award-number":["20000703"]}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The two visual cortical streams hypothesis, which suggests object properties (what) are processed separately from spatial properties (where), has a longstanding history, and much evidence has accumulated to support its conjectures. Nevertheless, in the last few decades, conflicting evidence has mounted that demands some explanation and modification. For example, existence of (1) shape activities (fMRI) or shape selectivities (physiology) in dorsal stream, similar to ventral stream; likewise, spatial activations (fMRI) or spatial selectivities (physiology) in ventral stream, similar to dorsal stream; (2) multiple segregated subpathways within a stream. In addition, the idea of segregation of various aspects of multiple objects in a scene raises questions about how these properties of multiple objects are then properly re-associated or bound back together to accurately perceive, remember, or make decisions. We will briefly review the history of the two-stream hypothesis, discuss competing accounts that challenge current thinking, and propose ideas on why the brain has segregated pathways. We will present ideas based on our own data using artificial neural networks (1) to reveal encoding differences for what and where that arise in a two-pathway neural network, (2) to show how these encoding differences can clarify previous conflicting findings, and (3) to elucidate the computational advantages of segregated pathways. Furthermore, we will discuss whether neural networks need to have multiple subpathways for different visual attributes. We will also discuss the binding problem (how to correctly associate the different attributes of each object together when there are multiple objects each with multiple attributes in a scene) and possible solutions to the binding problem. Finally, we will briefly discuss problems and limitations with existing models and potential fruitful future directions.<\/jats:p>","DOI":"10.1162\/jocn_a_02121","type":"journal-article","created":{"date-parts":[[2024,2,6]],"date-time":"2024-02-06T17:44:12Z","timestamp":1707241452000},"page":"2618-2626","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":3,"title":["Understanding Cortical Streams from a Computational Perspective"],"prefix":"10.1162","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5953-8521","authenticated-orcid":true,"given":"Zhixian","family":"Han","sequence":"first","affiliation":[{"name":"Purdue University"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2870-4985","authenticated-orcid":true,"given":"Anne B.","family":"Sereno","sequence":"additional","affiliation":[{"name":"Purdue University"},{"name":"Indiana University School of Medicine"}]}],"member":"281","published-online":{"date-parts":[[2024,12,1]]},"reference":[{"key":"2024112514543842500_bib1","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1152\/jn.00795.2010","article-title":"Organization of the macaque extrastriate visual cortex re-examined using the principle of spatial continuity of function","volume":"105","author":"Aflalo","year":"2011","journal-title":"Journal of Neurophysiology"},{"key":"2024112514543842500_bib2","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1097\/00001756-200004270-00027","article-title":"Eye position effects in macaque area V4","volume":"11","author":"Bremmer","year":"2000","journal-title":"NeuroReport"},{"key":"2024112514543842500_bib3","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1098\/rstb.1888.0011","article-title":"XI. An investigation into the functions of the occipital and temporal lobes of the monkey's brain","volume":"179","author":"Brown","year":"1888","journal-title":"Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences"},{"key":"2024112514543842500_bib4","first-page":"1597","article-title":"A simple framework for contrastive learning of visual representations","volume":"119","author":"Chen","year":"2020","journal-title":"Proceedings of the 37th International Conference on Machine Learning"},{"key":"2024112514543842500_bib5","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1146\/annurev.neuro.22.1.319","article-title":"Space and attention in parietal cortex","volume":"22","author":"Colby","year":"1999","journal-title":"Annual Review of Neuroscience"},{"key":"2024112514543842500_bib6","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1093\/cercor\/6.1.39","article-title":"Object and spatial visual working memory activate separate neural systems in human cortex","volume":"6","author":"Courtney","year":"1996","journal-title":"Cerebral Cortex"},{"key":"2024112514543842500_bib7","doi-asserted-by":"publisher","first-page":"eabl8913","DOI":"10.1126\/sciadv.abl8913","article-title":"Brain-like functional specialization emerges spontaneously in deep neural networks","volume":"8","author":"Dobs","year":"2022","journal-title":"Science Advances"},{"key":"2024112514543842500_bib8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/cercor\/1.1.1-a","article-title":"Distributed hierarchical processing in the primate cerebral cortex","volume":"1","author":"Felleman","year":"1991","journal-title":"Cerebral Cortex"},{"key":"2024112514543842500_bib9","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1098\/rstl.1884.0020","article-title":"XIX. A record of experiments on the effects of lesion of different regions of the cerebral hemispheres","volume":"175","author":"Ferrier","year":"1884","journal-title":"Philosophical Transactions of the Royal Society of London"},{"key":"2024112514543842500_bib10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3408062","article-title":"Modular neural networks for low-power image classification on embedded devices","volume":"26","author":"Goel","year":"2020","journal-title":"ACM Transactions on Design Automation of Electronic Systems"},{"key":"2024112514543842500_bib11","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1111\/dmcn.12299","article-title":"Separate visual systems for perception and action: A framework for understanding cortical visual impairment","volume":"55(Suppl. 4)","author":"Goodale","year":"2013","journal-title":"Developmental Medicine and Child Neurology"},{"key":"2024112514543842500_bib12","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1038\/s41562-022-01302-0","article-title":"The spatiotemporal neural dynamics of object location representations in the human brain","volume":"6","author":"Graumann","year":"2022","journal-title":"Nature Human Behaviour"},{"key":"2024112514543842500_bib13","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2012.05208","article-title":"On the binding problem in artificial neural networks","author":"Gref","year":"2020","journal-title":"arXiv"},{"key":"2024112514543842500_bib14","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1162\/neco_a_01456","article-title":"Modeling the ventral and dorsal cortical visual pathways using artificial neural networks","volume":"34","author":"Han","year":"2022","journal-title":"Neural Computation"},{"key":"2024112514543842500_bib15","article-title":"Constraining the binding problem using maps","author":"Han","year":"2023"},{"key":"2024112514543842500_bib16","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1162\/neco_a_01559","article-title":"Identifying and localizing multiple objects using artificial ventral and dorsal cortical visual pathways","volume":"35","author":"Han","year":"2023","journal-title":"Neural Computation"},{"key":"2024112514543842500_bib17","doi-asserted-by":"publisher","first-page":"5020","DOI":"10.1167\/jov.23.9.5020","article-title":"Is it always computationally advantageous to use segregated pathways to process different visual stimulus attributes separately?","volume":"23","author":"Han","year":"2023","journal-title":"Journal of Vision"},{"key":"2024112514543842500_bib18","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1038\/nn.4247","article-title":"Explicit information for category-orthogonal object properties increases along the ventral stream","volume":"19","author":"Hong","year":"2016","journal-title":"Nature Neuroscience"},{"key":"2024112514543842500_bib19","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1016\/j.cub.2014.12.050","article-title":"Attention reduces spatial uncertainty in human ventral temporal cortex","volume":"25","author":"Kay","year":"2015","journal-title":"Current Biology"},{"key":"2024112514543842500_bib20","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1038\/nn2036","article-title":"Two hierarchically organized neural systems for object information in human visual cortex","volume":"11","author":"Konen","year":"2008","journal-title":"Nature Neuroscience"},{"key":"2024112514543842500_bib21","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1038\/nrn3008","article-title":"A new neural framework for visuospatial processing","volume":"12","author":"Kravitz","year":"2011","journal-title":"Nature Reviews Neuroscience"},{"key":"2024112514543842500_bib22","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1016\/j.tics.2012.10.011","article-title":"The ventral visual pathway: An expanded neural framework for the processing of object quality","volume":"17","author":"Kravitz","year":"2013","journal-title":"Trends in Cognitive Sciences"},{"key":"2024112514543842500_bib23","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1152\/jn.00168.2006","article-title":"Comparison of shape encoding in primate dorsal and ventral visual pathways","volume":"97","author":"Lehky","year":"2007","journal-title":"Journal of Neurophysiology"},{"key":"2024112514543842500_bib24","doi-asserted-by":"publisher","first-page":"72","DOI":"10.3389\/fnint.2015.00072","article-title":"Characteristics of eye-position gain field populations determine geometry of visual space","volume":"9","author":"Lehky","year":"2016","journal-title":"Frontiers in Integrative Neuroscience"},{"key":"2024112514543842500_bib25","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1126\/science.3283936","article-title":"Segregation of form, color, movement, and depth: Anatomy, physiology, and perception","volume":"240","author":"Livingstone","year":"1988","journal-title":"Science"},{"key":"2024112514543842500_bib26","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1146\/annurev.ne.19.030196.003045","article-title":"Visual object recognition","volume":"19","author":"Logothetis","year":"1996","journal-title":"Annual Review of Neuroscience"},{"key":"2024112514543842500_bib27","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1093\/cercor\/4.5.523","article-title":"Inferior temporal mechanisms for invariant object recognition","volume":"4","author":"Lueschow","year":"1994","journal-title":"Cerebral Cortex"},{"key":"2024112514543842500_bib28","doi-asserted-by":"publisher","first-page":"1297","DOI":"10.1007\/s00221-017-4917-4","article-title":"How do the two visual streams interact with each other?","volume":"235","author":"Milner","year":"2017","journal-title":"Experimental Brain Research"},{"key":"2024112514543842500_bib29","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1016\/0166-2236(83)90190-X","article-title":"Object vision and spatial vision: Two cortical pathways","volume":"6","author":"Mishkin","year":"1983","journal-title":"Trends in Neurosciences"},{"key":"2024112514543842500_bib30","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1016\/j.tics.2020.11.006","article-title":"Evidence for a third visual pathway specialized for social perception","volume":"25","author":"Pitcher","year":"2021","journal-title":"Trends in Cognitive Sciences"},{"key":"2024112514543842500_bib31","doi-asserted-by":"publisher","first-page":"3319","DOI":"10.1093\/cercor\/bhac276","article-title":"Multiple cortical visual streams in humans","volume":"33","author":"Rolls","year":"2023","journal-title":"Cerebral Cortex"},{"key":"2024112514543842500_bib32","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1162\/jocn.1989.1.2.171","article-title":"Why are \u201cwhat\u201d and \u201cwhere\u201d processed by separate cortical visual systems? A computational investigation","volume":"1","author":"Rueckl","year":"1989","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2024112514543842500_bib33","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1016\/S0010-9452(08)70442-8","article-title":"Binding of what and where during working memory maintenance","volume":"43","author":"Sala","year":"2007","journal-title":"Cortex"},{"key":"2024112514543842500_bib34","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1093\/cercor\/bhj007","article-title":"Increased neural efficiency with repeated performance of a working memory task is information-type dependent","volume":"16","author":"Sayala","year":"2006","journal-title":"Cerebral Cortex"},{"key":"2024112514543842500_bib35","doi-asserted-by":"publisher","first-page":"4447","DOI":"10.1073\/pnas.0800431105","article-title":"The distribution of category and location information across object-selective regions in human visual cortex","volume":"105","author":"Schwarzlose","year":"2008","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2024112514543842500_bib36","doi-asserted-by":"publisher","first-page":"1078","DOI":"10.1152\/jn.00431.2005","article-title":"Attention and memory-related responses of neurons in the lateral intraparietal area during spatial and shape-delayed match-to-sample tasks","volume":"95","author":"Sereno","year":"2006","journal-title":"Journal of Neurophysiology"},{"key":"2024112514543842500_bib37","doi-asserted-by":"publisher","first-page":"159","DOI":"10.3389\/fncom.2010.00159","article-title":"Population coding of visual space: Comparison of spatial representations in dorsal and ventral pathways","volume":"4","author":"Sereno","year":"2011","journal-title":"Frontiers in Computational Neuroscience"},{"key":"2024112514543842500_bib38","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1016\/j.cortex.2019.06.005","article-title":"Representation of shape, space, and attention in monkey cortex","volume":"122","author":"Sereno","year":"2020","journal-title":"Cortex"},{"key":"2024112514543842500_bib39","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1038\/26752","article-title":"Shape selectivity in primate lateral intraparietal cortex","volume":"395","author":"Sereno","year":"1998","journal-title":"Nature"},{"key":"2024112514543842500_bib40","doi-asserted-by":"publisher","first-page":"28","DOI":"10.3389\/fnint.2014.00028","article-title":"Recovering stimulus locations using populations of eye-position modulated neurons in dorsal and ventral visual streams of non-human primates","volume":"8","author":"Sereno","year":"2014","journal-title":"Frontiers in Integrative Neuroscience"},{"key":"2024112514543842500_bib41","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1152\/jn.00841.2011","article-title":"Shape selectivity and remapping in dorsal stream visual area lip","volume":"111","author":"Subramanian","year":"2014","journal-title":"Journal of Neurophysiology"},{"key":"2024112514543842500_bib42","doi-asserted-by":"publisher","first-page":"1423","DOI":"10.1007\/s00429-021-02420-7","article-title":"One object, two networks? assessing the relationship between the face and body-selective regions in the primate visual system","volume":"227","author":"Taubert","year":"2022","journal-title":"Brain Structure & Function"},{"key":"2024112514543842500_bib43","doi-asserted-by":"publisher","first-page":"883","DOI":"10.1073\/pnas.95.3.883","article-title":"A neural system for human visual working memory","volume":"95","author":"Ungerleider","year":"1998","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2024112514543842500_bib44","first-page":"549","article-title":"Two cortical visual systems","volume-title":"Analysis of visual behavior","author":"Ungerleider","year":"1982"},{"key":"2024112514543842500_bib45","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1093\/cercor\/4.5.470","article-title":"Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys","volume":"4","author":"Webster","year":"1994","journal-title":"Cerebral Cortex"},{"key":"2024112514543842500_bib48","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1708.07747","article-title":"Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms","author":"Xiao","year":"2017","journal-title":"arXiv"},{"key":"2024112514543842500_bib46","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1162\/jocn_a_00475","article-title":"Ventral and dorsal visual stream contributions to the perception of object shape and object location","volume":"26","author":"Zachariou","year":"2014","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2024112514543842500_bib47","first-page":"12310","article-title":"Barlow Twins: Self-supervised learning via redundancy reduction","volume":"139","author":"Zbontar","year":"2021","journal-title":"Proceedings of the 38th International Conference on Machine Learning"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/36\/12\/2618\/2480650\/jocn_a_02121.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/36\/12\/2618\/2480650\/jocn_a_02121.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T14:54:50Z","timestamp":1732546490000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/36\/12\/2618\/119426\/Understanding-Cortical-Streams-from-a"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"references-count":48,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12,1]]},"published-print":{"date-parts":[[2024,12,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_02121","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024]]},"published":{"date-parts":[[2024]]}}}