{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T01:26:55Z","timestamp":1785893215346,"version":"3.56.0"},"reference-count":35,"publisher":"MIT Press","issue":"2","license":[{"start":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T00:00:00Z","timestamp":1671667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,1,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>In our previous study (Han &amp; Sereno, 2022a), we found that two artificial cortical visual pathways trained for either identity or space actively retain information about both identity and space independently and differently. We also found that this independently and differently retained information about identity and space in two separate pathways may be necessary to accurately and optimally recognize and localize objects. One limitation of our previous study was that there was only one object in each visual image, whereas in reality, there may be multiple objects in a scene. In this study, we find we are able to generalize our findings to object recognition and localization tasks where multiple objects are present in each visual image. We constrain the binding problem by training the identity network pathway to report the identities of objects in a given order according to the relative spatial relationships between the objects, given that most visual cortical areas including high-level ventral steam areas retain spatial information. Under these conditions, we find that the artificial neural networks with two pathways for identity and space have better performance in multiple-objects recognition and localization tasks (higher average testing accuracy, lower testing accuracy variance, less training time) than the artificial neural networks with a single pathway. We also find that the required number of training samples and the required training time increase quickly, and potentially exponentially, when the number of objects in each image increases, and we suggest that binding information from multiple objects simultaneously within any network (cortical area) induces conflict or competition and may be part of the reason why our brain has limited attentional and visual working memory capacities.<\/jats:p>","DOI":"10.1162\/neco_a_01559","type":"journal-article","created":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T00:56:32Z","timestamp":1671670592000},"page":"249-275","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":9,"title":["Identifying and Localizing Multiple Objects Using Artificial Ventral and Dorsal Cortical Visual Pathways"],"prefix":"10.1162","volume":"35","author":[{"given":"Zhixian","family":"Han","sequence":"first","affiliation":[{"name":"Department of Psychological Sciences, Purdue University, West Lafayette, IN 47907, U.S.A. han594@purdue.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Sereno","sequence":"additional","affiliation":[{"name":"Department of Psychological Sciences and Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN 47907, U.S.A. asereno@purdue.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2023,1,20]]},"reference":[{"key":"2023012618411764900_B1","doi-asserted-by":"crossref","unstructured":"Bakhtiari, S., Mineault, P., Lillicrap, T., Pack, C., & Richards, B. (2021). The functional specialization of visual cortex emerges from training parallel pathways with self-supervised predictive learning. In M.Ranzato, A.Beygelzimer, K.Nguyen, P. S.Liang, J. W.Vaughan, & Y.Dauphin (Eds.), Advances in neural information processing systems, 34 (pp. 25164\u201325178) Curran.","DOI":"10.1101\/2021.06.18.448989"},{"key":"2023012618411764900_B2","doi-asserted-by":"crossref","unstructured":"Colby, C. L., & Goldberg, M. E. (1999). Space and attention in parietal cortex. Annual Review of Neuroscience, 22, 319\u2013349. 10.1146\/annurev.neuro.22.1.319","DOI":"10.1146\/annurev.neuro.22.1.319"},{"key":"2023012618411764900_B3","doi-asserted-by":"crossref","unstructured":"Cowan, N.\n           (2010). The magical mystery four: How is working memory capacity limited, and why?Current Directions in Psychological Science, 19(1), 51\u201357. 10.1177\/0963721409359277","DOI":"10.1177\/0963721409359277"},{"key":"2023012618411764900_B4","doi-asserted-by":"crossref","unstructured":"Daneman, M., & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behavior, 19(4), 450\u2013466. 10.1016\/S0022-5371(80)90312-6","DOI":"10.1016\/S0022-5371(80)90312-6"},{"key":"2023012618411764900_B5","doi-asserted-by":"crossref","unstructured":"Dobs, K., Martinez, J., Kell, A. J. E., & Kanwisher, N. (2022). Brain-like functional specialization emerges spontaneously in deep neural networks. Science Advances, 8(11), 1\u201311. 10.1126\/sciadv.abl8913","DOI":"10.1126\/sciadv.abl8913"},{"key":"2023012618411764900_B6","doi-asserted-by":"crossref","unstructured":"Felleman, D., & Essen, D. V. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cerebral Cortex, 1(1), 1\u201347. 10.1093\/cercor\/1.1.1","DOI":"10.1093\/cercor\/1.1.1"},{"key":"2023012618411764900_B7","doi-asserted-by":"crossref","unstructured":"Han, Z., & Sereno, A. (2022a). Modeling the ventral and dorsal cortical visual pathways using artificial neural networks. Neural Computation, 34(1), 138\u2013171. 10.1162\/neco_a_01456","DOI":"10.1162\/neco_a_01456"},{"key":"2023012618411764900_B8","doi-asserted-by":"crossref","unstructured":"Han, Z., & Sereno, A. (2022b). Identifying and localizing multiple objects using artificial ventral and dorsal visual cortical pathways. Computational and Mathematical Models in Vision. Retrieved from https:\/\/docs.lib.purdue.edu\/modvis\/2022\/session01\/3\/","DOI":"10.1162\/neco_a_01559"},{"key":"2023012618411764900_B9","doi-asserted-by":"crossref","unstructured":"Isbell, E., Fukuda, K., Neville, H. J., & Vogel, E. K. (2015). Visual working memory continues to develop through adolescence. Frontiers in Psychology, 6, 1\u201310. 10.3389\/fpsyg.2015.00696","DOI":"10.3389\/fpsyg.2015.00696"},{"key":"2023012618411764900_B10","doi-asserted-by":"crossref","unstructured":"Konen, C. S., & Kastner, S. (2008). Two hierarchically organized neural systems for object information in human visual cortex. Nature Neuroscience, 11(2), 224\u2013231. 10.1038\/nn2036","DOI":"10.1038\/nn2036"},{"key":"2023012618411764900_B11","doi-asserted-by":"crossref","unstructured":"Konkle, T., & Alvarez, G. A. (2022). A self-supervised domain-general learning framework for human ventral stream representation. Nature Communication, 13(493), 1\u201312. 10.1038\/s41467-022-28091-4","DOI":"10.1038\/s41467-022-28091-4"},{"key":"2023012618411764900_B12","doi-asserted-by":"crossref","unstructured":"Kriegeskorte, N.\n           (2015). Deep neural networks: A new framework for modeling biological vision and brain information processing. Annual Review of Vision Science, 1, 417\u2013446. 10.1146\/annurev-vision-082114-035447","DOI":"10.1146\/annurev-vision-082114-035447"},{"key":"2023012618411764900_B13","doi-asserted-by":"crossref","unstructured":"Lehky, S. R., & Sereno, A. B. (2007). Comparison of shape encoding in primate dorsal and ventral visual pathways. Journal of Neurology, Neurosurgery, and Psychiatry, 97, 307\u2013319. 10.1152\/jn.00168.2006","DOI":"10.1152\/jn.00168.2006"},{"key":"2023012618411764900_B14","doi-asserted-by":"crossref","unstructured":"Lillicrap, T. P., Santoro, A., Marris, L., Akerman, C. J., & Hinton, G. (2020). Backpropagation and the brain. Nature Reviews Neuroscience, 21, 335\u2013346. 10.1038\/s41583-020-0277-3","DOI":"10.1038\/s41583-020-0277-3"},{"key":"2023012618411764900_B15","doi-asserted-by":"crossref","unstructured":"Logothetis, N. K., & Sheinberg, D. L. (1996). Visual object recognition. Annual Review of Neuroscience, 19, 577\u2013621. 10.1146\/annurev.ne.19.030196.003045","DOI":"10.1146\/annurev.ne.19.030196.003045"},{"key":"2023012618411764900_B16","doi-asserted-by":"crossref","unstructured":"Luck, S. J., & Vogel, E. K. (2013). Visual working memory capacity: From psychophysics and neurobiology to individual differences. Trends in Cognitive Sciences, 17(8), 391\u2013400. 10.1016\/j.tics.2013.06.006","DOI":"10.1016\/j.tics.2013.06.006"},{"key":"2023012618411764900_B17","doi-asserted-by":"crossref","unstructured":"Markov, Y. A., Utochkin, I. S., & Brady, T. F. (2021). Real-world objects are not stored in holistic representations in visual working memory. Journal of Vision, 21(3), 1\u201324. 10.1167\/jov.21.3.18","DOI":"10.1167\/jov.21.3.18"},{"key":"2023012618411764900_B18","doi-asserted-by":"crossref","unstructured":"Miller, G. A.\n           (1956). The magical number seven plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63(2), 81\u201397. 10.1037\/h0043158","DOI":"10.1037\/h0043158"},{"key":"2023012618411764900_B19","doi-asserted-by":"crossref","unstructured":"Mishkin, M., Ungerleider, L. G., & Macko, K. A. (1983). Object vision and spatial vision: Two cortical pathways. Trends in Neurosciences, 6, 414\u2013417. 10.1016\/0166-2236(83)90190-X","DOI":"10.1016\/0166-2236(83)90190-X"},{"key":"2023012618411764900_B20","doi-asserted-by":"crossref","unstructured":"Nairne, J. S.\n           (2015). The three \u201cws\u201d of episodic memory: What, when, and where. American Journal of Psychology, 128(2), 267\u2013279. 10.5406\/amerjpsyc.128.2.0267","DOI":"10.5406\/amerjpsyc.128.2.0267"},{"key":"2023012618411764900_B21","doi-asserted-by":"crossref","unstructured":"Oberauer, K.\n           (2009). Design for a working memory. Psychology of Learning and Motivation, 51, 45\u2013100. 10.1016\/S0079-7421(09)51002-X","DOI":"10.1016\/S0079-7421(09)51002-X"},{"key":"2023012618411764900_B22","doi-asserted-by":"crossref","unstructured":"Op De Beeck, H., & Vogels, R. (2000). Spatial sensitivity of macaque inferiortemporal neurons. Journal of Comparative Neurology, 426, 505\u2013518. 10.1002\/1096-9861(20001030)426:4&lt;505::aid-cne1&gt;3.0.co;2-m","DOI":"10.1002\/1096-9861(20001030)426:4<505::AID-CNE1>3.0.CO;2-M"},{"key":"2023012618411764900_B23","doi-asserted-by":"crossref","unstructured":"Quirk, C., Adam, K. C., & Vogel, E. K. (2020). No evidence for an object working memory capacity benefit with extended viewing time. eNeuro, 7(5), 1\u201313. 10.1523\/ENEURO.0150-20.2020","DOI":"10.1523\/ENEURO.0150-20.2020"},{"key":"2023012618411764900_B24","doi-asserted-by":"crossref","unstructured":"Sereno, A. B., & Lehky, S. R. (2011). Population coding of visual space: Comparison of spatial representations in dorsal and ventral pathways. Frontiers in Computational Neuroscience, 4(159), 1\u201316. 10.3389\/fncom.2010.00159","DOI":"10.3389\/fncom.2010.00159"},{"key":"2023012618411764900_B25","doi-asserted-by":"crossref","unstructured":"Sereno, A. B., Lehky, S. R., & Sereno, M. E. (2020). Representation of shape, space, and attention in monkey cortex. Cortex, 122, 40\u201360. 10.1016\/j.cortex.2019.06.005","DOI":"10.1016\/j.cortex.2019.06.005"},{"key":"2023012618411764900_B26","doi-asserted-by":"crossref","unstructured":"Sereno, A. B., Sereno, M. E., & Lehky, S. R. (2014). Recovering stimulus locations using populations of eye-position modulated neurons in dorsal and ventral visual streams of non-human primates. Frontiers in Integrative Neuroscience, 8, 1\u201320. 10.3389\/fnint.2014.00028","DOI":"10.3389\/fnint.2014.00028"},{"key":"2023012618411764900_B27","doi-asserted-by":"crossref","unstructured":"Sereno, M. I., Sood, M. R., & Huang, R.-S. (2022). Topological maps and brain computations from low to high. Frontiers in Systems Neuroscience, 16, 1\u201322. 10.3389\/fnsys.2022.787737","DOI":"10.3389\/fnsys.2022.787737"},{"key":"2023012618411764900_B28","doi-asserted-by":"crossref","unstructured":"Treisman, A.\n           (1996). The binding problem. Current Opinion in Neurobiology, 6(2), 171\u2013178. 10.1016\/S0959-4388(96)80070-5","DOI":"10.1016\/S0959-4388(96)80070-5"},{"key":"2023012618411764900_B29","unstructured":"Tulving, E.\n           (1972). Episodic and semantic memory. In E.Tulving & W.Donaldson (Eds.), Organization of memory (pp. 381\u2013403). Academic Press."},{"key":"2023012618411764900_B30","unstructured":"Ungerleider\n              L. G.\n            , & Mishkin, M. (1982). Two cortical visual systems. In M.Goodale, D. J.Ingle, & R. J. W.Mansfield (Eds.), Analysis of visual behavior (pp. 549\u2013586). MIT Press."},{"key":"2023012618411764900_B31","doi-asserted-by":"crossref","unstructured":"Whittington, J. C., & Bogacz, R. (2019). Theories of error back-propagation in the brain. Trends in Cognitive Sciences, 23(3), 235\u2013250. 10.1016\/j.tics.2018.12.005","DOI":"10.1016\/j.tics.2018.12.005"},{"key":"2023012618411764900_B32","unstructured":"Xiao, H., Rasul, K., & Vollgraf, R. (2017). Fashion-MNIST: A novel image dataset for benchmarking machine learning algorithms. arXiv:1708.07747"},{"key":"2023012618411764900_B33","doi-asserted-by":"crossref","unstructured":"Yamane, Y., Tsunoda, K., Matsumoto, M., Phillips, A. N., & Tanifuji, M. (2006). Representation of the spatial relationship among object parts by neurons in macaque inferotemporal cortex. Journal of Neurophysiology, 96, 3147\u20133156. 10.1152\/jn.01224.2005","DOI":"10.1152\/jn.01224.2005"},{"key":"2023012618411764900_B34","doi-asserted-by":"crossref","unstructured":"Yamins, D. L. K., Hong, H., Cadieu, C. F., Solomon, E. A., Seibert, D., & DiCarlo, J. J. (2014). Performance-optimized hierarchical models predict neural responses in higher visual cortex. PNAS, 111(23), 8619\u20138624. 10.1073\/pnas.1403112111","DOI":"10.1073\/pnas.1403112111"},{"key":"2023012618411764900_B35","doi-asserted-by":"crossref","unstructured":"Zhuang, C., Yan, S., Nayebi, A., Schrimpf, M., Frank, M. C., DiCarlo, J. J., & Yamins, D. L. K. (2022). Unsupervised neural network models of the ventral visual stream. PNAS, 118(3), 1\u201311. 10.1073\/pnas.2014196118","DOI":"10.1073\/pnas.2014196118"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/35\/2\/249\/2067683\/neco_a_01559.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/35\/2\/249\/2067683\/neco_a_01559.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,26]],"date-time":"2023-01-26T18:42:05Z","timestamp":1674758525000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/35\/2\/249\/114137\/Identifying-and-Localizing-Multiple-Objects-Using"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,20]]},"references-count":35,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1,20]]},"published-print":{"date-parts":[[2023,1,20]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01559","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,2]]},"published":{"date-parts":[[2023,1,20]]}}}