{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T01:24:34Z","timestamp":1792027474399,"version":"4.4.0"},"reference-count":45,"publisher":"MIT Press","issue":"10","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Visual scene perception is mediated by a set of cortical regions that respond preferentially to images of scenes, including the occipital place area (OPA) and parahippocampal place area (PPA). However, the differential contribution of OPA and PPA to scene perception remains an open research question. In this study, we take a deep neural network (DNN)-based computational approach to investigate the differences in OPA and PPA function. In a first step, we search for a computational model that predicts fMRI responses to scenes in OPA and PPA well. We find that DNNs trained to predict scene components (e.g., wall, ceiling, floor) explain higher variance uniquely in OPA and PPA than a DNN trained to predict scene category (e.g., bathroom, kitchen, office). This result is robust across several DNN architectures. On this basis, we then determine whether particular scene components predicted by DNNs differentially account for unique variance in OPA and PPA. We find that variance in OPA responses uniquely explained by the navigation-related floor component is higher compared to the variance explained by the wall and ceiling components. In contrast, PPA responses are better explained by the combination of wall and floor, that is, scene components that together contain the structure and texture of the scene. This differential sensitivity to scene components suggests differential functions of OPA and PPA in scene processing. Moreover, our results further highlight the potential of the proposed computational approach as a general tool in the investigation of the neural basis of human scene perception.<\/jats:p>","DOI":"10.1162\/jocn_a_01624","type":"journal-article","created":{"date-parts":[[2020,9,8]],"date-time":"2020-09-08T09:04:10Z","timestamp":1599555850000},"page":"2032-2043","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":16,"title":["Unraveling Representations in Scene-selective Brain Regions Using Scene-Parsing Deep Neural Networks"],"prefix":"10.1162","volume":"33","author":[{"given":"Kshitij","family":"Dwivedi","sequence":"first","affiliation":[{"name":"Freie Universit\u00e4t Berlin"},{"name":"Goethe University Frankfurt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Radoslaw Martin","family":"Cichy","sequence":"additional","affiliation":[{"name":"Freie Universit\u00e4t Berlin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gemma","family":"Roig","sequence":"additional","affiliation":[{"name":"Goethe University Frankfurt"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,9,1]]},"reference":[{"key":"2021090816501768200_bib1","first-page":"6541","article-title":"Network dissection: Quantifying interpretability of deep visual representations","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Bau","year":"2017"},{"key":"2021090816501768200_bib2","doi-asserted-by":"crossref","first-page":"4793","DOI":"10.1073\/pnas.1618228114","article-title":"Coding of navigational affordances in the human visual system","volume":"114","author":"Bonner","year":"2017","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021090816501768200_bib3","doi-asserted-by":"crossref","first-page":"e1006111","DOI":"10.1371\/journal.pcbi.1006111","article-title":"Computational mechanisms underlying cortical responses to the affordance properties of visual scenes","volume":"14","author":"Bonner","year":"2018","journal-title":"PLoS Computational Biology"},{"key":"2021090816501768200_bib4","first-page":"310","article-title":"Task-context overrules object- and category-related representational content in the human parietal cortex","volume":"27","author":"Bracci","year":"2017","journal-title":"Cerebral Cortex"},{"key":"2021090816501768200_bib5","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1016\/j.neuroimage.2017.03.062","article-title":"Task alters category representations in prefrontal but not high-level visual cortex","volume":"155","author":"Bugatus","year":"2017","journal-title":"Neuroimage"},{"key":"2021090816501768200_bib6","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.tics.2019.01.009","article-title":"Deep neural networks as scientific models","volume":"23","author":"Cichy","year":"2019","journal-title":"Trends in Cognitive Sciences"},{"key":"2021090816501768200_bib7","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.neuroimage.2016.03.063","article-title":"Dynamics of scene representations in the human brain revealed by magnetoencephalography and deep neural networks","volume":"153","author":"Cichy","year":"2017","journal-title":"Neuroimage"},{"key":"2021090816501768200_bib8","doi-asserted-by":"crossref","first-page":"27755","DOI":"10.1038\/srep27755","article-title":"Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence","volume":"6","author":"Cichy","year":"2016","journal-title":"Scientific Reports"},{"key":"2021090816501768200_bib9","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1523\/JNEUROSCI.4081-12.2013","article-title":"The occipital place area is causally and selectively involved in scene perception","volume":"33","author":"Dilks","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2021090816501768200_bib10","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.tics.2010.01.004","article-title":"The multiple-demand (MD) system of the primate brain: Mental programs for intelligent behaviour","volume":"14","author":"Duncan","year":"2010","journal-title":"Trends in Cognitive Sciences"},{"key":"2021090816501768200_bib11","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1038\/33402","article-title":"A cortical representation of the local visual environment","volume":"392","author":"Epstein","year":"1998","journal-title":"Nature"},{"key":"2021090816501768200_bib12","doi-asserted-by":"crossref","first-page":"12383","DOI":"10.1523\/JNEUROSCI.1134-15.2015","article-title":"Discrimination of visual categories based on behavioral relevance in widespread regions of frontoparietal cortex","volume":"35","author":"Erez","year":"2015","journal-title":"Journal of Neuroscience"},{"key":"2021090816501768200_bib13","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1167\/7.1.10","article-title":"What do we perceive in a glance of a real-world scene?","volume":"7","author":"Fei-Fei","year":"2007","journal-title":"Journal of Vision"},{"key":"2021090816501768200_bib14","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1111\/j.1467-9280.2009.02316.x","article-title":"The briefest of glances: The time course of natural scene understanding","volume":"20","author":"Greene","year":"2009","journal-title":"Psychological Science"},{"key":"2021090816501768200_bib15","doi-asserted-by":"crossref","first-page":"e32962","DOI":"10.7554\/eLife.32962","article-title":"Distinct contributions of functional and deep neural network features to representational similarity of scenes in human brain and behavior","volume":"7","author":"Groen","year":"2018","journal-title":"eLife"},{"key":"2021090816501768200_bib16","doi-asserted-by":"crossref","first-page":"E962","DOI":"10.1073\/pnas.1312567111","article-title":"Task context impacts visual object processing differentially across the cortex","volume":"111","author":"Harel","year":"2014","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021090816501768200_bib17","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1016\/S0896-6273(03)00144-2","article-title":"Large-scale mirror-symmetry organization of human occipito-temporal object areas","volume":"37","author":"Hasson","year":"2003","journal-title":"Neuron"},{"key":"2021090816501768200_bib18","first-page":"770","article-title":"Deep residual learning for image recognition","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"He","year":"2016"},{"key":"2021090816501768200_bib19","doi-asserted-by":"crossref","first-page":"e32816","DOI":"10.7554\/eLife.32816","article-title":"The representational dynamics of task and object processing in humans","volume":"7","author":"Hebart","year":"2018","journal-title":"eLife"},{"key":"2021090816501768200_bib20","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.neuron.2019.04.014","article-title":"Rapid invariant encoding of scene layout in human OPA","volume":"103","author":"Henriksson","year":"2019","journal-title":"Neuron"},{"key":"2021090816501768200_bib21","doi-asserted-by":"crossref","first-page":"e1003915","DOI":"10.1371\/journal.pcbi.1003915","article-title":"Deep supervised, but not unsupervised, models may explain IT cortical representation","volume":"10","author":"Khaligh-Razavi","year":"2014","journal-title":"PLoS Computational Biology"},{"key":"2021090816501768200_bib22","doi-asserted-by":"crossref","first-page":"7322","DOI":"10.1523\/JNEUROSCI.4588-10.2011","article-title":"Real-world scene representations in high-level visual cortex: It's the spaces more than the places","volume":"31","author":"Kravitz","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"2021090816501768200_bib23","first-page":"4","article-title":"Representational similarity analysis\u2014Connecting the branches of systems neuroscience","volume":"2","author":"Kriegeskorte","year":"2008","journal-title":"Frontiers in Systems Neuroscience"},{"key":"2021090816501768200_bib24","first-page":"1097","article-title":"ImageNet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2021090816501768200_bib25","first-page":"2117","article-title":"Feature pyramid networks for object detection","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Lin","year":"2017"},{"key":"2021090816501768200_bib26","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.neuroimage.2015.10.089","article-title":"Feature diagnosticity and task context shape activity in human scene-selective cortex","volume":"125","author":"Lowe","year":"2016","journal-title":"Neuroimage"},{"key":"2021090816501768200_bib27","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1162\/08989290051137549","article-title":"Mental imagery of faces and places activates corresponding stimulus-specific brain regions","volume":"12","author":"O'Craven","year":"2000","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021090816501768200_bib28","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.1152\/jn.00338.2016","article-title":"Conjoint representation of texture ensemble and location in the parahippocampal place area","volume":"117","author":"Park","year":"2017","journal-title":"Journal of Neurophysiology"},{"key":"2021090816501768200_bib29","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1523\/JNEUROSCI.3885-10.2011","article-title":"Disentangling scene content from spatial boundary: Complementary roles for the parahippocampal place area and lateral occipital complex in representing real-world scenes","volume":"31","author":"Park","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"2021090816501768200_bib30","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1126\/science.1145183","article-title":"Meaning in visual search","volume":"187","author":"Potter","year":"1975","journal-title":"Science"},{"key":"2021090816501768200_bib31","doi-asserted-by":"crossref","first-page":"1761","DOI":"10.1038\/s41593-019-0520-2","article-title":"A deep learning framework for neuroscience","volume":"22","author":"Richards","year":"2019","journal-title":"Nature Neuroscience"},{"key":"2021090816501768200_bib32","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s11263-007-0090-8","article-title":"LabelMe: A database and web-based tool for image annotation","volume":"77","author":"Russell","year":"2008","journal-title":"International Journal of Computer Vision"},{"key":"2021090816501768200_bib33","doi-asserted-by":"crossref","first-page":"11921","DOI":"10.1523\/JNEUROSCI.0137-15.2015","article-title":"A retinotopic basis for the division of high-level scene processing between lateral and ventral human occipitotemporal cortex","volume":"35","author":"Silson","year":"2015","journal-title":"Journal of Neuroscience"},{"key":"2021090816501768200_bib34","article-title":"High-resolution representations for labeling pixels and regions","author":"Sun","year":"2019"},{"key":"2021090816501768200_bib35","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1038\/381520a0","article-title":"Speed of processing in the human visual system","volume":"381","author":"Thorpe","year":"1996","journal-title":"Nature"},{"key":"2021090816501768200_bib36","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1093\/cercor\/bhs364","article-title":"Multiple object properties drive scene-selective regions","volume":"24","author":"Troiani","year":"2014","journal-title":"Cerebral Cortex"},{"key":"2021090816501768200_bib37","doi-asserted-by":"crossref","first-page":"8767","DOI":"10.1523\/JNEUROSCI.3392-16.2017","article-title":"Goal-directed visual processing differentially impacts human ventral and dorsal visual representations","volume":"37","author":"Vaziri-Pashkam","year":"2017","journal-title":"Journal of Neuroscience"},{"key":"2021090816501768200_bib38","doi-asserted-by":"crossref","first-page":"14592","DOI":"10.1523\/JNEUROSCI.2616-11.2011","article-title":"Adaptive coding of task-relevant information in human frontoparietal cortex","volume":"31","author":"Woolgar","year":"2011","journal-title":"Journal of Neuroscience"},{"key":"2021090816501768200_bib39","first-page":"418","article-title":"Unified perceptual parsing for scene understanding","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Xiao","year":"2018"},{"key":"2021090816501768200_bib40","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1038\/nn.4244","article-title":"Using goal-driven deep learning models to understand sensory cortex","volume":"19","author":"Yamins","year":"2016","journal-title":"Nature Neuroscience"},{"key":"2021090816501768200_bib41","doi-asserted-by":"crossref","first-page":"8619","DOI":"10.1073\/pnas.1403112111","article-title":"Performance-optimized hierarchical models predict neural responses in higher visual cortex","volume":"111","author":"Yamins","year":"2014","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021090816501768200_bib42","first-page":"2881","article-title":"Pyramid scene parsing network","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhao","year":"2017"},{"key":"2021090816501768200_bib43","article-title":"Object detectors emerge in deep scene CNNs","author":"Zhou","year":"2014"},{"key":"2021090816501768200_bib44","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","article-title":"Places: A 10 million image database for scene recognition","volume":"40","author":"Zhou","year":"2017","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2021090816501768200_bib45","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/s11263-018-1140-0","article-title":"Semantic understanding of scenes through the ADE20K dataset","volume":"127","author":"Zhou","year":"2019","journal-title":"International Journal of Computer Vision"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/33\/10\/2032\/1962114\/jocn_a_01624.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/33\/10\/2032\/1962114\/jocn_a_01624.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,8]],"date-time":"2021-09-08T15:12:46Z","timestamp":1631113966000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/33\/10\/2032\/97376\/Unraveling-Representations-in-Scene-selective"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,1]]},"references-count":45,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,9,1]]},"published-print":{"date-parts":[[2021,9,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01624","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.03.10.985309","asserted-by":"object"}]},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,10]]},"published":{"date-parts":[[2021,9,1]]}}}