{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T19:49:46Z","timestamp":1779306586387,"version":"3.51.4"},"reference-count":90,"publisher":"MIT Press","issue":"11","license":[{"start":{"date-parts":[[2023,8,17]],"date-time":"2023-08-17T00:00:00Z","timestamp":1692230400000},"content-version":"vor","delay-in-days":228,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Einstein Center for Neuroscience"},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["CI 241\/1-1"],"award-info":[{"award-number":["CI 241\/1-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["CI 241\/1-7"],"award-info":[{"award-number":["CI 241\/1-7"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["CI 241\/3-1"],"award-info":[{"award-number":["CI 241\/3-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["ERC-StG-2018-803370"],"award-info":[{"award-number":["ERC-StG-2018-803370"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["ERC-StG-2022-101039524"],"award-info":[{"award-number":["ERC-StG-2022-101039524"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Humans effortlessly make quick and accurate perceptual decisions about the nature of their immediate visual environment, such as the category of the scene they face. Previous research has revealed a rich set of cortical representations potentially underlying this feat. However, it remains unknown which of these representations are suitably formatted for decision-making. Here, we approached this question empirically and computationally, using neuroimaging and computational modeling. For the empirical part, we collected EEG data and RTs from human participants during a scene categorization task (natural vs. man-made). We then related EEG data to behavior to behavior using a multivariate extension of signal detection theory. We observed a correlation between neural data and behavior specifically between \u223c100 msec and \u223c200 msec after stimulus onset, suggesting that the neural scene representations in this time period are suitably formatted for decision-making. For the computational part, we evaluated a recurrent convolutional neural network (RCNN) as a model of brain and behavior. Unifying our previous observations in an image-computable model, the RCNN predicted well the neural representations, the behavioral scene categorization data, as well as the relationship between them. Our results identify and computationally characterize the neural and behavioral correlates of scene categorization in humans.<\/jats:p>","DOI":"10.1162\/jocn_a_02043","type":"journal-article","created":{"date-parts":[[2023,8,17]],"date-time":"2023-08-17T12:08:44Z","timestamp":1692274124000},"page":"1879-1897","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":11,"title":["Empirically Identifying and Computationally Modeling the Brain\u2013Behavior Relationship for Human Scene Categorization"],"prefix":"10.1162","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4853-7187","authenticated-orcid":true,"given":"Agnessa","family":"Karapetian","sequence":"first","affiliation":[{"name":"Freie Universit\u00e4t Berlin, Germany"},{"name":"Charit\u00e9 \u2013 Universit\u00e4tsmedizin Berlin, Einstein Center for Neurosciences Berlin, Germany"},{"name":"Bernstein Center for Computational Neuroscience Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antoniya","family":"Boyanova","sequence":"additional","affiliation":[{"name":"Freie Universit\u00e4t Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muthukumar","family":"Pandaram","sequence":"additional","affiliation":[{"name":"Bernstein Center for Computational Neuroscience Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0471-8170","authenticated-orcid":true,"given":"Klaus","family":"Obermayer","sequence":"additional","affiliation":[{"name":"Charit\u00e9 \u2013 Universit\u00e4tsmedizin Berlin, Einstein Center for Neurosciences Berlin, Germany"},{"name":"Bernstein Center for Computational Neuroscience Berlin, Germany"},{"name":"Technische Universit\u00e4t Berlin, Germany"},{"name":"Humboldt-Universit\u00e4t zu Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8076-6062","authenticated-orcid":true,"given":"Tim C.","family":"Kietzmann","sequence":"additional","affiliation":[{"name":"Universit\u00e4t Osnabr\u00fcck, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4190-6071","authenticated-orcid":true,"given":"Radoslaw M.","family":"Cichy","sequence":"additional","affiliation":[{"name":"Freie Universit\u00e4t Berlin, Germany"},{"name":"Charit\u00e9 \u2013 Universit\u00e4tsmedizin Berlin, Einstein Center for Neurosciences Berlin, Germany"},{"name":"Bernstein Center for Computational Neuroscience Berlin, Germany"},{"name":"Humboldt-Universit\u00e4t zu Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2023,11,1]]},"reference":[{"key":"2023101014123375800_bib1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1603.04467","article-title":"TensorFlow: Large-scale machine learning on heterogeneous distributed systems","volume-title":"arXiv:1603.04467","author":"Abadi","year":"2016"},{"key":"2023101014123375800_bib2","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1016\/S0896-6273(00)80546-2","article-title":"An area within human ventral cortex sensitive to \u201cbuilding\u201d stimuli: Evidence and implications","volume":"21","author":"Aguirre","year":"1998","journal-title":"Neuron"},{"key":"2023101014123375800_bib3","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1016\/j.neuroimage.2018.05.037","article-title":"The temporal evolution of conceptual object representations revealed through models of behavior, semantics and deep neural networks","volume":"178","author":"Bankson","year":"2018","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib4","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1162\/089892903321662976","article-title":"A cortical mechanism for triggering top\u2013down facilitation in visual object recognition","volume":"15","author":"Bar","year":"2003","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023101014123375800_bib5","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1073\/pnas.0507062103","article-title":"Top\u2013down facilitation of visual recognition","volume":"103","author":"Bar","year":"2006","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023101014123375800_bib6","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"key":"2023101014123375800_bib7","doi-asserted-by":"publisher","first-page":"6513","DOI":"10.1523\/JNEUROSCI.1714-18.2019","article-title":"The ventral visual pathway represents animal appearance over Animacy, unlike human behavior and deep neural networks","volume":"39","author":"Bracci","year":"2019","journal-title":"Journal of Neuroscience"},{"key":"2023101014123375800_bib8","doi-asserted-by":"publisher","first-page":"433","DOI":"10.1163\/156856897X00357","article-title":"The psychophysics toolbox","volume":"10","author":"Brainard","year":"1997","journal-title":"Spatial Vision"},{"key":"2023101014123375800_bib9","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/S0165-0173(01)00085-6","article-title":"Integrated model of visual processing","volume":"36","author":"Bullier","year":"2001","journal-title":"Brain Research Reviews"},{"key":"2023101014123375800_bib10","doi-asserted-by":"publisher","first-page":"e1003963","DOI":"10.1371\/journal.pcbi.1003963","article-title":"Deep neural networks rival the representation of primate IT cortex for core visual object recognition","volume":"10","author":"Cadieu","year":"2014","journal-title":"PLoS Computational Biology"},{"key":"2023101014123375800_bib11","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1162\/jocn_a_00476","article-title":"Reaction time for object categorization is predicted by representational distance","volume":"26","author":"Carlson","year":"2014","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023101014123375800_bib12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1167\/13.10.1","article-title":"Representational dynamics of object vision: The first 1000 ms","volume":"13","author":"Carlson","year":"2013","journal-title":"Journal of Vision"},{"key":"2023101014123375800_bib13","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2104.13714","article-title":"The Algonauts project 2021 challenge: How the human brain makes sense of a world in motion","author":"Cichy","year":"2021","journal-title":"arXiv:2104.13714"},{"key":"2023101014123375800_bib14","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1016\/j.tics.2019.01.009","article-title":"Deep neural networks as scientific models","volume":"23","author":"Cichy","year":"2019","journal-title":"Trends in Cognitive Sciences"},{"key":"2023101014123375800_bib15","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1016\/j.neuroimage.2016.03.063","article-title":"Dynamics of scene representations in the human brain revealed by magnetoencephalography and deep neural networks","volume":"153","author":"Cichy","year":"2017","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib16","doi-asserted-by":"publisher","first-page":"27755","DOI":"10.1038\/srep27755","article-title":"Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence","volume":"6","author":"Cichy","year":"2016","journal-title":"Scientific Reports"},{"key":"2023101014123375800_bib17","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.neuroimage.2019.03.031","article-title":"The spatiotemporal neural dynamics underlying perceived similarity for real-world objects","volume":"194","author":"Cichy","year":"2019","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib18","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1038\/nn.3635","article-title":"Resolving human object recognition in space and time","volume":"17","author":"Cichy","year":"2014","journal-title":"Nature Neuroscience"},{"key":"2023101014123375800_bib19","doi-asserted-by":"publisher","first-page":"107687","DOI":"10.1016\/j.neuropsychologia.2020.107687","article-title":"Reaction times predict dynamic brain representations measured with MEG for only some object categorisation tasks","volume":"151","author":"Contini","year":"2021","journal-title":"Neuropsychologia"},{"key":"2023101014123375800_bib20","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1016\/j.neuropsychologia.2017.02.013","article-title":"Decoding the time-course of object recognition in the human brain: From visual features to categorical decisions","volume":"105","author":"Contini","year":"2017","journal-title":"Neuropsychologia"},{"key":"2023101014123375800_bib21","doi-asserted-by":"publisher","first-page":"1415","DOI":"10.3758\/s13423-016-1002-0","article-title":"Is neuroimaging measuring information in the brain?","volume":"23","author":"de-Wit","year":"2016","journal-title":"Psychonomic Bulletin & Review"},{"key":"2023101014123375800_bib22","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1016\/j.neuron.2012.01.010","article-title":"How does the brain solve visual object recognition?","volume":"73","author":"DiCarlo","year":"2012","journal-title":"Neuron"},{"key":"2023101014123375800_bib23","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2209.11737","article-title":"Semantic scene descriptions as an objective of human vision","author":"Doerig","year":"2022","journal-title":"arXiv:2209.11737"},{"key":"2023101014123375800_bib24","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1038\/s41583-023-00705-w","article-title":"The neuroconnectionist research programme","volume":"24","author":"Doerig","year":"2023","journal-title":"Nature Reviews Neuroscience"},{"key":"2023101014123375800_bib25","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1016\/j.neuroimage.2016.10.001","article-title":"Seeing it all: Convolutional network layers map the function of the human visual system","volume":"152","author":"Eickenberg","year":"2017","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib26","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1038\/33402","article-title":"A cortical representation of the local visual environment","volume":"392","author":"Epstein","year":"1998","journal-title":"Nature"},{"key":"2023101014123375800_bib27","doi-asserted-by":"publisher","first-page":"6445","DOI":"10.1111\/ejn.15440","article-title":"Task-dependent neural representations of visual object categories","volume":"54","author":"Farzmahdi","year":"2021","journal-title":"European Journal of Neuroscience"},{"key":"2023101014123375800_bib28","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1126\/science.291.5502.312","article-title":"Categorical representation of visual stimuli in the primate prefrontal cortex","volume":"291","author":"Freedman","year":"2001","journal-title":"Science"},{"key":"2023101014123375800_bib29","doi-asserted-by":"publisher","first-page":"5235","DOI":"10.1523\/JNEUROSCI.23-12-05235.2003","article-title":"A comparison of primate prefrontal and inferior temporal cortices during visual categorization","volume":"23","author":"Freedman","year":"2003","journal-title":"Journal of Neuroscience"},{"key":"2023101014123375800_bib30","article-title":"Partial success in closing the gap between human and machine vision","author":"Geirhos","year":"2021"},{"key":"2023101014123375800_bib31","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1146\/annurev.neuro.29.051605.113038","article-title":"The neural basis of decision making","volume":"30","author":"Gold","year":"2007","journal-title":"Annual Review of Neuroscience"},{"key":"2023101014123375800_bib32","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1038\/s41562-022-01302-0","article-title":"The spatiotemporal neural dynamics of object location representations in the human brain","volume":"6","author":"Graumann","year":"2022","journal-title":"Nature Human Behaviour"},{"key":"2023101014123375800_bib33","volume-title":"Signal detection theory and psychophysics","author":"Green","year":"1966"},{"key":"2023101014123375800_bib34","doi-asserted-by":"publisher","first-page":"e1006327","DOI":"10.1371\/journal.pcbi.1006327","article-title":"Shared spatiotemporal category representations in biological and artificial deep neural networks","volume":"14","author":"Greene","year":"2018","journal-title":"PLoS Computational Biology"},{"key":"2023101014123375800_bib35","doi-asserted-by":"publisher","first-page":"5283","DOI":"10.1523\/JNEUROSCI.2088-19.2020","article-title":"Disentangling the independent contributions of visual and conceptual features to the spatiotemporal dynamics of scene categorization","volume":"40","author":"Greene","year":"2020","journal-title":"Journal of Neuroscience"},{"key":"2023101014123375800_bib36","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/S0959-4388(03)00040-0","article-title":"The neural basis of object perception","volume":"13","author":"Grill-Spector","year":"2003","journal-title":"Current Opinion in Neurobiology"},{"key":"2023101014123375800_bib37","doi-asserted-by":"publisher","first-page":"18814","DOI":"10.1523\/JNEUROSCI.3128-13.2013","article-title":"From image statistics to scene gist: Evoked neural activity reveals transition from low-level natural image structure to scene category","volume":"33","author":"Groen","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2023101014123375800_bib38","doi-asserted-by":"publisher","first-page":"252","DOI":"10.1016\/j.neuroimage.2018.06.022","article-title":"Finding decodable information that can be read out in behaviour","volume":"179","author":"Grootswagers","year":"2018","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib39","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1162\/jocn_a_01068","article-title":"Decoding dynamic brain patterns from evoked responses: A tutorial on multivariate pattern analysis applied to time series neuroimaging data","volume":"29","author":"Grootswagers","year":"2017","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023101014123375800_bib40","doi-asserted-by":"publisher","first-page":"10005","DOI":"10.1523\/JNEUROSCI.5023-14.2015","article-title":"Deep neural networks reveal a gradient in the complexity of neural representations across the ventral stream","volume":"35","author":"G\u00fc\u00e7l\u00fc","year":"2015","journal-title":"Journal of Neuroscience"},{"key":"2023101014123375800_bib41","doi-asserted-by":"publisher","first-page":"434","DOI":"10.1016\/j.neuroimage.2018.02.044","article-title":"Multivariate pattern analysis for MEG: A comparison of dissimilarity measures","volume":"173","author":"Guggenmos","year":"2018","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib42","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1126\/science.274.5286.427","article-title":"Neural control of voluntary movement initiation","volume":"274","author":"Hanes","year":"1996","journal-title":"Science"},{"key":"2023101014123375800_bib43","doi-asserted-by":"publisher","first-page":"ENEURO.0139-16.2016","DOI":"10.1523\/ENEURO.0139-16.2016","article-title":"The temporal dynamics of scene processing: A multifaceted EEG investigation","volume":"3","author":"Harel","year":"2016","journal-title":"ENeuro"},{"key":"2023101014123375800_bib44","doi-asserted-by":"publisher","first-page":"E962","DOI":"10.1073\/pnas.1312567111","article-title":"Task context impacts visual object processing differentially across the cortex","volume":"111","author":"Harel","year":"2014","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023101014123375800_bib45","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.1016\/S0896-6273(03)00144-2","article-title":"Large-scale mirror-symmetry organization of human occipito-temporal object areas","volume":"37","author":"Hasson","year":"2003","journal-title":"Neuron"},{"key":"2023101014123375800_bib46","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1038\/nrn1931","article-title":"Decoding mental states from brain activity in humans","volume":"7","author":"Haynes","year":"2006","journal-title":"Nature Reviews Neuroscience"},{"key":"2023101014123375800_bib47","doi-asserted-by":"publisher","first-page":"e32816","DOI":"10.7554\/eLife.32816","article-title":"The representational dynamics of task and object processing in humans","volume":"7","author":"Hebart","year":"2018","journal-title":"eLife"},{"key":"2023101014123375800_bib48","doi-asserted-by":"publisher","first-page":"10023","DOI":"10.1073\/pnas.0603949103","article-title":"Involvement of human left dorsolateral prefrontal cortex in perceptual decision making is independent of response modality","volume":"103","author":"Heekeren","year":"2006","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023101014123375800_bib49","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1146\/annurev.psych.50.1.243","article-title":"High-level scene perception","volume":"50","author":"Henderson","year":"1999","journal-title":"Annual Review of Psychology"},{"key":"2023101014123375800_bib50","doi-asserted-by":"publisher","first-page":"1622","DOI":"10.1152\/jn.00515.2021","article-title":"Resolving the time course of visual and auditory object categorization","volume":"127","author":"Iamshchinina","year":"2022","journal-title":"Journal of Neurophysiology"},{"key":"2023101014123375800_bib51","doi-asserted-by":"publisher","first-page":"1726","DOI":"10.3389\/fpsyg.2017.01726","article-title":"Deep convolutional neural networks outperform feature-based but not categorical models in explaining object similarity judgments","volume":"8","author":"Jozwik","year":"2017","journal-title":"Frontiers in Psychology"},{"key":"2023101014123375800_bib52","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1038\/s42003-022-04194-y","article-title":"Disentangling five dimensions of animacy in human brain and behaviour","volume":"5","author":"Jozwik","year":"2022","journal-title":"Communications Biology"},{"key":"2023101014123375800_bib53","doi-asserted-by":"publisher","first-page":"117045","DOI":"10.1016\/j.neuroimage.2020.117045","article-title":"Rapid contextualization of fragmented scene information in the human visual system","volume":"219","author":"Kaiser","year":"2020","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib54","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1038\/nn1444","article-title":"Decoding the visual and subjective contents of the human brain","volume":"8","author":"Kamitani","year":"2005","journal-title":"Nature Neuroscience"},{"key":"2023101014123375800_bib55","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1016\/j.neuron.2020.09.035","article-title":"Fast recurrent processing via ventrolateral prefrontal cortex is needed by the primate ventral stream for robust core visual object recognition","volume":"109","author":"Kar","year":"2021","journal-title":"Neuron"},{"key":"2023101014123375800_bib56","doi-asserted-by":"publisher","first-page":"974","DOI":"10.1038\/s41593-019-0392-5","article-title":"Evidence that recurrent circuits are critical to the ventral stream's execution of core object recognition behavior","volume":"22","author":"Kar","year":"2019","journal-title":"Nature Neuroscience"},{"key":"2023101014123375800_bib57","doi-asserted-by":"publisher","first-page":"e1003915","DOI":"10.1371\/journal.pcbi.1003915","article-title":"Deep supervised, but not unsupervised, models may explain IT cortical representation","volume":"10","author":"Khaligh-Razavi","year":"2014","journal-title":"PLoS Computational Biology"},{"key":"2023101014123375800_bib58","doi-asserted-by":"publisher","first-page":"21854","DOI":"10.1073\/pnas.1905544116","article-title":"Recurrence is required to capture the representational dynamics of the human visual system","volume":"116","author":"Kietzmann","year":"2019","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023101014123375800_bib59","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1038\/5739","article-title":"Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque","volume":"2","author":"Kim","year":"1999","journal-title":"Nature Neuroscience"},{"key":"2023101014123375800_bib60","doi-asserted-by":"publisher","first-page":"368","DOI":"10.1016\/j.neuroimage.2019.04.079","article-title":"Similarity judgments and cortical visual responses reflect different properties of object and scene categories in naturalistic images","volume":"197","author":"King","year":"2019","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib61","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3389\/neuro.06.004.2008","article-title":"Representational similarity analysis\u2014Connecting the branches of systems neuroscience","volume":"2","author":"Kriegeskorte","year":"2008","journal-title":"Frontiers in Systems Neuroscience"},{"key":"2023101014123375800_bib62","doi-asserted-by":"publisher","first-page":"9596","DOI":"10.1073\/pnas.092277599","article-title":"Rapid natural scene categorization in the near absence of attention","volume":"99","author":"Li","year":"2002","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023101014123375800_bib63","doi-asserted-by":"publisher","first-page":"2017","DOI":"10.1162\/jocn_a_01544","article-title":"Convolutional neural networks as a model of the visual system: Past, present, and future","volume":"33","author":"Lindsay","year":"2021","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023101014123375800_bib64","doi-asserted-by":"publisher","DOI":"10.1101\/2021.03.11.434452","article-title":"Value signals in orbitofrontal cortex predict economic decisions on a trial-to-trial basis","author":"McGinty","year":"2021","journal-title":"bioRxiv 2021.03.11.434452"},{"key":"2023101014123375800_bib65","doi-asserted-by":"publisher","first-page":"e2011417118","DOI":"10.1073\/pnas.2011417118","article-title":"An ecologically motivated image dataset for deep learning yields better models of human vision","volume":"118","author":"Mehrer","year":"2021","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023101014123375800_bib66","doi-asserted-by":"publisher","first-page":"e1003553","DOI":"10.1371\/journal.pcbi.1003553","article-title":"A toolbox for representational similarity analysis","volume":"10","author":"Nili","year":"2014","journal-title":"PLoS Computational Biology"},{"key":"2023101014123375800_bib67","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1162\/08989290051137549","article-title":"Mental imagery of faces and places activates corresponding stimulus-specific brain regions","volume":"12","author":"O'Craven","year":"2000","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023101014123375800_bib68","doi-asserted-by":"publisher","first-page":"e156869","DOI":"10.1155\/2011\/156869","article-title":"FieldTrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data","volume":"2011","author":"Oostenveld","year":"2010","journal-title":"Computational Intelligence and Neuroscience"},{"key":"2023101014123375800_bib69","doi-asserted-by":"publisher","first-page":"8965","DOI":"10.1523\/JNEUROSCI.1655-06.2006","article-title":"Neural representation of task difficulty and decision making during perceptual categorization: A timing diagram","volume":"26","author":"Philiastides","year":"2006","journal-title":"Journal of Neuroscience"},{"key":"2023101014123375800_bib70","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1093\/cercor\/bhi130","article-title":"Temporal characterization of the neural correlates of perceptual decision making in the human brain","volume":"16","author":"Philiastides","year":"2006","journal-title":"Cerebral Cortex"},{"key":"2023101014123375800_bib71","doi-asserted-by":"publisher","first-page":"13082","DOI":"10.1523\/JNEUROSCI.3540-07.2007","article-title":"EEG-informed fMRI reveals spatiotemporal characteristics of perceptual decision making","volume":"27","author":"Philiastides","year":"2007","journal-title":"Journal of Neuroscience"},{"key":"2023101014123375800_bib72","doi-asserted-by":"publisher","DOI":"10.1101\/2022.08.23.505015","article-title":"RTNet: A neural network that exhibits the signatures of human perceptual decision making","author":"Rafiei","year":"2022","journal-title":"bioRxiv:2022.08.23.505015"},{"key":"2023101014123375800_bib73","doi-asserted-by":"publisher","first-page":"1761","DOI":"10.1038\/s41593-019-0520-2","article-title":"A deep learning framework for neuroscience","volume":"22","author":"Richards","year":"2019","journal-title":"Nature Neuroscience"},{"key":"2023101014123375800_bib74","doi-asserted-by":"publisher","first-page":"190","DOI":"10.3389\/fnins.2016.00190","article-title":"Neural decoding and \u201cinner\u201d psychophysics: A distance-to-bound approach for linking mind, brain, and behavior","volume":"10","author":"Ritchie","year":"2016","journal-title":"Frontiers in Neuroscience"},{"key":"2023101014123375800_bib75","doi-asserted-by":"publisher","first-page":"e1004316","DOI":"10.1371\/journal.pcbi.1004316","article-title":"Emerging object representations in the visual system predict reaction times for categorization","volume":"11","author":"Ritchie","year":"2015","journal-title":"PLoS Computational Biology"},{"key":"2023101014123375800_bib76","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1038\/s41583-020-00395-8","article-title":"If deep learning is the answer, what is the question?","volume":"22","author":"Saxe","year":"2021","journal-title":"Nature Reviews Neuroscience"},{"key":"2023101014123375800_bib77","doi-asserted-by":"publisher","first-page":"413","DOI":"10.1016\/j.neuron.2020.07.040","article-title":"Integrative benchmarking to advance neurally mechanistic models of human intelligence","volume":"108","author":"Schrimpf","year":"2020","journal-title":"Neuron"},{"key":"2023101014123375800_bib78","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1016\/j.neuroimage.2017.07.018","article-title":"Convolutional neural network-based encoding and decoding of visual object recognition in space and time","volume":"180","author":"Seeliger","year":"2018","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib79","doi-asserted-by":"publisher","first-page":"e1008022","DOI":"10.1371\/journal.pcbi.1008022","article-title":"Depth in convolutional neural networks solves scene segmentation","volume":"16","author":"Seijdel","year":"2020","journal-title":"PLoS Computational Biology"},{"key":"2023101014123375800_bib80","doi-asserted-by":"publisher","first-page":"eabm2219","DOI":"10.1126\/sciadv.abm2219","article-title":"Reassessing hierarchical correspondences between brain and deep networks through direct interface","volume":"8","author":"Sexton","year":"2022","journal-title":"Science Advances"},{"key":"2023101014123375800_bib81","doi-asserted-by":"publisher","DOI":"10.1101\/2022.04.06.487259","article-title":"Mechanisms of human dynamic object recognition revealed by sequential deep neural networks","author":"S\u00f6rensen","year":"2022","journal-title":"bioRxiv:2022.04.06.487259"},{"key":"2023101014123375800_bib82","doi-asserted-by":"publisher","first-page":"e1008215","DOI":"10.1371\/journal.pcbi.1008215","article-title":"Recurrent neural networks can explain flexible trading of speed and accuracy in biological vision","volume":"16","author":"Spoerer","year":"2020","journal-title":"PLoS Computational Biology"},{"key":"2023101014123375800_bib83","doi-asserted-by":"publisher","first-page":"2767","DOI":"10.1016\/j.cell.2021.03.042","article-title":"High-precision coding in visual cortex","volume":"184","author":"Stringer","year":"2021","journal-title":"Cell"},{"key":"2023101014123375800_bib84","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1162\/08989290152001880","article-title":"The time course of visual processing: From early perception to decision-making","volume":"13","author":"VanRullen","year":"2001","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023101014123375800_bib85","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-2440-0","volume-title":"The nature of statistical learning theory","author":"Vapnik","year":"1995"},{"key":"2023101014123375800_bib86","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1016\/j.neuroimage.2016.02.019","article-title":"Perceptual similarity of visual patterns predicts dynamic neural activation patterns measured with MEG","volume":"132","author":"Wardle","year":"2016","journal-title":"Neuroimage"},{"key":"2023101014123375800_bib87","doi-asserted-by":"publisher","first-page":"8619","DOI":"10.1073\/pnas.1403112111","article-title":"Performance-optimized hierarchical models predict neural responses in higher visual cortex","volume":"111","author":"Yamins","year":"2014","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023101014123375800_bib88","doi-asserted-by":"publisher","first-page":"1174","DOI":"10.1111\/ejn.15598","article-title":"The effect of task on object processing revealed by EEG decoding","volume":"55","author":"Yip","year":"2022","journal-title":"European Journal of Neuroscience"},{"key":"2023101014123375800_bib89","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2210.08340","article-title":"Toward next-generation artificial intelligence: Catalyzing the NeuroAI revolution","author":"Zador","year":"2022","journal-title":"arXiv:2210.08340"},{"key":"2023101014123375800_bib90","doi-asserted-by":"publisher","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","article-title":"Places: A 10 million image database for scene recognition","volume":"40","author":"Zhou","year":"2018","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/11\/1879\/2162581\/jocn_a_02043.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/11\/1879\/2162581\/jocn_a_02043.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,10]],"date-time":"2023-10-10T10:14:24Z","timestamp":1696932864000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/35\/11\/1879\/117201\/Empirically-Identifying-and-Computationally"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":90,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11,1]]},"published-print":{"date-parts":[[2023,11,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_02043","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.01.22.525084","asserted-by":"object"}]},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}