{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T03:01:36Z","timestamp":1793070096672,"version":"4.5.0"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,7,9]],"date-time":"2024-07-09T00:00:00Z","timestamp":1720483200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,9]],"date-time":"2024-07-09T00:00:00Z","timestamp":1720483200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000025","name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01MH112541"],"award-info":[{"award-number":["R01MH112541"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Commun"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In everyday life, people need to respond appropriately to many types of emotional stimuli. Here, we investigate whether human occipital-temporal cortex (OTC) shows co-representation of the semantic category and affective content of visual stimuli. We also explore whether OTC transformation of semantic and affective features extracts information of value for guiding behavior. Participants viewed 1620 emotional natural images while functional magnetic resonance imaging data were acquired. Using voxel-wise modeling we show widespread tuning to semantic and affective image features across OTC. The top three principal components underlying OTC voxel-wise responses to image features encoded stimulus animacy, stimulus arousal and interactions of animacy with stimulus valence and arousal. At low to moderate dimensionality, OTC tuning patterns predicted behavioral responses linked to each image better than regressors directly based on image features. This is consistent with OTC representing stimulus semantic category and affective content in a manner suited to guiding behavior.<\/jats:p>","DOI":"10.1038\/s41467-024-49073-8","type":"journal-article","created":{"date-parts":[[2024,7,9]],"date-time":"2024-07-09T06:11:11Z","timestamp":1720505471000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Occipital-temporal cortical tuning to semantic and affective features of natural images predicts associated behavioral responses"],"prefix":"10.1038","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-7037-0342","authenticated-orcid":false,"given":"Samy A.","family":"Abdel-Ghaffar","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander G.","family":"Huth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark D.","family":"Lescroart","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dustin","family":"Stansbury","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7273-1054","authenticated-orcid":false,"given":"Jack L.","family":"Gallant","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7833-3030","authenticated-orcid":false,"given":"Sonia J.","family":"Bishop","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,9]]},"reference":[{"key":"49073_CR1","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1038\/nrn.2018.22","volume":"19","author":"J LeDoux","year":"2018","unstructured":"LeDoux, J. & Daw, N. D. Surviving threats: neural circuit and computational implications of a new taxonomy of defensive behaviour. Nat. Rev. Neurosci. 19, 269\u2013282 (2018).","journal-title":"Nat. Rev. Neurosci."},{"key":"49073_CR2","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1038\/scientificamerican0694-50","volume":"270","author":"JE LeDoux","year":"1994","unstructured":"LeDoux, J. E. Emotion, memory and the brain. Sci. Am. 270, 50\u201357 (1994).","journal-title":"Sci. Am."},{"key":"49073_CR3","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1016\/j.physbeh.2007.05.057","volume":"92","author":"A Ohman","year":"2007","unstructured":"Ohman, A., Carlsson, K., Lundqvist, D. & Ingvar, M. On the unconscious subcortical origin of human fear. Physiol. Behav. 92, 180\u2013185 (2007).","journal-title":"Physiol. Behav."},{"key":"49073_CR4","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1038\/nrn2889","volume":"11","author":"M Tamietto","year":"2010","unstructured":"Tamietto, M. & de Gelder, B. Neural bases of the non-conscious perception of emotional signals. Nat. Rev. Neurosci. 11, 697\u2013709 (2010).","journal-title":"Nat. Rev. Neurosci."},{"key":"49073_CR5","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1038\/nrn2920","volume":"11","author":"L Pessoa","year":"2010","unstructured":"Pessoa, L. & Adolphs, R. Emotion processing and the amygdala: from a \u2018low road\u2019 to \u2018many roads\u2019 of evaluating biological significance. Nat. Rev. Neurosci. 11, 773\u2013783 (2010).","journal-title":"Nat. Rev. Neurosci."},{"key":"49073_CR6","doi-asserted-by":"publisher","first-page":"e1004066","DOI":"10.1371\/journal.pcbi.1004066","volume":"11","author":"TD Wager","year":"2015","unstructured":"Wager, T. D. et al. A Bayesian model of category-specific emotional brain responses. PLoS Comput. Biol. 11, e1004066 (2015).","journal-title":"PLoS Comput. Biol."},{"key":"49073_CR7","doi-asserted-by":"publisher","first-page":"1114","DOI":"10.1038\/nn.3749","volume":"17","author":"J Chikazoe","year":"2014","unstructured":"Chikazoe, J., Lee, D. H., Kriegeskorte, N. & Anderson, A. K. Population coding of affect across stimuli, modalities and individuals. Nat. Neurosci. 17, 1114\u20131122 (2014).","journal-title":"Nat. Neurosci."},{"key":"49073_CR8","doi-asserted-by":"publisher","unstructured":"P.A. Kragel, M.C. Reddan, K.S. LaBar & TD Wager (2019) Emotion schemas are embedded in the human visual system. Sci. Adv. https:\/\/doi.org\/10.1126\/sciadv.aaw4358.","DOI":"10.1126\/sciadv.aaw4358"},{"key":"49073_CR9","doi-asserted-by":"publisher","first-page":"1955","DOI":"10.1016\/j.neuroimage.2003.08.011","volume":"20","author":"J Mour\u00e3o-Miranda","year":"2003","unstructured":"Mour\u00e3o-Miranda, J. et al. Contributions of stimulus valence and arousal to visual activation during emotional perception. Neuroimage 20, 1955\u20131963 (2003).","journal-title":"Neuroimage"},{"key":"49073_CR10","doi-asserted-by":"publisher","DOI":"10.1016\/j.isci.2020.101060","volume":"23","author":"T Horikawa","year":"2020","unstructured":"Horikawa, T., Cowen, A. S., Keltner, D. & Kamitani, Y. The neural representation of visually evoked emotion is high-dimensional, categorical, and distributed across transmodal brain regions. iScience 23, 101060 (2020).","journal-title":"iScience"},{"key":"49073_CR11","doi-asserted-by":"publisher","first-page":"3047","DOI":"10.1093\/cercor\/bhaa411","volume":"31","author":"K Bo","year":"2021","unstructured":"Bo, K. et al. Decoding neural representations of affective scenes in retinotopic visual cortex. Cereb. Cortex 31, 3047\u20133063 (2021).","journal-title":"Cereb. Cortex"},{"key":"49073_CR12","doi-asserted-by":"publisher","first-page":"4302","DOI":"10.1523\/JNEUROSCI.17-11-04302.1997","volume":"17","author":"N Kanwisher","year":"1997","unstructured":"Kanwisher, N., McDermott, J. & Chun, M. M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302\u20134311 (1997).","journal-title":"J. Neurosci."},{"key":"49073_CR13","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1162\/089892900562165","volume":"12","author":"I Gauthier","year":"2000","unstructured":"Gauthier, I. et al. The fusiform \u201cface area\u201d is part of a network that processes faces at the individual level. J. Cogn. Neurosci. 12, 495\u2013504 (2000).","journal-title":"J. Cogn. Neurosci."},{"key":"49073_CR14","doi-asserted-by":"publisher","first-page":"2470","DOI":"10.1126\/science.1063414","volume":"293","author":"PE Downing","year":"2001","unstructured":"Downing, P. E., Jiang, Y., Shuman, M. & Kanwisher, N. A cortical area selective for visual processing of the human body. Science 293, 2470\u20132473 (2001).","journal-title":"Science"},{"key":"49073_CR15","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1038\/33402","volume":"392","author":"R Epstein","year":"1998","unstructured":"Epstein, R. & Kanwisher, N. A cortical representation of the local visual environment. Nature 392, 598\u2013601 (1998).","journal-title":"Nature"},{"key":"49073_CR16","doi-asserted-by":"publisher","first-page":"8135","DOI":"10.1073\/pnas.92.18.8135","volume":"92","author":"R Malach","year":"1995","unstructured":"Malach, R. et al. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc. Natl. Acad. Sci. USA 92, 8135\u20138139 (1995).","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"49073_CR17","doi-asserted-by":"publisher","first-page":"3008","DOI":"10.1523\/JNEUROSCI.2106-19.2020","volume":"15","author":"E Margalit","year":"2020","unstructured":"Margalit, E. et al. Ultra-high-resolution fMRI of human ventral temporal cortex reveals differential representation of categories and domains. J. Neurosci. 15, 3008\u20133024 (2020).","journal-title":"J. Neurosci."},{"key":"49073_CR18","doi-asserted-by":"publisher","first-page":"2608","DOI":"10.1523\/JNEUROSCI.5547-11.2012","volume":"32","author":"AC Connolly","year":"2012","unstructured":"Connolly, A. C. et al. The representation of biological classes in the human brain. J. Neurosci. 32, 2608\u20132618 (2012).","journal-title":"J. Neurosci."},{"key":"49073_CR19","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1016\/j.neuron.2007.07.011","volume":"55","author":"BZ Mahon","year":"2007","unstructured":"Mahon, B. Z. Action-related properties shape object representations in the ventral stream. Neuron 55, 507\u2013520 (2007).","journal-title":"Neuron"},{"key":"49073_CR20","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1016\/j.neuron.2009.07.012","volume":"63","author":"BZ Mahon","year":"2009","unstructured":"Mahon, B. Z., Anzellotti, S., Schwarzbach, J., Zampini, M. & Caramazza, A. Category-specific organization in the human brain does not require visual experience. Neuron 63, 397\u2013405 (2009).","journal-title":"Neuron"},{"key":"49073_CR21","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1016\/j.neuropsychologia.2017.03.033","volume":"105","author":"MV Peelen","year":"2017","unstructured":"Peelen, M. V. & Downing, P. E. Category selectivity in human visual cortex: beyond visual object recognition. Neuropsychologia 105, 177\u2013183 (2017).","journal-title":"Neuropsychologia"},{"key":"49073_CR22","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1016\/j.neubiorev.2013.10.006","volume":"41","author":"E Ricciardi","year":"2014","unstructured":"Ricciardi, E., Bonino, D., Pellegrini, S. & Pietrini, P. Mind the blind brain to understand the sighted one! Is there a supramodal cortical functional architecture? Neurosci. Biobehav Rev. 41, 64\u201377 (2014).","journal-title":"Neurosci. Biobehav Rev."},{"key":"49073_CR23","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1016\/j.tics.2008.07.004","volume":"12","author":"RA Epstein","year":"2008","unstructured":"Epstein, R. A. Parahippocampal and retrosplenial contributions to human spatial navigation. Trends Cogn. Sci. 12, 388\u2013396 (2008).","journal-title":"Trends Cogn. Sci."},{"key":"49073_CR24","doi-asserted-by":"publisher","first-page":"591","DOI":"10.3389\/fnhum.2014.00591","volume":"8","author":"F Perini","year":"2014","unstructured":"Perini, F., Caramazza, A. & Peelen, M. V. Left occipitotemporal cortex contributes to the discrimination of tool-associated hand actions: fMRI and TMS evidence. Front. Hum. Neurosci. 8, 591 (2014).","journal-title":"Front. Hum. Neurosci."},{"key":"49073_CR25","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1038\/nature06713","volume":"452","author":"KN Kay","year":"2008","unstructured":"Kay, K. N., Naselaris, T., Prenger, R. J. & Gallant, J. L. Identifying natural images from human brain activity. Nature 452, 352\u2013355 (2008).","journal-title":"Nature"},{"key":"49073_CR26","doi-asserted-by":"publisher","first-page":"902","DOI":"10.1016\/j.neuron.2009.09.006","volume":"63","author":"T Naselaris","year":"2009","unstructured":"Naselaris, T., Prenger, R. J., Kay, K. N., Oliver, M. & Gallant, J. L. Bayesian reconstruction of natural images from human brain activity. Neuron 63, 902\u2013915 (2009).","journal-title":"Neuron"},{"key":"49073_CR27","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1016\/j.neuroimage.2010.07.073","volume":"56","author":"T Naselaris","year":"2011","unstructured":"Naselaris, T., Kay, K. N., Nishimoto, S. & Gallant, J. L. Encoding and decoding in fMRI. Neuroimage 56, 400\u2013410 (2011).","journal-title":"Neuroimage"},{"key":"49073_CR28","doi-asserted-by":"publisher","first-page":"1210","DOI":"10.1016\/j.neuron.2012.10.014","volume":"76","author":"AG Huth","year":"2012","unstructured":"Huth, A. G., Nishimoto, S., Vu, A. T. & Gallant, J. L. A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron 76, 1210\u20131224 (2012).","journal-title":"Neuron"},{"key":"49073_CR29","doi-asserted-by":"publisher","first-page":"E962","DOI":"10.1073\/pnas.1312567111","volume":"111","author":"A Harel","year":"2014","unstructured":"Harel, A., Kravitz, D. J. & Baker, C. I. Task context impacts visual object processing differentially across the cortex. Proc. Natl. Acad. Sci. 111, E962\u2013E971 (2014).","journal-title":"Proc. Natl. Acad. Sci."},{"key":"49073_CR30","first-page":"310","volume":"27","author":"S Bracci","year":"2017","unstructured":"Bracci, S., Daniels, N. & Op de Beeck, H. Task context overrules object- and category-related representational content in the human parietal cortex. Cereb. Cortex 27, 310\u2013321 (2017).","journal-title":"Cereb. Cortex"},{"key":"49073_CR31","doi-asserted-by":"publisher","first-page":"216","DOI":"10.1016\/j.pneurobio.2008.09.001","volume":"86","author":"ET Rolls","year":"2008","unstructured":"Rolls, E. T. & Grabenhorst, F. The orbitofrontal cortex and beyond: from affect to decision-making. Prog. Neurobiol. 86, 216\u2013244. (2008).","journal-title":"Prog. Neurobiol."},{"key":"49073_CR32","doi-asserted-by":"publisher","first-page":"973","DOI":"10.1038\/nn.4320","volume":"19","author":"EL Rich","year":"2016","unstructured":"Rich, E. L. & Wallis, J. D. Decoding subjective decisions from orbitofrontal cortex. Nat. Neurosci. 19, 973\u2013980 (2016).","journal-title":"Nat. Neurosci."},{"key":"49073_CR33","doi-asserted-by":"publisher","first-page":"14693","DOI":"10.1523\/JNEUROSCI.2218-11.2011","volume":"31","author":"DJ Levy","year":"2011","unstructured":"Levy, D. J. & Glimcher, P. W. Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain. J. Neurosci. 31, 14693\u201314707 (2011).","journal-title":"J. Neurosci."},{"key":"49073_CR34","doi-asserted-by":"publisher","first-page":"412","DOI":"10.1016\/j.neuroimage.2013.02.063","volume":"76","author":"O Bartra","year":"2013","unstructured":"Bartra, O., McGuire, J. T. & Kable, J. W. The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76, 412\u2013427 (2013).","journal-title":"Neuroimage"},{"key":"49073_CR35","doi-asserted-by":"publisher","first-page":"820","DOI":"10.1038\/35097575","volume":"2","author":"J Duncan","year":"2001","unstructured":"Duncan, J. An adaptive coding model of neural function in prefrontal cortex. Nat. Rev. Neurosci. 2, 820\u2013829 (2001).","journal-title":"Nat. Rev. Neurosci."},{"key":"49073_CR36","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1016\/j.neuron.2009.02.025","volume":"62","author":"H Liu","year":"2009","unstructured":"Liu, H., Agam, Y., Madsen, J. R. & Kreiman, G. Timing, timing, timing: fast decoding of object information from intracranial field potentials in human visual cortex. Neuron 62, 281\u2013290 (2009).","journal-title":"Neuron"},{"key":"49073_CR37","doi-asserted-by":"publisher","DOI":"10.1038\/srep20232","volume":"6","author":"DJ Mitchell","year":"2016","unstructured":"Mitchell, D. J. & Cusack, R. Semantic and emotional content of imagined representations in human occipitotemporal cortex. Sci. Rep. 6, 20232 (2016).","journal-title":"Sci. Rep."},{"key":"49073_CR38","unstructured":"Lang, P. J., Bradley, M. M. & Cuthbert, B. N. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Gainesville, Florida: Technical Report A-B, Univ. Florida (2008)."},{"key":"49073_CR39","doi-asserted-by":"crossref","unstructured":"Yao, B., Yang, X. & Wu, T. Image parsing with stochastic grammer: The Lotus Hill dataset and inference scheme. In: the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. City: Miami, Florida (2009).","DOI":"10.1109\/CVPR.2009.5204331"},{"key":"49073_CR40","doi-asserted-by":"publisher","first-page":"1480","DOI":"10.1016\/j.neuroimage.2007.02.005","volume":"35","author":"GK Aguirre","year":"2007","unstructured":"Aguirre, G. K. Continuous carry-over designs for fMRI. Neuroimage 35, 1480\u20131494 (2007).","journal-title":"Neuroimage"},{"key":"49073_CR41","doi-asserted-by":"publisher","first-page":"2142","DOI":"10.1016\/j.neuroimage.2011.10.018","volume":"59","author":"JD Power","year":"2012","unstructured":"Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L. & Petersen, S. E. Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. Neuroimage 59, 2142\u20132154 (2012).","journal-title":"Neuroimage"},{"key":"49073_CR42","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1016\/j.neuroimage.2011.12.061","volume":"76","author":"J Carp","year":"2013","unstructured":"Carp, J. Optimizing the order of operations for movement scrubbing: Comment on Power et al. Neuroimage 76, 436\u2013438 (2013).","journal-title":"Neuroimage"},{"key":"49073_CR43","doi-asserted-by":"publisher","first-page":"653","DOI":"10.1016\/j.neuron.2012.02.004","volume":"73","author":"J LeDoux","year":"2012","unstructured":"LeDoux, J. Rethinking the emotional brain. Neuron 73, 653\u2013676 (2012).","journal-title":"Neuron"},{"key":"49073_CR44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fninf.2015.00023","volume":"9","author":"JS Gao","year":"2015","unstructured":"Gao, J. S., Huth, A. G., Lescroart, M. D. & Gallant, J. L. Pycortex: an interactive surface visualizer for fMRI. Front. Neuroinform. 9, 1\u201312 (2015).","journal-title":"Front. Neuroinform."}],"container-title":["Nature Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-49073-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-49073-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-49073-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,9]],"date-time":"2024-07-09T06:11:55Z","timestamp":1720505515000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41467-024-49073-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,9]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["49073"],"URL":"https:\/\/doi.org\/10.1038\/s41467-024-49073-8","relation":{},"ISSN":["2041-1723"],"issn-type":[{"value":"2041-1723","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,9]]},"assertion":[{"value":"29 October 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"5531"}}