{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T20:01:12Z","timestamp":1764964872509,"version":"3.46.0"},"reference-count":57,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T00:00:00Z","timestamp":1763424000000},"content-version":"vor","delay-in-days":321,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NIH","award":["R01EY030854"],"award-info":[{"award-number":["R01EY030854"]}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,12,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Two defining visual features of a real-world object are its shape and color. While previous fMRI pattern decoding studies showed that these features are represented in a largely orthogonal and independent manner in the human occipitotemporal cortex (OTC) during visual perception, how they are coded together in visual working memory (VWM) remains unknown. Here, we asked human participants to retain a real-world object\u2019s shape and color together in VWM. Using fMRI pattern decoding, we trained a linear classifier to decode two object shapes in one color to then decode the same two object shapes either in the same color (within-decoding) or in a different color (cross-decoding). During VWM encoding, replicating prior findings, we found significant cross-decoding and no drop in cross-decoding compared to within-decoding across OTC, indicating orthogonal and independent shape and color coding. During VWM delay, we again found significant cross-decoding, but more critically, a significant cross-decoding drop in OTC shape-selective areas and ventral color areas, indicating interactive shape and color coding in these areas in VWM. To our knowledge, this is the first time that interactive shape and color representations are reported in VWM in the human brain using fMRI pattern decoding. Sensory representations of an object\u2019s shape and color are thus transformed during VWM delay, likely tracking the demand of VWM to enable more efficient information storage.<\/jats:p>","DOI":"10.1162\/imag.a.1049","type":"journal-article","created":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T20:01:58Z","timestamp":1763496118000},"update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":0,"title":["Interactive shape and color representation in visual working memory for colored objects in the human occipitotemporal cortex"],"prefix":"10.1162","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8697-314X","authenticated-orcid":false,"given":"Yaoda","family":"Xu","sequence":"first","affiliation":[{"name":"Yale University, New Haven, CT, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Swinchoski","sequence":"additional","affiliation":[{"name":"Yale University, New Haven, CT, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"JohnMark","family":"Taylor","sequence":"additional","affiliation":[{"name":"Columbia University, New York, NY, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marvin","family":"Chun","sequence":"additional","affiliation":[{"name":"Yale University, New Haven, CT, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2025,12,5]]},"reference":[{"issue":"1","key":"2025120514560893400_IMAG.a.1049-b1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"issue":"10","key":"2025120514560893400_IMAG.a.1049-b2","doi-asserted-by":"crossref","first-page":"1711","DOI":"10.1162\/jocn_a_00422","article-title":"The role of transverse occipital sulcus in scene perception and its relationship to object individuation in inferior intraparietal sulcus","volume":"25","author":"Bettencourt","year":"2013","journal-title":"Journal of Cognitive Neuroscience"},{"issue":"1","key":"2025120514560893400_IMAG.a.1049-b3","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1038\/nn.4174","article-title":"Decoding under distraction reveals distinct occipital and parietal contributions to visual short-term memory representation","volume":"19","author":"Bettencourt","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"3","key":"2025120514560893400_IMAG.a.1049-b4","doi-asserted-by":"crossref","first-page":"1488","DOI":"10.1152\/jn.00404.2016","article-title":"Understanding location- and feature-based processing along the human intraparietal sulcus","volume":"116","author":"Bettencourt","year":"2016","journal-title":"Journal of Neurophysiology"},{"issue":"4","key":"2025120514560893400_IMAG.a.1049-b5","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1163\/156856897X00357","article-title":"The psychophysics toolbox","volume":"10","author":"Brainard","year":"1997","journal-title":"Spatial Vision"},{"issue":"1","key":"2025120514560893400_IMAG.a.1049-b6","doi-asserted-by":"crossref","first-page":"5737","DOI":"10.1038\/s41598-020-62832-z","article-title":"Surface-based analysis increases the specificity of cortical activation patterns and connectivity results","volume":"10","author":"Brodoehl","year":"2020","journal-title":"Scientific Reports"},{"issue":"44","key":"2025120514560893400_IMAG.a.1049-b7","doi-asserted-by":"crossref","first-page":"13992","DOI":"10.1523\/JNEUROSCI.3577-09.2009","article-title":"Decoding and reconstructing color from responses in human visual cortex","volume":"29","author":"Brouwer","year":"2009","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"2025120514560893400_IMAG.a.1049-b8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1961189.1961199","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"issue":"2","key":"2025120514560893400_IMAG.a.1049-b9","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.tics.2016.12.007","article-title":"The distributed nature of working memory","volume":"21","author":"Christophel","year":"2017","journal-title":"Trends in Cognitive Sciences"},{"issue":"2","key":"2025120514560893400_IMAG.a.1049-b10","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1006\/nimg.1998.0395","article-title":"Cortical surface-based analysis: I. Segmentation and surface reconstruction","volume":"9","author":"Dale","year":"1999","journal-title":"NeuroImage"},{"key":"2025120514560893400_IMAG.a.1049-b11","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1146\/annurev-psych-010814-015031","article-title":"The cognitive neuroscience of working memory","volume":"66","author":"D\u2019Esposito","year":"2015","journal-title":"Annual Review of Psychology"},{"key":"2025120514560893400_IMAG.a.1049-b12","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.94191.3.sa3","article-title":"Visual working memories are abstractions of percepts","author":"Duan","year":"2024","journal-title":"eLife"},{"issue":"1","key":"2025120514560893400_IMAG.a.1049-b13","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/S0896-6273(00)80526-7","article-title":"Cue-invariant activation in object-related areas of the human occipital lobe","volume":"21","author":"Grill-Spector","year":"1998","journal-title":"Neuron"},{"issue":"7238","key":"2025120514560893400_IMAG.a.1049-b14","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1038\/nature07832","article-title":"Decoding reveals the contents of visual working memory in early visual areas","volume":"458","author":"Harrison","year":"2009","journal-title":"Nature"},{"issue":"11","key":"2025120514560893400_IMAG.a.1049-b15","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1162\/jocn_a_01156","article-title":"Task-context dependent linear representation of multiple visual objects in human parietal cortex","volume":"29","author":"Jeong","year":"2017","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2025120514560893400_IMAG.a.1049-b16","doi-asserted-by":"crossref","unstructured":"Kiyonaga, A., & Serences, J. T.\n          Sensory reformatting for a working visual memory. Trends in Cognitive Sciences (In press). https:\/\/doi.org\/10.1016\/j.tics.2025.09.006","DOI":"10.1016\/j.tics.2025.09.006"},{"issue":"9","key":"2025120514560893400_IMAG.a.1049-b17","doi-asserted-by":"crossref","first-page":"3310","DOI":"10.1523\/JNEUROSCI.20-09-03310.2000","article-title":"Cortical regions involved in perceiving object shape","volume":"20","author":"Kourtzi","year":"2000","journal-title":"Journal of Neuroscience"},{"issue":"11","key":"2025120514560893400_IMAG.a.1049-b18","doi-asserted-by":"crossref","first-page":"1822","DOI":"10.1016\/j.neuron.2022.03.016","article-title":"Unveiling the abstract format of mnemonic representations","volume":"110","author":"Kwak","year":"2022","journal-title":"Neuron"},{"issue":"5","key":"2025120514560893400_IMAG.a.1049-b19","doi-asserted-by":"crossref","first-page":"1682","DOI":"10.1523\/JNEUROSCI.3164-15.2016","article-title":"Color-biased regions of the ventral visual pathway lie between face- and place-selective regions in humans, as in macaques","volume":"36","author":"Lafer-Sousa","year":"2016","journal-title":"Journal of Neuroscience"},{"issue":"21","key":"2025120514560893400_IMAG.a.1049-b20","doi-asserted-by":"crossref","first-page":"3435","DOI":"10.1016\/j.cub.2018.08.043","article-title":"Laminar organization of working memory signals in human visual cortex","volume":"28","author":"Lawrence","year":"2018","journal-title":"Current Biology"},{"issue":"6","key":"2025120514560893400_IMAG.a.1049-b21","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1016\/j.tins.2017.04.004","article-title":"Sustained activity encoding working memories: Not fully distributed","volume":"40","author":"Leavitt","year":"2017","journal-title":"Trends in Neurosciences"},{"issue":"18","key":"2025120514560893400_IMAG.a.1049-b22","doi-asserted-by":"crossref","first-page":"3775","DOI":"10.1016\/j.cub.2023.07.067","article-title":"Neural population dynamics of human working memory","volume":"33","author":"Li","year":"2023","journal-title":"Current Biology"},{"issue":"3","key":"2025120514560893400_IMAG.a.1049-b23","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1038\/nn.3038","article-title":"Theta coupling between V4 and prefrontal cortex predicts visual short-term memory performance","volume":"15","author":"Liebe","year":"2012","journal-title":"Nature Neuroscience"},{"issue":"6657","key":"2025120514560893400_IMAG.a.1049-b24","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1038\/36846","article-title":"The capacity of visual working memory for features and conjunctions","volume":"390","author":"Luck","year":"1997","journal-title":"Nature"},{"issue":"18","key":"2025120514560893400_IMAG.a.1049-b25","doi-asserted-by":"crossref","first-page":"8135","DOI":"10.1073\/pnas.92.18.8135","article-title":"Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex","volume":"92","author":"Malach","year":"1995","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"2025120514560893400_IMAG.a.1049-b26","doi-asserted-by":"crossref","first-page":"9088","DOI":"10.1038\/s41598-023-36029-z","article-title":"The representation of multiple visual objects in human ventral visual areas and in convolutional neural networks","volume":"13","author":"Mocz","year":"2023","journal-title":"Scientific Reports"},{"issue":"2","key":"2025120514560893400_IMAG.a.1049-b27","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1016\/j.neuroimage.2010.04.270","article-title":"A comparison of volume-based and surface-based multi-voxel pattern analysis","volume":"56","author":"Oosterhof","year":"2011","journal-title":"NeuroImage"},{"issue":"7","key":"2025120514560893400_IMAG.a.1049-b28","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.tics.2004.05.009","article-title":"Comparative mapping of higher visual areas in monkeys and humans","volume":"8","author":"Orban","year":"2004","journal-title":"Trends in Cognitive Sciences"},{"key":"2025120514560893400_IMAG.a.1049-b29","doi-asserted-by":"crossref","first-page":"932","DOI":"10.3389\/fpsyg.2014.00932","article-title":"Distributed processing of color and form in the visual cortex","volume":"5","author":"Rentzeperis","year":"2014","journal-title":"Frontiers in Psychology"},{"key":"2025120514560893400_IMAG.a.1049-b200","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.visres.2016.09.010","article-title":"Neural mechanisms of information storage in visual short-term memory","volume":"128","author":"Serences","year":"2016","journal-title":"Vision Research"},{"issue":"2","key":"2025120514560893400_IMAG.a.1049-b30","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1111\/j.1467-9280.2009.02276.x","article-title":"Stimulus-specific delay activity in human primary visual cortex","volume":"20","author":"Serences","year":"2009","journal-title":"Psychological Science"},{"issue":"5212","key":"2025120514560893400_IMAG.a.1049-b31","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1126\/science.7754376","article-title":"Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging","volume":"268","author":"Sereno","year":"1995","journal-title":"Science"},{"issue":"3","key":"2025120514560893400_IMAG.a.1049-b32","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/j.cub.2008.12.050","article-title":"The coding of color, motion, and their conjunction in the human visual cortex","volume":"19","author":"Seymour","year":"2009","journal-title":"Current Biology"},{"issue":"8","key":"2025120514560893400_IMAG.a.1049-b33","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1093\/cercor\/bhp265","article-title":"Coding and binding of color and form in visual cortex","volume":"20","author":"Seymour","year":"2010","journal-title":"Cerebral Cortex"},{"issue":"20","key":"2025120514560893400_IMAG.a.1049-b34","doi-asserted-by":"crossref","first-page":"5326","DOI":"10.1523\/JNEUROSCI.0991-07.2007","article-title":"Visual topography of human intraparietal sulcus","volume":"27","author":"Swisher","year":"2007","journal-title":"Journal of Neuroscience"},{"issue":"7","key":"2025120514560893400_IMAG.a.1049-b35","doi-asserted-by":"crossref","first-page":"e0253442","DOI":"10.1371\/journal.pone.0253442","article-title":"Joint representation of color and shape in convolutional neural networks: A stimulus-rich network perspective","volume":"16","author":"Taylor","year":"2021","journal-title":"PLoS One"},{"key":"2025120514560893400_IMAG.a.1049-b36","doi-asserted-by":"crossref","first-page":"118941","DOI":"10.1016\/j.neuroimage.2022.118941","article-title":"Representation of color, form, and their conjunction across the human ventral visual pathway","volume":"251","author":"Taylor","year":"2022","journal-title":"NeuroImage"},{"key":"2025120514560893400_IMAG.a.1049-b37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1162\/imag_a_00354","article-title":"Using fMRI to examine nonlinear mixed selectivity tuning to task and category in the human brain","volume":"2","author":"Taylor","year":"2024","journal-title":"Imaging Neuroscience"},{"key":"2025120514560893400_IMAG.a.1049-b38","doi-asserted-by":"crossref","first-page":"13804","DOI":"10.1038\/ncomms13804","article-title":"Layer-specificity in the effects of attention and working memory on activity in primary visual cortex","volume":"8","author":"van Kerkoerle","year":"2017","journal-title":"Nature Communications"},{"issue":"1","key":"2025120514560893400_IMAG.a.1049-b39","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1162\/jocn_a_01335","article-title":"Spatial frequency tolerant visual object representations in the human ventral and dorsal visual processing pathways","volume":"31","author":"Vaziri-Pashkam","year":"2019","journal-title":"Journal of Cognitive Neuroscience"},{"issue":"36","key":"2025120514560893400_IMAG.a.1049-b40","doi-asserted-by":"crossref","first-page":"8767","DOI":"10.1523\/JNEUROSCI.3392-16.2017","article-title":"Goal-directed visual processing differentially impacts human ventral and dorsal visual representations","volume":"37","author":"Vaziri-Pashkam","year":"2017","journal-title":"Journal of Neuroscience"},{"issue":"5","key":"2025120514560893400_IMAG.a.1049-b41","doi-asserted-by":"crossref","first-page":"2034","DOI":"10.1093\/cercor\/bhy080","article-title":"An information-driven 2-pathway characterization of occipitotemporal and posterior parietal visual object representations","volume":"29","author":"Vaziri-Pashkam","year":"2019","journal-title":"Cerebral Cortex"},{"issue":"2","key":"2025120514560893400_IMAG.a.1049-b42","first-page":"458","article-title":"Limitations of object-based feature encoding in visual short-term memory","volume":"28","author":"Xu","year":"2002","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"issue":"7","key":"2025120514560893400_IMAG.a.1049-b43","doi-asserted-by":"crossref","first-page":"1260","DOI":"10.3758\/BF03194770","article-title":"Encoding color and shape from different parts of an object in visual short-term memory","volume":"64","author":"Xu","year":"2002","journal-title":"Perception & Psychophysics"},{"issue":"10","key":"2025120514560893400_IMAG.a.1049-b44","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1016\/j.tics.2017.06.013","article-title":"Reevaluating the sensory account of visual working memory storage","volume":"21","author":"Xu","year":"2017","journal-title":"Trends in Cognitive Sciences"},{"issue":"3","key":"2025120514560893400_IMAG.a.1049-b45","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.tics.2017.12.008","article-title":"Sensory cortex is nonessential in working memory storage: A reply to commentaries","volume":"22","author":"Xu","year":"2018","journal-title":"Trends in Cognitive Sciences"},{"issue":"5\u20138","key":"2025120514560893400_IMAG.a.1049-b46","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1080\/13506285.2020.1818659","article-title":"Revisit once more the sensory storage account of visual working memory","volume":"28","author":"Xu","year":"2020","journal-title":"Visual Cognition"},{"issue":"7","key":"2025120514560893400_IMAG.a.1049-b47","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1080\/13506285.2021.1946230","article-title":"Towards a better understanding of information storage in visual working memory","volume":"29","author":"Xu","year":"2021","journal-title":"Visual Cognition"},{"issue":"21","key":"2025120514560893400_IMAG.a.1049-b48","doi-asserted-by":"crossref","first-page":"4516","DOI":"10.1016\/j.cub.2023.08.080","article-title":"Parietal-driven visual working memory representation in occipito-temporal cortex","volume":"33","author":"Xu","year":"2023","journal-title":"Current Biology"},{"issue":"3","key":"2025120514560893400_IMAG.a.1049-b49","doi-asserted-by":"crossref","first-page":"e3002915","DOI":"10.1371\/journal.pbio.3002915","article-title":"The human posterior parietal cortices orthogonalize the representation of different streams of information concurrently coded in visual working memory","volume":"22","author":"Xu","year":"2024","journal-title":"PLoS Biology"},{"issue":"7","key":"2025120514560893400_IMAG.a.1049-b50","doi-asserted-by":"crossref","first-page":"ENEURO.0162","DOI":"10.1523\/ENEURO.0162-25.2025","article-title":"Transformed visual working memory representations in human occipitotemporal and posterior parietal cortices","volume":"12","author":"Xu","year":"2025","journal-title":"Eneuro"},{"key":"2025120514560893400_IMAG.a.1049-b51","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/B978-0-12-801371-7.00004-1","article-title":"The contribution of human superior intraparietal sulcus to visual short-term memory and perception","volume-title":"Mechanisms of sensory working memory: Attention and performance","author":"Xu","year":"2015"},{"key":"2025120514560893400_IMAG.a.1049-b52","doi-asserted-by":"crossref","first-page":"107140","DOI":"10.1016\/j.neuropsychologia.2019.107140","article-title":"Task modulation of the 2-pathway characterization of occipitotemporal and posterior parietal visual object representations","volume":"132","author":"Xu","year":"2019","journal-title":"Neuropsychologia"},{"key":"2025120514560893400_IMAG.a.1049-b53","doi-asserted-by":"crossref","first-page":"119635","DOI":"10.1016\/j.neuroimage.2022.119635","article-title":"Understanding transformation tolerant visual object representations in the human brain and convolutional neural networks","volume":"263","author":"Xu","year":"2022","journal-title":"NeuroImage"},{"key":"2025120514560893400_IMAG.a.1049-b54","doi-asserted-by":"crossref","first-page":"120149","DOI":"10.1016\/j.neuroimage.2023.120149","article-title":"Categorical working memory codes in human visual cortex","volume":"274","author":"Yan","year":"2023","journal-title":"NeuroImage"},{"key":"2025120514560893400_IMAG.a.1049-b55","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.neuroimage.2017.05.055","article-title":"Occipital, parietal, and frontal cortices selectively maintain task-relevant features of multi-feature objects in visual working memory","volume":"157","author":"Yu","year":"2017","journal-title":"NeuroImage"},{"issue":"6","key":"2025120514560893400_IMAG.a.1049-b56","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TPAMI.2017.2723009","article-title":"Places: A 10 million image database for scene recognition","volume":"40","author":"Zhou","year":"2018","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"}],"container-title":["Imaging Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/imag\/article-pdf\/doi\/10.1162\/IMAG.a.1049\/2565680\/imag.a.1049.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/imag\/article-pdf\/doi\/10.1162\/IMAG.a.1049\/2565680\/imag.a.1049.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T19:56:33Z","timestamp":1764964593000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/imag\/article\/doi\/10.1162\/IMAG.a.1049\/134145\/Interactive-shape-and-color-representation-in"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"references-count":57,"URL":"https:\/\/doi.org\/10.1162\/imag.a.1049","relation":{},"ISSN":["2837-6056"],"issn-type":[{"type":"electronic","value":"2837-6056"}],"subject":[],"published-other":{"date-parts":[[2025]]},"published":{"date-parts":[[2025]]},"article-number":"IMAG.a.1049"}}