{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T04:33:28Z","timestamp":1773722008284,"version":"3.50.1"},"reference-count":62,"publisher":"MIT Press","issue":"6","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31600907"],"award-info":[{"award-number":["31600907"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Visual perception and mental imagery have been shown to share a hierarchical topological visual structure of neural representation, despite the existence of dissociation of neural substrate between them in function and structure. However, we have limited knowledge about how the visual hierarchical cortex is involved in visual perception and visual imagery in a unique and shared fashion. In this study, a data set including a visual perception and an imagery experiment with human participants was used to train 2 types of voxel-wise encoding models. These models were based on Gabor features and voxel activity patterns of high-level visual cortex (i.e., fusiform face area, parahippocampal place area, and lateral occipital complex) to predict activity in the early visual cortex (EVC, i.e., V1, V2, V3) during perception, and then tested with respect to the generalization of these models to mental imagery. Our results showed that during perception and imagery, activities in the EVC could be independently predicted by the Gabor features and activity of high-level visual cortex via voxel-wise encoding models, which suggested that perception and imagery might share neural representation in the EVC. We further found Gabor-specific and non-Gabor-specific patterns of neural response to stimuli in the EVC, which were shared by perception and imagery. These findings provide insight into the mechanisms of how visual perception and imagery share representation in the EVC.<\/jats:p>","DOI":"10.1162\/jocn_a_01992","type":"journal-article","created":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T15:35:53Z","timestamp":1681313753000},"page":"1045-1060","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":4,"title":["Gabor and Non-Gabor Neural Representations Are Shared between Visual Perception and Mental Imagery"],"prefix":"10.1162","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5420-5122","authenticated-orcid":true,"given":"Yingying","family":"Huang","sequence":"first","affiliation":[{"name":"South China Normal University, Guangzhou, China"},{"name":"University of Glasgow, United Kingdom"}]},{"given":"Frank","family":"Pollick","sequence":"additional","affiliation":[{"name":"University of Glasgow, United Kingdom"}]},{"given":"Ming","family":"Liu","sequence":"additional","affiliation":[{"name":"South China Normal University, Guangzhou, China"}]},{"given":"Delong","family":"Zhang","sequence":"additional","affiliation":[{"name":"South China Normal University, Guangzhou, China"},{"name":"Kashi University, Kashgar, China"}]}],"member":"281","published-online":{"date-parts":[[2023,6,1]]},"reference":[{"key":"2023050222243327400_bib1","doi-asserted-by":"publisher","first-page":"6389","DOI":"10.1523\/JNEUROSCI.0537-20.2020","article-title":"Prior expectations of motion direction modulate early sensory processing","volume":"40","author":"Aitken","year":"2020","journal-title":"Journal of Neuroscience"},{"key":"2023050222243327400_bib2","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.1016\/j.cub.2013.05.065","article-title":"Shared representations for working memory and mental imagery in early visual cortex","volume":"23","author":"Albers","year":"2013","journal-title":"Current Biology"},{"key":"2023050222243327400_bib3","doi-asserted-by":"publisher","first-page":"332","DOI":"10.1016\/j.neuroimage.2019.06.057","article-title":"Visual imagery during real-time fMRI neurofeedback from occipital and superior parietal cortex","volume":"200","author":"Andersson","year":"2019","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib4","doi-asserted-by":"publisher","first-page":"1367","DOI":"10.1016\/j.cub.2013.06.012","article-title":"Mental imagery changes multisensory perception","volume":"23","author":"Berger","year":"2013","journal-title":"Current Biology"},{"key":"2023050222243327400_bib5","doi-asserted-by":"publisher","first-page":"849","DOI":"10.3758\/mc.36.4.849","article-title":"Visual mental imagery and visual perception: Structural equivalence revealed by scanning processes","volume":"36","author":"Borst","year":"2008","journal-title":"Memory & Cognition"},{"key":"2023050222243327400_bib6","doi-asserted-by":"publisher","first-page":"1037","DOI":"10.1098\/rspb.1998.0396","article-title":"Extrastriate feedback to primary visual cortex in primates: A quantitative analysis of connectivity","volume":"265","author":"Budd","year":"1998","journal-title":"Proceedings of the Royal Society of London, Series B: Biological Sciences"},{"key":"2023050222243327400_bib7","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1093\/brain\/120.2.217","article-title":"Field-specific deficits in visual imagery following hemianopia due to unilateral occipital infarcts","volume":"120","author":"Butter","year":"1997","journal-title":"Brain"},{"key":"2023050222243327400_bib8","doi-asserted-by":"publisher","first-page":"10577","DOI":"10.1523\/JNEUROSCI.3726-05.2005","article-title":"Do we know what the early visual system does?","volume":"25","author":"Carandini","year":"2005","journal-title":"Journal of Neuroscience"},{"key":"2023050222243327400_bib9","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1093\/cercor\/bhr106","article-title":"Imagery and perception share cortical representations of content and location","volume":"22","author":"Cichy","year":"2012","journal-title":"Cerebral Cortex"},{"key":"2023050222243327400_bib10","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1007\/BF01320076","article-title":"Dual coding theory and education","volume":"3","author":"Clark","year":"1991","journal-title":"Educational Psychology Review"},{"key":"2023050222243327400_bib11","doi-asserted-by":"publisher","first-page":"1160","DOI":"10.1364\/JOSAA.2.001160","article-title":"Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters","volume":"2","author":"Daugman","year":"1985","journal-title":"Journal of the Optical Society of America A: Optics and Image Science"},{"key":"2023050222243327400_bib12","doi-asserted-by":"publisher","first-page":"2382","DOI":"10.1073\/pnas.93.6.2382","article-title":"Mapping striate and extrastriate visual areas in human cerebral cortex","volume":"93","author":"DeYoe","year":"1996","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023050222243327400_bib13","doi-asserted-by":"publisher","first-page":"1703","DOI":"10.1016\/j.neuroimage.2010.08.034","article-title":"The power of imagination\u2014How anticipatory mental imagery alters perceptual processing of fearful facial expressions","volume":"54","author":"Diekhof","year":"2011","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib14","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/j.tics.2019.02.004","article-title":"Shared neural mechanisms of visual perception and imagery","volume":"23","author":"Dijkstra","year":"2019","journal-title":"Trends in Cognitive Sciences"},{"key":"2023050222243327400_bib15","doi-asserted-by":"publisher","first-page":"e33904","DOI":"10.7554\/eLife.33904","article-title":"Differential temporal dynamics during visual imagery and perception","volume":"7","author":"Dijkstra","year":"2018","journal-title":"eLife"},{"key":"2023050222243327400_bib16","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1016\/j.neuron.2007.10.017","article-title":"Mapping the matrix: The ways of neocortex","volume":"56","author":"Douglas","year":"2007","journal-title":"Neuron"},{"key":"2023050222243327400_bib17","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1038\/369525a0","article-title":"fMRI of human visual cortex","volume":"369","author":"Engel","year":"1994","journal-title":"Nature"},{"key":"2023050222243327400_bib18","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1038\/nature07832","article-title":"Decoding reveals the contents of visual working memory in early visual areas","volume":"458","author":"Harrison","year":"2009","journal-title":"Nature"},{"key":"2023050222243327400_bib19","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1038\/nn1445","article-title":"Predicting the orientation of invisible stimuli from activity in human primary visual cortex","volume":"8","author":"Haynes","year":"2005","journal-title":"Nature Neuroscience"},{"key":"2023050222243327400_bib20","doi-asserted-by":"publisher","first-page":"15037","DOI":"10.1038\/ncomms15037","article-title":"Generic decoding of seen and imagined objects using hierarchical visual features","volume":"8","author":"Horikawa","year":"2017","journal-title":"Nature Communications"},{"key":"2023050222243327400_bib21","doi-asserted-by":"publisher","first-page":"1501","DOI":"10.1152\/jn.00812.2009","article-title":"Recognition alters the spatial pattern of FMRI activation in early retinotopic cortex","volume":"103","author":"Hsieh","year":"2010","journal-title":"Journal of Neurophysiology"},{"key":"2023050222243327400_bib22","doi-asserted-by":"publisher","first-page":"1772","DOI":"10.1126\/science.7792605","article-title":"Common mechanisms of visual imagery and perception","volume":"268","author":"Ishai","year":"1995","journal-title":"Science"},{"key":"2023050222243327400_bib23","doi-asserted-by":"publisher","DOI":"10.1037\/10538-000","volume-title":"The principles of psychology","author":"James","year":"1890"},{"key":"2023050222243327400_bib24","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1152\/jn.1987.58.6.1233","article-title":"An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex","volume":"58","author":"Jones","year":"1987","journal-title":"Journal of Neurophysiology"},{"key":"2023050222243327400_bib25","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1038\/nn1444","article-title":"Decoding the visual and subjective contents of the human brain","volume":"8","author":"Kamitani","year":"2005","journal-title":"Nature Neuroscience"},{"key":"2023050222243327400_bib26","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1126\/science.282.5386.108","article-title":"Mechanisms of directed attention in the human extrastriate cortex as revealed by functional MRI","volume":"282","author":"Kastner","year":"1998","journal-title":"Science"},{"key":"2023050222243327400_bib27","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1038\/nature06713","article-title":"Identifying natural images from human brain activity","volume":"452","author":"Kay","year":"2008","journal-title":"Nature"},{"key":"2023050222243327400_bib28","doi-asserted-by":"publisher","first-page":"e50232","DOI":"10.7554\/eLife.50232","article-title":"Cortical excitability controls the strength of mental imagery","volume":"9","author":"Keogh","year":"2020","journal-title":"eLife"},{"key":"2023050222243327400_bib29","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1016\/B978-0-12-821377-3.00012-X","article-title":"Aphantasia: The science of visual imagery extremes","volume-title":"Handbook of clinical neurology","author":"Keogh","year":"2021"},{"key":"2023050222243327400_bib30","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1016\/j.neuron.2012.04.034","article-title":"Less is more: Expectation sharpens representations in the primary visual cortex","volume":"75","author":"Kok","year":"2012","journal-title":"Neuron"},{"key":"2023050222243327400_bib31","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1162\/jocn.1995.7.3.415","article-title":"Image and brain: The resolution of the imagery debate","volume":"7","author":"Kosslyn","year":"1996","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023050222243327400_bib32","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1126\/science.284.5411.167","article-title":"The role of area 17 in visual imagery: Convergent evidence from PET and rTMS","volume":"284","author":"Kosslyn","year":"1999","journal-title":"Science"},{"key":"2023050222243327400_bib33","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1037\/0033-2909.129.5.723","article-title":"When is early visual cortex activated during visual mental imagery?","volume":"129","author":"Kosslyn","year":"2003","journal-title":"Psychological Bulletin"},{"key":"2023050222243327400_bib34","doi-asserted-by":"publisher","first-page":"4064","DOI":"10.1016\/j.neuroimage.2011.10.055","article-title":"Disentangling visual imagery and perception of real-world objects","volume":"59","author":"Lee","year":"2012","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib35","doi-asserted-by":"publisher","first-page":"959","DOI":"10.1109\/34.541406","article-title":"Image representation using 2D Gabor wavelets","volume":"18","author":"Lee","year":"1996","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2023050222243327400_bib36","doi-asserted-by":"publisher","DOI":"10.1101\/2020.01.14.905885","article-title":"Conceptual knowledge affects early stages of visual mental imagery and object perception","author":"Maier","year":"2021","journal-title":"bioRxiv"},{"key":"2023050222243327400_bib37","doi-asserted-by":"publisher","first-page":"118266","DOI":"10.1016\/j.neuroimage.2021.118266","article-title":"Voxel-to-voxel predictive models reveal unexpected structure in unexplained variance","volume":"238","author":"Mell","year":"2021","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib38","unstructured":"Morgan, A. T.\n           (2018). Encoding and decoding of cortical feedback to human early visual cortex. PhD Thesis. University of Glasgow."},{"key":"2023050222243327400_bib39","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1017\/S0140525X12002361","article-title":"Backwards is the way forward: Feedback in the cortical hierarchy predicts the expected future","volume":"36","author":"Muckli","year":"2013","journal-title":"Behavioral and Brain Sciences"},{"key":"2023050222243327400_bib40","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/j.neuroimage.2014.10.018","article-title":"A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes","volume":"105","author":"Naselaris","year":"2015","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib41","doi-asserted-by":"publisher","first-page":"902","DOI":"10.1016\/j.neuron.2009.09.006","article-title":"Bayesian reconstruction of natural images from human brain activity","volume":"63","author":"Naselaris","year":"2009","journal-title":"Neuron"},{"key":"2023050222243327400_bib42","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1162\/08989290051137549","article-title":"Mental imagery of faces and places activates corresponding stimulus-specific brain regions","volume":"12","author":"O'Craven","year":"2000","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023050222243327400_bib43","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1016\/j.visres.2003.10.022","article-title":"BOLD fMRI and psychophysical measurements of contrast response to broadband images","volume":"44","author":"Olman","year":"2004","journal-title":"Vision Research"},{"key":"2023050222243327400_bib44","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1038\/nrn2314","article-title":"Interpreting fMRI data: Maps, modules and dimensions","volume":"9","author":"Op de Beeck","year":"2008","journal-title":"Nature Reviews Neuroscience"},{"key":"2023050222243327400_bib45","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1038\/s41583-019-0202-9","article-title":"The human imagination: The cognitive neuroscience of visual mental imagery","volume":"20","author":"Pearson","year":"2019","journal-title":"Nature Reviews Neuroscience"},{"key":"2023050222243327400_bib46","doi-asserted-by":"publisher","first-page":"982","DOI":"10.1016\/j.cub.2008.05.048","article-title":"The functional impact of mental imagery on conscious perception","volume":"18","author":"Pearson","year":"2008","journal-title":"Current Biology"},{"key":"2023050222243327400_bib47","doi-asserted-by":"publisher","first-page":"10089","DOI":"10.1073\/pnas.1504933112","article-title":"The heterogeneity of mental representation: Ending the imagery debate","volume":"112","author":"Pearson","year":"2015","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2023050222243327400_bib48","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1016\/S0960-9822(01)00242-1","article-title":"Nonmonotonic noise tuning of BOLD fMRI signal to natural images in the visual cortex of the anesthetized monkey","volume":"11","author":"Rainer","year":"2001","journal-title":"Current Biology"},{"key":"2023050222243327400_bib49","doi-asserted-by":"publisher","first-page":"818","DOI":"10.1016\/j.neuroimage.2009.11.084","article-title":"Reading the mind's eye: Decoding category information during mental imagery","volume":"50","author":"Reddy","year":"2010","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib50","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1152\/jn.2002.88.1.455","article-title":"Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex","volume":"88","author":"Ringach","year":"2002","journal-title":"Journal of Neurophysiology"},{"key":"2023050222243327400_bib51","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1016\/j.neuron.2006.07.021","article-title":"The radial bias: A different slant on visual orientation sensitivity in human and nonhuman primates","volume":"51","author":"Sasaki","year":"2006","journal-title":"Neuron"},{"key":"2023050222243327400_bib52","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1126\/science.7754376","article-title":"Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging","volume":"268","author":"Sereno","year":"1995","journal-title":"Science"},{"key":"2023050222243327400_bib53","doi-asserted-by":"publisher","first-page":"550","DOI":"10.1006\/nimg.2000.0642","article-title":"Spatiotemporal frequency and direction sensitivities of human visual areas measured using fMRI","volume":"12","author":"Singh","year":"2000","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib54","doi-asserted-by":"publisher","first-page":"910","DOI":"10.1162\/089892901753165827","article-title":"Motor and visual imagery as two complementary but neurally dissociable mental processes","volume":"13","author":"Sirigu","year":"2001","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2023050222243327400_bib55","doi-asserted-by":"publisher","first-page":"8443","DOI":"10.1523\/JNEUROSCI.5069-11.2012","article-title":"Predictive top\u2013down integration of prior knowledge during speech perception","volume":"32","author":"Sohoglu","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"2023050222243327400_bib56","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1016\/j.neubiorev.2020.12.029","article-title":"Visual mental imagery engages the left fusiform gyrus, but not the early visual cortex: A meta-analysis of neuroimaging evidence","volume":"122","author":"Spagna","year":"2021","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"2023050222243327400_bib57","doi-asserted-by":"publisher","first-page":"1565","DOI":"10.1523\/JNEUROSCI.4657-08.2009","article-title":"Top\u2013down activation of shape-specific population codes in visual cortex during mental imagery","volume":"29","author":"Stokes","year":"2009","journal-title":"Journal of Neuroscience"},{"key":"2023050222243327400_bib58","doi-asserted-by":"publisher","first-page":"1104","DOI":"10.1016\/j.neuroimage.2006.06.062","article-title":"Inverse retinotopy: Inferring the visual content of images from brain activation patterns","volume":"33","author":"Thirion","year":"2006","journal-title":"Neuroimage"},{"key":"2023050222243327400_bib59","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1016\/j.tics.2013.08.005","article-title":"Imagery and visual working memory: One and the same?","volume":"17","author":"Tong","year":"2013","journal-title":"Trends in Cognitive Sciences"},{"key":"2023050222243327400_bib60","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1109\/83.277894","article-title":"Estimation of linear parametric models of nonGaussian discrete random fields with application to texture synthesis","volume":"3","author":"Tugnait","year":"1994","journal-title":"IEEE Transactions on Image Processing"},{"key":"2023050222243327400_bib61","doi-asserted-by":"publisher","first-page":"2621","DOI":"10.1016\/j.cub.2020.04.074","article-title":"Visual imagery and perception share neural representations in the alpha frequency band","volume":"30","author":"Xie","year":"2020","journal-title":"Current Biology"},{"key":"2023050222243327400_bib62","doi-asserted-by":"publisher","first-page":"e108557","DOI":"10.1371\/journal.pone.0108557","article-title":"Neural associations of the early retinotopic cortex with the lateral occipital complex during visual perception","volume":"9","author":"Zhang","year":"2014","journal-title":"PLoS One"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/6\/1045\/2082933\/jocn_a_01992.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/jocn\/article-pdf\/35\/6\/1045\/2082933\/jocn_a_01992.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,2]],"date-time":"2023-05-02T22:24:38Z","timestamp":1683066278000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/35\/6\/1045\/115627\/Gabor-and-Non-Gabor-Neural-Representations-Are"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":62,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,6,1]]},"published-print":{"date-parts":[[2023,6,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01992","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023]]},"published":{"date-parts":[[2023]]}}}