{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T09:45:31Z","timestamp":1778319931251,"version":"3.51.4"},"reference-count":44,"publisher":"MIT Press","issue":"6","funder":[{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01MH064498"],"award-info":[{"award-number":["R01MH064498"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Humans can construct rich subjective experience even when no information is available in the external world. Here, we investigated the neural representation of purely internally generated stimulus-like information during visual working memory. Participants performed delayed recall of oriented gratings embedded in noise with varying contrast during fMRI scanning. Their trialwise behavioral responses provided an estimate of their mental representation of the to-be-reported orientation. We used multivariate inverted encoding models to reconstruct the neural representations of orientation in reference to the response. We found that response orientation could be successfully reconstructed from activity in early visual cortex, even on 0% contrast trials when no orientation information was actually presented, suggesting the existence of a purely internally generated neural code in early visual cortex. In addition, cross-generalization and multidimensional scaling analyses demonstrated that information derived from internal sources was represented differently from typical working memory representations, which receive influences from both external and internal sources. Similar results were also observed in intraparietal sulcus, with slightly different cross-generalization patterns. These results suggest a potential mechanism for how externally driven and internally generated information is maintained in working memory.<\/jats:p>","DOI":"10.1162\/jocn_a_01702","type":"journal-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T15:18:40Z","timestamp":1614784720000},"page":"1142-1157","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":28,"title":["The Neural Codes Underlying Internally Generated Representations in Visual Working Memory"],"prefix":"10.1162","volume":"33","author":[{"given":"Qing","family":"Yu","sequence":"first","affiliation":[{"name":"Chinese Academy of Sciences, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bradley R.","family":"Postle","sequence":"additional","affiliation":[{"name":"University of Wisconsin\u2013Madison"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2021,5,1]]},"reference":[{"key":"2021050319313587500_bib1","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1016\/j.cub.2013.05.065","article-title":"Shared representations for working memory and mental imagery in early visual cortex","volume":"23","author":"Albers","year":"2013","journal-title":"Current Biology"},{"key":"2021050319313587500_bib2","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/S1364-6613(00)01593-X","article-title":"Overlapping mechanisms of attention and spatial working memory","volume":"5","author":"Awh","year":"2001","journal-title":"Trends in Cognitive Sciences"},{"key":"2021050319313587500_bib3","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1038\/nrn1201","article-title":"Working memory: Looking back and looking forward","volume":"4","author":"Baddeley","year":"2003","journal-title":"Nature Reviews Neuroscience"},{"key":"2021050319313587500_bib4","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1177\/0956797619830398","article-title":"Reactivation of previous experiences in a working memory task","volume":"30","author":"Bae","year":"2019","journal-title":"Psychological Science"},{"key":"2021050319313587500_bib5","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1037\/xge0000076","article-title":"Why some colors appear more memorable than others: A model combining categories and particulars in color working memory","volume":"144","author":"Bae","year":"2015","journal-title":"Journal of Experimental Psychology: General"},{"key":"2021050319313587500_bib6","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1167\/14.4.7","article-title":"Stimulus-specific variability in color working memory with delayed estimation","volume":"14","author":"Bae","year":"2014","journal-title":"Journal of Vision"},{"key":"2021050319313587500_bib7","doi-asserted-by":"crossref","first-page":"1016","DOI":"10.1038\/s41593-020-0644-4","article-title":"Interplay between persistent activity and activity-silent dynamics in the prefrontal cortex underlies serial biases in working memory","volume":"23","author":"Barbosa","year":"2020","journal-title":"Nature Neuroscience"},{"key":"2021050319313587500_bib8","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"Journal of the Royal Statistical Society, Series B: Statistical Methodology"},{"key":"2021050319313587500_bib9","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1038\/nn.4174","article-title":"Decoding the content of visual short-term memory under distraction in occipital and parietal areas","volume":"19","author":"Bettencourt","year":"2016","journal-title":"Nature Neuroscience"},{"key":"2021050319313587500_bib10","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1163\/156856897X00357","article-title":"The Psychophysics Toolbox","volume":"10","author":"Brainard","year":"1997","journal-title":"Spatial Vision"},{"key":"2021050319313587500_bib11","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1006\/cbmr.1996.0014","article-title":"AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages","volume":"29","author":"Cox","year":"1996","journal-title":"Computers and Biomedical Research"},{"key":"2021050319313587500_bib12","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1146\/annurev-psych-010814-015031","article-title":"The cognitive neuroscience of working memory","volume":"66","author":"D'Esposito","year":"2015","journal-title":"Annual Review of Psychology"},{"key":"2021050319313587500_bib13","doi-asserted-by":"crossref","first-page":"e33904","DOI":"10.7554\/eLife.33904","article-title":"Differential temporal dynamics during visual imagery and perception","volume":"7","author":"Dijkstra","year":"2018","journal-title":"eLife"},{"key":"2021050319313587500_bib14","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1037\/0096-3445.128.3.309","article-title":"Working memory, short-term memory, and general fluid intelligence: A latent-variable approach","volume":"128","author":"Engle","year":"1999","journal-title":"Journal of Experimental Psychology: General"},{"key":"2021050319313587500_bib15","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1016\/j.neuron.2015.07.013","article-title":"Parietal and frontal cortex encode stimulus-specific mnemonic representations during visual working memory","volume":"87","author":"Ester","year":"2015","journal-title":"Neuron"},{"key":"2021050319313587500_bib16","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1038\/nn.3689","article-title":"Serial dependence in visual perception","volume":"17","author":"Fischer","year":"2014","journal-title":"Nature Neuroscience"},{"key":"2021050319313587500_bib17","doi-asserted-by":"crossref","first-page":"3216","DOI":"10.1016\/j.cub.2017.09.031","article-title":"Alpha-band activity reveals spontaneous representations of spatial position in visual working memory","volume":"27","author":"Foster","year":"2017","journal-title":"Current Biology"},{"key":"2021050319313587500_bib18","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1038\/nrn3476","article-title":"Top\u2013down influences on visual processing","volume":"14","author":"Gilbert","year":"2013","journal-title":"Nature Reviews Neuroscience"},{"key":"2021050319313587500_bib19","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1038\/nature07832","article-title":"Decoding reveals the contents of visual working memory in early visual areas","volume":"458","author":"Harrison","year":"2009","journal-title":"Nature"},{"key":"2021050319313587500_bib20","doi-asserted-by":"crossref","first-page":"3435","DOI":"10.1016\/j.cub.2018.08.043","article-title":"Laminar organization of working memory signals in human visual cortex","volume":"28","author":"Lawrence","year":"2018","journal-title":"Current Biology"},{"key":"2021050319313587500_bib21","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1523\/JNEUROSCI.2453-17.2017","article-title":"Inverted encoding models of human population response conflate noise and neural tuning width","volume":"38","author":"Liu","year":"2018","journal-title":"Journal of Neuroscience"},{"key":"2021050319313587500_bib22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v088.i02","article-title":"JASP: Graphical statistical software for common statistical designs","volume":"88","author":"Love","year":"2019","journal-title":"Journal of Statistical Software"},{"key":"2021050319313587500_bib23","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1016\/j.tics.2013.06.006","article-title":"Visual working memory capacity: From psychophysics and neurobiology to individual differences","volume":"17","author":"Luck","year":"2013","journal-title":"Trends in Cognitive Sciences"},{"key":"2021050319313587500_bib24","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1038\/nn.3785","article-title":"Sharp emergence of feature-selective sustained activity along the dorsal visual pathway","volume":"17","author":"Mendoza-Halliday","year":"2014","journal-title":"Nature Neuroscience"},{"key":"2021050319313587500_bib25","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.conb.2013.01.020","article-title":"Network interactions: Non-geniculate input to V1","volume":"23","author":"Muckli","year":"2013","journal-title":"Current Opinion in Neurobiology"},{"key":"2021050319313587500_bib26","doi-asserted-by":"crossref","first-page":"3366","DOI":"10.1038\/s41467-019-11298-3","article-title":"Error-correcting dynamics in visual working memory","volume":"10","author":"Panichello","year":"2019","journal-title":"Nature Communications"},{"key":"2021050319313587500_bib27","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1038\/s41583-019-0202-9","article-title":"The human imagination: The cognitive neuroscience of visual mental imagery","volume":"20","author":"Pearson","year":"2019","journal-title":"Nature Reviews Neuroscience"},{"key":"2021050319313587500_bib28","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1163\/156856897X00366","article-title":"The VideoToolbox software for visual psychophysics: Transforming numbers into movies","volume":"10","author":"Pelli","year":"1997","journal-title":"Spatial Vision"},{"key":"2021050319313587500_bib29","doi-asserted-by":"crossref","first-page":"1336","DOI":"10.1038\/s41593-019-0428-x","article-title":"Coexisting representations of sensory and mnemonic information in human visual cortex","volume":"22","author":"Rademaker","year":"2019","journal-title":"Nature Neuroscience"},{"key":"2021050319313587500_bib30","doi-asserted-by":"crossref","first-page":"12990","DOI":"10.1523\/JNEUROSCI.1892-12.2012","article-title":"The relationship between working memory storage and elevated activity as measured with functional magnetic resonance imaging","volume":"32","author":"Riggall","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"2021050319313587500_bib31","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1146\/annurev-vision-111815-114443","article-title":"Early visual cortex as a multiscale cognitive blackboard","volume":"2","author":"Roelfsema","year":"2016","journal-title":"Annual Review of Vision Science"},{"key":"2021050319313587500_bib32","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1162\/jocn_a_00955","article-title":"Decoding and reconstructing the focus of spatial attention from the topography of alpha-band oscillations","volume":"28","author":"Samaha","year":"2016","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021050319313587500_bib33","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1167\/19.4.25","article-title":"Confidence boosts serial dependence in orientation estimation","volume":"19","author":"Samaha","year":"2019","journal-title":"Journal of Vision"},{"key":"2021050319313587500_bib34","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.visres.2016.09.010","article-title":"Neural mechanisms of information storage in visual short-term memory","volume":"128","author":"Serences","year":"2016","journal-title":"Vision Research"},{"key":"2021050319313587500_bib35","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1111\/j.1467-9280.2009.02276.x","article-title":"Stimulus-specific delay activity in human primary visual cortex","volume":"20","author":"Serences","year":"2009","journal-title":"Psychological Science"},{"key":"2021050319313587500_bib36","doi-asserted-by":"crossref","first-page":"ENEURO.0098-18.2018","DOI":"10.1523\/ENEURO.0098-18.2018","article-title":"Inverted encoding models assay population-level stimulus representations, not single-unit neural tuning","volume":"5","author":"Sprague","year":"2018","journal-title":"eNeuro"},{"key":"2021050319313587500_bib37","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1038\/s41593-018-0335-6","article-title":"Concurrent visual and motor selection during visual working memory guided action","volume":"22","author":"van Ede","year":"2019","journal-title":"Nature Neuroscience"},{"key":"2021050319313587500_bib38","doi-asserted-by":"crossref","first-page":"13804","DOI":"10.1038\/ncomms13804","article-title":"Layer-specificity in the effects of attention and working memory on activity in primary visual cortex","volume":"8","author":"van Kerkoerle","year":"2017","journal-title":"Nature Communications"},{"key":"2021050319313587500_bib39","doi-asserted-by":"crossref","first-page":"3911","DOI":"10.1093\/cercor\/bhu277","article-title":"Probabilistic maps of visual topography in human cortex","volume":"25","author":"Wang","year":"2015","journal-title":"Cerebral Cortex"},{"key":"2021050319313587500_bib40","doi-asserted-by":"crossref","first-page":"113","DOI":"10.3758\/BF03202828","article-title":"QUEST: A Bayesian adaptive psychometric method","volume":"33","author":"Watson","year":"1983","journal-title":"Perception & Psychophysics"},{"key":"2021050319313587500_bib41","doi-asserted-by":"crossref","first-page":"e3000854","DOI":"10.1371\/journal.pbio.3000854","article-title":"Delay-period activity in frontal, parietal, and occipital cortex tracks noise and biases in visual working memory","volume":"18","author":"Yu","year":"2020","journal-title":"PLoS Biology"},{"key":"2021050319313587500_bib42","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1016\/j.neuroimage.2017.05.055","article-title":"Occipital, parietal, and frontal cortices selectively maintain task-relevant features of multi-feature objects in visual working memory","volume":"157","author":"Yu","year":"2017","journal-title":"Neuroimage"},{"key":"2021050319313587500_bib43","doi-asserted-by":"crossref","first-page":"3182","DOI":"10.1093\/cercor\/bhy184","article-title":"Temporal-order-based attentional priority modulates mnemonic representations in parietal and frontal cortices","volume":"29","author":"Yu","year":"2019","journal-title":"Cerebral Cortex"},{"key":"2021050319313587500_bib44","doi-asserted-by":"crossref","first-page":"e3000769","DOI":"10.1371\/journal.pbio.3000769","article-title":"Different states of priority recruit different neural representations in visual working memory","volume":"18","author":"Yu","year":"2020","journal-title":"PLoS Biology"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/33\/6\/1142\/1913694\/jocn_a_01702.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/33\/6\/1142\/1913694\/jocn_a_01702.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,25]],"date-time":"2024-08-25T07:44:37Z","timestamp":1724571877000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/33\/6\/1142\/97393\/The-Neural-Codes-Underlying-Internally-Generated"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,1]]},"references-count":44,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,5,1]]},"published-print":{"date-parts":[[2021,5,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01702","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,6]]},"published":{"date-parts":[[2021,5,1]]}}}