{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"bioRxiv"}],"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T18:22:52Z","timestamp":1785435772738,"version":"3.56.0"},"posted":{"date-parts":[[2025,9,7]]},"group-title":"Neuroscience","reference-count":85,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2025,9,7]],"date-time":"2025-09-07T00:00:00Z","timestamp":1757203200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.biorxiv.org\/about\/FAQ#license"}],"funder":[{"DOI":"10.13039\/100015326","name":"NIH Common Fund","doi-asserted-by":"crossref","award":["K99EY036650"],"award-info":[{"award-number":["K99EY036650"]}],"id":[{"id":"10.13039\/100015326","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100015326","name":"NIH Common Fund","doi-asserted-by":"crossref","award":["R01MH129426"],"award-info":[{"award-number":["R01MH129426"]}],"id":[{"id":"10.13039\/100015326","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100015326","name":"NIH Common Fund","doi-asserted-by":"crossref","award":["R61DC021925"],"award-info":[{"award-number":["R61DC021925"]}],"id":[{"id":"10.13039\/100015326","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100015326","name":"NIH Common Fund","doi-asserted-by":"crossref","award":["R01MH120194"],"award-info":[{"award-number":["R01MH120194"]}],"id":[{"id":"10.13039\/100015326","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100015326","name":"NIH Common Fund","doi-asserted-by":"crossref","award":["R01EB026439"],"award-info":[{"award-number":["R01EB026439"]}],"id":[{"id":"10.13039\/100015326","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100015326","name":"NIH Common Fund","doi-asserted-by":"crossref","award":["U24NS109103"],"award-info":[{"award-number":["U24NS109103"]}],"id":[{"id":"10.13039\/100015326","id-type":"DOI","asserted-by":"crossref"}]},{"award":["U01NS108916"],"award-info":[{"award-number":["U01NS108916"]}],"id":[{"id":"https:\/\/ror.org\/001d55x84","id-type":"ROR","asserted-by":"publisher"}]},{"award":["U01NS128612"],"award-info":[{"award-number":["U01NS128612"]}],"id":[{"id":"https:\/\/ror.org\/001d55x84","id-type":"ROR","asserted-by":"publisher"}]},{"award":["R21NS128307"],"award-info":[{"award-number":["R21NS128307"]}],"id":[{"id":"https:\/\/ror.org\/001d55x84","id-type":"ROR","asserted-by":"publisher"}]},{"award":["P41EB018783"],"award-info":[{"award-number":["P41EB018783"]}],"id":[{"id":"https:\/\/ror.org\/001d55x84","id-type":"ROR","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000181","name":"AFOSR","doi-asserted-by":"crossref","award":["FA9550-21-1-0088"],"award-info":[{"award-number":["FA9550-21-1-0088"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSF","award":["BCS-1945230"],"award-info":[{"award-number":["BCS-1945230"]}]},{"DOI":"10.13039\/100009607","name":"McDonnell Center for Systems Neuroscience","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009607","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2025,9,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:p>Object recognition requires integrated processing that extends beyond the visual cortex, incorporating semantic and memory-related processes. However, it remains unclear how different attributes, such as visual, semantic, and memorability features, are encoded and interact during perception. Here, we recorded intracranial electroencephalography from 5143 channels while participants viewed natural object images. We systematically characterized the spatiotemporal patterns of neural encoding for visual, semantic, and memorability attributes and showed that memorability was encoded in a distributed manner, which can be dissociated from visual and semantic coding. While the ventral temporal cortex (VTC) was engaged in encoding all three attributes, the representations were dissociable. Interestingly, memorability representations in the prefrontal cortex appeared to arise from integrated visual and semantic signals from the VTC; and memorability influenced early stages of visual and semantic processing. Our results were corroborated by high-resolution 7T fMRI, which revealed continuous encoding across the brain, and further validated using a separate dataset featuring within-category object variability. Lastly, single-neuron recordings confirmed semantic and memorability coding in the medial temporal lobe. Together, these findings provide a comprehensive view of how visual, semantic, and memorability attributes are dynamically encoded across the brain, highlighting the complex interplay between these attributes that collectively shape object recognition and memory formation.<\/jats:p>","DOI":"10.1101\/2025.09.06.674646","type":"posted-content","created":{"date-parts":[[2025,9,7]],"date-time":"2025-09-07T08:45:22Z","timestamp":1757234722000},"source":"Crossref","is-referenced-by-count":1,"title":["Neural computations of visual, semantic, and memorability features in the human brain"],"prefix":"10.64898","author":[{"given":"Yue","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2588-2754","authenticated-orcid":false,"given":"Peter","family":"Brunner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jon T","family":"Willie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Runnan","family":"Cao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuo","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2025091002200583000_2025.09.06.674646v1.1","doi-asserted-by":"publisher","DOI":"10.1080\/14640747308400340"},{"key":"2025091002200583000_2025.09.06.674646v1.2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.94.2.115"},{"key":"2025091002200583000_2025.09.06.674646v1.3","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0803390105"},{"key":"2025091002200583000_2025.09.06.674646v1.4","doi-asserted-by":"publisher","DOI":"10.1037\/a0033872"},{"key":"2025091002200583000_2025.09.06.674646v1.5","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2015.03.005"},{"key":"2025091002200583000_2025.09.06.674646v1.6","first-page":"145","article-title":"What makes an image memorable?","volume":"2011","year":"2011","journal-title":"Cvpr"},{"key":"2025091002200583000_2025.09.06.674646v1.7","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2020.107408"},{"key":"2025091002200583000_2025.09.06.674646v1.8","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2020.04.001"},{"key":"2025091002200583000_2025.09.06.674646v1.9","doi-asserted-by":"publisher","DOI":"10.1007\/s00018-011-0641-6"},{"key":"2025091002200583000_2025.09.06.674646v1.10","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2017.01.063"},{"key":"2025091002200583000_2025.09.06.674646v1.11","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.47596"},{"key":"2025091002200583000_2025.09.06.674646v1.12","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-42429-x"},{"key":"2025091002200583000_2025.09.06.674646v1.13","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-020-0901-2"},{"key":"2025091002200583000_2025.09.06.674646v1.14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3002564"},{"key":"2025091002200583000_2025.09.06.674646v1.15","doi-asserted-by":"publisher","DOI":"10.1162\/imag_a_00281"},{"key":"2025091002200583000_2025.09.06.674646v1.16","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-26467-5"},{"key":"2025091002200583000_2025.09.06.674646v1.17","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-025-56793-y"},{"key":"2025091002200583000_2025.09.06.674646v1.18","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.115.1.39"},{"key":"2025091002200583000_2025.09.06.674646v1.19","doi-asserted-by":"publisher","DOI":"10.1038\/33396"},{"key":"2025091002200583000_2025.09.06.674646v1.20","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-017-1309-5"},{"key":"2025091002200583000_2025.09.06.674646v1.21","doi-asserted-by":"publisher","DOI":"10.1101\/lm.051649.120"},{"key":"2025091002200583000_2025.09.06.674646v1.22","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/nqmjt"},{"key":"2025091002200583000_2025.09.06.674646v1.23","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.add2981"},{"key":"2025091002200583000_2025.09.06.674646v1.24","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.a.60"},{"key":"2025091002200583000_2025.09.06.674646v1.25","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(00)01482-0"},{"key":"2025091002200583000_2025.09.06.674646v1.26","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-49173-5"},{"key":"2025091002200583000_2025.09.06.674646v1.27","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.05.015"},{"key":"2025091002200583000_2025.09.06.674646v1.28","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2024.105535"},{"key":"2025091002200583000_2025.09.06.674646v1.29","doi-asserted-by":"crossref","unstructured":"Deng J , Dong W , Socher R , Li L-J , Li K , Fei-Fei L , editors. Imagenet: A large-scale hierarchical image database. 2009 IEEE conference on computer vision and pattern recognition; 2009: Ieee.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"2025091002200583000_2025.09.06.674646v1.30","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2848-08.2008"},{"key":"2025091002200583000_2025.09.06.674646v1.31","doi-asserted-by":"publisher","DOI":"10.1016\/j.pneurobio.2012.06.008"},{"key":"2025091002200583000_2025.09.06.674646v1.32","doi-asserted-by":"publisher","DOI":"10.1038\/77664"},{"key":"2025091002200583000_2025.09.06.674646v1.33","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3747"},{"key":"2025091002200583000_2025.09.06.674646v1.34","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-vision-102016-061214"},{"key":"2025091002200583000_2025.09.06.674646v1.35","unstructured":"Sun KHXZSRJ . Deep Residual Learning for Image Recognition. CVPR. 2016."},{"key":"2025091002200583000_2025.09.06.674646v1.36","unstructured":"Muennighoff N. SGPT : GPT Sentence Embeddings for Semantic Search. CoRR. 2022;abs\/2202.08904."},{"key":"2025091002200583000_2025.09.06.674646v1.37","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1007\/s42113-022-00126-5","article-title":"Embracing New Techniques in Deep Learning for Estimating Image Memorability","volume":"5","year":"2022","journal-title":"Computional Brain & Behavior"},{"key":"2025091002200583000_2025.09.06.674646v1.38","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-024-01816-9"},{"key":"2025091002200583000_2025.09.06.674646v1.39","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.32259"},{"key":"2025091002200583000_2025.09.06.674646v1.40","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-021-00921-6"},{"key":"2025091002200583000_2025.09.06.674646v1.41","doi-asserted-by":"publisher","DOI":"10.1126\/science.aav9436"},{"key":"2025091002200583000_2025.09.06.674646v1.42","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2350-5"},{"key":"2025091002200583000_2025.09.06.674646v1.43","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/37epc"},{"key":"2025091002200583000_2025.09.06.674646v1.44","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2025.02.063"},{"key":"2025091002200583000_2025.09.06.674646v1.45","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2014.06.017"},{"key":"2025091002200583000_2025.09.06.674646v1.46","doi-asserted-by":"crossref","unstructured":"Colin Conwell , Jacob Prince , George Alvarez , Konkle T . The Unreasonable Effectiveness of Word Models in Predicting High-Level Visual Cortex Responses to Natural Images. 2023.","DOI":"10.32470\/CCN.2023.1642-0"},{"key":"2025091002200583000_2025.09.06.674646v1.47","doi-asserted-by":"publisher","DOI":"10.1038\/7221"},{"key":"2025091002200583000_2025.09.06.674646v1.48","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-021-00962-x"},{"key":"2025091002200583000_2025.09.06.674646v1.49","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2135-23.2024"},{"key":"2025091002200583000_2025.09.06.674646v1.50","unstructured":"Doerig A , Kietzmann TC , Allen E , Wu Y , Naselaris T , Kay K , et al. Semantic scene descriptions as an objective of human vision. arXiv preprint. 2022. doi: arXiv:2209.11737."},{"key":"2025091002200583000_2025.09.06.674646v1.51","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-023-00753-y"},{"key":"2025091002200583000_2025.09.06.674646v1.52","unstructured":"Tsung-Yi Lin MM , Serge Belongie , Lubomir Bourdev , Ross Girshick , James Hays PP , Deva Ramanan , C. Lawrence Zitnick , Piotr Dollar. Microsoft COCO: Common Objects in Context. 2015."},{"key":"2025091002200583000_2025.09.06.674646v1.53","doi-asserted-by":"publisher","DOI":"10.3390\/brainsci11040443"},{"key":"2025091002200583000_2025.09.06.674646v1.54","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1648-20.2020"},{"key":"2025091002200583000_2025.09.06.674646v1.55","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3251"},{"key":"2025091002200583000_2025.09.06.674646v1.56","doi-asserted-by":"crossref","unstructured":"Megla E , Bainbridge WA . Interaction of Perception and Memory.pdf. In: Sherman SM, editor. Oxford Research Encyclopedia of Neuroscience: Oxford University Press; 2024.","DOI":"10.1093\/acrefore\/9780190264086.013.392"},{"key":"2025091002200583000_2025.09.06.674646v1.57","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-psych-032720-041031"},{"key":"2025091002200583000_2025.09.06.674646v1.58","unstructured":"Radford A , Kim JW , Hallacy C , Ramesh A , Goh G , Agarwal S , et al. Learning Transferable Visual Models From Natural Language Supervision. In: Marina M, Tong Z, editors. Proceedings of the 38th International Conference on Machine Learning; Proceedings of Machine Learning Research: PMLR; 2021. p. 8748--63."},{"key":"2025091002200583000_2025.09.06.674646v1.59","unstructured":"Colin Conwell , Emalie McMahon , Akshay Vivek Jagadeesh , Kasper Vinken , Saloni Sharma , Jacob S. Prince , et al. Monkey See, Model Knew. NeurIPS 2024 Workshop UniReps. 2024."},{"key":"2025091002200583000_2025.09.06.674646v1.60","unstructured":"Adrien Doerig , Tim C. Kietzmann , Emily Allen , Wu Y , Naselaris T , Kay K , et al. Visual representations in the human brain are aligned with large language models."},{"key":"2025091002200583000_2025.09.06.674646v1.61","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-53147-y"},{"key":"2025091002200583000_2025.09.06.674646v1.62","first-page":"1","volume-title":"Psychology of Learning and Motivation","volume":"70","year":"2019"},{"key":"2025091002200583000_2025.09.06.674646v1.63","doi-asserted-by":"crossref","unstructured":"Bylinskii Z , Goetschalckx L , Newman A , Oliva A . Memorability: An Image-Computable Measure of Information Utility. In: Ionescu B, Bainbridge WA, Murray N, editors. Human Perception of Visual Information: Psychological and Computational Perspectives. Cham: Springer International Publishing; 2022. p. 207-39.","DOI":"10.1007\/978-3-030-81465-6_8"},{"key":"2025091002200583000_2025.09.06.674646v1.64","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainresbull.2006.08.003"},{"key":"2025091002200583000_2025.09.06.674646v1.65","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-12559-1"},{"key":"2025091002200583000_2025.09.06.674646v1.66","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2020.104341"},{"key":"2025091002200583000_2025.09.06.674646v1.67","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhae285"},{"key":"2025091002200583000_2025.09.06.674646v1.68","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2010.00020"},{"key":"2025091002200583000_2025.09.06.674646v1.69","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2017.12.005"},{"key":"2025091002200583000_2025.09.06.674646v1.70","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-024-01863-2"},{"key":"2025091002200583000_2025.09.06.674646v1.71","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2025.02.063"},{"key":"2025091002200583000_2025.09.06.674646v1.72","doi-asserted-by":"crossref","unstructured":"Ying Tai , Jian Yang , Xiaoming Liu , Xu C. MemNet : A Persistent Memory Network for Image Restoration. ICCV2017.","DOI":"10.1109\/ICCV.2017.486"},{"key":"2025091002200583000_2025.09.06.674646v1.73","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2003.10.009"},{"key":"2025091002200583000_2025.09.06.674646v1.74","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-024-07309-z"},{"key":"2025091002200583000_2025.09.06.674646v1.75","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2005.12.033"},{"key":"2025091002200583000_2025.09.06.674646v1.76","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)00569-X"},{"key":"2025091002200583000_2025.09.06.674646v1.77","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-12623-6"},{"key":"2025091002200583000_2025.09.06.674646v1.78","doi-asserted-by":"crossref","unstructured":"He K , Zhang X , Ren S , Sun J , editors. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition; 2016.","DOI":"10.1109\/CVPR.2016.90"},{"key":"2025091002200583000_2025.09.06.674646v1.79","doi-asserted-by":"publisher","DOI":"10.1145\/3065386"},{"key":"2025091002200583000_2025.09.06.674646v1.80","doi-asserted-by":"publisher","DOI":"10.1038\/s42003-022-03557-9"},{"key":"2025091002200583000_2025.09.06.674646v1.81","doi-asserted-by":"crossref","unstructured":"Cao R , Wang J , Lin C , De Falco E , Peter A , Rey HG , et al. Feature-based encoding of face identity by single neurons in the human amygdala and hippocampus. Nature Human Behaviour. 2025.","DOI":"10.1038\/s41562-025-02218-1"},{"key":"2025091002200583000_2025.09.06.674646v1.82","unstructured":"Junnan Li , Ramprasaath R. Selvaraju , Akhilesh Deepak Gotmare , Shafiq Joty , Caiming Xiong , Hoi S. Align before Fuse: Vision and Language Representation Learning with Momentum Distillation. NeurIPS 2021."},{"key":"2025091002200583000_2025.09.06.674646v1.83","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.06.004.2008"},{"key":"2025091002200583000_2025.09.06.674646v1.84","doi-asserted-by":"publisher","DOI":"10.1038\/ng2088"},{"key":"2025091002200583000_2025.09.06.674646v1.85","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2017.05.011"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1101\/2025.09.06.674646","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T09:30:42Z","timestamp":1768469442000},"score":1,"resource":{"primary":{"URL":"http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2025.09.06.674646"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,7]]},"references-count":85,"URL":"https:\/\/doi.org\/10.1101\/2025.09.06.674646","relation":{},"subject":[],"published":{"date-parts":[[2025,9,7]]},"subtype":"preprint"}}