{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T06:15:03Z","timestamp":1772172903507,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009138","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000}}],"reference-count":55,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2021,6,23]],"date-time":"2021-06-23T00:00:00Z","timestamp":1624406400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["18K18141"],"award-info":[{"award-number":["18K18141"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["15H05311"],"award-info":[{"award-number":["15H05311"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009023","name":"Precursory Research for Embryonic Science and Technology","doi-asserted-by":"crossref","award":["JPMJPR20C6"],"award-info":[{"award-number":["JPMJPR20C6"]}],"id":[{"id":"10.13039\/501100009023","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100009024","name":"Exploratory Research for Advanced Technology","doi-asserted-by":"publisher","award":["JPMJER1801"],"award-info":[{"award-number":["JPMJER1801"]}],"id":[{"id":"10.13039\/501100009024","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>The quantitative modeling of semantic representations in the brain plays a key role in understanding the neural basis of semantic processing. Previous studies have demonstrated that word vectors, which were originally developed for use in the field of natural language processing, provide a powerful tool for such quantitative modeling. However, whether semantic representations in the brain revealed by the word vector-based models actually capture our perception of semantic information remains unclear, as there has been no study explicitly examining the behavioral correlates of the modeled brain semantic representations. To address this issue, we compared the semantic structure of nouns and adjectives in the brain estimated from word vector-based brain models with that evaluated from human behavior. The brain models were constructed using voxelwise modeling to predict the functional magnetic resonance imaging (fMRI) response to natural movies from semantic contents in each movie scene through a word vector space. The semantic dissimilarity of brain word representations was then evaluated using the brain models. Meanwhile, data on human behavior reflecting the perception of semantic dissimilarity between words were collected in psychological experiments. We found a significant correlation between brain model- and behavior-derived semantic dissimilarities of words. This finding suggests that semantic representations in the brain modeled via word vectors appropriately capture our perception of word meanings.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009138","type":"journal-article","created":{"date-parts":[[2021,6,23]],"date-time":"2021-06-23T16:06:16Z","timestamp":1624464376000},"page":"e1009138","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":22,"title":["Behavioral correlates of cortical semantic representations modeled by word vectors"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0555-518X","authenticated-orcid":true,"given":"Satoshi","family":"Nishida","sequence":"first","affiliation":[]},{"given":"Antoine","family":"Blanc","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9491-4433","authenticated-orcid":true,"given":"Naoya","family":"Maeda","sequence":"additional","affiliation":[]},{"given":"Masataka","family":"Kado","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8015-340X","authenticated-orcid":true,"given":"Shinji","family":"Nishimoto","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2021,6,23]]},"reference":[{"key":"pcbi.1009138.ref001","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9","article-title":"Indexing by latent semantic analysis","volume":"41","author":"S Deerwester","year":"1990","journal-title":"J Am Soc Inf Sci"},{"key":"pcbi.1009138.ref002","first-page":"3111","article-title":"Distributed representations of words and phrases and their compositionality","volume":"26","author":"T Mikolov","year":"2013","journal-title":"Adv Neural Inf Process Syst"},{"key":"pcbi.1009138.ref003","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. Proceedings of the Empiricial Methods in Natural Language Processing (EMNLP 2014). 2014. pp. 1532\u20131543.","DOI":"10.3115\/v1\/D14-1162"},{"key":"pcbi.1009138.ref004","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1162\/tacl_a_00051","article-title":"Enriching word vectors with subword information","volume":"5","author":"P Bojanowski","year":"2017","journal-title":"Trans Assoc Comput Linguist"},{"key":"pcbi.1009138.ref005","doi-asserted-by":"crossref","first-page":"203","DOI":"10.3758\/BF03204766","article-title":"Producing high-dimensional semantic spaces from lexical co-occurrence","volume":"28","author":"K Lund","year":"1996","journal-title":"Behav Res methods, instruments, Comput"},{"key":"pcbi.1009138.ref006","first-page":"746","article-title":"Linguistic regularities in continuous space word representations","author":"T Mikolov","year":"2013","journal-title":"HLT-NAACL"},{"key":"pcbi.1009138.ref007","first-page":"1555","article-title":"Learning sentiment-specific word embedding","author":"D Tang","year":"2014","journal-title":"ACL"},{"key":"pcbi.1009138.ref008","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1007\/s12559-017-9492-2","article-title":"Learning word representations for sentiment analysis","volume":"9","author":"Y Li","year":"2017","journal-title":"Cognit Comput"},{"key":"pcbi.1009138.ref009","article-title":"FAQ-based question answering via word alignment","author":"Z Wang","year":"2015","journal-title":"arXiv"},{"key":"pcbi.1009138.ref010","article-title":"Semantic vector space models predict neural responses to complex visual stimuli","author":"U G\u00fc\u00e7l\u00fc","year":"2015","journal-title":"arXiv"},{"key":"pcbi.1009138.ref011","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.neuroimage.2017.08.017","article-title":"Decoding naturalistic experiences from human brain activity via distributed representations of words","volume":"180","author":"S Nishida","year":"2018","journal-title":"Neuroimage"},{"key":"pcbi.1009138.ref012","article-title":"Reduced intra- and inter-individual diversity of semantic representations in the brains of schizophrenia patients","author":"S Nishida","year":"2020","journal-title":"bioRxiv"},{"key":"pcbi.1009138.ref013","doi-asserted-by":"crossref","unstructured":"Ruan Y-P, Ling Z-H, Hu Y. Exploring semantic representation in brain activity using word embeddings. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 2016. pp. 669\u2013679.","DOI":"10.18653\/v1\/D16-1064"},{"key":"pcbi.1009138.ref014","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0112575","article-title":"Simultaneously uncovering the patterns of brain regions involved in different story reading Subprocesses","volume":"9","author":"L Wehbe","year":"2014","journal-title":"PLoS One"},{"key":"pcbi.1009138.ref015","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/j.neuroimage.2017.06.042","article-title":"Mapping between fMRI responses to movies and their natural language annotations","volume":"180","author":"K Vodrahalli","year":"2018","journal-title":"Neuroimage"},{"key":"pcbi.1009138.ref016","first-page":"333.13","article-title":"Word statistics in large-scale texts explain the human cortical semantic representation of objects, actions, and impressions","volume":"45","author":"S Nishida","year":"2015","journal-title":"Soc Neurosci Abstr"},{"key":"pcbi.1009138.ref017","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1038\/s41467-018-03068-4","article-title":"Toward a universal decoder of linguistic meaning from brain activation","volume":"9","author":"F Pereira","year":"2018","journal-title":"Nat Commun"},{"key":"pcbi.1009138.ref018","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.ins.2019.08.043","article-title":"Fine-grained neural decoding with distributed word representations","volume":"507","author":"S Wang","year":"2020","journal-title":"Inf Sci (Ny)"},{"key":"pcbi.1009138.ref019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpsyg.2012.00245","article-title":"Inverse MDS: Inferring dissimilarity structure from multiple item arrangements","volume":"3","author":"N Kriegeskorte","year":"2012","journal-title":"Front Psychol"},{"key":"pcbi.1009138.ref020","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.neuroimage.2014.10.018","article-title":"A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes","volume":"105","author":"T Naselaris","year":"2015","journal-title":"Neuroimage"},{"key":"pcbi.1009138.ref021","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1038\/nature17637","article-title":"Gallant, Jack L. Natural speech reveals the semantic maps that tile human cerebral cortex","volume":"532","author":"AG Huth","year":"2016","journal-title":"Nature"},{"key":"pcbi.1009138.ref022","doi-asserted-by":"crossref","first-page":"5281","DOI":"10.1609\/aaai.v34i04.5974","article-title":"Brain-mediated transfer learning of convolutional neural networks","author":"S Nishida","year":"2020","journal-title":"Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence"},{"key":"pcbi.1009138.ref023","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1016\/j.neuron.2012.10.014","article-title":"A continuous semantic space describes the representation of thousands of object and action categories across the human brain","volume":"76","author":"AG Huth","year":"2012","journal-title":"Neuron"},{"key":"pcbi.1009138.ref024","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1006\/nimg.1998.0395","article-title":"Cortical surface-based analysis. I. Segmentation and surface reconstruction","volume":"9","author":"AM Dale","year":"1999","journal-title":"Neuroimage"},{"key":"pcbi.1009138.ref025","first-page":"195","article-title":"Cortical surface-based analysis. II: Inflation, flattening, and a surface-based coordinate system","volume":"9","author":"B Fischl","year":"1999","journal-title":"Neuroimage"},{"key":"pcbi.1009138.ref026","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neuroimage.2010.06.010","article-title":"Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature","volume":"53","author":"C Destrieux","year":"2010","journal-title":"Neuroimage"},{"key":"pcbi.1009138.ref027","doi-asserted-by":"crossref","first-page":"2608","DOI":"10.1523\/JNEUROSCI.5547-11.2012","article-title":"The representation of biological classes in the human brain","volume":"32","author":"AC Connolly","year":"2012","journal-title":"J Neurosci"},{"key":"pcbi.1009138.ref028","doi-asserted-by":"crossref","first-page":"1126","DOI":"10.1016\/j.neuron.2008.10.043","article-title":"Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey","volume":"60","author":"N Kriegeskorte","year":"2008","journal-title":"Neuron"},{"key":"pcbi.1009138.ref029","doi-asserted-by":"crossref","first-page":"10235","DOI":"10.1523\/JNEUROSCI.0983-13.2013","article-title":"Tripartite organization of the ventral stream by animacy and object size","volume":"33","author":"T Konkle","year":"2013","journal-title":"J Neurosci"},{"key":"pcbi.1009138.ref030","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1162\/COLI_a_00237","article-title":"SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation.","volume":"41","author":"F Hill","year":"2015","journal-title":"Comput Linguist."},{"key":"pcbi.1009138.ref031","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/02643294.2016.1176907","article-title":"A comparative evaluation of off-the-shelf distributed semantic representations for modelling behavioural data","volume":"33","author":"F Pereira","year":"2016","journal-title":"Cogn Neuropsychol"},{"key":"pcbi.1009138.ref032","article-title":"Context Matters: Recovering Human Semantic Structure from Machine Learning Analysis of Large-Scale Text Corpora","author":"MC Iordan","year":"2020","journal-title":"arXiv"},{"key":"pcbi.1009138.ref033","doi-asserted-by":"crossref","first-page":"1173","DOI":"10.1038\/s41562-020-00951-3","article-title":"Revealing the multidimensional mental representations of natural objects underlying human similarity judgements","volume":"4","author":"MN Hebart","year":"2020","journal-title":"Nat Hum Behav."},{"key":"pcbi.1009138.ref034","doi-asserted-by":"crossref","first-page":"7722","DOI":"10.1523\/JNEUROSCI.0675-19.2019","article-title":"The representation of semantic information across human cerebral cortex during listening versus reading is invariant to stimulus modality","volume":"39","author":"F Deniz","year":"2019","journal-title":"J Neurosci"},{"key":"pcbi.1009138.ref035","article-title":"The language network is recruited but not required for non-verbal semantic processing","author":"AA Ivanova","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1009138.ref036","doi-asserted-by":"crossref","DOI":"10.3389\/fpsyg.2013.00625","article-title":"Consciousness in humans and non-human animals: recent advances and future directions","volume":"4","author":"M Boly","year":"2013","journal-title":"Front Psychol"},{"key":"pcbi.1009138.ref037","doi-asserted-by":"crossref","first-page":"2497","DOI":"10.1093\/cercor\/bhv072","article-title":"The behavioral relevance of task information in human prefrontal cortex","volume":"26","author":"MW Cole","year":"2016","journal-title":"Cereb Cortex"},{"key":"pcbi.1009138.ref038","doi-asserted-by":"crossref","first-page":"1211","DOI":"10.1523\/JNEUROSCI.3887-05.2006","article-title":"Prefrontal set activity predicts rule-specific neural processing during subsequent cognitive performance","volume":"26","author":"K Sakai","year":"2006","journal-title":"J Neurosci"},{"key":"pcbi.1009138.ref039","first-page":"2227","volume-title":"Deep contextualized word representations. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers).","author":"M Peters","year":"2018"},{"key":"pcbi.1009138.ref040","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","author":"J Devlin","year":"2018","journal-title":"arXiv."},{"key":"pcbi.1009138.ref041","first-page":"5753","article-title":"XLNet: Generalized autoregressive pretraining for language understanding","author":"Z Yang","year":"2019","journal-title":"Advances in neural information processing systems"},{"key":"pcbi.1009138.ref042","first-page":"6629","volume-title":"Proceedings of the 32Nd International Conference on Neural Information Processing Systems","author":"S Jain","year":"2018"},{"key":"pcbi.1009138.ref043","doi-asserted-by":"crossref","first-page":"5137","DOI":"10.18653\/v1\/P19-1507","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics.","author":"S Jat","year":"2019"},{"key":"pcbi.1009138.ref044","article-title":"Artificial neural networks accurately predict language processing in the brain","author":"M Schrimpf","year":"2020","journal-title":"bioRxiv"},{"key":"pcbi.1009138.ref045","article-title":"Towards a rigorous science of interpretable machine learning","author":"F Doshi-Velez","year":"2017","journal-title":"arXiv"},{"key":"pcbi.1009138.ref046","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3236009","article-title":"A survey of methods for explaining black box models","volume":"51","author":"R Guidotti","year":"2019","journal-title":"ACM Comput Surv"},{"key":"pcbi.1009138.ref047","first-page":"1299","volume-title":"Two\/too simple adaptations of Word2Vec for syntax problems. Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"W Ling","year":"2015"},{"key":"pcbi.1009138.ref048","article-title":"Retrofitting word vectors to semantic lexicons","author":"M Faruqui","year":"2014","journal-title":"arXiv"},{"key":"pcbi.1009138.ref049","first-page":"1501","volume-title":"Proceedings of ACL","author":"Q Liu","year":"2015"},{"key":"pcbi.1009138.ref050","first-page":"489","article-title":"Interpretable semantic vectors from a joint model of brain- and text-based meaning","author":"A Fyshe","year":"2014","journal-title":"ACL"},{"key":"pcbi.1009138.ref051","doi-asserted-by":"crossref","unstructured":"Barrett M, Bingel J, Hollenstein N, Rei M, S\u00f8gaard A. Sequence classification with human attention. CoNLL 2018 - 22nd Conf Comput Nat Lang Learn Proc. 2018; 302\u2013312. doi: 10.18653\/v1\/k18-1030","DOI":"10.18653\/v1\/K18-1030"},{"key":"pcbi.1009138.ref052","doi-asserted-by":"crossref","first-page":"1144","DOI":"10.1002\/mrm.22361","article-title":"Multiband multislice GE-EPI at 7 tesla, with 16-fold acceleration using partial parallel imaging with application to high spatial and temporal whole-brain fMRI","volume":"63","author":"S Moeller","year":"2010","journal-title":"Magn Reson Med"},{"key":"pcbi.1009138.ref053","doi-asserted-by":"crossref","first-page":"1641","DOI":"10.1016\/j.cub.2011.08.031","article-title":"Reconstructing visual experiences from brain activity evoked by natural movies","volume":"21","author":"S Nishimoto","year":"2011","journal-title":"Curr Biol"},{"key":"pcbi.1009138.ref054","first-page":"1","article-title":"Human object-similarity judgments reflect and transcend the primate-IT object representation","volume":"4","author":"M Mur","year":"2013","journal-title":"Front Psychol"},{"key":"pcbi.1009138.ref055","doi-asserted-by":"crossref","first-page":"14545","DOI":"10.1073\/pnas.1402594111","article-title":"Unique semantic space in the brain of each beholder predicts perceived similarity","volume":"111","author":"I Charest","year":"2014","journal-title":"Proc Natl Acad Sci U S A"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009138","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009138","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T13:50:56Z","timestamp":1625579456000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009138"}},"subtitle":[],"editor":[{"given":"Ming Bo","family":"Cai","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,6,23]]},"references-count":55,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6,23]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009138","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.08.06.240705","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,23]]}}}