{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T19:39:06Z","timestamp":1776281946798,"version":"3.50.1"},"reference-count":19,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["TACL"],"published-print":{"date-parts":[[2017,12]]},"abstract":"<jats:p> Important advances have recently been made using computational semantic models to decode brain activity patterns associated with concepts; however, this work has almost exclusively focused on concrete nouns. How well these models extend to decoding abstract nouns is largely unknown. We address this question by applying state-of-the-art computational models to decode functional Magnetic Resonance Imaging (fMRI) activity patterns, elicited by participants reading and imagining a diverse set of both concrete and abstract nouns. One of the models we use is linguistic, exploiting the recent word2vec skipgram approach trained on Wikipedia. The second is visually grounded, using deep convolutional neural networks trained on Google Images. Dual coding theory considers concrete concepts to be encoded in the brain both linguistically and visually, and abstract concepts only linguistically. Splitting the fMRI data according to human concreteness ratings, we indeed observe that both models significantly decode the most concrete nouns; however, accuracy is significantly greater using the text-based models for the most abstract nouns. More generally this confirms that current computational models are sufficiently advanced to assist in investigating the representational structure of abstract concepts in the brain. <\/jats:p>","DOI":"10.1162\/tacl_a_00043","type":"journal-article","created":{"date-parts":[[2018,12,28]],"date-time":"2018-12-28T15:42:50Z","timestamp":1546011770000},"page":"17-30","source":"Crossref","is-referenced-by-count":41,"title":["Visually Grounded and Textual Semantic Models Differentially Decode                     Brain Activity Associated with Concrete and Abstract Nouns"],"prefix":"10.1162","volume":"5","author":[{"given":"Andrew J.","family":"Anderson","sequence":"first","affiliation":[{"name":"Brain & Cognitive Sciences, University of Rochester,"}]},{"given":"Douwe","family":"Kiela","sequence":"additional","affiliation":[{"name":"Computer Laboratory, University of Cambridge,"}]},{"given":"Stephen","family":"Clark","sequence":"additional","affiliation":[{"name":"Computer Laboratory, University of Cambridge,"}]},{"given":"Massimo","family":"Poesio","sequence":"additional","affiliation":[{"name":"School of Computer Science and Electronic Engineering, University of Essex,"}]}],"member":"281","reference":[{"key":"p_2","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_00508"},{"key":"p_3","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.neuroimage.2015.06.093","volume":"120","author":"Anderson A. J.","year":"2015","journal-title":"NeuroImage"},{"key":"p_4","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.neuroimage.2015.12.035","volume":"128","author":"Anderson A. J.","year":"2016","journal-title":"NeuroImage"},{"issue":"3","key":"p_5","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1037\/a0016261","volume":"116","author":"Andrews M.","year":"2009","journal-title":"Psychological Review"},{"key":"p_6","doi-asserted-by":"crossref","first-page":"424","DOI":"10.3758\/BF03195471","volume":"34","author":"Barca L.","year":"2002","journal-title":"Behavior Research Methods, Instruments, & Computers"},{"issue":"1","key":"p_7","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Benjamini Y.","year":"1995","journal-title":"Journal of the Royal Statistical Society, Series B (Methodological)"},{"issue":"47","key":"p_10","doi-asserted-by":"crossref","first-page":"18597","DOI":"10.1523\/JNEUROSCI.1548-13.2013","volume":"33","author":"Bruffaerts R.","year":"2013","journal-title":"J. Neuroscience"},{"key":"p_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1613\/jair.4135","volume":"49","author":"Bruni E.","year":"2014","journal-title":"Journal of Artifical Intelligence Research"},{"key":"p_13","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_00458"},{"key":"p_14","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1016\/j.neuroimage.2010.04.271","volume":"56","author":"Chang K. M.","year":"2010","journal-title":"NeuroImage: Special Issue on Multivariate Decoding and Brain Reading"},{"key":"p_25","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1038\/nn.2303","volume":"12","author":"Kriegeskorte N.","year":"2009","journal-title":"Nature Neuroscience"},{"key":"p_26","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1146\/annurev-vision-082114-035447","volume":"1","author":"Kriegeskorte N.","year":"2015","journal-title":"Annual Review of Vision Science"},{"key":"p_28","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1126\/science.1152876","volume":"320","author":"Mitchell T. M.","year":"2008","journal-title":"Science"},{"key":"p_31","first-page":"1410","volume":"22","author":"Palatucci M.","year":"2009","journal-title":"Neural Information Processing Systems"},{"key":"p_32","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/j.artint.2012.06.005","volume":"194","author":"Pereira F.","year":"2013","journal-title":"Artif. Intell."},{"issue":"1","key":"p_36","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1037\/0021-9010.72.1.146","volume":"72","author":"Silver N. C.","year":"1987","journal-title":"J. Applied Psychology"},{"key":"p_38","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/j.neuroimage.2012.04.048","volume":"62","author":"Sudre G.","year":"2012","journal-title":"NeuroImage"},{"key":"p_39","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1207\/s15516709cog0000_33","volume":"29","author":"Wiemer-Hastings K.","year":"2005","journal-title":"Cognitive Science"},{"key":"p_40","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_01000"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00043","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:38:05Z","timestamp":1615585085000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43388"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12]]},"references-count":19,"alternative-id":["10.1162\/tacl_a_00043"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00043","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12]]}}}