{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T20:52:12Z","timestamp":1792443132440,"version":"4.5.0"},"reference-count":91,"publisher":"National Academy of Sciences","issue":"46","license":[{"start":{"date-parts":[[2022,5,8]],"date-time":"2022-05-08T00:00:00Z","timestamp":1651968000000},"content-version":"vor","delay-in-days":181,"URL":"https:\/\/www.pnas.org\/site\/aboutpnas\/licenses.xhtml"}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2021,11,16]]},"abstract":"<jats:title>Significance<\/jats:title>\n                  <jats:p>Learning to read results in the formation of a specialized region in the human ventral visual cortex. This region, the visual word form area (VWFA), responds selectively to written words more than to other visual stimuli. However, how neural circuits at this site implement an invariant recognition of written words remains unknown. Here, we show how an artificial neural network initially designed for object recognition can be retrained to recognize words. Once literate, the network develops a sparse neuronal representation of words that replicates several known aspects of the cognitive neuroscience of reading and leads to precise predictions concerning how a small set of neurons implement the orthographic stage of reading acquisition using a compositional neural code.<\/jats:p>","DOI":"10.1073\/pnas.2104779118","type":"journal-article","created":{"date-parts":[[2021,11,8]],"date-time":"2021-11-08T16:26:37Z","timestamp":1636388797000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":53,"title":["Emergence of a compositional neural code for written words: Recycling of a convolutional neural network for reading"],"prefix":"10.1073","volume":"118","author":[{"given":"T.","family":"Hannagan","sequence":"first","affiliation":[{"name":"Cognitive Neuroimaging Unit, Commissariat \u00e0 l'\u00c9nergie Atomique et aux \u00c9nergies Alternatives,  INSERM, Universit\u00e9 Paris-Saclay, NeuroSpin,  Gif-Sur-Yvette 91191, France;"},{"name":"Coll\u00e8ge de France, Universit\u00e9 Paris Sciences Lettres 75005 Paris, France;"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8320-4516","authenticated-orcid":false,"given":"A.","family":"Agrawal","sequence":"additional","affiliation":[{"name":"Cognitive Neuroimaging Unit, Commissariat \u00e0 l'\u00c9nergie Atomique et aux \u00c9nergies Alternatives,  INSERM, Universit\u00e9 Paris-Saclay, NeuroSpin,  Gif-Sur-Yvette 91191, France;"},{"name":"Coll\u00e8ge de France, Universit\u00e9 Paris Sciences Lettres 75005 Paris, France;"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"L.","family":"Cohen","sequence":"additional","affiliation":[{"name":"Sorbonne Universit\u00e9, INSERM U1127, CNRS UMR 7225, Institut du Cerveau et de la Moelle \u00e9pini\u00e8r, H\u00f4pital de la Piti\u00e9-Salp\u00eatri\u00e8re, Paris 75013, France;"},{"name":"Assistance Publique-H\u00f4pitaux de Paris, H\u00f4pital de la Piti\u00e9 Salp\u00eatri\u00e8re, F\u00e9d\u00e9ration de Neurologie, Paris F-75013, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S.","family":"Dehaene","sequence":"additional","affiliation":[{"name":"Cognitive Neuroimaging Unit, Commissariat \u00e0 l'\u00c9nergie Atomique et aux \u00c9nergies Alternatives,  INSERM, Universit\u00e9 Paris-Saclay, NeuroSpin,  Gif-Sur-Yvette 91191, France;"},{"name":"Coll\u00e8ge de France, Universit\u00e9 Paris Sciences Lettres 75005 Paris, France;"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2021,11,8]]},"reference":[{"key":"e_1_3_4_1_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3924"},{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2012.12.005"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/123.2.291"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0703300104"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_00499"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1121304109"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/89551"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.0956-7976.2004.00674.x"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2007.10.044"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2003.10.021"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.2004103"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2011.04.001"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2011.04.003"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.01.001"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2007.10.004"},{"key":"e_1_3_4_16_2","volume-title":"Reading in the Brain","author":"Dehaene S.","year":"2009","unstructured":"S. Dehaene, Reading in the Brain (Penguin Viking, New York, NY, 2009)."},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1194140"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)00662-1"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(02)01870-3"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2009.01.003"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1719616115"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00429-018-1676-3"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4918-13.2014"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2015.05.006"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2011.01.004"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.35237"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4354"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-017-0186-2"},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1101\/408385"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2007.11.036"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2007.05.031"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2006.06.053"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-020-00982-w"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1006\/jmla.1996.0040"},{"key":"e_1_3_4_35_2","first-page":"97","volume-title":"Masked Priming: State of the Art","author":"Perea M.","year":"2003","unstructured":"M. Perea, S. J. Lupker, \u201cTransposed-letter confusability effects in masked form priming\u201d Masked Priming: State of the Art, S. Kinoshita, S. J. Lupker, Eds. (Psychology Press, New York, NY, 2003), pp. 97\u2013120."},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2016.07.009"},{"key":"e_1_3_4_37_2","first-page":"61","article-title":"Contribution \u00e0 l\u2019\u00e9tude anatomo-pathologique et clinique des diff\u00e9rentes vari\u00e9t\u00e9s de c\u00e9cit\u00e9 verbale","volume":"4","author":"Dejerine J.","year":"1892","unstructured":"J. Dejerine, Contribution \u00e0 l\u2019\u00e9tude anatomo-pathologique et clinique des diff\u00e9rentes vari\u00e9t\u00e9s de c\u00e9cit\u00e9 verbale. Mem. Soc. Biol. 4, 61\u201390 (1892).","journal-title":"Mem. Soc. Biol."},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2006.03.031"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1008215"},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2009.03.017"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2005.05.004"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.32.4.865"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1904184116"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1177\/0956797619881134"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.54846"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2015.12.008"},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17714-3"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.1002420"},{"key":"e_1_3_4_49_2","unstructured":"G. E. Hinton N. Srivastava A. Krizhevsky I. Sutskever R. R. Salakhutdinov Improving neural networks by preventing co-adaptation of feature detectors. arXiv [Preprint] (2012). https:\/\/arxiv.org\/abs\/1207.0580 (Accessed 21 January 2021)."},{"key":"e_1_3_4_50_2","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava N.","year":"2014","unstructured":"N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, R. Salakhutdinov, Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929\u20131958 (2014).","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1177\/0956797612474322"},{"key":"e_1_3_4_52_2","first-page":"4","article-title":"Representational similarity analysis\u2014connecting the branches of systems neuroscience","volume":"2","author":"Kriegeskorte N.","year":"2008","unstructured":"N. Kriegeskorte, M. Mur, P. Bandettini, Representational similarity analysis\u2014connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2, 4 (2008).","journal-title":"Front. Syst. Neurosci."},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(70)90002-2"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2015.07.028"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1417347111"},{"key":"e_1_3_4_56_2","first-page":"646","volume-title":"Advances in Neural Information Processing Systems","author":"Goodfellow I.","year":"2009","unstructured":"I. Goodfellow, H. Lee, Q. V. Le, A. Saxe, A. Y. Ng, \u201cMeasuring invariances in deep networks\u201d in Advances in Neural Information Processing Systems, Y. Bengio, D. Schuurmans, J. D. Lafferty, C. K. I. Williams, A. Culotta, Eds. (Curran Associates, Inc., Red Hook, NY, 2009), vol. 22, pp. 646\u2013654."},{"key":"e_1_3_4_57_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.108.1.204"},{"key":"e_1_3_4_58_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.106.3.491"},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.96.4.523"},{"key":"e_1_3_4_60_2","doi-asserted-by":"publisher","DOI":"10.1037\/0096-1523.24.4.1131"},{"key":"e_1_3_4_61_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.103.1.56"},{"key":"e_1_3_4_62_2","unstructured":"R. T. McCoy T. Linzen E. Dunbar P. Smolensky RNNs implicitly implement tensor product representations. arXiv [Preprint] (2019). https:\/\/arxiv.org\/abs\/1812.08718 (Accessed 28 March 2020)."},{"key":"e_1_3_4_63_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(90)90007-M"},{"key":"e_1_3_4_64_2","first-page":"109","volume-title":"Psychology of Learning and Motivation","author":"McCloskey M.","year":"1989","unstructured":"M. McCloskey, N. J. Cohen, \u201cCatastrophic interference in connectionist networks: The sequential learning problem\u201d in Psychology of Learning and Motivation, G. H. Bower, Ed. (Academic Press, New York, NY, 1989), pp. 109\u2013165."},{"key":"e_1_3_4_65_2","volume-title":"The Oxford Handbook of Reading","author":"Kolinsky R.","year":"2014","unstructured":"R. Kolinsky, \u201cHow learning to read influences language and cognition\u201d in The Oxford Handbook of Reading, A. Pollatsek, R. Treiman, Eds. (Oxford University Press, Oxford, UK, 2014)."},{"key":"e_1_3_4_66_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcn.2018.09.003"},{"key":"e_1_3_4_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2010.11.043"},{"key":"e_1_3_4_68_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0033198"},{"key":"e_1_3_4_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2017.05.011"},{"key":"e_1_3_4_70_2","first-page":"419","volume-title":"Handbook of Mathematical Psychology","author":"Miller G. A.","year":"1963","unstructured":"G. A. Miller, N. Chomsky, \u201cFinitary models of language users\u201d in Handbook of Mathematical Psychology, R. D. Luce, R. R. Bush, E. Galanter, Eds. (Wiley, New York, NY, 1963), vol. 1, p. 419\u2013491."},{"key":"e_1_3_4_71_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00635"},{"key":"e_1_3_4_72_2","doi-asserted-by":"publisher","DOI":"10.1167\/11.6.8"},{"key":"e_1_3_4_73_2","doi-asserted-by":"publisher","DOI":"10.1101\/2020.07.09.185116"},{"key":"e_1_3_4_74_2","doi-asserted-by":"publisher","DOI":"10.1101\/407007"},{"key":"e_1_3_4_75_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1905544116"},{"key":"e_1_3_4_76_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1403112111"},{"key":"e_1_3_4_77_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2016.10.001"},{"key":"e_1_3_4_78_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2350-5"},{"key":"e_1_3_4_79_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.88.5.375"},{"key":"e_1_3_4_80_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.114.2.273"},{"key":"e_1_3_4_81_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-13996-4"},{"key":"e_1_3_4_82_2","unstructured":"A. Nayebi . Task-driven convolutional recurrent models of the visual system. arXiv [Preprint] (2018). https:\/\/arxiv.org\/abs\/1807.00053 (Accessed 10 February 2021)."},{"key":"e_1_3_4_83_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1509321112"},{"key":"e_1_3_4_84_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.1603309"},{"key":"e_1_3_4_85_2","doi-asserted-by":"publisher","DOI":"10.1037\/a0026744"},{"key":"e_1_3_4_86_2","doi-asserted-by":"publisher","DOI":"10.1177\/1529100618772271"},{"key":"e_1_3_4_87_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn1065"},{"key":"e_1_3_4_88_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0823-z"},{"key":"e_1_3_4_89_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1218152"},{"key":"e_1_3_4_90_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2011.12.022"},{"key":"e_1_3_4_91_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1119983"}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.pnas.org\/syndication\/doi\/10.1073\/pnas.2104779118","content-type":"unspecified","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2104779118","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,13]],"date-time":"2022-04-13T08:13:44Z","timestamp":1649837624000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.2104779118"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,8]]},"references-count":91,"journal-issue":{"issue":"46","published-print":{"date-parts":[[2021,11,16]]}},"alternative-id":["10.1073\/pnas.2104779118"],"URL":"https:\/\/doi.org\/10.1073\/pnas.2104779118","relation":{},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,8]]},"assertion":[{"value":"2021-09-10","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2104779118"}}