{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T10:11:17Z","timestamp":1767175877931,"version":"build-2238731810"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010658","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000}}],"reference-count":94,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2022,10,31]],"date-time":"2022-10-31T00:00:00Z","timestamp":1667174400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["GRK 2340"],"award-info":[{"award-number":["GRK 2340"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["GRK 2340"],"award-info":[{"award-number":["GRK 2340"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Language interfaces with many other cognitive domains. This paper explores how interactions at these interfaces can be studied with deep learning methods, focusing on the relation between language emergence and visual perception. To model the emergence of language, a sender and a receiver agent are trained on a reference game. The agents are implemented as deep neural networks, with dedicated vision and language modules. Motivated by the mutual influence between language and perception in cognition, we apply systematic manipulations to the agents\u2019 (i) visual representations, to analyze the effects on emergent communication, and (ii) communication protocols, to analyze the effects on visual representations. Our analyses show that perceptual biases shape semantic categorization and communicative content. Conversely, if the communication protocol partitions object space along certain attributes, agents learn to represent visual information about these attributes more accurately, and the representations of communication partners align. Finally, an evolutionary analysis suggests that visual representations may be shaped in part to facilitate the communication of environmentally relevant distinctions. Aside from accounting for co-adaptation effects between language and perception, our results point out ways to modulate and improve visual representation learning and emergent communication in artificial agents.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010658","type":"journal-article","created":{"date-parts":[[2022,10,31]],"date-time":"2022-10-31T13:53:54Z","timestamp":1667224434000},"page":"e1010658","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":3,"title":["Mutual influence between language and perception in multi-agent communication games"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1295-0973","authenticated-orcid":true,"given":"Xenia","family":"Ohmer","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5742-2667","authenticated-orcid":true,"given":"Michael","family":"Marino","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Franke","sequence":"additional","affiliation":[]},{"given":"Peter","family":"K\u00f6nig","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,10,31]]},"reference":[{"key":"pcbi.1010658.ref001","volume-title":"Convention","author":"D Lewis","year":"1969"},{"key":"pcbi.1010658.ref002","volume-title":"Arenas of language use","author":"HH Clark","year":"1992"},{"key":"pcbi.1010658.ref003","doi-asserted-by":"crossref","unstructured":"Bisk Y, Holtzman A, Thomason J, Andreas J, Bengio Y, Chai J, et al. Experience grounds language. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP); 2020. p. 8718\u20138735.","DOI":"10.18653\/v1\/2020.emnlp-main.703"},{"issue":"12","key":"pcbi.1010658.ref004","doi-asserted-by":"crossref","first-page":"e2016569118","DOI":"10.1073\/pnas.2016569118","article-title":"Communicating artificial neural networks develop efficient color-naming systems","volume":"118","author":"R Chaabouni","year":"2021","journal-title":"Proceedings of the National Academy of Sciences (PNAS)"},{"issue":"7","key":"pcbi.1010658.ref005","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0234894","article-title":"A reinforcement-learning approach to efficient communication","volume":"15","author":"M K\u00e5geb\u00e4ck","year":"2020","journal-title":"PLOS ONE"},{"key":"pcbi.1010658.ref006","doi-asserted-by":"crossref","unstructured":"Harding Graesser L, Cho K, Kiela D. Emergent linguistic phenomena in multi-agent communication games. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP); 2019. p. 3700\u20133710.","DOI":"10.18653\/v1\/D19-1384"},{"key":"pcbi.1010658.ref007","unstructured":"Ohmer X, K\u00f6nig P, Franke M. Reinforcement of semantic representations in pragmatic agents leads to the emergence of a mutual exclusivity bias. In: Proceedings of the 42nd Annual Meeting of the Cognitive Science Society (CogSci); 2020. p. 1779\u20131785."},{"key":"pcbi.1010658.ref008","doi-asserted-by":"crossref","unstructured":"Portelance E, Frank MC, Jurafsky D, Sordoni A, Laroche R. The emergence of the shape bias results from communicative efficiency. In: Proceedings of the 25th Conference on Computational Natural Language Learning (CoNLL); 2021. p. 607\u2013623.","DOI":"10.18653\/v1\/2021.conll-1.48"},{"key":"pcbi.1010658.ref009","unstructured":"Choi E, Lazaridou A, de Freitas N. Compositional obverter communication learning from raw visual input. In: Proceedings of the 6th International Conference on Learning Representations (ICLR); 2018. p. 1\u201318."},{"key":"pcbi.1010658.ref010","unstructured":"Li F, Bowling M. Ease-of-teaching and language structure from emergent communication. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems (NeurIPS); 2019. p. 1\u201311."},{"key":"pcbi.1010658.ref011","unstructured":"Ren Y, Guo S, Labeau M, Cohen SB, Kirby S. Compositional languages emerge in a neural iterated learning model. In: Proceedings of the 8th International Conference on Learning Representations (ICLR); 2020. p. 1\u201322."},{"issue":"11","key":"pcbi.1010658.ref012","first-page":"1","article-title":"Deep supervised, but not unsupervised, models may explain IT cortical representation","volume":"10","author":"SM Khaligh-Razavi","year":"2014","journal-title":"PLOS Computational Biology"},{"key":"pcbi.1010658.ref013","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1146\/annurev-vision-082114-035447","article-title":"Deep neural networks: A new framework for modeling biological vision and brain information processing","volume":"1","author":"N Kriegeskorte","year":"2015","journal-title":"Annual Review of Vision Science"},{"key":"pcbi.1010658.ref014","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/srep27755","article-title":"Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence","volume":"6","author":"RM Cichy","year":"2016","journal-title":"Scientific Reports"},{"key":"pcbi.1010658.ref015","doi-asserted-by":"crossref","first-page":"1726","DOI":"10.3389\/fpsyg.2017.01726","article-title":"Deep convolutional neural networks outperform feature-based but not categorical models in explaining object similarity judgments","volume":"8","author":"KM Jozwik","year":"2017","journal-title":"Frontiers in Psychology"},{"issue":"8","key":"pcbi.1010658.ref016","doi-asserted-by":"crossref","first-page":"2648","DOI":"10.1111\/cogs.12670","article-title":"Evaluating (and improving) the correspondence between deep neural networks and human representations","volume":"42","author":"JC Peterson","year":"2018","journal-title":"Cognitive Science"},{"issue":"4","key":"pcbi.1010658.ref017","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1073\/pnas.0610341104","article-title":"Color naming reflects optimal partitions of color space","volume":"104","author":"T Regier","year":"2007","journal-title":"Proceedings of the National Academy of Sciences (PNAS)"},{"key":"pcbi.1010658.ref018","volume-title":"Metaphors we live by","author":"G Lakoff","year":"1980"},{"issue":"11","key":"pcbi.1010658.ref019","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1016\/j.tics.2020.08.005","article-title":"Effects of language on visual perception","volume":"24","author":"G Lupyan","year":"2020","journal-title":"Trends in Cognitive Science"},{"issue":"19","key":"pcbi.1010658.ref020","doi-asserted-by":"crossref","first-page":"7780","DOI":"10.1073\/pnas.0701644104","article-title":"Russian blues reveal effects of language on color discrimination","volume":"104","author":"J Winawer","year":"2007","journal-title":"Proceedings of the National Academy of Sciences (PNAS)"},{"issue":"7","key":"pcbi.1010658.ref021","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1037\/xge0000560","article-title":"Hearing words changes color perception: Facilitation of color discrimination by verbal and visual cues","volume":"148","author":"L Forder","year":"2019","journal-title":"Journal of Experimental Psychology: General"},{"issue":"7","key":"pcbi.1010658.ref022","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/S1364-6613(99)01333-9","article-title":"Possible stages in the evolution of the language capacity","volume":"3","author":"R Jackendoff","year":"1999","journal-title":"Trends in Cognitive Sciences"},{"key":"pcbi.1010658.ref023","unstructured":"Havrylov S, Titov I. Emergence of language with multi-agent games: Learning to communicate with sequences of symbols. In: Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS); 2017. p. 2149\u20132159."},{"key":"pcbi.1010658.ref024","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez Luna D, Ponti EM, Hupkes D, Bruni E. Internal and external pressures on language emergence: least effort, object constancy and frequency. In: Findings of the Association for Computational Linguistics: EMNLP 2020; 2020. p. 4428\u20134437.","DOI":"10.18653\/v1\/2020.findings-emnlp.397"},{"key":"pcbi.1010658.ref025","doi-asserted-by":"crossref","unstructured":"Lazaridou A, Potapenko A, Tieleman O. Multi-agent communication meets natural language: Synergies between functional and structural language learning. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL); 2020. p. 7663\u20137674.","DOI":"10.18653\/v1\/2020.acl-main.685"},{"issue":"6","key":"pcbi.1010658.ref026","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/S1364-6613(03)00109-8","article-title":"The role of similarity in the development of categorization","volume":"7","author":"VM Sloutsky","year":"2003","journal-title":"Trends in Cognitive Sciences"},{"key":"pcbi.1010658.ref027","first-page":"146","volume-title":"From global similarities to kinds of similarities: The construction of dimensions in development","author":"LB Smith","year":"1989"},{"issue":"1","key":"pcbi.1010658.ref028","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1016\/0022-5193(74)90110-6","article-title":"The theory of games and the evolution of animal conflicts","volume":"47","author":"J Maynard Smith","year":"1974","journal-title":"Journal of Theoretical Biology"},{"issue":"6","key":"pcbi.1010658.ref029","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.2307\/1913390","article-title":"Strategic information transmission","volume":"50","author":"VP Crawford","year":"1982","journal-title":"Econometrica"},{"issue":"2","key":"pcbi.1010658.ref030","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1006\/jeth.1997.2359","article-title":"A survey of experiments on communication via cheap talk","volume":"78","author":"VP Crawford","year":"1998","journal-title":"Journal of Economic Theory"},{"issue":"5","key":"pcbi.1010658.ref031","first-page":"1323","article-title":"Experimental evidence on the evolution of meaning of messages in sender-receiver games","volume":"88","author":"A Blume","year":"1998","journal-title":"The American Economic Review"},{"issue":"2","key":"pcbi.1010658.ref032","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1162\/106454602320184248","article-title":"Natural language from artificial life","volume":"8","author":"S Kirby","year":"2002","journal-title":"Artificial life"},{"key":"pcbi.1010658.ref033","unstructured":"Mikolov T, Joulin A, Baroni M. A Roadmap towards machine intelligence. arXiv preprint. 2015;arXiv:1511.08130."},{"key":"pcbi.1010658.ref034","first-page":"384","volume-title":"Synthesising the origins of language and meaning using co-evolution, self-organisation and level formation","author":"L Steels","year":"1998"},{"issue":"5","key":"pcbi.1010658.ref035","first-page":"16","article-title":"Language games for autonomous robots","volume":"16","author":"L Steels","year":"2001","journal-title":"IEEE Intelligent Systems"},{"issue":"4","key":"pcbi.1010658.ref036","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1017\/S0140525X05000087","article-title":"Coordinating perceptually grounded categories through language: A case study for colour","volume":"28","author":"L Steels","year":"2005","journal-title":"Behavioral and Brain Sciences"},{"key":"pcbi.1010658.ref037","unstructured":"Bleys J, Loetzsch M, Spranger M, Steels L. The grounded colour naming game. In: Proceedings of the 18th IEEE International Symposium on Robot and Human Interactive Communication (Ro-Man); 2009. p. 1\u20137."},{"key":"pcbi.1010658.ref038","unstructured":"Lazaridou A, Baroni M. Emergent multi-agent communication in the deep learning era. arXiv preprint. 2020;arXiv:2006.02419."},{"key":"pcbi.1010658.ref039","doi-asserted-by":"crossref","unstructured":"Bouchacourt D, Baroni M. Miss Tools and Mr Fruit: Emergent Communication in Agents Learning about Object Affordances. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL); 2019. p. 3909\u20133918.","DOI":"10.18653\/v1\/P19-1380"},{"key":"pcbi.1010658.ref040","doi-asserted-by":"crossref","unstructured":"Kharitonov E, Baroni M. Emergent language generalization and acquisition speed are not tied to compositionality. In: Proceedings of the 3rd BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP. Association for Computational Linguistics; 2020. p. 11\u201315.","DOI":"10.18653\/v1\/2020.blackboxnlp-1.2"},{"key":"pcbi.1010658.ref041","doi-asserted-by":"crossref","unstructured":"Chaabouni R, Kharitonov E, Bouchacourt D, Dupoux E, Baroni M. Compositionality and generalization in emergent languages. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL); 2020. p. 4427\u20134442.","DOI":"10.18653\/v1\/2020.acl-main.407"},{"key":"pcbi.1010658.ref042","unstructured":"Lazaridou A, Peysakhovich A, Baroni M. Multi-agent cooperation and the emergence of (natural) language. In: Proceedings of the 5th International Conference on Learning Representations (ICLR); 2017. p. 1\u201311."},{"key":"pcbi.1010658.ref043","doi-asserted-by":"crossref","unstructured":"Bouchacourt D, Baroni M. How agents see things: On visual representations in an emergent language game. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP); 2018. p. 981\u2013985.","DOI":"10.18653\/v1\/D18-1119"},{"key":"pcbi.1010658.ref044","unstructured":"Burgess C, Kim H. 3D Shapes Dataset; 2018. https:\/\/github.com\/deepmind\/3d-shapes."},{"key":"pcbi.1010658.ref045","doi-asserted-by":"crossref","unstructured":"Cho K, van Merri\u00ebnboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, et al. Learning phrase representations using RNN encoder\u2013decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP); 2014. p. 1724\u20131734.","DOI":"10.3115\/v1\/D14-1179"},{"issue":"10","key":"pcbi.1010658.ref046","doi-asserted-by":"crossref","first-page":"1284","DOI":"10.1080\/23273798.2017.1391398","article-title":"Categories, concepts, and conceptual development","volume":"34","author":"VM Sloutsky","year":"2019","journal-title":"Language, Cognition and Neuroscience"},{"key":"pcbi.1010658.ref047","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1007\/BF00992696","article-title":"Simple statistical gradient-following algorithms for connectionist reinforcement learning","volume":"8","author":"RJ Williams","year":"1992","journal-title":"Machine Learning"},{"key":"pcbi.1010658.ref048","unstructured":"Mnih V, Badia AP, Mirza M, Graves A, Lillicrap T, Harley T, et al. Asynchronous methods for deep reinforcement learning. In: Proceedings of the 33rd International Conference on Machine Learning (ICML). vol. 48; 2016. p. 1928\u20131937."},{"issue":"4","key":"pcbi.1010658.ref049","first-page":"1","article-title":"Representational similarity analysis \u2014 connecting the branches of systems neuroscience","volume":"2","author":"N Kriegeskorte","year":"2008","journal-title":"Frontiers in Systems Neuroscience"},{"key":"pcbi.1010658.ref050","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"L van der Maaten","year":"2008","journal-title":"Journal of Machine Learning Research (JMLR)"},{"key":"pcbi.1010658.ref051","unstructured":"Hill F, Clark S, Hermann KM, Blunsom P. Simulating early word learning in situated connectionist agents. In: Proceedings of the 42nd Annual Meeting of the Cognitive Science Society (CogSci); 2020. p. 875\u2013881."},{"issue":"1","key":"pcbi.1010658.ref052","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/0025-5564(78)90077-9","article-title":"Evolutionary stable strategies and game dynamics","volume":"40","author":"PD Taylor","year":"1978","journal-title":"Mathematical Biosciences"},{"key":"pcbi.1010658.ref053","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139173179","volume-title":"Evolutionary games and population dynamics","author":"J Hofbauer","year":"1998"},{"key":"pcbi.1010658.ref054","volume-title":"Population games and evolutionary dynamics","author":"WH Sandholm","year":"2010"},{"issue":"4","key":"pcbi.1010658.ref055","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1093\/bjps\/axx002","article-title":"Vagueness and imprecise imitation in signaling games","volume":"69","author":"M Franke","year":"2018","journal-title":"The British Journal for the Philosophy of Science"},{"issue":"1","key":"pcbi.1010658.ref056","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1006\/jeth.1997.2319","article-title":"Learning through reinforcement and replicator dynamics","volume":"77","author":"T B\u00f6rgers","year":"1997","journal-title":"Journal of Economic Theory"},{"key":"pcbi.1010658.ref057","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2884.001.0001","volume-title":"Evolutionary dynamics and extensive form games","author":"R Cressman","year":"2003"},{"key":"pcbi.1010658.ref058","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL); 2019. p. 4171\u20134186."},{"key":"pcbi.1010658.ref059","unstructured":"Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I. Language models are unsupervised multitask learners. OpenAI Blog; 2019."},{"key":"pcbi.1010658.ref060","unstructured":"Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, et al. Language models are few-shot learners. In: Proceedings of the 34th International Conference on Neural Information Processing Systems (NeurIPS); 2020. p. 1877\u20131901."},{"issue":"3","key":"pcbi.1010658.ref061","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/0010-0285(76)90013-X","article-title":"Basic objects in natural categories","volume":"8","author":"E Rosch","year":"1976","journal-title":"Cognitive Psychology"},{"key":"pcbi.1010658.ref062","unstructured":"Szegedy C, Zaremba W, Sutskever I, Bruna J, Erhan D, Goodfellow I, et al. Intriguing properties of neural networks. In: Proceedings of the 2nd International Conference on Learning Representations (ICLR); 2014. p. 1\u201310."},{"key":"pcbi.1010658.ref063","unstructured":"Gandhi K, Lake BM. Mutual exclusivity as a challenge for neural networks. In: Proceedings of the 34th International Conference on Neural Information Processing Systems (NeurIPS); 2020. p. 14182\u201314192."},{"issue":"4","key":"pcbi.1010658.ref064","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1037\/0096-3445.131.4.477","article-title":"Acquisition of categorical color perception: A perceptual learning approach to the linguistic relativity hypothesis","volume":"131","author":"E \u00d6zgen","year":"2002","journal-title":"Journal of Experimental Psychology: General"},{"issue":"2","key":"pcbi.1010658.ref065","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1016\/j.cognition.2008.03.009","article-title":"The conceptual grouping effect: Categories matter (and named categories matter more)","volume":"108","author":"G Lupyan","year":"2008","journal-title":"Cognition"},{"key":"pcbi.1010658.ref066","unstructured":"Harnad S, Hanson SJ, Lubin J. Categorical perception and the evolution of supervised learning in neural nets. In: Powers DW, Reeker L, editors. Working Papers of the AAAI Spring Symposium on Machine Learning of Natural Language and Ontology; 1991. p. 65\u201374."},{"key":"pcbi.1010658.ref067","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1075\/eoc.4.1.07can","article-title":"The adaptive advantage of symbolic theft over sensorimotor toil: Grounding language in perceptual categories","volume":"4","author":"A Cangelosi","year":"2000","journal-title":"Evolution of Communication"},{"issue":"4","key":"pcbi.1010658.ref068","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1037\/0096-3445.127.4.331","article-title":"Referential communication and category acquisition","volume":"127","author":"AB Markman","year":"1998","journal-title":"Journal of Experimental Psychology: General"},{"issue":"11","key":"pcbi.1010658.ref069","doi-asserted-by":"crossref","first-page":"e12796","DOI":"10.1111\/cogs.12796","article-title":"Novel labels increase category coherence, but only when people have the goal to coordinate","volume":"43","author":"E Suffill","year":"2019","journal-title":"Cognitive Science"},{"key":"pcbi.1010658.ref070","volume-title":"Conceptual spaces: The geometry of thought","author":"P G\u00e4rdenfors","year":"2004"},{"issue":"8","key":"pcbi.1010658.ref071","doi-asserted-by":"crossref","first-page":"2079","DOI":"10.1162\/NECO_a_00475","article-title":"The evolution of representation in simple cognitive networks","volume":"25","author":"L Marstaller","year":"2013","journal-title":"Neural Computation"},{"issue":"7","key":"pcbi.1010658.ref072","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.tics.2004.05.009","article-title":"Comparative mapping of higher visual areas in monkeys and humans","volume":"8","author":"GA Orban","year":"2004","journal-title":"Trends in Cognitive Sciences"},{"key":"pcbi.1010658.ref073","doi-asserted-by":"crossref","first-page":"1247","DOI":"10.1007\/s00429-021-02437-y","article-title":"Receptor architecture of macaque and human early visual areas: not equal, but comparable","volume":"227","author":"L Rapan","year":"2022","journal-title":"Brain Structure and Function"},{"issue":"401","key":"pcbi.1010658.ref074","first-page":"1","article-title":"The mystery of language evolution","volume":"5","author":"MD Hauser","year":"2014","journal-title":"Frontiers in Psychology"},{"issue":"5","key":"pcbi.1010658.ref075","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1017\/S0140525X08004998","article-title":"Language as shaped by the brain","volume":"31","author":"MH Christiansen","year":"2008","journal-title":"The behavioral and brain sciences"},{"issue":"3","key":"pcbi.1010658.ref076","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/0022-5193(83)90445-9","article-title":"Replicator dynamics","volume":"100","author":"P Schuster","year":"1983","journal-title":"Journal of Theoretical Biology"},{"key":"pcbi.1010658.ref077","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199580828.001.0001","volume-title":"Signals: Evolution, learning, and information","author":"B Skyrms","year":"2010"},{"key":"pcbi.1010658.ref078","volume-title":"Action in perception","author":"A No\u00eb","year":"2004"},{"issue":"8","key":"pcbi.1010658.ref079","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1167\/15.8.22","article-title":"Categorical facilitation with equally discriminable colors","volume":"15","author":"C Witzel","year":"2015","journal-title":"Journal of Vision"},{"issue":"10","key":"pcbi.1010658.ref080","doi-asserted-by":"crossref","first-page":"2017","DOI":"10.1162\/jocn_a_01544","article-title":"Convolutional neural networks as a model of the visual system: Past, present, and future","volume":"33","author":"GW Lindsay","year":"2021","journal-title":"Journal of Cognitive Neuroscience"},{"issue":"10","key":"pcbi.1010658.ref081","first-page":"2044","article-title":"Diverse deep neural networks all predict human inferior temporal cortex well, after training and fitting","volume":"33","author":"KR Storrs","year":"2021","journal-title":"Journal of Cognitive Neuroscience"},{"key":"pcbi.1010658.ref082","doi-asserted-by":"crossref","unstructured":"Kietzmann TC, McClure P, Kriegeskorte N. Deep neural networks in computational neuroscience; 2019. Oxford Research Encyclopedia of Neuroscience. Available from: https:\/\/oxfordre.com\/neuroscience\/view\/10.1093\/acrefore\/9780190264086.001.0001\/acrefore-9780190264086-e-46.","DOI":"10.1093\/acrefore\/9780190264086.013.46"},{"issue":"11","key":"pcbi.1010658.ref083","doi-asserted-by":"crossref","first-page":"1761","DOI":"10.1038\/s41593-019-0520-2","article-title":"A deep learning framework for neuroscience","volume":"22","author":"BA Richards","year":"2019","journal-title":"Nature Neuroscience"},{"issue":"13","key":"pcbi.1010658.ref084","first-page":"1","article-title":"Use of superordinate labels yields more robust an human-like visual representations in convolutional neural networks","volume":"21","author":"S Ahn","year":"2021","journal-title":"Journal of Vision"},{"issue":"1551","key":"pcbi.1010658.ref085","first-page":"1","article-title":"Recurrent convolutional neural networks: A better model of biological object recognition","volume":"8","author":"CJ Spoerer","year":"2017","journal-title":"Frontiers in Psychology"},{"issue":"43","key":"pcbi.1010658.ref086","doi-asserted-by":"crossref","first-page":"21854","DOI":"10.1073\/pnas.1905544116","article-title":"Recurrence is required to capture the representational dynamics of the human visual system","volume":"116","author":"TC Kietzmann","year":"2019","journal-title":"Proceedings of the National Academy of Sciences (PNAS)"},{"key":"pcbi.1010658.ref087","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.neunet.2020.11.004","article-title":"Learning sparse and meaningful representations through embodiment","volume":"134","author":"V Clay","year":"2021","journal-title":"Neural Networks"},{"key":"pcbi.1010658.ref088","first-page":"249","volume-title":"Constructing inferences and relations during text comprehension","author":"AC Graesser","year":"2001"},{"key":"pcbi.1010658.ref089","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1515\/lity.1997.1.1.33","article-title":"Mirativity: The grammatical marking of unexpected information","volume":"1","author":"S Delancey","year":"1997","journal-title":"Linguistic Typology"},{"issue":"5","key":"pcbi.1010658.ref090","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3465055","article-title":"An attentive survey of attention models","volume":"12","author":"S Chaudhari","year":"2021","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"issue":"7626","key":"pcbi.1010658.ref091","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1038\/nature20101","article-title":"Hybrid computing using a neural network with dynamic external memory","volume":"538","author":"A Graves","year":"2016","journal-title":"Nature"},{"issue":"3","key":"pcbi.1010658.ref092","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1002\/wcs.104","article-title":"Linguistic relativity","volume":"2","author":"P Wolff","year":"2011","journal-title":"WIREs Cognitive Science"},{"key":"pcbi.1010658.ref093","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1098\/rstb.2012.0117","article-title":"The co-evolution of language and emotions","volume":"367","author":"E Jablonka","year":"2012","journal-title":"Philosophical Transactions of the Royal Society B"},{"issue":"3","key":"pcbi.1010658.ref094","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.neunet.2009.03.007","article-title":"Language and cognition","volume":"22","author":"L Perlovsky","year":"2009","journal-title":"Neural Networks"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010658","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T00:00:00Z","timestamp":1668038400000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010658","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T13:48:42Z","timestamp":1668088122000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010658"}},"subtitle":[],"editor":[{"given":"Ming Bo","family":"Cai","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,10,31]]},"references-count":94,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2022,10,31]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010658","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,31]]}}}