{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T07:01:37Z","timestamp":1672815697173},"reference-count":48,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T00:00:00Z","timestamp":1672704000000},"content-version":"vor","delay-in-days":367,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,12,23]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Computational approaches to the study of language emergence can help us understand how natural languages are shaped by cognitive and sociocultural factors. Previous work focused on tasks where agents refer to a single entity. In contrast, we study how agents predicate, that is, how they express that some relation holds between several entities. We introduce a setup where agents talk about a variable number of entities that can be partially observed by the listener. In the presence of a least-effort pressure, they tend to discuss only entities that are not observed by the listener. Thus we can obtain artificial phrases that denote a single entity, as well as artificial sentences that denote several entities. In natural languages, if we ignore the verb, phrases are usually concatenated, either in a specific order or by adding case markers to form sentences. Our setup allows us to quantify how much this holds in emergent languages using a metric we call concatenability. We also measure transitivity, which quantifies the importance of word order. We demonstrate the usefulness of this new setup and metrics for studying factors that influence argument structure. We compare agents having access to input representations structured into pre-segmented objects with properties, versus unstructured representations. Our results indicate that the awareness of object structure yields a more natural sentence organization.<\/jats:p>","DOI":"10.1162\/tacl_a_00524","type":"journal-article","created":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T19:25:13Z","timestamp":1672773913000},"page":"1375-1391","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":0,"title":["The Emergence of Argument Structure in Artificial Languages"],"prefix":"10.1162","volume":"10","author":[{"given":"Tom","family":"Bosc","sequence":"first","affiliation":[{"name":"Mila Universit\u00e9 de Montr\u00e9al, Canada. bosct@mila.quebec"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pascal","family":"Vincent","sequence":"additional","affiliation":[{"name":"Meta AI, Mila Universit\u00e9 de Montr\u00e9al, Canada CIFAR AI Chair. vincentp@iro.umontreal.ca"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2022,12,23]]},"reference":[{"key":"2023010319173264500_bib1","article-title":"Layer normalization","author":"Ba","year":"2016","journal-title":"arXiv preprint arXiv:1607.06450v1"},{"key":"2023010319173264500_bib2","article-title":"Neural machine translation by jointly learning to align and translate","author":"Bahdanau","year":"2014","journal-title":"arXiv preprint arXiv:1409.0473v7"},{"key":"2023010319173264500_bib3","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1093\/oxfordhb\/9780199206476.013.0020","article-title":"Case and alternative strategies: Word order and agreement marking","volume":"2009","author":"Bakker","year":"2009","journal-title":"In The Oxford Handbook of Case, edited by Andrej Malchukov and Andrew Spencer"},{"key":"2023010319173264500_bib4","article-title":"Rat big, cat eaten! Ideas for a useful deep-agent protolanguage","author":"Baroni","year":"2020","journal-title":"arXiv preprint arXiv:2003.11922v1"},{"issue":"2","key":"2023010319173264500_bib5","article-title":"Random search for hyper-parameter optimization.","volume":"13","author":"Bergstra","year":"2012","journal-title":"Journal of Machine Learning Research"},{"key":"2023010319173264500_bib6","article-title":"Emergence of communication in an interactive world with consistent speakers","author":"Bogin","year":"2018","journal-title":"arXiv preprint arXiv:1809.00549v1"},{"key":"2023010319173264500_bib7","doi-asserted-by":"publisher","first-page":"10","DOI":"10.18653\/v1\/K16-1002","article-title":"Generating sentences from a continuous space","volume-title":"Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning","author":"Bowman","year":"2016"},{"key":"2023010319173264500_bib8","doi-asserted-by":"publisher","first-page":"4427","DOI":"10.18653\/v1\/2020.acl-main.407","article-title":"Compositionality and generalization in emergent languages","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Chaabouni","year":"2020"},{"key":"2023010319173264500_bib9","first-page":"6293","article-title":"Anti-efficient encoding in emergent communication","volume-title":"Advances in Neural Information Processing Systems","author":"Chaabouni","year":"2019"},{"key":"2023010319173264500_bib10","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511620539","volume-title":"Using Language","author":"Clark","year":"1996"},{"issue":"3","key":"2023010319173264500_bib11","doi-asserted-by":"publisher","first-page":"547","DOI":"10.2307\/415037","article-title":"Thematic proto-roles and argument selection","volume":"67","author":"Dowty","year":"1991","journal-title":"Language"},{"key":"2023010319173264500_bib12","unstructured":"Dedre\n              Gentner\n            \n          . 1982. Why nouns are learned before verbs: Linguistic relativity versus natural partitioning. Center for the Study of Reading Technical Report; no. 257."},{"key":"2023010319173264500_bib13","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1163\/9789004368811_003","article-title":"Logic and conversation","volume-title":"Speech Acts","author":"Grice","year":"1975"},{"key":"2023010319173264500_bib14","volume-title":"The Emergence of Compositional Languages for Numeric Concepts Through Iterated Learning in Neural Agents","author":"Guo","year":"2019"},{"issue":"2","key":"2023010319173264500_bib15","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/0024-3841(89)90015-6","article-title":"Biological evolution of the Saussurean sign as a component of the language acquisition device","volume":"77","author":"Hurford","year":"1989","journal-title":"Lingua"},{"key":"2023010319173264500_bib16","article-title":"Categorical reparameterization with gumbel- softmax","author":"Jang","year":"2016","journal-title":"arXiv preprint arXiv:1611.01144v5"},{"key":"2023010319173264500_bib17","article-title":"EGG: A toolkit for research on Emergence of lanGuage in Games","author":"Kharitonov","year":"2021"},{"key":"2023010319173264500_bib18","article-title":"Adam: A method for stochastic optimization","author":"Kingma","year":"2014","journal-title":"arXiv preprint arXiv:1412.6980v9"},{"key":"2023010319173264500_bib19","first-page":"4743","article-title":"Improved variational inference with inverse autoregressive flow","volume-title":"Advances in Neural Information Processing Systems","author":"Kingma","year":"2016"},{"key":"2023010319173264500_bib20","first-page":"1989","article-title":"From TreeBank to PropBank.","volume-title":"LREC","author":"Kingsbury","year":"2002"},{"key":"2023010319173264500_bib21","first-page":"2688","article-title":"Neural relational inference for interacting systems","volume-title":"International Conference on Machine Learning","author":"Kipf","year":"2018"},{"key":"2023010319173264500_bib22","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1007\/978-1-4471-0663-0_6","article-title":"The emergence of linguistic structure: An overview of the iterated learning model","author":"Kirby","year":"2002","journal-title":"Simulating the Evolution of Language"},{"key":"2023010319173264500_bib23","doi-asserted-by":"publisher","first-page":"2962","DOI":"10.18653\/v1\/D17-1321","article-title":"Natural language does not emerge \u2018naturally\u2019 in multi-agent dialog","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","author":"Kottur","year":"2017"},{"key":"2023010319173264500_bib24","article-title":"Emergent multi-agent communication in the deep learning era","author":"Lazaridou","year":"2020","journal-title":"arXiv preprint arXiv:2006.02419v1"},{"key":"2023010319173264500_bib25","article-title":"Emergence of linguistic communication from referential games with symbolic and pixel input","volume-title":"6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30\u2013May 3, 2018, Conference Track Proceedings","author":"Lazaridou","year":"2018"},{"key":"2023010319173264500_bib26","article-title":"Multi-agent cooperation and the emergence of (natural) language","volume-title":"5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24\u201326, 2017, Conference Track Proceedings","author":"Lazaridou","year":"2017"},{"issue":"3","key":"2023010319173264500_bib27","doi-asserted-by":"publisher","first-page":"217","DOI":"10.2307\/2685594","article-title":"Using heteroscedasticity consistent standard errors in the linear regression model","volume":"54","author":"Scott Long","year":"2000","journal-title":"The American Statistician"},{"key":"2023010319173264500_bib28","first-page":"693","article-title":"On the pitfalls of measuring emergent communication","volume-title":"Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, AAMAS \u201919, Montreal, QC, Canada, May 13\u201317, 2019","author":"Lowe","year":"2019"},{"issue":"3","key":"2023010319173264500_bib29","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1016\/0304-4076(85)90158-7","article-title":"Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties","volume":"29","author":"MacKinnon","year":"1985","journal-title":"Journal of Econometrics"},{"key":"2023010319173264500_bib30","article-title":"The concrete distribution: A continuous relaxation of discrete random variables","author":"Maddison","year":"2016","journal-title":"arXiv preprint arXiv:1611.00712v3"},{"key":"2023010319173264500_bib31","doi-asserted-by":"publisher","first-page":"56","DOI":"10.25080\/Majora-92bf1922-00a","article-title":"Data structures for statistical computing in Python","volume-title":"Proceedings of the 9th Python in Science Conference","author":"McKinney","year":"2010"},{"issue":"2","key":"2023010319173264500_bib32","doi-asserted-by":"publisher","first-page":"730","DOI":"10.1016\/j.cognition.2007.04.007","article-title":"Ape metaphysics: Object individuation without language","volume":"106","author":"Mendes","year":"2008","journal-title":"Cognition"},{"key":"2023010319173264500_bib33","first-page":"1495","article-title":"Emergence of grounded compositional language in multi-agent populations","volume-title":"Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI- 18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2\u20137, 2018","author":"Mordatch","year":"2018"},{"key":"2023010319173264500_bib34","first-page":"807","article-title":"Rectified linear units improve restricted boltzmann machines","volume-title":"Proceedings of the 27th International Conference on International Conference on Machine Learning","author":"Nair","year":"2010"},{"key":"2023010319173264500_bib35","first-page":"8024","article-title":"PyTorch: An imperative style, high-performance deep learning library","volume-title":"Advances in Neural Information Processing Systems 32","author":"Paszke","year":"2019"},{"key":"2023010319173264500_bib36","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.646","article-title":"Effective estimation of deep generative language models","author":"Pelsmaeker","year":"2019","journal-title":"arXiv preprint arXiv:1904.08194"},{"key":"2023010319173264500_bib37","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1162\/tacl_a_00152","article-title":"Semantic proto- roles","volume":"3","author":"Reisinger","year":"2015","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2023010319173264500_bib38","article-title":"A simple neural network module for relational reasoning","volume":"30","author":"Santoro","year":"2017","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2023010319173264500_bib39","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-92bf1922-011","article-title":"statsmodels: Econometric and statistical modeling with Python","volume-title":"9th Python in Science Conference","author":"Seabold","year":"2010"},{"issue":"1","key":"2023010319173264500_bib40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1075\/eoc.1.1.02ste","article-title":"The synthetic modeling of language origins","volume":"1","author":"Steels","year":"1997","journal-title":"Evolution of Communication"},{"key":"2023010319173264500_bib41","article-title":"Relational Neural Expectation Maximization: Unsupervised Discovery of Objects and their Interactions","volume-title":"International Conference on Learning Representations","author":"van Steenkiste","year":"2018"},{"key":"2023010319173264500_bib42","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1002\/9781405166348.ch1","article-title":"Inflection","author":"Stump","year":"2017","journal-title":"The Handbook of Morphology"},{"key":"2023010319173264500_bib43","article-title":"Compositionality","volume-title":"The Stanford Encyclopedia of Philosophy, fall 2020 edition","author":"Szab\u00f3","year":"2020"},{"key":"2023010319173264500_bib44","article-title":"pandas- dev\/pandas: Pandas 1.2.3","author":"Development Team","year":"2021"},{"key":"2023010319173264500_bib45","volume-title":"Origins of Human Communication","author":"Tomasello","year":"2010"},{"key":"2023010319173264500_bib46","first-page":"5998","article-title":"Attention is All you Need","volume-title":"Advances in Neural Information Processing Systems 30","author":"Vaswani","year":"2017"},{"issue":"2","key":"2023010319173264500_bib47","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1006\/cogp.1996.0005","article-title":"Infants\u2019 metaphysics: The case of numerical identity","volume":"30","author":"Fei","year":"1996","journal-title":"Cognitive Psychology"},{"key":"2023010319173264500_bib48","volume-title":"Human behavior and the principle of least effort","author":"Zipf","year":"1949"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00524\/2065948\/tacl_a_00524.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00524\/2065948\/tacl_a_00524.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,3]],"date-time":"2023-01-03T19:25:26Z","timestamp":1672773926000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00524\/114371\/The-Emergence-of-Argument-Structure-in-Artificial"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":48,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00524","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022]]}}}