{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,1,30]],"date-time":"2024-01-30T21:29:03Z","timestamp":1706650143446},"reference-count":69,"publisher":"MIT Press","issue":"3","license":[{"start":{"date-parts":[[2022,4,13]],"date-time":"2022-04-13T00:00:00Z","timestamp":1649808000000},"content-version":"vor","delay-in-days":102,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Multilingual sentence encoders have seen much success in cross-lingual model transfer for downstream NLP tasks. The success of this transfer is, however, dependent on the model\u2019s ability to encode the patterns of cross-lingual similarity and variation. Yet, we know relatively little about the properties of individual languages or the general patterns of linguistic variation that the models encode. In this article, we investigate these questions by leveraging knowledge from the field of linguistic typology, which studies and documents structural and semantic variation across languages. We propose methods for separating language-specific subspaces within state-of-the-art multilingual sentence encoders (LASER, M-BERT, XLM, and XLM-R) with respect to a range of typological properties pertaining to lexical, morphological, and syntactic structure. Moreover, we investigate how typological information about languages is distributed across all layers of the models. Our results show interesting differences in encoding linguistic variation associated with different pretraining strategies. In addition, we propose a simple method to study how shared typological properties of languages are encoded in two state-of-the-art multilingual models\u2014M-BERT and XLM-R. The results provide insight into their information-sharing mechanisms and suggest that these linguistic properties are encoded jointly across typologically similar languages in these models.<\/jats:p>","DOI":"10.1162\/coli_a_00444","type":"journal-article","created":{"date-parts":[[2022,4,13]],"date-time":"2022-04-13T19:51:11Z","timestamp":1649879471000},"page":"635-672","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":3,"title":["Investigating Language Relationships in Multilingual Sentence Encoders Through the Lens of Linguistic Typology"],"prefix":"10.1162","volume":"48","author":[{"given":"Rochelle","family":"Choenni","sequence":"first","affiliation":[{"name":"University of Amsterdam The Institute for Logic, Language and Computation (ILLC) r.m.v.k.choenni@uva.nl"}]},{"given":"Ekaterina","family":"Shutova","sequence":"additional","affiliation":[{"name":"University of Amsterdam The Institute for Logic, Language and Computation (ILLC) e.shutova@uva.nl"}]}],"member":"281","published-online":{"date-parts":[[2022,9,1]]},"reference":[{"key":"2022090113562945500_bib1","doi-asserted-by":"publisher","first-page":"13","DOI":"10.3115\/v1\/W14-4203","article-title":"Cross-lingual dependency parsing of related languages with rich morphosyntactic tagsets","volume-title":"EMNLP 2014 Workshop on Language Technology for Closely Related Languages and Language Variants","author":"Agi\u0107","year":"2014"},{"key":"2022090113562945500_bib2","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1162\/tacl_a_00109","article-title":"Many languages, one parser","volume":"4","author":"Ammar","year":"2016","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2022090113562945500_bib3","article-title":"Massively multilingual word embeddings","author":"Ammar","year":"2016","journal-title":"arXiv preprint arXiv:1602.01925"},{"key":"2022090113562945500_bib4","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1162\/tacl_a_00288","article-title":"Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond","volume":"7","author":"Artetxe","year":"2019","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2022090113562945500_bib5","doi-asserted-by":"publisher","first-page":"127","DOI":"10.3115\/1613715.1613734","article-title":"Multilingual subjectivity analysis using machine translation","volume-title":"Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing","author":"Banea","year":"2008"},{"issue":"3","key":"2022090113562945500_bib6","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1162\/coli_a_00382","article-title":"Semantic drift in multilingual representations","volume":"46","author":"Beinborn","year":"2020","journal-title":"Computational Linguistics"},{"issue":"2","key":"2022090113562945500_bib7","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1162\/coli_a_00351","article-title":"What do language representations really represent?","volume":"45","author":"Bjerva","year":"2019","journal-title":"Computational Linguistics"},{"key":"2022090113562945500_bib8","doi-asserted-by":"publisher","first-page":"14","DOI":"10.18653\/v1\/P18-2003","article-title":"Deep RNNs Encode Soft Hierarchical Syntax","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Blevins","year":"2018"},{"key":"2022090113562945500_bib9","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1024","article-title":"Unsupervised multilingual word embeddings","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Chen","year":"2018"},{"key":"2022090113562945500_bib10","doi-asserted-by":"publisher","first-page":"5564","DOI":"10.18653\/v1\/2020.acl-main.493","article-title":"Finding universal grammatical relations in Multilingual BERT","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020","author":"Chi","year":"2020"},{"key":"2022090113562945500_bib11","doi-asserted-by":"publisher","first-page":"8440","DOI":"10.18653\/v1\/2020.acl-main.747","article-title":"Unsupervised cross-lingual representation learning at scale","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Conneau","year":"2020"},{"key":"2022090113562945500_bib12","doi-asserted-by":"publisher","first-page":"2126","DOI":"10.18653\/v1\/P18-1198","article-title":"What you can cram into a single vector: Probing sentence embeddings for linguistic properties","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Conneau","year":"2018"},{"key":"2022090113562945500_bib13","doi-asserted-by":"publisher","first-page":"2475","DOI":"10.18653\/v1\/D18-1269","article-title":"XNLI: Evaluating cross-lingual sentence representations","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Conneau","year":"2018"},{"key":"2022090113562945500_bib14","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511840579","volume-title":"Typology and Universals","author":"Croft","year":"2002"},{"key":"2022090113562945500_bib15","first-page":"4171","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin","year":"2019"},{"key":"2022090113562945500_bib16","article-title":"Order of subject, object and verb","volume-title":"The World Atlas of Language Structures Online","author":"Dryer","year":"2013"},{"key":"2022090113562945500_bib17","volume-title":"WALS Online","author":"Dryer","year":"2013"},{"key":"2022090113562945500_bib18","doi-asserted-by":"publisher","first-page":"845","DOI":"10.3115\/v1\/P15-2139","article-title":"Low resource dependency parsing: Cross-lingual parameter sharing in a neural network parser","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)","author":"Duong","year":"2015"},{"key":"2022090113562945500_bib19","doi-asserted-by":"publisher","first-page":"339","DOI":"10.18653\/v1\/D15-1040","article-title":"A neural network model for low-resource universal dependency parsing","volume-title":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","author":"Duong","year":"2015"},{"key":"2022090113562945500_bib20","doi-asserted-by":"publisher","first-page":"369","DOI":"10.3115\/1687878.1687931","article-title":"Dependency grammar induction via bitext projection constraints","volume-title":"Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1-Volume 1","author":"Ganchev","year":"2009"},{"key":"2022090113562945500_bib21","doi-asserted-by":"publisher","first-page":"316","DOI":"10.18653\/v1\/D18-1029","article-title":"On the relation between linguistic typology and (limitations of) multilingual language modeling","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Gerz","year":"2018"},{"key":"2022090113562945500_bib22","doi-asserted-by":"publisher","first-page":"45","DOI":"10.18653\/v1\/2020.blackboxnlp-1.5","article-title":"It\u2019s not Greek to mBERT: Inducing word-level translations from Multilingual BERT","volume-title":"Proceedings of the Third BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP","author":"Gonen","year":"2020"},{"key":"2022090113562945500_bib23","first-page":"12","article-title":"A universal framework for inductive transfer parsing across multi-typed treebanks","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers","author":"Guo","year":"2016"},{"key":"2022090113562945500_bib24","first-page":"4129","article-title":"A structural probe for finding syntax in word representations","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Volume 1 (Long and Short Papers)","author":"Hewitt","year":"2019"},{"key":"2022090113562945500_bib25","doi-asserted-by":"publisher","first-page":"2485","DOI":"10.18653\/v1\/D19-1252","article-title":"Unicoder: A universal language encoder by pre-training with multiple cross-lingual tasks","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Huang","year":"2019"},{"issue":"3","key":"2022090113562945500_bib26","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1017\/S1351324905003840","article-title":"Bootstrapping parsers via syntactic projection across parallel texts","volume":"11","author":"Hwa","year":"2005","journal-title":"Natural Language Engineering"},{"key":"2022090113562945500_bib27","article-title":"Cross-lingual ability of multilingual BERT: An empirical study","volume-title":"International Conference on Learning Representations","author":"Karthikeyan","year":"2020"},{"key":"2022090113562945500_bib28","first-page":"561","article-title":"Together we can: Bilingual bootstrapping for WSD","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1","author":"Khapra","year":"2011"},{"key":"2022090113562945500_bib29","doi-asserted-by":"publisher","first-page":"454","DOI":"10.18653\/v1\/2021.findings-emnlp.41","article-title":"Multilingual chart-based constituency parse extraction from pre-trained language models","volume-title":"Findings of the Association for Computational Linguistics: EMNLP 2021","author":"Kim","year":"2021"},{"key":"2022090113562945500_bib30","article-title":"Adam: A method for stochastic optimization","author":"Kingma","year":"2014","journal-title":"arXiv preprint arXiv:1412.6980"},{"key":"2022090113562945500_bib31","first-page":"7059","article-title":"Cross-lingual language model pretraining","author":"Lample","year":"2019","journal-title":"Advances in Neural Information Processing Systems (NIPS)"},{"key":"2022090113562945500_bib32","doi-asserted-by":"publisher","first-page":"4483","DOI":"10.18653\/v1\/2020.emnlp-main.363","article-title":"From zero to hero: On the limitations of zero-shot language transfer with multilingual transformers","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Lauscher","year":"2020"},{"key":"2022090113562945500_bib33","doi-asserted-by":"publisher","first-page":"1663","DOI":"10.18653\/v1\/2020.findings-emnlp.150","article-title":"On the language neutrality of pre-trained multilingual representations","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings","author":"Libovicky\u0300","year":"2020"},{"key":"2022090113562945500_bib34","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1162\/tacl_a_00115","article-title":"Assessing the ability of LSTMs to learn syntax-sensitive dependencies","volume":"4","author":"Linzen","year":"2016","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2022090113562945500_bib35","article-title":"RoBERTa: A robustly optimized BERT pretraining approach","author":"Liu","year":"2019","journal-title":"arXiv preprint arXiv:1907.11692"},{"key":"2022090113562945500_bib36","first-page":"629","article-title":"Selective sharing for multilingual dependency parsing","volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1","author":"Naseem","year":"2012"},{"key":"2022090113562945500_bib37","first-page":"1399","article-title":"Joining forces pays off: Multilingual joint word sense disambiguation","volume-title":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning","author":"Navigli","year":"2012"},{"key":"2022090113562945500_bib38","first-page":"1659","article-title":"Universal dependencies v1: A multilingual treebank collection","volume-title":"Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916)","author":"Nivre","year":"2016"},{"key":"2022090113562945500_bib39","article-title":"What the [MASK]? Making sense of language-specific BERT models","author":"Nozza","year":"2020","journal-title":"arXiv preprint arXiv:2003.02912"},{"key":"2022090113562945500_bib40","first-page":"1297","article-title":"Survey on the use of typological information in natural language processing","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers","author":"O\u2019Horan","year":"2016"},{"key":"2022090113562945500_bib41","first-page":"1015","article-title":"Multilingual hierarchical attention networks for document classification","volume-title":"IJCNLP (1)","author":"Pappas","year":"2017"},{"key":"2022090113562945500_bib42","doi-asserted-by":"publisher","first-page":"1532","DOI":"10.3115\/v1\/D14-1162","article-title":"GloVe: Global vectors for word representation","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington","year":"2014"},{"key":"2022090113562945500_bib43","doi-asserted-by":"publisher","first-page":"1499","DOI":"10.18653\/v1\/D18-1179","article-title":"Dissecting contextual word embeddings: Architecture and representation","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Peters","year":"2018"},{"key":"2022090113562945500_bib44","doi-asserted-by":"publisher","first-page":"2227","DOI":"10.18653\/v1\/N18-1202","article-title":"Deep contextualized word representations","volume-title":"Proceedings of NAACL-HLT","author":"Peters","year":"2018"},{"key":"2022090113562945500_bib45","doi-asserted-by":"publisher","first-page":"4996","DOI":"10.18653\/v1\/P19-1493","article-title":"How multilingual is Multilingual BERT?","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Pires","year":"2019"},{"issue":"3","key":"2022090113562945500_bib46","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1162\/coli_a_00357","article-title":"Modeling language variation and universals: A survey on typological linguistics for natural language processing","volume":"45","author":"Ponti","year":"2019","journal-title":"Computational Linguistics"},{"key":"2022090113562945500_bib47","doi-asserted-by":"publisher","first-page":"1531","DOI":"10.18653\/v1\/P18-1142","article-title":"Isomorphic transfer of syntactic structures in cross-lingual NLP","volume-title":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Ponti","year":"2018"},{"key":"2022090113562945500_bib48","doi-asserted-by":"publisher","first-page":"1478","DOI":"10.18653\/v1\/P16-1140","article-title":"Investigating language universal and specific properties in word embeddings","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Qian","year":"2016"},{"key":"2022090113562945500_bib49","first-page":"37","article-title":"Multilingual probing of deep pre-trained contextual encoders","volume-title":"Proceedings of the First NLPL Workshop on Deep Learning for Natural Language Processing","author":"Ravishankar","year":"2019"},{"key":"2022090113562945500_bib50","doi-asserted-by":"publisher","first-page":"156","DOI":"10.18653\/v1\/W19-4318","article-title":"Probing multilingual sentence representations with X-Probe","volume-title":"Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019)","author":"Ravishankar","year":"2019"},{"issue":"2","key":"2022090113562945500_bib51","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1162\/coli_a_00376","article-title":"LINSPECTOR: Multilingual probing tasks for word representations","volume":"46","author":"\u015eahin","year":"2020","journal-title":"Computational Linguistics"},{"key":"2022090113562945500_bib52","doi-asserted-by":"publisher","first-page":"47","DOI":"10.18653\/v1\/D19-6106","article-title":"BERT is not an interlingua and the bias of tokenization","volume-title":"Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019)","author":"Singh","year":"2019"},{"key":"2022090113562945500_bib53","doi-asserted-by":"publisher","first-page":"354","DOI":"10.3115\/1219840.1219884","article-title":"Contrastive estimation: Training log-linear models on unlabeled data","volume-title":"Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics","author":"Smith","year":"2005"},{"key":"2022090113562945500_bib54","first-page":"1061","article-title":"Target language adaptation of discriminative transfer parsers","volume-title":"The 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"T\u00e4ckstr\u00f6m","year":"2013"},{"key":"2022090113562945500_bib55","doi-asserted-by":"publisher","first-page":"4593","DOI":"10.18653\/v1\/P19-1452","article-title":"BERT rediscovers the classical NLP pipeline","volume-title":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","author":"Tenney","year":"2019"},{"key":"2022090113562945500_bib56","article-title":"What do you learn from context? Probing for sentence structure in contextualized word representations","volume-title":"7th International Conference on Learning Representations, ICLR 2019","author":"Tenney","year":"2019"},{"key":"2022090113562945500_bib57","first-page":"340","article-title":"Cross-lingual dependency parsing with universal dependencies and predicted POS labels","volume-title":"Proceedings of the Third International Conference on Dependency Linguistics (Depling 2015)","author":"Tiedemann","year":"2015"},{"key":"2022090113562945500_bib58","doi-asserted-by":"publisher","first-page":"130","DOI":"10.3115\/v1\/W14-1614","article-title":"Treebank translation for cross-lingual parser induction","volume-title":"Eighteenth Conference on Computational Natural Language Learning (CoNLL 2014)","author":"Tiedemann","year":"2014"},{"key":"2022090113562945500_bib59","doi-asserted-by":"publisher","first-page":"281","DOI":"10.18653\/v1\/D19-6132","article-title":"Zero-shot dependency parsing with pre-trained multilingual sentence representations","volume-title":"Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019)","author":"Tran","year":"2019"},{"key":"2022090113562945500_bib60","doi-asserted-by":"publisher","first-page":"9090","DOI":"10.1609\/aaai.v34i05.6443","article-title":"A comparison of architectures and pretraining methods for contextualized multilingual word embeddings","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"van der Heijden","year":"2020"},{"key":"2022090113562945500_bib61","doi-asserted-by":"crossref","first-page":"4438","DOI":"10.18653\/v1\/2020.emnlp-main.359","article-title":"On negative interference in multilingual language models","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Wang","year":"2020"},{"key":"2022090113562945500_bib62","doi-asserted-by":"publisher","first-page":"833","DOI":"10.18653\/v1\/D19-1077","article-title":"Beto, Bentz, Becas: The surprising cross-lingual effectiveness of BERT","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Wu","year":"2019"},{"key":"2022090113562945500_bib63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3115\/1072133.1072187","article-title":"Inducing multilingual text analysis tools via robust projection across aligned corpora","volume-title":"Proceedings of the First International Conference on Human Language Technology Research","author":"Yarowsky","year":"2001"},{"key":"2022090113562945500_bib64","article-title":"Learning and evaluating general linguistic intelligence","author":"Yogatama","year":"2019","journal-title":"arXiv preprint arXiv:1901.11373"},{"key":"2022090113562945500_bib65","first-page":"35","article-title":"Cross-language parser adaptation between related languages","volume-title":"Proceedings of the IJCNLP-08 Workshop on NLP for Less Privileged Languages","author":"Zeman","year":"2008"},{"key":"2022090113562945500_bib66","doi-asserted-by":"publisher","first-page":"1307","DOI":"10.18653\/v1\/N16-1156","article-title":"Ten pairs to tag\u2013multilingual POS tagging via coarse mapping between embeddings","volume-title":"Proceedings of NAACL-HLT","author":"Zhang","year":"2016"},{"key":"2022090113562945500_bib67","first-page":"1368","article-title":"Learning to map into a universal POS tagset","volume-title":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning","author":"Zhang","year":"2012"},{"key":"2022090113562945500_bib68","first-page":"1426","article-title":"A subspace learning framework for cross-lingual sentiment classification with partial parallel data","volume-title":"Twenty-Fourth International Joint Conference on Artificial Intelligence","author":"Zhou","year":"2015"},{"key":"2022090113562945500_bib69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2838931.2838936","article-title":"Integrating and evaluating neural word embeddings in information retrieval","volume-title":"Proceedings of the 20th Australasian Document Computing Symposium","author":"Zuccon","year":"2015"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/coli\/article-pdf\/48\/3\/635\/2040464\/coli_a_00444.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/coli\/article-pdf\/48\/3\/635\/2040464\/coli_a_00444.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T13:57:27Z","timestamp":1662040647000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/48\/3\/635\/110573\/Investigating-Language-Relationships-in"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"references-count":69,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,9,1]]},"published-print":{"date-parts":[[2022,9,1]]}},"URL":"https:\/\/doi.org\/10.1162\/coli_a_00444","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022]]},"published":{"date-parts":[[2022]]}}}