{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,16]],"date-time":"2024-07-16T00:19:34Z","timestamp":1721089174412},"reference-count":75,"publisher":"MIT Press","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2019,6]]},"abstract":"<jats:p>We borrow the concept of representation learning from deep learning research, and we argue that the quest for Greenbergian implicational universals can be reformulated as the learning of good latent representations of languages, or sequences of surface typological features. By projecting languages into latent representations and performing inference in the latent space, we can handle complex dependencies among features in an implicit manner. The most challenging problem in turning the idea into a concrete computational model is the alarmingly large number of missing values in existing typological databases. To address this problem, we keep the number of model parameters relatively small to avoid overfitting, adopt the Bayesian learning framework for its robustness, and exploit phylogenetically and\/or spatially related languages as additional clues. Experiments show that the proposed model recovers missing values more accurately than others and that some latent variables exhibit phylogenetic and spatial signals comparable to those of surface features.<\/jats:p>","DOI":"10.1162\/coli_a_00346","type":"journal-article","created":{"date-parts":[[2019,3,20]],"date-time":"2019-03-20T18:09:55Z","timestamp":1553105395000},"page":"199-228","source":"Crossref","is-referenced-by-count":3,"title":["Bayesian Learning of Latent Representations of Language Structures"],"prefix":"10.1162","volume":"45","author":[{"given":"Yugo","family":"Murawaki","sequence":"first","affiliation":[{"name":"Kyoto University, Graduate School of Informatics."}]}],"member":"281","reference":[{"key":"bib1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-linguistics-011415-040735"},{"key":"bib2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0141287"},{"key":"bib3","volume-title":"The Atoms of Language: The Mind\u2019s Hidden Rules of Grammar","author":"Baker Mark C.","year":"2001"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1515\/lingty-2016-0035"},{"key":"bib5","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"bib6","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1974.tb00999.x"},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-017-0192-4"},{"key":"bib9","first-page":"155","volume-title":"Treebanks: Building and Using Parsed Corpora","author":"Boeckx Cedric","year":"2014"},{"key":"bib10","doi-asserted-by":"publisher","DOI":"10.1126\/science.1219669"},{"key":"bib11","doi-asserted-by":"publisher","DOI":"10.1016\/B0-08-044854-2\/00177-2"},{"key":"bib12","doi-asserted-by":"publisher","DOI":"10.1353\/lan.2015.0005"},{"key":"bib13","first-page":"2172","volume-title":"Advances in Neural Information Processing Systems 29","author":"Chen Xi","year":"2016"},{"key":"bib14","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1515\/9783110095869.1.9.506","volume-title":"Syntax: An International Handbook of Contemporary Research","volume":"1","author":"Chomsky Noam","year":"1993"},{"key":"bib15","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511840579"},{"key":"bib16","doi-asserted-by":"publisher","DOI":"10.1515\/lity.2003.013"},{"key":"bib17","first-page":"593","volume-title":"Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics","author":"Daum\u00e9 III Hal","year":"2009"},{"key":"bib18","first-page":"65","volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics","author":"Daum\u00e9 III Hal","year":"2007"},{"key":"bib19","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2010.1595"},{"key":"bib20","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1103"},{"issue":"2","key":"bib21","first-page":"123","volume":"33","author":"Dryer Matthew S.","year":"1998","journal-title":"Chicago Linguistic Society"},{"key":"bib22","doi-asserted-by":"publisher","DOI":"10.1075\/sl.13.2.03dry"},{"key":"bib23","doi-asserted-by":"publisher","DOI":"10.1515\/lity.2011.024"},{"key":"bib24","doi-asserted-by":"publisher","DOI":"10.1038\/nature09923"},{"key":"bib25","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.anthro.34.081804.120406"},{"key":"bib26","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1030"},{"key":"bib27","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2009.03.008"},{"key":"bib28","first-page":"744","volume-title":"Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics","author":"Goldwater Sharon","year":"2007"},{"key":"bib29","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1145\/1143844.1143890","volume-title":"Proceedings of the 23rd International Conference on Machine Learning","author":"G\u00f6r\u00fcr Dilan","year":"2006"},{"key":"bib30","doi-asserted-by":"publisher","DOI":"10.1038\/nature02029"},{"key":"bib31","first-page":"73","volume-title":"Universals of Language","author":"Greenberg Joseph H.","year":"1963"},{"key":"bib32","first-page":"61","volume-title":"Universals of Human Language","volume":"1","author":"Greenberg Joseph H.","year":"1978"},{"key":"bib33","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2010.0051"},{"key":"bib34","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1700388114"},{"key":"bib35","first-page":"1185","volume":"12","author":"Griffiths Thomas L.","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"bib36","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.114.2.211"},{"key":"bib38","doi-asserted-by":"publisher","DOI":"10.1075\/la.132.04has"},{"key":"bib39","volume-title":"The World Atlas of Language Structures","author":"Haspelmath Martin","year":"2005"},{"key":"bib40","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199227761.001.0001","volume-title":"The Genesis of Grammar: A Reconstruction","author":"Heine Bernd","year":"2007"},{"key":"bib41","doi-asserted-by":"publisher","DOI":"10.1162\/089976602760128018"},{"key":"bib42","doi-asserted-by":"publisher","DOI":"10.1126\/science.1127647"},{"key":"bib43","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(91)90009-T"},{"key":"bib44","doi-asserted-by":"publisher","DOI":"10.1016\/j.physd.2004.09.006"},{"key":"bib45","doi-asserted-by":"publisher","DOI":"10.1214\/088342305000000016"},{"key":"bib46","doi-asserted-by":"publisher","DOI":"10.1007\/s00357-012-9097-0"},{"key":"bib47","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74494-8_48"},{"key":"bib48","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"bib49","doi-asserted-by":"publisher","DOI":"10.1080\/00949650902882162"},{"key":"bib50","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1319042111"},{"key":"bib51","first-page":"977","volume-title":"Advances in Neural Information Processing Systems","volume":"19","author":"Meeds Edward","year":"2007"},{"key":"bib52","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/93.2.451"},{"key":"bib53","doi-asserted-by":"publisher","DOI":"10.1016\/0304-4076(86)90002-3"},{"key":"bib54","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/N15-1036"},{"key":"bib55","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1158"},{"key":"bib56","first-page":"451","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)","author":"Murawaki Yugo","year":"2017"},{"key":"bib57","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1468"},{"key":"bib58","doi-asserted-by":"publisher","DOI":"10.1093\/jole\/lzx022"},{"key":"bib59","first-page":"359","volume-title":"Proceedings of the Twenty-Second Conference on Uncertainty in Artificial Intelligence","author":"Murray Iain","year":"2006"},{"key":"bib60","first-page":"629","volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Naseem Tahira","year":"2012"},{"key":"bib61","doi-asserted-by":"publisher","DOI":"10.1201\/b10905-6"},{"key":"bib62","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2010.1917"},{"key":"bib63","doi-asserted-by":"publisher","DOI":"10.7208\/chicago\/9780226580593.001.0001"},{"key":"bib64","doi-asserted-by":"publisher","DOI":"10.1075\/cilt.124.27nic"},{"key":"bib65","first-page":"1297","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers","author":"O\u2019Horan Helen","year":"2016"},{"key":"bib66","doi-asserted-by":"publisher","DOI":"10.1086\/503444"},{"key":"bib67","doi-asserted-by":"publisher","DOI":"10.1524\/stuf.2008.0023"},{"key":"bib68","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781107294332"},{"key":"bib69","volume-title":"Optimality Theory: Constraint Interaction in Generative Grammar","author":"Prince Alan","year":"2008"},{"key":"bib70","doi-asserted-by":"publisher","DOI":"10.3102\/1076998613480394"},{"key":"bib71","first-page":"1329","volume-title":"Proceedings of the 17th International Conference on Neural Information Processing Systems","author":"Srebro Nathan","year":"2005"},{"key":"bib72","doi-asserted-by":"publisher","DOI":"10.1128\/mSystems.00025-15"},{"key":"bib73","doi-asserted-by":"publisher","DOI":"10.1007\/s12110-012-9142-z"},{"key":"bib74","first-page":"17","volume-title":"Acts of the First International Congress of Linguists","author":"Trubetzkoy Nikolai Sergeevich","year":"1928"},{"key":"bib75","doi-asserted-by":"publisher","DOI":"10.1515\/ling.1995.33.4.741"},{"key":"bib76","first-page":"681","volume-title":"Proceedings of the 28th International Conference on Machine Learning (ICML-11)","author":"Welling Max","year":"2011"},{"key":"bib77","volume-title":"Temporal Stability of Linguistic Typological Features","author":"Wichmann S\u00f8ren","year":"2009"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/coli_a_00346","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T23:31:19Z","timestamp":1721086279000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/45\/2\/199-228\/1636"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6]]},"references-count":75,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,6]]}},"alternative-id":["10.1162\/coli_a_00346"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00346","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6]]}}}