{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T16:25:24Z","timestamp":1775665524604,"version":"3.50.1"},"reference-count":57,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:p> We quantify the linguistic complexity of different languages\u2019 morphological systems. We verify that there is a statistically significant empirical trade-off between paradigm size and irregularity: A language\u2019s inflectional paradigms may be either large in size or highly irregular, but never both. We define a new measure of paradigm irregularity based on the conditional entropy of the surface realization of a paradigm\u2014 how hard it is to jointly predict all the word forms in a paradigm from the lemma. We estimate irregularity by training a predictive model. Our measurements are taken on large morphological paradigms from 36 typologically diverse languages. <\/jats:p>","DOI":"10.1162\/tacl_a_00271","type":"journal-article","created":{"date-parts":[[2019,6,19]],"date-time":"2019-06-19T17:40:02Z","timestamp":1560966002000},"page":"327-342","source":"Crossref","is-referenced-by-count":23,"title":["On the Complexity and Typology of Inflectional Morphological Systems"],"prefix":"10.1162","volume":"7","author":[{"given":"Ryan","family":"Cotterell","sequence":"first","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University."}]},{"given":"Christo","family":"Kirov","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University."}]},{"given":"Mans","family":"Hulden","sequence":"additional","affiliation":[{"name":"Department of Linguistics, University of Colorado."}]},{"given":"Jason","family":"Eisner","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University."}]}],"member":"281","reference":[{"issue":"3","key":"bib1","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1353\/lan.2013.0054","volume":"89","author":"Ackerman Farrell","year":"2013","journal-title":"Language"},{"key":"bib3","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511586262","volume-title":"A-Morphous Morphology","volume":"62","author":"Anderson Stephen R.","year":"1992"},{"key":"bib4","series-title":"Linguistic Inquiry Monographs","volume-title":"Word Formation in Generative Grammar","author":"Aronoff Mark","year":"1976"},{"key":"bib5","series-title":"Oxford Handbooks in Linguistic. Part II: Paradigms and their Variants","doi-asserted-by":"crossref","DOI":"10.1093\/oxfordhb\/9780199591428.001.0001","volume-title":"The Oxford Handbook of Inflection","author":"Baerman Matthew","year":"2015"},{"key":"bib6","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780198723769.001.0001","volume-title":"Understanding and measuring morphological complexity","author":"Baerman Matthew","year":"2015"},{"key":"bib7","volume-title":"Proceedings of ICLR","author":"Bahdanau Dzmitry","year":"2015"},{"key":"bib8","first-page":"69","volume-title":"Proceedings of the 26th West Coast Conference on Formal Linguistics","author":"Bane Max","year":"2008"},{"issue":"2","key":"bib9","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1080\/00437956.1958.11659661","volume":"14","author":"Berko Jean","year":"1958","journal-title":"Word"},{"key":"bib10","volume-title":"Language","author":"Bloomfield Leonard","year":"1933"},{"issue":"2","key":"bib11","doi-asserted-by":"crossref","first-page":"156","DOI":"10.3366\/word.2016.0092","volume":"9","author":"Bonami Olivier","year":"2016","journal-title":"Word Structure"},{"key":"bib12","first-page":"887","volume-title":"Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)","author":"Bouchard-C\u00f4t\u00e9 Alexandre","year":"2007"},{"issue":"1","key":"bib13","first-page":"31","volume":"18","author":"Brown Peter F.","year":"1992","journal-title":"Computational Linguistics"},{"key":"bib14","volume-title":"The Evolution of Morphology","volume":"14","author":"Carstairs-McCarthy Andrew","year":"2010"},{"issue":"3","key":"bib15","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1109\/TIT.1968.1054142","volume":"14","author":"Chow C. K.","year":"1968","journal-title":"IEEE Transactions on Information Theory"},{"key":"bib16","author":"Cotterell Ryan","year":"2018","journal-title":"arXiv:1804.08262v1"},{"key":"bib17","first-page":"1","volume-title":"Proceedings of the CoNLL SIGMORPHON 2018 Shared Task: Universal Morphological Reinflection","author":"Cotterell Ryan","year":"2018"},{"key":"bib18","volume-title":"Proceedings of the CoNLL-SIGMORPHON 2017 Shared Task: Universal Morphological Reinflection","author":"Cotterell Ryan","year":"2017"},{"key":"bib19","doi-asserted-by":"crossref","first-page":"10","DOI":"10.18653\/v1\/W16-2002","volume-title":"Proceedings of the 14th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology","author":"Cotterell Ryan","year":"2016"},{"key":"bib20","first-page":"625","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL)","author":"Cotterell Ryan","year":"2014"},{"key":"bib21","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00149"},{"key":"bib22","first-page":"759","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL)","author":"Cotterell Ryan","year":"2017"},{"key":"bib23","first-page":"725","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Cotterell Ryan","year":"2017"},{"key":"bib24","first-page":"101","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Dreyer Markus","year":"2009"},{"key":"bib25","first-page":"616","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Dreyer Markus","year":"2011"},{"key":"bib26","first-page":"1080","volume-title":"Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Dreyer Markus","year":"2008"},{"issue":"4","key":"bib27","doi-asserted-by":"crossref","first-page":"233","DOI":"10.6028\/jres.071B.032","volume":"71","author":"Edmonds Jack","year":"1967","journal-title":"Journal of Research of the National Bureau of Standards B"},{"issue":"2","key":"bib28","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1017\/S0332586500003000","volume":"17","author":"Gil David","year":"1994","journal-title":"Nordic Journal of Linguistics"},{"issue":"1","key":"bib29","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/0010-0277(94)00655-5","volume":"56","author":"Hare Mary","year":"1995","journal-title":"Cognition"},{"key":"bib30","volume-title":"A Course In Modern Linguistics","author":"Hockett Charles F.","year":"1958"},{"key":"bib31","first-page":"555","volume-title":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL)","author":"Kann Katharina","year":"2016"},{"key":"bib32","volume-title":"Phonology in Generative Grammar","author":"Kenstowicz Michael J.","year":"1994"},{"key":"bib33","first-page":"455","volume-title":"The Handbook of Morphology","author":"Kibrik Aleksandr E.","year":"1998"},{"key":"bib34","volume-title":"Proceedings of LREC 2018","author":"Kirov Christo","year":"2018"},{"key":"bib35","doi-asserted-by":"crossref","first-page":"67","DOI":"10.18653\/v1\/P17-4012","volume-title":"Proceedings of ACL 2017, System Demonstrations","author":"Klein Guillaume","year":"2017"},{"issue":"4","key":"bib36","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/BF02478259","volume":"5","author":"McCulloch Warren S.","year":"1943","journal-title":"Bulletin of Mathematical Biophysics"},{"issue":"2","key":"bib37","first-page":"125","volume":"5","author":"McWhorter John","year":"2001","journal-title":"Linguistic Typology"},{"key":"bib38","unstructured":"Yoon Mi Oh. 2015. Linguistic Complexity and Information: Quantitative Approaches. Ph.D. thesis, Universit\u00e9 de Lyon, France."},{"key":"bib39","volume-title":"Probabilistic Automata","author":"Paz Azaria","year":"2003"},{"issue":"3","key":"bib40","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1353\/lan.2011.0057","volume":"87","author":"Pellegrino Fran\u00e7ois","year":"2011","journal-title":"Language"},{"issue":"1","key":"bib41","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/0010-0277(88)90032-7","volume":"28","author":"Pinker Steven","year":"1988","journal-title":"Cognition"},{"key":"bib42","first-page":"19","volume-title":"Proceedings of the 8th Symposium on English and Greek Linguistics","author":"Ralli Angela","year":"1994"},{"issue":"3","key":"bib43","first-page":"519","volume":"40","author":"Ralli Angela","year":"2002","journal-title":"Linguistics"},{"key":"bib44","volume-title":"Language Computation","author":"Rissanen Jorma","year":"1994"},{"key":"bib45","doi-asserted-by":"crossref","DOI":"10.4324\/9781315843186","volume-title":"A Short History of Linguistics","author":"Robins Robert Henry","year":"2013"},{"key":"bib46","volume-title":"Computational Approaches to Morphological Complexity","author":"Sagot Beno\u00eet","year":"2013"},{"key":"bib47","volume-title":"Language: An Introduction to the Study of Speech","author":"Sapir Edward","year":"1921"},{"key":"bib48","volume":"27","author":"Shannon Claude E.","year":"1948","journal-title":"Bell Systems Technical Journal"},{"issue":"6","key":"bib49","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/0893-9659(91)90080-F","volume":"4","author":"Siegelmann Hava T.","year":"1991","journal-title":"Applied Mathematics Letters"},{"issue":"1","key":"bib50","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1006\/jcss.1995.1013","volume":"50","author":"Siegelmann Hava T.","year":"1995","journal-title":"Journal of Computer and System Sciences"},{"key":"bib51","author":"Smith Kenny","year":"2008","journal-title":"Philosophical Transactions B"},{"key":"bib52","doi-asserted-by":"crossref","DOI":"10.4135\/9781544308562","volume-title":"The Cognitive Sciences: An Interdisciplinary Approach","author":"Sobel Carolyn P.","year":"2013"},{"key":"bib53","volume-title":"Morphological Theory: An Introduction to Word Structure in Generative Grammar","author":"Spencer Andrew","year":"1991"},{"key":"bib54","doi-asserted-by":"crossref","DOI":"10.1524\/9783050059587","volume-title":"Irregularity in Morphology (and beyond)","volume":"11","author":"Stolz Thomas","year":"2012"},{"key":"bib55","first-page":"3104","volume-title":"Advances in Neural Information Processing Systems (NIPS)","author":"Sutskever Ilya","year":"2014"},{"key":"bib56","unstructured":"John Sylak-Glassman. 2016, The composition and use of the universal morphological feature schema (Unimorph schema). Johns Hopkins University."},{"key":"bib57","first-page":"674","volume-title":"Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (ACL)","author":"Sylak-Glassman John","year":"2015"},{"key":"bib58","author":"Zeiler Matthew D.","year":"2012","journal-title":"arXiv:1212.5701v1"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00271","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:23Z","timestamp":1615585163000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43492"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11]]},"references-count":57,"alternative-id":["10.1162\/tacl_a_00271"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00271","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11]]}}}