{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T07:47:36Z","timestamp":1787125656166,"version":"build-2736575974"},"reference-count":54,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,1,11]],"date-time":"2020-01-11T00:00:00Z","timestamp":1578700800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Does systematic covariation in the usage patterns of forms shape the sublexical variance observed in conversational speech? We address this question in terms of a recently proposed discriminative theory of human communication that argues that the distribution of events in communicative contexts should maintain mutual predictability between language users, present evidence that the distributions of words in the empirical contexts in which they are learned and used are geometric, and thus support this. Here, we extend this analysis to a corpus of conversational English, showing that the distribution of grammatical regularities and the sub-distributions of tokens discriminated by them are also geometric. Further analyses reveal a range of structural differences in the distribution of types in parts of speech categories that further support the suggestion that linguistic distributions (and codes) are subcategorized by context at multiple levels of abstraction. Finally, a series of analyses of the variation in spoken language reveals that quantifiable differences in the structure of lexical subcategories appears in turn to systematically shape sublexical variation in speech signal.<\/jats:p>","DOI":"10.3390\/e22010090","type":"journal-article","created":{"date-parts":[[2020,1,13]],"date-time":"2020-01-13T04:05:51Z","timestamp":1578888351000},"page":"90","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["How the Probabilistic Structure of Grammatical Context Shapes Speech"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3538-5698","authenticated-orcid":false,"given":"Maja","family":"Linke","sequence":"first","affiliation":[{"name":"Department of Linguistics, University of Tuebingen, Wilhelmstra\u00dfe 19, 72074 Tuebingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Ramscar","sequence":"additional","affiliation":[{"name":"Department of Linguistics, University of Tuebingen, Wilhelmstra\u00dfe 19, 72074 Tuebingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,11]]},"reference":[{"key":"ref_1","first-page":"927","article-title":"Against Formal Phonology","volume":"81","author":"Port","year":"2016","journal-title":"Linguist. Soc. Am."},{"key":"ref_2","first-page":"58","article-title":"How spoken languages work in the absence of an inventory of discrete units","volume":"53","author":"Ramscar","year":"2016","journal-title":"Lang. Commun."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ramscar, M. (2019). Source codes in human communication. arXiv.","DOI":"10.31234\/osf.io\/e3hps"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1016\/j.cognition.2011.10.009","article-title":"Granularity and the acquisition of grammatical gender: How order-of-acquisition affects what gets learned","volume":"122","author":"Arnon","year":"2012","journal-title":"Cognition"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1111\/tops.12078","article-title":"The myth of cognitive decline: Non-linear dynamics of lifelong learning","volume":"6","author":"Ramscar","year":"2014","journal-title":"Top. Cogn. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Scribner, S., and Cole, M. (1981). The Psychology of Literacy, Harvard University Press.","DOI":"10.4159\/harvard.9780674433014"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"245","DOI":"10.3109\/02699200903532524","article-title":"Deconstructing phonetic transcription: Covert contrast, perceptual bias, and an extraterrestrial view of Vox Humana","volume":"24","author":"Munson","year":"2010","journal-title":"Clin. Linguist. Phonics"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1080\/00107510500052444","article-title":"Power Laws, Pareto Distributions and Zipf\u2019s Law","volume":"46","author":"Newman","year":"2005","journal-title":"Contemp. Phys."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1002\/j.1538-7305.1928.tb01236.x","article-title":"Transmission of Information","volume":"7","author":"Hartley","year":"1928","journal-title":"Bell Syst. Tech. J."},{"key":"ref_11","unstructured":"Ramscar, M. (2019). The empirical structure of word frequency distributions. arXiv, in press."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Blevins, J.P., Ackerman, F., Malouf, R., and Ramscar, M. (2016). Morphology as an adaptive discriminative system. Morphological Metatheory, John Benjamins Publishing.","DOI":"10.1075\/la.229.10ble"},{"key":"ref_13","unstructured":"McDonald, S., and Ramscar, M. (2001, January 1\u20134). Testing the distributioanl hypothesis: The influence of context on judgements of semantic similarity. Proceedings of the Annual Meeting of the Cognitive Science Society, Edinburgh, UK."},{"key":"ref_14","unstructured":"Levin, B. (1995). English Verb Classes and Alternations: A Preliminary Investigation, University of Chicago Press."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5720","DOI":"10.1073\/pnas.1800708115","article-title":"Nouns slow down speech across structurally and culturally diverse languages","volume":"115","author":"Seifart","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1006\/brln.2001.2514","article-title":"The Recognition of Reduced Word Forms","volume":"81","author":"Ernestus","year":"2002","journal-title":"Brain Lang."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.jml.2018.01.001","article-title":"The phonetic specificity of contrastive hyperarticulation in natural speech","volume":"100","author":"Wedel","year":"2018","journal-title":"J. Mem. Lang."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.jml.2008.06.003","article-title":"Predictability effects on durations of content and function words in conversational English","volume":"60","author":"Bell","year":"2009","journal-title":"J. Mem. Lang."},{"key":"ref_19","unstructured":"van Son, R.J.J.H., and Pols, L.C.W. (2003, January 3\u20139). An Acoustic Model of Communicative Efficiency in Consonants and Vowels taking into Account Context Distinctiveness. Proceedings of the International Congress of Phonetic Sciences (ICPhS), Barcelona, Spain."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e43","DOI":"10.1353\/lan.2018.0012","article-title":"The redundancy of self-organization as an explanation of english spelling","volume":"94","author":"Sampson","year":"2018","journal-title":"Language"},{"key":"ref_21","unstructured":"Popper, K. (2013). The Logic and Evolution of Scientific Discovery, Routledge."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1515\/LANGCOG.2009.008","article-title":"Syntactic probabilities affect pronunciation variation in spontaneous speech","volume":"1","author":"Tily","year":"2009","journal-title":"Lang. Cogn."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/S0010-0277(03)00139-2","article-title":"The role of prosodic boundaries in the resolution of lexical embedding in speech comprehension","volume":"90","author":"Salverda","year":"2003","journal-title":"Cognition"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"430","DOI":"10.3758\/BF03193061","article-title":"Prosodic cues for morphological complexity: The case of Dutch plural nouns","volume":"33","author":"Kemps","year":"2005","journal-title":"Mem. Cogn."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1023\/A:1021980931292","article-title":"Disfluencies signal theee, um, new information","volume":"32","author":"Arnold","year":"2003","journal-title":"J. Psycholinguist. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1037\/0278-7393.33.5.914","article-title":"If you say thee uh you are describing something hard: The on-line attribution of disfluency during reference comprehension","volume":"33","author":"Arnold","year":"2007","journal-title":"J. Exp. Psychol. Learn. Mem. Cogn."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1177\/0265532212455394","article-title":"What makes speech sound fluent? The contributions of pauses, speed and repairs","volume":"30","author":"Bosker","year":"2013","journal-title":"Lang. Test."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.jml.2014.05.004","article-title":"Native \u2018um\u2019s elicit prediction of low-frequency referents, but non-native \u2018um\u2019s do not","volume":"75","author":"Bosker","year":"2014","journal-title":"J. Mem. Lang."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.jml.2011.03.004","article-title":"The disfluent discourse: Effects of filled pauses on recall","volume":"65","author":"Fraundorf","year":"2011","journal-title":"J. Mem. Lang."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1016\/j.csl.2013.08.003","article-title":"The listening talker: A review of human and algorithmic context-induced modifications of speech","volume":"28","author":"Cooke","year":"2014","journal-title":"Comput. Speech Lang."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1111\/tops.12316","article-title":"Alternative solutions to a language design problem: The role of adjectives and gender marking in efficient communication","volume":"10","author":"Dye","year":"2018","journal-title":"Top. Cogn. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.specom.2004.09.001","article-title":"The Buckeye corpus of conversational speech: Labeling conventions and a test of transcriber reliability","volume":"45","author":"Pitt","year":"2005","journal-title":"Speech Commun."},{"key":"ref_33","unstructured":"Dilts, P.C. (2013). Modelling Phonetic Reduction in a Corpus of Spoken English Using Random Forests and Mixed-Effects Regression. [Ph.D. Thesis, University of Alberta]."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1142\/S021812741002596X","article-title":"The structure of phonological networks across multiple languages","volume":"20","author":"Arbesman","year":"2010","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wood, S.N. (2017). Generalized Additive Models, Chapman & Hall\/CRC.","DOI":"10.1201\/9781315370279"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.2307\/2532444","article-title":"Exploring the nature of covariate effects in the proportional hazards model","volume":"46","author":"Hastie","year":"1990","journal-title":"Biometrics"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Collins, M. (2002). Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms. Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing\u2014Volume 10, Association for Computational Linguistics.","DOI":"10.3115\/1118693.1118694"},{"key":"ref_38","first-page":"31","article-title":"Grammatical category disambiguation by statistical optimization","volume":"14","author":"DeRose","year":"1988","journal-title":"Comput. Linguist."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1111\/j.1756-8765.2008.01009.x","article-title":"Children\u2019s grammars grow more abstract with age\u2014Evidence from an automatic procedure for identifying the productive units of language","volume":"1","author":"Borensztajn","year":"2009","journal-title":"Top. Cogn. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Sampson, G., Gil, D., and Trudgill, P. (2009). How much grammar does it take to sail a boat?. Language Complexity as an Evolving Variable, Oxford University Press.","DOI":"10.1093\/oso\/9780199545216.001.0001"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"9419","DOI":"10.1073\/pnas.1405984111","article-title":"The civilizing process in London\u2019 s Old Bailey","volume":"111","author":"Klingenstein","year":"2014","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Baayen, R.H. (2001). Word Frequency Distributions, Kluwer Academic Publishers.","DOI":"10.1007\/978-94-010-0844-0"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1515\/cllt-2014-0009","article-title":"Zipf\u2019s law and the grammar of languages: A quantitative study of Old and Modern English parallel texts","volume":"10","author":"Bentz","year":"2014","journal-title":"Corpus Linguist. Linguist. Theory"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1112","DOI":"10.3758\/s13423-014-0585-6","article-title":"Zipf\u2019s word frequency law in natural language: A critical review and future directions","volume":"21","author":"Piantadosi","year":"2014","journal-title":"Psychon. Bull. Rev."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Genzel, D., and Charniak, E. (2002, January 7\u201312). Entropy rate constancy in text. Proceedings of the 40th Annual Meeting on Association For Computational Linguistics, Philadelphia, PA, USA.","DOI":"10.3115\/1073083.1073117"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1093\/llc\/fqq018","article-title":"The Corpus of Contemporary American English as the first reliable monitor corpus of English","volume":"25","author":"Davies","year":"2010","journal-title":"Lit. Linguist. Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.jml.2016.12.002","article-title":"Cognitive load makes speech sound fast, but does not modulate acoustic context effects","volume":"94","author":"Bosker","year":"2017","journal-title":"J. Mem. Lang."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"3728","DOI":"10.1121\/1.418332","article-title":"Articulatory strengthening at the edges of prosodic domains","volume":"101","author":"Fougeron","year":"1997","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_49","first-page":"171","article-title":"How efficient is speech?","volume":"25","author":"Pols","year":"2003","journal-title":"Proc. Inst. Phon. Sci."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1177\/0023830913489096","article-title":"Functional Load and the Lexicon: Evidence that Syntactic Category and Frequency Relationships in Minimal Lemma Pairs Predict the Loss of Phoneme contrasts in Language Change","volume":"56","author":"Wedel","year":"2013","journal-title":"Lang. Speech"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"3526","DOI":"10.1073\/pnas.1012551108","article-title":"Word lengths are optimized for efficient communication","volume":"108","author":"Piantadosi","year":"2011","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1075\/ml.9.3.01arn","article-title":"Time and again: The changing effect of word and multiword frequency on phonetic duration for highly frequent sequences","volume":"9","author":"Arnon","year":"2015","journal-title":"Ment. Lex."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"267","DOI":"10.3758\/BF03204386","article-title":"Spoken word recognition processes and the gating paradigm","volume":"28","author":"Grosjean","year":"1980","journal-title":"Percept. Psychophys."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"180","DOI":"10.3758\/BF03333798","article-title":"Can semantic constraint reduce the role of word frequency during spoken-word recognition?","volume":"22","author":"Grosjean","year":"1984","journal-title":"Bull. Psychon. Soc."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/90\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:19:32Z","timestamp":1760361572000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/1\/90"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,11]]},"references-count":54,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,1]]}},"alternative-id":["e22010090"],"URL":"https:\/\/doi.org\/10.3390\/e22010090","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,11]]}}}