{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T14:13:30Z","timestamp":1781100810760,"version":"3.54.1"},"reference-count":72,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2023,10,5]],"date-time":"2023-10-05T00:00:00Z","timestamp":1696464000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Registers are situationally defined text varieties, such as letters, essays, or news articles, that are considered to be one of the most important predictors of linguistic variation. Often historical databases of language lack register information, which could greatly enhance their usability (e.g. Early English Books Online). This article examines register variation in Late Modern English and automatic register identification in historical corpora. We model register variation in the corpus of Founding Era American English (COFEA) and develop machine-learning methods for automatic register identification in COFEA. We also extract and analyze the most significant grammatical characteristics estimated by the classifier for the best-predicted registers and found that letters and journals in the 1700s were characterized by informational density. The chosen method enables us to learn more about registers in the Founding Era. We show that some registers can be reliably identified from COFEA, the best overall performance achieved by the deep learning model Bidirectional Encoder Representations from Transformers with an F1-score of 97 per cent. This suggests that deep learning models could be utilized in other studies concerned with historical language and its automatic classification.<\/jats:p>","DOI":"10.1093\/llc\/fqad049","type":"journal-article","created":{"date-parts":[[2023,10,6]],"date-time":"2023-10-06T02:12:58Z","timestamp":1696558378000},"page":"1659-1677","source":"Crossref","is-referenced-by-count":2,"title":["In search of founding era registers: automatic modeling of registers from the corpus of Founding Era American English"],"prefix":"10.1093","volume":"38","author":[{"given":"Liina","family":"Repo","sequence":"first","affiliation":[{"name":"School of Languages and Translation Studies, University of Turku , FI-20014 University of Turku , Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9871-5092","authenticated-orcid":false,"given":"Brett","family":"Hashimoto","sequence":"additional","affiliation":[{"name":"Department of Linguistics, Brigham Young University , Provo, UT 84602, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Veronika","family":"Laippala","sequence":"additional","affiliation":[{"name":"School of Languages and Translation Studies, University of Turku , FI-20014 University of Turku , Finland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,10,5]]},"reference":[{"key":"2023120103525514700_fqad049-B1","first-page":"278","volume-title":"The Adams Papers, Diary of John Quincy Adams","author":"\u201c22d.,\u201d Founders Online, National Archives","year":"1981"},{"key":"2023120103525514700_fqad049-B2","first-page":"197","volume-title":"The Adams Papers, Papers of John Adams","author":"\u201cEnclosure: A Proposal Regarding the Procurement of Powder, 12 October 1775,\u201d Founders Online, National Archives","year":"1979"},{"key":"2023120103525514700_fqad049-B3","first-page":"320","volume-title":"The Papers of Benjamin Franklin","author":"Labaree","year":"1961"},{"key":"2023120103525514700_fqad049-B4","first-page":"812","volume-title":"The Papers of Thomas Jefferson","author":"\u201cTo Thomas Jefferson from Willink, Van Staphorst & Hubbard, 30 December 1791,\u201d Founders Online, National Archives","year":"1997"},{"key":"2023120103525514700_fqad049-B5","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1075\/rs.18015.arg","article-title":"Register in Computational Language Research","volume":"1","author":"Argamon","year":"2019","journal-title":"Register Studies"},{"key":"2023120103525514700_fqad049-B6","first-page":"1","author":"Bahdanau","year":"2015"},{"key":"2023120103525514700_fqad049-B7","first-page":"505","article-title":"Original Meaning and the Establishment Clause: A Corpus Linguistics Analysis","volume":"61","author":"Barclay","year":"2019","journal-title":"Arizona Law Review"},{"key":"2023120103525514700_fqad049-B8","first-page":"509","article-title":"Corpus Evidence Illuminates the Meaning of Bear Arms\u2019","volume":"46","author":"Baron","year":"2019","journal-title":"Hastings Constitutional Law Quarterly"},{"key":"2023120103525514700_fqad049-B9","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511621024","volume-title":"Variation across Speech and Writing","author":"Biber","year":"1988"},{"key":"2023120103525514700_fqad049-B10","first-page":"89","volume-title":"Towards a History of English as a History of Genres","author":"Biber","year":"2001"},{"key":"2023120103525514700_fqad049-B11","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1515\/cllt-2012-0002","article-title":"Register as a Predictor of Linguistic Variation\u2019","volume":"8","author":"Biber","year":"2012","journal-title":"Corpus Linguistics and Linguistic Theory"},{"key":"2023120103525514700_fqad049-B12","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1177\/00754240022004857","article-title":"Historical Change in the Language Use of Women and Men\u2019","volume":"28","author":"Biber","year":"2000","journal-title":"Journal of English Linguistics"},{"key":"2023120103525514700_fqad049-B13","doi-asserted-by":"crossref","DOI":"10.1017\/9781108686136","volume-title":"Register, Genre, and Style","author":"Biber","year":"2019","edition":"2nd edn"},{"key":"2023120103525514700_fqad049-B14","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1177\/0075424216628955","article-title":"Register Variation on the Searchable Web: A Multi-Dimensional Analysis","volume":"44","author":"Biber","year":"2016","journal-title":"Journal of English Linguistics"},{"key":"2023120103525514700_fqad049-B15","doi-asserted-by":"crossref","DOI":"10.1017\/9781316388228","volume-title":"Register Variation Online","author":"Biber","year":"2018"},{"key":"2023120103525514700_fqad049-B16","doi-asserted-by":"crossref","first-page":"487","DOI":"10.2307\/415220","article-title":"Drift and the Evolution of English Style: A History of Three Genres","volume":"65","author":"Biber","year":"1989","journal-title":"Language"},{"key":"2023120103525514700_fqad049-B17","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1515\/9783110877007.688","volume-title":"History of Englishes: New Methods and Interpretations in Historical Linguistics","author":"Biber","year":"1992"},{"key":"2023120103525514700_fqad049-B18","first-page":"253","volume-title":"To Explain the Present: Studies in the Changing English Language in Honour of Matti Rissanen","author":"Biber","year":"1997"},{"key":"2023120103525514700_fqad049-B19","first-page":"1","author":"Biber","year":"1994"},{"key":"2023120103525514700_fqad049-B20","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1177\/0075424212472509","article-title":"Being Specific about Historical Change: The Influence of Sub-Register","volume":"41","author":"Biber","year":"2013","journal-title":"Journal of English Linguistics"},{"key":"2023120103525514700_fqad049-B21","author":"Carpenter v. United States","year":"2018"},{"key":"2023120103525514700_fqad049-B22","first-page":"31","author":"Conneau","year":"2019"},{"key":"2023120103525514700_fqad049-B23","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/S0898-5898(96)90025-X","article-title":"Investigating Academic Texts with Corpus-Based Techniques: An Example from Biology","volume":"8","author":"Conrad","year":"1996","journal-title":"Linguistics and Education"},{"key":"2023120103525514700_fqad049-B24","volume-title":"The Cambridge Encyclopedia of the English Language","author":"Crystal","year":"2003","edition":"2nd edn."},{"key":"2023120103525514700_fqad049-B25","first-page":"465","article-title":"Using Empirical Data to Investigate the Original Meaning of \u201cEmolument\u201d in the Constitution","volume":"36","author":"Cunningham","year":"2020","journal-title":"Georgia State University Law Review"},{"key":"2023120103525514700_fqad049-B26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/frai.2021.609970","article-title":"Register Adaptation vs. Innovation Across Situational Contexts: 18th Century Women in Transition","volume":"4","author":"Degaetano-Ortlieb","year":"2021","journal-title":"Frontiers of Artificial Intelligence"},{"key":"2023120103525514700_fqad049-B27","first-page":"4171","author":"Devlin","year":"2019"},{"key":"2023120103525514700_fqad049-B28","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1002\/asi.20427","article-title":"Learning to Classify Documents According to Genre","volume":"51","author":"Finn","year":"2006","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2023120103525514700_fqad049-B29","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1075\/scl.9.17gei","volume-title":"Using Corpora to Explore Linguistic Variation","author":"Geisler","year":"2002"},{"key":"2023120103525514700_fqad049-B30","first-page":"321","article-title":"Texting the Written Evidence: On Register Analysis in Late Middle English and Early Modern English","volume":"18","author":"Gonz\u00e1lez-\u00c1lvarez","year":"1998","journal-title":"Text & Talk"},{"key":"2023120103525514700_fqad049-B31","first-page":"1157","article-title":"An Introduction to Variable and Feature Selection","volume":"3","author":"Guyon","year":"2003","journal-title":"Journal of Machine Learning Research"},{"key":"2023120103525514700_fqad049-B32","first-page":"1","author":"Hashimoto","year":"2023"},{"key":"2023120103525514700_fqad049-B33","author":"Hashimoto","year":"."},{"key":"2023120103525514700_fqad049-B34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5334\/johd.48","article-title":"Neural Language Models for Nineteenth-Century English","volume":"7","author":"Hosseini","year":"2021","journal-title":"Journal of Open Humanities Data"},{"key":"2023120103525514700_fqad049-B35","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/BFb0026683","volume-title":"Machine Learning: ECML-98. Lecture Notes in Computer Science","author":"Joachims","year":"1998"},{"key":"2023120103525514700_fqad049-B36","doi-asserted-by":"crossref","DOI":"10.3389\/frai.2022.975729","article-title":"Predictive Keywords: Using Machine Learning to Explain Document Characteristics","volume":"5","author":"Kyr\u00f6l\u00e4inen","year":"2023","journal-title":"Frontiers in Artificial Intelligence"},{"key":"2023120103525514700_fqad049-B37","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1075\/rs.18011.kyt","article-title":"Register in Historical Linguistics","volume":"1","author":"Kyt\u00f6","year":"2019","journal-title":"Register Studies"},{"key":"2023120103525514700_fqad049-B38","first-page":"292","author":"Laippala","year":"2019"},{"key":"2023120103525514700_fqad049-B39","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1007\/s10579-020-09519-z","article-title":"Exploring the Role of Lexis and Grammar for the Stable Identification of Register in an Unrestricted Corpus of Web Documents","volume":"55","author":"Laippala","year":"2021","journal-title":"Language Resources and Evaluation"},{"key":"2023120103525514700_fqad049-B40","doi-asserted-by":"crossref","DOI":"10.1007\/s10579-022-09624-1","article-title":"Register Identification from the Unrestricted Open Web Using the Corpus of Online Registers of English","volume":"57","author":"Laippala","year":"2023","journal-title":"Language Resources and Evaluation"},{"key":"2023120103525514700_fqad049-B41","author":"Lample","year":"2018"},{"key":"2023120103525514700_fqad049-B42","first-page":"1","author":"Levering","year":"2008"},{"key":"2023120103525514700_fqad049-B43","first-page":"34","author":"Li","year":"2019"},{"key":"2023120103525514700_fqad049-B44","first-page":"4996","author":"Libovick\u00fd","year":"2019"},{"key":"2023120103525514700_fqad049-B45","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1016\/j.ipm.2004.06.004","article-title":"Multiple Sets of Features for Automatic Genre Classification of Web Documents","volume":"41","author":"Lim","year":"2005","journal-title":"Information Processing and Management"},{"key":"2023120103525514700_fqad049-B46","doi-asserted-by":"crossref","first-page":"18","DOI":"10.3390\/e23010018","article-title":"Explainable AI: A Review of Machine Learning Interpretability Methods","volume":"23","author":"Linardatos","year":"2021","journal-title":"Entropy"},{"key":"2023120103525514700_fqad049-B47","author":"Liu","year":"2019"},{"key":"2023120103525514700_fqad049-B48","first-page":"208","author":"Mishra","year":"2019"},{"key":"2023120103525514700_fqad049-B49","author":"Monaco","year":"2017"},{"key":"2023120103525514700_fqad049-B50","first-page":"1915","article-title":"The Dictionary Is Not a Fortress: Definitional Fallacies and a Corpus-Based Approach to Plain Meaning","volume":"87","author":"Mouritsen","year":"2010","journal-title":"Brigham Young University Law Review"},{"key":"2023120103525514700_fqad049-B51","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"2023120103525514700_fqad049-B52","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1162\/COLI_a_00052","article-title":"Stable Classification of Text Genres","volume":"37","author":"Petrenz","year":"2011","journal-title":"Computational Linguistics"},{"key":"2023120103525514700_fqad049-B53","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1007\/s10579-018-9418-y","article-title":"Open Set Evaluation of Web Genre Identification","volume":"52","author":"Pritsos","year":"2018","journal-title":"Language Resources and Evaluation"},{"key":"2023120103525514700_fqad049-B54","author":"ProQuest","year":"2021"},{"key":"2023120103525514700_fqad049-B55","first-page":"183","author":"Repo","year":"2021"},{"key":"2023120103525514700_fqad049-B56","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1162\/tacl_a_00349","article-title":"A Primer in BERTology: What We Know About How BERT Works","volume":"8","author":"Rogers","year":"2020","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2023120103525514700_fqad049-B57","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/505282.505283","article-title":"Machine Learning in Automated Text Categorization","volume":"34","author":"Sebastiani","year":"2002","journal-title":"ACM Computing Surveys"},{"key":"2023120103525514700_fqad049-B58","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1075\/rs.19015.sha","article-title":"Genre Annotation for the Web","volume":"3","author":"Sharoff","year":"2021","journal-title":"Register Studies"},{"key":"2023120103525514700_fqad049-B59","first-page":"3063","author":"Sharoff","year":"2010"},{"key":"2023120103525514700_fqad049-B60","doi-asserted-by":"crossref","DOI":"10.7208\/chicago\/9780226304991.001.0001","volume-title":"Ordinary Meaning: A Theory of the Most Fundamental Principle of Legal Interpretation","author":"Slocum","year":"2015"},{"key":"2023120103525514700_fqad049-B61","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1515\/9783110811148.185","volume-title":"English in Transition: Corpus-Based Studies in Linguistic Variation and Genre Styles","author":"Taavitsainen","year":"1997"},{"key":"2023120103525514700_fqad049-B62","volume-title":"Medical and Scientific Writing in Late Medieval English","author":"Taavitsainen","year":"2004"},{"key":"2023120103525514700_fqad049-B63","first-page":"191","volume-title":"From Data to Evidence in English Language Research","author":"Taavitsainen","year":"2019"},{"key":"2023120103525514700_fqad049-B64","first-page":"2222","author":"Tanase","year":"2020"},{"key":"2023120103525514700_fqad049-B65","volume-title":"Statistical Learning Theory","author":"Vapnik","year":"1998"},{"key":"2023120103525514700_fqad049-B66","first-page":"6000","author":"Vaswani","year":"2017"},{"key":"2023120103525514700_fqad049-B67","author":"Wan","year":"2019"},{"key":"2023120103525514700_fqad049-B68","first-page":"4003","author":"Wenzek","year":"2020"},{"key":"2023120103525514700_fqad049-B69","first-page":"38","author":"Wolf","year":"2020"},{"key":"2023120103525514700_fqad049-B70","first-page":"1963","author":"Worsham","year":"2018"},{"key":"2023120103525514700_fqad049-B71","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1163\/9789004657311_015","volume-title":"Corpora across the Centuries: Proceedings of the First International Colloquium on English Diachronic Corpora, St Catharine\u2019s College Cambridge, 25\u201327 March 1993","author":"Wright","year":"1994"},{"key":"2023120103525514700_fqad049-B72","first-page":"19","author":"Zhu","year":"2015"}],"container-title":["Digital Scholarship in the Humanities"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/dsh\/article-pdf\/38\/4\/1659\/53961773\/fqad049.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/dsh\/article-pdf\/38\/4\/1659\/53961773\/fqad049.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T03:54:37Z","timestamp":1701402877000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/dsh\/article\/38\/4\/1659\/7293015"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,5]]},"references-count":72,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,10,5]]},"published-print":{"date-parts":[[2023,11,30]]}},"URL":"https:\/\/doi.org\/10.1093\/llc\/fqad049","relation":{},"ISSN":["2055-7671","2055-768X"],"issn-type":[{"value":"2055-7671","type":"print"},{"value":"2055-768X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,12,1]]},"published":{"date-parts":[[2023,10,5]]}}}