{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T00:50:12Z","timestamp":1778287812268,"version":"3.51.4"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2018,10,27]],"date-time":"2018-10-27T00:00:00Z","timestamp":1540598400000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>There is a long-standing debate about the authorship of the Bixby Letter, one of the most famous pieces of correspondence in American history. Despite being signed by President Abraham Lincoln, some historians have claimed that its true author was John Hay, Lincoln\u2019s personal secretary. Analyses of the letter have been inconclusive in part because the text totals only 139 words and is thus far too short to be attributed using standard methods. To test whether Lincoln or Hay wrote this letter, we therefore introduce and apply a new technique for attributing short texts called \u2018n-gram tracing\u2019. After demonstrating that our method can distinguish between the known writings of Lincoln and Hay with a very high degree of accuracy, we use it to attribute the Bixby Letter. We conclude that the text was authored by John Hay\u2014rewriting this one episode in the history of the USA, while offering a solution to one of the most persistent problems in authorship attribution.<\/jats:p>","DOI":"10.1093\/llc\/fqy042","type":"journal-article","created":{"date-parts":[[2018,12,19]],"date-time":"2018-12-19T11:24:49Z","timestamp":1545218689000},"page":"493-512","source":"Crossref","is-referenced-by-count":20,"title":["Attributing the Bixby Letter using n-gram tracing"],"prefix":"10.1093","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3630-7349","authenticated-orcid":false,"given":"Jack","family":"Grieve","sequence":"first","affiliation":[{"name":"Department of English Language and Linguistics, University of Birmingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Isobelle","family":"Clarke","sequence":"additional","affiliation":[{"name":"Department of English Language and Linguistics, University of Birmingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emily","family":"Chiang","sequence":"additional","affiliation":[{"name":"Centre for Forensic Linguistics, Aston University, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hannah","family":"Gideon","sequence":"additional","affiliation":[{"name":"Centre for Forensic Linguistics, Aston University, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Annina","family":"Heini","sequence":"additional","affiliation":[{"name":"Centre for Forensic Linguistics, Aston University, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4218-5130","authenticated-orcid":false,"given":"Andrea","family":"Nini","sequence":"additional","affiliation":[{"name":"Department of Linguistics and English Language, University of Manchester, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emily","family":"Waibel","sequence":"additional","affiliation":[{"name":"Centre for English Language and Communication, Aston University, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,10,26]]},"reference":[{"key":"2019091011542848000_fqy042-B1","volume-title":"A Beautiful Blunder: The True Story of Lincoln's Letter to Mrs. Lydia A. Bixby","author":"Barton","year":"1926"},{"key":"2019091011542848000_fqy042-B2","volume-title":"The Collected Works of Abraham Lincoln","author":"Basler","year":"1953"},{"key":"2019091011542848000_fqy042-B47","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511621024","volume-title":"Variation Across Speech and Writing","author":"Biber","year":"1988"},{"key":"2019091011542848000_fqy042-B3","volume-title":"Proceedings of the 2013 International Conference on Computer, Information and Telecommunication Systems (CITS)","author":"Brocardo","year":"2013"},{"key":"2019091011542848000_fqy042-B4","volume-title":"Abraham Lincoln and the Widow Bixby","author":"Bullard","year":"1946"},{"key":"2019091011542848000_fqy042-B5","first-page":"26","author":"Bullard","year":"1951"},{"key":"2019091011542848000_fqy042-B6","doi-asserted-by":"crossref","first-page":"59","DOI":"10.5406\/19457987.16.1.07","article-title":"New light on the Bixby Letter","volume":"16","author":"Burlingame","year":"1995","journal-title":"Journal of the Abraham Lincoln Association"},{"key":"2019091011542848000_fqy042-B7","first-page":"64","article-title":"The trouble with the Bixby Letter: The stirring civil war document featured in Saving Private Ryan grew out of a lie and probably wasn't really written by Lincoln","volume":"50","author":"Burlingame","year":"1999","journal-title":"American Heritage"},{"key":"2019091011542848000_fqy042-B8","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1093\/llc\/17.3.267","article-title":"\u2018Delta\u2019: a measure of stylistic difference and a guide to likely authorship","volume":"17","author":"Burrows","year":"2002","journal-title":"Literary and Linguistic Computing"},{"key":"2019091011542848000_fqy042-B9","volume-title":"Across the Busy Years: Recollections and Reflections","author":"Butler","year":"1940"},{"key":"2019091011542848000_fqy042-B10","first-page":"1","article-title":"Who\u2019s at the keyboard? Authorship attribution in digital evidence investigations","volume":"4","author":"Chaski","year":"2005","journal-title":"International Journal of Digital Evidence"},{"key":"2019091011542848000_fqy042-B11","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1093\/applin\/25.4.431","article-title":"Author identification, idiolect, and linguistic uniqueness","volume":"25","author":"Coulthard","year":"2004","journal-title":"Applied Linguistics"},{"key":"2019091011542848000_fqy042-B12","volume-title":"An Introduction to Forensic Linguistics","author":"Coulthard","year":"2017"},{"key":"2019091011542848000_fqy042-B13","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1093\/llc\/fqt066","article-title":"Does size matter? Authorship attribution, small samples, big problem","volume":"30","author":"Eder","year":"2015","journal-title":"Digital Scholarship in the Humanities"},{"key":"2019091011542848000_fqy042-B14","author":"Ehrhardt","year":"2007"},{"key":"2019091011542848000_fqy042-B15","first-page":"1","article-title":"America\u2019s most famous letter","volume":"57","author":"Emerson","year":"2006","journal-title":"American Heritage"},{"key":"2019091011542848000_fqy042-B16","first-page":"86","article-title":"New evidence from an ignored voice: Robert Todd Lincoln and the authorship of Bixby Letter","volume":"110","author":"Emerson","year":"2008","journal-title":"Lincoln Herald"},{"key":"2019091011542848000_fqy042-B17","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1093\/llc\/11.4.163","article-title":"Feature-finding for text classification","volume":"11","author":"Forsyth","year":"1996","journal-title":"Literary and Linguistic Computing"},{"key":"2019091011542848000_fqy042-B18","volume-title":"Proceedings of the 20th International Conference on Computational Linguistics (COLING)","author":"Gamon","year":"2004"},{"key":"2019091011542848000_fqy042-B19","first-page":"467","article-title":"TXT 4N6: method, consistency, and distinctiveness in the analysis of SMS text messages","volume":"21","author":"Grant","year":"2013","journal-title":"Journal of Law and Policy"},{"key":"2019091011542848000_fqy042-B20","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1093\/llc\/fqm020","article-title":"Quantitative authorship attribution: an evaluation of techniques","volume":"22","author":"Grieve","year":"2007","journal-title":"Literary and Linguistic Computing"},{"key":"2019091011542848000_fqy042-B21","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1093\/llc\/fqm023","article-title":"Bigrams of syntactic labels for authorship discrimination of short texts","volume":"22","author":"Hirst","year":"2007","journal-title":"Literary and Linguistic Computing"},{"key":"2019091011542848000_fqy042-B22","first-page":"37","article-title":"Identifying idiolect in forensic authorship attribution: an n-gram textbite approach","volume":"1","author":"Johnson","year":"2014","journal-title":"Language and Law\/Linguagem E Direito"},{"key":"2019091011542848000_fqy042-B23","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1561\/1500000005","article-title":"Authorship attribution","volume":"1","author":"Juola","year":"2006","journal-title":"Foundations and Trends in Information Retrieval"},{"key":"2019091011542848000_fqy042-B24","volume-title":"Proceedings of the Third Conference of the Pacific Association for Computational Linguistics (PACLING 3)","author":"Ke\u0161elj","year":"2003"},{"key":"2019091011542848000_fqy042-B25","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1002\/asi.20961","article-title":"Computational methods in authorship attribution","volume":"60","author":"Koppel","year":"2009","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2019091011542848000_fqy042-B26","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1007\/s10579-009-9111-2","article-title":"Authorship attribution in the wild","volume":"45","author":"Koppel","year":"2011","journal-title":"Language Resources and Evaluation"},{"key":"2019091011542848000_fqy042-B27","first-page":"352","article-title":"\u2018The strong god circumstance\u2019: the political career of John Hay","volume":"67","author":"Kushner","year":"1974","journal-title":"Journal of the Illinois State Historical Society"},{"key":"2019091011542848000_fqy042-B28","volume-title":"John Milton Hay: The Union of Poetry and Politics","author":"Kushner","year":"1977"},{"key":"2019091011542848000_fqy042-B29","volume-title":"Proceedings of the Second Cybercrime and Trustworthy Computing Workshop (CTC","author":"Layton","year":"2010"},{"key":"2019091011542848000_fqy042-B30","volume-title":"Proceedings of the Twenty-Second International Conference on Computational Linguistics (COLING 2008)","author":"Luyckx","year":"2008"},{"key":"2019091011542848000_fqy042-B31","volume-title":"Proceedings of the International Association of Forensic Linguists\u2019 10th Biennial Conference","author":"MacLeod","year":"2012"},{"key":"2019091011542848000_fqy042-B32","volume-title":"Forensic Stylistics","author":"McMenamin","year":"1993"},{"key":"2019091011542848000_fqy042-B33","doi-asserted-by":"crossref","DOI":"10.1201\/9781420041170","volume-title":"Forensic Linguistics: Advances in Forensic Stylistics","author":"McMenamin","year":"2002"},{"key":"2019091011542848000_fqy042-B34","first-page":"135","article-title":"Lincoln\u2019s Bixby Letter: a study in authorship","volume":"91","author":"Nickell","year":"1989","journal-title":"Lincoln Herald"},{"key":"2019091011542848000_fqy042-B35","doi-asserted-by":"crossref","DOI":"10.1093\/llc\/fqx065","article-title":"An authorship analysis of the Jack the Ripper letters","author":"Nini","year":"2018","journal-title":"Digital Scholarship in the Humanities"},{"key":"2019091011542848000_fqy042-B36","doi-asserted-by":"crossref","DOI":"10.1075\/nlp.12","volume-title":"Literary Detective Work on the Computer","author":"Oakes","year":"2014"},{"key":"2019091011542848000_fqy042-B37","volume-title":"Lincoln the President","author":"Randall","year":"1955"},{"key":"2019091011542848000_fqy042-B38","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Schwartz","year":"2013"},{"key":"2019091011542848000_fqy042-B39","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/978-3-642-22327-3_16","volume-title":"Natural Language Processing and Information Systems (NLDB 2011)","author":"Silva","year":"2011"},{"key":"2019091011542848000_fqy042-B40","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1002\/asi.21001","article-title":"A survey of modern authorship attribution methods","volume":"60","author":"Stamatatos","year":"2009","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2019091011542848000_fqy042-B41","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1023\/A:1002681919510","article-title":"Computer-based authorship attribution without lexical measures","volume":"35","author":"Stamatatos","year":"2001","journal-title":"Computers and the Humanities"},{"key":"2019091011542848000_fqy042-B42","doi-asserted-by":"crossref","first-page":"19","DOI":"10.5121\/mlaij.2016.3103","article-title":"A survey on similarity measures in text mining","volume":"3","author":"Vijaymeena","year":"2016","journal-title":"Machine Learning and Applications: An International Journal"},{"key":"2019091011542848000_fqy042-B43","volume-title":"Abraham Lincoln and the Bixby Letter","author":"Wakefield","year":"1948"},{"key":"2019091011542848000_fqy042-B44","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1075\/ijcl.22.2.03wri","article-title":"Using word n-grams to identify authors and idiolects","volume":"22","author":"Wright","year":"2017","journal-title":"International Journal of Corpus Linguistics"},{"key":"2019091011542848000_fqy042-B45","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.jeconom.2015.02.006","article-title":"Cross-validation for selecting a model selection procedure","volume":"187","author":"Zhang","year":"2015","journal-title":"Journal of Econometrics"},{"key":"2019091011542848000_fqy042-B46","volume-title":"The Psycho-biology of Language: An Introduction to Dynamic Philology","author":"Zipf","year":"1935"}],"container-title":["Digital Scholarship in the Humanities"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/dsh\/article-pdf\/34\/3\/493\/29212843\/fqy042.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T16:47:33Z","timestamp":1775321253000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/dsh\/article\/34\/3\/493\/5145759"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,26]]},"references-count":47,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,10,26]]},"published-print":{"date-parts":[[2019,9,1]]}},"URL":"https:\/\/doi.org\/10.1093\/llc\/fqy042","relation":{},"ISSN":["2055-7671","2055-768X"],"issn-type":[{"value":"2055-7671","type":"print"},{"value":"2055-768X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,9]]},"published":{"date-parts":[[2018,10,26]]}}}