{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T07:53:40Z","timestamp":1790063620912,"version":"4.0.1"},"reference-count":42,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2019,6,2]],"date-time":"2019-06-02T00:00:00Z","timestamp":1559433600000},"content-version":"vor","delay-in-days":365,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["#200021_149665\/1"],"award-info":[{"award-number":["#200021_149665\/1"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Based on n text excerpts, the authorship linking task is to determine a way to link pairs of documents written by the same person together. This problem is closely related to authorship attribution questions, and its solution can be used in the author clustering task. However, no training information is provided and the solution must be unsupervised. To achieve this, various text representation strategies can be applied, such as characters, punctuation symbols, or letter n-grams as well as words, lemmas, Part-Of-Speech (POS) tags, and sequences of them. To estimate the stylistic distance (or similarity) between two text excerpts, different measures have been suggested based on the L1 norm (e.g. Manhattan, Tanimoto), the L2 norm (e.g. Matusita), the inner product (e.g. Cosine), or the entropy paradigm (e.g. Jeffrey divergence). From those possible implementations, it is not clear which text representation and distance functions produce the best performance, and this study provides an answer to this question. Three corpora, extracted from French and English literature, have been evaluated using standard methodology. Moreover, we suggest an additional performance measure called high precision (HPrec) capable of judging the quality of a ranked list of links to provide only correct answers. No systematic difference can be found between token- or lemma-based text representations. Simple POS tags do not provide an effective solution but short sequences of them form a good text representation. Letter n-grams (with n = 4\u20136) give high HPrec rates. As distance measures, this study found that the Tanimoto, Matusita, and Clark distance measures perform better than the often-used Cosine function. Finally, applying a pruning procedure (e.g. culling terms appearing once or twice or limiting the vocabulary to the 500 most frequent words) reduces the representation complexity and might even improve the effectiveness of the attribution scheme.<\/jats:p>","DOI":"10.1093\/llc\/fqy013","type":"journal-article","created":{"date-parts":[[2018,6,2]],"date-time":"2018-06-02T08:45:33Z","timestamp":1527929133000},"page":"189-207","source":"Crossref","is-referenced-by-count":18,"title":["Evaluation of text representation schemes and distance measures for authorship linking"],"prefix":"10.1093","volume":"34","author":[{"given":"Mirco","family":"Kocher","sequence":"first","affiliation":[{"name":"University of Neuchatel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacques","family":"Savoy","sequence":"first","affiliation":[{"name":"University of Neuchatel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2018,6,2]]},"reference":[{"key":"2020030521252959000_fqy013-B1","first-page":"307","volume-title":"Proceedings Computer Security ESORICS","author":"Almishari","year":"2012"},{"issue":"2","key":"2020030521252959000_fqy013-B2","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1145\/1461928.1461959","article-title":"Automatically profiling the author of an anonymous text","volume":"52","author":"Argamon","year":"2009","journal-title":"Communications of the ACM"},{"key":"2020030521252959000_fqy013-B3","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511801686","volume-title":"Analysis Linguistic Data: A Practical Introduction to Statistics Using R","author":"Baayen","year":"2008"},{"key":"2020030521252959000_fqy013-B4","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511814358","volume-title":"Register, Genre, and Style","author":"Biber","year":"2009"},{"issue":"4","key":"2020030521252959000_fqy013-B5","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1093\/llc\/14.4.445","article-title":"The Application of Principal Component Analysis to Stylometry","volume":"14","author":"Binongo","year":"1999","journal-title":"Literary and Linguistic Computing"},{"key":"2020030521252959000_fqy013-B6","volume-title":"Satisfied Customers Tell Three Friends, Angry Customers Tell 3,000","author":"Blackshaw","year":"2008"},{"issue":"1","key":"2020030521252959000_fqy013-B7","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1093\/llc\/7.2.91","article-title":"Not unless you ask nicely: the interpretative nexus between analysis and information","volume":"7","author":"Burrows","year":"1992","journal-title":"Literary and Linguistic Computing"},{"issue":"3","key":"2020030521252959000_fqy013-B8","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1093\/llc\/17.3.267","article-title":"Delta: a measure of stylistic difference and a guide to likely authorship","volume":"17","author":"Burrows","year":"2002","journal-title":"Literary and Linguistic Computing"},{"issue":"1","key":"2020030521252959000_fqy013-B9","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1093\/llc\/fqi067","article-title":"All the way through: testing for authorship in different frequency strata","volume":"22","author":"Burrows","year":"2007","journal-title":"Literary and Linguistic Computing"},{"key":"2020030521252959000_fqy013-B10","volume-title":"Proceedings Qualico 2016","author":"Cortelazzo","year":"2016"},{"key":"2020030521252959000_fqy013-B11","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511605437","volume-title":"Shakespeare, Computers, and the Mystery of Authorship","author":"Craig","year":"2009"},{"key":"2020030521252959000_fqy013-B12","volume-title":"Pattern Classification","author":"Duda","year":"2001"},{"key":"2020030521252959000_fqy013-B13","doi-asserted-by":"crossref","DOI":"10.2200\/S00762ED1V01Y201703HLT037","volume-title":"Neural Network Methods for Natural Language Processing","author":"Goldberg","year":"2017"},{"key":"2020030521252959000_fqy013-B14","volume-title":"Deep Learning","author":"Goodfellow","year":"2016"},{"issue":"1","key":"2020030521252959000_fqy013-B15","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/(SICI)1097-4571(199101)42:1<7::AID-ASI2>3.0.CO;2-P","article-title":"How effective is suffixing?","volume":"42","author":"Harman","year":"1991","journal-title":"Journal of the American Society for Information Science"},{"issue":"3","key":"2020030521252959000_fqy013-B16","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1093\/llc\/13.3.111","article-title":"The evolution of stylometry in humanities scholarship","volume":"13","author":"Holmes","year":"1998","journal-title":"Literary and Linguistic Computing"},{"issue":"2","key":"2020030521252959000_fqy013-B17","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1093\/llc\/fqq001","article-title":"A comparative study of machine learning methods for authorship attribution","volume":"25","author":"Jockers","year":"2010","journal-title":"Literary and Linguistic Computing"},{"key":"2020030521252959000_fqy013-B18","volume-title":"Foundations and Trends in Information Retrieval","author":"Juola","year":"2006"},{"key":"2020030521252959000_fqy013-B19","author":"Ke\u0161elj","year":"2003"},{"issue":"2","key":"2020030521252959000_fqy013-B20","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1093\/llc\/9.2.119","article-title":"Authorship determination using letter pair frequency features with neural network classifier","volume":"9","author":"Kjell","year":"1994","journal-title":"Literary and Linguistics Computing"},{"issue":"5","key":"2020030521252959000_fqy013-B21","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1016\/j.ipm.2017.04.004","article-title":"Distance measures in author profiling.","volume":"53","author":"Kocher","year":"2017","journal-title":"Information Processing and Management"},{"issue":"6","key":"2020030521252959000_fqy013-B22","first-page":"1261","article-title":"Measuring differentiability: unmasking pseudonymous authors","volume":"8","author":"Koppel","year":"2007","journal-title":"Journal of Machine Learning Research"},{"issue":"3","key":"2020030521252959000_fqy013-B23","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1093\/llc\/fqi063","article-title":"A tool for literary studies","volume":"21","author":"Labb\u00e9","year":"2006","journal-title":"Literary and Linguistic Computing"},{"issue":"1","key":"2020030521252959000_fqy013-B24","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1080\/09296170600850601","article-title":"Experiments on authorship attribution by intertextual distance in English","volume":"14","author":"Labb\u00e9","year":"2007","journal-title":"Journal of Quantitative Linguistics"},{"issue":"3","key":"2020030521252959000_fqy013-B25","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1093\/llc\/9.3.235","article-title":"Shakespeare, Fletcher, and the Two Noble Kinsmen","volume":"9","author":"Ledger","year":"1994","journal-title":"Literary and Linguistic Computing"},{"key":"2020030521252959000_fqy013-B26","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511483165","volume-title":"Attributing Authorship: An Introduction","author":"Love","year":"2002"},{"key":"2020030521252959000_fqy013-B27","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511809071","volume-title":"Introduction to Information Retrieval","author":"Manning","year":"2008"},{"key":"2020030521252959000_fqy013-B28","volume-title":"Who Wrote Shakespeare","author":"Michell","year":"1996"},{"issue":"1\/2","key":"2020030521252959000_fqy013-B29","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1023\/B:INRT.0000009441.78971.be","article-title":"Character N-gram tokenization for European language text retrieval","volume":"7","author":"McNamee","year":"2004","journal-title":"Information Retrieval Journal"},{"key":"2020030521252959000_fqy013-B30","volume-title":"Forensic Linguistics","author":"Olsson","year":"2008"},{"key":"2020030521252959000_fqy013-B31","volume-title":"The Secret Life of Pronouns. What our Words Say about us","author":"Pennebaker","year":"2011"},{"issue":"1","key":"2020030521252959000_fqy013-B32","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.ipm.2015.06.003","article-title":"On the impact of emotions on author profiling","volume":"52","author":"Rangel","year":"2016","journal-title":"Information Processing and Management"},{"issue":"2","key":"2020030521252959000_fqy013-B33","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1093\/llc\/fqt047","article-title":"Comparative evaluation of term selection functions for authorship attribution","volume":"30","author":"Savoy","year":"2015","journal-title":"Digital Scholarship in the Humanities"},{"issue":"8","key":"2020030521252959000_fqy013-B34","first-page":"1858","article-title":"Text representation strategies: an example with the State of the Union addresses","volume":"67","author":"Savoy","year":"2016","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2020030521252959000_fqy013-B35","first-page":"55","article-title":"Analysis of the style and the Rhetoric of the American Presidents over two centuries","volume":"38","author":"Savoy","year":"2017","journal-title":"Glottometrics"},{"issue":"3","key":"2020030521252959000_fqy013-B36","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1002\/asi.21001","article-title":"A survey of modern authorship attribution methods","volume":"60","author":"Stamatatos","year":"2009","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2020030521252959000_fqy013-B37","volume-title":"Notebook Papers of CLEF 2016 Labs and Workshop","author":"Stamatatos","year":"2016"},{"key":"2020030521252959000_fqy013-B38","volume-title":"John Florio, the Man who was Shakespeare","author":"Tassinari","year":"2009"},{"key":"2020030521252959000_fqy013-B39","author":"Toutanova","year":"2003"},{"issue":"3","key":"2020030521252959000_fqy013-B40","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1093\/llc\/fqx066","article-title":"What is Elena Ferrante? A comparative analysis of a secretive bestselling Italian writer","volume":"33","author":"Tuzzi","year":"2018","journal-title":"Digital Scholarship in the Humanities"},{"key":"2020030521252959000_fqy013-B41","volume-title":"The TREC Experiment and Evaluation in Information Retrieval","author":"Voorhees","year":"2005"},{"key":"2020030521252959000_fqy013-B42","author":"Zhao","year":"2007"}],"container-title":["Digital Scholarship in the Humanities"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/dsh\/article-pdf\/34\/1\/189\/28078677\/fqy013.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/dsh\/article-pdf\/34\/1\/189\/28078677\/fqy013.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,3,6]],"date-time":"2020-03-06T02:30:08Z","timestamp":1583461808000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/dsh\/article\/34\/1\/189\/5032370"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,2]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,6,2]]},"published-print":{"date-parts":[[2019,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/llc\/fqy013","relation":{},"ISSN":["2055-7671","2055-768X"],"issn-type":[{"value":"2055-7671","type":"print"},{"value":"2055-768X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,4]]},"published":{"date-parts":[[2018,6,2]]}}}