{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:16:09Z","timestamp":1781104569991,"version":"3.54.1"},"reference-count":56,"publisher":"IGI Global","isbn-type":[{"value":"9781613504475","type":"print"},{"value":"9781613504482","type":"electronic"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>The investigation of natural language processing in the field of Applied Linguistics is pursued with both theoretical and practical aims, such as arriving at a clearer understanding of the nature of language knowledge, the rules that govern its use, how it is acquired, how unique it is to individual speakers, and how it can best be taught to learners. The purpose of this chapter is to draw attention to some of the prominent areas of overlap between Applied Linguistics and ANLP, highlighting the problems they face in relation to the characterization of lexical deployment, and focusing particularly on challenges related to the measurement of lexical diversity and the representation of the unique lexical signatures of individual samples of natural language use. The bulk of the chapter is devoted to describing preliminary solutions to these challenges.<\/jats:p>","DOI":"10.4018\/978-1-61350-447-5.ch005","type":"book-chapter","created":{"date-parts":[[2012,2,29]],"date-time":"2012-02-29T09:48:29Z","timestamp":1330508909000},"page":"50-72","source":"Crossref","is-referenced-by-count":9,"title":["Lexical Challenges in the Intersection of Applied Linguistics and ANLP"],"prefix":"10.4018","author":[{"given":"Scott","family":"Jarvis","sequence":"first","affiliation":[{"name":"Ohio University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"978-1-61350-447-5.ch005.-1","doi-asserted-by":"publisher","DOI":"10.1093\/applin\/amm024"},{"key":"978-1-61350-447-5.ch005.-2","doi-asserted-by":"publisher","DOI":"10.1080\/09296179808590121"},{"key":"978-1-61350-447-5.ch005.-3","doi-asserted-by":"publisher","DOI":"10.1093\/llc\/18.3.235"},{"key":"978-1-61350-447-5.ch005.-4","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511519871"},{"key":"978-1-61350-447-5.ch005.-5","author":"D.Biber","year":"1999","journal-title":"Longman grammar of spoken and written English"},{"key":"978-1-61350-447-5.ch005.-6","unstructured":"Budiu, R., Royer, C., & Pirolli, P. (2007). Modeling information scent: A comparison of LSA, PMI and GLSA similarity measures on common tests and corpora. Proceedings of RIAO'07. Pittsburgh, PA."},{"key":"978-1-61350-447-5.ch005.-7","doi-asserted-by":"publisher","DOI":"10.3138\/cmlr.59.3.393"},{"key":"978-1-61350-447-5.ch005.-8","doi-asserted-by":"publisher","DOI":"10.1023\/B:CHUM.0000009291.06947.52"},{"key":"978-1-61350-447-5.ch005.-9","doi-asserted-by":"publisher","DOI":"10.1093\/applin\/amm022"},{"key":"978-1-61350-447-5.ch005.-10","doi-asserted-by":"crossref","unstructured":"Crossley, S. A., Salsbury, T., & McNamara, D. S. (in press). The development of polysemy and frequency use in English second language speakers. Language Learning, 60(3).","DOI":"10.1111\/j.1467-9922.2010.00568.x"},{"key":"978-1-61350-447-5.ch005.-11","article-title":"Predicting lexical proficiency in language learners using computational indices.","author":"S. A.Crossley","journal-title":"Language Testing"},{"key":"978-1-61350-447-5.ch005.-12","doi-asserted-by":"publisher","DOI":"10.1080\/14790710408668176"},{"key":"978-1-61350-447-5.ch005.-13","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324905003694"},{"key":"978-1-61350-447-5.ch005.-14","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1075\/scl.33.04gra","article-title":"The contribution of learner corpora to second language acquisition and foreign language teaching: A critical evaluation","author":"S.Granger","year":"2009","journal-title":"Corpora and language teaching"},{"key":"978-1-61350-447-5.ch005.-15","author":"S.Granger","year":"2009","journal-title":"The international corpus of learner English. Handbook and CD-ROM, version 2. Louvain-la-Neuve"},{"key":"978-1-61350-447-5.ch005.-16","doi-asserted-by":"publisher","DOI":"10.1093\/llc\/16.4.403"},{"key":"978-1-61350-447-5.ch005.-17","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022673822140"},{"key":"978-1-61350-447-5.ch005.-18","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139524773","author":"S.Hunston","year":"2002","journal-title":"Corpora in applied linguistics"},{"key":"978-1-61350-447-5.ch005.-19","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9574.1994.tb01448.x"},{"key":"978-1-61350-447-5.ch005.-20","doi-asserted-by":"publisher","DOI":"10.1191\/0265532202lt220oa"},{"key":"978-1-61350-447-5.ch005.-21","unstructured":"Jarvis, S. (2003, October 16-19). Measuring lexical diversity through exhaustive sampling. Paper presented at the Annual Second Language Research Forum. Tucson, AZ."},{"key":"978-1-61350-447-5.ch005.-22","unstructured":"Jarvis, S. (2006, July 6-8). Examining the properties of lexical diversity through quantitative and qualitative means. Paper presented at the 16th Sociolinguistics Symposium. Limerick, Ireland."},{"key":"978-1-61350-447-5.ch005.-23","unstructured":"Jarvis, S. (2007, September 27-28). Word choice: Converging trends and promising prospects. Keynote address presented at Models and Measures of Vocabulary Deployment: Orientation Towards the Future. Reading, UK."},{"key":"978-1-61350-447-5.ch005.-24","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-4781.2007.00589.x"},{"key":"978-1-61350-447-5.ch005.-25","author":"K.Kuiper","year":"1996","journal-title":"Smooth talkers"},{"key":"978-1-61350-447-5.ch005.-26","author":"T. K.Landauer","year":"2007","journal-title":"LSA: A road to meaning"},{"key":"978-1-61350-447-5.ch005.-27","doi-asserted-by":"publisher","DOI":"10.1093\/applin\/16.3.307"},{"key":"978-1-61350-447-5.ch005.-28","unstructured":"Leech, G. 2005. Adding linguistic annotation. In M. Wynne (Ed.), Developing linguistic corpora: A guide to good practice (pp. 17-29). Oxford, UK: Oxbow Books. Retrieved April 9, 2010, from http:\/\/ahds.ac.uk\/linguistic-corpora\/"},{"key":"978-1-61350-447-5.ch005.-29","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/6393.001.0001","author":"W.Levelt","year":"1989","journal-title":"Speaking: From intention to articulation"},{"key":"978-1-61350-447-5.ch005.-30","author":"M.Linnarud","year":"1986","journal-title":"Lexis in composition: A performance analysis of Swedish learners' written English"},{"key":"978-1-61350-447-5.ch005.-31","unstructured":"(2009). Longman Dictionary of Contemporary English (5th ed.). London, UK: Pearson Longman."},{"key":"978-1-61350-447-5.ch005.-32","doi-asserted-by":"publisher","DOI":"10.1057\/9780230511804"},{"key":"978-1-61350-447-5.ch005.-33","unstructured":"McCarthy, P., & Jarvis, S. (in press). MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment."},{"key":"978-1-61350-447-5.ch005.-34","doi-asserted-by":"publisher","DOI":"10.1177\/0265532207080767"},{"key":"978-1-61350-447-5.ch005.-35","doi-asserted-by":"publisher","DOI":"10.1177\/0033688206076158"},{"key":"978-1-61350-447-5.ch005.-36","author":"T.McEnery","year":"2001","journal-title":"Corpus linguistics"},{"key":"978-1-61350-447-5.ch005.-37","first-page":"5","article-title":"P_Lex: A simple and effective way of describing the lexical characteristics of short L2 texts.","volume":"16","author":"P.Meara","year":"2001","journal-title":"Prospect"},{"key":"978-1-61350-447-5.ch005.-38","first-page":"85","article-title":"Lexical signatures in foreign-language free-form texts.","volume":"135-136","author":"P.Meara","year":"2002","journal-title":"Review of Applied Linguistics"},{"key":"978-1-61350-447-5.ch005.-39","first-page":"359","author":"S.Meyer zu Eissen","year":"2007","journal-title":"Plagiarism detection without reference collections. Advances in data analysis"},{"key":"978-1-61350-447-5.ch005.-40","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139524759","author":"I. S. P.Nation","year":"2001","journal-title":"Learning vocabulary in another language"},{"key":"978-1-61350-447-5.ch005.-41","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1075\/scl.12.11nes","article-title":"Learner corpora and their potential in language teaching","author":"N.Nesselhauf","year":"2004","journal-title":"How to use corpora in language teaching"},{"key":"978-1-61350-447-5.ch005.-42","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511732942"},{"key":"978-1-61350-447-5.ch005.-43","first-page":"7","article-title":"Sample survey methods and computer-assisted analysis in the study of grammatical variation","author":"D.Sankoff","year":"1973","journal-title":"Canadian languages and their social context"},{"key":"978-1-61350-447-5.ch005.-44","unstructured":"Santini, M. (2004). State-of-the-art on automatic genre identification. Technical Report ITRI-04-03, 2004, Information Technology Research Institute. UK: University of Brighton."},{"key":"978-1-61350-447-5.ch005.-45","unstructured":"Schmitt, N. (in press). Researching vocabulary: A vocabulary research manual."},{"key":"978-1-61350-447-5.ch005.-46","unstructured":"Sinclair, J. (2005). Corpus and text: Basic principles. In M. Wynne (Ed.), Developing linguistic corpora: A guide to good practice (pp. 1-16). Oxford, UK: Oxbow Books. Retrieved April 9, 2010, from http:\/\/ahds.ac.uk\/linguistic-corpora\/"},{"key":"978-1-61350-447-5.ch005.-47","doi-asserted-by":"publisher","DOI":"10.1002\/asi.21001"},{"key":"978-1-61350-447-5.ch005.-48","doi-asserted-by":"publisher","DOI":"10.1162\/089120100750105920"},{"key":"978-1-61350-447-5.ch005.-49","unstructured":"Stein, B., Lipka, N., Prettenhofer, P. (2010). Intrinsic plagiarism analysis. Language Resources and Evaluation, LRE, 2010."},{"key":"978-1-61350-447-5.ch005.-50","unstructured":"Stein, B., & Meyer zu Eissen, S. (2007). Intrinsic plagiarism analysis with meta learning. In Proceedings of the SIGIR Workshop on Plagiarism Analysis, Authorship Attribution, and Near-Duplicate Detection (pp. 45-50)."},{"key":"978-1-61350-447-5.ch005.-51","first-page":"11","article-title":"Corpus linguistics 25+ years on","author":"J.Svartvik","year":"2007","journal-title":"Corpus linguistics 25 years on"},{"key":"978-1-61350-447-5.ch005.-52","doi-asserted-by":"publisher","DOI":"10.1080\/09296179608590062"},{"key":"978-1-61350-447-5.ch005.-53","doi-asserted-by":"crossref","DOI":"10.1075\/lllt.9.09und","article-title":"The eyes have it: An eye-movement study into the processing of formulaic sequences","author":"G.Underwood","year":"2004","journal-title":"Formulaic sequences"},{"key":"978-1-61350-447-5.ch005.-54","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1177\/026553220001700103","article-title":"Coming to grips with lexical richness in spontaneous speech data.","volume":"17","author":"A.Vermeer","year":"2000","journal-title":"Language Testing"},{"key":"978-1-61350-447-5.ch005.-55","author":"W.Weaver","year":"1949","journal-title":"The mathematical theory of communication"},{"key":"978-1-61350-447-5.ch005.-56","author":"G. U.Yule","year":"1944","journal-title":"The statistical study of literary vocabulary"}],"container-title":["Cross-Disciplinary Advances in Applied Natural Language Processing"],"original-title":[],"link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=64580","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,22]],"date-time":"2025-03-22T02:21:26Z","timestamp":1742610086000},"score":1,"resource":{"primary":{"URL":"http:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/978-1-61350-447-5.ch005"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[null]]},"ISBN":["9781613504475","9781613504482"],"references-count":56,"URL":"https:\/\/doi.org\/10.4018\/978-1-61350-447-5.ch005","relation":{},"subject":[]}}