{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T05:16:07Z","timestamp":1774415767011,"version":"3.50.1"},"reference-count":0,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[1999,6,1]],"date-time":"1999-06-01T00:00:00Z","timestamp":928195200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[1999,6]]},"abstract":"<jats:p>Resnik and Yarowsky (1997) made a set of observations about the state-of-the-art in automatic \nword sense disambiguation and, motivated by those observations, offered several specific \nproposals regarding improved evaluation criteria, common training and testing resources, \nand the definition of sense inventories. Subsequent discussion of those proposals resulted \nin <jats:sc>SENSEVAL<\/jats:sc>, the first evaluation exercise for word sense disambiguation (Kilgarriff and \nPalmer 2000). This article is a revised and extended version of our 1997 workshop paper, \nreviewing its observations and proposals and discussing them in light of the <jats:sc>SENSEVAL<\/jats:sc> exercise. \nIt also includes a new in-depth empirical study of translingually-based sense inventories \nand distance measures, using statistics collected from native-speaker annotations of 222 \npolysemous contexts across 12 languages. These data show that monolingual sense distinctions \nat most levels of granularity can be effectively captured by translations into some set of second \nlanguages, especially as language family distance increases. In addition, the probability that \na given sense pair will tend to lexicalize differently across languages is shown to correlate \nwith semantic salience and sense granularity; sense hierarchies automatically generated from \nsuch distance matrices yield results remarkably similar to those created by professional \nmonolingual lexicographers.<\/jats:p>","DOI":"10.1017\/s1351324999002211","type":"journal-article","created":{"date-parts":[[2002,7,27]],"date-time":"2002-07-27T09:30:22Z","timestamp":1027762222000},"page":"113-133","source":"Crossref","is-referenced-by-count":72,"title":["Distinguishing systems and distinguishing senses: \nnew evaluation methods for Word Sense Disambiguation"],"prefix":"10.1017","volume":"5","author":[{"given":"PHILIP","family":"RESNIK","sequence":"first","affiliation":[]},{"given":"DAVID","family":"YAROWSKY","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[1999,6,1]]},"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324999002211","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,3,29]],"date-time":"2019-03-29T15:17:25Z","timestamp":1553872645000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324999002211\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1999,6]]},"references-count":0,"journal-issue":{"issue":"2","published-print":{"date-parts":[[1999,6]]}},"alternative-id":["S1351324999002211"],"URL":"https:\/\/doi.org\/10.1017\/s1351324999002211","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[1999,6]]}}}