{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,11,2]],"date-time":"2024-11-02T07:40:21Z","timestamp":1730533221473,"version":"3.28.0"},"reference-count":21,"publisher":"Walter de Gruyter GmbH","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,2,26]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p xml:lang=\"en\">We present a word similarity gold standard for Akkadian, a language documented in ancient Mesopotamian sources from the 24th century BCE until the first century CE. The gold standard comprises 300 word pairs ranked by their paradigmatic similarity by five independently working Assyriologists. We use the gold standard to tune PMI + SVD and fastText models to improve their performance. We also present a hyper-parametrized PMI + SVD model for building count-based word embeddings, that aims to deal with the data sparsity and repetition issues encountered in Akkadian texts. Our model combines Dirichlet smoothing with context distribution smoothing, and uses context similarity weighting to down-sample distortion caused by formulaic litanies and partially or fully duplicated passages.<\/jats:p>","DOI":"10.1515\/itit-2023-0065","type":"journal-article","created":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T00:24:56Z","timestamp":1727223896000},"page":"4-14","source":"Crossref","is-referenced-by-count":0,"title":["Towards a word similarity gold standard for Akkadian: creation and model optimization"],"prefix":"10.1515","volume":"66","author":[{"given":"Aleksi","family":"Sahala","sequence":"first","affiliation":[{"name":"Digital Humanities , University of Helsinki , Helsinki , Finland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Beatrice","family":"Baragli","sequence":"additional","affiliation":[{"name":"Ancient Near Eastern Studies , University of W\u00fcrzburg , W\u00fcrzburg , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giulia","family":"Lentini","sequence":"additional","affiliation":[{"name":"Ancient History , LMU Munich , Munich , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Poppy","family":"Tushingham","sequence":"additional","affiliation":[{"name":"Ancient History , LMU Munich , Munich , Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2024,9,25]]},"reference":[{"key":"2024110207213606504_j_itit-2023-0065_ref_001","doi-asserted-by":"crossref","unstructured":"F. Hill, R. Reichart, and A. Korhonen, \u201cSimlex-999: evaluating semantic models with (genuine) similarity estimation,\u201d Comput. Linguist., vol.\u00a041, no.\u00a04, pp.\u00a0665\u2013695, 2015. https:\/\/doi.org\/10.1162\/coli_a_00237.","DOI":"10.1162\/COLI_a_00237"},{"key":"2024110207213606504_j_itit-2023-0065_ref_002","doi-asserted-by":"crossref","unstructured":"L. Finkelstein, et al.., \u201cPlacing search in context: the concept revisited,\u201d in Proceedings of the 10th International Conference on World Wide Web, 2001, pp.\u00a0406\u2013414.","DOI":"10.1145\/371920.372094"},{"key":"2024110207213606504_j_itit-2023-0065_ref_003","doi-asserted-by":"crossref","unstructured":"E. Bruni, N.-K. Tran, and M. Baroni, \u201cMultimodal distributional semantics,\u201d J. Artif. Intell. Res., vol.\u00a049, pp.\u00a01\u201347, 2014. https:\/\/doi.org\/10.1613\/jair.4135.","DOI":"10.1613\/jair.4135"},{"key":"2024110207213606504_j_itit-2023-0065_ref_004","doi-asserted-by":"crossref","unstructured":"B. Kouwenberg, \u201cAkkadian in general,\u201d in The Semitic Languages: An International Handbook, S. Weninger, Ed., De Gruyter Mouton, 2011.","DOI":"10.1515\/9783110251586.330"},{"key":"2024110207213606504_j_itit-2023-0065_ref_005","unstructured":"W. von Soden, Grundriss der akkadischen Grammatik, 3rd ed. Rome, Pontifical Biblical Institute, 1995."},{"key":"2024110207213606504_j_itit-2023-0065_ref_006","unstructured":"J. A. Black, A. R. George, and J. N. Postgate, A Concise Dictionary of Akkadian, vol.\u00a05, Wiesbaden, Otto Harrassowitz Verlag, 2000."},{"key":"2024110207213606504_j_itit-2023-0065_ref_007","unstructured":"J. R. Firth, A Synopsis of Linguistic Theory 1930-55, vols. 1952\u201359, Oxford, The Philological Society, 1957."},{"key":"2024110207213606504_j_itit-2023-0065_ref_008","unstructured":"T. Mikolov, K. Chen, G. Corrado, and J. Dean, \u201cEfficient estimation of word representations in vector space,\u201d arXiv:1301:3781v3, 2013."},{"key":"2024110207213606504_j_itit-2023-0065_ref_009","doi-asserted-by":"crossref","unstructured":"P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov, \u201cEnriching word vectors with subword information,\u201d arXiv preprint arXiv:1607.04606, 2016.","DOI":"10.1162\/tacl_a_00051"},{"key":"2024110207213606504_j_itit-2023-0065_ref_010","doi-asserted-by":"crossref","unstructured":"J. Pennington, R. Socher, and C. Manning, \u201cGloVe: global vectors for word representation,\u201d in Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, Association for Computational Linguistics, 2014, pp.\u00a01532\u20131543.","DOI":"10.3115\/v1\/D14-1162"},{"key":"2024110207213606504_j_itit-2023-0065_ref_011","unstructured":"J. Jungmaier, N. Kassner, and B. Roth, \u201cDirichlet-smoothed word embeddings for low-resource settings,\u201d in Proceedings of the Twelfth Language Resources and Evaluation Conference, Marseille, France, European Language Resources Association, 2020, pp.\u00a03560\u20133565."},{"key":"2024110207213606504_j_itit-2023-0065_ref_012","unstructured":"O. Levy and Y. Goldberg, \u201cNeural word embedding as implicit matrix factorization,\u201d in Proceedings of the 27th International Conference on Neural Information Processing Systems \u2013 Volume 2, Cambridge, MA, USA, NIPS\u201914, MIT Press, 2014, pp.\u00a02177\u20132185."},{"key":"2024110207213606504_j_itit-2023-0065_ref_013","doi-asserted-by":"crossref","unstructured":"O. Levy, Y. Goldberg, and I. Dagan, \u201cImproving distributional similarity with lessons learned from word embeddings,\u201d Trans. Assoc. Comput. Linguist., vol.\u00a03, pp.\u00a0211\u2013225, 2015. https:\/\/doi.org\/10.1162\/tacl_a_00134.","DOI":"10.1162\/tacl_a_00134"},{"key":"2024110207213606504_j_itit-2023-0065_ref_014","unstructured":"K. Church and P. Hanks, \u201cWord association norms, mutual information, and lexicography,\u201d Comput. Linguist., vol.\u00a016, no.\u00a01, pp.\u00a022\u201329, 1990."},{"key":"2024110207213606504_j_itit-2023-0065_ref_015","unstructured":"G. J. Bouma, \u201cNormalized (pointwise) mutual information in collocation extraction,\u201d in Proceedings of GSCL, vol.\u00a030, 2009."},{"key":"2024110207213606504_j_itit-2023-0065_ref_016","unstructured":"M. Sahlgren, The Word-Space Model, Stockholm, Stockholm University, 2006."},{"key":"2024110207213606504_j_itit-2023-0065_ref_017","doi-asserted-by":"crossref","unstructured":"A. Sahala and K. Lind\u00e9n, \u201cImproving word association measures in repetitive corpora with context similarity weighting,\u201d in Proceedings of the 12th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, IC3K 2020, Volume 1: KDIR, Budapest, Hungary, November 2-4, 2020, A. Fred and J. Filipe, Eds., Portugal, SCITEPRESS Science and Technology Publications, 2020, pp.\u00a048\u201358.","DOI":"10.5220\/0010106800480058"},{"key":"2024110207213606504_j_itit-2023-0065_ref_018","unstructured":"R. \u0158eh\u016f\u0159ek and P. Sojka, \u201cSoftware framework for topic modelling with large corpora,\u201d in Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, Valletta, Malta, ELRA, 2010, pp.\u00a045\u201350."},{"key":"2024110207213606504_j_itit-2023-0065_ref_019","unstructured":"S. Bird, E. Klein, and E. Loper, Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit, Beijing, O\u2019Reilly, 2009."},{"key":"2024110207213606504_j_itit-2023-0065_ref_020","doi-asserted-by":"crossref","unstructured":"P. D. Turney and P. Pantel, \u201cFrom frequency to meaning: vector space models of semantics,\u201d J. Artif. Intell. Res., vol.\u00a037, pp.\u00a0141\u2013188, 2010. https:\/\/doi.org\/10.1613\/jair.2934.","DOI":"10.1613\/jair.2934"},{"key":"2024110207213606504_j_itit-2023-0065_ref_021","doi-asserted-by":"crossref","unstructured":"H. Rubenstein and J. B. Goodenough, \u201cContextual correlates of synonymy,\u201d Commun. ACM, vol.\u00a08, no.\u00a010, pp.\u00a0627\u2013633, 1965. https:\/\/doi.org\/10.1145\/365628.365657.","DOI":"10.1145\/365628.365657"}],"container-title":["it - Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2023-0065\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2023-0065\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,2]],"date-time":"2024-11-02T07:22:12Z","timestamp":1730532132000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2023-0065\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,1]]},"references-count":21,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,10,30]]},"published-print":{"date-parts":[[2024,2,26]]}},"alternative-id":["10.1515\/itit-2023-0065"],"URL":"https:\/\/doi.org\/10.1515\/itit-2023-0065","relation":{},"ISSN":["1611-2776","2196-7032"],"issn-type":[{"type":"print","value":"1611-2776"},{"type":"electronic","value":"2196-7032"}],"subject":[],"published":{"date-parts":[[2024,2,1]]}}}