{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T22:15:36Z","timestamp":1766268936217,"version":"3.32.0"},"reference-count":36,"publisher":"Association for Natural Language Processing","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Natural Language Processing"],"published-print":{"date-parts":[[2024]]},"DOI":"10.5715\/jnlp.31.1487","type":"journal-article","created":{"date-parts":[[2024,12,14]],"date-time":"2024-12-14T22:14:29Z","timestamp":1734214469000},"page":"1487-1522","source":"Crossref","is-referenced-by-count":1,"title":["Construction and Analysis of Evaluation Dataset for Japanese Lexical Semantic Change Detection","\u65e5\u672c\u8a9e\u610f\u5473\u5909\u5316\u691c\u51fa\u306e\u305f\u3081\u306e\u8a55\u4fa1\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u306e\u69cb\u7bc9\u3068\u5206\u6790"],"prefix":"10.5715","volume":"31","author":[{"given":"Zhidong","family":"Ling","sequence":"first","affiliation":[{"name":"Tokyo Metropolitan University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taichi","family":"Aida","sequence":"additional","affiliation":[{"name":"Tokyo Metropolitan University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Teruaki","family":"Oka","sequence":"additional","affiliation":[{"name":"Tokyo Metropolitan University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mamoru","family":"Komachi","sequence":"additional","affiliation":[{"name":"Hitotsubashi University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"3685","reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"\u76f8\u7530\u592a\u4e00\uff0c\u5c0f\u753a\u5b88\uff0c\u5c0f\u6728\u66fd\u667a\u4fe1\uff0c\u9ad8\u6751\u5927\u4e5f\uff0c\u6301\u6a4b\u5927\u5730 (2023). \u7570\u306a\u308b\u6642\u671f\u3067\u306e\u610f\u5473\u306e\u9055\u3044\u3092\u6349\u3048\u308b\u5358\u8a9e\u5206\u6563\u8868\u73fe\u306e\u7d50\u5408\u5b66\u7fd2. \u81ea\u7136\u8a00\u8a9e\u51e6\u7406, 30 (2), pp. 275\u2013303. [T. Aida et al. (2023). A Comprehensive Analysis of PMI-based Models for Measuring Semantic Differences. Journal of Natural Language Processing, 30(2), pp. 275\u2013303.].","DOI":"10.5715\/jnlp.30.275"},{"key":"2","unstructured":"\u6d45\u539f\u6b63\u5e78\uff0c\u897f\u5185\u6c99\u6075\uff0c\u52a0\u85e4\u7965 (2020). NWJC-BERT: \u591a\u7fa9\u8a9e\u306b\u5bfe\u3059\u308b\u30d2\u30c8\u3068\u6587\u8108\u5316\u5358\u8a9e\u57cb\u3081\u8fbc\u307f\u306e\u985e\u4f3c\u6027\u5224\u65ad\u306e\u5bfe\u7167\u5206\u6790. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c 26 \u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 961\u2013964. [M. Asahara et al. (2020). NWJC-BERT: Tagigo ni taisuru Hito to Bunmyakuka Tango Ume-komi no Ruiji-sei Handan no Taisho Bunseki. Proceedings of the 26th Annual Meeting of the Association for Natural Language Processing, pp. 961\u2013964.]."},{"key":"3","doi-asserted-by":"crossref","unstructured":"Cassotti, P., Siciliani, L., DeGemmis, M., Semeraro, G., and Basile, P. (2023). \u201cXL-LEXEME: WiC Pretrained Model for Cross-Lingual LEXical sEMantic changE.\u201d In Rogers, A., Boyd-Graber, J., and Okazaki, N. (Eds.), <i>ACL<\/i>, pp. 1577\u20131585, Toronto, Canada. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2023.acl-short.135"},{"key":"4","unstructured":"Castro, S. (2017). \u201cFast Krippendorff: Fast Computation of Krippendorff\u2019s Alpha Agreement Measure.\u201d \\url{https:\/\/github.com\/pln-fing-udelar\/fast-krippendorff}."},{"key":"5","doi-asserted-by":"crossref","unstructured":"Chen, J., Chersoni, E., and Huang, C.-r. (2022). \u201cLexicon of Changes: Towards the Evaluation of Diachronic Semantic Shift in Chinese.\u201d In <i>Proceedings of the 3rd Workshop on Computational Approaches to Historical Language Change<\/i>, pp. 113\u2013118, Dublin, Ireland. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.lchange-1.11"},{"key":"6","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). \u201cBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.\u201d In Burstein, J., Doran, C., and Solorio, T. (Eds.), <i>Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)<\/i>, pp. 4171\u20134186, Minneapolis, Minnesota. Association for Computational Linguistics."},{"key":"7","doi-asserted-by":"crossref","unstructured":"Giulianelli, M., Del Tredici, M., and Fern\u00e1ndez, R. (2020). \u201cAnalysing Lexical Semantic Change with Contextualised Word Representations.\u201d In <i>Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics<\/i>, pp. 3960\u20133973, Online. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2020.acl-main.365"},{"key":"8","doi-asserted-by":"crossref","unstructured":"Giulianelli, M., Kutuzov, A., and Pivovarova, L. (2022). \u201cDo Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change.\u201d In <i>Proceedings of the 3rd Workshop on Computational Approaches to Historical Language Change<\/i>, pp. 54\u201367, Dublin, Ireland. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.lchange-1.6"},{"key":"9","doi-asserted-by":"crossref","unstructured":"Hamilton, W. L., Leskovec, J., and Jurafsky, D. (2016). \u201cDiachronic Word Embeddings Reveal Statistical Laws of Semantic Change.\u201d In <i>Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)<\/i>, pp. 1489\u20131501, Berlin, Germany. Association for Computational Linguistics.","DOI":"10.18653\/v1\/P16-1141"},{"key":"10","doi-asserted-by":"crossref","unstructured":"Hu, R., Li, S., and Liang, S. (2019). \u201cDiachronic Sense Modeling with Deep Contextualized Word Embeddings: An Ecological View.\u201d In Korhonen, A., Traum, D., and M\u00e0rquez, L. (Eds.), <i>Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics<\/i>, pp. 3899\u20133908, Florence, Italy. Association for Computational Linguistics.","DOI":"10.18653\/v1\/P19-1379"},{"key":"11","doi-asserted-by":"crossref","unstructured":"Kim, Y., Chiu, Y.-I., Hanaki, K., Hegde, D., and Petrov, S. (2014). \u201cTemporal Analysis of Language through Neural Language Models.\u201d In Danescu-Niculescu-Mizil, C., Eisenstein, J., McKeown, K., and Smith, N. A. (Eds.), <i>Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science<\/i>, pp. 61\u201365, Baltimore, MD, USA. Association for Computational Linguistics.","DOI":"10.3115\/v1\/W14-2517"},{"key":"12","doi-asserted-by":"crossref","unstructured":"\u5c0f\u6797\u5343\u771f\uff0c\u76f8\u7530\u592a\u4e00\uff0c\u5ca1\u7167\u6643\uff0c\u5c0f\u753a\u5b88 (2023). BERT \u3092\u7528\u3044\u305f\u65e5\u672c\u8a9e\u306e\u610f\u5473\u5909\u5316\u306e\u5206\u6790. \u81ea\u7136\u8a00\u8a9e\u51e6\u7406, 30 (2), pp. 713\u2013747. [K. Kobayashi et al. (2023). Analysis of Semantic Changes in Japanese Words Using BERT. Journal of Natural Language Processing, 30(2), pp. 713\u2013747.].","DOI":"10.5715\/jnlp.30.713"},{"key":"13","doi-asserted-by":"crossref","unstructured":"Kulkarni, V., Al-Rfou, R., Perozzi, B., and Skiena, S. (2015). \u201cStatistically Significant Detection of Linguistic Change.\u201d In <i>Proceedings of the 24th International Conference on World Wide Web<\/i>, WWW \u201915, pp. 625\u2013635, Republic and Canton of Geneva, CHE. International World Wide Web Conferences Steering Committee.","DOI":"10.1145\/2736277.2741627"},{"key":"14","doi-asserted-by":"crossref","unstructured":"Kutuzov, A. and Pivovarova, L. (2021). \u201cThree-part Diachronic Semantic Change Dataset for Russian.\u201d In Tahmasebi, N., Jatowt, A., Xu, Y., Hengchen, S., Montariol, S., and Dubossarsky, H. (Eds.), <i>Proceedings of the 2nd International Workshop on Computational Approaches to Historical Language Change 2021<\/i>, pp. 7\u201313, Online. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2021.lchange-1.2"},{"key":"15","doi-asserted-by":"crossref","unstructured":"Kutuzov, A., Pivovarova, L., and Giulianelli, M. (2021). \u201cGrammatical Profiling for Semantic Change Detection.\u201d In <i>Proceedings of the 25th Conference on Computational Natural Language Learning<\/i>, pp. 423\u2013434, Online. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2021.conll-1.33"},{"key":"16","unstructured":"Kutuzov, A., Touileb, S., M\u00e6hlum, P., Enstad, T., and Wittemann, A. (2022). \u201cNorDiaChange: Diachronic Semantic Change Dataset for Norwegian.\u201d In Calzolari, N., B\u00e9chet, F., Blache, P., Choukri, K., Cieri, C., Declerck, T., Goggi, S., Isahara, H., Maegaard, B., Mariani, J., Mazo, H., Odijk, J., and Piperidis, S. (Eds.), <i>Proceedings of the 13th Language Resources and Evaluation Conference<\/i>, pp. 2563\u20132572, Marseille, France. European Language Resources Association."},{"key":"17","unstructured":"Ling, Z., Aida, T., Oka, T., and Komachi, M. (2023). \u201cConstruction of Evaluation Dataset for Japanese Lexical Semantic Change Detection.\u201d In Huang, C.-R., Harada, Y., Kim, J.-B., Chen, S., Hsu, Y.-Y., Chersoni, E., A, P., Zeng, W. H., Peng, B., Li, Y., and Li, J. (Eds.), <i>Proceedings of the 37th Pacific Asia Conference on Language, Information and Computation<\/i>, pp. 125\u2013136, Hong Kong, China. Association for Computational Linguistics."},{"key":"18","unstructured":"\u9593\u6df5\u6d0b\u5b50\uff0c\u5c0f\u6728\u66fd\u667a\u4fe1 (2021). \u8fd1\u73fe\u4ee3\u65e5\u672c\u8a9e\u306e\u610f\u5473\u5909\u5316\u5206\u6790\u306e\u305f\u3081\u306e\u5358\u8a9e\u30c7\u30fc\u30bf\u30bb\u30c3\u30c8\u69cb\u7bc9\u306e\u8a66\u307f. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c 27 \u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1166\u20131170. [Y. Mabuchi and T. Ogiso (2021). Kingenndai Nihongo no Imihenka Bunseki no Tame no Tango Dataset Kouchiku no Kokoromi. Proceedings of the 27th Annual Meeting of the Association for Natural Language Processing, pp. 1166\u20131170.]."},{"key":"19","doi-asserted-by":"crossref","unstructured":"Maekawa, K., Yamazaki, M., Ogiso, T., Maruyama, T., Ogura, H., Kashino, W., Koiso, H., Yamaguchi, M., Tanaka, M., and Den, Y. (2014). \u201cBalanced Corpus of Contemporary Written Japanese.\u201d <i>Language Resources and Evaluation<\/i>, 48 (2), pp. 345\u2013371.","DOI":"10.1007\/s10579-013-9261-0"},{"key":"20","unstructured":"Mikolov, T., Chen, K., Corrado, G. S., and Dean, J. (2013a). \u201cEfficient Estimation of Word Representations in Vector Space.\u201d In <i>International Conference on Learning Representations<\/i>."},{"key":"21","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., and Dean, J. (2013b). \u201cDistributed Representations of Words and Phrases and their Compositionality.\u201d In Burges, C., Bottou, L., Welling, M., Ghahramani, Z., and Weinberger, K. (Eds.), <i>Advances in Neural Information Processing Systems<\/i>, Vol. 26. Curran Associates, Inc."},{"key":"22","unstructured":"\u6c38\u6fa4\u6e08 (2010). \u5909\u5316\u30d1\u30bf\u30fc\u30f3\u304b\u3089\u307f\u308b\u8fd1\u73fe\u4ee3\u6f22\u8a9e\u306e\u54c1\u8a5e\u7528\u6cd5. \u6771\u4eac\u5927\u5b66\u8a00\u8a9e\u5b66\u8ad6\u96c6, 30, pp. 115\u2013168. [I. Nagasawa (2010). Henka Pattern kara Miru Kingen-dai Kango no Hinshi Yohou. Tokyo Daigaku Gengogaku Ronshu, 30, pp. 115\u2013168.]."},{"key":"23","unstructured":"\u5c0f\u690b\u79c0\u6a39\uff0c\u5c0f\u78ef\u82b1\u7d75\uff0c\u51a8\u58eb\u6c60\u512a\u7f8e\uff0c\u5bae\u5185\u4f50\u591c\u9999\uff0c\u5c0f\u897f\u5149\uff0c\u539f\u88d5 (2011). \u300e\u73fe\u4ee3\u65e5\u672c\u8a9e\u66f8\u304d\u8a00\u8449\u5747\u8861\u30b3\u30fc\u30d1\u30b9\u300f\u5f62\u614b\u8ad6\u60c5\u5831\u898f\u7a0b\u96c6 \u7b2c 4 \u7248\uff08\u4e0b\uff09. \u30c6\u30af\u30cb\u30ab\u30eb\u30fb\u30ec\u30dd\u30fc\u30c8, \u56fd\u7acb\u56fd\u8a9e\u7814\u7a76\u6240, pp. 1\u2013172, (1)\u2013(55). [H. Ogura et al. (2011). Gendai Nihongo Kakikotoba Kin-ko Corpus Keitaeron Joho Kiteishu Dai 4 Han (Ge). Kokuritsu Kokugo Kenkyusho, pp. 1\u2013172, (1)\u2013(55).]."},{"key":"24","unstructured":"Pilehvar, M. T. and Camacho-Collados, J. (2019). \u201cWiC: the Word-in-Context Dataset for Evaluating Context-Sensitive Meaning Representations.\u201d In Burstein, J., Doran, C., and Solorio, T. (Eds.), <i>Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)<\/i>, pp. 1267\u20131273, Minneapolis, Minnesota. Association for Computational Linguistics."},{"key":"25","doi-asserted-by":"crossref","unstructured":"Rodina, J. and Kutuzov, A. (2020). \u201cRuSemShift: A Dataset of Historical Lexical Semantic Change in Russian.\u201d In <i>Proceedings of the 28th International Conference on Computational Linguistics<\/i>, pp. 1037\u20131047, Barcelona, Spain (Online). International Committee on Computational Linguistics.","DOI":"10.18653\/v1\/2020.coling-main.90"},{"key":"26","doi-asserted-by":"crossref","unstructured":"Rosin, G. D., Guy, I., and Radinsky, K. (2022). \u201cTime Masking for Temporal Language Models.\u201d In <i>ACM International Conference on Web Search and Data Mining<\/i>, \\textit{The 22th ACM International Conference on Web Search and Data Mining}, pp. 833\u2013841, New York, NY, USA. Association for Computing Machinery.","DOI":"10.1145\/3488560.3498529"},{"key":"27","doi-asserted-by":"crossref","unstructured":"Rosin, G. D. and Radinsky, K. (2022). \u201cTemporal Attention for Language Models.\u201d In Carpuat, M., de Marneffe, M.-C., and Meza Ruiz, I. V. (Eds.), <i>Findings of the Association for Computational Linguistics: NAACL 2022<\/i>, pp. 1498\u20131508, Seattle, United States. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.findings-naacl.112"},{"key":"28","doi-asserted-by":"crossref","unstructured":"Rousseeuw, P. J. (1987). \u201cSilhouettes: A Graphical Aid to The Interpretation and Validation of Cluster Analysis.\u201d <i>Journal of Computational and Applied Mathematics<\/i>, 20, pp. 53\u201365.","DOI":"10.1016\/0377-0427(87)90125-7"},{"key":"29","unstructured":"\u51cc\u5fd7\u68df\uff0c\u76f8\u7530\u592a\u4e00\uff0c\u5ca1\u7167\u6643\uff0c\u5c0f\u753a\u5b88 (2024). \u65e5\u672c\u8a9e\u610f\u5473\u5909\u5316\u691c\u51fa\u306e\u8a55\u4fa1\u30bb\u30c3\u30c8\u306e\u62e1\u5f35\u3068\u691c\u51fa\u624b\u6cd5\u306e\u8a55\u4fa1. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c 30 \u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 194\u2013199. [Z. Ling et al. (2024). Nihongo Imihenka Kenshutsu no Hyokaset-to no Kakucho to Kenshutsu Shuho no Hyoka. Proceedings of the 30th Annual Meeting of the Association for Natural Language Processing, pp. 194\u2013199.]."},{"key":"30","doi-asserted-by":"crossref","unstructured":"Schlechtweg, D., H\u00e4tty, A., Del Tredici, M., and Schulte im Walde, S. (2019). \u201cA Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domains.\u201d In <i>Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics<\/i>, pp. 732\u2013746, Florence, Italy. Association for Computational Linguistics.","DOI":"10.18653\/v1\/P19-1072"},{"key":"31","doi-asserted-by":"crossref","unstructured":"Schlechtweg, D., McGillivray, B., Hengchen, S., Dubossarsky, H., and Tahmasebi, N. (2020). \u201cSemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection.\u201d In <i>Proceedings of the 14th Workshop on Semantic Evaluation<\/i>, pp. 1\u201323, Barcelona (online). International Committee for Computational Linguistics.","DOI":"10.18653\/v1\/2020.semeval-1.1"},{"key":"32","doi-asserted-by":"crossref","unstructured":"Schlechtweg, D., Schulte im Walde, S., and Eckmann, S. (2018). \u201cDiachronic Usage Relatedness (DURel): A Framework for the Annotation of Lexical Semantic Change.\u201d In <i>Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)<\/i>, pp. 169\u2013174, New Orleans, Louisiana. Association for Computational Linguistics.","DOI":"10.18653\/v1\/N18-2027"},{"key":"33","doi-asserted-by":"crossref","unstructured":"Schlechtweg, D., Tahmasebi, N., Hengchen, S., Dubossarsky, H., and McGillivray, B. (2021). \u201cDWUG: A Large Resource of Diachronic Word Usage Graphs in Four Languages.\u201d In <i>Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing<\/i>, pp. 7079\u20137091, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2021.emnlp-main.567"},{"key":"34","unstructured":"\u7530\u4e2d\u4f51 (2015). \u8fd1\u73fe\u4ee3\u65e5\u672c\u8a9e\u306b\u304a\u3051\u308b\u65b0\u305f\u306a\u52a9\u6570\u8a5e\u306e\u6210\u7acb\u3068\u5b9a\u7740. Ph.D. thesis, \u7b51\u6ce2\u5927\u5b66 (University of Tsukuba). [Y. Tanaka (2015). Kingen-dai Nihongo ni okeru Aratana Josushi no Seiritsu to Teichaku. University of Tsukuba.]."},{"key":"35","doi-asserted-by":"crossref","unstructured":"Yao, Z., Sun, Y., Ding, W., Rao, N., and Xiong, H. (2018). \u201cDynamic Word Embeddings for Evolving Semantic Discovery.\u201d In <i>Proceedings of the 11th ACM International Conference on Web Search and Data Mining<\/i>, <i>The 18th ACM International Conference on Web Search and Data Mining<\/i>, pp. 673\u2013681, New York, NY, USA. Association for Computing Machinery.","DOI":"10.1145\/3159652.3159703"},{"key":"36","doi-asserted-by":"crossref","unstructured":"Zamora-Reina, F. D., Bravo-Marquez, F., and Schlechtweg, D. (2022). \u201cLSCDiscovery: A Shared Task on Semantic Change Discovery and Detection in Spanish.\u201d In <i>LChange<\/i>, pp. 149\u2013164, Dublin, Ireland. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.lchange-1.16"}],"container-title":["Journal of Natural Language Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/jnlp\/31\/4\/31_1487\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,21]],"date-time":"2024-12-21T04:30:57Z","timestamp":1734755457000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/jnlp\/31\/4\/31_1487\/_article\/-char\/ja\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"references-count":36,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024]]}},"URL":"https:\/\/doi.org\/10.5715\/jnlp.31.1487","relation":{},"ISSN":["1340-7619","2185-8314"],"issn-type":[{"type":"print","value":"1340-7619"},{"type":"electronic","value":"2185-8314"}],"subject":[],"published":{"date-parts":[[2024]]}}}