{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,21]],"date-time":"2025-06-21T04:40:09Z","timestamp":1750480809389,"version":"3.41.0"},"reference-count":16,"publisher":"Association for Natural Language Processing","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Natural Language Processing"],"published-print":{"date-parts":[[2025]]},"DOI":"10.5715\/jnlp.32.738","type":"journal-article","created":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T22:09:48Z","timestamp":1749938988000},"page":"738-745","source":"Crossref","is-referenced-by-count":0,"title":["NLP2025 Workshop: Present and Future of Natural Language Evaluation in the LLM Era","NLP2025 \u30ef\u30fc\u30af\u30b7\u30e7\u30c3\u30d7\uff1aLLM\u6642\u4ee3\u306e\u3053\u3068\u3070\u306e\u8a55\u4fa1\u306e\u73fe\u5728\u3068\u672a\u6765"],"prefix":"10.5715","volume":"32","author":[{"given":"Katsuhito","family":"Sudoh","sequence":"first","affiliation":[{"name":"Nara Women\u2019s University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mamoru","family":"Komachi","sequence":"additional","affiliation":[{"name":"Hitotsubashi University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tomoyuki","family":"Kajiwara","sequence":"additional","affiliation":[{"name":"Ehime University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masato","family":"Mita","sequence":"additional","affiliation":[{"name":"Recruit Co., Ltd."},{"name":"Tokyo Metropolitan University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"3685","reference":[{"key":"1","unstructured":"Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J. D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., and Amodei, D. (2020). \u201cLanguage Models are Few-Shot Learners.\u201d In <i>Advances in Neural Information Processing Systems<\/i>, Vol. 33, pp. 1877\u20131901."},{"key":"2","doi-asserted-by":"crossref","unstructured":"Bryant, C., Felice, M., and Briscoe, T. (2017). \u201cAutomatic Annotation and Evaluation of Error Types for Grammatical Error Correction.\u201d In <i>Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)<\/i>, pp. 793\u2013805.","DOI":"10.18653\/v1\/P17-1074"},{"key":"3","unstructured":"Felice, M., Bryant, C., and Briscoe, T. (2016). \u201cAutomatic Extraction of Learner Errors in ESL Sentences Using Linguistically Enhanced Alignments.\u201d In <i>Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers<\/i>, pp. 825\u2013835. The COLING 2016 Organizing Committee."},{"key":"4","doi-asserted-by":"crossref","unstructured":"Gong, P., Liu, X., Huang, H., and Zhang, M. (2022). \u201cRevisiting Grammatical Error Correction Evaluation and Beyond.\u201d In <i>Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing<\/i>, pp. 6891\u20136902.","DOI":"10.18653\/v1\/2022.emnlp-main.463"},{"key":"5","doi-asserted-by":"crossref","unstructured":"Gotou, T., Nagata, R., Mita, M., and Hanawa, K. (2020). \u201cTaking the Correction Difficulty into Account in Grammatical Error Correction Evaluation.\u201d In <i>Proceedings of the 28th International Conference on Computational Linguistics<\/i>, pp. 2085\u20132095.","DOI":"10.18653\/v1\/2020.coling-main.188"},{"key":"6","doi-asserted-by":"crossref","unstructured":"Guerreiro, N. M., Rei, R., Stigt, D. v., Coheur, L., Colombo, P., and Martins, A. F. T. (2024). \u201cxcomet: Transparent Machine Translation Evaluation through Fine-grained Error Detection.\u201d <i>Transactions of the Association for Computational Linguistics<\/i>, 12, pp. 979\u2013995.","DOI":"10.1162\/tacl_a_00683"},{"key":"7","unstructured":"Kobayashi, M., Mita, M., and Komachi, M. (2024). \u201cLarge Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction.\u201d In <i>Proceedings of the 19th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2024)<\/i>, pp. 68\u201377."},{"key":"8","doi-asserted-by":"crossref","unstructured":"Kocmi, T. and Federmann, C. (2023). \u201cGEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4.\u201d In <i>Proceedings of the Eighth Conference on Machine Translation<\/i>, pp. 768\u2013775. Association for Computational Linguistics.","DOI":"10.18653\/v1\/2023.wmt-1.64"},{"key":"9","unstructured":"Maeda, K., Kaneko, M., and Okazaki, N. (2022). \u201cIMPARA: Impact-Based Metric for GEC Using Parallel Data.\u201d In <i>Proceedings of the 29th International Conference on Computational Linguistics<\/i>, pp. 3578\u20133588."},{"key":"10","doi-asserted-by":"crossref","unstructured":"Napoles, C., Sakaguchi, K., Post, M., and Tetreault, J. (2015). \u201cGround Truth for Grammatical Error Correction Metrics.\u201d In <i>Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers)<\/i>, pp. 588\u2013593.","DOI":"10.3115\/v1\/P15-2097"},{"key":"11","unstructured":"Napoles, C., Sakaguchi, K., Post, M., and Tetreault, J. (2016). \u201cGLEU Without Tuning.\u201d <i>arXiv preprint arXiv:1605.02592<\/i>."},{"key":"12","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002). \u201cBleu: A Method for Automatic Evaluation of Machine Translation.\u201d In <i>Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics<\/i>, pp. 311\u2013318.","DOI":"10.3115\/1073083.1073135"},{"key":"13","doi-asserted-by":"crossref","unstructured":"Popovi\u0107, M. (2015). \u201cchrF: Character N-gram F-score for Automatic MT Evaluation.\u201d In <i>Proceedings of the Tenth Workshop on Statistical Machine Translation<\/i>, pp. 392\u2013395.","DOI":"10.18653\/v1\/W15-3049"},{"key":"14","doi-asserted-by":"crossref","unstructured":"Rei, R., Stewart, C., Farinha, A. C., and Lavie, A. (2020). \u201cCOMET: A Neural Framework for MT Evaluation.\u201d In <i>Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)<\/i>, pp. 2685\u20132702.","DOI":"10.18653\/v1\/2020.emnlp-main.213"},{"key":"15","unstructured":"\u6a3d\u672c\u7a7a\u5b99\uff0c\u68b6\u539f\u667a\u4e4b\uff0c\u4e8c\u5bae\u5d07 (2025). \u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\u306e\u6587\u751f\u6210\u78ba\u7387\u3092\u7528\u3044\u305f\u6559\u5e2b\u306a\u3057\u54c1\u8cea\u63a8\u5b9a. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c 31 \u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 2821\u20132825. [S. Tarumoto et al. (2025). Daikibo Gengo Moderu no Bunseisei Kakuritsu wo Mochiita Kyoshi nashi Hinshitsu Suitei. Proceedings of the 31th Annual Meeting of the Association for Natural Language Processing, pp. 2821\u20132825.]."},{"key":"16","unstructured":"Zhang, T., Kishore, V., Wu, F., Weinberger, K. Q., and Artzi, Y. (2020). \u201cBERTScore: Evaluating Text Generation with BERT.\u201d <i>arXiv preprint arXiv:1904.09675<\/i>."}],"container-title":["Journal of Natural Language Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/jnlp\/32\/2\/32_738\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,21]],"date-time":"2025-06-21T04:13:27Z","timestamp":1750479207000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/jnlp\/32\/2\/32_738\/_article\/-char\/ja\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"references-count":16,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.5715\/jnlp.32.738","relation":{},"ISSN":["1340-7619","2185-8314"],"issn-type":[{"type":"print","value":"1340-7619"},{"type":"electronic","value":"2185-8314"}],"subject":[],"published":{"date-parts":[[2025]]}}}