{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,6,15]],"date-time":"2024-06-15T05:21:44Z","timestamp":1718428904284},"reference-count":11,"publisher":"Association for Natural Language Processing","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Natural Language Processing"],"published-print":{"date-parts":[[2023]]},"DOI":"10.5715\/jnlp.30.844","type":"journal-article","created":{"date-parts":[[2023,6,14]],"date-time":"2023-06-14T22:14:21Z","timestamp":1686780861000},"page":"844-850","source":"Crossref","is-referenced-by-count":1,"title":["Theme Session in NLP 2023: Evaluation and Quality Estimation of Natural Language","NLP2023 \u30c6\u30fc\u30de\u30bb\u30c3\u30b7\u30e7\u30f3\u300c\u3053\u3068\u3070\u306e\u8a55\u4fa1\u3068\u54c1\u8cea\u63a8\u5b9a\u300d"],"prefix":"10.5715","volume":"30","author":[{"given":"Katsuhito","family":"Sudoh","sequence":"first","affiliation":[{"name":"Nara Institute of Science and Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mamoru","family":"Komachi","sequence":"additional","affiliation":[{"name":"Hitotsubashi University"},{"name":"Tokyo Metropolitan University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tomiyuki","family":"Kajiwara","sequence":"additional","affiliation":[{"name":"Ehime University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masato","family":"Mita","sequence":"additional","affiliation":[{"name":"CyberAgent Inc."},{"name":"Tokyo Metropolitan University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"3685","reference":[{"key":"1","unstructured":"Panatchakorn Anantaprayoon\uff0c\u91d1\u5b50\u6b63\u5f18\uff0c\u5ca1\u5d0e\u76f4\u89b3 (2023). \u4e0b\u6d41\u30bf\u30b9\u30af\u3067\u306e\u65e5\u672c\u8a9e\u4e8b\u524d\u5b66\u7fd2\u30e2\u30c7\u30eb\u306e\u6027\u5225\u30d0\u30a4\u30a2\u30b9\u306e\u8a55\u4fa1. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1563\u20131568. [P. Anantaprayoon et al. (2023). Karyu Tasuku deno Nihongo Jizen Gakushu Moderu no Seibetsu Baiasu no Hyoka. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1563\u20131568.]."},{"key":"2","unstructured":"\u661f\u91ce\u7fd4\uff0c\u5f35\u57f9\u6960 (2023). \u81ea\u7136\u8a00\u8a9e\u751f\u6210\u306b\u304a\u3051\u308b\u30bf\u30b9\u30af\u6a2a\u65ad\u81ea\u52d5\u8a55\u4fa1\u306e\u30e1\u30bf\u5206\u6790. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1267\u20131271. [S. Hoshino and P. Zhang (2023). Shizen Gengo Seisei niokeru Tasuku Odan Jido Hyoka no Meta Bunseki. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1267\u20131271.]."},{"key":"3","unstructured":"Kocmi, T. and Federmann, C. (2023). \u201cLarge Language Models Are State-of-the-Art Evaluators of Translation Quality.\u201d <i>arXiv preprint 2302.14520 [cs.CL]<\/i>."},{"key":"4","unstructured":"\u5c0f\u6c60\u592e\u665f\uff0c\u65e9\u77e2\u4ed5\u6643\u7ae0 (2023). \u30c6\u30ad\u30b9\u30c8\u30fb\u753b\u50cf\u306b\u3088\u308b\u60c5\u5831\u6d88\u5316\u52b9\u7387\u306e\u30e1\u30c7\u30a3\u30a2\u5225\u69cb\u6210\u56e0\u5b50\u62bd\u51fa. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1553\u20131556. [H. Koike and T. Hayashi (2023). Tekisuto\u30fbGazo niyoru Joho Shoka Koritsu no Mediabetsu Koseiinshi Chushutsu. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1553\u20131556.]."},{"key":"5","unstructured":"\u9ed2\u7530\u52c7\u6597\uff0c\u85e4\u7530\u7be4\uff0c\u68b6\u539f\u667a\u4e4b\uff0c\u4e8c\u5bae\u5d07 (2023). \u7591\u4f3c\u8a13\u7df4\u30c7\u30fc\u30bf\u306b\u57fa\u3065\u304f\u6a5f\u68b0\u7ffb\u8a33\u306e\u6559\u5e2b\u306a\u3057\u54c1\u8cea\u63a8\u5b9a. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1283\u20131287. [Y. Kuroda et al. (2023). Giji Kunren Deta ni Motozuku Kikai Honyaku no Kyoshinashi Hinshitsu Suitei. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1283\u20131287.]."},{"key":"6","unstructured":"\u674e\u5728\u93ac\uff0c\u9577\u8c37\u90e8\u967d\u4e00\u90ce\uff0c\u4f0a\u96c6\u9662\u90c1\u5b50\uff0c\u9752\u6728\u512a\u5b50\uff0c\u6751\u7530\u88d5\u7f8e\u5b50 (2023). \u5b66\u7fd2\u8005\u4f5c\u6587\u8a55\u4fa1\u30b7\u30b9\u30c6\u30e0\u300cjWriter\u300d\u306b\u3088\u308b\u7fd2\u719f\u5ea6\u3068\u8ad6\u7406\u6027\u306e\u81ea\u52d5\u8a55\u4fa1. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1569\u20131573. [J. Lee et al. (2023). Gakushusha Sakubun Hyoka Shisutemu \u2018`jWriter\u2019&apos; niyoru Shujukudo to Ronrisei no Jido Hyoka. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1569\u20131573.]."},{"key":"7","unstructured":"\u8494\u82d7\u8309\u90a3\uff0c\u9808\u85e4\u514b\u4ec1\uff0c\u4e2d\u6751\u54f2\uff0c\u677e\u4e0b\u4f73\u4e16\uff0c\u5c71\u7530\u512a (2023). \u540c\u6642\u901a\u8a33\u54c1\u8cea\u8a55\u4fa1\u65b9\u6cd5\u691c\u8a0e\u306e\u305f\u3081\u306e\u540c\u6642\u901a\u8a33\u8005\u3068\u7ffb\u8a33\u8005\u306e\u8a55\u4fa1\u6bd4\u8f03\u5206\u6790. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1277\u20131282. [M. Makinae et al. (2023). Doji Tsuyaku Hinshitsu Hyoka Hoho Kento no tameno Doji Tsuyakusha to Honyakusha no Hyoka Hikaku Bunseki. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1277\u20131282.]."},{"key":"8","unstructured":"\u91ce\u53e3\u590f\u5e0c\uff0c\u68b6\u539f\u667a\u4e4b (2023). \u5165\u529b\u6587\u3068\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u30e2\u30c7\u30eb\u306e\u76f8\u6027\u5224\u5b9a. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1288\u20131292. [N. Noguchi and T. Kajiwara (2023). Nyuryokubun to Shizen Gengo Shori Moderu no Aisho Hantei. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1288\u20131292.]."},{"key":"9","unstructured":"\u65b0\u4fdd\u5f70\u4eba\uff0c\u5c71\u7530\u5bdb\u7ae0\uff0c\u5fb3\u6c38\u5065\u4f38 (2023). \u53c2\u7167\u4f8b\u3092\u4f7f\u308f\u306a\u3044\u30ad\u30e3\u30c3\u30c1\u30b3\u30d4\u30fc\u306e\u81ea\u52d5\u8a55\u4fa1. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1557\u20131562. [A. Shimbo et al. (2023). Sanshorei wo Tsukawanai Kyatchikopi no Jido Hyoka. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1557\u20131562.]."},{"key":"10","doi-asserted-by":"crossref","unstructured":"\u9808\u85e4\u514b\u4ec1\uff0c\u5c0f\u753a\u5b88\uff0c\u68b6\u539f\u667a\u4e4b (2021). NLP2021 \u30ef\u30fc\u30af\u30b7\u30e7\u30c3\u30d7\uff1a\u6587\u7ae0\u306e\u8a55\u4fa1\u3068\u54c1\u8cea\u63a8\u5b9a \uff5e\u4eba\u9593\u30fb\u6a5f\u68b0\u306e\u300c\u4f5c\u6587\u300d\u306e\u5de7\u62d9\u3092\u3069\u3046\u898b\u6975\u3081\u308b\u304b\uff1f\uff5e. \u81ea\u7136\u8a00\u8a9e\u51e6\u7406, 28 (3), pp. 895\u2013900. [K. Sudoh et al. (2021). NLP2021 Workshop: Evaluation and Quality Estimation of Text\u2015How Do We Judge Human- and Machine-generated Text Good or Bad? Journal of Natural Language Processing, 28 (3), pp. 895\u2013900.].","DOI":"10.5715\/jnlp.28.895"},{"key":"11","unstructured":"\u5c71\u4e2d\u5149\uff0c\u5fb3\u6c38\u5065\u4f38 (2023). \u7de8\u96c6\u64cd\u4f5c\u306b\u3088\u308b\u30c7\u30fc\u30bf\u62e1\u5f35\u3092\u7528\u3044\u305f\u30c6\u30ad\u30b9\u30c8\u5e73\u6613\u5316\u306e\u81ea\u52d5\u8a55\u4fa1. \u8a00\u8a9e\u51e6\u7406\u5b66\u4f1a\u7b2c29\u56de\u5e74\u6b21\u5927\u4f1a\u767a\u8868\u8ad6\u6587\u96c6, pp. 1272\u20131276. [H. Yamanaka and T. Tokunaga (2023). Henshu Sosa niyoru Deta Kakucho wo Mochiita Tekisuto Heiika no Jido Hyoka. The Proceedings of the 29th Annual Meeting of the Association for Natural Language Processing, pp. 1272\u20131276.]."}],"container-title":["Journal of Natural Language Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/jnlp\/30\/2\/30_844\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,10]],"date-time":"2024-05-10T05:11:49Z","timestamp":1715317909000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/jnlp\/30\/2\/30_844\/_article\/-char\/ja\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"references-count":11,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023]]}},"URL":"https:\/\/doi.org\/10.5715\/jnlp.30.844","relation":{},"ISSN":["1340-7619","2185-8314"],"issn-type":[{"value":"1340-7619","type":"print"},{"value":"2185-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023]]}}}