{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:14:40Z","timestamp":1750306480438,"version":"3.41.0"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2016,1,28]],"date-time":"2016-01-28T00:00:00Z","timestamp":1453939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61203313, 61462044, 61462045, 61402208"],"award-info":[{"award-number":["61203313, 61462044, 61462045, 61402208"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Natural Science Foundation of Jiangxi Provincial Department of Science and Technology of China","award":["20151BAB207025"],"award-info":[{"award-number":["20151BAB207025"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2016,3,8]]},"abstract":"<jats:p>\n            Automatic evaluation of machine translations is an important task. Most existing evaluation metrics rely on matching the same word or letter\n            <jats:italic>n<\/jats:italic>\n            -grams. This strategy leads to poor results on Chinese translations because one has to rely merely on matching identical characters. In this article, we propose a new evaluation metric that allows different characters with the same or similar meaning to match. An Indirect Hidden Markov Model (IHMM) is proposed to align the Chinese translation with human references at the character level. In the model, the emission probabilities are estimated by character similarity, including character semantic similarity and character surface similarity, and transition probabilities are estimated by a heuristic distance-based distortion model. When evaluating the submitted output of English-to-Chinese translation systems in the IWSLT\u201908 CT-EC and NIST\u201908 EC tasks, the experimental results indicate that the proposed metric has a significantly better correlation with human evaluation than the state-of-the-art machine translation metrics (i.e., BLEU, Meteor Universal, and TESLA-CELAB). This study shows that it is important to allow different characters to match in the evaluation of Chinese translations and that the IHMM is a reasonable approach for the alignment of Chinese characters.\n          <\/jats:p>","DOI":"10.1145\/2815619","type":"journal-article","created":{"date-parts":[[2016,2,1]],"date-time":"2016-02-01T20:37:54Z","timestamp":1454359074000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Modeling Monolingual Character Alignment for Automatic Evaluation of Chinese Translation"],"prefix":"10.1145","volume":"15","author":[{"given":"Maoxi","family":"Li","sequence":"first","affiliation":[{"name":"Jiangxi Normal University, Nanchang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingwen","family":"Wang","sequence":"additional","affiliation":[{"name":"Jiangxi Normal University, Nanchang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanxi","family":"Li","sequence":"additional","affiliation":[{"name":"Jiangxi Normal University, Nanchang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fan","family":"Xu","sequence":"additional","affiliation":[{"name":"Jiangxi Normal University, Nanchang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,1,28]]},"reference":[{"volume-title":"Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization. Association for Computational Linguistics","author":"Banerjee S.","key":"e_1_2_1_1_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_2_1","DOI":"10.5555\/92858.92860"},{"doi-asserted-by":"publisher","key":"e_1_2_1_3_1","DOI":"10.5555\/972470.972474"},{"volume-title":"Findings of the 2013 workshop on statistical machine translation. In Proceedings of the 8th Workshop on Statistical Machine Translation (WMT). Association for Computational Linguistics","author":"Bojar O.","key":"e_1_2_1_4_1"},{"volume-title":"Findings of the 2014 workshop on statistical machine translation. In Proceedings of the 9th Workshop on Statistical Machine Translation (WMT). Association for Computational Linguistics","year":"2014","author":"Bojar O.","key":"e_1_2_1_5_1"},{"volume-title":"Findings of the 2012 workshop on statistical machine translation. In Proceedings of the 7th Workshop on Statistical Machine Translation (WMT). Association for Computational Linguistics","author":"Callison-Burch C.","key":"e_1_2_1_6_1"},{"volume-title":"Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics","author":"Chan Y. S.","key":"e_1_2_1_7_1"},{"volume-title":"PORT: A precision-order-recall MT evaluation metric for tuning. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (ACL)","year":"2012","author":"Chen B.","key":"e_1_2_1_8_1"},{"volume-title":"Proceedings of the 9th Workshop on Statistical Machine Translation (WMT). Association for Computational Linguistics","author":"Denkowski M.","key":"e_1_2_1_9_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.3115\/1219840.1219907"},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.5555\/1289189.1289273"},{"volume-title":"Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics","author":"He X.","key":"e_1_2_1_12_1"},{"volume-title":"Proceedings of the International Workshop on Spoken Language Translation (IWSLT). Association for Computational Linguistics","author":"He Y.","key":"e_1_2_1_13_1"},{"volume-title":"Proceedings of the 14th International Conference on Text, Speech and Dialogue (TSD). Springer-Verlag Berlin Heidelberg, Pilsen, Czech Republic, 72--79","author":"Fishel M.","key":"e_1_2_1_14_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_15_1","DOI":"10.3115\/1220175.1220296"},{"volume-title":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics","author":"Hopkins M.","key":"e_1_2_1_16_1"},{"volume-title":"Proceedings of the 24th International Conference on Computational Linguistics (COLING). The COLING 2012 Organizing Committee","author":"Jones B.","key":"e_1_2_1_17_1"},{"volume-title":"Proceedings of the International Workshop on Spoken Language Translation (IWSLT). Association for Computational Linguistics","year":"2012","author":"Koehn P.","key":"e_1_2_1_18_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_19_1","DOI":"10.3115\/1073445.1073462"},{"volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL\/HLT). Association for Computational Linguistics","author":"Li M.","key":"e_1_2_1_20_1"},{"volume-title":"Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics","author":"Liu C.","key":"e_1_2_1_21_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_22_1","DOI":"10.3115\/1220175.1220252"},{"volume-title":"Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR. Association for Computational Linguistics","author":"Liu C.","key":"e_1_2_1_23_1"},{"volume-title":"Proceedings of the 9th Workshop on Statistical Machine Translation (WMT). Association for Computational Linguistics","author":"Machacek M.","key":"e_1_2_1_24_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.3115\/1073083.1073133"},{"doi-asserted-by":"publisher","key":"e_1_2_1_26_1","DOI":"10.3115\/1073083.1073135"},{"volume-title":"Proceedings of IWSLT \u20192008","year":"2008","author":"Paul M.","key":"e_1_2_1_27_1"},{"volume-title":"Proceedings of the 9th Workshop on Statistical Machine Translation (WMT). Association for Computational Linguistics","author":"Sakaguchi K.","key":"e_1_2_1_28_1"},{"volume-title":"Proceedings of Association for Machine Translation in the Americas (AMTA). Association for Machine Translation in the Americas, Boston Marriott","author":"Snover M.","key":"e_1_2_1_29_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_30_1","DOI":"10.3115\/993268.993313"},{"volume-title":"Proceedings of the 23rd International Conference on Computational Linguistics (COLING). Coling 2010 Organizing Committee","year":"2010","author":"Wang K.","key":"e_1_2_1_31_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_32_1","DOI":"10.5555\/2591248.2591265"},{"doi-asserted-by":"publisher","key":"e_1_2_1_33_1","DOI":"10.3115\/1220175.1220241"},{"volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics","author":"Xiong D.","key":"e_1_2_1_34_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_35_1","DOI":"10.1162\/tacl_a_00224"},{"volume-title":"Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI). Association for the Advancement of Artificial Intelligence","author":"Zhang J.","key":"e_1_2_1_36_1"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2815619","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2815619","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:48:21Z","timestamp":1750225701000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2815619"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,1,28]]},"references-count":36,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,3,8]]}},"alternative-id":["10.1145\/2815619"],"URL":"https:\/\/doi.org\/10.1145\/2815619","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2016,1,28]]},"assertion":[{"value":"2014-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-01-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}