{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:12Z","timestamp":1750220352242,"version":"3.41.0"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T00:00:00Z","timestamp":1628726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100010418","name":"Institute for Information & communications Technology Promotion","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Korea government","award":["2019-0-01906"],"award-info":[{"award-number":["2019-0-01906"]}]},{"name":"Artificial Intelligence Graduate School Program","award":["R7119-16-1001"],"award-info":[{"award-number":["R7119-16-1001"]}]},{"name":"Core technology development of the real-time simultaneous speech translation based on knowledge enhancement"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"<jats:p>Automatic post-editing (APE) is the study of correcting translation errors in the output of an unknown machine translation (MT) system and has been considered as a method of improving translation quality without any modification to conventional MT systems. Recently, several variants of Transformer that take both the MT output and its corresponding source sentence as inputs have been proposed for APE; and models introducing an additional attention layer into the encoder to jointly encode the MT output with its source sentence recorded a high-rank in the WMT19 APE shared task. We examine the effectiveness of such joint-encoding strategy in a controlled environment and compare four types of decoder multi-source attention strategies that have been introduced into previous APE models. The experimental results indicate that the joint-encoding strategy is effective and that taking the final encoded representation of the source sentence is the more proper strategy than taking such representation within the same encoder stack. Furthermore, among the multi-source attention strategies combined with the joint-encoding, the strategy that applies attention to the concatenated input representation and the strategy that adds up the individual attention to each input improve the quality of APE results over the strategy using the joint-encoding only.<\/jats:p>","DOI":"10.1145\/3465383","type":"journal-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T16:57:58Z","timestamp":1628787478000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Exploration of Effective Attention Strategies for Neural Automatic Post-editing with Transformer"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6015-1164","authenticated-orcid":false,"given":"Jaehun","family":"Shin","sequence":"first","affiliation":[{"name":"Pohang University of Science and Technology (POSTECH), Nam-gu, Pohang, Republic of Korea"}]},{"given":"Wonkee","family":"Lee","sequence":"additional","affiliation":[{"name":"Pohang University of Science and Technology (POSTECH), Nam-gu, Pohang, Republic of Korea"}]},{"given":"Byung-Hyun","family":"Go","sequence":"additional","affiliation":[{"name":"Pohang University of Science and Technology (POSTECH), Nam-gu, Pohang, Republic of Korea"}]},{"given":"Baikjin","family":"Jung","sequence":"additional","affiliation":[{"name":"Pohang University of Science and Technology (POSTECH), Nam-gu, Pohang, Republic of Korea"}]},{"given":"Youngkil","family":"Kim","sequence":"additional","affiliation":[{"name":"Electronics and Telecommunications Research Institute (ETRI), Daejeon, Republic of Korea"}]},{"given":"Jong-Hyeok","family":"Lee","sequence":"additional","affiliation":[{"name":"Pohang University of Science and Technology (POSTECH), Nam-gu, Pohang, Republic of Korea"}]}],"member":"320","published-online":{"date-parts":[[2021,8,12]]},"reference":[{"volume-title":"3rd International Controlled Language Applications Workshop (CLAW'00)","year":"2000","author":"Allen Jeffrey","key":"e_1_2_1_1_1"},{"volume-title":"3rd International Conference on Learning Representations (ICLR'15)","year":"2015","author":"Bahdanau Dzmitry","key":"e_1_2_1_2_1"},{"key":"e_1_2_1_3_1","volume-title":"MT Summit","volume":"13","author":"B\u00e9chara Hanna","year":"2011"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-4772"},{"key":"e_1_2_1_5_1","first-page":"17","volume-title":"Findings of the 2017 conference on machine translation (WMT'17). In Proceedings of the 2nd Conference on Machine Translation. Association for Computational Linguistics, 169\u2013214","author":"Bojar Ond\u0159ej","year":"2017"},{"key":"e_1_2_1_6_1","first-page":"16","volume-title":"Findings of the 2016 conference on machine translation. In Proceedings of the 1st Conference on Machine Translation","volume":"2","author":"Bojar Ond\u0159ej","year":"2016"},{"key":"e_1_2_1_7_1","first-page":"15","volume-title":"Findings of the 2015 workshop on statistical machine translation. In Proceedings of the 10th Workshop on Statistical Machine Translation. Association for Computational Linguistics, 1\u201346","author":"Bojar Ond\u0159ej","year":"2015"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-4773"},{"volume-title":"Proceedings of the 4th Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2)","author":"Chatterjee Rajen","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","first-page":"18","volume-title":"Findings of the WMT 2018 shared task on automatic post-editing. In Proceedings of the 3rd Conference on Machine Translation: Shared Task Papers. Association for Computational Linguistics, 710\u2013725","author":"Chatterjee Rajen","year":"2018"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-2026"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1179"},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-4775"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-2378"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-4774"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6467"},{"volume-title":"Rush","year":"2017","author":"Klein Guillaume","key":"e_1_2_1_18_1"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.3115\/1075096.1075136"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1007"},{"volume-title":"Transformer-based automatic post-editing with a context-aware encoding approach for multi-source inputs. arXiv preprint arXiv:1908.05679","year":"2019","author":"Lee WonKee","key":"e_1_2_1_21_1"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5412"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-2361"},{"key":"e_1_2_1_24_1","first-page":"19","volume-title":"Proceedings of the 4th Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2). Association for Computational Linguistics, 118\u2013123","author":"Lopes Ant\u00f3nio V.","year":"1865"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.3115\/1118693.1118711"},{"volume-title":"Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC'18)","year":"2018","author":"Negri Matteo","key":"e_1_2_1_26_1"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6468"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5414"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.2478\/v10108-010-0010-x"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1159"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6470"},{"volume-title":"Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 508\u2013515","year":"2007","author":"Simard Michel","key":"e_1_2_1_33_1"},{"volume-title":"Proceedings of Association for Machine Translation in the Americas. 223\u2013231","year":"2006","author":"Snover Matthew","key":"e_1_2_1_34_1"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-6471"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-4777"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5417"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3465383","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3465383","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:12Z","timestamp":1750191432000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3465383"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,12]]},"references-count":38,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3465383"],"URL":"https:\/\/doi.org\/10.1145\/3465383","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2021,8,12]]},"assertion":[{"value":"2020-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-08-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}