{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,29]],"date-time":"2025-11-29T16:22:19Z","timestamp":1764433339905,"version":"3.41.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2020,8,4]],"date-time":"2020-08-04T00:00:00Z","timestamp":1596499200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Beijing Municipal Science and Technology Project","award":["No. Z181100008918017"],"award-info":[{"award-number":["No. Z181100008918017"]}]},{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["No. U1836221"],"award-info":[{"award-number":["No. U1836221"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2020,9,30]]},"abstract":"<jats:p>Deep neural networks (DNNs) have provably enhanced the state-of-the-art natural language process (NLP) with their capability of feature learning and representation. As one of the more challenging NLP tasks, neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy and word coverage. It is therefore a promising direction to combine the advantages of both NMT and SMT. In this article, we propose a deep neural network--based system combination framework leveraging both minimum Bayes-risk decoding and multi-source NMT, which take as input the N-best outputs of NMT and SMT systems and produce the final translation. In particular, we apply the proposed model to both RNN and self-attention networks with different segmentation granularity. We verify our approach empirically through a series of experiments on resource-rich Chinese\u21d2English and low-resource English\u21d2Vietnamese translation tasks. Experimental results demonstrate the effectiveness and universality of our proposed approach, which significantly outperforms the conventional system combination methods and the best individual system output.<\/jats:p>","DOI":"10.1145\/3389791","type":"journal-article","created":{"date-parts":[[2020,7,7]],"date-time":"2020-07-07T12:39:07Z","timestamp":1594125547000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Deep Neural Network--based Machine Translation System Combination"],"prefix":"10.1145","volume":"19","author":[{"given":"Long","family":"Zhou","sequence":"first","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, P.R. China"}]},{"given":"Jiajun","family":"Zhang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, P.R. China"}]},{"given":"Xiaomian","family":"Kang","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, P.R. China"}]},{"given":"Chengqing","family":"Zong","sequence":"additional","affiliation":[{"name":"National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, P.R. China"}]}],"member":"320","published-online":{"date-parts":[[2020,8,4]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_2_1_1_1","DOI":"10.18653\/v1\/D16-1162"},{"doi-asserted-by":"publisher","key":"e_1_2_1_2_1","DOI":"10.3115\/1599081.1599086"},{"volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201915)","year":"2015","author":"Bahdanau Dzmitry","key":"e_1_2_1_3_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_4_1","DOI":"10.1109\/ASRU.2001.1034659"},{"doi-asserted-by":"publisher","key":"e_1_2_1_5_1","DOI":"10.1016\/j.asoc.2019.02.031"},{"doi-asserted-by":"publisher","key":"e_1_2_1_6_1","DOI":"10.3115\/1690219.1690278"},{"doi-asserted-by":"publisher","key":"e_1_2_1_7_1","DOI":"10.3115\/1219840.1219873"},{"doi-asserted-by":"publisher","key":"e_1_2_1_8_1","DOI":"10.3115\/v1\/D14-1179"},{"doi-asserted-by":"publisher","key":"e_1_2_1_9_1","DOI":"10.3115\/1699648.1699656"},{"doi-asserted-by":"publisher","key":"e_1_2_1_10_1","DOI":"10.18653\/v1\/N16-1101"},{"doi-asserted-by":"publisher","key":"e_1_2_1_11_1","DOI":"10.3115\/v1\/E14-2008"},{"volume-title":"Proceedings of the International Conference on Computational Linguistics (COLING\u201916)","year":"2016","author":"Garmash Ekaterina","key":"e_1_2_1_12_1"},{"volume":"70","volume-title":"Proceedings of the 34th International Conference on Machine Learning (Proceedings of Machine Learning Research), Doina Precup and Yee Whye Teh (Eds.)","author":"Gehring Jonas","key":"e_1_2_1_13_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_14_1","DOI":"10.18653\/v1\/D18-1048"},{"unstructured":"Hany Hassan Anthony Aue Chang Chen Vishal Chowdhary Jonathan Clark Christian Federmann Xuedong Huang Marcin Junczys-Dowmunt William Lewis Mu Li etal 2018. Achieving human parity on automatic Chinese to English news translation. arXiv preprint arXiv:1803.05567 (2018).  Hany Hassan Anthony Aue Chang Chen Vishal Chowdhary Jonathan Clark Christian Federmann Xuedong Huang Marcin Junczys-Dowmunt William Lewis Mu Li et al. 2018. Achieving human parity on automatic Chinese to English news translation. arXiv preprint arXiv:1803.05567 (2018).","key":"e_1_2_1_15_1"},{"volume-title":"Proceedings of the Annual Confernece on Artificial Intelligence (AAAI\u201916)","year":"2016","author":"He Wei","key":"e_1_2_1_16_1"},{"doi-asserted-by":"crossref","unstructured":"Kenneth Heafield and Alon Lavie. 2010. Combining machine translation output with open source. In The Prague Bulletin of Machematical Linguistics.  Kenneth Heafield and Alon Lavie. 2010. Combining machine translation output with open source. In The Prague Bulletin of Machematical Linguistics.","key":"e_1_2_1_17_1","DOI":"10.2478\/v10108-010-0008-4"},{"doi-asserted-by":"publisher","key":"e_1_2_1_18_1","DOI":"10.1162\/neco.1997.9.8.1735"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201910)","year":"2010","author":"Isozaki Hideki","key":"e_1_2_1_19_1"},{"volume-title":"Proceedings of the International Conference on Spoken Language Translation (IWSLT\u201916)","year":"2016","author":"Junczys-Dowmunt Marcin","key":"e_1_2_1_20_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_21_1","DOI":"10.18653\/v1\/W17-3204"},{"doi-asserted-by":"publisher","key":"e_1_2_1_22_1","DOI":"10.21236\/ADA461156"},{"volume-title":"Proceedings of the Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (HLT-NAACL\u201904)","year":"2004","author":"Kumar Shankar","key":"e_1_2_1_23_1"},{"volume-title":"Proceedings of the International Conference on Spoken Language Translation (IWSLT\u201909)","year":"2009","author":"Li Maoxi","key":"e_1_2_1_24_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_25_1","DOI":"10.1109\/CHINSL.2008.ECP.80"},{"doi-asserted-by":"publisher","key":"e_1_2_1_26_1","DOI":"10.18653\/v1\/P17-2031"},{"doi-asserted-by":"publisher","key":"e_1_2_1_27_1","DOI":"10.18653\/v1\/W18-6326"},{"volume-title":"Natural Language Processing and Chinese Computing","author":"Liu Yuchen","key":"e_1_2_1_28_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_29_1","DOI":"10.18653\/v1\/D15-1122"},{"volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP\u201907)","year":"2007","author":"Macherey Wolfgang","key":"e_1_2_1_30_1"},{"volume-title":"Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Papers). Association for Machine Translation in the Americas","year":"2018","author":"Marie Benjamin","key":"e_1_2_1_31_1"},{"volume-title":"Proceedings of the International Conference on Computational Linguistics (COLING\u201916)","year":"2016","author":"Niehues Jan","key":"e_1_2_1_32_1"},{"volume-title":"Proceedings of the Annual Conference of the Association for Computational Linguistics (ACL\u201902)","year":"2002","author":"Och Franz","key":"e_1_2_1_33_1"},{"volume-title":"Proceedings of MT Summit.","year":"2001","author":"Och Franz Josef","key":"e_1_2_1_34_1"},{"volume-title":"Proceedings of the Annual Conference of the Association for Computational Linguistics (ACL\u201902)","year":"2002","author":"Papineni Kishore","key":"e_1_2_1_35_1"},{"key":"e_1_2_1_36_1","first-page":"301","article-title":"Hybrid machine translation by combining output from multiple machine translation systems","volume":"7","author":"Mat\u012bss","year":"2019","journal-title":"Baltic J. Mod. Comput."},{"volume-title":"Proceedings of the Annual Conference of the Association for Computational Linguistics (ACL\u201907)","year":"2007","author":"Rosti Antti-Veikko I.","key":"e_1_2_1_37_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_38_1","DOI":"10.3115\/1626394.1626423"},{"doi-asserted-by":"publisher","key":"e_1_2_1_39_1","DOI":"10.18653\/v1\/W17-4739"},{"doi-asserted-by":"publisher","key":"e_1_2_1_40_1","DOI":"10.18653\/v1\/P16-1162"},{"volume-title":"Proceedings of NIPS","year":"2014","author":"Sutskever Ilya","key":"e_1_2_1_41_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_42_1","DOI":"10.3115\/1613715.1613792"},{"doi-asserted-by":"publisher","key":"e_1_2_1_43_1","DOI":"10.18653\/v1\/P16-1008"},{"key":"e_1_2_1_44_1","first-page":"I","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","journal-title":"Advances in Neural Information Processing Systems"},{"volume-title":"Proceedings of the 31st AAAI Conference on Artificial Intelligence.","year":"2017","author":"Wang Xing","key":"e_1_2_1_45_1"},{"unstructured":"Yonghui Wu Mike Schuster Zhifeng Chen Quoc V. Le and Mohammad Norouzi. 2016. Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. In arXiv preprint arXix:1609.08144.  Yonghui Wu Mike Schuster Zhifeng Chen Quoc V. Le and Mohammad Norouzi. 2016. Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. In arXiv preprint arXix:1609.08144.","key":"e_1_2_1_46_1"},{"unstructured":"Yingce Xia Fei Tian Lijun Wu Jianxin Lin Tao Qin Nenghai Yu and Tie-Yan Liu. 2017. Deliberation networks: Sequence generation beyond one-pass decoding. In Advances in Neural Information Processing Systems. 1784--1794.  Yingce Xia Fei Tian Lijun Wu Jianxin Lin Tao Qin Nenghai Yu and Tie-Yan Liu. 2017. Deliberation networks: Sequence generation beyond one-pass decoding. In Advances in Neural Information Processing Systems. 1784--1794.","key":"e_1_2_1_47_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_48_1","DOI":"10.3115\/1073012.1073079"},{"doi-asserted-by":"publisher","key":"e_1_2_1_49_1","DOI":"10.5555\/3304222.3304411"},{"volume-title":"Deep recurrent models with fast-forward connections for neural machine translation. arXiv preprint arXiv:1606.04199","year":"2016","author":"Zhou Jie","key":"e_1_2_1_50_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_51_1","DOI":"10.18653\/v1\/P17-2060"},{"volume-title":"Synchronous bidirectional neural machine translation. Trans. Assoc. Comput. Ling. 7 (Mar","year":"2019","author":"Zhou Long","key":"e_1_2_1_52_1"},{"doi-asserted-by":"publisher","key":"e_1_2_1_53_1","DOI":"10.1007\/978-981-10-2053-7_54"},{"doi-asserted-by":"publisher","key":"e_1_2_1_54_1","DOI":"10.18653\/v1\/N16-1004"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3389791","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3389791","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:32Z","timestamp":1750200092000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3389791"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,4]]},"references-count":54,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2020,9,30]]}},"alternative-id":["10.1145\/3389791"],"URL":"https:\/\/doi.org\/10.1145\/3389791","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2020,8,4]]},"assertion":[{"value":"2019-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-08-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}