{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,12]],"date-time":"2026-07-12T16:26:16Z","timestamp":1783873576304,"version":"3.55.0"},"reference-count":47,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2020,10,6]],"date-time":"2020-10-06T00:00:00Z","timestamp":1601942400000},"content-version":"vor","delay-in-days":585,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>It is intuitive that semantic representations can be useful for machine translation, mainly because they can help in enforcing meaning preservation and handling data sparsity (many sentences correspond to one meaning) of machine translation models. On the other hand, little work has been done on leveraging semantics for neural machine translation (NMT). In this work, we study the usefulness of AMR (abstract meaning representation) on NMT. Experiments on a standard English-to-German dataset show that incorporating AMR as additional knowledge can significantly improve a strong attention-based sequence-to-sequence neural translation model.<\/jats:p>","DOI":"10.1162\/tacl_a_00252","type":"journal-article","created":{"date-parts":[[2019,4,2]],"date-time":"2019-04-02T13:04:45Z","timestamp":1554210285000},"page":"19-31","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":50,"title":["Semantic Neural Machine Translation Using AMR"],"prefix":"10.1162","volume":"7","author":[{"given":"Linfeng","family":"Song","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Rochester, Rochester, NY 14627, United Stated. lsong10@cs.rochester.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Gildea","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Rochester, Rochester, NY 14627, United Stated. gildea@cs.rochester.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yue","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Engineering, Westlake University, China. yue.zhang@wias.org.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiguo","family":"Wang","sequence":"additional","affiliation":[{"name":"IBM T.J. Watson Research Center, Yorktown Heights, NY 10598, United Stated. zgw.tomorrow@gmail.com"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinsong","family":"Su","sequence":"additional","affiliation":[{"name":"Xiamen University, Xiamen, China. jssu@xmu.edu.cn"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2019,3,1]]},"reference":[{"key":"2021060823285243600_bib1","doi-asserted-by":"crossref","unstructured":"Roee Aharoni and Yoav Goldberg. 2017. Towards string-to-tree neural machine translation. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL-17), pages 132\u2013140.","DOI":"10.18653\/v1\/P17-2021"},{"key":"2021060823285243600_bib2","doi-asserted-by":"crossref","unstructured":"Yoav Artzi, Kenton Lee, and Luke Zettlemoyer. 2015. Broad-coverage CCG semantic parsing with AMR. In Conference on Empirical Methods in Natural Language Processing (EMNLP-15), pages 1699\u20131710.","DOI":"10.18653\/v1\/D15-1198"},{"key":"2021060823285243600_bib3","unstructured":"Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In International Conference on Learning Representations (ICLR)."},{"key":"2021060823285243600_bib4","doi-asserted-by":"crossref","unstructured":"Kathryn Baker, Michael Bloodgood, Bonnie J Dorr, Chris Callison-Burch, Nathaniel W Filardo, Christine Piatko, Lori Levin, and Scott Miller. 2012. Modality and negation in SIMT use of modality and negation in semantically-informed syntactic MT. Computational Linguistics, 38(2):411\u2013438.","DOI":"10.1162\/COLI_a_00099"},{"key":"2021060823285243600_bib5","unstructured":"Laura Banarescu, Claire Bonial, Shu Cai, Madalina Georgescu, Kira Griffitt, Ulf Hermjakob, Kevin Knight, Philipp Koehn, Martha Palmer, and Nathan Schneider. 2013. Abstract meaning representation for sembanking. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, pages 178\u2013186."},{"key":"2021060823285243600_bib6","doi-asserted-by":"crossref","unstructured":"Joost Bastings, Ivan Titov, Wilker Aziz, Diego Marcheggiani, and Khalil Simaan. 2017. Graph convolutional encoders for syntax-aware neural machine translation. In Conference on Empirical Methods in Natural Language Processing (EMNLP-17), pages 1957\u20131967.","DOI":"10.18653\/v1\/D17-1209"},{"key":"2021060823285243600_bib7","doi-asserted-by":"crossref","unstructured":"Daniel Beck, Gholamreza Haffari, and Trevor Cohn. 2018. Graph-to-sequence learning using gated graph neural networks. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL-18), pages 273\u2013283.","DOI":"10.18653\/v1\/P18-1026"},{"key":"2021060823285243600_bib8","doi-asserted-by":"crossref","unstructured":"Jan Buys and Phil Blunsom. 2017. Robust incremental neural semantic graph parsing. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL-17), pages 1215\u20131226.","DOI":"10.18653\/v1\/P17-1112"},{"key":"2021060823285243600_bib9","doi-asserted-by":"crossref","unstructured":"Huadong Chen, Shujian Huang, David Chiang, and Jiajun Chen. 2017. Improved neural machine translation with a syntax-aware encoder and decoder. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL-17), pages 1936\u20131945.","DOI":"10.18653\/v1\/P17-1177"},{"key":"2021060823285243600_bib10","doi-asserted-by":"crossref","unstructured":"Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita, and Tiejun Zhao. 2018. Syntax-directed attention for neural machine translation. In Proceedings of the National Conference on Artificial Intelligence (AAAI-18).","DOI":"10.1609\/aaai.v32i1.11910"},{"key":"2021060823285243600_bib11","unstructured":"Kyunghyun Cho, Bart van Merrienboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder\u2013decoder for statistical machine translation. In Conference on Empirical Methods in Natural Language Processing (EMNLP-14), pages 1724\u20131734."},{"key":"2021060823285243600_bib12","doi-asserted-by":"crossref","unstructured":"Michael Denkowski and Alon Lavie. 2014. Meteor universal: Language specific translation evaluation for any target language. In Proceedings of the Ninth Workshop on Statistical Machine Translation, pages 376\u2013380.","DOI":"10.3115\/v1\/W14-3348"},{"key":"2021060823285243600_bib13","doi-asserted-by":"crossref","unstructured":"Jeffrey Flanigan, Chris Dyer, Noah A. Smith, and Jaime Carbonell. 2016. CMU at SemEval-2016 Task 8: Graph-based AMR parsing with infinite ramp loss. In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), pages 1202\u20131206.","DOI":"10.18653\/v1\/S16-1186"},{"key":"2021060823285243600_bib14","doi-asserted-by":"crossref","unstructured":"Jeffrey Flanigan, Sam Thomson, Jaime Carbonell, Chris Dyer, and Noah A. Smith. 2014. A discriminative graph-based parser for the abstract meaning representation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL-14), pages 1426\u20131436.","DOI":"10.3115\/v1\/P14-1134"},{"key":"2021060823285243600_bib15","doi-asserted-by":"crossref","unstructured":"Jonas Groschwitz, Matthias Lindemann, Meaghan Fowlie, Mark Johnson, and Alexander Koller. 2018. AMR dependency parsing with a typed semantic algebra. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL-18), pages 1831\u20131841.","DOI":"10.18653\/v1\/P18-1170"},{"key":"2021060823285243600_bib16","unstructured":"Zhijiang Guo and Wei Lu. 2018. Better transition-based AMR parsing with a refined search space. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL-18), pages 1712\u20131722."},{"key":"2021060823285243600_bib17","doi-asserted-by":"crossref","unstructured":"Sepp Hochreiter and J\u00fcrgen Schmidhuber. 1997. Long short-term memory. Neural Computation, 9(8):1735\u20131780.","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"2021060823285243600_bib18","doi-asserted-by":"crossref","unstructured":"Pierre Isabelle, Colin Cherry, and George Foster. 2017. A challenge set approach to evaluating machine translation. In Conference on Empirical Methods in Natural Language Processing (EMNLP-17), pages 2486\u20132496.","DOI":"10.18653\/v1\/D17-1263"},{"key":"2021060823285243600_bib19","unstructured":"Bevan Jones, Jacob Andreas, Daniel Bauer, Karl Moritz Hermann, and Kevin Knight. 2012. Semantics-based machine translation with hyperedge replacement grammars. In Proceedings of the International Conference on Computational Linguistics (COLING-12), pages 1359\u2013pages 1376."},{"key":"2021060823285243600_bib20","unstructured":"Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980."},{"key":"2021060823285243600_bib21","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi- supervised classification with graph convolutional networks. In International Conference on Learning Representations (ICLR)."},{"key":"2021060823285243600_bib22","doi-asserted-by":"crossref","unstructured":"Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander M. Rush. 2017. OpenNMT: Open-Source Toolkit for Neural Machine Translation. arXiv preprint arXiv:1701.02810.","DOI":"10.18653\/v1\/P17-4012"},{"key":"2021060823285243600_bib23","unstructured":"Philipp Koehn . 2004. Statistical significance tests for machine translation evaluation. In Conference on Empirical Methods in Natural Language Processing (EMNLP-04), pages 388\u2013395."},{"key":"2021060823285243600_bib24","doi-asserted-by":"crossref","unstructured":"Ioannis Konstas, Srinivasan Iyer, Mark Yatskar, Yejin Choi, and Luke Zettlemoyer. 2017. Neural AMR: Sequence-to-sequence models for parsing and generation. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL-17), pages 146\u2013157.","DOI":"10.18653\/v1\/P17-1014"},{"key":"2021060823285243600_bib25","unstructured":"Junhui Li, Deyi Xiong, Zhaopeng Tu , MuhuaZhu, MinZhang, and GuodongZhou. 2017. Modeling source syntax for neural machine translation. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL-17), pages 688\u2013697."},{"key":"2021060823285243600_bib26","unstructured":"Xiang Li, Thien Huu Nguyen, Kai Cao, and Ralph Grishman. 2015a. Improving event detection with abstract meaning representation. In Proceedings of the First Workshop on Computing News Storylines, pages 11\u201315."},{"key":"2021060823285243600_bib27","unstructured":"Yujia Li, Daniel Tarlow, Marc Brockschmidt, and Richard Zemel. 2015b. Gated graph sequence neural networks. arXiv preprint arXiv:1511.05493."},{"key":"2021060823285243600_bib28","unstructured":"Ding Liu and Daniel Gildea. 2010. Semantic role features for machine translation. In Proceedings of the 23rd International Conference on Computational Linguistics (COLING-10), pages 716\u2013724."},{"key":"2021060823285243600_bib29","unstructured":"Chunchuan Lyu and Ivan Titov. 2018. AMR parsing as graph prediction with latent alignment. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL-18), pages 397\u2013407."},{"key":"2021060823285243600_bib30","doi-asserted-by":"crossref","unstructured":"Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In Association for Computational Linguistics (ACL) System Demonstrations, pages 55\u201360.","DOI":"10.3115\/v1\/P14-5010"},{"key":"2021060823285243600_bib31","doi-asserted-by":"crossref","unstructured":"Diego Marcheggiani, Joost Bastings, and Ivan Titov. 2018. Exploiting semantics in neural machine translation with graph convolutional networks. In Proceedings of the 2018 Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL-18), pages 486\u2013492.","DOI":"10.18653\/v1\/N18-2078"},{"key":"2021060823285243600_bib32","doi-asserted-by":"crossref","unstructured":"Arindam Mitra and Chitta Baral. 2015. Locationing a question answering challenge by combining statistical methods with inductive rule learning and reasoning. In Proceedings of the National Conference on Artificial Intelligence (AAAI-16).","DOI":"10.1609\/aaai.v30i1.10354"},{"key":"2021060823285243600_bib33","doi-asserted-by":"crossref","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL-02), pages 311\u2013318.","DOI":"10.3115\/1073083.1073135"},{"key":"2021060823285243600_bib34","unstructured":"Xiaochang Peng, Linfeng Song, and Daniel Gildea. 2015. A synchronous hyperedge replacement grammar based approach for AMR parsing. In Proceedings of the Nineteenth Conference on Computational Natural Language Learning, pages 32\u201341."},{"key":"2021060823285243600_bib35","unstructured":"Xiaochang Peng, Linfeng Song, Daniel Gildea, and Giorgio Satta. 2018. Sequence-to-sequence models for cache transition systems. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL-18), pages 1842\u20131852."},{"key":"2021060823285243600_bib36","doi-asserted-by":"crossref","unstructured":"Michael Pust, Ulf Hermjakob, Kevin Knight, Daniel Marcu, and Jonathan May. 2015. Parsing english into abstract meaning representation using syntax-based machine translation. In Conference on Empirical Methods in Natural Language Processing (EMNLP-15), pages 1143\u20131154.","DOI":"10.18653\/v1\/D15-1136"},{"key":"2021060823285243600_bib37","doi-asserted-by":"crossref","unstructured":"Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Neural machine translation of rare words with subword units. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL-16), pages 1715\u20131725.","DOI":"10.18653\/v1\/P16-1162"},{"key":"2021060823285243600_bib38","unstructured":"Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In Proceedings of Association for Machine Translation in the Americas, pages 223\u2013231."},{"key":"2021060823285243600_bib39","doi-asserted-by":"crossref","unstructured":"Linfeng Song, Yue Zhang, Zhiguo Wang, and Daniel Gildea. 2018. A graph-to-sequence model for AMR-to-text generation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL-18), pages 1842\u20131852.","DOI":"10.18653\/v1\/P18-1150"},{"key":"2021060823285243600_bib40","doi-asserted-by":"crossref","unstructured":"Felix Stahlberg, Eva Hasler, Aurelien Waite, and Bill Byrne. 2016. Syntactically guided neural machine translation. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL-16), pages 299\u2013305.","DOI":"10.18653\/v1\/P16-2049"},{"key":"2021060823285243600_bib41","doi-asserted-by":"crossref","unstructured":"Sho Takase, Jun Suzuki, Naoaki Okazaki, Tsutomu Hirao, and Masaaki Nagata. 2016. Neural headline generation on abstract meaning representation. In Conference on Empirical Methods in Natural Language Processing (EMNLP-16), pages 1054\u20131059.","DOI":"10.18653\/v1\/D16-1112"},{"key":"2021060823285243600_bib42","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, 30, pages 5998\u20136008."},{"key":"2021060823285243600_bib43","doi-asserted-by":"crossref","unstructured":"Chuan Wang and Nianwen Xue. 2017. Getting the most out of AMR parsing. In Conference on Empirical Methods in Natural Language Processing (EMNLP-17), pages 1257\u20131268.","DOI":"10.18653\/v1\/D17-1129"},{"key":"2021060823285243600_bib44","doi-asserted-by":"crossref","unstructured":"Yuk Wah Wong and Raymond Mooney. 2006. Learning for semantic parsing with statistical machine translation. In Proceedings of the 2006 Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL-06), pages 439\u2013446.","DOI":"10.3115\/1220835.1220891"},{"key":"2021060823285243600_bib45","unstructured":"Dekai Wu and PascaleFung. 2009. Semantic roles for SMT: A hybrid two-pass model. In Proceedings of the 2009 Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL-09), pages 13\u201316."},{"key":"2021060823285243600_bib46","unstructured":"Shuangzhi Wu , MingZhou, and DongdongZhang. 2017. Improved neural machine translation with source syntax. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence (IJCAI-17), pages 4179\u20134185."},{"key":"2021060823285243600_bib47","doi-asserted-by":"crossref","unstructured":"Yue Zhang, Qi Liu , and LinfengSong. 2018. Sentence-state LSTM for text representation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL-18), pages 317\u2013327.","DOI":"10.18653\/v1\/P18-1030"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00252\/1923268\/tacl_a_00252.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00252\/1923268\/tacl_a_00252.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,15]],"date-time":"2022-09-15T02:24:18Z","timestamp":1663208658000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00252\/43494\/Semantic-Neural-Machine-Translation-Using-AMR"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,1]]},"references-count":47,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00252","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,3]]},"published":{"date-parts":[[2019,3,1]]}}}