{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T12:32:57Z","timestamp":1774441977930,"version":"3.50.1"},"reference-count":95,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,12,24]],"date-time":"2020-12-24T00:00:00Z","timestamp":1608768000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,12,24]],"date-time":"2020-12-24T00:00:00Z","timestamp":1608768000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010665","name":"Science Foundation Ireland","doi-asserted-by":"publisher","award":["13\/RC\/2106"],"award-info":[{"award-number":["13\/RC\/2106"]}],"id":[{"id":"10.13039\/100010665","id-type":"DOI","asserted-by":"publisher"}]},{"name":"H2020 Marie Sklodowska-Curie Actions","award":["713567"],"award-info":[{"award-number":["713567"]}]},{"DOI":"10.13039\/501100003513","name":"University of Surrey","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003513","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Machine Translation"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This article presents a review of the evolution of automatic post-editing, a term that describes methods to improve the output of machine translation systems, based on knowledge extracted from datasets that include post-edited content. The article describes the specificity of automatic post-editing in comparison with other tasks in machine translation, and it discusses how it may function as a complement to them. Particular detail is given in the article to the five-year period that covers the shared tasks presented in WMT conferences (2015\u20132019). In this period, discussion of automatic post-editing evolved from the definition of its main parameters to an announced demise, associated with the difficulties in improving output obtained by neural methods, which was then followed by renewed interest. The article debates the role and relevance of automatic post-editing, both as an academic endeavour and as a useful application in commercial workflows.<\/jats:p>","DOI":"10.1007\/s10590-020-09252-y","type":"journal-article","created":{"date-parts":[[2020,12,24]],"date-time":"2020-12-24T10:02:46Z","timestamp":1608804166000},"page":"101-143","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["A review of the state-of-the-art in automatic post-editing"],"prefix":"10.1007","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4193-3854","authenticated-orcid":false,"given":"F\u00e9lix","family":"do Carmo","sequence":"first","affiliation":[]},{"given":"Dimitar","family":"Shterionov","sequence":"additional","affiliation":[]},{"given":"Joss","family":"Moorkens","sequence":"additional","affiliation":[]},{"given":"Joachim","family":"Wagner","sequence":"additional","affiliation":[]},{"given":"Murhaf","family":"Hossari","sequence":"additional","affiliation":[]},{"given":"Eric","family":"Paquin","sequence":"additional","affiliation":[]},{"given":"Dag","family":"Schmidtke","sequence":"additional","affiliation":[]},{"given":"Declan","family":"Groves","sequence":"additional","affiliation":[]},{"given":"Andy","family":"Way","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,12,24]]},"reference":[{"key":"9252_CR1","doi-asserted-by":"crossref","unstructured":"Aharoni R, Goldberg Y (2017) Morphological inflection generation with hard monotonic attention. In: Proceedings of the 55th annual meeting of the association for computational linguistics (Volume 1: Long Papers), Vancouver, Canada, pp 2004\u20132015","DOI":"10.18653\/v1\/P17-1183"},{"key":"9252_CR2","unstructured":"Allen J, Hogan C (2000) Toward the development of a post editing module for raw machine translation output: a controlled language perspective. In: Third international controlled language applications workshop (CLAW-00). Seattle, Washington, USA, pp 62\u201371"},{"key":"9252_CR3","unstructured":"Astudillo R, Gra\u00e7a JV, Martins A (2018) Translation Quality Estimation and Automatic Post-Editing - Workshop Proceedings. In: The 13th conference of the association for machine translation in the Americas (AMTA2018), Boston, USA"},{"key":"9252_CR4","unstructured":"Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. In: Proceedings of the 3rd international conference on learning representations (ICLR (2015) San Diego. CA, USA, p 15"},{"key":"9252_CR5","unstructured":"B\u00e9chara H, Ma Y, van Genabith J (2011) Statistical post-editing for a statistical MT system. In: Proceedings of the 13th machine translation summit (MT Summit XIII), Xiamen, China, pp 308\u2013315"},{"key":"9252_CR6","doi-asserted-by":"crossref","unstructured":"B\u00e9rard A, Pietquin O, Besacier L (2017) LIG-CRIStAL System for the WMT17 Automatic Post-Editing Task. In: Proceedings of the second conference on machine translation (WMT 2017), Copenhagen, Denmark, vol\u00a02, pp 623\u2013629","DOI":"10.18653\/v1\/W17-4772"},{"key":"9252_CR7","doi-asserted-by":"crossref","unstructured":"Bojar O, Chatterjee R, Federmann C, Haddow B, Huck M, Hokamp C, Koehn P, Logacheva V, Monz C, Negri M, Post M, Scarton C, Specia L, Turchi M (2015) Findings of the 2015 workshop on statistical machine translation. In: Proceedings of the tenth workshop on statistical machine translation (WMT15), Lisbon, Portugal, pp 1\u201346","DOI":"10.18653\/v1\/W15-3001"},{"key":"9252_CR8","doi-asserted-by":"crossref","unstructured":"Bojar O, Chatterjee R, Federmann C, Graham Y, Haddow B, Huck M, Yepes AJ, Koehn P, Logacheva V, Monz C, Negri M, Neveol A, Neves M, Popel M, Post M, Rubino R, Scarton C, Specia L, Turchi M, Verspoor K, Zampieri M (2016) Findings of the 2016 conference on machine translation (WMT16). In: Proceedings of the first conference on machine translation (WMT16), vol\u00a02. Berlin, Germany, pp 131\u2013198","DOI":"10.18653\/v1\/W16-2301"},{"key":"9252_CR9","doi-asserted-by":"crossref","unstructured":"Bojar O, Chatterjee R, Federmann C, Graham Y, Haddow B, Huang S, Huck M, Koehn P, Liu Q, Logacheva V, Monz C, Negri M, Post M, Rubino R, Specia L, Turchi M (2017) Findings of the 2017 conference on machine translation (WMT17). In: Proceedings of the second conference on machine translation (WMT17), Vol 2. Shared Task Papers, Copenhagen, Denmark, pp 169\u2013214","DOI":"10.18653\/v1\/W17-4717"},{"key":"9252_CR10","doi-asserted-by":"crossref","unstructured":"Calixto I, Liu Q, Campbell N (2017) Doubly-attentive decoder for multi-modal neural machine translation. In: Proceedings of the 55th annual meeting of the association for computational linguistics, ACL 2017, Vol 1. Long Papers, Vancouver, Canada, pp 1913\u20131924","DOI":"10.18653\/v1\/P17-1175"},{"key":"9252_CR11","unstructured":"do\u00a0Carmo F (2017) Post-editing: a theoretical and practical challenge for translation studies and machine learning. PhD thesis, Universidade do Porto"},{"issue":"2","key":"9252_CR12","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1007\/s10590-014-9152-1","volume":"28","author":"M Cettolo","year":"2014","unstructured":"Cettolo M, Bertoldi N, Federico M, Schwenk H, Barrault L, Servan C (2014) Translation project adaptation for MT-enhanced computer assisted translation. Mach Transl 28(2):127\u2013150","journal-title":"Mach Transl"},{"key":"9252_CR13","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Turchi M, Negri M (2015a) The FBK participation in the WMT15 automatic post-editing shared task. In: Proceedings of the tenth workshop on statistical machine translation, Association for Computational Linguistics, Lisbon, Portugal, pp 210\u2013215","DOI":"10.18653\/v1\/W15-3025"},{"key":"9252_CR14","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Weller M, Negri M, Turchi M (2015b) Exploring the planet of the apes: a comparative study of state-of-the-art methods for mt automatic post-editing. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing. Vol. 2: Short Papers, Association for Computational Linguistics, Beijing, China, pp 156\u2013161","DOI":"10.3115\/v1\/P15-2026"},{"key":"9252_CR15","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Arcan M, Negri M, Turchi M (2016a) Instance selection for online automatic post-editing in a multi-domain scenario. In: Proceedings of the 12th conference of the Association for Machine Translation in the Americas (AMTA2016) \u2013 Researcher\u2019s Track, Austin, texas, pp 1\u201316","DOI":"10.18653\/v1\/E17-1050"},{"key":"9252_CR16","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Gebremelak G, Negri M, Turchi M (2016b) Online automatic post-editing across domains. In: Proceedings of third Italian conference on computational linguistics(CLiC-it 2016) & fifth evaluation campaign of natural languageprocessing and speech tools for Italian. Final Workshop (EVALITA2016), CLIC-IT, Napoli, Italy. http:\/\/ceur-ws.org\/Vol-1749\/paper16.pdf","DOI":"10.4000\/books.aaccademia.1748"},{"key":"9252_CR17","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Farajian MA, Negri M, Turchi M, Srivastava A, Pal S (2017a) Multi-source neural automatic post-editing: Fbk\u2019s participation in the wmt 2017 ape shared task. In: Proceedings of the second conference on machine translation, Copenhagen, Denmark, pp 630\u2013638","DOI":"10.18653\/v1\/W17-4773"},{"key":"9252_CR18","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Gebremelak G, Negri M, Turchi M (2017b) Online automatic post-editing for MT in a multi-domain translation environment. In: Proceedings of the 15th conference of the European chapter of the association for computational linguistics: volume 1, long papers. Association for Computational Linguistics, Valencia, Spain, pp 525\u2013535. https:\/\/www.aclweb.org\/anthology\/E17-1050","DOI":"10.18653\/v1\/E17-1050"},{"key":"9252_CR19","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Negri M, Rubino R, Turchi M (2018a) Findings of the WMT 2018 shared task on automatic post-editing. In: Proceedings of the 3rd conference on machine translation WMT (shared task), Brussels, Belgium, pp 710\u2013725","DOI":"10.18653\/v1\/W18-6452"},{"key":"9252_CR20","unstructured":"Chatterjee R, Negri M, Turchi M, Blain F, Specia L (2018b) Combining quality estimation and automatic post-editing to enhance machine translation output. In: The 13th conference of the association for machine translation in the Americas (AMTA2018), vol\u00a01. Boston, USA, pp 26\u201338"},{"key":"9252_CR21","doi-asserted-by":"crossref","unstructured":"Chatterjee R, Federmann C, Negri M, Turchi M (2019) Findings of the WMT 2019 shared task on automatic post-editing. In: Proceedings of the fourth conference on machine translation (Vol. 3: Shared Task Papers), Florence, Italy, pp 11\u201328","DOI":"10.18653\/v1\/W19-5402"},{"key":"9252_CR22","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K (2019) Bert: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, (NAACL-HLT 2019), Minneapolis, Minnesota, USA, vol. 1 (Long and Short Papers), pp 4171\u20134186"},{"key":"9252_CR23","unstructured":"Dowling M, Judge J, Lynn T, Graham Y (2016) English to irish machine translation with automatic post-editing. Celtic Language Technology Workshop at 23rd French conference on natural language processing, association francophone pour la communication Parl\u00e9e (AFCP) et Association pour le Traitement Automatique des Langues (ATALA). France, Paris, pp 42\u201354"},{"key":"9252_CR24","unstructured":"Dreyer M, Marcu D (2012) HyTER: Meaning-equivalent semantics for translation evaluation. In: Proceedings of the 2012 conference of the North American chapter of the association for computational linguistics: human language technologies (HLT-NAACL 2012), Montr\u00e9al, Canada, pp 162\u2013171"},{"key":"9252_CR25","doi-asserted-by":"crossref","unstructured":"Dugast L, Senellart J, Koehn P (2007) Statistical post-edition on SYSTRAN rule-based translation system. In: Proceedings of the second workshop on statistical machine translation (StatMT 07), Prague, Czech Republic, June, pp 220\u2013223","DOI":"10.3115\/1626355.1626387"},{"key":"9252_CR26","unstructured":"Durrani N, Schmid H, Fraser A (2011) A joint sequence translation model with integrated reordering. In: Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, (ACL 2011), Stroudsburg, PA, USA, pp 1045\u20131054"},{"key":"9252_CR27","unstructured":"Federico M (2018) Challenges in adaptive neural machine translation. In: Proceedings of the association for machine translation in the Americas (AMTA 2018) workshop on translation quality estimation and automatic post-editing, Boston, Massachusetts, USA, pp 207\u2013242"},{"key":"9252_CR28","doi-asserted-by":"publisher","first-page":"25","DOI":"10.2478\/v10108-012-0006-9","volume":"98","author":"C Federmann","year":"2012","unstructured":"Federmann C (2012) Appraise: an open-source toolkit for manual evaluation of machine translation output. Prague Bull Math Linguist 98:25\u201335","journal-title":"Prague Bull Math Linguist"},{"key":"9252_CR29","doi-asserted-by":"crossref","unstructured":"Freitag M, Caswell I, Roy S (2019) Ape at scale and its implications on mt evaluation biases. arXiv:1904.04790","DOI":"10.18653\/v1\/W19-5204"},{"key":"9252_CR30","unstructured":"Gra\u00e7a J (2018) Unbabel: how to combine AI with the crowd to scale professional-quality translation. In: Proceedings of the association for machine translation in the Americas (AMTA 2018) workshop on translation quality estimation and automatic post-editing, Association for Machine Translation in the Americas, Boston, Massachusetts, USA, pp 41\u201385"},{"key":"9252_CR31","unstructured":"Graham Y, Baldwin T, Moffat A, Zobel J (2013) Continuous measurement scales in human evaluation of machine translation. In: Proceedings of the 7th linguistic annotation workshop & interoperability with discourse, ACL, Sofia, Bulgaria, pp 33\u201341"},{"key":"9252_CR32","doi-asserted-by":"crossref","unstructured":"Hokamp C (2017) Ensembling factored neural machine translation models for automatic post-editing and quality estimation. In: Proceedings of the second conference on machine translation (WMT 2017), Association for Computational Linguistics, Copenhagen, Denmark, pp 647\u2013654","DOI":"10.18653\/v1\/W17-4775"},{"key":"9252_CR33","doi-asserted-by":"publisher","unstructured":"Jauregi\u00a0Unanue I, Zare\u00a0Borzeshi E, Piccardi M (2018) A shared attention mechanism for interpretation of neural automatic post-editing systems. In: Proceedings of the 2nd workshop on neural machine translation and generation, association for computational linguistics, Melbourne, Australia, pp 11\u201317, https:\/\/doi.org\/10.18653\/v1\/W18-2702,https:\/\/www.aclweb.org\/anthology\/W18-2702","DOI":"10.18653\/v1\/W18-2702,"},{"key":"9252_CR34","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1162\/tacl_a_00065","volume":"5","author":"M Johnson","year":"2017","unstructured":"Johnson M, Schuster M, Le QV, Krikun M, Wu Y, Chen Z, Thorat N, Vi\u00e9gas FB, Wattenberg M, Corrado G, Hughes M, Dean J (2017) Google\u2019s multilingual neural machine translation system: enabling zero-shot translation. Trans Assoc Comput Linguist (TACL) 5:339\u2013351","journal-title":"Trans Assoc Comput Linguist (TACL)"},{"key":"9252_CR35","unstructured":"Junczys-Dowmunt M (2018a) Are we experiencing the golden age of automatic post-editing? In: Proceedings of the association for machine translation in the Americas (AMTA 2018) workshop on translation quality estimation and automatic post-editing, Association for Machine Translation in the Americas, Boston, Massachusetts, USA, pp 144\u2013206"},{"key":"9252_CR36","unstructured":"Junczys-Dowmunt M (2018b) Are we experiencing the golden age of automatic post-editing? In: Proceedings of the association for machine translation in the Americas (AMTA 2018) workshop on translation quality estimation and automatic post-editing, Boston, MA, pp 144\u2013206"},{"key":"9252_CR37","doi-asserted-by":"crossref","unstructured":"Junczys-Dowmunt M, Grundkiewicz R (2016) Log-linear combinations of monolingual and bilingual neural machine translation models for automatic post-editing. In: Proceedings of the first conference on machine translation, WMT 2016, colocated with ACL 2016, August 11\u201312, Berlin, Germany, Association for Computational Linguistics, Berlin, Germany, pp 751\u2013758","DOI":"10.18653\/v1\/W16-2378"},{"key":"9252_CR38","doi-asserted-by":"crossref","unstructured":"Junczys-Dowmunt M, Grundkiewicz R (2017) The amu-uedin submission to the wmt 2017 shared task on automatic post-editing. In: Proceedings of the second conference on machine translation (WMT 2017), Association for Computational Linguistics, Copenhagen, Denmark, pp 639\u2013646","DOI":"10.18653\/v1\/W17-4774"},{"key":"9252_CR39","doi-asserted-by":"crossref","unstructured":"Junczys-Dowmunt M, Grundkiewicz R (2018) Ms-uedin submission to the wmt2018 ape shared task: dual-source transformer for automatic post-editing. In: Proceedings of the third conference on machine translation WMT 2018): shared task papers, Association for Computational Linguistics, pp 822\u2013826","DOI":"10.18653\/v1\/W18-6467"},{"key":"9252_CR40","doi-asserted-by":"crossref","unstructured":"Junczys-Dowmunt M, Grundkiewicz R, Dwojak T, Hoang H, Heafield K, Neckermann T, Seide F, Germann U, Fikri\u00a0Aji A, Bogoychev N, Martins AFT, Birch A (2018) Marian: fast neural machine translation in C++. In: Proceedings of the 56th annual meeting of the association for computational linguistics, (ACL 2018), system demonstrations, Melbourne, Australia, pp 116\u2013121","DOI":"10.18653\/v1\/P18-4020"},{"key":"9252_CR41","unstructured":"Khalikov M (2018) Machine translation at booking.com: what\u2019s next? In: Proceedings of the association for machine translation in the Americas (AMTA 2018) workshop on translation quality estimation and automatic post-editing, Association for Machine Translation in the Americas, Boston, Massachusetts, USA, pp 86\u2013143"},{"key":"9252_CR42","doi-asserted-by":"crossref","unstructured":"Klein G, Kim Y, Deng Y, Senellart J, Rush AM (2017) Opennmt: open-source toolkit for neural machine translation. In: Proceedings of the 55th annual meeting of the association for computational linguistics, (ACL 2017), system demonstrations, Vancouver, Canada, pp 67\u201372","DOI":"10.18653\/v1\/P17-4012"},{"key":"9252_CR43","unstructured":"Knight K, Chander I (1994) Automated postediting of documents. In: Proceedings of the 12th national conference on artificial intelligence (AAAI 1994), vol\u00a01. Seattle, Washington, USA, pp 779\u2013784"},{"key":"9252_CR44","unstructured":"Knowles R, Ortega J, Koehn P (2018) A comparison of machine translation paradigms for use in black-box fuzzy-match repair. In: Proceedings of the AMTA 2018 workshop on translation quality estimation and automatic post-editing, Association for Machine Translation in the Americas, Boston, MA, pp 249\u2013255. https:\/\/www.aclweb.org\/anthology\/W18-2108"},{"key":"9252_CR45","doi-asserted-by":"crossref","unstructured":"Koehn P, Knowles R (2017) Six challenges for neural machine translation. In: Proceedings of the first workshop on neural machine translation, (NMT@ACL 2017), Vancouver, Canada, pp 28\u201339","DOI":"10.18653\/v1\/W17-3204"},{"key":"9252_CR46","unstructured":"Kranias L, Samiotou A (2004) Automatic translation memory fuzzy match post-editing: a step beyond traditional TM\/MT integration. In: Proceedings of the fourth international conference on language resources and evaluation (LREC\u201904), European Language Resources Association (ELRA), Lisbon, Portugal. http:\/\/www.lrec-conf.org\/proceedings\/lrec2004\/pdf\/435.pdf"},{"key":"9252_CR47","doi-asserted-by":"crossref","unstructured":"Lagarda AL, Alabau V, Casacuberta F, Silva R, D\u00edaz-de Lia\u00f1o E (2009) Statistical post-editing of a rule-based machine translation system. In: Proceedings of human language technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics (HLT-NAACL 2009), Companion Volume: Short Papers, June 2009, pp 217\u2013220","DOI":"10.3115\/1620853.1620913"},{"issue":"1","key":"9252_CR48","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.csl.2014.10.004","volume":"32","author":"AL Lagarda","year":"2015","unstructured":"Lagarda AL, Ortiz-Mart\u00ednez D, Alabau V, Casacuberta F (2015) Translating without in-domain corpus: machine translation post-editing with online learning techniques. Comput Speech Lang 32(1):109\u2013134. https:\/\/doi.org\/10.1016\/j.csl.2014.10.004","journal-title":"Comput Speech Lang"},{"key":"9252_CR49","doi-asserted-by":"crossref","unstructured":"Lee W, Shin J, Lee JH (2019) Transformer-based automatic post-editing model with joint encoder and multi-source attention of decoder. In: Proceedings of the fourth conference on machine translation (WMT 2019), Association for Computational Linguistics, Florence, Italy, vol 3: Shared Task Papers, pp 112\u2013117","DOI":"10.18653\/v1\/W19-5412"},{"key":"9252_CR50","doi-asserted-by":"crossref","unstructured":"Libovick\u00fd J, Helcl J, Tlust\u00fd M, Bojar O, Pecina P (2016) CUNI system for WMT16 automatic post-editing and multimodal translation tasks. In: Proceedings of the first conference on machine translation (WMT 2016), Association for Computational Linguistics, Berlin, Germany, vol 2, Shared Task Papers, pp 646\u2013654","DOI":"10.18653\/v1\/W16-2361"},{"key":"9252_CR51","doi-asserted-by":"crossref","unstructured":"Lopes AV, Farajian MA, Correia GM, Tr\u00e9nous J, Martins AFT (2019) Unbabel\u2019s submission to the WMT2019 APE shared task: bert-based encoder-decoder for automatic post-editing. In: Proceedings of the fourth conference on machine translation (WMT2019), vol 3: Shared Task Papers, pp 118\u2013123","DOI":"10.18653\/v1\/W19-5413"},{"key":"9252_CR52","unstructured":"Mare\u010dek D, Rosa R, Galusc\u00e1kova P, Bojar O (2011) Two-step translation with grammatical post- processing. In: Proceedings of the sixth workshop on statistical machine translation (WMT 2011), Edinburgh, Scotland, UK, pp 426\u2013432"},{"key":"9252_CR53","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1162\/tacl_a_00056","volume":"5","author":"AF Martins","year":"2017","unstructured":"Martins AF, Junczys-Dowmunt M, Kepler FN, Astudillo R, Hokamp C, Grundkiewicz R (2017) Pushing the limits of translation quality estimation. Trans Assoc Comput Linguist (TACL 2017) 5:205\u2013218","journal-title":"Trans Assoc Comput Linguist (TACL 2017)"},{"key":"9252_CR54","unstructured":"Mattoni G, Nagle P, Collantes C, Shterionov D (2017) Zero-Shot Translation for Indian Languages with Sparse Data. In: Proceedings of the 16th machine translation summit (MTSummit 2017), vol 2: Users and Translators Track, pp 1\u201310"},{"key":"9252_CR55","doi-asserted-by":"crossref","unstructured":"Negri M, Turchi M, Bertoldi N, Federico M (2018a) Online neural automatic post-editing for neural machine translation. In: Cabrio E, Mazzei A, Tamburini F (eds) Proceedings of the fifth italian conference on computational linguistics (CLiC-it 2018), Torino, Italy, December 10\u201312, 2018. CEUR-WS.org, CEUR Workshop Proceedings, vol 2253, http:\/\/ceur-ws.org\/Vol-2253\/paper63.pdf","DOI":"10.4000\/books.aaccademia.3534"},{"key":"9252_CR56","unstructured":"Negri M, Turchi M, Chatterjee R, Bertoldi N (2018b) ESCAPE: a large-scale synthetic corpus for automatic post-editing. In: Proceedings of the eleventh international conference on language resources and evaluation, (LREC 2018), European Language Resources Association (ELRA), Miyazaki, Japan, pp 24\u201330"},{"issue":"1","key":"9252_CR57","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1162\/089120103321337421","volume":"29","author":"F Och","year":"2003","unstructured":"Och F, Ney H (2003) A systematic comparison of various statistical alignment models. Computat Linguist 29(1):19\u201351","journal-title":"Computat Linguist"},{"key":"9252_CR58","unstructured":"Ortega J, S\u00e1nchez-Mart\u00ednez F, Turchi M, Negri M (2019) Improving translations by combining fuzzy-match repair with automatic post-editing. In: Proceedings of machine translation summit XVII Volume 1: Research Track, European Association for Machine Translation, Dublin, Ireland, pp 256\u2013266. https:\/\/www.aclweb.org\/anthology\/W19-6625"},{"key":"9252_CR59","doi-asserted-by":"publisher","unstructured":"Ortiz-Mart\u00ednez D, Casacuberta F (2014) The new thot toolkit for fully-automatic and interactive statistical machine translation. In: Proceedings of the demonstrations at the 14th conference of the European chapter of the association for computational linguistics, Association for Computational Linguistics, Gothenburg, Sweden, pp 45\u201348. https:\/\/doi.org\/10.3115\/v1\/E14-2012,https:\/\/www.aclweb.org\/anthology\/E14-2012","DOI":"10.3115\/v1\/E14-2012,"},{"key":"9252_CR60","doi-asserted-by":"crossref","unstructured":"Pal S, Vela M, Naskar SK, van Genabith J (2015) USAAR-SAPE: An English\u2013Spanish statistical automatic post-editing system. In: Proceedings of the tenth workshop on statistical machine translation (WMT2015), Lisbon, Portugal, pp 216\u2013221","DOI":"10.18653\/v1\/W15-3026"},{"key":"9252_CR61","unstructured":"Pal S, Naskar SK, van Genabith J (2016a) Multi-engine and multi-alignment based automatic post-editing and its impact on translation productivity. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers, The COLING 2016 Organizing Committee, Osaka, Japan, pp 2559\u20132570. https:\/\/www.aclweb.org\/anthology\/C16-1241"},{"key":"9252_CR62","doi-asserted-by":"crossref","unstructured":"Pal S, Zampieri M, van Genabith J (2016b) USAAR: an operation sequential model for automatic statistical post-editing. In: Proceedings of the first conference on machine translation (WMT 2016), Association for Computational Linguistics, Berlin, Germany, vol 2, Shared Task Papers, pp 759\u2013763","DOI":"10.18653\/v1\/W16-2379"},{"key":"9252_CR63","doi-asserted-by":"crossref","unstructured":"Pal S, Herbig N, Kr\u00fcger A, van Genabith J (2018) A transformer-based multi-source automatic post-editing system. In: Proceedings of the third conference on machine translation (WMT 2018): Shared Task Papers, Association for Computational Linguistics, Belgium, Brussels, pp 827\u2013835","DOI":"10.18653\/v1\/W18-6468"},{"key":"9252_CR64","doi-asserted-by":"crossref","unstructured":"Papineni K, Roukos S, Ward T, Zhu WJ (2002) BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting on association for computational linguistics (ACL 2002), Association for Computational Linguistics, Philadelphia, Pennsylvania, USA, pp 311\u2013318","DOI":"10.3115\/1073083.1073135"},{"key":"9252_CR65","unstructured":"Parton K, Habash N, Mckeown K, Iglesias G (2012) Can automatic post-editing make MT more meaningful? In: Proceedings of the 16th annual conference of the European Association for Machine Translation (EAMT 2012) pp 111\u2013118"},{"key":"9252_CR66","unstructured":"Poncelas A, Shterionov D, Way A, de\u00a0Buy\u00a0Wenniger GM, Passban P (2018) Investigating backtranslation in neural machine translation. In: Proceedings of the 21st annual conference of the European association for machine translation (EAMT 2018), Alacant, Spain, pp 249\u2013258"},{"key":"9252_CR67","doi-asserted-by":"crossref","unstructured":"Pylypenko D, Rubino R (2018) DFKI-MLT system description for the WMT18 automatic post-editing task. In: Proceedings of the third conference on machine translation: shared task papers, (WMT 2018), Brussels, Belgium, pp 836\u2013839","DOI":"10.18653\/v1\/W18-6469"},{"key":"9252_CR68","unstructured":"Qin Y, Specia L (2015) Truly exploring multiple references for machine translation evaluation. In: Proceedings of the 18th annual conference of the european association for machine translation, (EAMT 2015), Antalya, Turkey, pp 113\u2013120"},{"key":"9252_CR69","unstructured":"Rosa R, Mare\u010dek D, Du\u0161ek O (2012) DEPFIX: a system for automatic correction of Czech MT outputs. In: Proceedings of the seventh workshop on statistical machine translation. Montreal, Canada"},{"key":"9252_CR70","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1075\/ata.ii.26rya","volume":"2","author":"JP Ryan","year":"1988","unstructured":"Ryan JP (1988) The role of the translator in making an mt system work: perspective of a developer. Technol Transl Strateg Am Transl Assoc Sch Monogr Ser 2:127\u2013132","journal-title":"Technol Transl Strateg Am Transl Assoc Sch Monogr Ser"},{"key":"9252_CR71","doi-asserted-by":"crossref","unstructured":"Sennrich R, Haddow B, Birch A (2016a) Controlling politeness in neural machine translation via side constraints. HLT-NAACL. The Association for Computational Linguistics, San Diego, CA, pp 35\u201340","DOI":"10.18653\/v1\/N16-1005"},{"key":"9252_CR72","doi-asserted-by":"crossref","unstructured":"Sennrich R, Haddow B, Birch A (2016b) Improving neural machine translation models with monolingual data. In: Proceedings of the 54th annual meeting of the association for computational linguistics, ACL 2016, Berlin, Germany, vol 1: Long Papers, pp 86\u201396","DOI":"10.18653\/v1\/P16-1009"},{"key":"9252_CR73","doi-asserted-by":"crossref","unstructured":"Sennrich R, Haddow B, Birch A (2016c) Neural machine translation of rare words with subword units. In: Proceedings of the 54th annual meeting of the association for computational linguistics, ACL 2016, Volume 1: Long Papers, Association for Computational Linguistics, Berlin, Germany, pp 1715\u20131725","DOI":"10.18653\/v1\/P16-1162"},{"key":"9252_CR74","doi-asserted-by":"crossref","unstructured":"Shen S, Cheng Y, He Z, He W, Wu H, Sun M, Liu Y (2016) Minimum risk training for neural machine translation. In: Proceedings of the 54th annual meeting of the association for computational linguistics (Volume 1: Long Papers), Association for Computational Linguistics, Berlin, Germany, pp 1683\u20131692","DOI":"10.18653\/v1\/P16-1159"},{"key":"9252_CR75","doi-asserted-by":"crossref","unstructured":"Shin J, Lee JH (2018) Multi-encoder transformer network for automatic post-editing. In: Proceedings of the third conference on machine translation: shared task papers, Belgium, Brussels, pp 840\u2013845","DOI":"10.18653\/v1\/W18-6470"},{"key":"9252_CR76","doi-asserted-by":"crossref","unstructured":"Shterionov D, Wagner J, do\u00a0Carmo F (2019) APE through neural and statistical MT with augmented data. ADAPT\/DCU submission to the WMT 2019 APE shared task. In: Proceedings of the fourth conference on machine translation (WMT2019) (Volume 3: Shared Task Papers), Florence, Italy, pp 132\u2013138","DOI":"10.18653\/v1\/W19-5415"},{"key":"9252_CR77","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1007\/s10590-020-09249-7","volume":"34","author":"D Shterionov","year":"2020","unstructured":"Shterionov D, do Carmo F, Wagner J, Hossari M, Paquin E, Moorkens J (2020) A roadmap to neural automatic post-editing - an empirical approach. Mach Transl 34:67\u201396","journal-title":"Mach Transl"},{"key":"9252_CR78","unstructured":"Simard M, Foster G (2013) Pepr: post-edit propagation using phrase-based statistical machine translation. In: Proceedings of the XIV machine translation summit"},{"key":"9252_CR79","first-page":"508","volume":"2007","author":"M Simard","year":"2007","unstructured":"Simard M, Goutte C, Isabelle P (2007a) Statistical Phrase-based Post-editing. Proc NAACL HLT 2007:508\u2013515","journal-title":"Proc NAACL HLT"},{"key":"9252_CR80","doi-asserted-by":"crossref","unstructured":"Simard M, Ueffing N, Isabelle P, Kuhn R (2007b) Rule-based translation with statistical phrase-based Post-editing. In: Proceedings of the second workshop on statistical machine translation, Prague, Czech Republic, pp 203\u2013206","DOI":"10.3115\/1626355.1626383"},{"key":"9252_CR81","unstructured":"Snover M, Dorr B, Schwartz R, Micciulla L, Makhoul J (2006) A study of translation edit rate with targeted human annotation. In: Proceedings of the 7th conference of the association for machine translation of the Americas (AMTA 2006). Visions for the Future of Machine Translation, Cambridge, Massachusetts, USA, pp 223\u2013231"},{"issue":"2\u20133","key":"9252_CR82","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1007\/s10590-009-9062-9","volume":"23","author":"MG Snover","year":"2009","unstructured":"Snover MG, Madnani N, Dorr B, Schwartz R (2009) Ter-plus: paraphrase, semantic, and alignment enhancements to translation edit rate. Mach Transl 23(2\u20133):117\u2013127","journal-title":"Mach Transl"},{"key":"9252_CR83","unstructured":"Specia L, Harris K, Blain F, Burchardt A, Macketanz V, Skadi\u0146a I, Negri M, , Turchi M (2017) Translation quality and productivity: a study on rich morphology languages. In: Proceedings of machine translation summit XVI, Nagoya, Japan, pp 55\u201371"},{"key":"9252_CR84","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/s10590-019-09232-x","volume":"33","author":"P S\u00e1nchez-Gij\u00f3n","year":"2019","unstructured":"S\u00e1nchez-Gij\u00f3n P, Moorkens J, Way A (2019) Post-editing neural machine translation versus translation memory segments. Mach Transl 33:31\u201359","journal-title":"Mach Transl"},{"key":"9252_CR85","doi-asserted-by":"crossref","unstructured":"Tan Y, Chen Z, Huang L, Zhang L, Li M, Wang M (2017) Neural post-editing based on quality estimation. In: Proceedings of the second conference on machine translation (WMT2017), Copenhagen, Denmark, vol\u00a02, pp 655\u2013660","DOI":"10.18653\/v1\/W17-4776"},{"key":"9252_CR86","doi-asserted-by":"crossref","unstructured":"Tebbifakhr A, Agrawal R, Negri M, Turchi M (2018) Multi-source transformer with combined losses for automatic post editing. In: Proceedings of the third conference on machine translation: shared task papers, Association for Computational Linguistics, Brussels, Belgium, pp 846\u2013852","DOI":"10.18653\/v1\/W18-6471"},{"key":"9252_CR87","doi-asserted-by":"crossref","unstructured":"Tebbifakhr A, Negri M, Turchi M (2019) Effort-aware neural automatic post-editing. In: Proceedings of the fourth conference on machine translation (WMT2019) (Volume 3: Shared Task Papers), Florence, Italy, pp 139\u2013144","DOI":"10.18653\/v1\/W19-5416"},{"key":"9252_CR88","unstructured":"Turchi M, Tebbifakhr A, Negri M (2019) Quality estimation in support of automatic post-editing. In: workshop on human-aided translation (MT Summit 2019), Dublin"},{"key":"9252_CR89","unstructured":"Ueffing N (2018) Automatic post-editing and machine translation quality estimation at ebay. In: Proceedings of the association for machine translation in the Americas (AMTA 2018) workshop on translation quality estimation and automatic post-editing, Association for Machine Translation in the Americas, Boston, Massachusetts, USA, pp 1\u201334"},{"key":"9252_CR90","doi-asserted-by":"crossref","unstructured":"Vanmassenhove E, Hardmeier C, Way A (2018) Getting gender right in neural MT. In: Proceedings of the 2018 conference on empirical methods in natural language processing (EMNLP2018), Association for Computational Linguistics, Brussels, Belgium, pp 3003\u20133008","DOI":"10.18653\/v1\/D18-1334"},{"key":"9252_CR91","unstructured":"Vanmassenhove E, Shterionov D, Way A (2019) Lost in translation: Loss and decay of linguistic richness in machine translation. In: Proceedings of machine translation summit XVII volume 1: research track, European Association for Machine Translation, Dublin, Ireland, pp 222\u2013232. https:\/\/www.aclweb.org\/anthology\/W19-6622"},{"key":"9252_CR92","doi-asserted-by":"crossref","unstructured":"Varis D, Bojar O (2017) CUNI system for WMT17 automatic post-editing task. In: Proceedings of the second conference on machine translation, (WMT 2017), Copenhagen, Denmark, pp 661\u2013666","DOI":"10.18653\/v1\/W17-4777"},{"key":"9252_CR93","first-page":"5998","volume-title":"Advances in neural information processing systems 30","author":"A Vaswani","year":"2017","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Lu, Polosukhin I (2017) Attention is all you need. In: Guyon I, Luxburg UV, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R (eds) Advances in neural information processing systems 30. Curran Associates Inc, Red Hook, pp 5998\u20136008"},{"key":"9252_CR94","first-page":"2692","volume-title":"Advances in neural information processing systems 28","author":"O Vinyals","year":"2015","unstructured":"Vinyals O, Fortunato M, Jaitly N (2015) Pointer networks. In: Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R (eds) Advances in neural information processing systems 28. Curran Associates Inc, Red Hook, pp 2692\u20132700"},{"key":"9252_CR95","doi-asserted-by":"crossref","unstructured":"Wisniewski G, P\u00e9cheux N, Yvon F (2015) Why predicting post-edition is so hard? Failure analysis of LIMSI submission to the APE shared task. In: Proceedings of the tenth workshop on statistical machine translation, Lisbon, Portugal, pp 222\u2013227","DOI":"10.18653\/v1\/W15-3027"}],"container-title":["Machine Translation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10590-020-09252-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10590-020-09252-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10590-020-09252-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,22]],"date-time":"2021-07-22T16:28:56Z","timestamp":1626971336000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10590-020-09252-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,24]]},"references-count":95,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["9252"],"URL":"https:\/\/doi.org\/10.1007\/s10590-020-09252-y","relation":{},"ISSN":["0922-6567","1573-0573"],"issn-type":[{"value":"0922-6567","type":"print"},{"value":"1573-0573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,24]]},"assertion":[{"value":"31 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 October 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 December 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}