{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T23:41:57Z","timestamp":1784936517833,"version":"3.55.0"},"reference-count":279,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,8,25]],"date-time":"2025-08-25T00:00:00Z","timestamp":1756080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Historically regarded as one of the most challenging tasks presented to achieve complete artificial intelligence (AI), machine translation (MT) research has seen continuous devotion over the past decade, resulting in cutting-edge architectures for the modeling of sequential information. While the majority of statistical models traditionally relied on the idea of learning from parallel translation examples, recent research exploring self-supervised and multi-task learning methods extended the capabilities of MT models, eventually allowing the creation of general-purpose large language models (LLMs). In addition to versatility in providing translations useful across languages and domains, LLMs can in principle perform any natural language processing (NLP) task given sufficient amount of task-specific examples. While LLMs now reach a point where they can both replace and augment traditional MT models, the extent of their advantages and the ways in which they leverage translation capabilities across multilingual NLP tasks remains a wide area for exploration. In this literature survey, we present an introduction to the current position of MT research with a historical look at different modeling approaches to MT, how these might be advantageous for the solution of particular problems, and which problems are solved or remain open in regard to recent developments. We also discuss the connection of MT models leading to the development of prominent LLM architectures, how they continue to support LLM performance across different tasks by providing a means for cross-lingual knowledge transfer, and the redefinition of the task with the possibilities that LLM technology brings.<\/jats:p>","DOI":"10.3390\/info16090723","type":"journal-article","created":{"date-parts":[[2025,8,25]],"date-time":"2025-08-25T07:30:29Z","timestamp":1756107029000},"page":"723","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Machine Translation in the Era of Large Language Models:A Survey of Historical and Emerging Problems"],"prefix":"10.3390","volume":"16","author":[{"given":"Duygu","family":"Ataman","sequence":"first","affiliation":[{"name":"Department of Computer Science, New York University, New York, NY 10011, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandra","family":"Birch","sequence":"additional","affiliation":[{"name":"School of Informatics, University of Edinburgh, Edinburgh EH8 9AB, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1831-3457","authenticated-orcid":false,"given":"Nizar","family":"Habash","sequence":"additional","affiliation":[{"name":"Department of Computer Science, New York University, Abu Dhabi P.O. Box 129188, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcello","family":"Federico","sequence":"additional","affiliation":[{"name":"Amazon, 28046 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1565-064X","authenticated-orcid":false,"given":"Philipp","family":"Koehn","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyunghyun","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Computer Science, New York University, New York, NY 10011, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,8,25]]},"reference":[{"key":"ref_1","unstructured":"Russell, S.J., and Norvig, P. (2016). Artificial Intelligence: A Modern Approach, Pearson."},{"key":"ref_2","unstructured":"Sutskever, I., Vinyals, O., and Le, Q.V. (2014, January 8\u201313). Sequence to sequence learning with neural networks. Proceedings of the Advances in Neural Information Processing Systems 27 (NIPS 2014), Montreal, QC, Canada."},{"key":"ref_3","unstructured":"Bahdanau, D., Cho, K., and Bengio, Y. (2015, January 7\u20139). Neural machine translation by jointly learning to align and translate. Proceedings of the 3rd International Conference on Learning representations, ICLr 2015, San Diego, CA, USA."},{"key":"ref_4","unstructured":"Wu, Y., Schuster, M., Chen, Z., Le, Q.V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., and Macherey, K. (2016). Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv."},{"key":"ref_5","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Luong, M.T., Pham, H., and Manning, C.D. (2015, January 17\u201321). Effective Approaches to Attention-Based Neural Machine Translation. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.","DOI":"10.18653\/v1\/D15-1166"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Artetxe, M., Labaka, G., Agirre, E., and Cho, K. (May, January 30). Unsupervised neural machine translation. Proceedings of the 6th International Conference on Learning Representations, ICLr 2018, Vancouver, BC, Canada.","DOI":"10.18653\/v1\/D18-1399"},{"key":"ref_8","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018, January 1\u20136). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the NAACL-HLT, New Orleans, LA, USA."},{"key":"ref_9","unstructured":"Zhang, B., Haddow, B., and Birch, A. (2023, January 23\u201329). Prompting large language model for machine translation: A case study. Proceedings of the International Conference on Machine Learning, PMLr, Honolulu, HI, USA."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Luong, M.-T., Kayser, M., and Manning, C.D. (2015, January 30\u201331). Deep neural language models for machine translation. Proceedings of the Nineteenth Conference on Computational Natural Language Learning, Beijing, China.","DOI":"10.18653\/v1\/K15-1031"},{"key":"ref_11","unstructured":"Ha, T.-L., Niehues, J., and Waibel, A. (2016, January 8\u20139). Toward multilingual neural machine translation with universal encoder and decoder. Proceedings of the 13th International Conference on Spoken Language Translation, Seattle, WA, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Tu, Z., Liu, Y., Shang, L., Liu, X., and Li, H. (2017, January 4\u20139). Neural machine translation with reconstruction. Proceedings of the AAAI Conference on Artificial Intelligence, San Francisco, CA, USA. No. 1.","DOI":"10.1609\/aaai.v31i1.10950"},{"key":"ref_13","unstructured":"Gehring, J., Auli, M., Grangier, D., and Dauphin, Y. (August, January 30). A convolutional encoder model for neural machine translation. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada."},{"key":"ref_14","unstructured":"Gu, J., Bradbury, J., Xiong, C., Li, V.O.K., and Socher, R. (May, January 30). Non-autoregressive neural machine translation. Proceedings of the International Conference on Learning Representations (ICLR), Vancouver, BC, Canada."},{"key":"ref_15","unstructured":"Ott, M., Edunov, S., Grangier, D., and Auli, M. (November, January 31). Scaling neural machine translation. Proceedings of the Third Conference on Machine Translation: Research Papers, Belgium, Brussels."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Irie, K., Zeyer, A., Schl\u00fcter, R., and Ney, H. (2019, January 15\u201319). Language modeling with deep transformers. Proceedings of the Interspeech 2019, Graz, Austria.","DOI":"10.21437\/Interspeech.2019-2225"},{"key":"ref_17","unstructured":"Han, J.M., Babuschkin, I., Edwards, H., Neelakantan, A., Xu, T., Polu, S., Ray, A., Shyam, P., Ramesh, A., and Radford, A. (2021). Unsupervised neural machine translation with generative language models only. arXiv."},{"key":"ref_18","unstructured":"Zhang, B., Ghorbani, B., Bapna, A., Cheng, Y., Garcia, X., Shen, J., and Firat, O. (2022, January 17\u201323). Examining scaling and transfer of language model architectures for machine translation. Proceedings of the International Conference on Machine Learning, Baltimore, MD, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Guo, S., Zhang, S., and Feng, Y. (2024, January 11\u201316). Decoder-only streaming transformer for simultaneous translation. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.acl-long.480"},{"key":"ref_20","first-page":"7339","article-title":"You only cache once: Decoder-decoder architectures for language models","volume":"37","author":"Sun","year":"2024","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_21","unstructured":"Shiwen, Y., and Xiaojing, B. (2014). Rule-based machine translation. Routledge Encyclopedia of Translation Technology, Routledge."},{"key":"ref_22","unstructured":"ALPAC (1966). Language and Machines: Computers in Translation and Linguistics: A Report, Number 1416."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chomsky, N. (2002). Syntactic Structures, Mouton de Gruyter.","DOI":"10.1515\/9783110218329"},{"key":"ref_24","unstructured":"Tanaka, H. (1993). Multilingual Machine Translation Systems in the Future. Progress in Machine Translation, IOS Press."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Dong, D., Wu, H., He, W., Yu, D., and Wang, H. (2015, January 26\u201331). Multi-task learning for multiple language translation. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, Beijing, China.","DOI":"10.3115\/v1\/P15-1166"},{"key":"ref_26","unstructured":"Gasser, M. (2017, January 25\u201327). Minimal dependency translation: A framework for computer-assisted translation for under-resourced languages. Proceedings of the Information and Communication Technology for Development for Africa: First International Conference, ICT4DA 2017, Bahir Dar, Ethiopia."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1007\/s10590-021-09260-6","article-title":"recent advances in Apertium, a free\/open-source rule-based machine translation platform for low-resource languages","volume":"35","author":"Khanna","year":"2021","journal-title":"Mach. Transl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1162\/coli_a_00446","article-title":"Survey of low-resource machine translation","volume":"48","author":"Haddow","year":"2022","journal-title":"Comput. Linguist."},{"key":"ref_29","unstructured":"N\u00f8rsteb\u00f8 Moshagen, S., Pirinen, F., Antonsen, L., Gaup, B., Mikkelsen, I.L.S., Trosterud, T., Wiechetek, L., and Hiovain-Asikainen, K. (2023). The GiellaLT infrastructure: A multilingual infrastructure for rule-based NLP. Rule-Based Language Technology, University of Tartu."},{"key":"ref_30","unstructured":"Trieu, H.-L., Tran, D.-V., and Nguyen, L.-M. (2017, January 16\u201318). Investigating phrase-based and neural-based machine translation on low-resource settings. Proceedings of the 31st Pacific Asia Conference on Language, Information and Computation, Cebu City, Philippines."},{"key":"ref_31","unstructured":"Sennrich, R., and Zhang, B. (August, January 28). Revisiting low-resource neural machine translation: A case study. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1007\/s10590-021-09281-1","article-title":"Recent advances of low-resource neural machine translation","volume":"35","author":"Haque","year":"2021","journal-title":"Mach. Transl."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, R., Tan, X., Luo, R., Qin, T., and Liu, T.-Y. (2021, January 19\u201327). A survey on low-resource neural machine translation. Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence, Montreal, QC, Canada.","DOI":"10.24963\/ijcai.2021\/629"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kumar, S., Anastasopoulos, A., Wintner, S., and Tsvetkov, Y. (2021, January 1\u20136). Machine translation into low-resource language varieties. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), Virtual.","DOI":"10.18653\/v1\/2021.acl-short.16"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3524300","article-title":"Low-resource neural machine translation: Methods and trends","volume":"21","author":"Shi","year":"2022","journal-title":"ACM Trans. Asian -Low-Resour. Lang. Inf. Process."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3567592","article-title":"Neural machine translation for low-resource languages: A survey","volume":"55","author":"Ranathunga","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_37","first-page":"79","article-title":"A statistical approach to machine translation","volume":"16","author":"Brown","year":"1990","journal-title":"Comput. Linguist."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/79.543975","article-title":"The expectation-maximization algorithm","volume":"13","author":"Moon","year":"1996","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Koehn, P. (2010). Statistical Machine Translation, Cambridge University Press. [1st ed.].","DOI":"10.1017\/CBO9780511815829"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Koehn, P., Och, F.J., and Marcu, D. (June, January 27). Statistical phrase-based translation. Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Langauge Technology (HLT-NAACL 2003), Edmonton, AB, Canada.","DOI":"10.3115\/1073445.1073462"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zens, R., Och, F.J., and Ney, H. (2002, January 2\u20136). Phrase-based statistical machine translation. Proceedings of the Annual Conference on Artificial Intelligence, Canberra, Australia.","DOI":"10.1007\/3-540-45751-8_2"},{"key":"ref_42","unstructured":"Zens, R., and Ney, H. (2004, January 6). Improvements in phrase-based statistical machine translation. Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics: HLT-NAACL 2004, Boston, MA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1017\/S026988891200029X","article-title":"An Overview of the Phrase-based Statistical Machine Translation Techniques","volume":"27","year":"2012","journal-title":"Knowl. Eng. Rev."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1162\/COLI_a_00245","article-title":"A Survey of Word Reordering in Statistical Machine Translation: Computational Models and Language Phenomena","volume":"42","author":"Bisazza","year":"2016","journal-title":"Comput. Linguist."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zens, R., and Ney, H. (2003, January 7\u201312). A Comparative Study on Reordering Constraints in Statistical Machine Translation. Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan.","DOI":"10.3115\/1075096.1075115"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kumar, S., and Byrne, B. (2005, January 6\u20138). Local Phrase Reordering Models for Statistical Machine Translation. Proceedings of the Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, Vancouver, BC, Canada.","DOI":"10.3115\/1220575.1220596"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Kanthak, S., Vilar, D., Matusov, E., Zens, R., and Ney, H. (2005, January 29). Novel Reordering Approaches in Phrase-Based Statistical Machine Translation. Proceedings of the ACL Workshop on Building and Using Parallel Texts, Ann Arbor, MI, USA.","DOI":"10.3115\/1654449.1654488"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Xiong, D., Liu, Q., and Lin, S. (2006, January 17\u201321). Maximum Entropy Based Phrase Reordering Model for Statistical Machine Translation. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Sydney, Australia.","DOI":"10.3115\/1220175.1220241"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zens, R., and Ney, H. (2006, January 8). Discriminative Reordering Models for Statistical Machine Translation. Proceedings of the Workshop on Statistical Machine Translation, New York, NY, USA.","DOI":"10.3115\/1654650.1654659"},{"key":"ref_50","unstructured":"Li, C., Li, M., Zhang, D., Li, M., Zhou, M., and Guan, Y. (2007, January 23\u201330). A Probabilistic Approach to Syntax-Based Reordering for Statistical Machine Translation. Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics, Prague, Czech Republic."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zhao, C., Walker, M., and Chaturvedi, S. (2020, January 5\u201310). Bridging the Structural Gap Between Encoding and Decoding for Data-to-Text Generation. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.224"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Bentivogli, L., Bisazza, A., Cettolo, M., and Federico, M. (2016, January 1\u20135). Neural Versus Phrase-Based Machine Translation Quality: A Case Study. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1025"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Kalchbrenner, N., and Blunsom, P. (2013, January 18\u201321). recurrent continuous translation models. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA.","DOI":"10.18653\/v1\/D13-1176"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Bottou, L. (2010). Large-scale machine learning with stochastic gradient descent. COMPSTAT\u20192010, Proceedings of the 19th International Conference on Computational Statistics, Paris, France, 22\u201327 August 2010, Springer.","DOI":"10.1007\/978-3-7908-2604-3_16"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Jean, S., Cho, K., Memisevic, R., and Bengio, Y. (2015, January 26\u201331). On using very large target vocabulary for neural machine translation. Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL-IJCNLP 2015, Beijing, China.","DOI":"10.3115\/v1\/P15-1001"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Luong, M.T., and Manning, C.D. (2016, January 7\u201312). Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.","DOI":"10.18653\/v1\/P16-1100"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Sennrich, R., Haddow, B., and Birch, A. (2016, January 7\u201312). Neural Machine Translation of rare Words with Subword Units. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.","DOI":"10.18653\/v1\/P16-1162"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Kudo, T., and Richardson, J. (November, January 31). SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-2012"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Song, X., Salcianu, A., Song, Y., Dopson, D., and Zhou, D. (2021, January 7\u201311). Fast WordPiece Tokenization. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.160"},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Xu, J., Zhou, H., Gan, C., Zheng, Z., and Li, L. (2021, January 1\u20136). Vocabulary Learning via Optimal Transport for Neural Machine Translation. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Virtual Event.","DOI":"10.18653\/v1\/2021.acl-long.571"},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Wang, X., Ruder, S., and Neubig, G. (2021, January 6\u201311). Multi-View Subword Regularization. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.","DOI":"10.18653\/v1\/2021.naacl-main.40"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Ataman, D., Negri, M., Turchi, M., and Federico, M. (2017). Linguistically Motivated Vocabulary reduction for Neural Machine Translation from Turkish to English. Prague Bull. Math. Linguist., 331\u2013342.","DOI":"10.1515\/pralin-2017-0031"},{"key":"ref_64","unstructured":"Araabi, A., Monz, C., and Niculae, V. (2022, January 12\u201316). How Effective is Byte Pair Encoding for Out-Of-Vocabulary Words in Neural Machine Translation?. Proceedings of the 15th Biennial Conference of the Association for Machine Translation in the Americas (Volume 1: Research Track), Orlando, FL, USA."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Costa-juss\u00e0, M.R., and Fonollosa, J.A.R. (2016, January 7\u201312). Character-Based Neural Machine Translation. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Berlin, Germany.","DOI":"10.18653\/v1\/P16-2058"},{"key":"ref_66","unstructured":"Ling, W., Trancoso, I., Dyer, C., and Black, A.W. (2015). Character-based neural machine translation. arXiv."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1162\/tacl_a_00067","article-title":"Fully character-level neural machine translation without explicit segmentation","volume":"5","author":"Lee","year":"2017","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_68","unstructured":"Ataman, D., Aziz, W., and Birch, A. (2019, January 6\u20139). A Latent Morphology Model for Open-Vocabulary Neural Machine Translation. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Gall\u00e9, M. (2019, January 3\u20137). Investigating the effectiveness of BPE: The power of shorter sequences. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1141"},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Wang, C., Cho, K., and Gu, J. (2020, January 7\u201312). Neural Machine Translation with Byte-Level Subwords. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA. Number 05.","DOI":"10.1609\/aaai.v34i05.6451"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1007\/s42979-021-00723-4","article-title":"A Survey of Orthographic Information in Machine Translation","volume":"2","author":"Chakravarthi","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Libovick\u1ef3, J., Schmid, H., and Fraser, A. (2022). Why Don\u2019t People Use Character-Level Machine Translation?. Findings of the Association for Computational Linguistics: ACL 2022, Dublin, Ireland, 22\u201327 May 2022, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.findings-acl.194"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1162\/tacl_a_00651","article-title":"Are Character-level Translations Worth the Wait? Comparing ByT5 and mT5 for Machine Translation","volume":"12","author":"Edman","year":"2024","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Cherry, C., Foster, G., Bapna, A., Firat, O., and Macherey, W. (November, January 31). Revisiting Character-Based Neural Machine Translation with Capacity and Compression. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1461"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1162\/tacl_a_00461","article-title":"Byt5: Towards a token-free future with pre-trained byte-to-byte models","volume":"10","author":"Xue","year":"2022","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_76","unstructured":"Kaplan, J., McCandlish, S., Henighan, T., Brown, T.B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., and Amodei, D. (2020). Scaling laws for neural language models. arXiv."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.csl.2017.01.014","article-title":"On integrating a language model into neural machine translation","volume":"45","author":"Gulcehre","year":"2017","journal-title":"Comput. Speech Lang."},{"key":"ref_78","doi-asserted-by":"crossref","unstructured":"Kannan, A., Wu, Y., Nguyen, P., Sainath, T.N., Chen, Z., and Prabhavalkar, R. (2018, January 15\u201320). An Analysis of Incorporating an External Language Model into a Sequence-to-Sequence Model. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462682"},{"key":"ref_79","unstructured":"Ueffing, N., Haffari, G., and Sarkar, A. (2007, January 23\u201330). Transductive learning for statistical machine translation. Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, Prague, Czech Republic."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Bertoldi, N., and Federico, M. (2009, January 30\u201331). Domain Adaptation for Statistical Machine Translation with Monolingual Resources. Proceedings of the Fourth Workshop on Statistical Machine Translation, Athens, Greece.","DOI":"10.3115\/1626431.1626468"},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Wu, H., and Wang, H. (2009, January 2\u20137). Revisiting pivot language approach for machine translation. Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Singapore.","DOI":"10.3115\/1687878.1687902"},{"key":"ref_82","doi-asserted-by":"crossref","unstructured":"Sennrich, R., Haddow, B., and Birch, A. (2016, January 7\u201312). Improving Neural Machine Translation Models with Monolingual Data. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.","DOI":"10.18653\/v1\/P16-1009"},{"key":"ref_83","unstructured":"Burlot, F., and Yvon, F. (November, January 31). Using Monolingual Data in Neural Machine Translation: A Systematic Study. Proceedings of the Third Conference on Machine Translation: Research Papers, Brussels, Belgium."},{"key":"ref_84","doi-asserted-by":"crossref","unstructured":"Edunov, S., Ott, M., Auli, M., and Grangier, D. (November, January 31). Understanding Back-Translation at Scale. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1045"},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Wu, J., Wang, X., and Wang, W.Y. (2019, January 2\u20137). Extract and Edit: An Alternative to Back-Translation for Unsupervised Neural Machine Translation. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.","DOI":"10.18653\/v1\/N19-1120"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Gra\u00e7a, M., Kim, Y., Schamper, J., Khadivi, S., and Ney, H. (2019, January 1\u20132). Generalizing Back-Translation in Neural Machine Translation. Proceedings of the Fourth Conference on Machine Translation, Florence, Italy.","DOI":"10.18653\/v1\/W19-5205"},{"key":"ref_87","unstructured":"Przystupa, M., and Abdul-Mageed, M. (2009, January 30\u201331). Neural machine translation of low-resource and similar languages with backtranslation. Proceedings of the Fourth Conference on Machine Translation, Athens, Greece."},{"key":"ref_88","doi-asserted-by":"crossref","unstructured":"Feldman, I., and Coto-Solano, R. (2020, January 8\u201313). Neural machine translation models with back-translation for the extremely low-resource indigenous language Bribri. Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, Spain.","DOI":"10.18653\/v1\/2020.coling-main.351"},{"key":"ref_89","unstructured":"Mikolov, T., Le, Q.V., and Sutskever, I. (2013). Exploiting similarities among languages for machine translation. arXiv."},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Faruqui, M., and Dyer, C. (2014, January 26\u201330). Improving vector space word representations using multilingual correlation. Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, Gothenburg, Sweden.","DOI":"10.3115\/v1\/E14-1049"},{"key":"ref_91","doi-asserted-by":"crossref","unstructured":"Xing, C., Wang, D., Liu, C., and Lin, Y. (June, January 31). Normalized word embedding and orthogonal transform for bilingual word translation. Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, CO, USA.","DOI":"10.3115\/v1\/N15-1104"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Artetxe, M., Labaka, G., and Agirre, E. (2016, January 1\u20135). Learning principled bilingual mappings of word embeddings while preserving monolingual invariance. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1250"},{"key":"ref_93","unstructured":"Artetxe, M., Labaka, G., and Agirre, E. (August, January 30). Learning bilingual word embeddings with (almost) no bilingual data. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, BC, Canada."},{"key":"ref_94","unstructured":"Smith, S.L., Turban, D.H., Hamblin, S., and Hammerla, N.Y. (2017). Offline bilingual word vectors, orthogonal transformations and the inverted softmax. arXiv."},{"key":"ref_95","unstructured":"Ravi, S., and Knight, K. (2011, January 19\u201324). Deciphering foreign language. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, OR, USA."},{"key":"ref_96","unstructured":"Hermann, K.M., and Blunsom, P. (2014, January 14\u201316). Multilingual Distributed representations without Word Alignment. Proceedings of the International Conference on Learning Representations, Banff, AB, Canada."},{"key":"ref_97","unstructured":"Lample, G., Conneau, A., Denoyer, L., and Ranzato, M. (May, January 30). Unsupervised Machine Translation Using Monolingual Corpora Only. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_98","doi-asserted-by":"crossref","unstructured":"Yang, Z., Chen, W., Wang, F., and Xu, B. (2018, January 15\u201320). Unsupervised Neural Machine Translation with Weight Sharing. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1005"},{"key":"ref_99","unstructured":"Gra\u00e7a, Y.K.M., and Ney, H. (2020, January 3\u20135). When and why is unsupervised neural machine translation useless. Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, Lisbon, Portugal."},{"key":"ref_100","doi-asserted-by":"crossref","unstructured":"Kauers, M., Vogel, S., F\u00fcgen, C., and Waibel, A. (2002, January 16\u201320). Interlingua based statistical machine translation. Proceedings of the INTErSPEECH, Denver, CO, USA.","DOI":"10.21437\/ICSLP.2002-513"},{"key":"ref_101","unstructured":"De Gispert, A., and Marino, J.B. (2006, January 22\u201328). Catalan-English statistical machine translation without parallel corpus: Bridging through Spanish. Proceedings of the 5th International Conference on Language Resources and Evaluation (LrEC), Genoa, Italy."},{"key":"ref_102","unstructured":"Utiyama, M., and Isahara, H. (2007, January 22\u201327). A comparison of pivot methods for phrase-based statistical machine translation. Proceedings of the Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Main Conference, Rochester, NY, USA."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/s10590-008-9041-6","article-title":"Pivot language approach for phrase-based statistical machine translation","volume":"21","author":"Wu","year":"2007","journal-title":"Mach. Transl."},{"key":"ref_104","unstructured":"Bertoldi, N., Barbaiani, M., Federico, M., and Cattoni, R. (2008, January 20\u201321). Phrase-based statistical machine translation with pivot languages. Proceedings of the 5th International Workshop on Spoken Language Translation: Papers, Waikiki, HI, USA."},{"key":"ref_105","unstructured":"Chen, Y., Liu, Y., Cheng, Y., and Li, V.O. (August, January 30). A Teacher-Student Framework for Zero-Resource Neural Machine Translation. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, BC, Canada."},{"key":"ref_106","unstructured":"Leng, Y., Tan, X., Qin, T., Li, X.Y., and Liu, T.Y. (August, January 28). Unsupervised Pivot Translation for Distant Languages. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1162\/tacl_a_00065","article-title":"Google\u2019s multilingual neural machine translation system: Enabling zero-shot translation","volume":"5","author":"Johnson","year":"2017","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_108","doi-asserted-by":"crossref","unstructured":"Lample, G., Ott, M., Conneau, A., Denoyer, L., and Ranzato, M. (November, January 31). Phrase-Based & Neural Unsupervised Machine Translation. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1549"},{"key":"ref_109","unstructured":"Lu, Y., Keung, P., Ladhak, F., Bhardwaj, V., Zhang, S., and Sun, J. (November, January 31). A neural interlingua for multilingual machine translation. Proceedings of the Third Conference on Machine Translation: Research Papers, Brussels, Belgium."},{"key":"ref_110","unstructured":"Lakew, S.M., Cettolo, M., and Federico, M. (2018, January 20\u201326). A Comparison of Transformer and Recurrent Neural Networks on Multilingual Neural Machine Translation. Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, NM, USA."},{"key":"ref_111","doi-asserted-by":"crossref","unstructured":"Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzm\u00e1n, F., Grave, \u00c9., Ott, M., Zettlemoyer, L., and Stoyanov, V. (2020, January 5\u201310). Unsupervised Cross-lingual representation Learning at Scale. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.747"},{"key":"ref_112","unstructured":"Karthikeyan, K., Wang, Z., Mayhew, S., and Roth, D. (2019, January 6\u20139). Cross-lingual ability of multilingual bert: An empirical study. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_113","doi-asserted-by":"crossref","unstructured":"Kudugunta, S., Bapna, A., Caswell, I., and Firat, O. (2019, January 3\u20137). Investigating Multilingual NMT Representations at Scale. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1167"},{"key":"ref_114","unstructured":"Wang, X., Pham, H., Arthur, P., and Neubig, G. (May, January 30). Multilingual Neural Machine Translation with Soft Decoupled Encoding. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_115","unstructured":"Kim, Y., Gao, Y., and Ney, H. (August, January 28). Effective Cross-Lingual Transfer of Neural Machine Translation Models Without Shared Vocabularies. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_116","doi-asserted-by":"crossref","unstructured":"Zhu, C., Yu, H., Cheng, S., and Luo, W. (2020, January 5\u201310). Language-aware interlingua for multilingual neural machine translation. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.150"},{"key":"ref_117","doi-asserted-by":"crossref","unstructured":"Baziotis, C., Artetxe, M., Cross, J., and Bhosale, S. (2022, January 7\u201311). Multilingual Machine Translation with Hyper-Adapters. Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Abu Dhabi, United Arab Emirates.","DOI":"10.18653\/v1\/2022.emnlp-main.77"},{"key":"ref_118","first-page":"36230","article-title":"refining low-resource unsupervised translation by language disentanglement of multilingual translation model","volume":"35","author":"Nguyen","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_119","unstructured":"Costa-juss\u00e0, M.R., Cross, J., \u00c7elebi, O., Elbayad, M., Heafield, K., Heffernan, K., Kalbassi, E., Lam, J., Licht, D., and Maillard, J. (2022). No Language Left Behind: Scaling Human-Centered Machine Translation. arXiv."},{"key":"ref_120","unstructured":"Zanr, C., Peng, K., Dingr, L., Qiu, B., Liu, B., He, S., Lu, Q., Zhang, Z., Liu, C., and Liu, W. (2022). Vega-MT: The JD Explore Academy Translation System for WMT22. arXiv."},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1162\/tacl_a_00343","article-title":"Multilingual denoising pre-training for neural machine translation","volume":"8","author":"Liu","year":"2020","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_122","doi-asserted-by":"crossref","unstructured":"Edunov, S., Baevski, A., and Auli, M. (2019, January 2\u20137). Pre-trained language model representations for language generation. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.","DOI":"10.18653\/v1\/N19-1409"},{"key":"ref_123","doi-asserted-by":"crossref","unstructured":"Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018, January 1\u20136). Deep contextualized word representations. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, LA, USA.","DOI":"10.18653\/v1\/N18-1202"},{"key":"ref_124","first-page":"5485","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"ref_125","unstructured":"Yang, Z. (2019). XLNet: Generalized Autoregressive Pretraining for Language Understanding. arXiv."},{"key":"ref_126","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., and Sutskever, I. (2019). Language Models are Unsupervised Multitask Learners, OpenAI."},{"key":"ref_127","unstructured":"Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., and Anadkat, S. (2023). Gpt-4 technical report. arXiv."},{"key":"ref_128","first-page":"1","article-title":"Palm: Scaling language modeling with pathways","volume":"24","author":"Chowdhery","year":"2023","journal-title":"J. Mach. Learn. Res."},{"key":"ref_129","unstructured":"Le Scao, T., Fan, A., Akiki, C., Pavlick, E., Ili\u0107, S., Hesslow, D., Castagn\u00e9, R., Luccioni, A.S., Yvon, F., and Gall\u00e9, M. (2023). Bloom: A 176b-parameter open-access multilingual language model. arXiv."},{"key":"ref_130","unstructured":"Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M.A., Lacroix, T., Rozi\u00e8re, B., Goyal, N., Hambro, E., and Azhar, F. (2023). Llama: Open and efficient foundation language models. arXiv."},{"key":"ref_131","unstructured":"Bawden, R., Birch, A., Dobreva, R., Oncevay, A., Barone, A.V.M., and Williams, P. (2020, January 19\u201320). The University of Edinburgh\u2019s English-Tamil and English-Inuktitut submissions to the WMT20 news translation task. Proceedings of the 5th Conference on Machine Translation, Online."},{"key":"ref_132","doi-asserted-by":"crossref","unstructured":"Baziotis, C., Haddow, B., and Birch, A. (2020, January 16\u201320). Language Model Prior for Low-Resource Neural Machine Translation. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.","DOI":"10.18653\/v1\/2020.emnlp-main.615"},{"key":"ref_133","doi-asserted-by":"crossref","unstructured":"Baziotis, C., Titov, I., Birch, A., and Haddow, B. (2021, January 1\u20136). Exploring Unsupervised Pretraining Objectives for Machine Translation. Proceedings of the Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, Online.","DOI":"10.18653\/v1\/2021.findings-acl.261"},{"key":"ref_134","first-page":"1877","article-title":"Language models are few-shot learners","volume":"33","author":"Brown","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_135","unstructured":"Zeng, A., Liu, X., Du, Z., Wang, Z., Lai, H., Ding, M., Yang, Z., Xu, Y., Zheng, W., and Xia, X. (2023, January 1\u20135). GLM-130B: An Open Bilingual Pre-Trained Model. Proceedings of the Eleventh International Conference on Learning Representations, Kigali, Rwanda."},{"key":"ref_136","unstructured":"Aynetdinov, A., and Akbik, A. (2024). SemScore: Automated Evaluation of Instruction-Tuned LLMs based on Semantic Textual Similarity. arXiv."},{"key":"ref_137","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1049\/cje.2019.03.015","article-title":"Language model score regularization for speech recognition","volume":"28","author":"Zhang","year":"2019","journal-title":"Chin. J. Electron."},{"key":"ref_138","unstructured":"Hendy, A., Abdelrehim, M., Sharaf, A., Raunak, V., Gabr, M., Matsushita, H., Kim, Y.J., Afify, M., and Awadalla, H.H. (2023). How good are gpt models at machine translation? A comprehensive evaluation. arXiv."},{"key":"ref_139","doi-asserted-by":"crossref","unstructured":"Kocmi, T., Avramidis, E., Bawden, R., Bojar, O., Dvorkovich, A., Federmann, C., Fishel, M., Freitag, M., Gowda, T., and Grundkiewicz, R. (2023, January 6\u20137). Findings of the 2023 conference on machine translation (WMT23): LLMs are here but not quite there yet. Proceedings of the WMT23-Eighth Conference on Machine Translation, Singapore.","DOI":"10.18653\/v1\/2023.wmt-1.1"},{"key":"ref_140","unstructured":"Xu, H., Kim, Y.J., Sharaf, A., and Awadalla, H.H. (2024, January 7\u201311). A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models. Proceedings of the Twelfth International Conference on Learning Representations, Vienna, Austria."},{"key":"ref_141","doi-asserted-by":"crossref","unstructured":"Zhu, W., Liu, H., Dong, Q., Xu, J., Huang, S., Kong, L., Chen, J., and Li, L. (2024, January 16\u201321). Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis. Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024, Mexico City, Mexico.","DOI":"10.18653\/v1\/2024.findings-naacl.176"},{"key":"ref_142","unstructured":"Jelinek, F. (1988, January 7\u20139). Applying Information Theoretic Methods: Evaluation of Grammar Quality. Proceedings of the Workshop on Evaluation of NLP Systems, Wayne, Pennsylvania."},{"key":"ref_143","doi-asserted-by":"crossref","unstructured":"Thorndike, E.L. (1932). The Fundamentals of Learning, Teachers College, Columbia University.","DOI":"10.1037\/10976-000"},{"key":"ref_144","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/BF02478259","article-title":"A Logical Calculus of the Ideas Immanent in Nervous Activity","volume":"5","author":"McCulloch","year":"1943","journal-title":"Bull. Math. Biophys."},{"key":"ref_145","unstructured":"Hebb, D.O. (1949). The Organization of Behavior: A Neuropsychological Theory, Wiley."},{"key":"ref_146","unstructured":"Rosenblatt, F. (1958). The Perceptron: A Probabilistic Model for Information Storage and Organization in the Brain, Cornell Aeronautical Laboratory. Technical Report 85-460-1."},{"key":"ref_147","unstructured":"Dreyfus, H., and Dreyfus, S.E. (1986). Mind over Machine, Simon and Schuster."},{"key":"ref_148","unstructured":"Chomsky, N. (2014). Aspects of the Theory of Syntax, MIT Press. Number 11."},{"key":"ref_149","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/0010-0277(88)90031-5","article-title":"Connectionism and cognitive architecture: A critical analysis","volume":"28","author":"Fodor","year":"1988","journal-title":"Cognition"},{"key":"ref_150","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1006\/cogp.1998.0694","article-title":"Rethinking eliminative connectionism","volume":"37","author":"Marcus","year":"1998","journal-title":"Cogn. Psychol."},{"key":"ref_151","unstructured":"Marcus, G.F. (2003). The Algebraic Mind: Integrating Connectionism and Cognitive Science, MIT Press."},{"key":"ref_152","doi-asserted-by":"crossref","unstructured":"Fodor, J.A., and Lepore, E. (2002). The Compositionality Papers, Oxford University Press.","DOI":"10.1093\/oso\/9780199252152.001.0001"},{"key":"ref_153","doi-asserted-by":"crossref","unstructured":"Calvo, P., and Symons, J. (2014). The Architecture of Cognition: Rethinking Fodor and Pylyshyn\u2019s Systematicity Challenge, MIT Press.","DOI":"10.7551\/mitpress\/9780262027236.001.0001"},{"key":"ref_154","doi-asserted-by":"crossref","first-page":"e253","DOI":"10.1017\/S0140525X16001837","article-title":"Building machines that learn and think like people","volume":"40","author":"Lake","year":"2017","journal-title":"Behav. Brain Sci."},{"key":"ref_155","unstructured":"Lake, B., and Baroni, M. (2018, January 10\u201315). Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks. Proceedings of the International Conference on Machine Learning, PMLr, Stockholm, Sweden."},{"key":"ref_156","unstructured":"Battaglia, P.W., Hamrick, J.B., Bapst, V., Sanchez-Gonzalez, A., Zambaldi, V., Malinowski, M., Tacchetti, A., Raposo, D., Santoro, A., and Faulkner, R. (2018). relational inductive biases, deep learning, and graph networks. arXiv."},{"key":"ref_157","unstructured":"Snyder, B., and Barzilay, R. (2010). Unsupervised Multilingual Learning. [Ph.D. Thesis, Massachusetts Institute of Technology]."},{"key":"ref_158","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1162\/tacl_a_00100","article-title":"Multilingual projection for parsing truly low-resource languages","volume":"4","author":"Johannsen","year":"2016","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_159","doi-asserted-by":"crossref","unstructured":"\u015eahin, G.G., and Steedman, M. (November, January 31). Data Augmentation via Dependency Tree Morphing for Low-Resource Languages. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1545"},{"key":"ref_160","unstructured":"Xia, M., Kong, X., Anastasopoulos, A., and Neubig, G. (August, January 28). Generalized Data Augmentation for Low-Resource Translation. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_161","unstructured":"Zhu, Y., Heinzerling, B., Vuli\u0107, I., Strube, M., Reichart, R., and Korhonen, A. (August, January 28). On the Importance of Subword Information for Morphological Tasks in Truly Low-Resource Languages. Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), Florence, Italy."},{"key":"ref_162","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1162\/coli_a_00357","article-title":"Modeling language variation and universals: A survey on typological linguistics for natural language processing","volume":"45","author":"Ponti","year":"2019","journal-title":"Comput. Linguist."},{"key":"ref_163","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1162\/tacl_a_00467","article-title":"Data-driven Model Generalizability in Crosslinguistic Low-resource Morphological Segmentation","volume":"10","author":"Liu","year":"2022","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_164","unstructured":"Carl, M. (1999, January 13\u201317). Inducing translation templates for example-based machine translation. Proceedings of the Machine Translation Summit VII, Singapore."},{"key":"ref_165","unstructured":"Brown, R.D. (1999, January 23\u201325). Adding linguistic knowledge to a lexical example-based translation system. Proceedings of the 8th Conference on Theoretical and Methodological Issues in Machine Translation of Natural Languages, Chester, UK."},{"key":"ref_166","first-page":"377","article-title":"Stochastic inversion transduction grammars and bilingual parsing of parallel corpora","volume":"23","author":"Wu","year":"1997","journal-title":"Comput. Linguist."},{"key":"ref_167","doi-asserted-by":"crossref","unstructured":"Chiang, D. (2005, January 25\u201330). A hierarchical phrase-based model for statistical machine translation. Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics, Ann Arbor, MI, USA.","DOI":"10.3115\/1219840.1219873"},{"key":"ref_168","doi-asserted-by":"crossref","unstructured":"Gildea, D. (2003, January 7\u201312). Loosely tree-based alignment for machine translation. Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan.","DOI":"10.3115\/1075096.1075107"},{"key":"ref_169","doi-asserted-by":"crossref","unstructured":"Yamada, K., and Knight, K. (2001, January 9\u201311). A syntax-based statistical translation model. Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, Toulouse, France.","DOI":"10.3115\/1073012.1073079"},{"key":"ref_170","doi-asserted-by":"crossref","unstructured":"Galley, M., and Manning, C.D. (2009, January 2\u20137). Quadratic-time dependency parsing for machine translation. Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, Singapore.","DOI":"10.3115\/1690219.1690255"},{"key":"ref_171","doi-asserted-by":"crossref","unstructured":"Liu, Y., Liu, Q., and Lin, S. (2006, January 17\u201321). Tree-to-string alignment template for statistical machine translation. Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Sydney, Australia.","DOI":"10.3115\/1220175.1220252"},{"key":"ref_172","doi-asserted-by":"crossref","unstructured":"Huang, L., Knight, K., and Joshi, A. (2006, January 8\u201312). Statistical syntax-directed translation with extended domain of locality. Proceedings of the 7th Conference of the Association for Machine Translation in the Americas: Technical Papers, Cambridge, MA, USA.","DOI":"10.3115\/1631828.1631829"},{"key":"ref_173","doi-asserted-by":"crossref","unstructured":"Mi, H., and Huang, L. (2008, January 25\u201327). Forest-based translation rule extraction. Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, Honolulu, HI, USA.","DOI":"10.3115\/1613715.1613745"},{"key":"ref_174","doi-asserted-by":"crossref","unstructured":"Eisner, J. (2003, January 7\u201312). Learning non-isomorphic tree mappings for machine translation. Proceedings of the Companion Volume to the Proceedings of 41st Annual Meeting of the Association for Computational Linguistics, Sapporo, Japan.","DOI":"10.3115\/1075178.1075217"},{"key":"ref_175","unstructured":"Menezes, A., and Quirk, C. (2005, January 13\u201315). Dependency Treelet Translation: The convergence of statistical and example-based machine-translation?. Proceedings of the Workshop on Example-Based Machine Translation, Phuket, Thailand."},{"key":"ref_176","doi-asserted-by":"crossref","unstructured":"Zhang, M., Jiang, H., Li, H., Aw, A., and Li, S. (2008, January 18\u201322). Grammar comparison study for translational equivalence modeling and statistical machine translation. Proceedings of the 22nd International Conference on Computational Linguistics (COLING 2008), Manchester, UK.","DOI":"10.3115\/1599081.1599219"},{"key":"ref_177","unstructured":"Chiang, D. (2010, January 11\u201316). Learning to translate with source and target syntax. Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, Uppsala, Sweden."},{"key":"ref_178","unstructured":"Toutanova, K., Suzuki, H., and Ruopp, A. (2008, January 15\u201320). Applying morphology generation models to machine translation. Proceedings of the ACL-08: HLT, Columbus, OH, USA."},{"key":"ref_179","unstructured":"Bisazza, A., and Federico, M. (2009, January 1\u20132). Morphological pre-processing for Turkish to English statistical machine translation. Proceedings of the 6th International Workshop on Spoken Language Translation: Papers, Tokyo, Japan."},{"key":"ref_180","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s10590-011-9110-0","article-title":"Orthographic and morphological processing for English\u2013Arabic statistical machine translation","volume":"26","author":"Habash","year":"2012","journal-title":"Mach. Transl."},{"key":"ref_181","unstructured":"Herzig, J., Shaw, P., Chang, M.W., Guu, K., Pasupat, P., and Zhang, Y. (2021). Unlocking compositional generalization in pre-trained models using intermediate representations. arXiv."},{"key":"ref_182","unstructured":"Eyig\u00f6z, E., Gildea, D., and Oflazer, K. (2013, January 9\u201314). Simultaneous word-morpheme alignment for statistical machine translation. Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Atlanta, GA, USA."},{"key":"ref_183","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez-Cartagena, V.M., and Toral, A. (2016, January 11\u201312). Abu-MaTran at WMT 2016 Translation Task: Deep Learning, Morphological Segmentation and Tuning on Character Sequences. Proceedings of the 1st Conference on Machine Translation ACL, Berlin, Germany.","DOI":"10.18653\/v1\/W16-2322"},{"key":"ref_184","unstructured":"Pirinen, T.A. (2015, January 11\u201313). Omorfi-Free and open source morphological lexical database for Finnish. Proceedings of the 20th Nordic Conference of Computational Linguistics (NODALIDA 2015), Vilnius, Lithuania."},{"key":"ref_185","doi-asserted-by":"crossref","unstructured":"Smit, P., Virpioja, S., Gr\u00f6nroos, S.A., and Kurimo, M. (2014, January 26\u201330). Morfessor 2.0: Toolkit for statistical morphological segmentation. Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Gothenburg, Sweden.","DOI":"10.3115\/v1\/E14-2006"},{"key":"ref_186","doi-asserted-by":"crossref","unstructured":"Huck, M., Riess, S., and Fraser, A. (2017, January 7\u20138). Target-Side Word Segmentation Strategies for Neural Machine Translation. Proceedings of the Second Conference on Machine Translation (WMT), Copenhagen, Denmark.","DOI":"10.18653\/v1\/W17-4706"},{"key":"ref_187","doi-asserted-by":"crossref","unstructured":"Tamchyna, A., Marco, M.W.D., and Fraser, A. (2017, January 7\u20138). Modeling Target-Side Inflection in Neural Machine Translation. Proceedings of the Second Conference on Machine Translation (WMT), Copenhagen, Denmark.","DOI":"10.18653\/v1\/W17-4704"},{"key":"ref_188","unstructured":"Ataman, D., and Federico, M. (2018, January 17\u201321). An evaluation of two vocabulary reduction methods for neural machine translation. Proceedings of the 13th Conference of the Association for Machine Translation in the Americas, Boston, MA, USA."},{"key":"ref_189","doi-asserted-by":"crossref","unstructured":"Sennrich, R. (2017, January 3\u20137). How Grammatical is Character-Level Neural Machine Translation? Assessing MT Quality with Contrastive Translation Pairs. Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, Valencia, Spain.","DOI":"10.18653\/v1\/E17-2060"},{"key":"ref_190","doi-asserted-by":"crossref","unstructured":"Ataman, D., Firat, O., Di Gangi, M.A., Federico, M., and Birch, A. (2019, January 4). On the Importance of Word Boundaries in Character-Level Neural Machine Translation. Proceedings of the 3rd Workshop on Neural Generation and Translation, Hong Kong, China.","DOI":"10.18653\/v1\/D19-5619"},{"key":"ref_191","doi-asserted-by":"crossref","unstructured":"Papineni, K., Roukos, S., Ward, T., and Zhu, W.J. (2002, January 6\u201312). Bleu: A method for automatic evaluation of machine translation. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, PA, USA.","DOI":"10.3115\/1073083.1073135"},{"key":"ref_192","unstructured":"Snover, M., Dorr, B., Schwartz, R., Micciulla, L., and Makhoul, J. (2006, January 8\u201312). A study of translation edit rate with targeted human annotation. Proceedings of the 7th Conference of the Association for Machine Translation in the Americas: Technical Papers, Cambridge, MA, USA."},{"key":"ref_193","doi-asserted-by":"crossref","unstructured":"Doddington, G. (2002, January 24\u201327). Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. Proceedings of the Second International Conference on Human Language Technology Research, San Diego, CA, USA.","DOI":"10.3115\/1289189.1289273"},{"key":"ref_194","first-page":"11","article-title":"Machine translation: A concise history","volume":"13","author":"Hutchins","year":"2007","journal-title":"Comput. Aided Transl. Theory Pract."},{"key":"ref_195","unstructured":"Culy, C., and Riehemann, S.Z. (2003, January 18\u201322). The limits of N-gram translation evaluation metrics. Proceedings of the Machine Translation Summit IX: Papers, New Orleans, LA, USA."},{"key":"ref_196","unstructured":"Callison-Burch, C., Osborne, M., and Koehn, P. (2006, January 3\u20137). re-evaluating the role of BLEU in machine translation research. Proceedings of the 11th Conference of the European Chapter of the Association for Computational Linguistics, Trento, Italy."},{"key":"ref_197","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s10590-009-9066-5","article-title":"Metrics for MT evaluation: Evaluating reordering","volume":"24","author":"Birch","year":"2010","journal-title":"Mach. Transl."},{"key":"ref_198","doi-asserted-by":"crossref","unstructured":"Mathur, N., Baldwin, T., and Cohn, T. (2020, January 5\u201310). Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.448"},{"key":"ref_199","doi-asserted-by":"crossref","unstructured":"Popovi\u0107, M. (2015, January 17\u201318). chrF: Character n-gram F-score for automatic MT evaluation. Proceedings of the Tenth Workshop on Statistical Machine Translation, Lisbon, Portugal.","DOI":"10.18653\/v1\/W15-3049"},{"key":"ref_200","unstructured":"Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2020, January 26\u201330). BERTScore: Evaluating Text Generation with BERT. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia."},{"key":"ref_201","doi-asserted-by":"crossref","unstructured":"Jawahar, G., Sagot, B., and Seddah, D. (August, January 28). What does BErT learn about the structure of language?. Proceedings of the ACL 2019-57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy.","DOI":"10.18653\/v1\/P19-1356"},{"key":"ref_202","doi-asserted-by":"crossref","unstructured":"Chi, E.A., Hewitt, J., and Manning, C.D. (2020, January 5\u201310). Finding Universal Grammatical Relations in Multilingual BErT. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.493"},{"key":"ref_203","doi-asserted-by":"crossref","unstructured":"Tian, Y., Xia, F., and Song, Y. (2024, January 11\u201316). Large Language Models Are No Longer Shallow Parsers. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.acl-long.384"},{"key":"ref_204","unstructured":"Urbizu, G., Zulaika, M., Saralegi, X., and Corral, A. (2024, January 20\u201325). How Well Can BErT Learn the Grammar of an Agglutinative and Flexible-Order Language? The Case of Basque. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LrEC-COLING 2024), Torino, Italy."},{"key":"ref_205","unstructured":"Koehn, P. (2005, January 13\u201315). Europarl: A parallel corpus for statistical machine translation. Proceedings of the 10th Machine Translation Summit, Phuket, Thailand."},{"key":"ref_206","unstructured":"Ziemski, M., Junczys-Dowmunt, M., and Pouliquen, B. (2016, January 23\u201328). The United Nations Parallel Corpus v1.0. Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), Portoro\u017e, Slovenia."},{"key":"ref_207","unstructured":"Moore, R.C., and Lewis, W.D. (2010, January 11\u201316). Intelligent selection of language model training data. Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, Uppsala, Sweden."},{"key":"ref_208","unstructured":"Cuong, H., and Sima\u2019an, K. (2014, January 23\u201329). Latent domain translation models in mix-of-domains haystack. Proceedings of the COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, Dublin, Ireland."},{"key":"ref_209","doi-asserted-by":"crossref","unstructured":"Huang, F. (2009, January 2\u20137). Confidence measure for word alignment. Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing (ACL-IJCNLP), Association for Computational Linguistics, Singapore.","DOI":"10.3115\/1690219.1690277"},{"key":"ref_210","unstructured":"Smith, J.R., Saint-Amand, H., Plamada, M., Koehn, P., Callison-Burch, C., and Lopez, A. (2013, January 4\u20139). Dirt cheap web-scale parallel text from the common crawl. Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics, Sofia, Bulgaria."},{"key":"ref_211","unstructured":"Espl\u00e0-Gomis, M., Forcada, M.L., and S\u00e1nchez-Mart\u00ednez, F. (2020, January 3\u20135). ParaCrawl: Web-scale acquisition of parallel corpora. Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, Lisboa, Portugal."},{"key":"ref_212","unstructured":"Schwenk, H., Wenzek, G., Edunov, S., Grave, E., and Joulin, A. (2019). CCMatrix: Mining billions of high-quality parallel sentences on the web. arXiv."},{"key":"ref_213","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1162\/tacl_a_00288","article-title":"Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond","volume":"7","author":"Artetxe","year":"2019","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_214","unstructured":"Feng, F., Yang, Y., Cer, D., Arivazhagan, N., and Wang, W. (2020). Language-agnostic BERT sentence embedding. arXiv."},{"key":"ref_215","doi-asserted-by":"crossref","unstructured":"NLLB Team (2024). Scaling neural machine translation to 200 languages. Nature, 630, 841\u2013846.","DOI":"10.1038\/s41586-024-07335-x"},{"key":"ref_216","unstructured":"He, P., Liu, X., Gao, J., and Chen, W. (2021, January 3\u20137). DeBERTa: Decoding-enhanced BERT with disentangled attention. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria."},{"key":"ref_217","unstructured":"Zhang, J., and Zong, C. (2016, January 11\u201316). Forward Translation for Improvements in Neural Machine Translation. Proceedings of the 2016 International Conference on Computational Linguistics and Natural Language Processing, Osaka, Japan."},{"key":"ref_218","unstructured":"Axelrod, A., He, X., and Gao, J. (2011, January 27\u201331). Domain adaptation via pseudo in-domain data selection. Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Edinburgh, UK."},{"key":"ref_219","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1515\/pralin-2017-0027","article-title":"Neural networks classifier for data selection in statistical machine translation","volume":"108","author":"Peris","year":"2016","journal-title":"Prague Bull. Math. Linguist."},{"key":"ref_220","unstructured":"Arivazhagan, N., Bapna, A., Firat, O., Aharoni, R., Johnson, M., and Macherey, W. (2019). Massively multilingual neural machine translation in the wild: Findings and challenges. arXiv."},{"key":"ref_221","unstructured":"Wang, Y., and Neubig, G. (August, January 28). Target conditioned sampling: Optimizing data selection for multilingual neural machine translation. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_222","first-page":"107","article-title":"Beyond English-centric multilingual machine translation","volume":"22","author":"Fan","year":"2021","journal-title":"J. Mach. Learn. Res."},{"key":"ref_223","doi-asserted-by":"crossref","unstructured":"Tan, X., Ren, Y., He, D., Qin, T., Xu, W., and Liu, T.Y. (2019, January 3\u20137). Multilingual neural machine translation with language clustering. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China.","DOI":"10.18653\/v1\/D19-1089"},{"key":"ref_224","doi-asserted-by":"crossref","unstructured":"Xue, L., Constant, N., Roberts, A., Kale, M., Al-Rfou, R., Siddhant, A., Barua, A., and Raffel, C. (2021, January 6\u201311). mT5: A massively multilingual pre-trained text-to-text transformer. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.","DOI":"10.18653\/v1\/2021.naacl-main.41"},{"key":"ref_225","doi-asserted-by":"crossref","unstructured":"Kim, Y., and Rush, A.M. (2016, January 1\u20135). Sequence-level knowledge distillation. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1139"},{"key":"ref_226","doi-asserted-by":"crossref","unstructured":"Wang, S., Liu, Y., Wang, C., Luan, H., and Sun, M. (2019, January 3\u20137). Improving Back-Translation with Uncertainty-Based Confidence Estimation. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1073"},{"key":"ref_227","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1162\/tacl_a_00474","article-title":"The FLORES-101 evaluation benchmark for low-resource and multilingual translation","volume":"10","author":"Goyal","year":"2022","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_228","doi-asserted-by":"crossref","unstructured":"Zhang, B., Williams, P., Titov, I., and Sennrich, R. (2020). Improving massively multilingual neural machine translation and zero-shot translation. arXiv.","DOI":"10.18653\/v1\/2020.acl-main.148"},{"key":"ref_229","doi-asserted-by":"crossref","unstructured":"Ahuja, S., Aggarwal, D., Gumma, V., Watts, I., Sathe, A., Ochieng, M., Hada, R., Jain, P., Ahmed, M., and Bali, K. (2024, January 16\u201321). MEGAVErSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Mexico City, Mexico.","DOI":"10.18653\/v1\/2024.naacl-long.143"},{"key":"ref_230","doi-asserted-by":"crossref","first-page":"1802","DOI":"10.1038\/s41562-023-01716-4","article-title":"Generative AI has a language problem","volume":"7","author":"Choudhury","year":"2023","journal-title":"Nat. Hum. Behav."},{"key":"ref_231","unstructured":"Gurgurov, D., B\u00e4umel, T., and Anikina, T. (2024). Multilingual Large Language Models and Curse of Multilinguality. arXiv."},{"key":"ref_232","doi-asserted-by":"crossref","unstructured":"Bafna, N., Murray, K., and Yarowsky, D. (2024, January 12\u201316). Evaluating Large Language Models Along Dimensions of Language Variation: A Systematik Invesdigatiom uv Cross-Lingual Generalization. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.emnlp-main.1044"},{"key":"ref_233","doi-asserted-by":"crossref","unstructured":"Mirzakhalov, J., Babu, A., Ataman, D., Kariev, S., Tyers, F., Abduraufov, O., Hajili, M., Ivanova, S., Khaytbaev, A., and Laverghetta, A. (2021, January 7\u201311). A Large-Scale Study of Machine Translation in Turkic Languages. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.475"},{"key":"ref_234","unstructured":"Emezue, C.C., and Dossou, B.F. (2021, January 10\u201311). MMTAfrica: Multilingual Machine Translation for African Languages. Proceedings of the Sixth Conference on Machine Translation, Online."},{"key":"ref_235","first-page":"90","article-title":"IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languages","volume":"2023","author":"Gala","year":"2023","journal-title":"Trans. Mach. Learn. Res."},{"key":"ref_236","unstructured":"Weller-Di Marco, M., and Fraser, A. (2022, January 7\u20138). Findings of the WMT 2022 shared tasks in unsupervised MT and very low resource supervised MT. Proceedings of the Seventh Conference on Machine Translation (WMT), Abu Dhabi, United Arab Emirates."},{"key":"ref_237","doi-asserted-by":"crossref","unstructured":"Ahmad, I.S., Anastasopoulos, A., Bojar, O., Borg, C., Carpuat, M., Cattoni, R., Cettolo, M., Chen, W., Dong, Q., and Federico, M. (2024, January 15\u201316). Findings of the IWSLT 2024 Evaluation Campaign. Proceedings of the 21st International Conference on Spoken Language Translation (IWSLT 2024), Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.iwslt-1.1"},{"key":"ref_238","unstructured":"Wenzek, G., Chaudhary, V., Fan, A., Gomez, S., Goyal, N., Jain, S., Kiela, D., Thrush, T., and Guzm\u00e1n, F. (2021, January 10\u201311). Findings of the WMT 2021 shared task on large-scale multilingual machine translation. Proceedings of the Sixth Conference on Machine Translation, Online."},{"key":"ref_239","unstructured":"Cettolo, M., Federico, M., Bentivogli, L., Niehues, J., St\u00fcker, S., Sudoh, K., Yoshino, K., and Federmann, C. (2017, January 14\u201315). Overview of the IWSLT 2017 evaluation campaign. Proceedings of the 14th International Workshop on Spoken Language Translation, Tokyo, Japan."},{"key":"ref_240","unstructured":"Niehues, J., Cattoni, R., St\u00fcker, S., Cettolo, M., Turchi, M., and Federico, M. (2018, January 29\u201330). The IWSLT 2018 Evaluation Campaign. Proceedings of the 15th International Conference on Spoken Language Translation, Bruges, Belgium."},{"key":"ref_241","unstructured":"Fraser, A. (2010, January 15\u201316). Findings of the WMT 2020 shared tasks in unsupervised MT and very low resource supervised MT. Proceedings of the Fifth Conference on Machine Translation, Uppsala, Sweden."},{"key":"ref_242","unstructured":"Libovick\u1ef3, J., and Fraser, A. (2021, January 10\u201311). Findings of the WMT 2021 shared tasks in unsupervised MT and very low resource supervised MT. Proceedings of the Sixth Conference on Machine Translation, Online."},{"key":"ref_243","unstructured":"Sant, J. (2022). Multilingual Low-Resource Translation for Indo-European Languages. [Bachelor\u2019s Thesis, University of Malta]."},{"key":"ref_244","unstructured":"Adelani, D.I., Alam, M.M.I., Anastasopoulos, A., Bhagia, A., Costa-Juss\u00e0, M.R., Dodge, J., Faisal, F., Federmann, C., Fedorova, N., and Guzm\u00e1n, F. (2022, January 7\u20138). Findings of the WMT\u201922 shared task on large-scale machine translation evaluation for African languages. Proceedings of the Seventh Conference on Machine Translation (WMT), Abu Dhabi, United Arab Emirates."},{"key":"ref_245","doi-asserted-by":"crossref","unstructured":"Pal, S., Pakray, P., Laskar, S.R., Laitonjam, L., Khenglawt, V., Warjri, S., Dadure, P.K., and Dash, S.K. (2023, January 6\u20137). Findings of the WMT 2023 shared task on low-resource Indic language translation. Proceedings of the Eighth Conference on Machine Translation, Singapore.","DOI":"10.18653\/v1\/2023.wmt-1.56"},{"key":"ref_246","doi-asserted-by":"crossref","unstructured":"Dabre, R., and Kunchukuttan, A. (2024, January 15\u201316). Findings of wmt 2024\u2019s multiindic22mt shared task for machine translation of 22 indian languages. Proceedings of the Ninth Conference on Machine Translation, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.wmt-1.55"},{"key":"ref_247","doi-asserted-by":"crossref","unstructured":"S\u00e1nchez-Mart\u00ednez, F., P\u00e9rez-Ortiz, J.A., Galiano-Jim\u00e9nez, A., and Oliver, A. (2024, January 15\u201316). Findings of the WMT 2024 Shared Task Translation into Low-Resource Languages of Spain: Blending Rule-Based and Neural Systems. Proceedings of the Ninth Conference on Machine Translation, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.wmt-1.57"},{"key":"ref_248","doi-asserted-by":"crossref","unstructured":"Pakray, P., Pal, S., Vetagiri, A., Krishna, R., Maji, A.K., Dash, S., Laitonjam, L., Sarah, L., and Manna, R. (2024, January 15\u201316). Findings of wmt 2024 shared task on low-resource indic languages translation. Proceedings of the Ninth Conference on Machine Translation, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.wmt-1.54"},{"key":"ref_249","doi-asserted-by":"crossref","unstructured":"Anastasopoulos, A., Barrault, L., Bentivogli, L., Bojar, O., Cattoni, R., Currey, A., Dinu, G., Duh, K., Elbayad, M., and Emmanuel, C. (2022, January 26\u201327). Findings of the IWSLT 2022 Evaluation Campaign. Proceedings of the 19th International Conference on Spoken Language Translation (IWSLT 2022), Association for Computational Linguistics, Dublin, Ireland.","DOI":"10.18653\/v1\/2022.iwslt-1.10"},{"key":"ref_250","doi-asserted-by":"crossref","unstructured":"Iyer, V., Malik, B., Zhu, W., Stepachev, P., Chen, P., Haddow, B., and Birch-Mayne, A. (2024, January 21). Exploring very low-resource translation with LLMs: The University of Edinburgh\u2019s submission to AmericasNLP 2024 translation task. Proceedings of the 4th Workshop on NLP for Indigenous Languages of the Americas, Association for Computational Linguistics (ACL), Mexico City, Mexico.","DOI":"10.18653\/v1\/2024.americasnlp-1.25"},{"key":"ref_251","doi-asserted-by":"crossref","unstructured":"Singh, S., Vargus, F., D\u2019souza, D., Karlsson, B., Mahendiran, A., Ko, W.Y., Shandilya, H., Patel, J., Mataciunas, D., and O\u2019Mahony, L. (2024, January 11\u201316). Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.acl-long.620"},{"key":"ref_252","unstructured":"Tanzer, G., Suzgun, M., Visser, E., Jurafsky, D., and Melas-Kyriazi, L. (2023, January 1\u20135). A Benchmark for Learning to Translate a New Language from One Grammar Book. Proceedings of the Twelfth International Conference on Learning Representations, Kigali, Rwanda."},{"key":"ref_253","doi-asserted-by":"crossref","unstructured":"Tran, K.M., Bisazza, A., and Monz, C. (November, January 31). The Importance of Being Recurrent for Modeling Hierarchical Structure. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1503"},{"key":"ref_254","unstructured":"Zhu, H., Liang, Y., Xu, W., and Xu, H. (2025, January 20). Evaluating Large Language Models for In-Context Learning of Linguistic Patterns in Unseen Low resource Languages. Proceedings of the First Workshop on Language Models for Low-Resource Languages, Abu Dhabi, United Arab Emirates."},{"key":"ref_255","doi-asserted-by":"crossref","unstructured":"Zhang, K., Choi, Y.M., Song, Z., He, T., Wang, W.Y., and Li, L. (2024). Hire a Linguist!: Learning Endangered Languages with In-Context Linguistic Descriptions. arXiv.","DOI":"10.18653\/v1\/2024.findings-acl.925"},{"key":"ref_256","unstructured":"Zerva, C., Blain, F., Rei, R., Lertvittayakumjorn, P., De Souza, J.G., Eger, S., Kanojia, D., Alves, D., Or\u01cesan, C., and Fomicheva, M. (2022, January 7\u20138). Findings of the WMT 2022 shared task on quality estimation. Proceedings of the Seventh Conference on Machine Translation (WMT), Abu Dhabi, United Arab Emirates."},{"key":"ref_257","unstructured":"Freitag, M., Rei, R., Mathur, N., Lo, C.K., Stewart, C., Avramidis, E., Kocmi, T., Foster, G., Lavie, A., and Martins, A.F. (2022, January 7\u20138). results of WMT22 metrics shared task: Stop using BLEU\u2013neural metrics are better and more robust. Proceedings of the Seventh Conference on Machine Translation (WMT), Abu Dhabi, United Arab Emirates."},{"key":"ref_258","doi-asserted-by":"crossref","unstructured":"Freitag, M., Mathur, N., Lo, C.K., Avramidis, E., Rei, R., Thompson, B., Kocmi, T., Blain, F., Deutsch, D., and Stewart, C. (2023, January 6\u20137). Results of WMT23 metrics shared task: Metrics might be guilty but references are not innocent. Proceedings of the Eighth Conference on Machine Translation, Singapore.","DOI":"10.18653\/v1\/2023.wmt-1.51"},{"key":"ref_259","doi-asserted-by":"crossref","unstructured":"Freitag, M., Mathur, N., Deutsch, D., Lo, C.K., Avramidis, E., Rei, R., Thompson, B., Blain, F., Kocmi, T., and Wang, J. (2024, January 15\u201316). Are LLMs breaking MT metrics? results of the WMT24 metrics shared task. Proceedings of the Ninth Conference on Machine Translation, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.wmt-1.2"},{"key":"ref_260","unstructured":"Liu, C., Dahlmeier, D., and Ng, H.T. (2011, January 27\u201329). Better evaluation metrics lead to better machine translation. Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, Edinburgh, UK."},{"key":"ref_261","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3485766","article-title":"A survey of evaluation metrics used for NLG systems","volume":"55","author":"Sai","year":"2022","journal-title":"ACM Comput. Surv. (CSUr)"},{"key":"ref_262","doi-asserted-by":"crossref","unstructured":"Moghe, N., Sherborne, T., Steedman, M., and Birch, A. (2023, January 9\u201314). Extrinsic Evaluation of Machine Translation Metrics. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Toronto, ON, Canada.","DOI":"10.18653\/v1\/2023.acl-long.730"},{"key":"ref_263","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1162\/tacl_a_00447","article-title":"Quality at a glance: An audit of web-crawled multilingual datasets","volume":"10","author":"Kreutzer","year":"2022","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_264","doi-asserted-by":"crossref","unstructured":"Wang, C., and Sennrich, R. (2020, January 5\u201310). On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translation. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Seattle, WA, USA.","DOI":"10.18653\/v1\/2020.acl-main.326"},{"key":"ref_265","doi-asserted-by":"crossref","unstructured":"Raunak, V., Menezes, A., and Junczys-Dowmunt, M. (2021, January 6\u201311). The Curious Case of Hallucinations in Neural Machine Translation. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.","DOI":"10.18653\/v1\/2021.naacl-main.92"},{"key":"ref_266","doi-asserted-by":"crossref","first-page":"1500","DOI":"10.1162\/tacl_a_00615","article-title":"Hallucinations in large multilingual translation models","volume":"11","author":"Guerreiro","year":"2023","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_267","unstructured":"Craciunescu, O., Gerding-Salas, C., and Stringer-O\u2019Keeffe, S. (2004). Machine translation and computer-assisted translation. Transl. J., 8."},{"key":"ref_268","unstructured":"Guha, J., and Heger, C. (2014, January 22\u201326). Machine translation for global e-commerce on ebay. Proceedings of the AMTA, Vancouver, BC, Canada."},{"key":"ref_269","unstructured":"Dinu, G., Mathur, P., Federico, M., and Al-Onaizan, Y. (August, January 28). Training Neural Machine Translation to Apply Terminology Constraints. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_270","doi-asserted-by":"crossref","unstructured":"Kocmi, T., Avramidis, E., Bawden, R., Bojar, O., Dvorkovich, A., Federmann, C., Fishel, M., Freitag, M., Gowda, T., and Grundkiewicz, R. (2024, January 15\u201316). Findings of the WMT24 general machine translation shared task: The LLM era is here but MT is not solved yet. Proceedings of the Ninth Conference on Machine Translation, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.wmt-1.1"},{"key":"ref_271","unstructured":"Reeder, F. (2001, January 18\u201322). In one hundred words or less. Proceedings of the Workshop on MT Evaluation, Santiago de Compostela, Spain."},{"key":"ref_272","doi-asserted-by":"crossref","unstructured":"Ahmadian, A., Cremer, C., Gall\u00e9, M., Fadaee, M., Kreutzer, J., Pietquin, O., \u00dcst\u00fcn, A., and Hooker, S. (2024, January 11\u201316). Back to Basics: Revisiting rEINFOrCE-Style Optimization for Learning from Human Feedback in LLMs. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics, Bangkok, Thailand.","DOI":"10.18653\/v1\/2024.acl-long.662"},{"key":"ref_273","unstructured":"M\u00fcller, M., Sennrich, R., and Volk, M. (November, January 31). Evaluation of coherence in machine translation with discourse-aware metrics. Proceedings of the Third Conference on Machine Translation: Research Papers, Brussels, Belgium."},{"key":"ref_274","doi-asserted-by":"crossref","unstructured":"Bawden, R., Sennrich, R., Birch, A., and Haddow, B. (2018, January 1\u20136). Evaluating discourse phenomena in neural machine translation. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, New Orleans, LA, USA.","DOI":"10.18653\/v1\/N18-1118"},{"key":"ref_275","unstructured":"Wang, X., Zhang, J., and Koehn, P. (2023, January 9\u201314). Document-level translation with large language models. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, Toronto, ON, Canada."},{"key":"ref_276","unstructured":"Freitag, M., Al-Onaizan, Y., Bapna, A., Johnson, M., Niu, X., Rios, A., Tran, C., and Firat, O. (2022, January 10\u201315). High-quality machine translation with expert-based human evaluation. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, WA, USA."},{"key":"ref_277","doi-asserted-by":"crossref","unstructured":"Iyer, V., Malik, B., Stepachev, P., Chen, P., Haddow, B., and Birch, A. (2024, January 15\u201316). Quality or Quantity? On Data Scale and Diversity in Adapting Large Language Models for Low-Resource Translation. Proceedings of the Ninth Conference on Machine Translation, Miami, FL, USA.","DOI":"10.18653\/v1\/2024.wmt-1.128"},{"key":"ref_278","doi-asserted-by":"crossref","unstructured":"Iyer, V., Chen, P., and Birch, A. (2023, January 6\u20137). Towards Effective Disambiguation for Machine Translation with Large Language Models. Proceedings of the Eighth Conference on Machine Translation, Singapore.","DOI":"10.18653\/v1\/2023.wmt-1.44"},{"key":"ref_279","doi-asserted-by":"crossref","unstructured":"Oncevay, A., Ataman, D., Van Berkel, N., Haddow, B., Birch, A., and Bjerva, J. (2022, January 10\u201315). Quantifying Synthesis and Fusion and Their Impact on Machine Translation. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Seattle, WA, USA.","DOI":"10.18653\/v1\/2022.naacl-main.94"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/9\/723\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:35:30Z","timestamp":1760034930000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/9\/723"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,25]]},"references-count":279,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["info16090723"],"URL":"https:\/\/doi.org\/10.3390\/info16090723","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,25]]}}}