{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T23:54:19Z","timestamp":1785974059821,"version":"3.56.0"},"reference-count":46,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T00:00:00Z","timestamp":1705017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Efforts to automate translation were made in the 1950s and 1960s, albeit with limited resources compared to current advanced standards. Machine translation is categorised under computational linguistics that examines employing computer software in the rendition of text from one language into another. The present paper seeks to compare five different machine translation systems for the sake of assessing the quality of their outputs in rendering certain articles of the Saudi Commercial Law into English through post-editing based on Human Translation Edit Rate. Each machine translation output is assessed against the same post-edited version, and the closest output to the post-edited version with regard to the use of the same lexicon and word order will achieve the lowest score. The lower the score of the machine translation output is, the higher quality it has. The paper then analyses the results of the Human Translation Edit Rate metric evaluation to ascertain as to whether or not high-quality machine translation outputs always produce acceptable Arabic\u2013English legal translation. The present paper argues that the use of Human Translation Edit Rate metric is a useful tool for the sake of undertaking post-editing procedures as it is a combination of both human evaluation as well as automatic evaluation. It is also advantageous as it takes account of both the use of lexicon and word order. However, such metric cannot be sufficiently depended on as one term substitution, which will be counted according to this metric as a single error, may render the whole sentence invalid, particularly in legal translation. This paper offers a baseline for the quality assessment of machine translation output through post-editing based on Human Translation Edit Rate metric and how its results should be analysed within Arabic\u2013English legal translation context, which may have implications for similar machine translation output quality assessment contexts.<\/jats:p>","DOI":"10.3389\/frai.2023.1282020","type":"journal-article","created":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T04:27:56Z","timestamp":1705033676000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["The use of automation in the rendition of certain articles of the Saudi Commercial Law into English: a post-editing-based comparison of five machine translation systems"],"prefix":"10.3389","volume":"6","author":[{"given":"Rafat Y.","family":"Alwazna","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,1,12]]},"reference":[{"key":"B1","author":"Almunjid","year":"2001","journal-title":"Almunjid"},{"key":"B2","doi-asserted-by":"publisher","first-page":"897","DOI":"10.1007\/s11196-013-9331-z","article-title":"Testing the precision of legal translation: the case of translating Islamic legal terms into English","volume":"26","author":"Alwazna","year":"","journal-title":"Int. J. Semiot. Law"},{"key":"B3","volume-title":"Translating Hanbal\u012b Shar\u012b\u2018a Code from Arabic into English","author":"Alwazna","year":""},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5539\/ells.v5n4p1","article-title":"Translation evaluation: the suitability of the argument macrostructure model for the assessment of translated texts across different fields","volume":"5","author":"Alwazna","year":"2015","journal-title":"Engl. Lang. Lit. Stud."},{"key":"B5","first-page":"211","article-title":"\u201cProblems of terminology in translating Islamic Law into legal English,\u201d","volume-title":"Meaning in Translation: Illusion of Precision. Paper presented at the Conference of Meaning in translation: Illusion of Precision, Riga, Latvia 2012","author":"Alwazna","year":""},{"key":"B6","first-page":"55","article-title":"\u201cTranslation quality assessment: the application of the argument macrostructure model to texts across different fields,\u201d","volume-title":"Translation and Meaning. New Series, Vol. 2, pt. 1. Paper presented at The Conference of Translation and Meaning, Lodz, Poland 2015","author":"Alwazna","year":""},{"key":"B7","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1515\/ijld-2017-0013","article-title":"Culture and law: the culture impact on Islamic legal statements and its implications for translation","volume":"2","author":"Alwazna","year":"2017","journal-title":"Int. J. Leg. Discourse"},{"key":"B8","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1007\/s11196-018-9580-y","article-title":"Translation and legal terminology: techniques for coping with the untranslatability of legal terms between Arabic and English","volume":"32","author":"Alwazna","year":"2019","journal-title":"Int. J. Semiot. Law"},{"key":"B9","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1075\/z.70.02arn","article-title":"\u201cTerminological equivalence and translation,\u201d","volume-title":"Terminology: Applications in Interdisciplinary Communication","author":"Arntz","year":"1993"},{"key":"B10","first-page":"3982","article-title":"\u201cPET: tool for post-editing and assessing machine translation,\u201d","author":"Aziz","year":"2012","journal-title":"Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12"},{"key":"B11","first-page":"1","article-title":"\u201cOn the same page? Comparing inter-annotator agreement in sentence and document level human machine translation evaluation,\u201d","volume-title":"Proceedings of the Fifth Conference on Machine Translation. Paper presented at the Fifth Conference on Machine Translation, Stroudsburg, USA 2020","author":"Castilho","year":"2020"},{"key":"B12","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/978-3-319-91241-7_2","article-title":"\u201cApproaches to human and machine translation quality assessment,\u201d","volume-title":"Translation Quality Assessment: From Principles to Practice","author":"Castilho","year":"2018"},{"key":"B13","first-page":"245","article-title":"Study and comparison of rule-based and statistical Catalan-Spanish machine translation systems","volume":"31","author":"Costa-Juss\u00e0","year":"2012","journal-title":"Comput. Inform."},{"key":"B14","article-title":"\u201cAnalysing post-editing performance: correlations with years of translation experience,\u201d","author":"De Almeida","year":"2010","journal-title":"Proceedings of The 14"},{"key":"B15","first-page":"131","article-title":"\u201cIssues in human and automatic translation quality assessment,\u201d","volume-title":"Human Issues in Translation Technology","author":"Doherty","year":"2017"},{"key":"B16","first-page":"597","article-title":"Machine translation divergences","volume":"20","author":"Dorr","year":"1994","journal-title":"Comput. Linguist."},{"key":"B17","volume-title":"Quality in Professional Translation: Assessment and Improvement","author":"Drugan","year":"2013"},{"key":"B18","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1075\/ts.6.2.06for","article-title":"Making sense of neural translation","volume":"6","author":"Forcada","year":"2017","journal-title":"Transl. Spaces"},{"key":"B19","volume-title":"Deep Learning","author":"Goodfellow","year":"2016"},{"key":"B20","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1075\/hts.1.qua1","article-title":"\u201cQuality in translation,\u201d","author":"Gouadec","year":"2010","journal-title":"Handbook of Translation Studies: Volume 1"},{"key":"B21","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1075\/intp.10.2.04grb","article-title":"Constructing interpreting quality","volume":"10","author":"Grbi\u0107","year":"2008","journal-title":"Interpreting"},{"key":"B22","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1007\/s10590-014-9155-y","article-title":"Correlations between productivity and quality when post-editing in a professional context","volume":"28","author":"Guerberof Arenas","year":"2014","journal-title":"Mach. Transl."},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1057\/9781137025487_13","author":"House","year":"2015","journal-title":"Translation Quality Assessment: Past and Present"},{"key":"B24","doi-asserted-by":"crossref","DOI":"10.1075\/sihols.97","volume-title":"Early Years in Machine Translation: Memoirs and Biographies of Pioneers.","author":"Hutchins","year":"2000"},{"key":"B25","unstructured":"2017"},{"key":"B26","first-page":"23","article-title":"\u201cHuman and machine translation,\u201d","author":"Kenny","year":"2022","journal-title":"Machine Translation for Everyone: Empowering Users in the Age of Artificial Intelligence"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511815829","author":"Koehn","year":"2010","journal-title":"Statistical Machine Translation"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1017\/9781108608480","author":"Koehn","year":"2020","journal-title":"Neural Machine Translation"},{"key":"B29","year":"2005","journal-title":"Longman Dictionary of Contemporary English"},{"key":"B30","unstructured":"MarkingM.\n          Facebook Says Statistical Machine Translation has Reached end of Life. Slator2016"},{"key":"B31","author":"Martin","year":"2002","journal-title":"Oxford Dictionary of Law"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1222","DOI":"10.1109\/TASL.2008.914970","article-title":"System combination for machine translation of spoken and written language","volume":"16","author":"Matusov","year":"2008","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"B33","doi-asserted-by":"publisher","first-page":"375","DOI":"10.1080\/1750399X.2018.1501639","article-title":"What to expect from neural machine translation: a practical in-class translation evaluation exercise","volume":"12","author":"Moorkens","year":"2018","journal-title":"Interpret. Transl. Train"},{"key":"B34","doi-asserted-by":"crossref","DOI":"10.4324\/9780203117743","volume-title":"Evaluation in Translation: Critical Points of Translator Decision-Making","author":"Munday","year":"2012"},{"key":"B35","volume-title":"A Short Guide to Post-editing","author":"Nitzke","year":"2021"},{"key":"B36","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s10590-011-9096-7","article-title":"Towards predicting post-editing productivity","volume":"25","author":"O'Brien","year":"2011","journal-title":"Mach. Transl."},{"key":"B37","first-page":"105","article-title":"\u201cHow to deal with errors in machine translation: post-editing,\u201d","volume-title":"Machine Translation for Everyone: Empowering Users in the Age of Artificial Intelligence","author":"O'Brien","year":"2022"},{"key":"B38","first-page":"51","article-title":"\u201cHow to choose a suitable neural machine translation solution: evaluation of MT quality,\u201d","volume-title":"Machine Translation for Everyone: Empowering Users in the Age of Artificial Intelligence","author":"Rossi","year":"2022"},{"key":"B39","volume-title":"New Approach to Legal Translation","author":"\u0160ar\u010devi\u0107","year":"1997"},{"key":"B40","article-title":"\u201cLegal translation and translation theory: a receiver-oriented approach,\u201d","author":"\u0160ar\u010devi\u0107","year":"2000","journal-title":"Legal Translation: History, Theory\/ies and Practice. Paper presented at International Clloquium, Geneva, Switzerland 2000"},{"key":"B41","unstructured":"ScrivenM.\n          Key Evaluation Checklist2007"},{"key":"B42","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1017\/S1472669621000384","article-title":"Emerging legal informatics towards legal innovation: current status and future challenges and opportunities","volume":"21","author":"Sharma","year":"2021","journal-title":"Leg. Inf. Manag."},{"key":"B43","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1075\/ata.viii.12smi","article-title":"\u201cCulture clash: Anglo-American Case Law and German Civil Law in translation,\u201d","author":"Smith","year":"1995","journal-title":"Translation and the Law"},{"key":"B44","first-page":"113","article-title":"\u201cA study of translation edit rate with targeted human annotation,\u201d","volume-title":"Proceedings of The Seventh Conference of The Association for Machine Translation in The Americas: Technical Papers. Paper presented at The Seventh Conference of The Association for Machine Translation in The Americas: Technical Papers, Cambridge, USA 2006","author":"Snover","year":"2006"},{"key":"B45","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1093\/oxfordhb\/9780199239306.013.0017","article-title":"\u201cLegal translation,\u201d","author":"Wolff","year":"2011","journal-title":"The Oxford Handbook of Translation Studies"},{"key":"B46","first-page":"87","article-title":"The impact of Google neural machine translation on post-editing by student translators","volume":"31","author":"Yamada","year":"2019","journal-title":"J. Spec. Transl."}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1282020\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T04:28:11Z","timestamp":1705033691000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2023.1282020\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,12]]},"references-count":46,"alternative-id":["10.3389\/frai.2023.1282020"],"URL":"https:\/\/doi.org\/10.3389\/frai.2023.1282020","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,12]]},"article-number":"1282020"}}