{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,1]],"date-time":"2025-10-01T15:47:30Z","timestamp":1759333650551,"version":"3.41.2"},"reference-count":60,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2021,12,17]],"date-time":"2021-12-17T00:00:00Z","timestamp":1639699200000},"content-version":"vor","delay-in-days":350,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["2021-1-SK01-KA220-HED-000032095"],"award-info":[{"award-number":["2021-1-SK01-KA220-HED-000032095"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>The paper focuses on investigating the impact of artificial agent (machine translator) on human agent (posteditor) using a proposed methodology, which is based on language complexity measures, POS tags, frequent tagsets, association rules, and their summarization. We examine this impact from the point of view of language complexity in terms of word and sentence structure. By the proposed methodology, we analyzed 24 733 tags of English to Slovak translations of technical texts, corresponding to the output of two MT systems (Google Translate and the European Commission\u2019s MT tool). We used both manual (adequacy and fluency) and semiautomatic (HTER metric) MT evaluation measures as the criteria for validity. We show that the proposed methodology is valid based on the evaluation of frequent tagsets and rules of MT outputs produced by Google Translate or of the European Commission\u2019s MT tool, and both postedited MT (PEMT) outputs using baseline methods. Our results have also shown that PEMT output produced by Google Translate is characterized by more frequent tagsets such as verbs in the infinitive with modal verbs compared to its MT output, which is characterized by masculine, inanimate nouns in locative of singular. In the MT output, produced by the European Commission\u2019s MT tool, the most frequent tagset was verbs in the infinitive compared to its postedited MT output, where verbs in imperative and the second person of plural occurred. These findings are also obtained from the use of the proposed methodology for MT evaluation. The contribution of the proposed methodology is an identification of systematic not random errors. Additionally, the study can also serve as information for optimizing the translation process using postediting.<\/jats:p>","DOI":"10.1155\/2021\/2806108","type":"journal-article","created":{"date-parts":[[2021,12,17]],"date-time":"2021-12-17T21:35:07Z","timestamp":1639776907000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["MT Evaluation in the Context of Language Complexity"],"prefix":"10.1155","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1003-7929","authenticated-orcid":false,"given":"Dasa","family":"Munkova","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9913-3596","authenticated-orcid":false,"given":"Michal","family":"Munk","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1657-395X","authenticated-orcid":false,"family":"\u013dubom\u00edr Benko","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3724-6357","authenticated-orcid":false,"given":"Jiri","family":"Stastny","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2021,12,17]]},"reference":[{"key":"e_1_2_9_1_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2012.09.001"},{"key":"e_1_2_9_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-021-00252-4"},{"key":"e_1_2_9_3_2","doi-asserted-by":"publisher","DOI":"10.5465\/amr.1988.4306775"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.1366\/000370258774615410"},{"key":"e_1_2_9_5_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2015.00348"},{"key":"e_1_2_9_6_2","doi-asserted-by":"publisher","DOI":"10.26478\/ja2019.7.11.1"},{"key":"e_1_2_9_7_2","doi-asserted-by":"publisher","DOI":"10.1075\/slcs.71"},{"key":"e_1_2_9_8_2","doi-asserted-by":"publisher","DOI":"10.11648\/j.ijll.20140202.15"},{"volume-title":"Systems Science","year":"2000","author":"Guo-zhi X.","key":"e_1_2_9_9_2"},{"key":"e_1_2_9_10_2","doi-asserted-by":"publisher","DOI":"10.1017\/s0305000900003688"},{"key":"e_1_2_9_11_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/6687337"},{"key":"e_1_2_9_12_2","first-page":"150","article-title":"No more rage against the machine: how the corpus-based identification of machine-translationese can lead to student empowerment","volume":"34","author":"Loock R.","year":"2020","journal-title":"J. Spec. Transl."},{"key":"e_1_2_9_13_2","doi-asserted-by":"publisher","DOI":"10.1002\/rrq.019"},{"key":"e_1_2_9_14_2","doi-asserted-by":"publisher","DOI":"10.1075\/ts.6.2.06for"},{"key":"e_1_2_9_15_2","first-page":"1","article-title":"Uncovering machine translationese using corpus analysis techniques to distinguish between original and machine-translated French","volume":"101","author":"De Clercq O.","year":"2021","journal-title":"Transl. Q"},{"volume-title":"Achieving Human Parity on Automatic Chinese to English News Translation","year":"2018","author":"Hassan H.","key":"e_1_2_9_16_2"},{"key":"e_1_2_9_17_2","first-page":"67","article-title":"NMT\u2019s wonderland where people turn into rabbits. A study on the comprehensibility of newly invented words in NMT output","volume":"9","author":"Macken L.","year":"2019","journal-title":"Comput. Linguist. Netherlands J."},{"key":"e_1_2_9_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102181"},{"key":"e_1_2_9_19_2","doi-asserted-by":"publisher","DOI":"10.7202\/1060173ar"},{"key":"e_1_2_9_20_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1001"},{"key":"e_1_2_9_21_2","article-title":"The impact of Google neural machine translation on post-editing by student translators","volume":"31","author":"Yamada M.","year":"2019","journal-title":"J. Spec. Transl."},{"key":"e_1_2_9_22_2","doi-asserted-by":"crossref","unstructured":"KumarP. AhmadR. ChaudharyB. D. andSangalR. Machine translation system as virtual appliance: for scalable service deployment on cloud Proceedings of the 2013 IEEE Seventh Int. Symp. Serv. Syst. Eng. Mar 2013 San Francisco CA USA IEEE 304\u2013308 https:\/\/doi.org\/10.1109\/SOSE.2013.69 2-s2.0-84880913942.","DOI":"10.1109\/SOSE.2013.69"},{"key":"e_1_2_9_23_2","doi-asserted-by":"publisher","DOI":"10.7906\/indecs.13.2.6"},{"key":"e_1_2_9_24_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-020-01662-2"},{"key":"e_1_2_9_25_2","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/6105872"},{"key":"e_1_2_9_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-020-01582-8"},{"key":"e_1_2_9_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91241-7"},{"key":"e_1_2_9_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91241-7_7"},{"key":"e_1_2_9_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10590-020-09249-7"},{"key":"e_1_2_9_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91241-7_2"},{"key":"e_1_2_9_31_2","doi-asserted-by":"publisher","DOI":"10.1080\/0907676x.2019.1595069"},{"key":"e_1_2_9_32_2","doi-asserted-by":"publisher","DOI":"10.1515\/9783110459586"},{"key":"e_1_2_9_33_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1263"},{"key":"e_1_2_9_34_2","first-page":"222","volume-title":"Proc. Mach. Transl. Summit XVII","author":"Vanmassenhove E.","year":"2019"},{"volume-title":"Handb. Nat. Lang. Process. Mach. Transl. DARPA Glob. Auton. Lang. Exploit.","year":"2011","author":"Dorr B.","key":"e_1_2_9_35_2"},{"key":"e_1_2_9_36_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2017.01282"},{"key":"e_1_2_9_37_2","first-page":"220","article-title":"MEANT: an inexpensive, high-accuracy, semiautomatic metric for evaluating translation utility via semantic frames","volume":"11","author":"Lo C.","year":"2011","journal-title":"ACLPPinforma"},{"key":"e_1_2_9_38_2","first-page":"273","volume-title":"Proc. Mach. Transl. Summit XVII","author":"Toral A.","year":"2019"},{"key":"e_1_2_9_39_2","doi-asserted-by":"publisher","DOI":"10.3233\/jifs-169505"},{"key":"e_1_2_9_40_2","doi-asserted-by":"publisher","DOI":"10.3390\/app11072948"},{"key":"e_1_2_9_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-91241-7_6"},{"key":"e_1_2_9_42_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-4707"},{"key":"e_1_2_9_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34584-5_17"},{"key":"e_1_2_9_44_2","doi-asserted-by":"publisher","DOI":"10.3115\/1557769.1557830"},{"key":"e_1_2_9_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-45114-0_24"},{"key":"e_1_2_9_46_2","first-page":"39","volume-title":"Proc. 13th Conf. Assoc. Mach. Transl. Am. (Volume 1 Res. Track), Association for Machine Translation in the Americas","author":"Conforti C.","year":"2018"},{"key":"e_1_2_9_47_2","doi-asserted-by":"publisher","DOI":"10.3115\/1626431.1626433"},{"key":"e_1_2_9_48_2","article-title":"Morphemes and POS tags for n-gram based evaluation metrics","author":"Popovi\u0107 M.","year":"2011","journal-title":"Proc. Sixth Work. Stat. Mach. Transl."},{"volume-title":"Machine Translation: Statistical Approach with Additional Linguistic Knowledge","year":"2009","author":"Popovi\u0107 M.","key":"e_1_2_9_49_2"},{"key":"e_1_2_9_50_2","doi-asserted-by":"publisher","DOI":"10.2478\/v10108-012-0012-y"},{"key":"e_1_2_9_51_2","first-page":"44","volume-title":"Proc. Int. Conf. New Methods Lang. Process","author":"Schmid H.","year":"1994"},{"key":"e_1_2_9_52_2","first-page":"13","volume-title":"Text, Speech and Language Technology","author":"Schmid H.","year":"1999"},{"volume-title":"Proc. EVALITA 2007 Work.","year":"2007","author":"Schmid H.","key":"e_1_2_9_53_2"},{"key":"e_1_2_9_54_2","first-page":"21","volume-title":"Proc. Int. Conf. \u00abCorpus Linguist","author":"Benko V.","year":"2013"},{"key":"e_1_2_9_55_2","first-page":"223","volume-title":"Proc. Assoc. Mach. Transl","author":"Snover M.","year":"2006"},{"key":"e_1_2_9_56_2","doi-asserted-by":"publisher","DOI":"10.3115\/1626431.1626480"},{"key":"e_1_2_9_57_2","first-page":"571","volume-title":"DIVAI 2016 11th Int. Sci. Conf. Distance Learn. Appl. Informatics, Sturovo, May 2 \u2013 4, 2016","author":"Munkov\u00e1 D.","year":"2016"},{"key":"e_1_2_9_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2013.05.286"},{"key":"e_1_2_9_59_2","doi-asserted-by":"publisher","DOI":"10.3233\/jifs-169504"},{"key":"e_1_2_9_60_2","first-page":"481","volume-title":"Lecture Notes in Computer Science","author":"Munkov\u00e1 D.","year":"2015"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2021\/2806108.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2021\/2806108.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2021\/2806108","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,9]],"date-time":"2024-08-09T22:43:24Z","timestamp":1723243404000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2021\/2806108"}},"subtitle":[],"editor":[{"given":"Wen-Long","family":"Shang","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":60,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1155\/2021\/2806108"],"URL":"https:\/\/doi.org\/10.1155\/2021\/2806108","archive":["Portico"],"relation":{},"ISSN":["1076-2787","1099-0526"],"issn-type":[{"type":"print","value":"1076-2787"},{"type":"electronic","value":"1099-0526"}],"subject":[],"published":{"date-parts":[[2021,1]]},"assertion":[{"value":"2021-05-18","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2806108"}}