{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T11:11:47Z","timestamp":1767870707258,"version":"3.49.0"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,11,26]],"date-time":"2021-11-26T00:00:00Z","timestamp":1637884800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,26]],"date-time":"2021-11-26T00:00:00Z","timestamp":1637884800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006109","name":"vedeck\u00e1 grantov\u00e1 agent\u00fara m\u0161vva\u0161 sr a sav","doi-asserted-by":"publisher","award":["VEGA-1\/0792\/21"],"award-info":[{"award-number":["VEGA-1\/0792\/21"]}],"id":[{"id":"10.13039\/501100006109","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005357","name":"agent\u00fara na podporu v\u00fdskumu a v\u00fdvoja","doi-asserted-by":"publisher","award":["APVV-18-0473"],"award-info":[{"award-number":["APVV-18-0473"]}],"id":[{"id":"10.13039\/501100005357","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001824","name":"grantov\u00e1 agentura \u010desk\u00e9 republiky","doi-asserted-by":"publisher","award":["19-15498S"],"award-info":[{"award-number":["19-15498S"]}],"id":[{"id":"10.13039\/501100001824","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Post-editing has become an important part not only of translation research but also in the global translation industry. While computer-aided translation tools, such as translation memories, are considered to be part of a translator's work, lately, machine translation (MT) systems have also been accepted by human translators. However, many human translators are still adopting the changes brought by translation technologies to the translation industry. This paper introduces a novel approach for seeking suitable pairs of <jats:italic>n<\/jats:italic>-grams when recommending <jats:italic>n<\/jats:italic>-grams (corresponding <jats:italic>n<\/jats:italic>-grams between MT and post-edited MT) based on the type of text (manual or administrative) and MT system used for machine translation. A tool that recommends and speeds up the correction of MT was developed to help the post-editors with their work. It is based on the analysis of words with the same lemmas and analysis of <jats:italic>n<\/jats:italic>-gram recommendations. These recommendations are extracted from sequence patterns of the mismatched words (MisMatch) between MT output and post-edited MT output. The paper aims to show the usage of morphological analysis for recommending the post-edit operations. It describes the usage of mismatched words in the <jats:italic>n<\/jats:italic>-gram recommendations for the post-edited MT output. The contribution consists of the methodology for seeking suitable pairs of words, <jats:italic>n<\/jats:italic>-grams and additionally the importance of taking into account metadata (the type of the text and\/or style and MT system) when recommending post-edited operations.<\/jats:p>","DOI":"10.1007\/s44196-021-00048-3","type":"journal-article","created":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T13:03:36Z","timestamp":1639400616000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Analysis of Edit Operations for Post-editing Systems"],"prefix":"10.1007","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8285-2404","authenticated-orcid":false,"given":"Jozef","family":"Kapusta","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"\u013dubom\u00edr","family":"Benko","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dasa","family":"Munkova","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9913-3596","authenticated-orcid":false,"given":"Michal","family":"Munk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,11,26]]},"reference":[{"key":"48_CR1","unstructured":"De Palma, D., Pielmeier, H., Stewart, R. G., Henderson, S.: Common Sense Advisory\u2019s Annual Report, 2016. [Online]. Available: http:\/\/www.commonsenseadvisory.com\/AbstractView\/tabid\/74\/ArticleID\/36540\/Title\/TheLanguageServicesMarket2016\/Default.aspx"},{"key":"48_CR2","unstructured":"Ch\u00e9ragui, M.A.: Theoretical overview of machine translation. In: Proceedings of ICWIT 2012, pp. 160\u2013169 (2012) [Online]. Available http:\/\/ceur-ws.org\/Vol-867\/Paper17.pdf"},{"key":"48_CR3","volume-title":"Interactive Translation vs. Pre-translation in the Context of Translation Memory Systems: Investigating the Effects of Translation Method on Productivity, Quality and Translator Satisfaction","author":"J Wallis","year":"2006","unstructured":"Wallis, J.: Interactive Translation vs. Pre-translation in the Context of Translation Memory Systems: Investigating the Effects of Translation Method on Productivity, Quality and Translator Satisfaction. University of Ottawa, Ottawa (2006)"},{"key":"48_CR4","volume-title":"Advantages and Disadvantages of Translation Memory: A Cost\/Benefit Analysis","author":"LE Webb","year":"1998","unstructured":"Webb, L.E.: Advantages and Disadvantages of Translation Memory: A Cost\/Benefit Analysis. Monterey Institute of International Studies, Monterey, CA (1998)"},{"key":"48_CR5","unstructured":"Benis, M.: Translation Memory from O to R. ITI Bull. (1999) [Online]. Available http:\/\/utkl.ff.cuni.cz\/~rosen\/VYUKA\/MT\/tm-review01.htm"},{"key":"48_CR6","doi-asserted-by":"publisher","unstructured":"Simard, M.: Translation spotting for translation memories. In: Proceedings of the HLT-NAACL 2003 Workshop on Building and Using Parallel Texts Data Driven Machine Translation and Beyond, vol. 3, pp. 65\u201372, May 2003. https:\/\/doi.org\/10.3115\/1118905.1118918","DOI":"10.3115\/1118905.1118918"},{"issue":"5","key":"48_CR7","doi-asserted-by":"publisher","first-page":"3211","DOI":"10.3233\/JIFS-169504","volume":"34","author":"M Munk","year":"2018","unstructured":"Munk, M., Munkova, D.: Detecting errors in machine translation using residuals and metrics of automatic evaluation. J. Intell. Fuzzy Syst. 34(5), 3211\u20133223 (2018). https:\/\/doi.org\/10.3233\/JIFS-169504","journal-title":"J. Intell. Fuzzy Syst."},{"key":"48_CR8","first-page":"141","volume-title":"Identification of relevant and redundant automatic metrics for mt evaluation. In: Multi-disciplinary Trends in Artificial Intelligence (MIWAI 2016) Book Series: Lecture Notes in Computer Science","author":"M Munk","year":"2016","unstructured":"Munk, M., Munkov\u00e1, D., Benko, \u013d: Identification of relevant and redundant automatic metrics for mt evaluation. In: Multi-disciplinary Trends in Artificial Intelligence (MIWAI 2016) Book Series: Lecture Notes in Computer Science, vol. 10053, pp. 141\u2013152. Springer International Publishing, Cham (2016)"},{"key":"48_CR9","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1007\/978-3-030-11932-4_35","volume":"916","author":"D Munkov\u00e1","year":"2020","unstructured":"Munkov\u00e1, D., Munk, M., Benko, \u013d, Absolon, J.: From old fashioned \u2018one size fits all\u2019 to tailor made online training. Adv. Intell. Syst. Comput. 916, 365\u2013376 (2020). https:\/\/doi.org\/10.1007\/978-3-030-11932-4_35","journal-title":"Adv. Intell. Syst. Comput."},{"key":"48_CR10","unstructured":"Benko, \u013d., Munkov\u00e1, D.: Application of POS tagging in machine translation evaluation. In: DIVAI 2016\u202f: 11th International Scientific Conference on Distance Learning in Applied Informatics, Sturovo, May 2\u20134, pp. 471\u2013489 (2016)"},{"key":"48_CR11","unstructured":"Snover, M.G., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proceedings of the 7th Conference of the Association for Machine Translation in the Americas: Technical Papers, August 8\u201312, pp. 223\u2013231 (2006)."},{"key":"48_CR12","volume-title":"Wie irrt die Maschine? Probleme der maschinellen \u00dcbersetzung","author":"T B\u00e1nik","year":"2019","unstructured":"B\u00e1nik, T., Benko, \u013d, M\u00e1chov\u00e1, R., Munk, M., Munkov\u00e1, D.: Wie irrt die Maschine? Probleme der maschinellen \u00dcbersetzung. Verlag Dr. Kovac, Hamburg (2019)"},{"issue":"5","key":"48_CR13","doi-asserted-by":"publisher","first-page":"3225","DOI":"10.3233\/JIFS-169505","volume":"34","author":"M Munk","year":"2018","unstructured":"Munk, M., Munkova, D., Benko, L.: Towards the use of entropy as a measure for the reliability of automatic MT evaluation metrics. J. Intell. Fuzzy Syst. 34(5), 3225\u20133233 (2018). https:\/\/doi.org\/10.3233\/JIFS-169505","journal-title":"J. Intell. Fuzzy Syst."},{"key":"48_CR14","unstructured":"Munkov\u00e1, D. et al.: M\u00fdli\u0165 sa je \u013eudsk\u00e9 (ale aj strojov\u00e9): anal\u00fdza ch\u00fdb strojov\u00e9ho prekladu do sloven\u010diny. UKF, Nitra (2017)"},{"key":"48_CR15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-29659-3","volume-title":"Recommender Systems: The Textbook","author":"CC Aggarwal","year":"2016","unstructured":"Aggarwal, C.C.: Recommender Systems: The Textbook. Springer International Publishing, Cham (2016)"},{"key":"48_CR16","doi-asserted-by":"publisher","first-page":"1282","DOI":"10.3389\/fpsyg.2017.01282","volume":"8","author":"J Daems","year":"2017","unstructured":"Daems, J., Vandepitte, S., Hartsuiker, T.J., Macken, L.: Identifying the machine translation error types with the greatest impact on post-editing effort. Front. Psychol. 8, 1282 (2017). https:\/\/doi.org\/10.3389\/fpsyg.2017.01282","journal-title":"Front. Psychol."},{"key":"48_CR17","unstructured":"Krings, H.P.: Repairing Texts: Empirical Investigations of Machine Translation Post-Editing Process. Kent State Univ Pr (2001)"},{"key":"48_CR18","unstructured":"Mariniello, E., Steiert, A.: The Human Role in a Machine-Translated World. TCworld (2016)"},{"key":"48_CR19","doi-asserted-by":"publisher","first-page":"7","DOI":"10.2478\/v10108-010-0010-x","volume":"93","author":"M Plitt","year":"2010","unstructured":"Plitt, M., Masselot, F.: A productivity test of statistical machine translation post-editing in a typical localisation context. Prague Bull. Math. Linguist. 93, 7\u201316 (2010)","journal-title":"Prague Bull. Math. Linguist."},{"key":"48_CR20","doi-asserted-by":"crossref","unstructured":"Green, S., Heer, J., Manning, C.D.: The efficacy of human post-editing for language translation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 439\u2013448 (2013)","DOI":"10.1145\/2470654.2470718"},{"key":"48_CR21","doi-asserted-by":"publisher","first-page":"38918","DOI":"10.1109\/ACCESS.2019.2897327","volume":"7","author":"W Khan","year":"2019","unstructured":"Khan, W., et al.: Part of speech tagging in Urdu: comparison of machine and deep learning approaches. IEEE Access 7, 38918\u201338936 (2019). https:\/\/doi.org\/10.1109\/ACCESS.2019.2897327","journal-title":"IEEE Access"},{"key":"48_CR22","unstructured":"Espla-Gomis, M., S\u00e1nchez-Mart\u00ednez, F., Forcada, M.L.: Using machine translation in computer-aided translation to suggest the target-side words to change. In: Machine Translation Summit, pp. 172\u2013179 (2011) [Online]. Available https:\/\/rua.ua.es\/dspace\/bitstream\/10045\/27578\/1\/espla-gomis11b.pdf"},{"key":"48_CR23","unstructured":"Dara, A., Dandapat, S., Groves, D., van Genabith, J.: TMTprime: a recommender system for MT and TM integration. In: Proceedings of the NAACL HLT 2013 Demonstration Session, pp. 10\u201313 (2013) [Online]. Available http:\/\/www.aclweb.org\/anthology\/N13-3003"},{"key":"48_CR24","unstructured":"He, Y., Ma, Y., van Genabith, J., Way, A.: Bridging SMT and TM with translation recommendation. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 622\u2013630 (2010) [Online]. Available http:\/\/www.mt-archive.info\/ACL-2010-He.pdf"},{"key":"48_CR25","unstructured":"He, Y., Ma, Y., Roturier, J., Way, A., van Genabith, J.: Improving the post-editing experience using translation recommendation: a user study. In: Proceedings of the 9th Conference of the Association for Machine Translation in the Americas: Research Papers, October 31\u2013November 4, 10 p (2010)"},{"key":"48_CR26","unstructured":"Bonet, O. G.: To post-edit or to translate\u2026 That is the question: A case study of a recommender system for Quality Estimation of Machine Translation based on linguistic features. Euskal Herriko Unibertsitatea (2018)"},{"issue":"4","key":"48_CR27","doi-asserted-by":"publisher","first-page":"97","DOI":"10.9781\/ijimai.2020.11.010","volume":"6","author":"M Magdin","year":"2020","unstructured":"Magdin, M., Dr\u017e\u00edk, D., Reichel, J., Koprda, S.: The possibilities of classification of emotional states based on user behavioral characteristics. Int. J. Interact. Multimed. Artif. Intell. 6(4), 97\u2013104 (2020). https:\/\/doi.org\/10.9781\/ijimai.2020.11.010","journal-title":"Int. J. Interact. Multimed. Artif. Intell."},{"key":"48_CR28","unstructured":"Aranberri, N., Pascual Saiz, J.A.: Towards a post-editing recommendation system for Spanish\u2013Basque machine translation. In: Proceedings of the 21st Annual Conference of the European Association for Machine Translation, pp. 21\u201330 (2018)"},{"key":"48_CR29","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.ins.2017.04.005","volume":"405","author":"VR Kagita","year":"2017","unstructured":"Kagita, V.R., Pujari, A.K., Padmanabhan, V., Sahu, S.K., Kumar, V.: Conformal recommender system. Inf. Sci. (NY) 405, 157\u2013174 (2017). https:\/\/doi.org\/10.1016\/j.ins.2017.04.005","journal-title":"Inf. Sci. (NY)"},{"key":"48_CR30","doi-asserted-by":"publisher","unstructured":"Parra Escart\u00edn, C., Arcedillo, M.: A fuzzier approach to machine translation evaluation: a pilot study on post-editing productivity and automated metrics in commercial settings. In: Proceedings of the ACL 2015 Fourth Workshop on Hybrid Approaches to Translation (HyTra), Dec. 2015, pp. 40\u201345. https:\/\/doi.org\/10.18653\/v1\/w15-4107.","DOI":"10.18653\/v1\/w15-4107"},{"key":"48_CR31","unstructured":"Ortega, J.E., S\u00e1nchez-Mart\u00ednez, F., Forcada, M.L.: Fuzzy-match repair using black-box machine translation systems: what can be expected? (2016). Accessed: Feb. 09, 2020. [Online]. Available http:\/\/www.atril.com\/software\/dj-vu-x3-professional"},{"key":"48_CR32","doi-asserted-by":"publisher","unstructured":"Ortega, J., S\u00e1nchez-Mart\u00ednez, F., Forcada, M.: Using any machine translation source for fuzzy-match repair in a computer-aided translation setting (2014). https:\/\/doi.org\/10.13140\/2.1.3306.1121","DOI":"10.13140\/2.1.3306.1121"},{"issue":"4","key":"48_CR33","doi-asserted-by":"publisher","first-page":"21","DOI":"10.9781\/ijimai.2018.03.003","volume":"5","author":"RA Carrasco","year":"2019","unstructured":"Carrasco, R.A., Blasco, M.F., Garc\u00eda-Madariaga, J., Herrera-Viedma, E.: A fuzzy linguistic RFM model applied to campaign management. Int. J. Interact. Multimed. Artif. Intell. 5(4), 21\u201327 (2019). https:\/\/doi.org\/10.9781\/ijimai.2018.03.003","journal-title":"Int. J. Interact. Multimed. Artif. Intell."},{"key":"48_CR34","unstructured":"Knowles, R., Ortega, J.E., Koehn, P.: A comparison of machine translation paradigms for use in black-box fuzzy-Match Repair (2018). Accessed: Feb. 09, 2020. [Online]. Available http:\/\/www.casmacat.eu\/corpus\/"},{"key":"48_CR35","first-page":"590","volume":"2005","author":"D Varga","year":"2005","unstructured":"Varga, D., N\u00e9meth, L., Hal\u00e1csy, P., Kornai, A., Tr\u00f3n, V., Nagy, V.: Parallel corpora for medium density languages. Proc. RANLP 2005, 590\u2013596 (2005)","journal-title":"Proc. RANLP"},{"key":"48_CR36","doi-asserted-by":"publisher","DOI":"10.4324\/9781315841366","volume-title":"Corpus Annotation: Linguistic Information from Computer Text Corpora","author":"R Garside","year":"1997","unstructured":"Garside, R., Leech, G., Mcenery, A.M.: Corpus Annotation: Linguistic Information from Computer Text Corpora. Routledge, London (1997)"},{"key":"48_CR37","unstructured":"Forr\u00f3ov\u00e1, M., Hor\u00e1k, A.: Morfologick\u00e1 anot\u00e1cia textov. In: Sloven\u010dina na za\u010diatku 21. Storo\u010dia v Pre\u0161ove, pp. 1\u201312 (2003)"},{"key":"48_CR38","unstructured":"Schmid, H.: Probabilistic part-of-speech tagging using decision trees. In: Proceedings of the International Conference on New Methods in Language Processing, pp. 44\u201349 (1994)"},{"key":"48_CR39","unstructured":"Schmid, H., Baroni, M., Zanchetta, E., Stein, A.: The Enriched TreeTagger System (2007)"},{"key":"48_CR40","unstructured":"\u201cTreeTagger\u2014A Language Independent Part-of-Speech Tagger.\u201d http:\/\/www.cis.uni-muenchen.de\/~schmid\/tools\/TreeTagger\/. Accessed Oct. 10 (2019)"},{"key":"48_CR41","doi-asserted-by":"publisher","unstructured":"Agrawal, R., Imielinski, T., Swami, A.: Mining association rules between sets of items in large databases. In: Proceedings of the 1993 ACM SIGMOD International Conference on Management of Data, pp. 207\u2013216 (1993). https:\/\/doi.org\/10.1145\/170035.170072.","DOI":"10.1145\/170035.170072"},{"issue":"3\u20134","key":"48_CR42","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/s10590-014-9156-x","volume":"28","author":"LN Vieira","year":"2014","unstructured":"Vieira, L.N.: Indices of cognitive effort in machine translation post-editing. Mach. Transl. 28(3\u20134), 187\u2013216 (2014). https:\/\/doi.org\/10.1007\/s10590-014-9156-x","journal-title":"Mach. Transl."}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-021-00048-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-021-00048-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-021-00048-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T13:29:24Z","timestamp":1639402164000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-021-00048-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,26]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["48"],"URL":"https:\/\/doi.org\/10.1007\/s44196-021-00048-3","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,26]]},"assertion":[{"value":"21 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 November 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 November 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interset"}}],"article-number":"197"}}