{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T03:51:09Z","timestamp":1772682669194,"version":"3.50.1"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"3-4","license":[{"start":{"date-parts":[[2014,11,21]],"date-time":"2014-11-21T00:00:00Z","timestamp":1416528000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Machine Translation"],"published-print":{"date-parts":[[2014,12]]},"DOI":"10.1007\/s10590-014-9160-1","type":"journal-article","created":{"date-parts":[[2014,11,21]],"date-time":"2014-11-21T15:05:16Z","timestamp":1416582316000},"page":"237-262","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Quality evaluation in community post-editing"],"prefix":"10.1007","volume":"28","author":[{"given":"Linda","family":"Mitchell","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sharon","family":"O\u2019Brien","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johann","family":"Roturier","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2014,11,21]]},"reference":[{"key":"9160_CR1","unstructured":"Baer N (2010) Trends in crowdsourcing: case studies from not-for-profit and for-profit organisations. ATA 2010, Oct 27\u201330, 2010, Denver, Colorado, USA. http:\/\/www.wiki-translation.com\/tiki-download_wiki_attachment.php?attId=62 . Accessed 6 Jan 2014"},{"key":"9160_CR2","unstructured":"Banerjee P (2013) Domain adaptation for statistical machine translation of corporate and user-generated content. Dissertation, Dublin City University"},{"key":"9160_CR3","unstructured":"Blanchon H, Boitet C, Huynh C (2009) A web service enabling gradable post-edition of pre-translations produced by existing translation tools: practical use to provide high-quality translation of an online encyclopedia. MT Summit XII, Beyond translation memories: new tools for translators workshop. Ottawa, Canada, pp 20\u201327"},{"key":"9160_CR4","unstructured":"de Almeida G (2013) Translating the post-editor: an investigation of post-editing changes and correlations with professional experience across two Romance languages. Dissertation, Dublin City University"},{"key":"9160_CR5","unstructured":"D\u00e9silets A, van der Meer J (2011) Co-creating a repository of best-practices for collaborative translators. In: O\u2019Hagan, M (ed) Linguistica antverpienisia new series: themes in translation studies. Translation as a social activity, 10\/2011, pp 27\u201345"},{"key":"9160_CR6","volume-title":"Quality in professional translation: assessment and improvement","author":"J Drugan","year":"2013","unstructured":"Drugan J (2013) Quality in professional translation: assessment and improvement. Bloomsbury, London"},{"key":"9160_CR7","doi-asserted-by":"crossref","unstructured":"Dugast L, Senellart J, Koehn P (2007) Statistical post-editing on SYSTRAN\u2019s rule-based translation system. In: Proceedings of the second workshop on statistical machine translation. StatMT \u201907. Association for Computational Linguistics. Prague, Czech Republic, pp 220\u2013223","DOI":"10.3115\/1626355.1626387"},{"key":"9160_CR8","unstructured":"Flournoy RS, Callison-Burch C (2000) Reconciling user expectations and translation technology to create a useful real-world application. In: Proceedings of the Twenty-second International Conference on Translating and the Computer, 16\u201317 November 2000, London, United Kingdom"},{"key":"9160_CR9","unstructured":"Federmann C (2010) Appraise: an open-source toolkit for manual phrase-based evaluation of translations. In: Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC \u201910), Valetta, Malta, May 2010"},{"issue":"1","key":"9160_CR10","first-page":"11","volume":"7","author":"A Guerberof","year":"2009","unstructured":"Guerberof A (2009) Productivity and quality in the postediting of outputs from translation memories and machine translation. Localis Focus 7(1):11\u201321","journal-title":"Localis Focus"},{"key":"9160_CR11","doi-asserted-by":"crossref","unstructured":"Hu C, Bederson BB, Resnik P (2010) Translation by iterative collaboration between monolingual users. In: Proceedings of Graphics Interface. GI \u201910. Ottawa, Ontario, Canada, pp 39\u201346","DOI":"10.1145\/1837885.1837902"},{"key":"9160_CR12","doi-asserted-by":"crossref","unstructured":"Hu C, Bederson BB, Resnik P, Kronrod Y (2011) MonoTrans2: a new human computation system to support monolingual translation. In: Proceedings of the SIG-CHI Conference on Human Factors in Computing Systems. CHI \u201811. Vancouver, BC, Canada, pp 1133\u20131136","DOI":"10.1145\/1978942.1979111"},{"key":"9160_CR13","doi-asserted-by":"crossref","unstructured":"Koehn P, Hoang H, Birch A, Callison-Burch C, Federico M, Bertoldi N, Cowan B, Shen W, Moran C, Zens R, Dyer C, Bojar O, Constantin A, Herbst E (2007) Moses: open source toolkit for statistical machine translation. In: ACL 2007 Proceedings of demo and poster sessions. Czech Republic, Prague, pp 177\u2013180","DOI":"10.3115\/1557769.1557821"},{"key":"9160_CR14","unstructured":"Koehn P (2010) Enabling monolingual translators: post-editing vs. options. In: Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. HLT \u201910. Los Angeles, California: Association for Computation Linguistics, pp 537\u2013545"},{"key":"9160_CR15","unstructured":"Koskinen K, Suojanen T, Tuominen T (forthcoming) User-centered translation, Translation Practices Explained series. Routledge, London"},{"key":"9160_CR16","doi-asserted-by":"crossref","unstructured":"Kumaran A, Saravanan K, Maurice S (2008) wikiBABEL: community creation of multilingual data. In: Proceedings of the 4th International Symposium on Wikis. ACM, New York, NY, USA, pp 14:1\u201314:11","DOI":"10.1145\/1822258.1822277"},{"key":"9160_CR17","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159\u2013174","journal-title":"Biometrics"},{"key":"9160_CR18","unstructured":"LDC (2005) Linguistic data annotation specification: assessment of fluency and adequacy in translations. Revision 1:5"},{"key":"9160_CR19","unstructured":"MacQueen, JB (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of the 5 $$^{\\rm th}$$ th Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, pp 281\u2013297"},{"issue":"2","key":"9160_CR20","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1080\/13556509.2012.10799507","volume":"18","author":"J McDonough Dolmaya","year":"2012","unstructured":"McDonough Dolmaya J (2012) Analyzing the crowdsourcing model and its impact on public perceptions of translation. Translator 18(2):167\u2013191","journal-title":"Translator"},{"key":"9160_CR21","first-page":"33","volume-title":"Translation crowdsourcing and user-translator motivation at Facebook and Skype. Translation spaces","author":"M Mesipuu","year":"2012","unstructured":"Mesipuu M (2012) Translation crowdsourcing and user-translator motivation at Facebook and Skype. Translation spaces, vol 1. John Benjamins, Amsterdam, pp 33\u201353"},{"key":"9160_CR22","unstructured":"Mitchell L, Roturier J (2012) Evaluation of Machine-translated user generated content: a pilot study based on user ratings. In: EAMT 2012: Proceedings of the 16 $$^{\\rm th}$$ th Annual Meeting of the European Association for Machine Translation. Trento, Italy, pp 61\u201364"},{"key":"9160_CR23","unstructured":"Mitchell L, Roturier J, O\u2019Brien S (2013) Community-based post-editing of machine-translated content: monolingual vs. bilingual, In: Machine Translation Summit XIV, Workshop on Post-editing Technology and Practice. Nice, France, pp. 35\u201343"},{"issue":"3","key":"9160_CR24","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s10590-011-9096-7","volume":"25","author":"S O\u2019Brien","year":"2011","unstructured":"O\u2019Brien S (2011) Towards predicting post-editing productivity. Mach Transl 25(3):197\u2013215","journal-title":"Mach Transl"},{"key":"9160_CR25","unstructured":"O\u2019Brien S (2012) Towards a dynamic quality evaluation model for translation. J Specialised Transl (17):55\u201377"},{"key":"9160_CR26","unstructured":"O\u2019Hagan M (2011) Community translation: translation as a social activity and its possible consequences in the advent of Web 2.0 and beyond. In: O\u2019Hagan M (ed) Linguistica antverpienisia new series: themes in translation studies. Translation as a social activity, 10\/2011, pp 111\u2013128"},{"key":"9160_CR27","first-page":"55","volume":"12","author":"S Perrino","year":"2009","unstructured":"Perrino S (2009) User-generated translation: the future of translation in a Web 2.0 environment. J Specialised Transl 12:55\u201378","journal-title":"J Specialised Transl"},{"key":"9160_CR28","unstructured":"Pielmeier, H, Kelly, N (2012) Translation production models, common sense advisory report. http:\/\/www.commonsenseadvisory.com\/Portals\/_default\/Knowledgebase\/ArticleImages\/121130_R_Translation_Production_Models_Preview.pdf . Accessed 16 Jan 2014"},{"key":"9160_CR29","unstructured":"Pym, A (2011) Translation research terms: a tentative glossary for moments of perplexity and dispute. In: Pym, A (ed.) From translation research projects 3 (Online). Tarragona: Intercultural Studies Group, pp 75\u2013110. http:\/\/www.isg.urv.es\/publicity\/isg\/publications\/trp_3_2011\/index.htm . Accessed 25 July 2014"},{"key":"9160_CR30","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1075\/ts.2.08ris","volume":"2","author":"H Risku","year":"2013","unstructured":"Risku H, Windhager F, Apfelthaler M (2013) A dynamic network model of translatorial cognition and action. Transl Spaces 2:151\u2013182","journal-title":"Transl Spaces"},{"key":"9160_CR31","unstructured":"Roturier J, Bensadoun A (2011) Evaluation of MT systems to translate user generated content. In: Proceedings of the Thirteenth Machine Translation Summit. Xiamen, China, pp 244\u2013251"},{"key":"9160_CR32","unstructured":"Roturier J, Mitchell L, Grabowski R, Siegel M (2012) Using automatic machine translation metrics to analyze the impact of source reformulations. AMTA-2012: the Tenth Biennial Conference of the Association for Machine Translation in the Americas. San Diego, CA, pp 138\u2013144"},{"key":"9160_CR33","unstructured":"Roturier J, Mitchell L, Silva D (2013) The ACCEPT Post-Editing environment: a flexible and customizable online tool to perform and analyse machine translation post-editing. Machine Translation Summit XIV. Workshop on Post-editing Technology and Practice. Nice, France, pp 119\u2013128"},{"key":"9160_CR34","unstructured":"StataCorp LP (2014) kappa: interrater agreement. http:\/\/www.stata.com\/manuals13\/rkappa.pdf . Accessed 10 Jan 2014"},{"key":"9160_CR35","unstructured":"Stymne S (2011) BLAST: a tool for error analysis of machine translated output. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Student Session. Portland, Oregon, pp 56\u201361"},{"key":"9160_CR36","unstructured":"Symantec (2013) Browser-based client demonstrator and adapted post-editing environment and evaluation portal prototype. Deliverable 5.6, The ACCEPT Project (FP7\/2007-2013 grant agreement $$n^{\\circ }$$ n \u2218 288769). http:\/\/www.accept.unige.ch\/Products\/D_5_6_Browser-based_client_demonstrator_and_adapted_post-editing_environment_and_evaluation_portal_prototypes.pdf . Accessed 15 Jan 2014"},{"key":"9160_CR37","unstructured":"Tatsumi M, Aikawa T, Yamamoto K, Isahara H, (2012) How good is crowd post-editing? Its potential and limitations. In: AMTA 2012 Workshop on Post-Editing Technology and Practice (WPTP, (2012) Association for Machine Translation in the Americas (AMTA). San Diego, California, USA, pp 69\u201377"},{"key":"9160_CR38","unstructured":"TAUS (2011) MT post-editing guidelines. https:\/\/www.taus.net\/post-editing\/machine-translation-post-editing-guidelines . Accessed 20 Apr 2013"},{"key":"9160_CR39","unstructured":"Zaidan OF, Callison-Burch C (2011) Crowdsourcing translation: professional quality from non-professionals. In: Proceedings of the 49 $$^{\\rm th}$$ th Annual Meeting of the Association for Computational Linguistics. Portland, Oregon, pp 1220\u20131229"}],"container-title":["Machine Translation"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10590-014-9160-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10590-014-9160-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10590-014-9160-1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,30]],"date-time":"2019-05-30T18:37:47Z","timestamp":1559241467000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10590-014-9160-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,11,21]]},"references-count":39,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2014,12]]}},"alternative-id":["9160"],"URL":"https:\/\/doi.org\/10.1007\/s10590-014-9160-1","relation":{},"ISSN":["0922-6567","1573-0573"],"issn-type":[{"value":"0922-6567","type":"print"},{"value":"1573-0573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,11,21]]}}}