{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T09:15:59Z","timestamp":1673342159390},"reference-count":2,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["TACL"],"published-print":{"date-parts":[[2013,12]]},"abstract":"<jats:p> Machine translation (MT) draws from several different disciplines, making it a complex subject to teach. There are excellent pedagogical texts, but problems in MT and current algorithms for solving them are best learned by doing. As a centerpiece of our MT course, we devised a series of open-ended challenges for students in which the goal was to improve performance on carefully constrained instances of four key MT tasks: alignment, decoding, evaluation, and reranking. Students brought a diverse set of techniques to the problems, including some novel solutions which performed remarkably well. A surprising and exciting outcome was that student solutions or their combinations fared competitively on some tasks, demonstrating that even newcomers to the field can help improve the state-of-the-art on hard NLP problems while simultaneously learning a great deal. The problems, baseline code, and results are freely available. <\/jats:p>","DOI":"10.1162\/tacl_a_00218","type":"journal-article","created":{"date-parts":[[2018,12,28]],"date-time":"2018-12-28T15:42:12Z","timestamp":1546011732000},"page":"165-178","source":"Crossref","is-referenced-by-count":2,"title":["Learning to translate with products of novices: a suite of open-ended                     challenge problems for teaching MT"],"prefix":"10.1162","volume":"1","author":[{"given":"Adam","family":"Lopez","sequence":"first","affiliation":[{"name":"Human Language Technology Center of Excellence, Johns Hopkins                         University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matt","family":"Post","sequence":"additional","affiliation":[{"name":"Human Language Technology Center of Excellence, Johns Hopkins                         University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chris","family":"Callison-Burch","sequence":"additional","affiliation":[{"name":"Human Language Technology Center of Excellence, Johns Hopkins                         University"},{"name":"Computer and Information Science Department, University of                         Pennsylvania"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Weese","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juri","family":"Ganitkevitch","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Narges","family":"Ahmidi","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olivia","family":"Buzek","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leah","family":"Hanson","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Beenish","family":"Jamil","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ya-Ting","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Henry","family":"Pao","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fatima","family":"Rivera","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leili","family":"Shahriyari","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Debu","family":"Sinha","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Teichert","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Wampler","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Weinberger","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daguang","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lin","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shang","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Johns Hopkins University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"issue":"3","key":"p_17","doi-asserted-by":"crossref","first-page":"297","DOI":"10.2307\/1932409","volume":"26","author":"Dice L. R.","year":"1945","journal-title":"Ecology"},{"key":"p_38","author":"Lawrence R.","year":"2004","journal-title":"IEEE Transactions on Education, 47(4)."}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00218","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:08Z","timestamp":1615585148000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43233"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,12]]},"references-count":2,"alternative-id":["10.1162\/tacl_a_00218"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00218","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,12]]}}}