{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T22:31:18Z","timestamp":1648679478833},"reference-count":4,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["TACL"],"published-print":{"date-parts":[[2014,12]]},"abstract":"<jats:p> In this paper, we study the problem of manually correcting automatic annotations of natural language in as efficient a manner as possible. We introduce a method for automatically segmenting a corpus into chunks such that many uncertain labels are grouped into the same chunk, while human supervision can be omitted altogether for other segments. A tradeoff must be found for segment sizes. Choosing short segments allows us to reduce the number of highly confident labels that are supervised by the annotator, which is useful because these labels are often already correct and supervising correct labels is a waste of effort. In contrast, long segments reduce the cognitive effort due to context switches. Our method helps find the segmentation that optimizes supervision efficiency by defining user models to predict the cost and utility of supervising each segment and solving a constrained optimization problem balancing these contradictory objectives. A user study demonstrates noticeable gains over pre-segmented, confidence-ordered baselines on two natural language processing tasks: speech transcription and word segmentation. <\/jats:p>","DOI":"10.1162\/tacl_a_00174","type":"journal-article","created":{"date-parts":[[2018,12,28]],"date-time":"2018-12-28T15:43:26Z","timestamp":1546011806000},"page":"169-180","source":"Crossref","is-referenced-by-count":2,"title":["Segmentation for Efficient Supervised Language Annotation with an                     Explicit Cost-Utility Tradeoff"],"prefix":"10.1162","volume":"2","author":[{"given":"Matthias","family":"Sperber","sequence":"first","affiliation":[{"name":"Karlsruhe Institute of Technology, Institute for Anthropomatics, Germany,"}]},{"given":"Mirjam","family":"Simantzik","sequence":"additional","affiliation":[{"name":"Mobile Technologies GmbH, Germany,"}]},{"given":"Graham","family":"Neubig","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, AHC Laboratory, Japan,"}]},{"given":"Satoshi","family":"Nakamura","sequence":"additional","affiliation":[{"name":"Nara Institute of Science and Technology, AHC Laboratory, Japan,"}]},{"given":"Alex","family":"Waibel","sequence":"additional","affiliation":[{"name":"Karlsruhe Institute of Technology, Institute for Anthropomatics, Germany,"}]}],"member":"281","reference":[{"issue":"6","key":"p_10","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1007\/s00158-003-0368-6","volume":"26","author":"Timothy Marler R.","year":"2004","journal-title":"Structural and Multidisciplinary Optimization"},{"issue":"2","key":"p_15","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1207\/s15327051hci0502&3_4","volume":"5","author":"Olson Judith Reitman","year":"1990","journal-title":"Human-Computer Interaction"},{"issue":"2","key":"p_17","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1016\/0377-2217(95)00015-I","volume":"83","author":"Pisinger David","year":"1994","journal-title":"European Journal of Operational Research"},{"issue":"1","key":"p_27","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1145\/371127.371166","volume":"8","author":"Suhm Bernhard","year":"2001","journal-title":"Transactions on Computer-Human Interaction"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00174","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:38:53Z","timestamp":1615585133000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43315"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,12]]},"references-count":4,"alternative-id":["10.1162\/tacl_a_00174"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00174","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,12]]}}}