{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,20]],"date-time":"2025-11-20T06:42:36Z","timestamp":1763620956705,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,14]]},"DOI":"10.1145\/3447548.3467372","type":"proceedings-article","created":{"date-parts":[[2021,8,12]],"date-time":"2021-08-12T06:12:09Z","timestamp":1628748729000},"page":"458-466","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Meaning Error Rate"],"prefix":"10.1145","author":[{"given":"Ludmila","family":"Gordeeva","sequence":"first","affiliation":[{"name":"Yandex, Saint Petersburg, Russian Fed."}]},{"given":"Vasily","family":"Ershov","sequence":"additional","affiliation":[{"name":"Yandex, Saint Petersburg, Russian Fed."}]},{"given":"Oleg","family":"Gulyaev","sequence":"additional","affiliation":[{"name":"Yandex, Moscow, Russian Fed."}]},{"given":"Igor","family":"Kuralenok","sequence":"additional","affiliation":[{"name":"Yandex, Saint Petersburg, Russian Fed."}]}],"member":"320","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2015-322"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"e_1_3_2_1_3_1","first-page":"3","article-title":"RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS","volume":"39","author":"RALPH","year":"1952","unstructured":"RALPH ALLAN BRADLEY and MILTON E. TERRY. 1952 . RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS : THE METHOD OF PAIRED COMPARISONS. Biometrika 39 , 3 - 4 (12 1952), 324--345. https:\/\/doi.org\/10.1093\/biomet\/39.3-4. 324 arXiv:https:\/\/academic.oup.com\/biomet\/article-pdf\/39\/3-4\/324\/930466\/39-3-4-324.pdf 10.1093\/biomet RALPH ALLAN BRADLEY and MILTON E. TERRY. 1952. RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS: THE METHOD OF PAIRED COMPARISONS. Biometrika 39, 3-4 (12 1952), 324--345. https:\/\/doi.org\/10.1093\/biomet\/39.3-4. 324 arXiv:https:\/\/academic.oup.com\/biomet\/article-pdf\/39\/3-4\/324\/930466\/39-3-4-324.pdf","journal-title":"THE METHOD OF PAIRED COMPARISONS. Biometrika"},{"key":"e_1_3_2_1_4_1","volume-title":"DiCiccio and Bradley Efron","author":"Thomas","year":"1996","unstructured":"Thomas J. DiCiccio and Bradley Efron . 1996 . Bootstrap confidence intervals. Statist. Sci . 11, 3 (09 1996), 189--228. https:\/\/doi.org\/10.1214\/ss\/1032280214 10.1214\/ss Thomas J. DiCiccio and Bradley Efron. 1996. Bootstrap confidence intervals. Statist. Sci. 11, 3 (09 1996), 189--228. https:\/\/doi.org\/10.1214\/ss\/1032280214"},{"key":"e_1_3_2_1_5_1","volume-title":"Learning Sound Event Classifiers from Web Audio with Noisy Labels. CoRR abs\/1901.01189","author":"Fonseca Eduardo","year":"2019","unstructured":"Eduardo Fonseca , Manoj Plakal , Daniel P. W. Ellis , Frederic Font , Xavier Favory , and Xavier Serra . 2019. Learning Sound Event Classifiers from Web Audio with Noisy Labels. CoRR abs\/1901.01189 ( 2019 ). arXiv:1901.01189 http:\/\/arxiv.org\/ abs\/1901.01189 Eduardo Fonseca, Manoj Plakal, Daniel P. W. Ellis, Frederic Font, Xavier Favory, and Xavier Serra. 2019. Learning Sound Event Classifiers from Web Audio with Noisy Labels. CoRR abs\/1901.01189 (2019). arXiv:1901.01189 http:\/\/arxiv.org\/ abs\/1901.01189"},{"volume-title":"Proc. 7th Text Retrieval Conference TREC-7.","author":"Garofolo John S.","key":"e_1_3_2_1_6_1","unstructured":"John S. Garofolo , Ellen M. Voorhees , Cedric G. P. Auzanne , Vincent M. Stanford , and Bruce A. Lund . 1998. TREC-7 Spoken Document Retrieval Track Overview and Results . In Proc. 7th Text Retrieval Conference TREC-7. John S. Garofolo, Ellen M. Voorhees, Cedric G. P. Auzanne, Vincent M. Stanford, and Bruce A. Lund. 1998. TREC-7 Spoken Document Retrieval Track Overview and Results. In Proc. 7th Text Retrieval Conference TREC-7."},{"key":"e_1_3_2_1_7_1","volume-title":"li Deng, and Alex Acero","author":"He Xiaodong","year":"2011","unstructured":"Xiaodong He , li Deng, and Alex Acero . 2011 . Why word error rate is not a good metric for speech recognizer training for the speech translation task? 5632--5635. https:\/\/doi.org\/10.1109\/ICASSP.2011.5947637 10.1109\/ICASSP.2011.5947637 Xiaodong He, li Deng, and Alex Acero. 2011. Why word error rate is not a good metric for speech recognizer training for the speech translation task? 5632--5635. https:\/\/doi.org\/10.1109\/ICASSP.2011.5947637"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-6393(90)90008-W"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Samuel Kriman Stanislav Beliaev Boris Ginsburg Jocelyn Huang Oleksii Kuchaiev Vitaly Lavrukhin Ryan Leary Jason Li and Yang Zhang. 2019. QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions. arXiv:1910.10261 [eess.AS]  Samuel Kriman Stanislav Beliaev Boris Ginsburg Jocelyn Huang Oleksii Kuchaiev Vitaly Lavrukhin Ryan Leary Jason Li and Yang Zhang. 2019. QuartzNet: Deep Automatic Speech Recognition with 1D Time-Channel Separable Convolutions. arXiv:1910.10261 [eess.AS]","DOI":"10.1109\/ICASSP40776.2020.9053889"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2012.6289078"},{"key":"e_1_3_2_1_11_1","volume-title":"Jasper: An End-to-End Convolutional Neural Acoustic Model. Interspeech 2019 (Sep","author":"Li Jason","year":"2019","unstructured":"Jason Li , Vitaly Lavrukhin , Boris Ginsburg , Ryan Leary , Oleksii Kuchaiev , Jonathan M. Cohen , Huyen Nguyen , and Ravi Teja Gadde . 2019 . Jasper: An End-to-End Convolutional Neural Acoustic Model. Interspeech 2019 (Sep 2019). https:\/\/doi.org\/10.21437\/interspeech.2019-1819 10.21437\/interspeech.2019-1819 Jason Li, Vitaly Lavrukhin, Boris Ginsburg, Ryan Leary, Oleksii Kuchaiev, Jonathan M. Cohen, Huyen Nguyen, and Ravi Teja Gadde. 2019. Jasper: An End-to-End Convolutional Neural Acoustic Model. Interspeech 2019 (Sep 2019). https:\/\/doi.org\/10.21437\/interspeech.2019-1819"},{"volume-title":"On the Use of Information Retrieval Measures for Speech Recognition Evaluation. Idiap-RR Idiap-RR-73--2004","author":"McCowan Iain A.","key":"e_1_3_2_1_12_1","unstructured":"Iain A. McCowan , Darren Moore , John Dines , Daniel Gatica-Perez , Mike Flynn , Pierre Wellner , and Herv\u00e9 Bourlard . 2004. On the Use of Information Retrieval Measures for Speech Recognition Evaluation. Idiap-RR Idiap-RR-73--2004 . IDIAP , Martigny, Switzerland . Iain A. McCowan, Darren Moore, John Dines, Daniel Gatica-Perez, Mike Flynn, Pierre Wellner, and Herv\u00e9 Bourlard. 2004. On the Use of Information Retrieval Measures for Speech Recognition Evaluation. Idiap-RR Idiap-RR-73--2004. IDIAP, Martigny, Switzerland."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2011-364"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Andrew Morris Viktoria Maier and Phil Green. 2004. From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition.  Andrew Morris Viktoria Maier and Phil Green. 2004. From WER and RIL to MER and WIL: improved evaluation measures for connected speech recognition.","DOI":"10.21437\/Interspeech.2004-668"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124848"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2015.7178964"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1756006.1859894"},{"key":"e_1_3_2_1_19_1","volume-title":"End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures. arXiv preprint arXiv:1911.08460","author":"Synnaeve Gabriel","year":"2019","unstructured":"Gabriel Synnaeve , Qiantong Xu , Jacob Kahn , Edouard Grave , Tatiana Likhomanenko , Vineel Pratap , Anuroop Sriram , Vitaliy Liptchinsky , and Ronan Collobert . 2019. End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures. arXiv preprint arXiv:1911.08460 ( 2019 ). Gabriel Synnaeve, Qiantong Xu, Jacob Kahn, Edouard Grave, Tatiana Likhomanenko, Vineel Pratap, Anuroop Sriram, Vitaliy Liptchinsky, and Ronan Collobert. 2019. End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures. arXiv preprint arXiv:1911.08460 (2019)."},{"key":"e_1_3_2_1_20_1","volume-title":"Evaluating ASR Output for Information Retrieval. Measurement (01","author":"van der Werff Laurens","year":"2007","unstructured":"Laurens van der Werff , Willemijn Heeren , Jong G, D. Oard , Roeland Ordelman , and Stephan Raaijmakers . 2007. Evaluating ASR Output for Information Retrieval. Measurement (01 2007 ). Laurens van der Werff, Willemijn Heeren, Jong G, D. Oard, Roeland Ordelman, and Stephan Raaijmakers. 2007. Evaluating ASR Output for Information Retrieval. Measurement (01 2007)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.2307\/3001968"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASRU.2003.1318504"},{"key":"e_1_3_2_1_23_1","unstructured":"B. Ziolko Jakub Gaka Dawid Skurzok and Tomasz Jadczyk. 2010. Modified Weighted Levenshtein Distance in Automatic Speech Recognition.  B. Ziolko Jakub Gaka Dawid Skurzok and Tomasz Jadczyk. 2010. Modified Weighted Levenshtein Distance in Automatic Speech Recognition."}],"event":{"name":"KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"],"location":"Virtual Event Singapore","acronym":"KDD '21"},"container-title":["Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467372","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3467372","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:23Z","timestamp":1750191503000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467372"}},"subtitle":["ASR domain-specific metric framework"],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":23,"alternative-id":["10.1145\/3447548.3467372","10.1145\/3447548"],"URL":"https:\/\/doi.org\/10.1145\/3447548.3467372","relation":{},"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"2021-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}