{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:31:14Z","timestamp":1750307474244,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":17,"publisher":"ACM","license":[{"start":{"date-parts":[[2009,9,21]],"date-time":"2009-09-21T00:00:00Z","timestamp":1253491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2009,9,21]]},"DOI":"10.1145\/1865909.1865959","type":"proceedings-article","created":{"date-parts":[[2010,10,26]],"date-time":"2010-10-26T12:36:11Z","timestamp":1288096571000},"page":"251-258","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Automated metrics for speech translation"],"prefix":"10.1145","author":[{"given":"Sherri","family":"Condon","sequence":"first","affiliation":[{"name":"The MITRE Corporation, McLean, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Arehart","sequence":"additional","affiliation":[{"name":"The MITRE Corporation, McLean, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christy","family":"Doran","sequence":"additional","affiliation":[{"name":"The MITRE Corporation, McLean, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dan","family":"Parvaz","sequence":"additional","affiliation":[{"name":"The MITRE Corporation, McLean, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Aberdeen","sequence":"additional","affiliation":[{"name":"The MITRE Corporation, McLean, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karine","family":"Megerdoomian","sequence":"additional","affiliation":[{"name":"The MITRE Corporation, McLean, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Beatrice","family":"Oshika","sequence":"additional","affiliation":[{"name":"The MITRE Corporation, McLean, VA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2009,9,21]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"65","volume-title":"Proceedings of the ACL 2005 Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and\/or Summarization","author":"Banerjee S.","year":"2005","unstructured":"Banerjee , S. and A. Lavie . ( 2005 ). METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments . In Proceedings of the ACL 2005 Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and\/or Summarization , pp. 65 -- 73 . Banerjee, S. and A. Lavie. (2005). METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments. In Proceedings of the ACL 2005 Workshop on Intrinsic and Extrinsic Evaluation Measures for MT and\/or Summarization, pp. 65--73."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCTA.2007.120"},{"key":"e_1_3_2_1_3_1","first-page":"73","article-title":"A Comparison of String Distance Metrics for Name-Matching Tasks","volume":"2003","author":"Cohen W.","year":"2003","unstructured":"Cohen , W. , Ravikumar , P , and Fienberg , S. 2003 . A Comparison of String Distance Metrics for Name-Matching Tasks . IIWeb 2003 : 73 -- 78 . Cohen, W., Ravikumar, P, and Fienberg, S. 2003. A Comparison of String Distance Metrics for Name-Matching Tasks. IIWeb 2003: 73--78.","journal-title":"IIWeb"},{"key":"e_1_3_2_1_4_1","volume-title":"Course Wiki. Accessed","author":"Internet Information","year":"2009","unstructured":"Internet Information . Course Wiki. Accessed August , 2009 . http:\/\/ilps.science.uva.nl\/Teaching\/II0607\/twiki\/bin\/view\/Main\/MeetingFeb22#1_1_1_Averaging. Internet Information. Course Wiki. Accessed August, 2009. http:\/\/ilps.science.uva.nl\/Teaching\/II0607\/twiki\/bin\/view\/Main\/MeetingFeb22#1_1_1_Averaging."},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of EMNLP","author":"Koehn P.","year":"2004","unstructured":"Koehn , P. ( 2004 ). Statistical Significance Tests for Machine Translation Evaluation . In Proceedings of EMNLP 2004. Koehn, P. (2004). Statistical Significance Tests for Machine Translation Evaluation. In Proceedings of EMNLP 2004."},{"key":"e_1_3_2_1_6_1","unstructured":"Larkey L. and Connell M. 2007. Light stemming for Arabic information retrieval. In Arabic Computational Morphology: Knowledge-based and empirical method A. Soudi A. van den Bosch and G. Neumann Eds Springer Verlag.  Larkey L. and Connell M. 2007. Light stemming for Arabic information retrieval. In Arabic Computational Morphology: Knowledge-based and empirical method A. Soudi A. van den Bosch and G. Neumann Eds Springer Verlag."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3115\/1220575.1220668"},{"key":"e_1_3_2_1_8_1","unstructured":"Metrics for Machine Translation Evaluation (Metrics MaTr08). Accessed August 2009. http:\/\/www.itl.nist.gov\/iad\/mig\/tests\/metricsmatr\/2008.  Metrics for Machine Translation Evaluation (Metrics MaTr08). Accessed August 2009. http:\/\/www.itl.nist.gov\/iad\/mig\/tests\/metricsmatr\/2008."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/1626281.1626292"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.3115\/1073083.1073135"},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of LREC","author":"Sanders G.","year":"2008","unstructured":"Sanders , G. , Bronsart , S. , Condon , S. , and C. Schlenoff , ( 2008 ). Odds of successful transfer of low-level concepts: A key metric for bidirectional speech-to-speech machine translation in DARPA's TRANSTAC program . In Proceedings of LREC 2008. Sanders, G., Bronsart, S., Condon, S., and C. Schlenoff, (2008). Odds of successful transfer of low-level concepts: A key metric for bidirectional speech-to-speech machine translation in DARPA's TRANSTAC program. In Proceedings of LREC 2008."},{"key":"e_1_3_2_1_12_1","volume-title":"Accessed","author":"Lite","year":"2009","unstructured":"SC Lite . NIST Multi-Modal Information Group . Accessed August , 2009 . http:\/\/www.itl.nist.gov\/iad\/mig\/tools\/ SCLite. NIST Multi-Modal Information Group. Accessed August, 2009. http:\/\/www.itl.nist.gov\/iad\/mig\/tools\/"},{"key":"e_1_3_2_1_13_1","first-page":"223","volume-title":"A Study of Translation Error Rate with Targeted Human Annotation. In Proceedings of AMTA","author":"Snover M.","year":"2006","unstructured":"Snover , M. , Dorr , B. , Schwartz , R. , Makhoul , J. , and L. Micciula . ( 2006 ). A Study of Translation Error Rate with Targeted Human Annotation. In Proceedings of AMTA 2006, pp. 223 -- 231 . Snover, M., Dorr, B., Schwartz, R., Makhoul, J., and L. Micciula. (2006). A Study of Translation Error Rate with Targeted Human Annotation. In Proceedings of AMTA 2006, pp. 223--231."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASRU.2007.4430144"},{"key":"e_1_3_2_1_15_1","first-page":"386","article-title":"Evaluation of Machine Translation and Its Evaluation","volume":"2003","author":"Turian J. P.","year":"2003","unstructured":"Turian , J. P. , Shen , L. and I. D. Melamed . ( 2003 ). Evaluation of Machine Translation and Its Evaluation . In Proceedings of MT Summit 2003 , pp. 386 -- 393 . Turian, J. P., Shen, L. and I. D. Melamed. (2003). Evaluation of Machine Translation and Its Evaluation. In Proceedings of MT Summit 2003, pp. 386--393.","journal-title":"Proceedings of MT Summit"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of LREC","author":"Weiss B.","year":"2008","unstructured":"Weiss , B. , Schlenoff , C. , Sanders , G. , Steves , M. , Condon , S. , Phillips , J. , and Parvaz , D . ( 2008 ). Performance Evaluation of Speech Translation Systems . In Proceedings of LREC 2008. Weiss, B., Schlenoff, C., Sanders, G., Steves, M., Condon, S., Phillips, J., and Parvaz, D. (2008). Performance Evaluation of Speech Translation Systems. In Proceedings of LREC 2008."},{"key":"e_1_3_2_1_17_1","unstructured":"WordNet. Accessed August 2009. http:\/\/wordnet.princeton.edu.  WordNet. Accessed August 2009. http:\/\/wordnet.princeton.edu."}],"event":{"name":"PerMIS '09: Performance Metrics for Intelligent Systems","sponsor":["NIST National Institute of Standards and Technology","SIGAI ACM Special Interest Group on Artificial Intelligence"],"location":"Gaithersburg Maryland","acronym":"PerMIS '09"},"container-title":["Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1865909.1865959","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1865909.1865959","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:08:48Z","timestamp":1750248528000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1865909.1865959"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,9,21]]},"references-count":17,"alternative-id":["10.1145\/1865909.1865959","10.1145\/1865909"],"URL":"https:\/\/doi.org\/10.1145\/1865909.1865959","relation":{},"subject":[],"published":{"date-parts":[[2009,9,21]]},"assertion":[{"value":"2009-09-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}