{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T21:05:59Z","timestamp":1694639159156},"reference-count":84,"publisher":"Cambridge University Press (CUP)","issue":"3","license":[{"start":{"date-parts":[[2010,6,15]],"date-time":"2010-06-15T00:00:00Z","timestamp":1276560000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2010,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper focuses on an important step in the creation of a system of meaning representation and the development of semantically annotated parallel corpora, for use in applications such as machine translation, question answering, text summarization, and information retrieval. The work described below constitutes the first effort of any kind to annotate multiple translations of foreign-language texts with interlingual content. Three levels of representation are introduced: deep syntactic dependencies (IL0), intermediate semantic representations (IL1), and a normalized representation that unifies conversives, nonliteral language, and paraphrase (IL2). The resulting annotated, multilingually induced, parallel corpora will be useful as an empirical basis for a wide range of research, including the development and evaluation of interlingual NLP systems and paraphrase-extraction systems as well as a host of other research and development efforts in theoretical and applied linguistics, foreign language pedagogy, translation studies, and other related disciplines.<\/jats:p>","DOI":"10.1017\/s1351324910000070","type":"journal-article","created":{"date-parts":[[2010,6,15]],"date-time":"2010-06-15T13:17:38Z","timestamp":1276607858000},"page":"197-243","source":"Crossref","is-referenced-by-count":2,"title":["Interlingual annotation of parallel text corpora: a new framework for annotation and evaluation"],"prefix":"10.1017","volume":"16","author":[{"given":"BONNIE J.","family":"DORR","sequence":"first","affiliation":[]},{"given":"REBECCA J.","family":"PASSONNEAU","sequence":"additional","affiliation":[]},{"given":"DAVID","family":"FARWELL","sequence":"additional","affiliation":[]},{"given":"REBECCA","family":"GREEN","sequence":"additional","affiliation":[]},{"given":"NIZAR","family":"HABASH","sequence":"additional","affiliation":[]},{"given":"STEPHEN","family":"HELMREICH","sequence":"additional","affiliation":[]},{"given":"EDUARD","family":"HOVY","sequence":"additional","affiliation":[]},{"given":"LORI","family":"LEVIN","sequence":"additional","affiliation":[]},{"given":"KEITH J.","family":"MILLER","sequence":"additional","affiliation":[]},{"given":"TERUKO","family":"MITAMURA","sequence":"additional","affiliation":[]},{"given":"OWEN","family":"RAMBOW","sequence":"additional","affiliation":[]},{"given":"ADVAITH","family":"SIDDHARTHAN","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2010,6,15]]},"reference":[{"key":"S1351324910000070_ref84","volume-title":"Proceedings of the Conference of the Association for Machine Translation in the Americas","author":"White","year":"1994"},{"key":"S1351324910000070_ref77","doi-asserted-by":"publisher","DOI":"10.3115\/1118984.1118988"},{"key":"S1351324910000070_ref76","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2008.34.3.319"},{"key":"S1351324910000070_ref71","volume-title":"Proceedings of the International Lisp Conference","author":"Philpot","year":"2003"},{"key":"S1351324910000070_ref68","volume-title":"Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC)","author":"Passonneau","year":"2006"},{"key":"S1351324910000070_ref67","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324909005051"},{"key":"S1351324910000070_ref66","volume-title":"Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC)","author":"Passonneau","year":"2006"},{"key":"S1351324910000070_ref64","volume-title":"Proceedings of HLT-NAACL","author":"Pang","year":"2003"},{"key":"S1351324910000070_ref63","doi-asserted-by":"publisher","DOI":"10.1162\/0891201053630264"},{"key":"S1351324910000070_ref62","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1017\/S135132490500402X","article-title":"Making fine-grained and coarse-grained sense distinctions","volume":"13","author":"Palmer","year":"2005","journal-title":"Journal of Natural Language Engineering"},{"key":"S1351324910000070_ref60","doi-asserted-by":"publisher","DOI":"10.3115\/993268.993373"},{"key":"S1351324910000070_ref59","volume-title":"Semantic Annotation of Multilingual Text Corpora","author":"Mitamura","year":"2004"},{"key":"S1351324910000070_ref56","first-page":"313","article-title":"Building a large annotated corpus of english: the Penn treebank","volume":"19","author":"Marcus","year":"1994","journal-title":"Computational Linguistics"},{"key":"S1351324910000070_ref55","volume-title":"Proceedings of the Workshop on Basic Ontological Issues in Knowledge Sharing, International Joint Conference on Artificial Intelligence (IJCAI-95)","author":"Mahesh","year":"1995"},{"key":"S1351324910000070_ref54","volume-title":"Proceedings of the ACL Workshop on Statistical Machine Translation","author":"Madnani","year":"2007"},{"key":"S1351324910000070_ref45","volume-title":"Semantic Interpretation in Generative Grammar","author":"Jackendoff","year":"1972"},{"key":"S1351324910000070_ref44","first-page":"223","article-title":"Nouvelles recherches sur la distribution florale","volume":"44","author":"Jaccard","year":"1908","journal-title":"Bulletin de la Societe Vaudoise des Sciences Naturelles"},{"key":"S1351324910000070_ref43","volume-title":"Proceedings of the National Conference on Digital Government Research","author":"Hovy","year":"2003"},{"key":"S1351324910000070_ref42","volume-title":"Proceedings of the NSF's dg.o 2001 Conference","author":"Hovy","year":"2003"},{"key":"S1351324910000070_ref40","volume-title":"Proceedings of the Human Language Technology\/North American Association of Computational Linguistics conference (HLT-NAACL 2006)","author":"Hovy","year":"2006"},{"key":"S1351324910000070_ref39","volume-title":"Keynote address for The Second International Workshop on Paraphrasing: Paraphrase Acquisition and Applications","author":"Hirst","year":"2003"},{"key":"S1351324910000070_ref38","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008062303478"},{"key":"S1351324910000070_ref69","volume-title":"Proceedings of the Document Understanding Conference (DUC) Workshop","author":"Passonneau","year":"2005"},{"key":"S1351324910000070_ref37","first-page":"105","volume-title":"Proceedings of the IRCS Workshop on Linguistic Databases","author":"Haji\u010d","year":"2001"},{"key":"S1351324910000070_ref36","doi-asserted-by":"publisher","DOI":"10.1023\/B:COAT.0000020960.27186.18"},{"key":"S1351324910000070_ref35","doi-asserted-by":"publisher","DOI":"10.1007\/s10590-009-9056-7"},{"key":"S1351324910000070_ref33","first-page":"565","volume-title":"Proceedings of Speech Prosody","author":"Gut","year":"2004"},{"key":"S1351324910000070_ref28","doi-asserted-by":"publisher","DOI":"10.1093\/ijl\/16.3.235"},{"key":"S1351324910000070_ref25","volume-title":"Proceedings of the Workshop on WordNet and Other Lexical Resources","author":"Fellbaum","year":"2001"},{"key":"S1351324910000070_ref24","doi-asserted-by":"crossref","first-page":"217","DOI":"10.7551\/mitpress\/7287.001.0001","volume-title":"WordNet: An Electronic Lexical Database","author":"Fellbaum","year":"1998"},{"key":"S1351324910000070_ref23","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7287.001.0001","volume-title":"WordNet: An Electronic Lexical Database","author":"Fellbaum","year":"1998"},{"key":"S1351324910000070_ref22","first-page":"55","volume-title":"Proceedings of the Workshop on Frontiers in Corpus Annotation. Workshop at the North American Chapter of the Association for Computational Linguistics (HLT-NAACL)","author":"Farwell","year":"2004"},{"key":"S1351324910000070_ref21","first-page":"19","article-title":"Pragmatics and translation","volume":"24","author":"Farwell","year":"1999","journal-title":"Procesamiento de Lenguaje Natural"},{"key":"S1351324910000070_ref20","unstructured":"Dorr B. J. , Olsen M. , Habash N. , and Thomas S. 2001. LCS verb database. Technical Report Online software database, University of Maryland, College Park, MD. http:\/\/www.umiacs.umd.edu\/~bonnie\/LCS_Database_Documentation.html [2010, March 29]."},{"key":"S1351324910000070_ref19","volume-title":"Proceedings of the Workshop on Building Lexical Resources from Semantically Annotated Corpora (LREC-2004)","author":"Dorr","year":"2004"},{"key":"S1351324910000070_ref53","volume-title":"Handbook of Morphosyntax and Argument Structure","author":"Levin","year":"1998"},{"key":"S1351324910000070_ref18","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/4362.001.0001","volume-title":"Machine Translation: A View from the Lexicon","author":"Dorr","year":"1993"},{"key":"S1351324910000070_ref17","volume-title":"Proceedings of COLING 2004","author":"Dolan","year":"2004"},{"key":"S1351324910000070_ref15","doi-asserted-by":"publisher","DOI":"10.1162\/089120104773633402"},{"key":"S1351324910000070_ref13","doi-asserted-by":"publisher","DOI":"10.1177\/001316446002000104"},{"key":"S1351324910000070_ref12","first-page":"25","volume-title":"Proceedings of the LREC Workshop on Models of Human Behaviour for the Specification and Evaluation of Multimodal Input and Output Interfaces","author":"Cerrato","year":"2004"},{"key":"S1351324910000070_ref11","first-page":"17","volume-title":"Proceedings of HLT-NAACL","author":"Callison-Burch","year":"2006"},{"key":"S1351324910000070_ref83","unstructured":"Walker K. , Bamba M. , Miller D. , Ma X. , Cieri C. , and Doddington G. 2003. Multiple-translation arabic corpus, Part 1. Technical Report catalog number LDC2003T18 and ISBN 1-58563-276-7, Linguistic Data Consortium (LDC)."},{"key":"S1351324910000070_ref10","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-010-0201-1_7"},{"key":"S1351324910000070_ref9","unstructured":"Bateman J. A. , Kasper R. T , Moore J. D. , and Whitney R. A. 1989. A general organization of knowledge for natural language processing: The Penman upper model. Technical Report Unpublished research report, USC\/Information Sciences Institute, Marina del Rey. ISI-TR-85-029."},{"key":"S1351324910000070_ref6","unstructured":"Baker K. , Bethard S. , Bloodgood M. , Brown R. , Callison-Burch C. , Coppersmith G. , Dorr B. , Filardo W. , Giles K. , Irvine , Ann K. , Mike L. , Lori M. , Justin M. , Jim M. , Scott P. , Aaron P. A. , Piatko C. , Schwartz L. , and Zajic D 2009. Semantically informed machine translation. Technical Report 002, Human Language Technology Center of Excellence, Summer Camp for Applied Language Exploration, Johns Hopkins University, Baltimore, MD."},{"key":"S1351324910000070_ref16","doi-asserted-by":"publisher","DOI":"10.2307\/1932409"},{"key":"S1351324910000070_ref5","unstructured":"Baker Kathryn , Bloodgood Michael , Dorr Bonnie J. , Filardo Nathaniel W. , Levin L. , and Piatko C. 2010. A modality lexicon and its use in automatic tagging. In Seventh Language Resources and Evaluation Conference (LREC-2010). University of Malta, Malta."},{"key":"S1351324910000070_ref4","first-page":"86","volume-title":"Proceedings of the Thirty-Sixth Annual Meeting of the Association for Computational Linguistics and Seventeenth International Conference on Computational Linguistics","author":"Baker","year":"1998"},{"key":"S1351324910000070_ref50","first-page":"1","volume-title":"Proceedings of the Second International Workshop on Paraphrasing: Paraphrase Acquisition and Applications (IWP2003)","author":"Kozlowski","year":"2003"},{"key":"S1351324910000070_ref46","volume-title":"Proceedings of the 3rd International Conference on Language Resources and Evaluation (LREC-2002)","author":"Kingsbury","year":"2002"},{"key":"S1351324910000070_ref72","volume-title":"Proceedings of IJCAI","author":"Philpot","year":"2005"},{"key":"S1351324910000070_ref58","volume-title":"Dependency Syntax: Theory and Practice","author":"Mel'\u010duk","year":"1988"},{"key":"S1351324910000070_ref70","first-page":"2","volume-title":"Proceedings of the NAACL-HLT 2009 Workshop on Semantic Evalutions: Recent Achievements and Future Directions (SEW-2009)","author":"Passonneau","year":"2009"},{"key":"S1351324910000070_ref78","doi-asserted-by":"publisher","DOI":"10.1086\/266577"},{"key":"S1351324910000070_ref51","volume-title":"Content Analysis: An Introduction to Its Methodology","author":"Krippendorff","year":"1980"},{"key":"S1351324910000070_ref1","first-page":"141","volume-title":"Proceedings of FG-MoL 2005","author":"Artstein","year":"2005"},{"key":"S1351324910000070_ref81","volume-title":"Proceedings of the Fifth Conference on Applied Natural Language Processing and Association for Computational Linguistics","author":"Tapanainen","year":"1997"},{"key":"S1351324910000070_ref52","doi-asserted-by":"crossref","unstructured":"Krippendorff K. 2007. Computing Krippendorff's alpha-reliability. http:\/\/www.asc.upenn.edu\/usr\/krippendorff\/webreliability.doc [2010, March 29].","DOI":"10.1002\/9781405186407.wbiecr029"},{"key":"S1351324910000070_ref57","volume-title":"Proceedings of Workshop on Applied Interlinguas: Practical Applications of Interlingual Approaches to NLP, ANLP-NAACL","author":"Martins","year":"2000"},{"key":"S1351324910000070_ref31","volume-title":"Proceedings of the MT Summit IV","author":"Funaki","year":"1993"},{"key":"S1351324910000070_ref80","unstructured":"Stowell T. 1981. Origins of Phrase Structure. PhD thesis, MIT."},{"key":"S1351324910000070_ref47","volume-title":"Sixth Workshop on Interlinguas: Annotations and Translations, MT Summit IX","author":"Kingsbury","year":"2003"},{"key":"S1351324910000070_ref32","doi-asserted-by":"crossref","DOI":"10.4324\/9781315841366","volume-title":"Corpus Annotation: Linguistic Information from Computer Text Corpora","author":"Garside","year":"1997"},{"key":"S1351324910000070_ref73","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC.2007.83"},{"key":"S1351324910000070_ref79","volume-title":"Nonparametric Statistics for the Behavioral Sciences","author":"Siegel","year":"1988"},{"key":"S1351324910000070_ref3","doi-asserted-by":"publisher","DOI":"10.1162\/coli.07-034-R2"},{"key":"S1351324910000070_ref8","first-page":"16","volume-title":"Proceedings of HLT-NAACL","author":"Barzilay","year":"2003"},{"key":"S1351324910000070_ref7","doi-asserted-by":"publisher","DOI":"10.3115\/1219840.1219914"},{"key":"S1351324910000070_ref29","volume-title":"Proceedings of the ACL Conference","author":"Fleischman","year":"2003"},{"key":"S1351324910000070_ref82","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-017-2535-4"},{"key":"S1351324910000070_ref41","volume-title":"Presentation at Darpa PI Meeting","author":"Hovy","year":"2003"},{"key":"S1351324910000070_ref61","volume-title":"Proceedings of the 1994 ARPA Human Language Technology Workshop","author":"Moore","year":"1994"},{"key":"S1351324910000070_ref26","unstructured":"Ferro L. , Mani I. , Sundheim B. , and Wilson G. 2001. TIDES temporal annotation guidelines, Version 1.0.2. Technical Report MTR 01W0000041, Mitre, McLean, VA."},{"key":"S1351324910000070_ref65","volume-title":"Proceedings of the Fourth International Conference on Language Resources and Evaluation (LREC)","author":"Passonneau","year":"2004"},{"key":"S1351324910000070_ref2","unstructured":"Artstein R. , and Poesio M. 2005b. Kappa Cubed = Alpha (or Beta). Technical Report NLE Technote 2005-01, University of Essex."},{"key":"S1351324910000070_ref74","volume-title":"Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC2006)","author":"Rambow","year":"2006"},{"key":"S1351324910000070_ref27","first-page":"1","volume-title":"Universals in Linguistic Theory","author":"Fillmore","year":"1968"},{"key":"S1351324910000070_ref75","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30194-3_26"},{"key":"S1351324910000070_ref14","doi-asserted-by":"publisher","DOI":"10.1037\/h0026256"},{"key":"S1351324910000070_ref49","volume-title":"Proceedings of AAAI","author":"Knight","year":"1994"},{"key":"S1351324910000070_ref48","volume-title":"Workshop on Applied Interlinguas (AMTA-2002)","author":"Kipper","year":"2002"},{"key":"S1351324910000070_ref34","volume-title":"Proceedings of AMTA-2002 Interlingua Reliability Workshop","author":"Habash","year":"2003"},{"key":"S1351324910000070_ref30","volume-title":"Frequency Analysis of English Usage","author":"Francis","year":"1982"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324910000070","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,29]],"date-time":"2021-10-29T13:52:21Z","timestamp":1635515541000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324910000070\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,6,15]]},"references-count":84,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2010,7]]}},"alternative-id":["S1351324910000070"],"URL":"https:\/\/doi.org\/10.1017\/s1351324910000070","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,6,15]]}}}