{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T13:20:41Z","timestamp":1762521641632},"reference-count":76,"publisher":"Cambridge University Press (CUP)","issue":"2","license":[{"start":{"date-parts":[[2013,12,13]],"date-time":"2013-12-13T00:00:00Z","timestamp":1386892800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2015,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>A key challenge at the core of many Natural Language Processing (NLP) tasks is the ability to determine which conclusions can be inferred from a given natural language text. This problem, called the<jats:italic>Recognition of Textual Entailment (RTE)<\/jats:italic>, has initiated the development of a range of algorithms, methods, and technologies. Unfortunately, research on Textual Entailment (TE), like semantics research more generally, is fragmented into studies focussing on various aspects of semantics such as world knowledge, lexical and syntactic relations, or more specialized kinds of inference. This fragmentation has problematic practical consequences. Notably, interoperability among the existing RTE systems is poor, and reuse of resources and algorithms is mostly infeasible. This also makes systematic evaluations very difficult to carry out. Finally, textual entailment presents a wide array of approaches to potential end users with little guidance on which to pick. Our contribution to this situation is the novel EXCITEMENT architecture, which was developed to enable and encourage the consolidation of methods and resources in the textual entailment area. It decomposes RTE into components with strongly typed interfaces. We specify (a) a modular linguistic analysis pipeline and (b) a decomposition of the \u2018core\u2019 RTE methods into top-level algorithms and subcomponents. We identify four major subcomponent types, including knowledge bases and alignment methods. The architecture was developed with a focus on generality, supporting all major approaches to RTE and encouraging language independence. We illustrate the feasibility of the architecture by constructing mappings of major existing systems onto the architecture. The practical implementation of this architecture forms the EXCITEMENT open platform. It is a suite of textual entailment algorithms and components which contains the three systems named above, including linguistic-analysis pipelines for three languages (English, German, and Italian), and comprises a number of linguistic resources. By addressing the problems outlined above, the platform provides a comprehensive and flexible basis for research and experimentation in textual entailment and is available as open source software under the GNU General Public License.<\/jats:p>","DOI":"10.1017\/s1351324913000351","type":"journal-article","created":{"date-parts":[[2013,12,13]],"date-time":"2013-12-13T09:55:09Z","timestamp":1386928509000},"page":"167-200","source":"Crossref","is-referenced-by-count":12,"title":["Design and realization of a modular architecture for textual entailment"],"prefix":"10.1017","volume":"21","author":[{"given":"SEBASTIAN","family":"PAD\u00d3","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"TAE-GIL","family":"NOH","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ASHER","family":"STERN","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"RUI","family":"WANG","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"ROBERTO","family":"ZANOLI","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2013,12,13]]},"reference":[{"key":"S1351324913000351_ref075","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324909990143"},{"key":"S1351324913000351_ref074","doi-asserted-by":"crossref","unstructured":"Wang R. , and Zhang Y. 2009. Recognizing textual relatedness with predicate-argument structures. In Proceedings of Conference on Empirical Methods in Natural Language Processing, Singapore, pp. 784\u201392.","DOI":"10.3115\/1699571.1699615"},{"key":"S1351324913000351_ref073","first-page":"742","volume-title":"Working Notes for the CLEF 2008 Workshop","author":"Wang","year":"2008"},{"key":"S1351324913000351_ref076","first-page":"288","volume-title":"Proceedings of the International Conference on Computational Semantics","author":"Zeller","year":"2013"},{"key":"S1351324913000351_ref072","unstructured":"Wang R. , and Neumann G. 2008a. An accuracy-oriented divide-and-conquer strategy for recognizing textual entailment. In Proceedings of the TAC Workshop on Textual Entailment, Gaithersburg, MD."},{"key":"S1351324913000351_ref071","unstructured":"Wang R. 2011. Intrinsic and Extrinsic Approaches to Recognizing Textual Entailment. PhD. thesis, Saarland University, Saarbr\u00fccken, Germany."},{"key":"S1351324913000351_ref070","doi-asserted-by":"crossref","unstructured":"Toutanova K. , and Manning C. D. 2000. Enriching the knowledge sources used in a maximum entropy part-of-speech tagger. In Proceedings of the Conference on Empirical methods in Natural Language Processing, Hong Kong, pp. 63\u201370.","DOI":"10.3115\/1117794.1117802"},{"key":"S1351324913000351_ref068","first-page":"455","volume-title":"Proceedings of the Conference on Recent Advances in Natural Language Processing","author":"Stern","year":"2011"},{"key":"S1351324913000351_ref066","unstructured":"Sch\u00e4fer U. 2007. Integrating Deep and Shallow Natural Language Processing Components \u2013 Representations and Hybrid Architectures. PhD thesis, Saarland University, Saarbr\u00fccken, Germany."},{"key":"S1351324913000351_ref065","unstructured":"Sammons M. , Vydiswaran V. , and Roth D. 2012. Recognizing textual entailment. In Daniel M. Bikel and I. Zitouni (eds.), Multilingual Natural Language Applications: From Theory to Practice. Englewood Cliffs, NJ: Prentice Hall, pp. 209\u2013258."},{"key":"S1351324913000351_ref064","first-page":"401","volume-title":"Proceedings of the Conference of the European Chapter of the ACL","author":"Romano","year":"2006"},{"key":"S1351324913000351_ref062","doi-asserted-by":"publisher","DOI":"10.1093\/logcom\/exm072"},{"key":"S1351324913000351_ref061","volume-title":"Proceedings of the HLT-NAACL Workshop on Software Engineering and Architecture of Language Technology Systems","author":"Patrick","year":"2003"},{"key":"S1351324913000351_ref059","first-page":"99","volume-title":"Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics","author":"Nivre","year":"2005"},{"key":"S1351324913000351_ref058","doi-asserted-by":"publisher","DOI":"10.1017\/S135132490999012X"},{"key":"S1351324913000351_ref057","first-page":"399","volume-title":"The Joint Conference on Lexical and Computational Semantics and Sixth International Workshop on Semantic Evaluation","author":"Negri","year":"2012"},{"key":"S1351324913000351_ref053","first-page":"59","volume-title":"Proceedings of the Conference on Inference in Computational Semantics","author":"Monz","year":"2001"},{"key":"S1351324913000351_ref052","first-page":"558","volume-title":"Proceedings of the Conference of the European Chapter of the ACL","author":"Mirkin","year":"2009"},{"key":"S1351324913000351_ref050","doi-asserted-by":"publisher","DOI":"10.3115\/1608829"},{"key":"S1351324913000351_ref048","first-page":"321","volume-title":"Proceedings of the Annual Conference of the North American Chapter of the ACL","author":"Mehdad","year":"2010"},{"key":"S1351324913000351_ref047","doi-asserted-by":"crossref","unstructured":"MacCartney B. , and Manning C. D. 2007, June. Natural logic for textual inference. In Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing, Prague, Czech Republic, pp. 193\u2013200.","DOI":"10.3115\/1654536.1654575"},{"key":"S1351324913000351_ref046","first-page":"41","volume-title":"Proceedings of the Human Language Technology Conference of the NAACL","author":"MacCartney","year":"2006"},{"key":"S1351324913000351_ref020","first-page":"3276","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation","author":"Clarke","year":"2012"},{"key":"S1351324913000351_ref017","first-page":"62","volume-title":"Proceedings of the NAACL\/HLT Young Investigators Workshop on Computational Approaches to Languages of the Americas","author":"Castillo","year":"2010"},{"key":"S1351324913000351_ref055","first-page":"670","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Negri","year":"2011"},{"key":"S1351324913000351_ref028","first-page":"1","volume-title":"Proceedings of the COLING Workshop on Cross-Framework and Cross-Domain Parser Evaluation","author":"de Marneffe","year":"2008"},{"key":"S1351324913000351_ref013","first-page":"628","volume-title":"Proceedings of the Joint Conference on Human Language Technology and Empirical Methods in Natural Language Processing","author":"Bos","year":"2005"},{"key":"S1351324913000351_ref022","first-page":"441","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Crysmann","year":"2002"},{"key":"S1351324913000351_ref042","first-page":"1","volume-title":"Proceedings of the ACL Linguistic Annotation Workshop","author":"Ide","year":"2007"},{"key":"S1351324913000351_ref033","first-page":"363","volume-title":"Proceedings of the Annual Meeting on Association for Computational Linguistics","author":"Finkel","year":"2005"},{"key":"S1351324913000351_ref049","first-page":"1336","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Mehdad","year":"2011"},{"key":"S1351324913000351_ref067","first-page":"44","volume-title":"Proceedings of the International Conference on New Methods in Language Processing","author":"Schmid","year":"1994"},{"key":"S1351324913000351_ref032","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324904003523"},{"key":"S1351324913000351_ref025","first-page":"39","volume-title":"Proceedings of the HLT-NAACL Workshop on Software Engineering and Architecture of Language Technology Systems","author":"Curran","year":"2003"},{"key":"S1351324913000351_ref041","first-page":"489","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation","author":"Hinrichs","year":"2010"},{"key":"S1351324913000351_ref060","doi-asserted-by":"crossref","unstructured":"Pad\u00f3 S. , Cer D. , Galley M. , Jurafsky D. , and Manning C. D. 2009. Measuring machine translation quality as semantic equivalence: a metric based on entailment features. Machine Translation, 23 (2\u20133): 181\u201393.","DOI":"10.1007\/s10590-009-9060-y"},{"key":"S1351324913000351_ref056","first-page":"314","volume-title":"Proceeding of the Conference of the Italian Association for Artificial Intelligence","author":"Negri","year":"2009"},{"key":"S1351324913000351_ref027","volume-title":"Recognizing Textual Entailment: Models and Applications","author":"Dagan","year":"2012"},{"key":"S1351324913000351_ref043","first-page":"177","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Koehn","year":"2007"},{"key":"S1351324913000351_ref014","first-page":"98","volume-title":"Proceedings of the Second PASCAL Challenges Workshop on Recognising Textual Entailment","author":"Bos","year":"2006"},{"key":"S1351324913000351_ref005","doi-asserted-by":"publisher","DOI":"10.3115\/1631862.1631872"},{"key":"S1351324913000351_ref003","first-page":"86","volume-title":"Proceedings of the Joint International Conference on Computational Linguistics and Annual Meeting of the Association for Computational Linguistics","author":"Baker","year":"1998"},{"key":"S1351324913000351_ref019","doi-asserted-by":"publisher","DOI":"10.3115\/1654536.1654549"},{"key":"S1351324913000351_ref011","first-page":"10","volume-title":"Proceedings of the Workshop on Applied Textual Inference","author":"Bergmair","year":"2009"},{"key":"S1351324913000351_ref054","first-page":"67","volume-title":"Proceedings of the Conference on Inference in Computational Semantics","author":"Nairn","year":"2006"},{"key":"S1351324913000351_ref069","first-page":"371","volume-title":"Proceedings of the Joint Conference on Human Language Technology and Conference on Empirical Methods in Natural Language Processing","author":"Tatu","year":"2005"},{"key":"S1351324913000351_ref024","volume-title":"Text Processing with GATE (Version 6)","author":"Cunningham","year":"2011"},{"key":"S1351324913000351_ref034","first-page":"742","volume-title":"Proceedings of the Annual Conference of the North American Chapter of the ACL","author":"Goldberg","year":"2010"},{"key":"S1351324913000351_ref015","first-page":"320","volume-title":"Proceedings of the International Conference on Computational Semantics","author":"Cabrio","year":"2011"},{"key":"S1351324913000351_ref021","volume-title":"Proceedings of the ACL Workshop on Software Engineering, Testing, and Quality Assurance for Natural Language Processing","author":"Cohen","year":"2008"},{"key":"S1351324913000351_ref004","first-page":"871","volume-title":"Proceedings of the Annual Meeting of the American Association for Artificial Intelligence","author":"Bar-Haim","year":"2007"},{"key":"S1351324913000351_ref007","unstructured":"Bentivogli L. , Magnini B. , Dagan I. , Trang Dang H. , and Giampiccolo D. 2009. The fifth PASCAL recognising textual entailment challenge. In Proceedings of the TAC Workshop on Textual Entailment, Gaithersburg, MD."},{"key":"S1351324913000351_ref051","first-page":"1209","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Mirkin","year":"2010"},{"key":"S1351324913000351_ref040","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324909990118"},{"key":"S1351324913000351_ref001","first-page":"385","volume-title":"Proceedings of the International Workshop on Semantic Evaluation","author":"Agirre","year":"2012"},{"key":"S1351324913000351_ref002","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1613\/jair.2985","article-title":"A survey of paraphrasing and textual entailment methods","volume":"38","author":"Androutsopoulos","year":"2010","journal-title":"Journal of Artificial Intelligence Research"},{"key":"S1351324913000351_ref039","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.01.004"},{"key":"S1351324913000351_ref006","first-page":"241","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Aharon","year":"2010"},{"key":"S1351324913000351_ref008","unstructured":"Berant J. 2012. Global Learning of Textual Entailment Graphs. PhD thesis, Tel Aviv University, Israel."},{"key":"S1351324913000351_ref009","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00085"},{"key":"S1351324913000351_ref010","first-page":"192","volume-title":"Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Berger","year":"2000"},{"key":"S1351324913000351_ref012","doi-asserted-by":"publisher","DOI":"10.3115\/1654536.1654541"},{"key":"S1351324913000351_ref016","first-page":"1205","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation","author":"Callmeier","year":"2004"},{"key":"S1351324913000351_ref018","first-page":"33","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Chklovski","year":"2004"},{"key":"S1351324913000351_ref023","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014348124664"},{"key":"S1351324913000351_ref026","first-page":"177","volume-title":"Proceedings of the PASCAL Challenges Workshop on Recognising Textual Entailment","author":"Dagan","year":"2005"},{"key":"S1351324913000351_ref029","first-page":"1039","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"de Marneffe","year":"2008"},{"key":"S1351324913000351_ref063","first-page":"7","volume-title":"Proceedings of the International Conference on Language Resources and Evaluation","author":"Pianta","year":"2008"},{"key":"S1351324913000351_ref030","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"S1351324913000351_ref031","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7287.001.0001","volume-title":"WordNet: An Electronic Lexical Database","author":"Fellbaum","year":"1998"},{"key":"S1351324913000351_ref035","unstructured":"Gurevych I. , M\u00fchlh\u00e4user M. , M\u00fcller C. , Steimle J. , Weimer M. , and Zesch T. 2007. Darmstadt knowledge processing repository based on UIMA. In Proceedings of the First Workshop on Unstructured Information Management Architecture at the Conference of the Society for Computational Linguistics and Language Technology, T\u00fcbingen, Germany."},{"key":"S1351324913000351_ref036","doi-asserted-by":"crossref","unstructured":"Haghighi A. , and Klein D. 2009. Simple coreference resolution with rich syntactic and semantic features. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Singapore, pp. 1152\u201361.","DOI":"10.3115\/1699648.1699661"},{"key":"S1351324913000351_ref045","first-page":"752","volume-title":"Proceedings of the Annual Meeting of the North American Chapter of the ACL","author":"Lotan","year":"2013"},{"key":"S1351324913000351_ref037","first-page":"1","volume-title":"Proceedings of the Conference of Natural Language Learning","author":"Haji\u010d","year":"2009"},{"key":"S1351324913000351_ref038","first-page":"905","volume-title":"Proceedings of the International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics","author":"Harabagiu","year":"2006"},{"key":"S1351324913000351_ref044","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1017\/S1351324901002765","article-title":"Discovery of inference rules for question answering","volume":"7","author":"Lin","year":"2002","journal-title":"Journal of Natural Language Engineering"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324913000351","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,4]],"date-time":"2019-08-04T18:23:55Z","timestamp":1564943035000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324913000351\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,12,13]]},"references-count":76,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2015,3]]}},"alternative-id":["S1351324913000351"],"URL":"https:\/\/doi.org\/10.1017\/s1351324913000351","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,12,13]]}}}