{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T11:55:21Z","timestamp":1772452521301,"version":"3.50.1"},"reference-count":20,"publisher":"SAGE Publications","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["WEB"],"published-print":{"date-parts":[[2015,7,1]]},"DOI":"10.3233\/web-150315","type":"journal-article","created":{"date-parts":[[2015,7,1]],"date-time":"2015-07-01T11:54:43Z","timestamp":1435751683000},"page":"123-133","source":"Crossref","is-referenced-by-count":1,"title":["Rank correlation analysis of RITE datasets and evaluation metrics \u2013 an observation on NTCIR-10 RITE Chinese subtasks"],"prefix":"10.1177","volume":"13","author":[{"given":"Chuan-Jie","family":"Lin","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, National Taiwan Ocean University, 2 Pei-Ning Road, Keelung 20224, Taiwan"}]},{"given":"Cheng-Wei","family":"Lee","sequence":"additional","affiliation":[{"name":"Institute of Information Science, Academia Sinica, 128 Academia Road, Section 2, Nankang, Taipei 11529, Taiwan"}]},{"given":"Cheng-Wei","family":"Shih","sequence":"additional","affiliation":[{"name":"Institute of Information Science, Academia Sinica, 128 Academia Road, Section 2, Nankang, Taipei 11529, Taiwan"}]},{"given":"Wen-Lian","family":"Hsu","sequence":"additional","affiliation":[{"name":"Institute of Information Science, Academia Sinica, 128 Academia Road, Section 2, Nankang, Taipei 11529, Taiwan"}]}],"member":"179","reference":[{"key":"10.3233\/WEB-150315_ref1","unstructured":"[1]Y.\u00a0Watanabe, Y.\u00a0Miyao, J.\u00a0Mizuno, T.\u00a0Shibata, H.\u00a0Kanayama, C.-W.\u00a0Lee, C.-J.\u00a0Lin, S.\u00a0Shi, T.\u00a0Mitamura, N.\u00a0Kando, H.\u00a0Shima and K.\u00a0Takeda, Overview of the recognizing inference in text (RITE-2) at NTCIR-10, in: Proc. of NTCIR-10, 2013, pp.\u00a0385\u2013404."},{"key":"10.3233\/WEB-150315_ref2","unstructured":"[2]L.\u00a0Bentivogli, I.\u00a0Dagan, H.T.\u00a0Dang, D.\u00a0Giampiccolo and B.\u00a0Magnini, The fifth Pascal recognizing textual entailment challenge, in: Proc. of TAC 2009 Workshop, 2009, pp.\u00a014\u201324."},{"key":"10.3233\/WEB-150315_ref3","unstructured":"[3]L.\u00a0Bentivogli, P.\u00a0Clark, I.\u00a0Dagan, H.T.\u00a0Dang and D.\u00a0Giampiccolo, The sixth Pascal recognizing textual entailment challenge, in: Proc. of the Text Analysis Conference (TAC 2010), 2010."},{"key":"10.3233\/WEB-150315_ref4","unstructured":"[4]L.\u00a0Bentivogli, P.\u00a0Clark, I.\u00a0Dagan, H.T.\u00a0Dang and D.\u00a0Giampiccolo, The seventh Pascal recognizing textual entailment challenge, in: Proc. of the Text Analysis Conference (TAC 2011), 2011."},{"key":"10.3233\/WEB-150315_ref5","doi-asserted-by":"crossref","unstructured":"[5]I.\u00a0Dagan, O.\u00a0Glickman and B.\u00a0Magnini, The Pascal recognising textual entailment challenge, in: Machine Learning Challenges. Evaluating Predictive Uncertainty, Visual Object Classification, and Recognising Textual Entailment, Lecture Notes in Computer Science, Vol.\u00a03944, 2006, pp.\u00a0177\u2013190.","DOI":"10.1007\/11736790_9"},{"key":"10.3233\/WEB-150315_ref6","unstructured":"[6]J.\u00a0Bos, F.M.\u00a0Zanzotto and M.\u00a0Pennacchiotti, Textual entailment at EVALITA 2009, in: Proc. of EVALITA 2009, 2009."},{"key":"10.3233\/WEB-150315_ref7","unstructured":"[7]H.\u00a0Shima, H.\u00a0Kanayama, C.-W.\u00a0Lee, C.-J.\u00a0Lin, T.\u00a0Mitamura, Y.\u00a0Miyao, S.\u00a0Shi and K.\u00a0Takeda, Overview of NTCIR-9 RITE: Recognizing inference in TExt, in: Proc. of NTCIR-9, 2011, pp.\u00a0291\u2013301."},{"key":"10.3233\/WEB-150315_ref8","doi-asserted-by":"crossref","unstructured":"[8]S.\u00a0Harabagiu and A.\u00a0Hickl, Methods for using textual entailment in open-domain question answering, in: Proc. of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the ACL, 2006, pp.\u00a0905\u2013912.","DOI":"10.3115\/1220175.1220289"},{"key":"10.3233\/WEB-150315_ref9","unstructured":"[9]B.\u00a0Sacaleanu, C.\u00a0Orasan, C.\u00a0Spurk, S.\u00a0Ou, O.\u00a0Ferrandez, M.\u00a0Kouylekov and M.\u00a0Negri, Entailment-based question answering for structured data, in: Proc. of 22nd International Conference on Computational Linguistics (COLING 2008), 2008, pp.\u00a0173\u2013176."},{"key":"10.3233\/WEB-150315_ref10","doi-asserted-by":"crossref","unstructured":"[10]S.\u00a0Clinchant, C.\u00a0Goutte and E.\u00a0Gaussier, Lexical entailment for information retrieval, in: Advances in Information Retrieval, Lecture Notes in Computer Science, Vol.\u00a03936, 2006, pp.\u00a0217\u2013228.","DOI":"10.1007\/11735106_20"},{"key":"10.3233\/WEB-150315_ref11","unstructured":"[11]D.\u00a0Parapar, \u00c1 Barreiro and D.E.\u00a0Losada, Query expansion using wordnet with a logical model of information retrieval, in: IADIS AC, 2005, pp.\u00a0487\u2013494."},{"key":"10.3233\/WEB-150315_ref13","doi-asserted-by":"crossref","unstructured":"[13]E.\u00a0Lloret, O.s.\u00a0Ferr\u00e1ndez, R.\u00a0Mun\u00f5z and M.\u00a0Palomar, A text summarization approach under the influence of textual entailment, in: Proc. of the 5th International Workshop on Natural Language Processing and Cognitive Science (NLPCS 2008), 2008, pp.\u00a022\u201331.","DOI":"10.5220\/0001732100220031"},{"key":"10.3233\/WEB-150315_ref14","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1142\/S0218194009004520","article-title":"Entailment-based linear segmentation in summarization","volume":"19","author":"Tatar","year":"2009","journal-title":"International Journal of Software Engineering and Knowledge Engineering"},{"key":"10.3233\/WEB-150315_ref15","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1017\/S135132490999012X","article-title":"Recognizing entailment in intelligent tutoring systems","volume":"15","author":"Nielsen","year":"2009","journal-title":"Natural Language Engineering"},{"key":"10.3233\/WEB-150315_ref16","doi-asserted-by":"crossref","unstructured":"[16]S.\u00a0Pado, M.\u00a0Galley, D.\u00a0Jurafsky and C.\u00a0Manning, Robust machine translation evaluation with entailment features, in: Proc. of ACL-IJCNLP 2009, 2009, pp.\u00a0297\u2013305.","DOI":"10.3115\/1687878.1687922"},{"key":"10.3233\/WEB-150315_ref17","doi-asserted-by":"crossref","unstructured":"[17]L.\u00a0Zhou, C.-Y.\u00a0Lin, D.S.\u00a0Munteanu and E.\u00a0Hovy, Paraeval: Using paraphrases to evaluate summaries automatically, in: Proc. of the Main Conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics (HLT-NAACL \u201906) 2006, pp.\u00a0447\u2013454.","DOI":"10.3115\/1220835.1220892"},{"key":"10.3233\/WEB-150315_ref19","doi-asserted-by":"crossref","unstructured":"[19]C.-W.\u00a0Lee, C.-J.\u00a0Lin, H.\u00a0Shima and W.-L.\u00a0Hsu, Evaluating and enhancing cross-domain rank predictability of textual entailment datasets, in: Proc. of the 13th IEEE International Conference on Information Reuse and Integration (IRI 2012), Workshop on Empirical Methods for Recognizing Inference in Text (EM-RITE), 2012, pp.\u00a051\u201358.","DOI":"10.1109\/IRI.2012.6302990"},{"key":"10.3233\/WEB-150315_ref20","unstructured":"[20]T.\u00a0Sakai, H.\u00a0Shima, N.\u00a0Kando, R.\u00a0Song, C.J.\u00a0Lin, T.\u00a0Mitamura, M.\u00a0Sugimito and C.W.\u00a0Lee, Overview of NTCIR-8 ACLIA IR4QA, in: Proc. of the 8th NTCIR Workshop Meeting on Evaluation of Information Access Technologies: Information Retrieval, Question Answering, and Cross-Lingual Information Access (NTCIR-8), 2010, pp.\u00a063\u201393."},{"issue":"4","key":"10.3233\/WEB-150315_ref21","doi-asserted-by":"crossref","first-page":"12:1","DOI":"10.1145\/1450295.1450297","article-title":"Boosting Chinese question answering with two lightweight methods: ABSPs and SCO-QAT","volume":"7","author":"Lee","year":"2008","journal-title":"ACM Transactions on Asian Language Information Processing (TALIP)"},{"key":"10.3233\/WEB-150315_ref22","unstructured":"[22]Y.\u00a0Sasaki, C.-J.\u00a0Lin, K.-h.\u00a0Chen and H.-H.\u00a0Chen, Overview of the NTCIR-6 cross-lingual question answering (CLQA) task, in: Proc. of NTCIR-6, 2007, pp.\u00a0153\u2013163."}],"container-title":["Web Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/WEB-150315","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T10:59:10Z","timestamp":1772449150000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/WEB-150315"}},"subtitle":[],"editor":[{"given":"Chao-Lin","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Mitsunori","family":"Matsushita","sequence":"additional","affiliation":[]},{"given":"Yasufumi","family":"Takama","sequence":"additional","affiliation":[]},{"given":"Min-Yuh","family":"Day","sequence":"additional","affiliation":[]},{"given":"Vincent Shin-Mu","family":"Tseng","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2015,7,1]]},"references-count":20,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/web-150315","relation":{},"ISSN":["2405-6464","2405-6456"],"issn-type":[{"value":"2405-6464","type":"electronic"},{"value":"2405-6456","type":"print"}],"subject":[],"published":{"date-parts":[[2015,7,1]]}}}