Recognising Textual Entailment Challenge

New! TAC 2008 Recognizing Textual Entailment (RTE) Track

 Recognising Textual Entailment Challenges

Textual Entailment Recognition was proposed recently as a generic task that captures major semantic inference needs across many natural language processing applications, such as Question Answering (QA), Information Retrieval (IR), Information Extraction (IE), and (multi) document summarization. This task requires to recognise, given two text fragments, whether the meaning of one text is entailed (can be inferred) from the other text.

The First Recognising Textual Entailment Challenge

(RTE 1)

The first PASCAL Recognising Textual Entailment Challenge (15 June 2004 - 10 April 2005) provided the first benchmark for the entailment task. The challenge raised noticeable attention in the research community, attracting 17 submissions from research groups worldwide. The relatively low accuracy achieved by the participating systems suggests that the entailment task is indeed a challenging one, with a wide room for improvement.

Challenge citation: Please use the following citation when referring to the RTE challenge:
Ido Dagan, Oren Glickman and Bernardo Magnini. The PASCAL Recognising Textual Entailment Challenge. In Quiñonero-Candela, J.; Dagan, I.; Magnini, B.; d'Alché-Buc, F. (Eds.), Machine Learning Challenges. Lecture Notes in Computer Science, Vol. 3944, pp. 177-190, Springer, 2006.

 

RTE 1 Workshop Proceedings

Second Recognising Textual Entailment Challenge website

Third Recognising Textual Entailment Challenge website