{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T20:02:53Z","timestamp":1779220973411,"version":"3.51.4"},"reference-count":0,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2002,2,14]],"date-time":"2002-02-14T00:00:00Z","timestamp":1013644800000},"content-version":"unspecified","delay-in-days":75,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2001,12]]},"abstract":"<jats:p>The Text REtrieval Conference (TREC) question answering track is an effort to bring the \nbenefits of large-scale evaluation to bear on a question answering (QA) task. The track has \nrun twice so far, first in TREC-8 and again in TREC-9. In each case, the goal was to retrieve \nsmall snippets of text that contain the actual answer to a question rather than the document \nlists traditionally returned by text retrieval systems. The best performing systems were able to \nanswer about 70% of the questions in TREC-8 and about 65% of the questions in TREC-9. \nWhile the 65% score is a slightly worse result than the TREC-8 scores in absolute terms, it \nrepresents a very significant improvement in question answering systems. The TREC-9 task \nwas considerably harder than the TREC-8 task because TREC-9 used actual users\u2019 questions \nwhile TREC-8 used questions constructed for the track. Future tracks will continue to \nchallenge the QA community with more difficult, and more realistic, question answering tasks.<\/jats:p>","DOI":"10.1017\/s1351324901002789","type":"journal-article","created":{"date-parts":[[2002,7,27]],"date-time":"2002-07-27T13:49:03Z","timestamp":1027777743000},"page":"361-378","source":"Crossref","is-referenced-by-count":116,"title":["The TREC question answering track"],"prefix":"10.1017","volume":"7","author":[{"given":"ELLEN M.","family":"VOORHEES","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"56","published-online":{"date-parts":[[2002,2,14]]},"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324901002789","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,7]],"date-time":"2019-05-07T21:32:55Z","timestamp":1557264775000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324901002789\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2001,12]]},"references-count":0,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2001,12]]}},"alternative-id":["S1351324901002789"],"URL":"https:\/\/doi.org\/10.1017\/s1351324901002789","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"value":"1351-3249","type":"print"},{"value":"1469-8110","type":"electronic"}],"subject":[],"published":{"date-parts":[[2001,12]]}}}