{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T17:07:35Z","timestamp":1760980055055,"version":"3.33.0"},"reference-count":8,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[1997,4,1]],"date-time":"1997-04-01T00:00:00Z","timestamp":859852800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[1997,4]]},"abstract":"<jats:p> Information retrieval (IR) research on text collections has concentrated on improving the effectiveness of the indexing and retrieval operations. For the most part, the evaluation of IR systems has been carried out on relatively small collections of documents, queries and relevance assessments. In 1992, the first of a series of evaluation exercises called TREC (Text REtrieval Conference) was launched in the USA and these exercises have continued annually since then. What makes TREC notable in IR research is that the document collections used are huge, compared to previous ones, and the groups participating in this collaborative evaluation represent a \u2018who is who\u2019 of IR research across the world. In this paper, we present an overview of TREC, the way it operates and the specialist \u2018tracks\u2019 it supports. We then concentrate on European involvement in TREC, examining the participants and the emergence of European TREC-like exercises. <\/jats:p>","DOI":"10.1177\/016555159702300208","type":"journal-article","created":{"date-parts":[[2004,12,18]],"date-time":"2004-12-18T01:36:35Z","timestamp":1103333795000},"page":"169-174","source":"Crossref","is-referenced-by-count":11,"title":["The TREC experiments and their impact on Europe"],"prefix":"10.1177","volume":"23","author":[{"given":"Alan F.","family":"Smeaton","sequence":"first","affiliation":[{"name":"Dublin City University, Ireland"}]},{"given":"Donna","family":"Harman","sequence":"additional","affiliation":[{"name":"National Institute for Standards and Technology, Maryland, USA"}]}],"member":"179","published-online":{"date-parts":[[1997,4,1]]},"reference":[{"volume-title":"Project Amaryllis","year":"1996","author":"Institute for Scientific and Technical Information","key":"atypb1"},{"volume-title":"D-lib Magazine (The Magazine of Digital Library Research)","year":"1995","author":"W.B. Croft","key":"atypb2"},{"volume-title":"The Information Engineering Sector","year":"1996","author":"European Commission DG XIII","key":"atypb3"},{"first-page":"40","volume-title":"Proceedings of the 19th Annual ACMSIGIR Conference on Research and Development in Information Retrieval (SIGIR 96)","author":"W. Kraaj","key":"atypb4"},{"volume-title":"The Third Text Retrieval Conference: TREC-3","author":"D.K. Harman","key":"atypb5"},{"volume-title":"The Fourth Text Retrieval Conference: TREC-4","author":"D.K. Harman","key":"atypb6"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(94)00048-8"},{"key":"atypb8","volume-title":"Information Retrieval","author":"C.J. van Rijsbergen","year":"1979","edition":"2"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555159702300208","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555159702300208","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T00:34:27Z","timestamp":1738024467000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/016555159702300208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1997,4]]},"references-count":8,"journal-issue":{"issue":"2","published-print":{"date-parts":[[1997,4]]}},"alternative-id":["10.1177\/016555159702300208"],"URL":"https:\/\/doi.org\/10.1177\/016555159702300208","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"type":"print","value":"0165-5515"},{"type":"electronic","value":"1741-6485"}],"subject":[],"published":{"date-parts":[[1997,4]]}}}