{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T00:26:14Z","timestamp":1777854374732,"version":"3.51.4"},"reference-count":11,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2002,12,1]],"date-time":"2002-12-01T00:00:00Z","timestamp":1038700800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Journal of Information Science"],"published-print":{"date-parts":[[2002,12]]},"abstract":"<jats:p>IR researchers need to collect comparative data to evaluate the worth of possible system improvements, for example new techniques for query enhancement. However it is sometimes difficult to achieve strict comparability in experiments designed for an interactive environment. We describe a method for merging results from different queries and collecting relevance feedback from users in comparative experiments. The method has been implemented in scripts supporting a Web-based front-end to a probabilistic retrieval system, using a relational database to log results. Its practical use is demonstrated in an investigation of initial query enhancement with collocate terms.<\/jats:p>","DOI":"10.1177\/016555150202800605","type":"journal-article","created":{"date-parts":[[2004,12,17]],"date-time":"2004-12-17T20:36:35Z","timestamp":1103315795000},"page":"493-503","source":"Crossref","is-referenced-by-count":0,"title":["A tool for comparative evaluation in an interactive environment"],"prefix":"10.1177","volume":"28","author":[{"given":"Susan","family":"Jones","sequence":"first","affiliation":[{"name":"Centre for Interactive Systems Research, City University, London, UK,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olga","family":"Vechtomova","sequence":"additional","affiliation":[{"name":"Centre for Interactive Systems Research, City University, London, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Robertson","sequence":"additional","affiliation":[{"name":"Centre for Interactive Systems Research, City University, London, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2002,12,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007186"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(00)00015-7"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007194"},{"key":"atypb4","first-page":"15","volume-title":"Knowledge at Work in Universities","author":"S. Jones","year":"1993"},{"key":"atypb5","first-page":"165","volume-title":"Proceedings of the 22nd BCS IRSG Meeting","author":"O. Vechtomova"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1177\/016555150202800102"},{"key":"atypb7","first-page":"109","volume-title":"Overview of the Third Text Retrieval Conference (TREC-3)","author":"S. Robertson"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.6028\/NIST.SP.500-246"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1002\/asi.4630260604"},{"key":"atypb10","unstructured":"[10] O. Vechtomova, Approaches to using word collocation in information                 retrieval. Ph.D. Thesis (City University, 2001)."},{"key":"atypb11","volume-title":"Corpus Linguistics","author":"T. McEnery","year":"1996"}],"container-title":["Journal of Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555150202800605","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/016555150202800605","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T23:06:25Z","timestamp":1777503985000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/016555150202800605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2002,12]]},"references-count":11,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2002,12]]}},"alternative-id":["10.1177\/016555150202800605"],"URL":"https:\/\/doi.org\/10.1177\/016555150202800605","relation":{},"ISSN":["0165-5515","1741-6485"],"issn-type":[{"value":"0165-5515","type":"print"},{"value":"1741-6485","type":"electronic"}],"subject":[],"published":{"date-parts":[[2002,12]]}}}