{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:42:25Z","timestamp":1761007345242,"version":"build-2065373602"},"reference-count":25,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2007,10,10]],"date-time":"2007-10-10T00:00:00Z","timestamp":1191974400000},"content-version":"vor","delay-in-days":647,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc of Assoc for Info"],"published-print":{"date-parts":[[2006,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper describes a framework for investigating the quality of different query expansion approaches, and applies it in the HARD TREC experimental setting. The intuition behind our approach is that each topic has an optimal term\u2010based representation, i.e. a set of terms that best describe it, and that the effectiveness of any other representation is correlated with the overlap that it has with the optimal representation. Indeed, we find that, for a wide number of candidate topic representations, obtained through various query\u2010expansion approaches, there is a high correlation between standard effectiveness measures (R\u2010P, P@10, MAP) and term overlap with what is estimated to be the optimal representation.<\/jats:p><jats:p>An important conclusion of comparing different query expansion approaches is that machines are better than humans at doing statistical calculations and at estimating which query terms are more likely to discriminate documents relevant for a given topic. This explains why, in the HARD track of TREC 2005, the overall conclusion was that interaction with the searcher and elicitation of additional information could not over\u2010perform automatic procedures for query improvement. However, the best results are obtained from hybrid approaches, in which human relevance judgments are used by algorithms for deriving terms representations. This result suggest that the best approach in improving retrieval performance is probably to focus on implicit relevance feedback and novel interaction models based on ostention or mediation, which have shown great potential.<\/jats:p>","DOI":"10.1002\/meet.14504301197","type":"journal-article","created":{"date-parts":[[2007,10,10]],"date-time":"2007-10-10T12:52:50Z","timestamp":1192020770000},"page":"1-34","source":"Crossref","is-referenced-by-count":0,"title":["Where do good query terms come from?"],"prefix":"10.1002","volume":"43","author":[{"given":"Gheorghe","family":"Muresan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dmitri","family":"Roussinov","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2007,10,10]]},"reference":[{"key":"e_1_2_11_2_1","doi-asserted-by":"crossref","unstructured":"AllenJ.(2004) HARD Track Overview in TREC 2004\u2010High Accuracy Retrieval from DocumentsProceedings of TREC 2004 Gaithersburg November 2004","DOI":"10.21236\/ADA455426"},{"key":"e_1_2_11_3_1","doi-asserted-by":"crossref","unstructured":"AllenJ.(2005) HARD Track Overview in TREC 2004\u2010High Accuracy Retrieval from DocumentsProceedings of TREC 2005 Gaithersburg November 2005","DOI":"10.6028\/NIST.SP.500-266.HARD-overview"},{"key":"e_1_2_11_4_1","first-page":"133","article-title":"Anomalous states of knowledge as a basis for information retrieval","volume":"5","author":"Belkin N. J.","year":"1980","journal-title":"Canadian Journal of Information Science"},{"key":"e_1_2_11_5_1","doi-asserted-by":"crossref","unstructured":"BelkinN. J. CoolC. Head JengJ. KellyD. LinS.et al. (2000) Relevance Feedback versus Local Context Analysis as Term Suggestion Devices: Rutgers' TREC\u20108 Interactive Track Experience In: E.M. Voorhees & D.K. Harman (Eds.)The Eighth Text REtrieval Conference (TREC 8)(pp.565\u2013576). Washington D.C.","DOI":"10.6028\/NIST.SP.500-246.rutgersb"},{"key":"e_1_2_11_6_1","unstructured":"BelkinN. J. CoolC. KellyD. KimG. LeeH.\u2010J. MuresanG. et al. (2002) Rutgers interactive track at TREC 2002Paper presented at the Eleventh Text Retrieval Conference (TREC 2002) Washington D.C."},{"key":"e_1_2_11_7_1","unstructured":"BelkinN. J. KellyD. LeeH.\u2010J. LiY.\u2010L. MuresanG. TangM.\u2010C. LiuL. LiuY.\u2010H. MuresanG.et al. (2004) Rutgers' HARD Track Experiments at TREC 2004Proceedings of TREC 2004 Gaithersburg November 2004"},{"key":"e_1_2_11_8_1","doi-asserted-by":"crossref","unstructured":"BelkinN. J. ColeM. GwizdkaJ. LiY.\u2010L. LiuJ.\u2010J. MuresanG.et al. (2005) Rutgers Information Interaction Lab at TREC 2005: Trying HARDProceedings of TREC 2005 Gaithersburg November 2005","DOI":"10.6028\/NIST.SP.500-266.HARD-rutgers.belkin"},{"key":"e_1_2_11_9_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026726"},{"volume-title":"TREC\u2010Experiment and Evaluation in Information Retrieval","year":"2005","author":"Buckley C.","key":"e_1_2_11_10_1"},{"key":"e_1_2_11_11_1","unstructured":"CampbellI.(1996) The Ostensive Model of Developing Information NeedsProceedings of COLIS\u201096 2nd International Conference on Conceptions of Library Science"},{"key":"e_1_2_11_12_1","doi-asserted-by":"crossref","unstructured":"Cronen\u2010TownsendS. ZhouY.&CroftW. B.(2004) A Framework for Selective Query ExpansionProceedings of CIKM 2004 Washington DC November 8\u201013 2004","DOI":"10.21236\/ADA477592"},{"key":"e_1_2_11_13_1","unstructured":"HarperD. J.(1980)Relevance Feedback in Document Systems: An Evaluation of Probabilistic StrategiesPhD thesis Jesus College Cambridge UK February 1980"},{"key":"e_1_2_11_14_1","first-page":"6","volume-title":"Information in Context: IRiX:ACM\u2010SIGIR Workshop 2004 Proceedings","author":"Ingwerwsen P.","year":"2004"},{"key":"e_1_2_11_15_1","doi-asserted-by":"crossref","unstructured":"KellyD. DolluV. D. &FuX.(2004) University of North Carolina's HARD track experiments at TREC 2004Thirteenth Text Retrieval Conference (TREC 2004)","DOI":"10.6028\/NIST.SP.500-261.HARD-u.northcarolina"},{"key":"e_1_2_11_16_1","unstructured":"KellyD. DolluV. D. &FuX.(2005 August 15\u201019) The loquacious user: A document\u2010independent source of terms for query expansionProceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '05) Salvador Brazil"},{"volume-title":"Proceedings of the Human Factors in Computing Systems Conference (CHI'96)","year":"1996","author":"Koenemann J.","key":"e_1_2_11_17_1"},{"key":"e_1_2_11_18_1","doi-asserted-by":"crossref","unstructured":"KrovetzR.(1993) Viewing morphology as an inference processProc. 16th ACM SIGIR Conference Pittsburgh June 27\u2010July 1 1993pp.191\u2013202","DOI":"10.1145\/160688.160718"},{"volume-title":"Foundations of Statistical Natural Language Processing","year":"1999","author":"Manning C. D.","key":"e_1_2_11_19_1"},{"key":"e_1_2_11_20_1","unstructured":"MuresanG.(2002)Using Document Clustering and Language Modelling in Mediated Information RetrievalPhD thesis Robert Gordon University Aberdeen UK January 2002"},{"key":"e_1_2_11_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20034"},{"key":"e_1_2_11_22_1","unstructured":"RobertsonS. E. WalkerS. Hancock\u2010BeaulieuM. M.&GatfordM.(1994) Okapi at TREC\u20103 Proceedings of the Third Text Retrieval Conference November 1994"},{"volume-title":"Relevance Feedback in Information Retrieval","year":"1971","author":"Rocchio J. J.","key":"e_1_2_11_23_1"},{"key":"e_1_2_11_24_1","doi-asserted-by":"crossref","unstructured":"RoussinovD. ZhaoL. &FanW.(2005) Mining Context Specific Similarity Relationships Using The World Wide WebProceedings of 2005 Conference on Human Language Technologies","DOI":"10.3115\/1220575.1220638"},{"key":"e_1_2_11_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(88)90021-0"},{"key":"e_1_2_11_26_1","unstructured":"WilkinsonR.(1997) Using combination of evidence for term expansionInformation Retrieval Research\u2010Proceedings of the 19th Annual BCS\u2010IRSG Colloquium on IR Research Aberdeen Scotland April 1997"}],"container-title":["Proceedings of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/meet.14504301197","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T12:43:13Z","timestamp":1760964193000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/meet.14504301197"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,1]]},"references-count":25,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2006,1]]}},"alternative-id":["10.1002\/meet.14504301197"],"URL":"https:\/\/doi.org\/10.1002\/meet.14504301197","archive":["Portico"],"relation":{},"ISSN":["0044-7870","1550-8390"],"issn-type":[{"type":"print","value":"0044-7870"},{"type":"electronic","value":"1550-8390"}],"subject":[],"published":{"date-parts":[[2006,1]]}}}