{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,5]],"date-time":"2025-10-05T19:50:08Z","timestamp":1759693808479,"version":"3.41.2"},"reference-count":26,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2004,4,1]],"date-time":"2004-04-01T00:00:00Z","timestamp":1080777600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2004,4,1]]},"abstract":"<jats:p>This study explored how the expression of search facets and relevance feedback (RF) by users was related to search success in interactive and automatic query expansion in the course of the search process. Search success was measured both in the number of relevant documents retrieved, whether identified by users or not. Research design consisted of 26 users searching for four TREC topics in Okapi IR system, half of the searchers using interactive and half automatic query expansion based on RF. The search logs were recorded, and the users filled in questionnaires for each topic concerning various features of searching. The results showed that the exhaustivity of the query was the most significant predictor of search success. Interactive expansion led to better search success than automatic expansion if all retrieved relevant items were counted, but there was no difference between the methods if only those items recognised relevant by users were observed. The analysis showed that the difference was facilitated by the liberal relevance criterion used in TREC not favouring highly relevant documents in evaluation.<\/jats:p>","DOI":"10.1108\/00220410410522016","type":"journal-article","created":{"date-parts":[[2004,3,30]],"date-time":"2004-03-30T18:14:37Z","timestamp":1080670477000},"page":"109-127","source":"Crossref","is-referenced-by-count":12,"title":["Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion"],"prefix":"10.1108","volume":"60","author":[{"given":"Pertti","family":"Vakkari","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susan","family":"Jones","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andy","family":"MacFarlane","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eero","family":"Sormunen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022021519524089500_b1","doi-asserted-by":"crossref","unstructured":"Bates, M.J. (1986), \u201cSubject access to online catologs: a design model\u201d, Journal of the American Society for Information Science, Vol. 37 No. 6, pp. 357\u201076.","DOI":"10.1002\/(SICI)1097-4571(198611)37:6<357::AID-ASI1>3.0.CO;2-H"},{"key":"key2022021519524089500_b2","doi-asserted-by":"crossref","unstructured":"Beaulieu, M. (1997), \u201cExperiments with interfaces to support query expansion\u201d, Journal of Documentation, Vol. 53 No. 1, pp. 8\u201019.","DOI":"10.1108\/EUM0000000007187"},{"key":"key2022021519524089500_b3","doi-asserted-by":"crossref","unstructured":"Beaulieu, M., Robertson, S. and Rasmussen, E. (1996), \u201cEvaluating interactive systems in TREC\u201d, Journal of the American Society for Information Science, Vol. 47 No. 1, pp. 85\u201094.","DOI":"10.1002\/(SICI)1097-4571(199601)47:1<85::AID-ASI8>3.0.CO;2-Z"},{"key":"key2022021519524089500_b4","unstructured":"Belkin, N. (1996), \u201cIntelligent information retrieval: whose intelligence?\u201d, ISI\u201996: Proceedings of the 5th International Symposium for Information Science, Universit\u00e4tsverlag Konstanz, Konstanz, pp. 25\u201031."},{"key":"key2022021519524089500_b5","doi-asserted-by":"crossref","unstructured":"Belkin et al. (2000), \u201cRelevance feedback versus local context analysis as term suggestion devices: Rutgers\u2019 TREC\u20108 interactive track experience\u201d, Proceedings of TREC\u20108.","DOI":"10.6028\/NIST.SP.500-246.interactive-rutgersb"},{"key":"key2022021519524089500_b6","doi-asserted-by":"crossref","unstructured":"Blair, D. and Maron, M. (1985), \u201cAn evaluation of retrieval effectiveness for a full\u2010text document retrieval system\u201d, Communications of the ACM, Vol. 28 No. 3, pp. 289\u201099.","DOI":"10.1145\/3166.3197"},{"key":"key2022021519524089500_b7","doi-asserted-by":"crossref","unstructured":"Brajnik, G., Mizzarro, S. and Tasso, C. (1996), \u201cEvaluating user interfaces to information retrieval systems: a case study\u201d, Proceedings of the SIGIR\u201996, ACM, New York, NY, pp. 128\u201036.","DOI":"10.1145\/243199.243249"},{"key":"key2022021519524089500_b8","unstructured":"Efthimiadis, E. (1996), \u201cQuery expansion\u201d, in Williams, M.E. (Ed.), Annual Review of Information Science and Technology, Vol. 31, Information Today, Medford, NJ, pp. 121\u201087."},{"key":"key2022021519524089500_b9","unstructured":"Fowkes, H. and Beaulieu, M. (2000), \u201cInteractive searching behavior: Okapi experiment for TREC\u20108\u201d, Proceedings of the BCS\u2010IRSG: 22nd Annual Colloquium on Information Retrieval Research, pp. 47\u201056."},{"key":"key2022021519524089500_b10","doi-asserted-by":"crossref","unstructured":"Hancock\u2010Beaulieu, M., Fieldhouse, M. and Do, T. (1995), \u201cAn evaluation of interactive query expansion in an online library catalogue with graphical user interface\u201d, Journal of Documentation, Vol. 51 No. 3, pp. 225\u201043.","DOI":"10.1108\/eb026949"},{"key":"key2022021519524089500_b11","unstructured":"Hawking, D., Thistlewaite, P. and Bailey, B. (1997), \u201cANU\/ACSys TREC\u20105 experiments\u201d, in Voorhees, E. and Harman, D. (Eds), Information Technology: The 5th Text Retrieval Conference (TREC\u20105), pp. 359\u201075."},{"key":"key2022021519524089500_b12","doi-asserted-by":"crossref","unstructured":"Jones, S., Gatford, M., Robertson, S., Hancock\u2010Beaulieu, M. and Secker, J. (1995), \u201cInteractive thesaurus navigation: intelligence rules OK?\u201d, Journal of the American Society for Information Science, Vol. 46 No. 1, pp. 52\u20109.","DOI":"10.1002\/(SICI)1097-4571(199501)46:1<52::AID-ASI6>3.0.CO;2-1"},{"key":"key2022021519524089500_b13","doi-asserted-by":"crossref","unstructured":"J\u00e4rvelin, K. and Kek\u00e4l\u00e4inen, J. (2000), \u201cIR evaluation methods for retrieving highly relevant documents\u201d, Proceedings of the SIGIR 2000, ACM, New York, NY, pp. 41\u20108.","DOI":"10.1145\/345508.345545"},{"key":"key2022021519524089500_b14","unstructured":"Kek\u00e4l\u00e4inen, J. (1999), \u201cThe effects of query complexity, expansion and structure on retrieval performance in probabilistic text retrieval\u201d, doctoral dissertation, Tampere University Press, Tampere."},{"key":"key2022021519524089500_b15","doi-asserted-by":"crossref","unstructured":"Kek\u00e4l\u00e4inen, J. and J\u00e4rvelin, K. (1998), \u201cThe impact of query structure and query extension on retrieval performance\u201d, Proceedings of the SIGIR'98, ACM, New York, NY, pp. 130\u20107.","DOI":"10.1145\/290941.290978"},{"key":"key2022021519524089500_b16","doi-asserted-by":"crossref","unstructured":"Koenemann, J. and Belkin, N. (1996), \u201cA case for interaction: a study of interactive information retrieval behavior and effectiveness\u201d, Proceedings of the Human Factors in Computing Systems Conference (CHI\u201996), ACM, New York, NY, pp. 205\u201012.","DOI":"10.1145\/238386.238487"},{"key":"key2022021519524089500_b17","doi-asserted-by":"crossref","unstructured":"Mitra, M., Singhal, A. and Buckley, C. (1998), \u201cImproving automatic query expansion\u201d, Proceedings of the SIGIR'98, ACM, New York, NY, pp. 206\u201014.","DOI":"10.1145\/290941.290995"},{"key":"key2022021519524089500_b18","doi-asserted-by":"crossref","unstructured":"Over, P. (2001), \u201cThe TREC interactive track: an annotated bibliography\u201d, Information Processing & Management, Vol. 37 No. 3, pp. 368\u201081.","DOI":"10.1016\/S0306-4573(00)00053-4"},{"key":"key2022021519524089500_b19","doi-asserted-by":"crossref","unstructured":"Pennanen, M. and Vakkari, P. (2003), \u201cStudents\u2019 conceptual structure, search process, and outcome while preparing a research proposal?\u201d, Journal of the American Society for Information Science and Technology, Vol. 54 No. 8.","DOI":"10.1002\/asi.10273"},{"key":"key2022021519524089500_b20","doi-asserted-by":"crossref","unstructured":"Ruthven, I. (2003), \u201cRe\u2010examining the potential effectiveness of interactive query expansion\u201d, Proceedings of the SIGIR'03, ACM, New York, NY, pp. 213\u201020.","DOI":"10.1145\/860435.860475"},{"key":"key2022021519524089500_b21","doi-asserted-by":"crossref","unstructured":"Sormunen, E. (2002a), \u201cA retrospective evaluation method for exact\u2010match and best\u2010match queries applying an interactive query performance analyser\u201d, in Crestani, F. et al. (Eds), Advances in Information Retrieval: Proceedings of the 24th European Colloquium on IR Research, Springer, Berlin and Heidelberg, pp. 334\u201052.","DOI":"10.1007\/3-540-45886-7_22"},{"key":"key2022021519524089500_b22","doi-asserted-by":"crossref","unstructured":"Sormunen, E. (2002b), \u201cLiberal relevance criteria of TREC \u2013 counting on negligible documents?\u201d, Proceedings of the SIGIR'02, ACM, New York, NY, pp. 324\u201030.","DOI":"10.1145\/564376.564433"},{"key":"key2022021519524089500_b23","doi-asserted-by":"crossref","unstructured":"Sormunen, E., Kek\u00e4l\u00e4inen, J., Koivisto, J. and J\u00e4rvelin, K. (2001), \u201cDocument text characteristics affect the ranking of the most relevant documents by expanded structured queries\u201d, Journal of Documentation, Vol. 57 No. 3, pp. 358\u201076.","DOI":"10.1108\/EUM0000000007087"},{"key":"key2022021519524089500_b24","doi-asserted-by":"crossref","unstructured":"Spink, A. (1995), \u201cTerm relevance feedback and mediated database searching\u201d, Information Processing & Management, Vol. 31 No. 2, pp. 161\u201071.","DOI":"10.1016\/0306-4573(95)80033-P"},{"key":"key2022021519524089500_b25","doi-asserted-by":"crossref","unstructured":"Vakkari, P. (2002), \u201cSubject knowledge, source of terms and term selection in query expansion: an analytical study\u201d, in Crestani, F. et al. (Eds), Advances in Information Retrieval: Proceedings of the 24th European Colloquium on IR Research, Springer, Berlin and Heidelberg, pp. 110\u201023.","DOI":"10.1007\/3-540-45886-7_8"},{"key":"key2022021519524089500_b26","unstructured":"Vakkari, P. and Sormunen, E. (n.d.), \u201cThe influence of relevance levels on the effectiveness of interactive information retrieval\u201d, Journal of the American Society for Information Science and Technology, forthcoming."}],"container-title":["Journal of Documentation"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/00220410410522016","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/00220410410522016\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/00220410410522016\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T23:37:19Z","timestamp":1753400239000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/jd\/article\/60\/2\/109-127\/198653"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,4,1]]},"references-count":26,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2004,4,1]]}},"alternative-id":["10.1108\/00220410410522016"],"URL":"https:\/\/doi.org\/10.1108\/00220410410522016","relation":{},"ISSN":["0022-0418"],"issn-type":[{"type":"print","value":"0022-0418"}],"subject":[],"published":{"date-parts":[[2004,4,1]]}}}