{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:19:49Z","timestamp":1777889989471,"version":"3.51.4"},"reference-count":42,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2016,8,4]],"date-time":"2016-08-04T00:00:00Z","timestamp":1470268800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Web Intelligence"],"published-print":{"date-parts":[[2016,8,4]]},"abstract":"<jats:p>This paper introduces an aspect based model for analysing search queries, where queries are represented as aspects or concepts instead of \u201cbag of words\u201d or strings. A search query may consist of multiple aspects, while some aspects are covered well in the search results and some others are underrepresented. We think the underrepresented aspects are the main reason for the retrieval of irrelevant documents. This paper introduces novel algorithms that identify query aspects and identify underrepresented aspects.<\/jats:p>\n                  <jats:p>This model has many applications and this paper focuses on three of them: query difficulty prediction, query expansion and interactive query expansion. The main idea is that a hard query is a query with multiple aspects and some of the aspects are underrepresented, and a query can be improved or expanded by adding terms that are semantically related to the underrepresented aspects. Our experiments show that our aspect based methods significantly outperform existing methods.<\/jats:p>","DOI":"10.3233\/web-160338","type":"journal-article","created":{"date-parts":[[2016,8,5]],"date-time":"2016-08-05T10:56:10Z","timestamp":1470394570000},"page":"173-197","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Query aspects approach to web search"],"prefix":"10.1177","volume":"14","author":[{"given":"Daniel","family":"Crabtree","sequence":"first","affiliation":[{"name":"Victoria University of Wellington, New Zealand. E-mails:\u00a0,\u00a0,\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoying","family":"Gao","sequence":"additional","affiliation":[{"name":"Victoria University of Wellington, New Zealand. E-mails:\u00a0,\u00a0,\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Andreae","sequence":"additional","affiliation":[{"name":"Victoria University of Wellington, New Zealand. E-mails:\u00a0,\u00a0,\u00a0"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2016,8,4]]},"reference":[{"key":"ref001","doi-asserted-by":"crossref","unstructured":"J.\u00a0Allan, Hard track overview in trec 2003: High accuracy retrieval from documents, in: The 12th Text REtrieval Conference (TREC\u201903), 2003, pp.\u00a024\u201337.","DOI":"10.6028\/NIST.SP.500-255.hard-overview"},{"key":"ref002","doi-asserted-by":"crossref","unstructured":"J.\u00a0Allan, Hard track overview in trec 2005 high accuracy retrieval from documents, in: The 14th Text REtrieval Conference (TREC\u201905), 2005.","DOI":"10.6028\/NIST.SP.500-266.HARD-overview"},{"key":"ref003","doi-asserted-by":"crossref","unstructured":"T.G.\u00a0Armstrong, A.\u00a0Moffat, W.\u00a0Webber and J.\u00a0Zobel, Improvements that don\u2019t add up: Ad-hoc retrieval results since 1998, in: The 18th ACM Conference on Information and Knowledge Management (CIKM\u201909), 2009, pp.\u00a0601\u2013610.","DOI":"10.1145\/1645953.1646031"},{"key":"ref004","unstructured":"S.\u00a0Bergsma and Q.I.\u00a0Wang, Learning noun phrase query segmentation, in: Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 2007, pp.\u00a0819\u2013826."},{"key":"ref005","unstructured":"P.\u00a0Berkhin, Survey of clustering data mining techniques, Technical report, Accrue Software, San Jose, CA, 2002."},{"key":"ref006","unstructured":"T.\u00a0Brants and A.\u00a0Franz, Web 1t 5-gram version 1 ldc2006t13\u2019, DVD. Philadelphia: Linguistic Data Consortium, 2006."},{"key":"ref007","doi-asserted-by":"crossref","unstructured":"C.\u00a0Buckley, Why current ir engines fail, in: The 27th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201904), 2004, pp.\u00a0584\u2013585.","DOI":"10.1145\/1008992.1009132"},{"key":"ref008","doi-asserted-by":"crossref","unstructured":"D.\u00a0Carmel, E.\u00a0Yom-Tov, A.\u00a0Darlow and D.\u00a0Pelleg, What makes a query difficult? in: The 29th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201906), 2006, pp.\u00a0390\u2013397. doi:10.1145\/1148170.1148238.","DOI":"10.1145\/1148170.1148238"},{"key":"ref009","doi-asserted-by":"crossref","unstructured":"K.\u00a0Collins-Thompson and P.N.\u00a0Bennett, Predicting query performance via classification, in: Advances in Information Retrieval, 32nd European Conference IR Research (ECIR\u201910), 2010, pp.\u00a0140\u2013152.","DOI":"10.1007\/978-3-642-12275-0_15"},{"key":"ref010","doi-asserted-by":"crossref","unstructured":"K.\u00a0Collins-Thompson and J.\u00a0Callan, Query expansion using random walk models, in: The 14th ACM International Conference on Information and Knowledge Management (CIKM\u201905), 2005, pp.\u00a0704\u2013711.","DOI":"10.1145\/1099554.1099727"},{"key":"ref011","doi-asserted-by":"crossref","unstructured":"D.\u00a0Crabtree, P.\u00a0Andreae and X.\u00a0Gao, Exploiting underrepresented query aspects for automatic query expansion, in: The 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD\u201907), 2007, pp.\u00a0191\u2013200. doi:10.1145\/1281192.1281216.","DOI":"10.1145\/1281192.1281216"},{"key":"ref012","doi-asserted-by":"crossref","unstructured":"D.\u00a0Crabtree, P.\u00a0Andreae and X.\u00a0Gao, Understanding query aspects with applications to interactive query expansion, in: The 2007 IEEE\/WIC\/ACM International Conference on Web Intelligence (WI\u201907), 2007, pp.\u00a0691\u2013695.","DOI":"10.1109\/WI.2007.30"},{"key":"ref013","doi-asserted-by":"crossref","unstructured":"D.\u00a0Crabtree, X.\u00a0Gao and P.\u00a0Andreae, Query directed clustering,\n                      Knowledge and Information Systems\n                      (2012), 1\u201337. http:\/\/dx.doi.org\/10.1007\/s10115-012-0564-z.","DOI":"10.1007\/s10115-012-0564-z"},{"key":"ref014","doi-asserted-by":"crossref","unstructured":"B.B.\u00a0Croft, H.R.\u00a0Turtle and D.D.\u00a0Lewis, The use of phrases and structured queries in information retrieval, in: The 14th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201991), 1991, pp.\u00a032\u201345. doi:10.1145\/122860.122864.","DOI":"10.1145\/122860.122864"},{"key":"ref015","doi-asserted-by":"crossref","unstructured":"S.\u00a0Cronen-Townsend, Y.\u00a0Zhou and W.B.\u00a0Croft, Predicting query performance, in: The 25th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201902), 2002, pp.\u00a0299\u2013306. doi:10.1145\/564376.564429.","DOI":"10.1145\/564376.564429"},{"key":"ref016","doi-asserted-by":"crossref","unstructured":"C.\u00a0Hauff, V.\u00a0Murdock and R.\u00a0Baeza-Yates, Improved query difficulty prediction for the web, in: The 17th ACM Conference on Information and Knowledge Management (CIKM\u201908), 2008, pp.\u00a0439\u2013448.","DOI":"10.1145\/1458082.1458142"},{"key":"ref017","doi-asserted-by":"crossref","unstructured":"B.\u00a0He and I.\u00a0Ounis, Inferring query performance using pre-retrieval predictors, in: Symposium on String Processing and Information Retrieval, Springer Verlag, 2004, pp.\u00a043\u201354. doi:10.1007\/978-3-540-30213-1_5.","DOI":"10.1007\/978-3-540-30213-1_5"},{"key":"ref018","doi-asserted-by":"crossref","unstructured":"J.\u00a0Huang, J.\u00a0Gao, J.\u00a0Miao, X.\u00a0Li, K.\u00a0Wang, F.\u00a0Behr and C.L.\u00a0Giles, Exploring web scale language models for search query processing, in: The 19th International Conference on World Wide Web (WWW\u201910), 2010, pp.\u00a0451\u2013460.","DOI":"10.1145\/1772690.1772737"},{"key":"ref019","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10341"},{"key":"ref020","unstructured":"X.A.\u00a0Lu and R.B.\u00a0Keefer, Query expansion\/reduction and its impact on retrieval effectiveness, in: The 3rd Text Retrieval Conference (TREC\u201995), 1995, pp.\u00a0231\u2013239."},{"key":"ref021","doi-asserted-by":"crossref","unstructured":"M.\u00a0Magennis and C.J.\u00a0van Rijsbergen, The potential and actual effectiveness of interactive query expansion, in: The 20th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201997), 1997, pp.\u00a0324\u2013332. doi:10.1145\/258525.258603.","DOI":"10.1145\/258525.258603"},{"key":"ref022","unstructured":"Mam 2007, Mamma.com: www.mamma.com."},{"key":"ref023","doi-asserted-by":"crossref","unstructured":"M.\u00a0Mitra, A.\u00a0Singhal and C.\u00a0Buckley, Improving automatic query expansion, in: The 21st International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201998), 1998, pp.\u00a0206\u2013214. doi:10.1145\/290941.290995.","DOI":"10.1145\/290941.290995"},{"key":"ref024","unstructured":"J.\u00a0Mothe and L.\u00a0Tanguy, Linguistic features to predict query difficulty, in: ACM SIGIR Workshop on Predicting Query Difficulty, 2005."},{"key":"ref025","doi-asserted-by":"crossref","unstructured":"F.A.D.\u00a0Neves, E.A.\u00a0Fox and X.\u00a0Yu, Connecting topics in document collections with stepping stones and pathways, in: The 14th ACM International Conference on Information and Knowledge Management (CIKM\u201905), 2005, pp.\u00a091\u201398.","DOI":"10.1145\/1099554.1099573"},{"key":"ref026","doi-asserted-by":"crossref","unstructured":"S.\u00a0Osi\u0144ski, J.\u00a0Stefanowski and D.\u00a0Weiss, Lingo: Search results clustering algorithm based on singular value decomposition, in: The International IIS: Intelligent Information Processing and Web Mining Conference, Advances in Soft Computing, Springer, 2004, pp.\u00a0359\u2013368. doi:10.1007\/978-3-540-39985-8_37.","DOI":"10.1007\/978-3-540-39985-8_37"},{"key":"ref027","doi-asserted-by":"crossref","unstructured":"G.\u00a0Pass, A.\u00a0Chowdhury and C.\u00a0Torgeson, A picture of search, in: The 1st International Conference on Scalable Information Systems, 2006.","DOI":"10.1145\/1146847.1146848"},{"key":"ref028","doi-asserted-by":"crossref","unstructured":"M.\u00a0Pechenizkiy, A.\u00a0Tsymbal and S.\u00a0Puuronen, Pca-based feature transformation for classification: Issues in medical diagnostics, in: The 17th IEEE Symposium on Computer-Based Medical Systems, 2004, pp.\u00a0535\u2013540. doi:10.1109\/CBMS.2004.1311770.","DOI":"10.1109\/CBMS.2004.1311770"},{"key":"ref029","unstructured":"J.\u00a0Rocchio, Relevance feedback in information retrieval, in: The SMART Retrieval System: Experiments in Automatic Document Processing, G.\u00a0Salton, ed. Prentice Hall, 1971, pp.\u00a0313\u2013323."},{"key":"ref030","doi-asserted-by":"crossref","unstructured":"A.\u00a0Shtok, O.\u00a0Kurland and D.\u00a0Carmel, Using statistical decision theory and relevance models for query-performance prediction, in: The 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201910), 2010, pp.\u00a0259\u2013266.","DOI":"10.1145\/1835449.1835494"},{"key":"ref031","unstructured":"M.\u00a0Strohmaier, P.\u00a0Prettenhofer and M.\u00a0Lux, Different degrees of explicitness in intentional artifacts \u2013 Studying user goals in a large search query log, in: The Workshop on Commonsense Knowledge and Goal Oriented Interfaces (CSKGOI\u201908), 2008."},{"key":"ref032","doi-asserted-by":"crossref","unstructured":"B.\u00a0Tan and F.\u00a0Peng, Unsupervised query segmentation using generative language models and Wikipedia, in: The 17th International Conference on World Wide Web (WWW\u201908), 2008, pp.\u00a0347\u2013356. doi:10.1145\/1367497.1367545.","DOI":"10.1145\/1367497.1367545"},{"key":"ref033","doi-asserted-by":"crossref","unstructured":"B.\u00a0V\u00e9lez, R.\u00a0Weiss, M.A.\u00a0Sheldon and D.K.\u00a0Gifford, Fast and effective query refinement, in: The 20th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201997), 1997, pp.\u00a06\u201315. doi:10.1145\/258525.258528.","DOI":"10.1145\/258525.258528"},{"key":"ref034","doi-asserted-by":"crossref","unstructured":"V.\u00a0Vinay, I.J.\u00a0Cox, N.\u00a0Milic-Frayling and K.\u00a0Wood, On ranking the effectiveness of searches, in: The 29th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201906), 2006, pp.\u00a0398\u2013404. doi:10.1145\/1148170.1148239.","DOI":"10.1145\/1148170.1148239"},{"key":"ref035","doi-asserted-by":"crossref","unstructured":"E.M.\u00a0Voorhees, Overview of the trec 2004 robust retrieval track, in: The 13th Text REtrieval Conference (TREC\u201904), 2004.","DOI":"10.6028\/NIST.SP.500-261.robust-overview"},{"key":"ref036","doi-asserted-by":"crossref","unstructured":"J.\u00a0Xu and W.B.\u00a0Croft, Query expansion using local and global document analysis, in: The 19th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201996), 1996, pp.\u00a04\u201311. doi:10.1145\/243199.243202.","DOI":"10.1145\/243199.243202"},{"key":"ref037","doi-asserted-by":"crossref","unstructured":"E.\u00a0Yom-Tov, S.\u00a0Fine, D.\u00a0Carmel and A.\u00a0Darlow, Learning to estimate query difficulty: Including applications to missing content detection and distributed information retrieval, in: The 28th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201905), 2005, pp.\u00a0512\u2013519.","DOI":"10.1145\/1076034.1076121"},{"issue":"4","key":"ref038","first-page":"29","volume":"28","author":"Yu X.","year":"2005","journal-title":"IEEE Data Engineering Bulletin"},{"key":"ref039","doi-asserted-by":"crossref","unstructured":"O.\u00a0Zamir and O.\u00a0Etzioni, Web document clustering: A feasibility demonstration, in: The 21st International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201998), 1998, pp.\u00a046\u201354. doi:10.1145\/290941.290956.","DOI":"10.1145\/290941.290956"},{"key":"ref040","doi-asserted-by":"crossref","unstructured":"J.\u00a0Zhang, L.\u00a0Sun, Y.\u00a0Lv and W.\u00a0Zhang, Relevance feedback by exploring the different feedback source and collection structure, in: The 14th Text REtrieval Conference (TREC\u201905), 2005.","DOI":"10.6028\/NIST.SP.500-266.HARD-cas.zhang"},{"key":"ref041","doi-asserted-by":"crossref","unstructured":"Y.\u00a0Zhou and W.B.\u00a0Croft, Ranking robustness: A novel framework to predict query performance, in: The 15th ACM International Conference on Information and Knowledge Management (CIKM\u201906), 2006, pp.\u00a0567\u2013574.","DOI":"10.1145\/1183614.1183696"},{"key":"ref042","doi-asserted-by":"crossref","unstructured":"J.\u00a0Zobel, How reliable are the results of large-scale information retrieval experiments? in: The 21st International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR\u201998), 1998, pp.\u00a0307\u2013314. doi:10.1145\/290941.291014.","DOI":"10.1145\/290941.291014"}],"container-title":["Web Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/WEB-160338","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/WEB-160338","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/WEB-160338","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T05:26:56Z","timestamp":1777613216000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/WEB-160338"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8,4]]},"references-count":42,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,8,4]]}},"alternative-id":["10.3233\/WEB-160338"],"URL":"https:\/\/doi.org\/10.3233\/web-160338","relation":{},"ISSN":["2405-6456","2405-6464"],"issn-type":[{"value":"2405-6456","type":"print"},{"value":"2405-6464","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,8,4]]}}}