{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T06:19:24Z","timestamp":1775283564995,"version":"3.50.1"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2006,7]]},"abstract":"<jats:p>Web-search queries are typically short and ambiguous. To classify these queries into certain target categories is a difficult but important problem. In this article, we present a new technique called query enrichment, which takes a short query and maps it to intermediate objects. Based on the collected intermediate objects, the query is then mapped to target categories. To build the necessary mapping functions, we use an ensemble of search engines to produce an enrichment of the queries. Our technique was applied to the ACM Knowledge Discovery and Data Mining competition (ACM KDDCUP) in 2005, where we won the championship on all three evaluation metrics (precision, F1 measure, which combines precision and recall, and creativity, which is judged by the organizers) among a total of 33 teams worldwide. In this article, we show that, despite the difficulty of an abundance of ambiguous queries and lack of training data, our query-enrichment technique can solve the problem satisfactorily through a two-phase classification framework. We present a detailed description of our algorithm and experimental evaluation. Our best result for F1 and precision is 42.4% and 44.4%, respectively, which is 9.6% and 24.3% higher than those from the runner-ups, respectively.<\/jats:p>","DOI":"10.1145\/1165774.1165776","type":"journal-article","created":{"date-parts":[[2006,10,18]],"date-time":"2006-10-18T18:11:32Z","timestamp":1161195092000},"page":"320-352","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":80,"title":["Query enrichment for web-query classification"],"prefix":"10.1145","volume":"24","author":[{"given":"Dou","family":"Shen","sequence":"first","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rong","family":"Pan","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian-Tao","family":"Sun","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey Junfeng","family":"Pan","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kangheng","family":"Wu","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Yin","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiang","family":"Yang","sequence":"additional","affiliation":[{"name":"Hong Kong University of Science and Technology, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2006,7]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Introduction to Machine Learning","author":"Alpaydin E."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007515423169"},{"key":"e_1_2_1_3_1","volume-title":"KDD '00: Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM Press","author":"Beeferman D."},{"key":"e_1_2_1_4_1","volume-title":"SIGIR '05: Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press","author":"Beitzel S. M."},{"key":"e_1_2_1_5_1","volume-title":"Maths from Scratch for Biologists","author":"Cann A. J."},{"key":"e_1_2_1_6_1","volume-title":"ICML '04: Proceedings of the 21st International Conference on Machine Learning. ACM Press","author":"Caruana R."},{"key":"e_1_2_1_7_1","volume-title":"-C","author":"Chang C.-H.","year":"1998"},{"key":"e_1_2_1_8_1","volume-title":"6th International World Wide Web Conference (WWW6). Poster presentation.]]","author":"Chekuri C."},{"key":"e_1_2_1_9_1","volume-title":"CHI '00: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM Press","author":"Chen H.","year":"2040"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Dietterich T. G. 2000. Ensemble methods in machine learning. In Multiple Classifier Systems. 1--15.]]   Dietterich T. G. 2000. Ensemble methods in machine learning. In Multiple Classifier Systems. 1--15.]]","DOI":"10.1007\/3-540-45014-9_1"},{"key":"e_1_2_1_11_1","volume-title":"KDD '99: Proceedings of the 5th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM Press","author":"Fan W."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.58871"},{"key":"e_1_2_1_13_1","unstructured":"HITEC. http:\/\/categorizer.tmit.bmr.hu.]]  HITEC. http:\/\/categorizer.tmit.bmr.hu.]]"},{"key":"e_1_2_1_14_1","volume-title":"Elementary Statistics","author":"Hoel P. G.","edition":"2"},{"key":"e_1_2_1_15_1","first-page":"19","article-title":"SAVVYSEARCH: A metasearch engine that learns which search engines to query","volume":"18","author":"Howe A. E.","year":"1997","journal-title":"AI Mag."},{"key":"e_1_2_1_16_1","first-page":"1","article-title":"The effect of query complexity on web searching results","volume":"6","author":"Jansen B. J.","year":"2000","journal-title":"Inf. Res."},{"key":"e_1_2_1_17_1","volume-title":"ECML'98 Proceedings of the 10th European Conference on Machine Learning, 137--142","author":"Joachims T.","year":"1998"},{"key":"e_1_2_1_18_1","volume-title":"ICML '99: Proceedings of the 16th International Conference on Machine Learning. Morgan Kaufmann","author":"Joachims T.","year":"1999"},{"key":"e_1_2_1_19_1","volume-title":"Automatic Keyword Classifications for Information Retrieval","author":"Jones K. S."},{"key":"e_1_2_1_20_1","volume-title":"SIGIR '03: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval. ACM Press","author":"Kang I.-H."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1117454.1117468"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.667881"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Lewis D. D. and Gale W. A. 1994. A sequential algorithm for training text classifiers. In SIGIR W. B. Croft and C. J. van Rijsbergen Eds. Springer Verlag Berlin Germany 3--12.]]   Lewis D. D. and Gale W. A. 1994. A sequential algorithm for training text classifiers. In SIGIR W. B. Croft and C. J. van Rijsbergen Eds. Springer Verlag Berlin Germany 3--12.]]","DOI":"10.1007\/978-1-4471-2099-5_1"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1117454.1117466"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the AAAI-98 Workshop on Learning for Text Categorization.]]","author":"McCallum A."},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","first-page":"1718","DOI":"10.1103\/PhysRevLett.81.1718","article-title":"Statistical mechanics of voting","volume":"81","author":"Meyer D. A.","year":"1998","journal-title":"Phys. Revei. Lett."},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1093\/ijl\/3.4.235","article-title":"Introduction to wordnet: An on-line lexical database","volume":"3","author":"Miller G.","year":"1990","journal-title":"Int. J. Lexicography"},{"key":"e_1_2_1_28_1","unstructured":"Page L. Brin S. Motwani R. and Winograd T. 1998. The pagerank citation ranking: Bringing order to the web. Tech. rep. Stanford Digital Library Technologies Project.]]  Page L. Brin S. Motwani R. and Winograd T. 1998. The pagerank citation ranking: Bringing order to the web. Tech. rep. Stanford Digital Library Technologies Project.]]"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the 4th International World-Wide web Conference","author":"Selberg E."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1117454.1117467"},{"key":"e_1_2_1_31_1","volume-title":"SIGIR '06: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.]] 10","author":"Shen D."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/331403.331405"},{"key":"e_1_2_1_33_1","volume-title":"Eds. International Series in Intelligent Technologies","volume":"20","author":"Tikk D."},{"key":"e_1_2_1_34_1","volume-title":"Information Retrieval","author":"Van R. C.","edition":"2"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1117454.1117469"},{"key":"e_1_2_1_36_1","volume-title":"SIGIR '94: Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Springer Verlag","author":"Voorhees E. M.","year":"1994"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/503104.503108"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009982220290"},{"key":"e_1_2_1_39_1","volume-title":"ICML '97: Proceedings of the 14th International Conference on Machine Learning. Morgan Kaufmann","author":"Yang Y."}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1165774.1165776","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T21:06:55Z","timestamp":1672261615000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1165774.1165776"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,7]]},"references-count":39,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2006,7]]}},"alternative-id":["10.1145\/1165774.1165776"],"URL":"https:\/\/doi.org\/10.1145\/1165774.1165776","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,7]]},"assertion":[{"value":"2006-07-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}