{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T14:55:40Z","timestamp":1761058540759,"version":"3.41.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2006,5,1]],"date-time":"2006-05-01T00:00:00Z","timestamp":1146441600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Internet Technol."],"published-print":{"date-parts":[[2006,5]]},"abstract":"<jats:p>This article describes the CLEVER search system developed at the IBM Almaden Research Center. We present a detailed and unified exposition of the various algorithmic components that make up the system, and then present results from two user studies.<\/jats:p>","DOI":"10.1145\/1149121.1149123","type":"journal-article","created":{"date-parts":[[2006,10,18]],"date-time":"2006-10-18T18:11:32Z","timestamp":1161195092000},"page":"131-152","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Core algorithms in the CLEVER system"],"prefix":"10.1145","volume":"6","author":[{"given":"Ravi","family":"Kumar","sequence":"first","affiliation":[{"name":"Yahoo! Research, Sunnyvale, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Prabhakar","family":"Raghavan","sequence":"additional","affiliation":[{"name":"Yahoo! Research, Sunnyvale, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sridhar","family":"Rajagopalan","sequence":"additional","affiliation":[{"name":"IBM Almaden Research Center, San Jose, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Tomkins","sequence":"additional","affiliation":[{"name":"Yahoo! Research, Sunnyvale, CA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2006,5]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 42nd IEEE Annual Symposium on Foundations of Computer Science. IEEE Computer Society Press","author":"Achlioptas D.","year":"2001","unstructured":"Achlioptas , D. , Fiat , A. , Karlin , A. , and McSherry , F. 2001 . Web search via hub synthesis . In Proceedings of the 42nd IEEE Annual Symposium on Foundations of Computer Science. IEEE Computer Society Press , Los Alamitos, CA, 500--509. Achlioptas, D., Fiat, A., Karlin, A., and McSherry, F. 2001. Web search via hub synthesis. In Proceedings of the 42nd IEEE Annual Symposium on Foundations of Computer Science. IEEE Computer Society Press, Los Alamitos, CA, 500--509."},{"volume-title":"Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press","author":"Bharat K.","key":"e_1_2_1_2_1","unstructured":"Bharat , K. and Henzinger , M . 1998. Improved algorithms for topic distillation in a hyperlinked environment . In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press , New York, NY, 104--111. 10.1145\/290941.290972 Bharat, K. and Henzinger, M. 1998. Improved algorithms for topic distillation in a hyperlinked environment. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 104--111. 10.1145\/290941.290972"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1052934.1052942"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 10th International Conference on World Wide Web. ACM Press","author":"Borodin A.","year":"1920","unstructured":"Borodin , A. , Roberts , G. O. , Rosenthal , J. S. , and Tsaparas , P . 2001. Finding authorities and hubs from link structures on the World Wide Web . In Proceedings of the 10th International Conference on World Wide Web. ACM Press , New York, NY, 415--429. 10.1145\/37 1920 .372096 Borodin, A., Roberts, G. O., Rosenthal, J. S., and Tsaparas, P. 2001. Finding authorities and hubs from link structures on the World Wide Web. In Proceedings of the 10th International Conference on World Wide Web. ACM Press, New York, NY, 415--429. 10.1145\/371920.372096"},{"key":"e_1_2_1_5_1","first-page":"1","article-title":"The anatomy of a large-scale hypertextual Web search engine. WWW7\/Comput","volume":"30","author":"Brin S.","year":"1998","unstructured":"Brin , S. and Page , L. 1998 . The anatomy of a large-scale hypertextual Web search engine. WWW7\/Comput . Netw. 30 , 1 -- 7 , 107--117. Brin, S. and Page, L. 1998. The anatomy of a large-scale hypertextual Web search engine. WWW7\/Comput. Netw. 30, 1--7, 107--117.","journal-title":"Netw."},{"key":"e_1_2_1_6_1","first-page":"8","article-title":"Syntactic clustering of the Web. WWW6\/Comput","volume":"29","author":"Broder A.","year":"1997","unstructured":"Broder , A. , Glassman , S. C. , Manasse , M. S. , and Zweig , G. 1997 . Syntactic clustering of the Web. WWW6\/Comput . Netw. 29 , 8 -- 13 , 1157--1166. Broder, A., Glassman, S. C., Manasse, M. S., and Zweig, G. 1997. Syntactic clustering of the Web. WWW6\/Comput. Netw. 29, 8--13, 1157--1166.","journal-title":"Netw."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 10th International World Wide Web Conference. ACM Press","author":"Chakrabarti S.","year":"2001","unstructured":"Chakrabarti , S. 2001 . Integrating the document object model with hyperlinks for enhanced topic distillation and information extraction . In Proceedings of the 10th International World Wide Web Conference. ACM Press , New York, NY, 211--220. 10.1145\/37 1920.372054 Chakrabarti, S. 2001. Integrating the document object model with hyperlinks for enhanced topic distillation and information extraction. In Proceedings of the 10th International World Wide Web Conference. ACM Press, New York, NY, 211--220. 10.1145\/371920.372054"},{"key":"e_1_2_1_8_1","first-page":"1","article-title":"Automatic resource compilation by analyzing hyperlink structure and associated text. WWW7\/Comput","volume":"30","author":"Chakrabarti S.","year":"1998","unstructured":"Chakrabarti , S. , Dom , B. , Gibson , D. , Kleinberg , J. , Raghavan , P. , and Rajagopalan , S. 1998 a. Automatic resource compilation by analyzing hyperlink structure and associated text. WWW7\/Comput . Netw. 30 , 1 -- 7 , 65--74. Chakrabarti, S., Dom, B., Gibson, D., Kleinberg, J., Raghavan, P., and Rajagopalan, S. 1998a. Automatic resource compilation by analyzing hyperlink structure and associated text. WWW7\/Comput. Netw. 30, 1--7, 65--74.","journal-title":"Netw."},{"volume-title":"Proceedings of the ACM SIGIR Workshop on Hypertext Analysis. ACM Press","author":"Chakrabarti S.","key":"e_1_2_1_9_1","unstructured":"Chakrabarti , S. , Dom , B. , Gibson , D. , Kumar , R. , Raghavan , P. , Rajagopalan , S. , and Tomkins , A . 1998b. Spectral filtering for resource discovery . In Proceedings of the ACM SIGIR Workshop on Hypertext Analysis. ACM Press , New York, NY, 13--21. Chakrabarti, S., Dom, B., Gibson, D., Kumar, R., Raghavan, P., Rajagopalan, S., and Tomkins, A. 1998b. Spectral filtering for resource discovery. In Proceedings of the ACM SIGIR Workshop on Hypertext Analysis. ACM Press, New York, NY, 13--21."},{"volume-title":"Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann","author":"Cohn D.","key":"e_1_2_1_10_1","unstructured":"Cohn , D. and Chang , H . 2000. Learning to probabilistically identify authoritative documents . In Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann , San Francisco, CA, 167--174. Cohn, D. and Chang, H. 2000. Learning to probabilistically identify authoritative documents. In Proceedings of the 17th International Conference on Machine Learning. Morgan Kaufmann, San Francisco, CA, 167--174."},{"key":"e_1_2_1_11_1","first-page":"11","article-title":"Finding related pages in the World Wide Web. WWW8\/Comput","volume":"31","author":"Dean J.","year":"1999","unstructured":"Dean , J. and Henzinger , M. 1999 . Finding related pages in the World Wide Web. WWW8\/Comput . Netw. 31 , 11 -- 16 , 1467--1479. Dean, J. and Henzinger, M. 1999. Finding related pages in the World Wide Web. WWW8\/Comput. Netw. 31, 11--16, 1467--1479.","journal-title":"Netw."},{"volume-title":"Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press","author":"Ding C.","key":"e_1_2_1_12_1","unstructured":"Ding , C. , He , X. , Husbands , P. , Zha , H. , and Simon , H . 2002. Pagerank, hits, and a unified framework for link analysis . In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press , New York, NY, 354--354. 10.1145\/564376.564440 Ding, C., He, X., Husbands, P., Zha, H., and Simon, H. 2002. Pagerank, hits, and a unified framework for link analysis. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 354--354. 10.1145\/564376.564440"},{"volume-title":"Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press","author":"Farahat A.","key":"e_1_2_1_13_1","unstructured":"Farahat , A. , Lofaro , T. , Miller , J. , Rae , G. , Schaefer , F. , and Ward , L . 2001. Modification of Kleinberg's HITS algorithm using matrix exponentiation and Web log records . In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press , New York, NY, 444--445. 10.1145\/383952.384086 Farahat, A., Lofaro, T., Miller, J., Rae, G., Schaefer, F., and Ward, L. 2001. Modification of Kleinberg's HITS algorithm using matrix exponentiation and Web log records. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 444--445. 10.1145\/383952.384086"},{"volume-title":"An Introduction to Probability Theory and its Applications","author":"Feller W.","key":"e_1_2_1_14_1","unstructured":"Feller , W. 1968. An Introduction to Probability Theory and its Applications , I & II. John Wiley , New York, NY . Feller, W. 1968. An Introduction to Probability Theory and its Applications, I & II. John Wiley, New York, NY."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s007780050005"},{"key":"e_1_2_1_16_1","unstructured":"Golub G. and Loan C. V. 1989. Matrix Computations. Johns Hopkins University Press Baltimore MD.  Golub G. and Loan C. V. 1989. Matrix Computations. Johns Hopkins University Press Baltimore MD."},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 11th International World Wide Web Conference. ACM Press","author":"Haveliwala T.","year":"2002","unstructured":"Haveliwala , T. 2002 . Topic sensitive page rank . In Proceedings of the 11th International World Wide Web Conference. ACM Press , New York, NY, 517--526. 10.1145\/511446.511513 Haveliwala, T. 2002. Topic sensitive page rank. In Proceedings of the 11th International World Wide Web Conference. ACM Press, New York, NY, 517--526. 10.1145\/511446.511513"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press","author":"Hofmann T.","year":"2000","unstructured":"Hofmann , T. 2000 . Learning probabilistic models of the web . In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press , New York, NY, 369--371. 10.1145\/345508.345660 Hofmann, T. 2000. Learning probabilistic models of the web. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 369--371. 10.1145\/345508.345660"},{"volume-title":"Proceedings of the 12th International Conference on World Wide Web. ACM Press","author":"Jeh G.","key":"e_1_2_1_19_1","unstructured":"Jeh , G. and Widom , J . 2003. Scaling personalized Web search . In Proceedings of the 12th International Conference on World Wide Web. ACM Press , New York, NY, 271--279. 10.1145\/775152.775191 Jeh, G. and Widom, J. 2003. Scaling personalized Web search. In Proceedings of the 12th International Conference on World Wide Web. ACM Press, New York, NY, 271--279. 10.1145\/775152.775191"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/324133.324140"},{"volume-title":"Proceedings of the 18th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems. ACM Press","author":"Kleinberg J. M.","key":"e_1_2_1_21_1","unstructured":"Kleinberg , J. M. and Tomkins , A . 1999. Applications of linear algebra in information retrieval and hypertext analysis . In Proceedings of the 18th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems. ACM Press , New York, NY, 185--193. 10.1145\/303976.303995 Kleinberg, J. M. and Tomkins, A. 1999. Applications of linear algebra in information retrieval and hypertext analysis. In Proceedings of the 18th ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems. ACM Press, New York, NY, 185--193. 10.1145\/303976.303995"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(99)00040-7"},{"volume-title":"Proceedings of the 4th ACM WebDB. ACM Press","author":"Kumar R.","key":"e_1_2_1_23_1","unstructured":"Kumar , R. , Raghavan , P. , Rajagopalan , S. , and Tomkins , A . 2001. On semi-automated Web taxonomy construction . In Proceedings of the 4th ACM WebDB. ACM Press , New York, NY, 91--96. Kumar, R., Raghavan, P., Rajagopalan, S., and Tomkins, A. 2001. On semi-automated Web taxonomy construction. In Proceedings of the 4th ACM WebDB. ACM Press, New York, NY, 91--96."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0036144503424786"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(00)00034-7"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/382979.383041"},{"volume-title":"Proceedings of the 11th International World Wide Web Conference. ACM Press","author":"Li L.","key":"e_1_2_1_27_1","unstructured":"Li , L. , Shang , Y. , and Zhang , W . 2002. Improvement of HITS -based algorithms on Web documents . In Proceedings of the 11th International World Wide Web Conference. ACM Press , New York, NY, 527--535. 10.1145\/511446.511514 Li, L., Shang, Y., and Zhang, W. 2002. Improvement of HITS -based algorithms on Web documents. In Proceedings of the 11th International World Wide Web Conference. ACM Press, New York, NY, 527--535. 10.1145\/511446.511514"},{"volume-title":"Proceedings of the 12th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press","author":"Maarek Y.","key":"e_1_2_1_28_1","unstructured":"Maarek , Y. and Smadja , F . 1989. Full text indexing based on lexical relations . In Proceedings of the 12th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press , New York, NY, 198--206. 10.1145\/75334.75355 Maarek, Y. and Smadja, F. 1989. Full text indexing based on lexical relations. In Proceedings of the 12th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 198--206. 10.1145\/75334.75355"},{"volume-title":"Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press","author":"Ng A.","key":"e_1_2_1_29_1","unstructured":"Ng , A. , Zheng , A. , and Jordan , M . 2001. Stable algorithms for link analysis . In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press , New York, NY, 258--266. 10.1145\/383952.384003 Ng, A., Zheng, A., and Jordan, M. 2001. Stable algorithms for link analysis. In Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York, NY, 258--266. 10.1145\/383952.384003"},{"key":"e_1_2_1_30_1","unstructured":"Page L. Brin S. Motwani R. and Winograd T. 1998. The pagerank citation ranking: Bringing order to the Web. Tech. rep. Stanford University Stanford CA.  Page L. Brin S. Motwani R. and Winograd T. 1998. The pagerank citation ranking: Bringing order to the Web. Tech. rep. Stanford University Stanford CA."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1389-1286(00)00078-5"},{"volume-title":"Proceedings of the 2nd International Conference on Web Information Systems Engineering (WISE '01","author":"Reddy P.","key":"e_1_2_1_32_1","unstructured":"Reddy , P. and Kitsuregawa , M . 2001. An approach to relate the web communities through bipartite graphs . In Proceedings of the 2nd International Conference on Web Information Systems Engineering (WISE '01 , Kyoto, Japan, Dec.3--6). Reddy, P. and Kitsuregawa, M. 2001. An approach to relate the web communities through bipartite graphs. In Proceedings of the 2nd International Conference on Web Information Systems Engineering (WISE '01, Kyoto, Japan, Dec.3--6)."},{"key":"e_1_2_1_33_1","unstructured":"Richardson M. and Domingos P. 2002. The intelligent surfer: Probabilistic combination of link and content information in pagerank. In Advances in Neural Information Processing Systems (NIPS). Morgan Kaufmann San Francisco CA 1441--1448.  Richardson M. and Domingos P. 2002. The intelligent surfer: Probabilistic combination of link and content information in pagerank. In Advances in Neural Information Processing Systems (NIPS). Morgan Kaufmann San Francisco CA 1441--1448."},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1002\/(SICI)1097-4571(199006)41:4<288::AID-ASI8>3.0.CO;2-H","article-title":"Improving retrieval performance for relevance feedback","volume":"41","author":"Salton G.","year":"1990","unstructured":"Salton , G. and Buckley , C. 1990 . Improving retrieval performance for relevance feedback . J. Amer. Soc. Informat. Sci. 41 , 4, 288 -- 297 . Salton, G. and Buckley, C. 1990. Improving retrieval performance for relevance feedback. J. Amer. Soc. Informat. Sci. 41, 4, 288--297.","journal-title":"J. Amer. Soc. Informat. Sci."},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 12th International Conference on World Wide Web. ACM Press","author":"Tomlin J. A.","year":"2003","unstructured":"Tomlin , J. A. 2003 . A new paradigm for ranking pages on the World Wide Web . In Proceedings of the 12th International Conference on World Wide Web. ACM Press , New York, NY, 350--355. 10.1145\/775152.775202 Tomlin, J. A. 2003. A new paradigm for ranking pages on the World Wide Web. In Proceedings of the 12th International Conference on World Wide Web. ACM Press, New York, NY, 350--355. 10.1145\/775152.775202"},{"volume-title":"Proceedings of the 10th International World Wide Web Conference. Poster.","author":"Toyoda M.","key":"e_1_2_1_36_1","unstructured":"Toyoda , M. and Kitsuregawa , M . 2001. A Web community chart for navigating related communities . In Proceedings of the 10th International World Wide Web Conference. Poster. Toyoda, M. and Kitsuregawa, M. 2001. A Web community chart for navigating related communities. In Proceedings of the 10th International World Wide Web Conference. Poster."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the 23rd ACM Symposium on Principles of Database Systems. ACM Press","author":"Tsaparas P.","year":"2004","unstructured":"Tsaparas , P. 2004 . Using non-linear dynamical systems for Web searching and ranking . In Proceedings of the 23rd ACM Symposium on Principles of Database Systems. ACM Press , New York, NY, 59--70. 10.1145\/1055558.1055569 Tsaparas, P. 2004. Using non-linear dynamical systems for Web searching and ranking. In Proceedings of the 23rd ACM Symposium on Principles of Database Systems. ACM Press, New York, NY, 59--70. 10.1145\/1055558.1055569"}],"container-title":["ACM Transactions on Internet Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1149121.1149123","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1149121.1149123","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:31:13Z","timestamp":1750264273000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1149121.1149123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,5]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2006,5]]}},"alternative-id":["10.1145\/1149121.1149123"],"URL":"https:\/\/doi.org\/10.1145\/1149121.1149123","relation":{},"ISSN":["1533-5399","1557-6051"],"issn-type":[{"type":"print","value":"1533-5399"},{"type":"electronic","value":"1557-6051"}],"subject":[],"published":{"date-parts":[[2006,5]]},"assertion":[{"value":"2006-05-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}