{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T07:33:23Z","timestamp":1780472003100,"version":"3.54.1"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2007,4,1]],"date-time":"2007-04-01T00:00:00Z","timestamp":1175385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2007,4]]},"abstract":"<jats:p>This article examines the reliability of implicit feedback generated from clickthrough data and query reformulations in World Wide Web (WWW) search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average. We find that such relative preferences are accurate not only between results from an individual query, but across multiple sets of results within chains of query reformulations.<\/jats:p>","DOI":"10.1145\/1229179.1229181","type":"journal-article","created":{"date-parts":[[2007,6,6]],"date-time":"2007-06-06T14:37:11Z","timestamp":1181140631000},"page":"7","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":442,"title":["Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search"],"prefix":"10.1145","volume":"25","author":[{"given":"Thorsten","family":"Joachims","sequence":"first","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Granka","sequence":"additional","affiliation":[{"name":"Google Inc., Mountain View, CA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bing","family":"Pan","sequence":"additional","affiliation":[{"name":"College of Charleston, Charleston, SC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Helene","family":"Hembrooke","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Filip","family":"Radlinski","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geri","family":"Gay","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2007,4]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 19--26","author":"Agichtein E.","unstructured":"Agichtein , E. , Brill , E. , and Dumais , S . 2006a. Improving Web search ranking by incorporating user behavior . In Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 19--26 . 10.1145\/1148170.1148177 Agichtein, E., Brill, E., and Dumais, S. 2006a. Improving Web search ranking by incorporating user behavior. In Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 19--26. 10.1145\/1148170.1148177"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 3--10","author":"Agichtein E.","unstructured":"Agichtein , E. , Brill , E. , Dumais , S. , and Ragno , R . 2006b. Learning user interaction models for predicting Web search preferences . In Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 3--10 . 10.1145\/1148170.1148175 Agichtein, E., Brill, E., Dumais, S., and Ragno, R. 2006b. Learning user interaction models for predicting Web search preferences. In Proceedings of the Conference on Research and Development in Information Retrieval (SIGIR). 3--10. 10.1145\/1148170.1148175"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the World Wide Web Conference (WWW). 10","author":"Almeida R.","unstructured":"Almeida , R. and Almeida , V . 2004. A community-aware search engine . In Proceedings of the World Wide Web Conference (WWW). 10 .1145\/988672.988728 Almeida, R. and Almeida, V. 2004. A community-aware search engine. In Proceedings of the World Wide Web Conference (WWW). 10.1145\/988672.988728"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 173--181","author":"Bartell B.","unstructured":"Bartell , B. , Cottrell , G. , and Belew , R . 1994. Automatic combination of multiple ranked retrieval systems . In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 173--181 . Bartell, B., Cottrell, G., and Belew, R. 1994. Automatic combination of multiple ranked retrieval systems. In Proceedings of the Annual ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 173--181."},{"key":"e_1_2_1_5_1","volume-title":"Finding Out About","author":"Belew R.","unstructured":"Belew , R. 2000. Finding Out About . Cambridge , University Press , Cambridge, U.K. Belew, R. 2000. Finding Out About. Cambridge, University Press, Cambridge, U.K."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the AAAI Workshop on Internet Based Information Systems. 1--8.","author":"Boyan J.","unstructured":"Boyan , J. , Freitag , D. , and Joachims , T . 1996. A machine learning architecture for optimizing Web search engines . In Proceedings of the AAAI Workshop on Internet Based Information Systems. 1--8. Boyan, J., Freitag, D., and Joachims, T. 1996. A machine learning architecture for optimizing Web search engines. In Proceedings of the AAAI Workshop on Internet Based Information Systems. 1--8."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/792550.792552"},{"key":"e_1_2_1_8_1","unstructured":"Brumby D. and Howes A. 2003. Interdependence and past-experience in menu choice assessment. In Poster presented at the 25th Annual Meeting of the Cognitive Science Society. Brumby D. and Howes A. 2003. Interdependence and past-experience in menu choice assessment. In Poster presented at the 25th Annual Meeting of the Cognitive Science Society."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Conference on Cognitive Modeling.","author":"Brumby D.","unstructured":"Brumby , D. and Howes , A . 2004. Good enough but I'll just check: Web-page search as attentional refocusing . In Proceedings of the International Conference on Cognitive Modeling. Brumby, D. and Howes, A. 2004. Good enough but I'll just check: Web-page search as attentional refocusing. In Proceedings of the International Conference on Cognitive Modeling."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML","author":"Burges C.","unstructured":"Burges , C. , Renshaw , S. , Renshaw , E. , Ari , L. , Deeds , M. , Hamilton , N. , and Hullender , G . 2005. Learning to rank using gradient descent . In Proceedings of the International Conference on Machine Learning (ICML , Bonn, Germany). 10.1145\/1102351.1102363 Burges, C., Renshaw, S., Renshaw, E., Ari, L., Deeds, M., Hamilton, N., and Hullender, G. 2005. Learning to rank using gradient descent. In Proceedings of the International Conference on Machine Learning (ICML, Bonn, Germany). 10.1145\/1102351.1102363"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the International Conference on Intelligent User Interfaces (IUI). 33--40","author":"Claypool M.","unstructured":"Claypool , M. , Le , P. , Waseda , M. , and Brown , D . 2001. Implicit interest indicators . In Proceedings of the International Conference on Intelligent User Interfaces (IUI). 33--40 . 10.1145\/359784.359836 Claypool, M., Le, P., Waseda, M., and Brown, D. 2001. Implicit interest indicators. In Proceedings of the International Conference on Intelligent User Interfaces (IUI). 33--40. 10.1145\/359784.359836"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1613\/jair.587","article-title":"Learning to order things","volume":"10","author":"Cohen W.","year":"1999","unstructured":"Cohen , W. , Shapire , R. , and Singer , Y. 1999 . Learning to order things . J. Artific. Intell. Res. 10 , 243 -- 270 . Cohen, W., Shapire, R., and Singer, Y. 1999. Learning to order things. J. Artific. Intell. Res. 10, 243--270.","journal-title":"J. Artific. Intell. Res."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS).","author":"Crammer K.","unstructured":"Crammer , K. and Singer , Y . 2001. Pranking with ranking . In Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS). Crammer, K. and Singer, Y. 2001. Pranking with ranking. In Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1059981.1059982"},{"key":"e_1_2_1_15_1","volume-title":"International Conference on Machine Learning (ICML). Morgan Kaufmann San Francisco, CA, 170--178","author":"Freund Y.","unstructured":"Freund , Y. , Iyer , R. , Schapire , R. , and Singer , Y . 1998. An efficient boosting algorithm for combining preferences . In International Conference on Machine Learning (ICML). Morgan Kaufmann San Francisco, CA, 170--178 . Freund, Y., Iyer, R., Schapire, R., and Singer, Y. 1998. An efficient boosting algorithm for combining preferences. In International Conference on Machine Learning (ICML). Morgan Kaufmann San Francisco, CA, 170--178."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/65943.65944"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press","author":"Furnas G.","year":"1985","unstructured":"Furnas , G. 1985 . Experience with an adaptive indexing scheme . In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press , New York, NY, 131--135. 10.1145\/317456.317480 Furnas, G. 1985. Experience with an adaptive indexing scheme. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI). ACM Press, New York, NY, 131--135. 10.1145\/317456.317480"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the Eye tracking Research and Applications Symposium (ETRA). 51--58","author":"Goldberg J.","unstructured":"Goldberg , J. , Stimson , M. , Lewenstein , M. , Scott , M. , and Wichansky , A . 2002. Eye-tracking in Web search tasks: design implications . In Proceedings of the Eye tracking Research and Applications Symposium (ETRA). 51--58 . 10.1145\/507072.507082 Goldberg, J., Stimson, M., Lewenstein, M., Scott, M., and Wichansky, A. 2002. Eye-tracking in Web search tasks: design implications. In Proceedings of the Eye tracking Research and Applications Symposium (ETRA). 51--58. 10.1145\/507072.507082"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 10","author":"Granka L.","unstructured":"Granka , L. , Joachims , T. , and Gay , G . 2004. Eye-tracking analysis of user behavior in www search . In Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 10 .1145\/1008992.1009079 Granka, L., Joachims, T., and Gay, G. 2004. Eye-tracking analysis of user behavior in www search. In Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 10.1145\/1008992.1009079"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the ACM Conference on Computer-Human Interaction (CHI). 10","author":"Halverson T.","unstructured":"Halverson , T. and Hornof , A . 2004. Link colors guide a search . In Proceedings of the ACM Conference on Computer-Human Interaction (CHI). 10 .1145\/985921.986066 Halverson, T. and Hornof, A. 2004. Link colors guide a search. In Proceedings of the ACM Conference on Computer-Human Interaction (CHI). 10.1145\/985921.986066"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Herbrich R. Graepel T. and Obermayer K. 2000. Large margin rank boundaries for ordinal regression. In Advances in Large Margin Classifiers. MIT Press Cambridge MA 115--132. Herbrich R. Graepel T. and Obermayer K. 2000. Large margin rank boundaries for ordinal regression. In Advances in Large Margin Classifiers. MIT Press Cambridge MA 115--132.","DOI":"10.7551\/mitpress\/1113.003.0010"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). 204--216","author":"Holland S.","unstructured":"Holland , S. , Ester , M. , and Kieling , W . 2003. Preference mining: A novel approach on mining user preferences for personalized applications . In Proceedings of the Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). 204--216 . Holland, S., Ester, M., and Kieling, W. 2003. Preference mining: A novel approach on mining user preferences for personalized applications. In Proceedings of the Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). 204--216."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1086\/209263","article-title":"Ignoring irrelevant information: Situational determinats of consumer learning","volume":"18","author":"Hutchinson W.","year":"1991","unstructured":"Hutchinson , W. and Alba , J. 1991 . Ignoring irrelevant information: Situational determinats of consumer learning . J. Consum. Res. 18 , 325 -- 345 . Hutchinson, W. and Alba, J. 1991. Ignoring irrelevant information: Situational determinats of consumer learning. J. Consum. Res. 18, 325--345.","journal-title":"J. Consum. Res."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(99)00056-4"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD). 10","author":"Joachims T.","year":"2002","unstructured":"Joachims , T. 2002 . Optimizing search engines using clickthrough data . In Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD). 10 .1145\/775047.775067 Joachims, T. 2002. Optimizing search engines using clickthrough data. In Proceedings of the ACM Conference on Knowledge Discovery and Data Mining (KDD). 10.1145\/775047.775067"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI).","volume":"1","author":"Joachims T.","unstructured":"Joachims , T. , Freitag , D. , and Mitchell , T . 1997. WebWatcher: A tour guide for the World Wide Web . In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). Vol. 1 . Morgan Kaufmann, San Francisco, CA, 770--777. Joachims, T., Freitag, D., and Mitchell, T. 1997. WebWatcher: A tour guide for the World Wide Web. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). Vol. 1. Morgan Kaufmann, San Francisco, CA, 770--777."},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 154--161","author":"Joachims T.","unstructured":"Joachims , T. , Granka , L. , Pang , B. , Hembrooke , H. , and Gay , G . 2005. Accurately interpreting clickthrough data as implicit feedback . In Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 154--161 . 10.1145\/1076034.1076063 Joachims, T., Granka, L., Pang, B., Hembrooke, H., and Gay, G. 2005. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 154--161. 10.1145\/1076034.1076063"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press","author":"Jones R.","unstructured":"Jones , R. and Fain , D . 2003. Query word deletion prediction . In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press , New York, NY, 435--436. 10.1145\/860435.860538 Jones, R. and Fain, D. 2003. Query word deletion prediction. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press, New York, NY, 435--436. 10.1145\/860435.860538"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1037\/0033-295X.87.4.329","article-title":"A theory of reading: From eye fixations to comprehension","volume":"87","author":"Just M.","year":"1980","unstructured":"Just , M. and Carpenter , P. 1980 . A theory of reading: From eye fixations to comprehension . Psycholog. Rev. 87 , 329 -- 354 . Just, M. and Carpenter, P. 1980. A theory of reading: From eye fixations to comprehension. Psycholog. Rev. 87, 329--354.","journal-title":"Psycholog. Rev."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the ACM International Conference on Research and Development in Information Retrieval (SIGIR). 377--384","author":"Kelly D.","unstructured":"Kelly , D. and Belkin , N . 2004. Display time as implicit feedback: Understanding task effects . In Proceedings of the ACM International Conference on Research and Development in Information Retrieval (SIGIR). 377--384 . 10.1145\/1008992.1009057 Kelly, D. and Belkin, N. 2004. Display time as implicit feedback: Understanding task effects. In Proceedings of the ACM International Conference on Research and Development in Information Retrieval (SIGIR). 377--384. 10.1145\/1008992.1009057"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/959258.959260"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). 263--274","author":"Kemp D.","unstructured":"Kemp , D. and Ramamohanarao , K . 2002. Long-term learning for Web search engines . In Proceedings of the European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). 263--274 . Kemp, D. and Ramamohanarao, K. 2002. Long-term learning for Web search engines. In Proceedings of the European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD). 263--274."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the ACM Conference on Computer-Human Interaction. (Extended abstract.) 10","author":"Kl\u00f6ckner K.","unstructured":"Kl\u00f6ckner , K. , Wirschum , N. , and Jameson , A . 2004. Depth- and breadth-first processing of search result lists . In Proceedings of the ACM Conference on Computer-Human Interaction. (Extended abstract.) 10 .1145\/985921.986115 Kl\u00f6ckner, K., Wirschum, N., and Jameson, A. 2004. Depth- and breadth-first processing of search result lists. In Proceedings of the ACM Conference on Computer-Human Interaction. (Extended abstract.) 10.1145\/985921.986115"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the Conference on Eye Tracking Research & Applications. 51--55","author":"Lankford C.","year":"2000","unstructured":"Lankford , C. 2000 . Gazetracker: Software designed to facilitate eye movement analysis . In Proceedings of the Conference on Eye Tracking Research & Applications. 51--55 . 10.1145\/355017.355025 Lankford, C. 2000. Gazetracker: Software designed to facilitate eye movement analysis. In Proceedings of the Conference on Eye Tracking Research & Applications. 51--55. 10.1145\/355017.355025"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (IJCAI '95)","author":"Lieberman H.","year":"1995","unstructured":"Lieberman , H. 1995 . Letizia: An agent that assists Web browsing . In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (IJCAI '95) . Morgan Kaufmann, San Francisco, CA, 924--929. Lieberman, H. 1995. Letizia: An agent that assists Web browsing. In Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence (IJCAI '95). Morgan Kaufmann, San Francisco, CA, 924--929."},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1086\/209543","article-title":"The role of direction of comparison, attribute-based processing, and attitude-based processing in consumer preference","volume":"25","author":"Mantell S.","year":"1999","unstructured":"Mantell , S. and Kardes , F. 1999 . The role of direction of comparison, attribute-based processing, and attitude-based processing in consumer preference . J. Consum. Res. 25 , 335 -- 352 . Mantell, S. and Kardes, F. 1999. The role of direction of comparison, attribute-based processing, and attitude-based processing in consumer preference. J. Consum. Res. 25, 335--352.","journal-title":"J. Consum. Res."},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 272--281","author":"Morita M.","unstructured":"Morita , M. and Shinoda , Y . 1994. Information filtering based on user behavior analysis and best match text retrieval . In Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 272--281 . Morita, M. and Shinoda, Y. 1994. Information filtering based on user behavior analysis and best match text retrieval. In Proceedings of the ACM Conference on Research and Development in Information Retrieval (SIGIR). 272--281."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the AAAI Workshop on Recommender Systems. 81--83","author":"Oard D.","unstructured":"Oard , D. and Kim , J . 1998. Implicit feedback for recommender systems . In Proceedings of the AAAI Workshop on Recommender Systems. 81--83 . Oard, D. and Kim, J. 1998. Implicit feedback for recommender systems. In Proceedings of the AAAI Workshop on Recommender Systems. 81--83."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the Conference on Eye Tracking Research & Applications, S. Spencer, Ed. ACM Press","author":"Pan B.","unstructured":"Pan , B. , Hembrooke , H. , Gay , G. , Granka , L. , Feusner , M. , and Newman , J . 2004. The determinants of Web page viewing behavior: An eye tracking study . In Proceedings of the Conference on Eye Tracking Research & Applications, S. Spencer, Ed. ACM Press , New York, NY. 10.1145\/968363.968391 Pan, B., Hembrooke, H., Gay, G., Granka, L., Feusner, M., and Newman, J. 2004. The determinants of Web page viewing behavior: An eye tracking study. In Proceedings of the Conference on Eye Tracking Research & Applications, S. Spencer, Ed. ACM Press, New York, NY. 10.1145\/968363.968391"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the ACM SIGKDD International Conference On Knowledge Discovery and Data Mining (KDD). 10","author":"Radlinski F.","year":"1870","unstructured":"Radlinski , F. and Joachims , T . 2005. Query chains: Learning to rank from implicit feedback . In Proceedings of the ACM SIGKDD International Conference On Knowledge Discovery and Data Mining (KDD). 10 .1145\/108 1870 .1081899 Radlinski, F. and Joachims, T. 2005. Query chains: Learning to rank from implicit feedback. In Proceedings of the ACM SIGKDD International Conference On Knowledge Discovery and Data Mining (KDD). 10.1145\/1081870.1081899"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1037\/0033-2909.124.3.372","article-title":"Eye movements in reading and information processing","volume":"124","author":"Rayner K.","year":"1998","unstructured":"Rayner , K. 1998 . Eye movements in reading and information processing . Psycholog. Bull. 124 , 372 -- 252 . Rayner, K. 1998. Eye movements in reading and information processing. Psycholog. Bull. 124, 372--252.","journal-title":"Psycholog. Bull."},{"key":"e_1_2_1_42_1","unstructured":"Salogarvi J. Kojo I. Jaana S. and Kaski S. 2003. Can relevance be inferred from eye movements in information retrieval&quest; In Proceedings of the Workshop on Self-Organizing Maps. 261--266. Salogarvi J. Kojo I. Jaana S. and Kaski S. 2003. Can relevance be inferred from eye movements in information retrieval&quest; In Proceedings of the Workshop on Self-Organizing Maps. 261--266."},{"key":"e_1_2_1_43_1","first-page":"243","article-title":"Consumption theory in terms of revealed preferences","volume":"15","author":"Samuelson P.","year":"1948","unstructured":"Samuelson , P. 1948 . Consumption theory in terms of revealed preferences . Econometrica 15 , 243 -- 253 . Samuelson, P. 1948. Consumption theory in terms of revealed preferences. Econometrica 15, 243--253.","journal-title":"Econometrica"},{"key":"e_1_2_1_44_1","volume-title":"Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press","author":"Shen X.","unstructured":"Shen , X. , Tan , B. , and Zhai , C . 2005. Context-sensitive information retrieval using implicit feedback . In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press , New York, NY, 43--50. 10.1145\/1076034.1076045 Shen, X., Tan, B., and Zhai, C. 2005. Context-sensitive information retrieval using implicit feedback. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press, New York, NY, 43--50. 10.1145\/1076034.1076045"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/331403.331405"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the Workshop on New Technologies for Personalized Information Access (PIA). 84--92","author":"Teevan J.","unstructured":"Teevan , J. , Dumais , S. , and Horvitz , E . 2005. Beyond the commons: Investigating the value of personalizing Web search . In Proceedings of the Workshop on New Technologies for Personalized Information Access (PIA). 84--92 . Teevan, J., Dumais, S., and Horvitz, E. 2005. Beyond the commons: Investigating the value of personalizing Web search. In Proceedings of the Workshop on New Technologies for Personalized Information Access (PIA). 84--92."},{"key":"e_1_2_1_47_1","volume-title":"Microeconomic Analysis","author":"Varian H.","unstructured":"Varian , H. 1992. Microeconomic Analysis . Noron, New York, NY. Varian, H. 1992. Microeconomic Analysis. Noron, New York, NY."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 24th BCS-IRSG European Colloquium on IR Research. Springer-Verlag","author":"White R.","unstructured":"White , R. , Ruthven , I. , and Jose , J . 2002. The use of implicit evidence for relevance feedback in Web retrieval . In Proceedings of the 24th BCS-IRSG European Colloquium on IR Research. Springer-Verlag , London, U.K., 93--109. White, R., Ruthven, I., and Jose, J. 2002. The use of implicit evidence for relevance feedback in Web retrieval. In Proceedings of the 24th BCS-IRSG European Colloquium on IR Research. Springer-Verlag, London, U.K., 93--109."},{"key":"e_1_2_1_49_1","volume-title":"Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press","author":"White R.","unstructured":"White , R. , Ruthven , I. , and Jose , J . 2005. A study of factors affecting the utility of implicit relevance feedback . In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press , New York, NY, 35--42. 10.1145\/1076034.1076044 White, R., Ruthven, I., and Jose, J. 2005. A study of factors affecting the utility of implicit relevance feedback. In Proceedings of the ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). ACM Press, New York, NY, 35--42. 10.1145\/1076034.1076044"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1229179.1229181","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1229179.1229181","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T14:51:36Z","timestamp":1750258296000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1229179.1229181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,4]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2007,4]]}},"alternative-id":["10.1145\/1229179.1229181"],"URL":"https:\/\/doi.org\/10.1145\/1229179.1229181","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,4]]},"assertion":[{"value":"2007-04-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}