{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T23:36:00Z","timestamp":1780702560883,"version":"3.54.1"},"reference-count":25,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2017,8,2]],"date-time":"2017-08-02T00:00:00Z","timestamp":1501632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2017,8,2]]},"abstract":"<jats:p>This paper examines the reliability of implicit feedback generated from clickthrough data in WWW search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average.<\/jats:p>","DOI":"10.1145\/3130332.3130334","type":"journal-article","created":{"date-parts":[[2017,8,2]],"date-time":"2017-08-02T19:36:12Z","timestamp":1501702572000},"page":"4-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":184,"title":["Accurately Interpreting Clickthrough Data as Implicit Feedback"],"prefix":"10.1145","volume":"51","author":[{"given":"Thorsten","family":"Joachims","sequence":"first","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Granka","sequence":"additional","affiliation":[{"name":"Stanford University, Palo Alto, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bing","family":"Pan","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Helene","family":"Hembrooke","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geri","family":"Gay","sequence":"additional","affiliation":[{"name":"Cornell University, Ithaca, NY, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,8,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988728"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2099-5_18"},{"key":"e_1_2_1_3_1","volume-title":"Finding Out About","author":"Belew R.","year":"2000","unstructured":"R. Belew . Finding Out About . Cambridge , 2000 . R. Belew. Finding Out About. Cambridge, 2000."},{"key":"e_1_2_1_4_1","first-page":"1","volume-title":"AAAI Workshop on Internet Based Information Systems","author":"Boyan J.","year":"1996","unstructured":"J. Boyan , D. Freitag , and T. Joachims . A machine learning architecture for optimizing web search engines . In AAAI Workshop on Internet Based Information Systems , pages 1 -- 8 , August 1996 . J. Boyan, D. Freitag, and T. Joachims. A machine learning architecture for optimizing web search engines. In AAAI Workshop on Internet Based Information Systems, pages 1--8, August 1996."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/792550.792552"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/359784.359836"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622859.1622867"},{"key":"e_1_2_1_8_1","volume-title":"Talk presented at SIGIR03 Workshop on Implicit Measures of User Interests and Preferences","author":"Fox S.","year":"2003","unstructured":"S. Fox , K. Karnawat , M. Mydland , S. Dumais , and T. White . Evaluating implicit measures to improve the search experiences . In Talk presented at SIGIR03 Workshop on Implicit Measures of User Interests and Preferences , 2003 . S. Fox, K. Karnawat, M. Mydland, S. Dumais, and T. White. Evaluating implicit measures to improve the search experiences. In Talk presented at SIGIR03 Workshop on Implicit Measures of User Interests and Preferences, 2003."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/65943.65944"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/507072.507082"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009079"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986066"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39804-2_20"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/775047.775067"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.87.4.329"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1008992.1009057"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45681-3_22"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986115"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/355017.355025"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-2099-5_28"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/968363.968391"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1081870.1081899"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.124.3.372"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1086\/209397"},{"key":"e_1_2_1_25_1","first-page":"261","volume-title":"Proceedings of the Workshop on Self-Organizing Maps","author":"Salogarvi J.","year":"2003","unstructured":"J. Salogarvi , I. Kojo , S. Jaana , and S. Kaski . Can relevance be inferred from eye movements in information retrieval ? In Proceedings of the Workshop on Self-Organizing Maps , pages 261 -- 266 , 2003 . J. Salogarvi, I. Kojo, S. Jaana, and S. Kaski. Can relevance be inferred from eye movements in information retrieval? In Proceedings of the Workshop on Self-Organizing Maps, pages 261--266, 2003."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130332.3130334","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130332.3130334","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:17Z","timestamp":1750213577000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130332.3130334"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,8,2]]},"references-count":25,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,8,2]]}},"alternative-id":["10.1145\/3130332.3130334"],"URL":"https:\/\/doi.org\/10.1145\/3130332.3130334","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2017,8,2]]},"assertion":[{"value":"2017-08-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}