{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:40:04Z","timestamp":1776084004259,"version":"3.50.1"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2010,3,1]],"date-time":"2010-03-01T00:00:00Z","timestamp":1267401600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2010,3]]},"abstract":"<jats:p>\n            Current Web search tools do a good job of retrieving documents that satisfy the most common intentions associated with a query, but do not do a very good job of discerning different individuals' unique search goals. We explore the variation in what different people consider relevant to the same query by mining three data sources: (1)\n            <jats:italic>explicit<\/jats:italic>\n            relevance judgments, (2) clicks on search results (a\n            <jats:italic>behavior-based implicit<\/jats:italic>\n            measure of relevance), and (3) the similarity of desktop content to search results (a\n            <jats:italic>content-based implicit<\/jats:italic>\n            measure of relevance). We find that people's explicit judgments for the same queries differ greatly. As a result, there is a large gap between how well search engines could perform if they were to tailor results to the individual, and how well they currently perform by returning results designed to satisfy everyone. We call this gap the\n            <jats:italic>potential for personalization<\/jats:italic>\n            . The two implicit indicators we studied provide complementary value for approximating this variation in result relevance among people. We discuss several uses of our findings, including a personalized search system that takes advantage of the implicit measures by ranking personally relevant results more highly and improving click-through rates.\n          <\/jats:p>","DOI":"10.1145\/1721831.1721835","type":"journal-article","created":{"date-parts":[[2010,4,7]],"date-time":"2010-04-07T02:56:32Z","timestamp":1270608992000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":101,"title":["Potential for personalization"],"prefix":"10.1145","volume":"17","author":[{"given":"Jaime","family":"Teevan","sequence":"first","affiliation":[{"name":"Microsoft Research"}]},{"given":"Susan T.","family":"Dumais","sequence":"additional","affiliation":[{"name":"Microsoft Research"}]},{"given":"Eric","family":"Horvitz","sequence":"additional","affiliation":[{"name":"Microsoft Research"}]}],"member":"320","published-online":{"date-parts":[[2010,4,6]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148175"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860453"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/4236.968829"},{"key":"e_1_2_1_4_1","unstructured":"Chi E. and Pirolli P. 2006. Social information foraging and collaborative search. 2006 Human Computer Interaction Consortium. http:\/\/www2.parc. com\/istl\/projects\/uir\/publications\/author\/Pirolli_ab.html  Chi E. and Pirolli P. 2006. Social information foraging and collaborative search. 2006 Human Computer Interaction Consortium. http:\/\/www2.parc. com\/istl\/projects\/uir\/publications\/author\/Pirolli_ab.html"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183614.1183658"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242651"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860451"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/944012.944015"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/258525.258568"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v58:2"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1059981.1059982"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240691"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199601)47:1%3C37::AID-ASI4%3E3.3.CO;2-I"},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the Text Retrieval Conference. 87--102","author":"Hawking D.","year":"2000","unstructured":"Hawking , D. 2000 . Overview of the TREC-9 Web Track . In Proceedings of the Text Retrieval Conference. 87--102 . Hawking, D. 2000. Overview of the TREC-9 Web Track. In Proceedings of the Text Retrieval Conference. 87--102."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the Text Retrieval Conference. 61--68","author":"Hawking D.","unstructured":"Hawking , D. and Craswell , N . 2001. Overview of the TREC-2001 Web Track . In Proceedings of the Text Retrieval Conference. 61--68 . Hawking, D. and Craswell, N. 2001. Overview of the TREC-2001 Web Track. In Proceedings of the Text Retrieval Conference. 61--68."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/345508.345545"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/775152.775191"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076063"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2006.03.006"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/959258.959260"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/238386.238487"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1198296.1198301"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199709)48:9%3C810::AID-ASI6%3E3.0.CO;2-U"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 272--281","author":"Morita M.","unstructured":"Morita , M. and Shinoda , Y . 1994. Information filtering based on user behavior analysis and best match text retrieval . In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 272--281 . Morita, M. and Shinoda, Y. 1994. Information filtering based on user behavior analysis and best match text retrieval. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 272--281."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the JCDL Workshop on Collaborative Information Retrieval.","author":"Morris M. R.","unstructured":"Morris , M. R. and Teevan , J . 2008. Understanding groups' properties as a means of improving collaborative search systems . In Proceedings of the JCDL Workshop on Collaborative Information Retrieval. Morris, M. R. and Teevan, J. 2008. Understanding groups' properties as a means of improving collaborative search systems. In Proceedings of the JCDL Workshop on Collaborative Information Retrieval."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460640"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/567498.567526"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148320"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/HICSS.2007.91"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/860435.860475"},{"key":"e_1_2_1_31_1","first-page":"81","article-title":"Relevance: A review of the literature and a framework for thinking on the notion in information science","volume":"6","author":"Saracevic T.","year":"1976","unstructured":"Saracevic , T. 1976 . Relevance: A review of the literature and a framework for thinking on the notion in information science . Adv. Librarian. 6 , 81 -- 139 . Saracevic, T. 1976. Relevance: A review of the literature and a framework for thinking on the notion in information science. Adv. Librarian. 6, 81--139.","journal-title":"Adv. Librarian."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0065-2830(06)30001-3"},{"key":"e_1_2_1_33_1","first-page":"3","article-title":"Relevance and information behavior","volume":"29","author":"Schamber L.","year":"1994","unstructured":"Schamber , L. 1994 . Relevance and information behavior . Ann. Rev. Inform. Sci. Tech. 29 , 3 -- 48 . Schamber, L. 1994. Relevance and information behavior. Ann. Rev. Inform. Sci. Tech. 29, 3--48.","journal-title":"Ann. Rev. Inform. Sci. Tech."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099554.1099747"},{"key":"e_1_2_1_35_1","unstructured":"Sparck Jones K. Walker S. and Robertson S. A. 1998. Probabilistic model of information retrieval: Development and status. Tech. rep. TR-446 Cambridge University Computer Laboratory.  Sparck Jones K. Walker S. and Robertson S. A. 1998. Probabilistic model of information retrieval: Development and status. Tech. rep. TR-446 Cambridge University Computer Laboratory."},{"key":"e_1_2_1_36_1","volume-title":"Web Search: Public Searching of the Web","author":"Spink A.","year":"2004","unstructured":"Spink , A. and Jansen , B . 2004 . Web Search: Public Searching of the Web . Kluwer Academic Publishers . Spink, A. and Jansen, B. 2004. Web Search: Public Searching of the Web. Kluwer Academic Publishers."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/988672.988764"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/985692.985745"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076111"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277894"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277770"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390364"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1498759.1498786"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291017"},{"key":"e_1_2_1_45_1","volume-title":"Eds","author":"Voorhees E.","year":"2005","unstructured":"Voorhees , E. and Harman , D. , Eds . 2005 . TREC : Experiment and Evaluation in Information Retrieval. The MIT Press . Voorhees, E. and Harman, D., Eds. 2005. TREC: Experiment and Evaluation in Information Retrieval. The MIT Press."},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the Australian Computer Society Conference (ACSC\u201808)","author":"Wu M.","unstructured":"Wu , M. , Turpin , A. , and Zobel , J . 2008. An investigation on a community's web search variability . In Proceedings of the Australian Computer Society Conference (ACSC\u201808) , 117--126. Wu, M., Turpin, A., and Zobel, J. 2008. An investigation on a community's web search variability. In Proceedings of the Australian Computer Society Conference (ACSC\u201808), 117--126."}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1721831.1721835","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1721831.1721835","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:23:38Z","timestamp":1750249418000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1721831.1721835"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,3]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2010,3]]}},"alternative-id":["10.1145\/1721831.1721835"],"URL":"https:\/\/doi.org\/10.1145\/1721831.1721835","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,3]]},"assertion":[{"value":"2007-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2009-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-04-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}