{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T16:19:16Z","timestamp":1770481156248,"version":"3.49.0"},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"1","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2007,5]]},"abstract":"<jats:p>The predominant business model for Web search engines is sponsored search, which generates billions in yearly revenue. But are sponsored links providing online consumers with relevant choices for products and services? We address this and related issues by investigating the relevance of sponsored and nonsponsored links for e-commerce queries on the major search engines. The results show that average relevance ratings for sponsored and nonsponsored links are practically the same, although the relevance ratings for sponsored links are statistically higher. We used 108 ecommerce queries and 8,256 retrieved links for these queries from three major Web search engines: Yahoo!, Google, and MSN. In addition to relevance measures, we qualitatively analyzed the e-commerce queries, deriving five categorizations of underlying information needs. Product-specific queries are the most prevalent (48%). Title (62%) and summary (33%) are the primary basis for evaluating sponsored links with URL a distant third (2%). To gauge the effectiveness of sponsored search campaigns, we analyzed the sponsored links from various viewpoints. It appears that links from organizations with large sponsored search campaigns are more relevant than the average sponsored link. We discuss the implications for Web search engines and sponsored search as a long-term business model and as a mechanism for finding relevant information for searchers.<\/jats:p>","DOI":"10.1145\/1232722.1232725","type":"journal-article","created":{"date-parts":[[2007,6,8]],"date-time":"2007-06-08T15:00:08Z","timestamp":1181314808000},"page":"3","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":50,"title":["The comparative effectiveness of sponsored and nonsponsored links for Web e-commerce queries"],"prefix":"10.1145","volume":"1","author":[{"given":"Bernard J.","family":"Jansen","sequence":"first","affiliation":[{"name":"The Pennsylvania State University, University Park, Pennsylvania"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2007,5]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/322796.322805"},{"key":"e_1_2_1_2_1","unstructured":"Brooks N. 2004a. How search engine rank impacts traffic. The Atlas Rank Report i (Aug.).  Brooks N. 2004a. How search engine rank impacts traffic. The Atlas Rank Report i (Aug.)."},{"key":"e_1_2_1_3_1","unstructured":"Brooks N. 2004b. How search engine rank impacts conversions. The Atlas Rank Report ii (Jan.).  Brooks N. 2004b. How search engine rank impacts conversions. The Atlas Rank Report ii (Jan.)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1002\/bult.1720320208","article-title":"Repeat search behavior: Implications for advertisers","volume":"32","author":"Brooks N.","year":"2006","unstructured":"Brooks , N. 2006 . Repeat search behavior: Implications for advertisers . Bull. Amer. Soc. Inform. Scien. Technol. 32 , 16 -- 17 . Brooks, N. 2006. Repeat search behavior: Implications for advertisers. Bull. Amer. Soc. Inform. Scien. Technol. 32, 16--17.","journal-title":"Bull. Amer. Soc. Inform. Scien. Technol."},{"key":"e_1_2_1_5_1","unstructured":"Cole J. I. Suman M. Schramm P. Lunn R. and Aquino J. S. 2003. Surveying the digital future year three. The Ucla Internet Report (Feb.).  Cole J. I. Suman M. Schramm P. Lunn R. and Aquino J. S. 2003. Surveying the digital future year three. The Ucla Internet Report (Feb.)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02310555","article-title":"Coefficient alpha and the internal structure of tests","volume":"16","author":"Cronbach L. J.","year":"1951","unstructured":"Cronbach , L. J. 1951 . Coefficient alpha and the internal structure of tests . Psychometrika. 16 , 297 -- 334 . Cronbach, L. J. 1951. Coefficient alpha and the internal structure of tests. Psychometrika. 16, 297--334.","journal-title":"Psychometrika."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of World Wide Web Conference (WWW'06)","author":"Dai H. K.","unstructured":"Dai , H. K. , Nie , Z. , Wang , L. , Zhao , L. , Wen , J.-R. , and Li , Y . 2006. Detecting online commercial intention (oci) . In Proceedings of World Wide Web Conference (WWW'06) . Edinburgh, Scotland. 829--837. 10.1145\/1135777.1135902 Dai, H. K., Nie, Z., Wang, L., Zhao, L., Wen, J.-R., and Li, Y. 2006. Detecting online commercial intention (oci). In Proceedings of World Wide Web Conference (WWW'06). Edinburgh, Scotland. 829--837. 10.1145\/1135777.1135902"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1002\/bult.1720320206","article-title":"Sponsored search: A brief history","volume":"32","author":"Fain D. C.","year":"2006","unstructured":"Fain , D. C. and Pedersen , J. O. 2006 . Sponsored search: A brief history . Bull. Amer. Soc. Inform. Sci. Tech. 32 , 12 -- 13 . Fain, D. C. and Pedersen, J. O. 2006. Sponsored search: A brief history. Bull. Amer. Soc. Inform. Sci. Tech. 32, 12--13.","journal-title":"Bull. Amer. Soc. Inform. Sci. Tech."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of 67th Annual Meeting of the American Society for Information Science and Technology (ASIS&T04)","author":"Huang X.","unstructured":"Huang , X. and Soergel , D . 2004. Relevance judges' understanding of topical relevance types: An explication of an enriched concept of topical relevance . In Proceedings of 67th Annual Meeting of the American Society for Information Science and Technology (ASIS&T04) . Providence, RI, 13--18. Huang, X. and Soergel, D. 2004. Relevance judges' understanding of topical relevance types: An explication of an enriched concept of topical relevance. In Proceedings of 67th Annual Meeting of the American Society for Information Science and Technology (ASIS&T04). Providence, RI, 13--18."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.816269"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1002\/bult.1720320204","article-title":"Paid search as an information seeking paradigm","volume":"32","author":"Jansen B. J.","year":"2006","unstructured":"Jansen , B. J. 2006 a. Paid search as an information seeking paradigm . Bull. Amer. Soc. Inform. Sci. Technol. 32 , 7 -- 8 . Jansen, B. J. 2006a. Paid search as an information seeking paradigm. Bull. Amer. Soc. Inform. Sci. Technol. 32, 7--8.","journal-title":"Bull. Amer. Soc. Inform. Sci. Technol."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.243"},{"key":"e_1_2_1_13_1","volume-title":"2nd International Workshop on Adversarial Information Retrieval on the Web (AIRWeb06)","author":"Jansen B. J.","year":"2006","unstructured":"Jansen , B. J. 2006 c. Adversarial information retrieval aspects of sponsored search . 2nd International Workshop on Adversarial Information Retrieval on the Web (AIRWeb06) . The 29th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR06). Jansen, B. J. 2006c. Adversarial information retrieval aspects of sponsored search. 2nd International Workshop on Adversarial Information Retrieval on the Web (AIRWeb06). The 29th Annual International ACM SIGIR Conference on Research & Development on Information Retrieval (SIGIR06)."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the American Society for Information Science & Technology Annual Meeting","author":"Jansen B. J.","unstructured":"Jansen , B. J. , Koshman , S. , and Spink , A . 2005a. An analysis of repeat users of vivisimo.Com . In Proceedings of the American Society for Information Science & Technology Annual Meeting . Charlotte, NC, 1--6. Jansen, B. J., Koshman, S., and Spink, A. 2005a. An analysis of repeat users of vivisimo.Com. In Proceedings of the American Society for Information Science & Technology Annual Meeting. Charlotte, NC, 1--6."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v56:14"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2005.09.003"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v57:14"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of 4th International Conference on Internet Computing","author":"Jansen B. J.","unstructured":"Jansen , B. J. and Spink , A . 2003. An analysis of Web information seeking and use: Documents retrieved versus documents viewed . In Proceedings of 4th International Conference on Internet Computing . Las Vegas, NV. 65--69. Jansen, B. J. and Spink, A. 2003. An analysis of Web information seeking and use: Documents retrieved versus documents viewed. In Proceedings of 4th International Conference on Internet Computing. Las Vegas, NV. 65--69."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2004.10.007"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v56:6"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(99)00056-4"},{"key":"e_1_2_1_22_1","unstructured":"Marable L. 2003. False oracles: Consumer reaction to learning the truth about how search engines work results of an ethnographic study. Consumer Webwatch Research 1--66.  Marable L. 2003. False oracles: Consumer reaction to learning the truth about how search engines work results of an ethnographic study. Consumer Webwatch Research 1--66."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v57:4"},{"key":"e_1_2_1_24_1","volume-title":"Qualitative Evaluation and Research Methods","author":"Patton M. Q.","unstructured":"Patton , M. Q. 1990. Qualitative Evaluation and Research Methods . Sage Publications, Inc. , Newbury Park, CA . Patton, M. Q. 1990. Qualitative Evaluation and Research Methods. Sage Publications, Inc., Newbury Park, CA."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of RIAO 2000: Computer-Assisted Information retrieval","author":"Selberg E.","unstructured":"Selberg , E. , and Etzioni , O . 2000. On the instability of Web search services . In Proceedings of RIAO 2000: Computer-Assisted Information retrieval . Paris, France. Selberg, E., and Etzioni, O. 2000. On the instability of Web search services. In Proceedings of RIAO 2000: Computer-Assisted Information retrieval. Paris, France."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/331403.331405"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1177\/016555150002600307","article-title":"Access to electronic commerce sites on the World Wide Web: An analysis of the effectiveness of six Internet search engines","volume":"26","author":"Spiteri L. F.","year":"2000","unstructured":"Spiteri , L. F. 2000 . Access to electronic commerce sites on the World Wide Web: An analysis of the effectiveness of six Internet search engines . J. Inform. Scien. 26 , 173 -- 183 . Spiteri, L. F. 2000. Access to electronic commerce sites on the World Wide Web: An analysis of the effectiveness of six Internet search engines. J. Inform. Scien. 26, 173--183.","journal-title":"J. Inform. Scien."},{"key":"e_1_2_1_28_1","unstructured":"Sullivan D. 2003. Nielsen\/netratings search engine ratings. (Oct.)  Sullivan D. 2003. Nielsen\/netratings search engine ratings. (Oct.)"},{"key":"e_1_2_1_29_1","volume-title":"Electronic Commerce: A Managerial Perspective","author":"Turban E.","year":"2004","unstructured":"Turban , E. , King , D. , Lee , J. , and Viehland , D . 2004 . Electronic Commerce: A Managerial Perspective . Pearson-Prentice Hall , Upper Saddle River, NJ. Turban, E., King, D., Lee, J., and Viehland, D. 2004. Electronic Commerce: A Managerial Perspective. Pearson-Prentice Hall, Upper Saddle River, NJ."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(03)00043-8"}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1232722.1232725","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T19:47:38Z","timestamp":1672256858000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1232722.1232725"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,5]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2007,5]]}},"alternative-id":["10.1145\/1232722.1232725"],"URL":"https:\/\/doi.org\/10.1145\/1232722.1232725","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"value":"1559-1131","type":"print"},{"value":"1559-114X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,5]]},"assertion":[{"value":"2007-05-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}