{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:08:56Z","timestamp":1754158136356,"version":"3.41.2"},"reference-count":18,"publisher":"Emerald","issue":"2","license":[{"start":{"date-parts":[[2003,4,1]],"date-time":"2003-04-01T00:00:00Z","timestamp":1049155200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2003,4,1]]},"abstract":"<jats:p>Pay for performance (PFP) search engines provide search services for documents on the Web, but unlike traditional search engines, they rank documents not on content characteristics, but according to the amount of money the owner of a Web site is willing to pay if a user visits the Web site through the search results pages. A study was conducted to compare the retrieval effectiveness of Overture (a PFP search engine) and Google (a traditional search engine) using a test suite of general knowledge questions. A total of 45 queries, based on a popular game show, \u201cWho wants to be a millionaire?\u201d, were submitted to each of these search engines and the first ten documents returned were analysed using different relevancy criteria. Results indicated that Google outperformed Overture in terms of precision and number of queries that could be answered. Implications for this study are also discussed.<\/jats:p>","DOI":"10.1108\/14684520310471699","type":"journal-article","created":{"date-parts":[[2003,5,8]],"date-time":"2003-05-08T21:49:46Z","timestamp":1052430586000},"page":"87-93","source":"Crossref","is-referenced-by-count":3,"title":["Relevancy rankings: pay for performance search engines in the hot seat"],"prefix":"10.1108","volume":"27","author":[{"given":"Dion H.","family":"Goh","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebecca P.","family":"Ang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","reference":[{"key":"key2022012720111958800_B1","doi-asserted-by":"crossref","unstructured":"Bar\u2010Ilan, J. (2000), \u201cEvaluating the stability of the search tools Hotbot and Snap: a case study\u201d, Online Information Review, Vol. 24 No. 6, pp. 439\u201049.","DOI":"10.1108\/14684520010362099"},{"key":"key2022012720111958800_B2","doi-asserted-by":"crossref","unstructured":"Brin, S. and Page, L. (1998), \u201cThe anatomy of a large\u2010scale hypertextual Web search engine\u201d, Computer Networks and ISDN Systems, Vol. 30 Nos 1\u20107, pp. 107\u201017.","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"key2022012720111958800_B3","unstructured":"Celador Productions (2002), Who Wants To Be A Millionaire, available at:  www.millionaireonline. tv\/enter.html"},{"key":"key2022012720111958800_B4","unstructured":"Chu, H. and Rosenthal, M. (1996), \u201cSearch engines for the World Wide Web: a comparative study and evaluation methodology\u201d, Proceedings of the 59th ASIS Annual Meeting, October 21\u201024, Baltimore, Maryland, Information Today, Medford, NJ,  pp. 127\u201035."},{"key":"key2022012720111958800_B5","unstructured":"Commercial Alert (2001), \u201cCommercial alert files complaint against search engines for deceptive ads\u201d, available at: www.commercialalert.org \/index.php?category_id=1&subcategory_id=24& article_id=33"},{"key":"key2022012720111958800_B6","unstructured":"Ding, W. and Marchionini, G. (1996), \u201cA comparative study of Web search service performance\u201d, Proceedings of the 59th ASIS Annual Meeting, October 21\u201024, Baltimore, Maryland, pp. 136\u201042."},{"key":"key2022012720111958800_B7","unstructured":"Festa, P. (2001), \u201cGoTo gains amid Web pains\u201d, CNET News.com, available at: http:\/\/news.cnet.com\/news\/0\u20101005\u2010200\u20105876770.html?tag=lh"},{"key":"key2022012720111958800_B8","unstructured":"Gallagher, D. (2002), \u201cUS warns Web sites to label sponsorships\u201d, The New York Times, available at: www.nytimes.com\/2002\/07\/02\/technology\/02SEAR.html"},{"key":"key2022012720111958800_B9","doi-asserted-by":"crossref","unstructured":"Goh, D. and Ang, R. (2002), \u201cAre pay for performance search engines relevant?\u201d, Journal of Information Science, Vol. 28 No. 5, pp. 349\u201055.","DOI":"10.1177\/016555150202800501"},{"key":"key2022012720111958800_B10","doi-asserted-by":"crossref","unstructured":"Gordon, M. and Pathak, P. (1999), \u201cFinding information on the World Wide Web: the retrieval effectiveness of search engines\u201d, Information Processing and Management, Vol. 35 No. 2, pp. 141\u201080.","DOI":"10.1016\/S0306-4573(98)00041-7"},{"key":"key2022012720111958800_B11","doi-asserted-by":"crossref","unstructured":"Henshaw, R. (2001), \u201cWhat next for Internet journals? Implications of the trend towards paid placement in search engines\u201d, First Monday, Vol. 6 No. 9, available at: http:\/\/firstmonday.org\/issues\/issue6_9\/henshaw\/index.html","DOI":"10.5210\/fm.v6i9.884"},{"key":"key2022012720111958800_B12","doi-asserted-by":"crossref","unstructured":"Jansen, B., Spink, A. and Saracevic, T. (2000), \u201cReal life, real users and real needs: a study and analysis of users\u2019 queries on the Web\u201d, Information Processing and Management, Vol. 36 No. 2, pp. 207\u201027.","DOI":"10.1016\/S0306-4573(99)00056-4"},{"key":"key2022012720111958800_B13","doi-asserted-by":"crossref","unstructured":"Leighton, H. and Srivastava, J. (1999), \u201cFirst 20 precision among World Wide Web search services (search engines)\u201d, Journal of the American Society for Information Science, Vol. 50 No. 10, pp. 870\u201081.","DOI":"10.1002\/(SICI)1097-4571(1999)50:10<870::AID-ASI4>3.0.CO;2-G"},{"key":"key2022012720111958800_B14","unstructured":"Overture (2002), \u201cListing guidelines\u201d, available at: www.overture.com\/d\/about\/advertisers\/relevancy. jhtml"},{"key":"key2022012720111958800_B15","unstructured":"Spink, A. and Xu, J. (2000), \u201cSelected results from a large study of Web searching: the Excite study\u201d, Information Research, Vol. 6 No. 1, available at: http:\/\/informationr.net\/ir\/6\u20101\/paper90.html"},{"key":"key2022012720111958800_B16","unstructured":"Sullivan, D. (2001), \u201cCan portals resist the dark side?\u201d, The Search Engine Report, available at: www.searchenginewatch.com\/sereport\/01\/06\u2010darkside.html"},{"key":"key2022012720111958800_B17","unstructured":"Sullivan, D. (2002), \u201cWho powers whom? Search providers chart\u201d, The Search Engine Report, available at: www.searchenginewatch.com\/reports\/alliances.html"},{"key":"key2022012720111958800_B18","unstructured":"Winzenburg, S. (2002), \u201cA content analysis of Who Wants To Be A Millionaire\u201d, available at: http:\/\/faculty.gvc.edu\/swinzenburg\/millionaire_study.html"}],"container-title":["Online Information Review"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/14684520310471699","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520310471699\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/14684520310471699\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:39:52Z","timestamp":1753403992000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/oir\/article\/27\/2\/87-93\/303941"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2003,4,1]]},"references-count":18,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2003,4,1]]}},"alternative-id":["10.1108\/14684520310471699"],"URL":"https:\/\/doi.org\/10.1108\/14684520310471699","relation":{},"ISSN":["1468-4527"],"issn-type":[{"type":"print","value":"1468-4527"}],"subject":[],"published":{"date-parts":[[2003,4,1]]}}}