{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T20:09:51Z","timestamp":1761163791611,"version":"build-2065373602"},"reference-count":8,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T00:00:00Z","timestamp":1548979200000},"content-version":"vor","delay-in-days":396,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["asistdl.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Proc. Assoc. Info. Sci. Tech."],"published-print":{"date-parts":[[2018,1]]},"abstract":"ABSTRACT<\/jats:title>\n \n A lab\u2010based experiment was conducted to understand the multidimensional and dynamic changes in the use of relevance criteria on online news on search engine result pages (SERPs). Data from retrospective think\u2010aloud (RTA) was first analyzed to investigate the criteria used when participants selected a search result on SERPs. The number and frequency of criteria used for relevance judgments were calculated. The criteria used on subsequent SERPs visits and on results at different ranks on SERPs were then analyzed to understand the differences in relevance criteria that were applied. The results showed that among the top six identified criteria,\n specific source<\/jats:italic>\n and\n topicality<\/jats:italic>\n were the two most often used relevance criteria. 59.6% of the times partic\u2010 ipants used a single criterion to make relevance judgment. Considering how criteria changed on subsequent visits to SERPs and on search results at different ranks,\n specific source<\/jats:italic>\n was the most often used criterion initially but was then surpassed by\n topicality<\/jats:italic>\n on subsequent visits to SERPs and on results at lower ranks. This could be explained by users using\n specific source<\/jats:italic>\n as the primary cue in information evaluation and by users' expectation that Google's search engine algorithm shows more relevant information on the first SERP and at the top result ranks.\n <\/jats:p>","DOI":"10.1002\/pra2.2018.14505501108","type":"journal-article","created":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T16:52:19Z","timestamp":1549039939000},"page":"768-769","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Relevance criteria dynamics: A study of online news selection on SERPs"],"prefix":"10.1002","volume":"55","author":[{"given":"Yung\u2010Sheng","family":"Chang","sequence":"first","affiliation":[{"name":"School of Information University of Texas at Austin USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacek","family":"Gwizdka","sequence":"additional","affiliation":[{"name":"School of Information University of Texas at Austin USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2019,2]]},"reference":[{"key":"e_1_2_5_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10286"},{"key":"e_1_2_5_3_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327825MCS0601_3"},{"key":"e_1_2_5_4_1","unstructured":"Saracevic T.(1996).Relevance reconsidered. Proceedings of CoLIS'1996."},{"key":"e_1_2_5_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(90)90050-C"},{"key":"e_1_2_5_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/107769909907600213"},{"key":"e_1_2_5_7_1","doi-asserted-by":"publisher","DOI":"10.1108\/00220410910983083"},{"key":"e_1_2_5_8_1","doi-asserted-by":"crossref","unstructured":"White R.(2013).Beliefs and biases in web search. Paper presented at the Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval.","DOI":"10.1145\/2484028.2484053"},{"key":"e_1_2_5_9_1","doi-asserted-by":"crossref","unstructured":"Zhang Y. Zhang J. Lease M. &Gwizdka J.(2014).Multidimensional relevance modeling via psychometrics and crowdsourcing. Paper presented at the Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval.","DOI":"10.1145\/2600428.2609577"}],"container-title":["Proceedings of the Association for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fpra2.2018.14505501108","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pra2.2018.14505501108","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/pra2.2018.14505501108","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/pra2.2018.14505501108","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T17:37:44Z","timestamp":1761068264000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/pra2.2018.14505501108"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1]]},"references-count":8,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1002\/pra2.2018.14505501108"],"URL":"https:\/\/doi.org\/10.1002\/pra2.2018.14505501108","archive":["Portico"],"relation":{},"ISSN":["2373-9231","2373-9231"],"issn-type":[{"type":"print","value":"2373-9231"},{"type":"electronic","value":"2373-9231"}],"subject":[],"published":{"date-parts":[[2018,1]]},"assertion":[{"value":"2019-02-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}