{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:47:17Z","timestamp":1761007637639,"version":"build-2065373602"},"reference-count":27,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2011,2,3]],"date-time":"2011-02-03T00:00:00Z","timestamp":1296691200000},"content-version":"vor","delay-in-days":94,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc of Assoc for Info"],"published-print":{"date-parts":[[2010,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper reports on the findings of a user study that explored how searchers tend to fixate on information associated with different relevance criteria in the web during the relevance judgment process. The user study involved the completion of questionnaires, use of eye tracking technology, talk aloud protocols and post\u2010search interviews. As opposed to previous studies, the present research asked participants to search for real information needs that represented different search contexts (e.g. from searches about personal interest to academic related searches). This permitted the identification of several relevance criteria that naturally occur across different search contexts and the emergence of some fixation patterns, not observed before, associated to the use of these criteria. Although the study examined participants' eye movements for both predictive and evaluative relevance judgments, this paper is focused on the findings of the predictive relevance judgment process and specifically participants' evaluation of the results presented in the search result interface of the Google search engine. It is anticipated that the findings reported in this paper could shed light on the process of predictive relevance judgment and especially on the problem of relevance criteria use through the use of eye tracking.<\/jats:p>","DOI":"10.1002\/meet.14504701145","type":"journal-article","created":{"date-parts":[[2011,2,3]],"date-time":"2011-02-03T16:35:46Z","timestamp":1296750946000},"page":"1-10","source":"Crossref","is-referenced-by-count":2,"title":["The use of relevance criteria during predictive judgment: An eye tracking approach"],"prefix":"10.1002","volume":"47","author":[{"given":"Panos","family":"Balatsoukas","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ian","family":"Ruthven","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2011,2,3]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/11555261_104"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<149::AID-ASI5>3.0.CO;2-J"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(1998)49:14<1293::AID-ASI7>3.0.CO;2-E"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(97)00078-2"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20436"},{"key":"e_1_2_8_7_1","doi-asserted-by":"crossref","unstructured":"Cutrell E. &Guan Z.(2007).What are you looking for? An eye\u2010tracking study of information usage in web search. In Proceddings of the ACM HCI 2007 Conference on Human factors in computing systems (pp.407\u2013415). New York: ACM.","DOI":"10.1145\/1240624.1240690"},{"key":"e_1_2_8_8_1","doi-asserted-by":"crossref","unstructured":"Dumais S. Buscher G.&Cutrell E.(2010).Individual differences in gaze patterns for web search.IIiX2010 August 18\u201321 New Brunswick New Jersey USA.","DOI":"10.1145\/1840784.1840812"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1108\/00220410310472518"},{"key":"e_1_2_8_11_1","doi-asserted-by":"crossref","unstructured":"Goldberg J. H. Stimson M. Lewenstein M. Scott N. &Wichansky A.(2002).Eye tracking in web search tasks: design implications. in Proceedings of the Eye tracking Research and Applications Symposium (ETRA). (pp.51\u201358). New York: ACM.","DOI":"10.1145\/507072.507082"},{"key":"e_1_2_8_12_1","doi-asserted-by":"crossref","unstructured":"Granka L. Joackinms T.andGay G.(2004).Eye\u2010Tracking Analysis of User Behavior in WWW Search. In: M. Sanderson K. Jarvelin J. Allan P. Bruza (Eds.) Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval Sheffield July 25\u201329 2004. (pp.478\u2013479). New York: ACM.","DOI":"10.1145\/1008992.1009079"},{"key":"e_1_2_8_13_1","doi-asserted-by":"crossref","unstructured":"Hughes A. Wilkens T. Wildemuth B. andMarchionini G.(2003).Text or pictures? An eyetracking study of how people view digital video surrogates. In E.M. Bakker et al (Eds.) Proceedings of the Second International Conference CIVR 2003 Urbana\u2010Champaign IL USA July 24\u201325 2003 (pp.271\u2013280) Berlin: Springer\u2010Verlag.","DOI":"10.1007\/3-540-45113-7_27"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20794"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2005.10.001"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1083-6101.2007.00351.x"},{"key":"e_1_2_8_17_1","doi-asserted-by":"crossref","unstructured":"Papaeconomou C. Zijlema A. &Ingwersen P.(2008).Searchers' Relevance Jugements and Criteria in Evaluating Web Pages in a Learning Style Perspective. InIIiX 2008 London UK 123\u2013132.","DOI":"10.1145\/1414694.1414722"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195173321.001.0001"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/17470210902816461"},{"key":"e_1_2_8_20_1","doi-asserted-by":"crossref","unstructured":"Rele S. &Duchowski A.T.(2005).Using eye tracking to evaluate alternative search results interfacesImpactof journals as proxies for citation counts. InProceedings of the 49thannual meeting of Human Factors and Ergonomics society September 26\u201330 2005 Orlando FL HFES.Orlando Florida HFES 2005.","DOI":"10.1177\/154193120504901508"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10017"},{"key":"e_1_2_8_22_1","doi-asserted-by":"crossref","unstructured":"Rodden K. Fu X. Aula A.&Spiro I.(2008).Eye\u2010mouse coordination patterns on web search pages. in Proceedings of the ACM CHI 2005 conference on human factors in computing systems (pp.2997\u20133002). New York: ACM press.","DOI":"10.1145\/1358628.1358797"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(01)00036-X"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.1116"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20106"},{"key":"e_1_2_8_26_1","doi-asserted-by":"crossref","unstructured":"Tseng Y\u2010C. &Howes A.(2008).The adaptation of visual search strategy to expected information gain. in Proceedings of the ACM CHI 2008 Conference on human factors in computing systems (pp.1075\u20131084). New York: ACM press.","DOI":"10.1145\/1357054.1357221"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199802)49:2<115::AID-ASI3>3.0.CO;2-T"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20839"}],"container-title":["Proceedings of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.14504701145","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.14504701145","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/meet.14504701145","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T14:56:23Z","timestamp":1760972183000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/meet.14504701145"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,11]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2010,11]]}},"alternative-id":["10.1002\/meet.14504701145"],"URL":"https:\/\/doi.org\/10.1002\/meet.14504701145","archive":["Portico"],"relation":{},"ISSN":["0044-7870","1550-8390"],"issn-type":[{"type":"print","value":"0044-7870"},{"type":"electronic","value":"1550-8390"}],"subject":[],"published":{"date-parts":[[2010,11]]}}}