{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:47:41Z","timestamp":1761007661944,"version":"build-2065373602"},"reference-count":47,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2011,2,3]],"date-time":"2011-02-03T00:00:00Z","timestamp":1296691200000},"content-version":"vor","delay-in-days":94,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc of Assoc for Info"],"published-print":{"date-parts":[[2010,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper examines a key question in Information Seeking and Retrieval: how do people assess the usefulness of documents? In an experimental study, we presented 25 participants with five task\u2010based search scenarios and asked them to assess and comment on the usefulness of Web documents from the Canadian government domain. Data was analyzed to test for the effect of five information task types: fact\u2010finding, deciding, doing, learning and problem\u2010solving. Participant assessments show a low level of agreement on usefulness scores overall, but consistency varied by task type. The criteria used to assess usefulness varied by level of usefulness, by task type and by participant. Findings contribute to our understanding of consistency in relevance assessments and the impact of tasks on information behaviour.<\/jats:p>","DOI":"10.1002\/meet.14504701261","type":"journal-article","created":{"date-parts":[[2011,2,3]],"date-time":"2011-02-03T16:35:46Z","timestamp":1296750946000},"page":"1-10","source":"Crossref","is-referenced-by-count":4,"title":["The goldilocks effect: Task\u2010centred assessments of e\u2010government information"],"prefix":"10.1002","volume":"47","author":[{"given":"Luanne","family":"Freund","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justyna","family":"Berzowska","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2011,2,3]]},"reference":[{"key":"e_1_2_19_2_1","doi-asserted-by":"crossref","unstructured":"Bales S. &Wang P.(2005).Consolidating user relevance criteria: A meta\u2010ethnography of empirical studies. In Proceedings of the 68th Annual Meeting of the American Society for Information Science and Technology. Silver Spring MD: ASIS&T.","DOI":"10.1002\/meet.14504201277"},{"key":"e_1_2_19_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<149::AID-ASI5>3.0.CO;2-J"},{"key":"e_1_2_19_4_1","unstructured":"Belkin N.(2010).On the evaluation of interactive information retrieval systems. In The Janus Faced Scholar a Festschrift in Honour of Peter Ingwersen.www.issi\u2010society.info\/peteringwersen\/pif_online.pdf"},{"key":"e_1_2_19_5_1","unstructured":"Belkin N.et al. (2009)Usefulness as the criterion for evaluation of interactive information retrieval. in Proceedings of the third Workshop on Human\u2010Computer Interaction and Information Retrieval.http:\/\/cuaslis.iorg\/hcir2009"},{"key":"e_1_2_19_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10286"},{"key":"e_1_2_19_7_1","article-title":"The IIR evaluation model: a framework for evaluation of interactive information retrieval systems","volume":"8","author":"Borlund P.","year":"2003","journal-title":"Information Research"},{"key":"e_1_2_19_8_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094428102005002002"},{"key":"e_1_2_19_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10064"},{"key":"e_1_2_19_10_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20197"},{"key":"e_1_2_19_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(95)80035-R"},{"key":"e_1_2_19_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-0271(71)90024-6"},{"key":"e_1_2_19_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(99)00072-2"},{"key":"e_1_2_19_14_1","doi-asserted-by":"crossref","unstructured":"Freund L.(2008).Exploiting task\u2010document relations in support of information retrieval in the workplace (Doctoral dissertation).","DOI":"10.1145\/1480506.1480529"},{"key":"e_1_2_19_15_1","unstructured":"University of Toronto Toronto Canada."},{"key":"e_1_2_19_16_1","first-page":"392","volume-title":"Theories of Information Behavior","author":"Hansen P.","year":"2005"},{"key":"e_1_2_19_17_1","unstructured":"Haraldsen M. P\u00e4iv\u00e4rinta T. Sein M. K. &Stray T. D.(2004 November).Developing e\u2010government portals: from life\u2010events through genres to requirements. Paper Presented at the 11th Norwegian Conference on Information Systems Stavanger Norway."},{"key":"e_1_2_19_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199601)47:1<37::AID-ASI4>3.0.CO;2-3"},{"key":"e_1_2_19_19_1","unstructured":"Hert C. A. &Marchionini G.(1997).Seeking statistical information in federal websites: users tasks strategies and design recommendations. Final Report to the United States Bureau of Labor Statistics."},{"volume-title":"How Americans get in touch with government","year":"2004","author":"Horrigan J. B.","key":"e_1_2_19_20_1"},{"key":"e_1_2_19_21_1","article-title":"Information seeking research needs extension towards tasks and technology","volume":"10","author":"J\u00e4rvelin K.","year":"2004","journal-title":"Information Research"},{"key":"e_1_2_19_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20483"},{"key":"e_1_2_19_23_1","unstructured":"Kelly D. Murdock V. Yuan X. Croft W. B. &"},{"key":"e_1_2_19_24_1","unstructured":"Belkin N. J.(2002).Features of documents relevant to task and fact\u2010oriented questions. In Proceedings of the eleventh international conference on Information and knowledge management. McLean VA: ACM."},{"key":"e_1_2_19_25_1","doi-asserted-by":"crossref","unstructured":"Kim S. &Soergel D.(2005).Selecting and measuring task characteristics as independent variables. In Proceedings of the 68th Annual ASIS&T Meeting Charlotte NC (Vol. 42). Medford NJ: Information Today.","DOI":"10.1002\/meet.14504201111"},{"key":"e_1_2_19_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-85902-4_30"},{"volume-title":"The rise of the e\u2010citizen: how people use government agencies' Web sites","year":"2002","author":"Larsen E.","key":"e_1_2_19_27_1"},{"key":"e_1_2_19_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094428106296642"},{"key":"e_1_2_19_29_1","unstructured":"Li Y.(2004 November).Task type and a faceted classification of tasks. Poster Presented at the American Society of Information Science and Technology Providence RI."},{"key":"e_1_2_19_30_1","first-page":"89","volume-title":"E\u2010Government Reconsidered: Renewal of Governance for the Knowledge Age","author":"Mitchinson T.","year":"2004"},{"key":"e_1_2_19_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(98)00012-5"},{"key":"e_1_2_19_32_1","unstructured":"Murdoch V. Kelly D. Croft W. B. Belkin N. Yuan X."},{"key":"e_1_2_19_33_1","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.ipm.2006.05.009","volume":"43","journal-title":"Information Processing and Management"},{"key":"e_1_2_19_34_1","doi-asserted-by":"publisher","DOI":"10.1086\/602592"},{"key":"e_1_2_19_35_1","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195173321.001.0001"},{"key":"e_1_2_19_36_1","unstructured":"Saracevic T.(1996).Relevance reconsidered. In P. Ingwersen & N. O. Pors (Eds.) Information science: Integration in perspective; Proceedings of CoLIS the 2nd international conference on conceptions of library and information science Copenhagen October 13\u201316"},{"key":"e_1_2_19_37_1","unstructured":"Royal School of Librarianship Copenhagen 201 218"},{"key":"e_1_2_19_38_1","unstructured":"Schamber L.(1991).User's criteria for evaluation in multimedia information seeking and use situations (Doctoral dissertation Syracuse University): Dissertation Abstracts International 52\/12 AAT 9214390."},{"key":"e_1_2_19_39_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.86.2.420"},{"key":"e_1_2_19_40_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20106"},{"key":"e_1_2_19_41_1","unstructured":"Toms E. G. O'Brien H. Kopak R. &Freund L.(2005).Searching for relevance in the relevance of search. In F. Crestani & I. Ruthven (Eds.) Information context: nature impact and role: 5th International Conference on Conceptions of Library and Information Science CoLIS 2005 Glasgow UK June 4\u20138. Berlin: Springer."},{"key":"e_1_2_19_42_1","unstructured":"Toms E. G. O'Brien H. Mackenzie T. Jordan C. Freund L. Toze S. Dawe E.&MacNutt A.(2008)Task effects on interactive search: the query factor. InProceedings of the Initiative for XML Retrieval (INEX) Workshop 2007."},{"key":"e_1_2_19_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/aris.1440370110"},{"key":"e_1_2_19_44_1","doi-asserted-by":"crossref","unstructured":"Vintnar M. &Leben A.(2002).The concepts of an active life\u2010event public portal. In Proceedings of the First International Conference on Electronic Government. Berlin: Springer.","DOI":"10.1007\/978-3-540-46138-8_62"},{"key":"e_1_2_19_45_1","unstructured":"Wang P.(1994).A cognitive model of document selection of real users of IR systems(Doctoral dissertation). University of Maryland College Park MD."},{"key":"e_1_2_19_46_1","unstructured":"Wildemuth B.M.&Freund L.(2009 October)Search tasks and their role in studies of search behaviors. Paper Presented at the Third Annual Workshop on Human Computer Interaction and Information Retrieval Washington D.C."},{"key":"e_1_2_19_47_1","first-page":"457","article-title":"Situational relevance","volume":"9","author":"Wilson P.","year":"1973","journal-title":"Information Processing & Management"},{"key":"e_1_2_19_48_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20361"}],"container-title":["Proceedings of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.14504701261","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.14504701261","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/meet.14504701261","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T14:56:14Z","timestamp":1760972174000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/meet.14504701261"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,11]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2010,11]]}},"alternative-id":["10.1002\/meet.14504701261"],"URL":"https:\/\/doi.org\/10.1002\/meet.14504701261","archive":["Portico"],"relation":{},"ISSN":["0044-7870","1550-8390"],"issn-type":[{"type":"print","value":"0044-7870"},{"type":"electronic","value":"1550-8390"}],"subject":[],"published":{"date-parts":[[2010,11]]}}}