{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T14:45:24Z","timestamp":1784558724939,"version":"3.55.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T00:00:00Z","timestamp":1576800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-1718295"],"award-info":[{"award-number":["IIS-1718295"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2020,1,31]]},"abstract":"<jats:p>\n            In interactive information retrieval, an important research question is: How do task characteristics influence users\u2019 needs and behaviors? We report on a laboratory study (\n            <jats:italic>N<\/jats:italic>\n            =32) that investigated the effects of task complexity on the types of information used by participants while searching. Participants completed tasks of four complexity levels and had access to four different types of information provided through a search-assistance tool referred to as the InfoBoxes (IB). The IB tool presented the following types of task-related information (\n            <jats:italic>info-types<\/jats:italic>\n            ) on different tabs: (1) facts, (2) concepts, (3) opinions, and (4) insights. Facts (and opinions) were defined as objective (and subjective) statements relevant to the task. Concepts were defined as important ideas, principles, or entities related to the task. Insights were defined as tips or advice about the task. The study investigated six research questions that considered the effects of task complexity on: (RQ1) participants\u2019 pre-\/post-task perceptions about useful info-types; (RQ2) use of different info-types during the task; (RQ3) motivations for engaging with the IB; (RQ4) gains from using it; (RQ5) the search stage participants were in while engaging with the IB; and (RQ6) motivations for sometimes avoiding the IB. Our results suggest that task complexity influenced all six types of outcomes. We discuss implications of our results for designing search assistance tools and systems that favor certain types of content based on task characteristics.\n          <\/jats:p>","DOI":"10.1145\/3371707","type":"journal-article","created":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T13:33:12Z","timestamp":1576848792000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["The Effects of Task Complexity on the Use of Different Types of Information in a Search Assistance Tool"],"prefix":"10.1145","volume":"38","author":[{"given":"Bogeum","family":"Choi","sequence":"first","affiliation":[{"name":"University of North Carolina at Chapel Hill, Chapel Hill, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Austin","family":"Ward","sequence":"additional","affiliation":[{"name":"University of North Carolina at Chapel Hill, Chapel Hill, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuan","family":"Li","sequence":"additional","affiliation":[{"name":"University of North Carolina at Chapel Hill, Chapel Hill, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaime","family":"Arguello","sequence":"additional","affiliation":[{"name":"University of North Carolina at Chapel Hill, Chapel Hill, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Capra","sequence":"additional","affiliation":[{"name":"University of North Carolina at Chapel Hill, Chapel Hill, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,12,20]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/5657.001.0001"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173618"},{"key":"e_1_2_1_3_1","volume-title":"Krathwohl","author":"Anderson Lorin W.","year":"2001","unstructured":"Lorin W. Anderson and David R . Krathwohl . 2001 . A Taxonomy for Learning, Teaching , and Assessing: A Revision of Bloom\u2019s Taxonomy of Educational Objectives. Pearson . Lorin W. Anderson and David R. Krathwohl. 2001. A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom\u2019s Taxonomy of Educational Objectives. Pearson."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-06028-6_8"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-20161-5_15"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23617"},{"key":"e_1_2_1_7_1","volume-title":"Bell and Ian Ruthven","author":"David","year":"2004","unstructured":"David J. Bell and Ian Ruthven . 2004 . Searchers\u2019 assessments of task complexity for web searching. In Proceedings of the ECIR. Springer , 57--71. David J. Bell and Ian Ruthven. 2004. Searchers\u2019 assessments of task complexity for web searching. In Proceedings of the ECIR. Springer, 57--71."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.10064"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/1072003.1072010"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(94)00041-Z"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.1988.4306775"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767741"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-56608-5_9"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPC.2010.2052859"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331309"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274784.3274788"},{"key":"e_1_2_1_17_1","volume-title":"Henderson and Julie Tallman","author":"Lynette","year":"2006","unstructured":"Lynette D. Henderson and Julie Tallman . 2006 . Stimulated Recall and Mental Models: Tools for Teaching and Learning Computer Information Literacy. Scarecrow Press , 55--91. Lynette D. Henderson and Julie Tallman. 2006. Stimulated Recall and Mental Models: Tools for Teaching and Learning Computer Information Literacy. Scarecrow Press, 55--91."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772724"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the EMNLP-CoNLL. Association for Computational Linguistics, 1511--1521","author":"Duan Huizhong","year":"2012","unstructured":"Huizhong Duan , Yanen Li , ChengXiang Zhai , and Dan Roth . 2012 . A discriminative model for query spelling correction with latent structural SVM . In Proceedings of the EMNLP-CoNLL. Association for Computational Linguistics, 1511--1521 . Huizhong Duan, Yanen Li, ChengXiang Zhai, and Dan Roth. 2012. A discriminative model for query spelling correction with latent structural SVM. In Proceedings of the EMNLP-CoNLL. Association for Computational Linguistics, 1511--1521."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986198"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0021663"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449290701773842"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23803"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1002\/meet.2011.14504801040"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2009.05.004"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/1103646.1103650"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2016.2623782"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2808194.2809465"},{"key":"e_1_2_1_29_1","volume-title":"Wickens","author":"Keppel Geoffrey","year":"1991","unstructured":"Geoffrey Keppel and Thomas D . Wickens . 1991 . Design and Analysis: A Researcher\u2019s Handbook (3rd ed.). Prentice Hall . Geoffrey Keppel and Thomas D. Wickens. 1991. Design and Analysis: A Researcher\u2019s Handbook (3rd ed.). Prentice Hall."},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the SIGIR. ACM, 891--894","author":"Kim Youngho","unstructured":"Youngho Kim and W. Bruce Croft . 2014. Diversifying query suggestions based on query documents . In Proceedings of the SIGIR. ACM, 891--894 . Youngho Kim and W. Bruce Croft. 2014. Diversifying query suggestions based on query documents. In Proceedings of the SIGIR. ACM, 891--894."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983323.2983824"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2008.07.005"},{"key":"e_1_2_1_34_1","volume-title":"Belkin","author":"Liu Chang","year":"2014","unstructured":"Chang Liu , Jingjing Liu , and Nicholas J . Belkin . 2014 . Predicting search task difficulty at different search stages. In Proceedings of the CIKM. ACM , 569--578. Chang Liu, Jingjing Liu, and Nicholas J. Belkin. 2014. Predicting search task difficulty at different search stages. In Proceedings of the CIKM. ACM, 569--578."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1816123.1816134"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398434"},{"key":"e_1_2_1_37_1","volume-title":"Cox","author":"Makri Stephann","year":"2010","unstructured":"Stephann Makri , Ann Blandford , and Anna L . Cox . 2010 . This is what I\u2019m doing and why: Reflections on a think-aloud study of Dl users\u2019 information behaviour. In Proceedings of the JCDL. ACM , 349--352. Stephann Makri, Ann Blandford, and Anna L. Cox. 2010. This is what I\u2019m doing and why: Reflections on a think-aloud study of Dl users\u2019 information behaviour. In Proceedings of the JCDL. ACM, 349--352."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210105"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009966"},{"key":"e_1_2_1_40_1","volume-title":"De Jong","author":"Ramey Judith","year":"2006","unstructured":"Judith Ramey , Ted Boren , Elisabeth Cuddihy , Joe Dumas , Zhiwei Guan , Maaike J. van den Haak , and Menno D. T . De Jong . 2006 . Does think aloud work?: How do we know? In Proceedings of the CHI EA. ACM , 45--48. Judith Ramey, Ted Boren, Elisabeth Cuddihy, Joe Dumas, Zhiwei Guan, Maaike J. van den Haak, and Menno D. T. De Jong. 2006. Does think aloud work?: How do we know? In Proceedings of the CHI EA. ACM, 45--48."},{"key":"e_1_2_1_41_1","volume-title":"Task complexity affects information use: A questionnaire study in city administration. Inform. Res. 19, 4","author":"Saastamoinen Miamaria","year":"2013","unstructured":"Miamaria Saastamoinen , Sanna Kumpulainen , Pertti Vakkari , and Kalervo J\u00e4rvelin . 2013. Task complexity affects information use: A questionnaire study in city administration. Inform. Res. 19, 4 ( 2013 ). Miamaria Saastamoinen, Sanna Kumpulainen, Pertti Vakkari, and Kalervo J\u00e4rvelin. 2013. Task complexity affects information use: A questionnaire study in city administration. Inform. Res. 19, 4 (2013)."},{"key":"e_1_2_1_42_1","volume-title":"Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance. J. Assoc. Inform. Sci. Technol. 58 (11","author":"Saracevic Tefko","year":"2007","unstructured":"Tefko Saracevic . 2007 . Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance. J. Assoc. Inform. Sci. Technol. 58 (11 2007), 2126--2144. Tefko Saracevic. 2007. Relevance: A review of the literature and a framework for thinking on the notion in information science. Part III: Behavior and effects of relevance. J. Assoc. Inform. Sci. Technol. 58 (11 2007), 2126--2144."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484076"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1002\/aris.1440370110"},{"key":"e_1_2_1_45_1","volume-title":"White and Jeff Huang","author":"Ryen","year":"2010","unstructured":"Ryen W. White and Jeff Huang . 2010 . Assessing the scenic route: Measuring the value of search trails in web logs. In Proceedings of the SIGIR. ACM , 587--594. Ryen W. White and Jeff Huang. 2010. Assessing the scenic route: Measuring the value of search trails in web logs. In Proceedings of the SIGIR. ACM, 587--594."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30586-6_53"},{"key":"e_1_2_1_47_1","volume-title":"Learning subjective language. Comput. Ling. 30, 3","author":"Wiebe Janyce","year":"2004","unstructured":"Janyce Wiebe , Theresa Wilson , Rebecca Bruce , Matthew Bell , and Melanie Martin . 2004. Learning subjective language. Comput. Ling. 30, 3 ( 2004 ). Janyce Wiebe, Theresa Wilson, Rebecca Bruce, Matthew Bell, and Melanie Martin. 2004. Learning subjective language. Comput. Ling. 30, 3 (2004)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1108\/JD-03-2014-0056"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2362724.2362768"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/1527090.1527093"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2011.02.007"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3371707","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3371707","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3371707","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:45:23Z","timestamp":1750268723000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3371707"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,20]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,1,31]]}},"alternative-id":["10.1145\/3371707"],"URL":"https:\/\/doi.org\/10.1145\/3371707","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,20]]},"assertion":[{"value":"2019-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-12-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}