{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T02:42:57Z","timestamp":1768012977983,"version":"3.49.0"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T00:00:00Z","timestamp":1648598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["IIS-1451668"],"award-info":[{"award-number":["IIS-1451668"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2022,3,30]]},"abstract":"<jats:p>Our research in this paper lies at the intersection of collaborative and conversational search. We report on a Wizard of Oz lab study in which 27 pairs of participants collaborated on search tasks over the Slack messaging platform. To complete tasks, pairs of collaborators interacted with a so-called searchbot with conversational capabilities. The role of the searchbot was played by a reference librarian. It is widely accepted that conversational search systems should be able to engage in mixed-initiative interaction ---take and relinquish control of a multi-agent conversation as appropriate. Research in discourse analysis differentiates between dialog- and task-level initiative. Taking dialog-level initiative involves leading a conversation for the sole purpose of establishing mutual belief between agents. Conversely, taking task-level initiative involves leading a conversation with the intent to influence the goals of the other agent(s). Participants in our study experienced three searchbot conditions, which varied based on the level of initiative the human searchbot was able to take: (1) no initiative, (2) only dialog-level initiative, and (3) both dialog- and task-level initiative. We investigate the effects of the searchbot condition on six different types of outcomes: (RQ1) perceptions of the searchbot's utility, (RQ2) perceptions of workload, (RQ3) perceptions of the collaboration, (RQ4) patterns of communication and collaboration, and perceived (RQ5) benefits and (RQ6) challenges from engaging with the searchbot.<\/jats:p>","DOI":"10.1145\/3512913","type":"journal-article","created":{"date-parts":[[2022,4,7]],"date-time":"2022-04-07T16:54:59Z","timestamp":1649350499000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["The Effects of System Initiative during Conversational Collaborative Search"],"prefix":"10.1145","volume":"6","author":[{"given":"Sandeep","family":"Avula","sequence":"first","affiliation":[{"name":"Amazon, Seattle, WA, USA"}]},{"given":"Bogeum","family":"Choi","sequence":"additional","affiliation":[{"name":"University of North Carolina, Chapel Hill, NC, USA"}]},{"given":"Jaime","family":"Arguello","sequence":"additional","affiliation":[{"name":"University of North Carolina at Chapel Hill, Chapel Hill, NC, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,4,7]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the SIGCHI conference on Human factors in computing systems. Association for Computing Machinery, 271--278","author":"Adamczyk Piotr D","year":"2004","unstructured":"Piotr D Adamczyk and Brian P Bailey . 2004 . If not now, when? The effects of interruption at different moments within task execution . In Proceedings of the SIGCHI conference on Human factors in computing systems. Association for Computing Machinery, 271--278 . Piotr D Adamczyk and Brian P Bailey. 2004. If not now, when? The effects of interruption at different moments within task execution. In Proceedings of the SIGCHI conference on Human factors in computing systems. Association for Computing Machinery, 271--278."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331265"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3451964.3451967"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-56608-5_3"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295750.3298928"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3176349.3176380"},{"key":"e_1_2_1_8_1","volume-title":"2nd International Workshop on Conversational Approaches to Information Retrieval.","author":"Azzopardi Leif","year":"2018","unstructured":"Leif Azzopardi , Mateusz Dubiel , Martin Halvey , and Jeff Dalton . 2018 . Conceptualizing Agent-Human Interactions during the Conversational Search Process . In 2nd International Workshop on Conversational Approaches to Information Retrieval. Leif Azzopardi, Mateusz Dubiel, Martin Halvey, and Jeff Dalton. 2018. Conceptualizing Agent-Human Interactions during the Conversational Search Process. In 2nd International Workshop on Conversational Approaches to Information Retrieval."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 6th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '83)","author":"Brooks H. M.","unstructured":"H. M. Brooks and N. J. Belkin . 1983. Using Discourse Analysis for the Design of Information Retrieval Interaction Mechanisms . In Proceedings of the 6th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '83) . Association for Computing Machinery, New York, NY, USA, 31--47. H. M. Brooks and N. J. Belkin. 1983. Using Discourse Analysis for the Design of Information Retrieval Interaction Mechanisms. In Proceedings of the 6th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '83). Association for Computing Machinery, New York, NY, USA, 31--47."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1547"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/11766247_47"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/meet.14504901181","article-title":"Design and evaluation of a system to support collaborative search","volume":"49","author":"Capra Robert","year":"2012","unstructured":"Robert Capra , Annie T Chen , Katie Hawthorne , Jaime Arguello , Lee Shaw , and Gary Marchionini . 2012 . Design and evaluation of a system to support collaborative search . Proceedings of the American Society for Information Science and Technology , Vol. 49 , 1 (2012), 1 -- 10 . Robert Capra, Annie T Chen, Katie Hawthorne, Jaime Arguello, Lee Shaw, and Gary Marchionini. 2012. Design and evaluation of a system to support collaborative search. Proceedings of the American Society for Information Science and Technology, Vol. 49, 1 (2012), 1--10.","journal-title":"Proceedings of the American Society for Information Science and Technology"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753468"},{"key":"e_1_2_1_14_1","volume-title":"AI in CAI: An artificial-intelligence approach to computer-assisted instruction","author":"Carbonell Jaime R","year":"1970","unstructured":"Jaime R Carbonell . 1970. AI in CAI: An artificial-intelligence approach to computer-assisted instruction . IEEE transactions on man-machine systems, Vol. 11 , 4 ( 1970 ), 190--202. Jaime R Carbonell. 1970. AI in CAI: An artificial-intelligence approach to computer-assisted instruction. IEEE transactions on man-machine systems, Vol. 11, 4 (1970), 190--202."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20010296"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939746"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.3115\/976909.979651"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3406522.3446030"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274784.3274788"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/985921.986198"},{"key":"e_1_2_1_21_1","volume-title":"Working Notes of AAAI97 Spring Symposium on Mixed-Initiative Interaction","author":"Freedman Reva","year":"1997","unstructured":"Reva Freedman . 1997 . Degrees of mixed-initiative interaction in an intelligent tutoring system . In Working Notes of AAAI97 Spring Symposium on Mixed-Initiative Interaction , Stanford, CA. 44--49. Reva Freedman. 1997. Degrees of mixed-initiative interaction in an intelligent tutoring system. In Working Notes of AAAI97 Spring Symposium on Mixed-Initiative Interaction, Stanford, CA. 44--49."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.73"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2005.856149"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0740-8188(02)00125-1"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401061"},{"key":"e_1_2_1_27_1","volume-title":"Search user interfaces","author":"Hearst Marti","unstructured":"Marti Hearst . 2009. Search user interfaces . Cambridge university press . Marti Hearst. 2009. Search user interfaces. Cambridge university press."},{"key":"e_1_2_1_28_1","volume-title":"Computer","volume":"47","author":"Hearst Marti A.","year":"2014","unstructured":"Marti A. Hearst . 2014 . What's Missing from Collaborative Search ? Computer , Vol. 47 , 3 (2014). Marti A. Hearst. 2014. What's Missing from Collaborative Search? Computer, Vol. 47, 3 (2014)."},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the International AAAI Conference on Web and Social Media","volume":"6","author":"Hecht Brent","year":"2012","unstructured":"Brent Hecht , Jaime Teevan , Meredith Morris , and Dan Liebling . 2012 . Searchbuddies: Bringing search engines into the conversation . In Proceedings of the International AAAI Conference on Web and Social Media , Vol. 6 . AAAI. Brent Hecht, Jaime Teevan, Meredith Morris, and Dan Liebling. 2012. Searchbuddies: Bringing search engines into the conversation. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 6. AAAI."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3020171"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1124772.1124882"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357070"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMC.2015.174"},{"key":"e_1_2_1_35_1","volume-title":"Conceptual Metaphors Impact Perceptions of Human-AI Collaboration. Proceedings of ACM Human-Computer Interaction","volume":"4","author":"Khadpe Pranav","year":"2020","unstructured":"Pranav Khadpe , Ranjay Krishna , Li Fei-Fei , Jeffrey T. Hancock , and Michael S. Bernstein . 2020 . Conceptual Metaphors Impact Perceptions of Human-AI Collaboration. Proceedings of ACM Human-Computer Interaction , Vol. 4 , CSCW ( 2020 ). Pranav Khadpe, Ranjay Krishna, Li Fei-Fei, Jeffrey T. Hancock, and Michael S. Bernstein. 2020. Conceptual Metaphors Impact Perceptions of Human-AI Collaboration. Proceedings of ACM Human-Computer Interaction, Vol. 4, CSCW (2020)."},{"key":"e_1_2_1_36_1","volume-title":"AAAI Symposium on Mixed Initiative Interaction. 89--94","author":"Kortenkamp David","year":"1997","unstructured":"David Kortenkamp , R Peter Bonasso , Dan Ryan , and Debbie Schreckenghost . 1997 . Traded control with autonomous robots as mixed initiative interaction . In AAAI Symposium on Mixed Initiative Interaction. 89--94 . David Kortenkamp, R Peter Bonasso, Dan Ryan, and Debbie Schreckenghost. 1997. Traded control with autonomous robots as mixed initiative interaction. In AAAI Symposium on Mixed Initiative Interaction. 89--94."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858288"},{"key":"e_1_2_1_38_1","volume-title":"The reference interview as partnership: An examination of librarian, library user, and social interaction. The reference librarian","author":"Mabry Celia Hales","year":"2004","unstructured":"Celia Hales Mabry . 2004. The reference interview as partnership: An examination of librarian, library user, and social interaction. The reference librarian , Vol. 40 , 83--84 ( 2004 ), 41--56. Celia Hales Mabry. 2004. The reference interview as partnership: An examination of librarian, library user, and social interaction. The reference librarian, Vol. 40, 83--84 (2004), 41--56."},{"key":"e_1_2_1_39_1","unstructured":"B. Martin B. Hanington and B.M. Hanington. 2012. Universal Methods of Design: 100 Ways to Research Complex Problems Develop Innovative Ideas and Design Effective Solutions .Rockport Publishers.  B. Martin B. Hanington and B.M. Hanington. 2012. Universal Methods of Design: 100 Ways to Research Complex Problems Develop Innovative Ideas and Design Effective Solutions .Rockport Publishers."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357312"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2441776.2441910"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1294211.1294215"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TABLETOP.2006.32"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1518974"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210163"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3020183"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1255"},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Rao Sudha","year":"2019","unstructured":"Sudha Rao and Hal Daum\u00e9 III. 2019 . Answer-based Adversarial Training for Generating Clarification Questions . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). 143--155. Sudha Rao and Hal Daum\u00e9 III. 2019. Answer-based Adversarial Training for Generating Clarification Questions. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 143--155."},{"key":"e_1_2_1_49_1","volume-title":"Integrated demo at CSCW","author":"Shah Chirag","unstructured":"Chirag Shah . 2010. Coagmento-a collaborative information seeking, synthesis and sense-making framework . In Integrated demo at CSCW . Association for Computing Machinery , 6--11. Chirag Shah. 2010. Coagmento-a collaborative information seeking, synthesis and sense-making framework. In Integrated demo at CSCW. Association for Computing Machinery, 6--11."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.22819"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/00380253.2019.1625735"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210002"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3298689.3346982"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3022144"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3409256.3409815"},{"key":"e_1_2_1_56_1","volume-title":"A Large-Scale Analysis of Mixed Initiative in Information-Seeking Dialogues for Conversational Search. ACM Transactions on Information Systems (TOIS)","author":"Vakulenko Svitlana","year":"2021","unstructured":"Svitlana Vakulenko , Evangelos Kanoulas , and Maarten de Rijke . 2021. A Large-Scale Analysis of Mixed Initiative in Information-Seeking Dialogues for Conversational Search. ACM Transactions on Information Systems (TOIS) ( 2021 ). Svitlana Vakulenko, Evangelos Kanoulas, and Maarten de Rijke. 2021. A Large-Scale Analysis of Mixed Initiative in Information-Seeking Dialogues for Conversational Search. ACM Transactions on Information Systems (TOIS) (2021)."},{"key":"e_1_2_1_57_1","volume-title":"Claudio Di Ciccio, and Maarten de Rijke","author":"Vakulenko Svitlana","year":"2019","unstructured":"Svitlana Vakulenko , Kate Revoredo , Claudio Di Ciccio, and Maarten de Rijke . 2019 . QRFA : A Data-Driven Model of Information-Seeking Dialogues. In Advances in Information Retrieval. Springer International Publishing , 541--557. Svitlana Vakulenko, Kate Revoredo, Claudio Di Ciccio, and Maarten de Rijke. 2019. QRFA: A Data-Driven Model of Information-Seeking Dialogues. In Advances in Information Retrieval. Springer International Publishing, 541--557."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053175"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.3115\/981823.981833"},{"key":"e_1_2_1_60_1","volume-title":"Search user interface design. Synthesis lectures on information concepts, retrieval, and services","author":"Wilson Max L","year":"2011","unstructured":"Max L Wilson . 2011. Search user interface design. Synthesis lectures on information concepts, retrieval, and services , Vol. 3 , 3 ( 2011 ), 1--143. Max L Wilson. 2011. Search user interface design. Synthesis lectures on information concepts, retrieval, and services, Vol. 3, 3 (2011), 1--143."},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1002\/meet.14504901386"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380126"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401160"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403202"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271776"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512913","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3512913","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:28Z","timestamp":1750191148000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3512913"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,30]]},"references-count":65,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2022,3,30]]}},"alternative-id":["10.1145\/3512913"],"URL":"https:\/\/doi.org\/10.1145\/3512913","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,30]]},"assertion":[{"value":"2022-04-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}