{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T02:52:02Z","timestamp":1783738322839,"version":"3.55.0"},"reference-count":36,"publisher":"MIT Press","license":[{"start":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T00:00:00Z","timestamp":1684454400000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,5,18]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>In an information-seeking conversation, a user may ask questions that are under-specified or unanswerable. An ideal agent would interact by initiating different response types according to the available knowledge sources. However, most current studies either fail to or artificially incorporate such agent-side initiative. This work presents InSCIt, a dataset for Information-Seeking Conversations with mixed-initiative Interactions. It contains 4.7K user-agent turns from 805 human-human conversations where the agent searches over Wikipedia and either directly answers, asks for clarification, or provides relevant information to address user queries. The data supports two subtasks, evidence passage identification and response generation, as well as a human evaluation protocol to assess model performance. We report results of two systems based on state-of-the-art models of conversational knowledge identification and open-domain question answering. Both systems significantly underperform humans, suggesting ample room for improvement in future studies.1<\/jats:p>","DOI":"10.1162\/tacl_a_00559","type":"journal-article","created":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T19:28:58Z","timestamp":1684524538000},"page":"453-468","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":9,"title":["<scp>InSCIt<\/scp>: Information-Seeking Conversations with Mixed-Initiative Interactions"],"prefix":"10.1162","volume":"11","author":[{"given":"Zeqiu","family":"Wu","sequence":"first","affiliation":[{"name":"University of Washington, USA. zeqiuwu1@uw.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryu","family":"Parish","sequence":"additional","affiliation":[{"name":"University of Washington, USA. rparish@uw.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Cheng","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA. chehao@microsoft.com"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sewon","family":"Min","sequence":"additional","affiliation":[{"name":"University of Washington, USA. sewon@uw.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Prithviraj","family":"Ammanabrolu","sequence":"additional","affiliation":[{"name":"Allen Institute for AI, USA. raja@allenai.org"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mari","family":"Ostendorf","sequence":"additional","affiliation":[{"name":"University of Washington, USA. ostendor@uw.edu"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hannaneh","family":"Hajishirzi","sequence":"additional","affiliation":[{"name":"University of Washington, USA. hannaneh@uw.edu"},{"name":"Allen Institute for AI, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2023,5,18]]},"reference":[{"key":"2023051919285159400_bib1","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1162\/tacl_a_00471","article-title":"TopiOCQA: Open-domain conversational question answering with topic switching","volume":"10","author":"Adlakha","year":"2022","journal-title":"Transactions of the Association for Computational Linguistics"},{"key":"2023051919285159400_bib2","doi-asserted-by":"publisher","first-page":"4473","DOI":"10.18653\/v1\/2021.emnlp-main.367","article-title":"Building and evaluating open-domain dialogue corpora with clarifying questions","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Aliannejadi","year":"2021"},{"key":"2023051919285159400_bib3","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331265","article-title":"Asking clarifying questions in open-domain information-seeking conversations","volume-title":"Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Aliannejadi","year":"2019"},{"key":"2023051919285159400_bib4","doi-asserted-by":"publisher","first-page":"520","DOI":"10.18653\/v1\/2021.naacl-main.44","article-title":"Open-domain question answering goes conversational via question rewriting","volume-title":"Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Anantha","year":"2021"},{"key":"2023051919285159400_bib5","doi-asserted-by":"publisher","first-page":"7302","DOI":"10.18653\/v1\/2020.acl-main.652","article-title":"DoQA - accessing domain-specific FAQs via conversational QA","volume-title":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","author":"Campos","year":"2020"},{"key":"2023051919285159400_bib6","doi-asserted-by":"publisher","first-page":"2174","DOI":"10.18653\/v1\/D18-1241","article-title":"QuAC: Question answering in context","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Choi","year":"2018"},{"key":"2023051919285159400_bib7","first-page":"4171","article-title":"BERT: Pre-training of deep bidirectional transformers for language understanding","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin","year":"2019"},{"key":"2023051919285159400_bib8","article-title":"Wizard of Wikipedia: Knowledge-powered conversational agents","volume-title":"International Conference on Learning Representations","author":"Dinan","year":"2019"},{"key":"2023051919285159400_bib9","doi-asserted-by":"publisher","first-page":"155","DOI":"10.18653\/v1\/2022.dialdoc-1.18","article-title":"DialDoc 2022 shared task: Open-book document-grounded dialogue modeling","volume-title":"Proceedings of the Second DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering","author":"Feng","year":"2022"},{"key":"2023051919285159400_bib10","doi-asserted-by":"publisher","first-page":"6162","DOI":"10.18653\/v1\/2021.emnlp-main.498","article-title":"MultiDoc2Dial: Modeling dialogues grounded in multiple documents","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Feng","year":"2021"},{"key":"2023051919285159400_bib11","doi-asserted-by":"publisher","first-page":"8118","DOI":"10.18653\/v1\/2020.emnlp-main.652","article-title":"doc2dial: A goal-oriented document-grounded dialogue dataset","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Feng","year":"2020"},{"key":"2023051919285159400_bib12","doi-asserted-by":"publisher","first-page":"599","DOI":"10.18653\/v1\/2022.acl-short.66","article-title":"UniGDD: A unified generative framework for goal-oriented document-grounded dialogue","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)","author":"Gao","year":"2022"},{"key":"2023051919285159400_bib13","doi-asserted-by":"publisher","first-page":"5110","DOI":"10.1609\/aaai.v32i1.11977","article-title":"A knowledge-grounded neural conversation model","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Ghazvininejad","year":"2018"},{"key":"2023051919285159400_bib14","article-title":"Abg-coQA: Clarifying ambiguity in conversational question answering","volume-title":"3rd Conference on Automated Knowledge Base Construction","author":"Guo","year":"2021"},{"key":"2023051919285159400_bib15","article-title":"spaCy: Industrial-strength natural language processing in Python","author":"Honnibal","year":"2020"},{"key":"2023051919285159400_bib16","doi-asserted-by":"publisher","first-page":"874","DOI":"10.18653\/v1\/2021.eacl-main.74","article-title":"Leveraging passage retrieval with generative models for open domain question answering","volume-title":"Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume","author":"Izacard","year":"2021"},{"key":"2023051919285159400_bib17","doi-asserted-by":"publisher","first-page":"6769","DOI":"10.18653\/v1\/2020.emnlp-main.550","article-title":"Dense passage retrieval for open-domain question answering","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Karpukhin","year":"2020"},{"key":"2023051919285159400_bib18","doi-asserted-by":"publisher","first-page":"149","DOI":"10.4018\/978-1-4666-2169-5.ch007","article-title":"Interactive question answering","author":"Konstantinova","year":"2013","journal-title":"Emerging Applications of Natural Language Processing: Concepts and New Research"},{"key":"2023051919285159400_bib19","doi-asserted-by":"crossref","first-page":"8074","DOI":"10.18653\/v1\/2022.acl-long.555","article-title":"Ditch the gold standard: Re-evaluating conversational question answering","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Li","year":"2022"},{"key":"2023051919285159400_bib20","doi-asserted-by":"publisher","first-page":"5783","DOI":"10.18653\/v1\/2020.emnlp-main.466","article-title":"AmbigQA: Answering ambiguous open-domain questions","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Min","year":"2020"},{"key":"2023051919285159400_bib21","doi-asserted-by":"publisher","first-page":"2322","DOI":"10.18653\/v1\/D18-1255","article-title":"Towards exploiting background knowledge for building conversation systems","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Moghe","year":"2018"},{"key":"2023051919285159400_bib22","article-title":"Webgpt: Browser-assisted question-answering with human feedback","author":"Nakano","year":"2021","journal-title":"arXiv preprint arXiv:2112.09332"},{"key":"2023051919285159400_bib23","article-title":"Introducing mantis: A novel multi-domain information seeking dialogues dataset","author":"Penha","year":"2019","journal-title":"arXiv preprint arXiv:1912.04639"},{"key":"2023051919285159400_bib24","doi-asserted-by":"publisher","first-page":"186","DOI":"10.18653\/v1\/W18-6319","article-title":"A call for clarity in reporting BLEU scores","volume-title":"Proceedings of the Third Conference on Machine Translation: Research Papers","author":"Post","year":"2018"},{"key":"2023051919285159400_bib25","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1162\/tacl_a_00266","article-title":"CoQA: A conversational question answering challenge","volume":"7","author":"Reddy","year":"2019","journal-title":"Transactions of the Association for Computational Linguistics"},{"issue":"1","key":"2023051919285159400_bib26","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1017\/S1351324908004907","article-title":"Does this list contain what you were searching for? Learning adaptive dialogue strategies for interactive question answering","volume":"15","author":"Rieser","year":"2009","journal-title":"Natural Language Engineering"},{"issue":"4","key":"2023051919285159400_bib27","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1561\/1500000019","article-title":"The probabilistic relevance framework: Bm25 and beyond","volume":"3","author":"Robertson","year":"2009","journal-title":"Foundations and Trends in Information Retrieval"},{"key":"2023051919285159400_bib28","doi-asserted-by":"publisher","first-page":"8153","DOI":"10.18653\/v1\/2020.emnlp-main.655","article-title":"Information seeking in the spirit of learning: A dataset for conversational curiosity","volume-title":"Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Rodriguez","year":"2020"},{"key":"2023051919285159400_bib29","doi-asserted-by":"publisher","first-page":"2087","DOI":"10.18653\/v1\/D18-1233","article-title":"Interpretation of natural language rules in conversational machine reading","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Saeidi","year":"2018"},{"key":"2023051919285159400_bib30","doi-asserted-by":"crossref","first-page":"3627","DOI":"10.18653\/v1\/2022.acl-long.253","article-title":"ConditionalQA: A complex reading comprehension dataset with conditional answers","volume-title":"Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)","author":"Sun","year":"2022"},{"issue":"1","key":"2023051919285159400_bib31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1017\/S1351324908004877","article-title":"Special issue on interactive question answering: Introduction","volume":"15","author":"Webb","year":"2009","journal-title":"Natural Language Engineering"},{"key":"2023051919285159400_bib32","first-page":"438","article-title":"A network-based end-to-end trainable task-oriented dialogue system","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers","author":"Wen","year":"2017"},{"key":"2023051919285159400_bib33","first-page":"1852","article-title":"DIALKI: Knowledge identification in conversational systems through dialogue-document contextualization","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Zeqiu","year":"2021"},{"key":"2023051919285159400_bib34","doi-asserted-by":"publisher","first-page":"1253","DOI":"10.1145\/3077136.3080721","article-title":"Anserini: Enabling the use of lucene for information retrieval research","volume-title":"Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Yang","year":"2017"},{"key":"2023051919285159400_bib35","doi-asserted-by":"publisher","first-page":"7371","DOI":"10.18653\/v1\/2021.emnlp-main.586","article-title":"SituatedQA: Incorporating extra-linguistic contexts into QA","volume-title":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","author":"Zhang","year":"2021"},{"key":"2023051919285159400_bib36","doi-asserted-by":"publisher","first-page":"708","DOI":"10.18653\/v1\/D18-1076","article-title":"A dataset for document grounded conversations","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing","author":"Zhou","year":"2018"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00559\/2102907\/tacl_a_00559.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/tacl\/article-pdf\/doi\/10.1162\/tacl_a_00559\/2102907\/tacl_a_00559.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,19]],"date-time":"2023-05-19T19:29:06Z","timestamp":1684524546000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/doi\/10.1162\/tacl_a_00559\/116048\/InSCIt-Information-Seeking-Conversations-with"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,18]]},"references-count":36,"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00559","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,18]]}}}