{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T16:12:12Z","timestamp":1772122332469,"version":"3.50.1"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T00:00:00Z","timestamp":1630454400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100010785","name":"Canada First Research Excellence Fund","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100010785","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology in Taiwan","doi-asserted-by":"crossref","award":["MOST 107-2218-E-002-061"],"award-info":[{"award-number":["MOST 107-2218-E-002-061"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2021,10,31]]},"abstract":"<jats:p>\n            Conversational search plays a vital role in conversational information seeking. As queries in information seeking dialogues are ambiguous for traditional ad hoc information retrieval (IR) systems due to the coreference and omission resolution problems inherent in natural language dialogue, resolving these ambiguities is crucial. In this article, we tackle conversational passage retrieval, an important component of conversational search, by addressing query ambiguities with query reformulation integrated into a multi-stage ad hoc IR system. Specifically, we propose two conversational query reformulation (CQR) methods: (1) term importance estimation and (2) neural query rewriting. For the former, we expand conversational queries using important terms extracted from the conversational context with frequency-based signals. For the latter, we reformulate conversational queries into natural, stand-alone, human-understandable queries with a pretrained sequence-to-sequence model. Detailed analyses of the two CQR methods are provided quantitatively and qualitatively, explaining their advantages, disadvantages, and distinct behaviors. Moreover, to leverage the strengths of both CQR methods, we propose combining their output with reciprocal rank fusion, yielding state-of-the-art retrieval effectiveness, 30% improvement in terms of NDCG@3 compared to the best submission of\n            <jats:bold>Text REtrieval Conference (TREC) Conversational Assistant Track (CAsT)<\/jats:bold>\n            2019.\n          <\/jats:p>","DOI":"10.1145\/3446426","type":"journal-article","created":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T19:35:32Z","timestamp":1630524932000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query Rewriting"],"prefix":"10.1145","volume":"39","author":[{"given":"Sheng-Chieh","family":"Lin","sequence":"first","affiliation":[{"name":"Research Center for Information Technology Innovation, Academia Sinica"}]},{"given":"Jheng-Hong","family":"Yang","sequence":"additional","affiliation":[{"name":"Research Center for Information Technology Innovation, Academia Sinica"}]},{"given":"Rodrigo","family":"Nogueira","sequence":"additional","affiliation":[{"name":"David R. Cheriton School of Computer Science, University of Waterloo"}]},{"given":"Ming-Feng","family":"Tsai","sequence":"additional","affiliation":[{"name":"Department of Computer Science, National Chengchi University"}]},{"given":"Chuan-Ju","family":"Wang","sequence":"additional","affiliation":[{"name":"Research Center for Information Technology Innovation, Academia Sinica"}]},{"given":"Jimmy","family":"Lin","sequence":"additional","affiliation":[{"name":"David R. Cheriton School of Computer Science, University of Waterloo"}]}],"member":"320","published-online":{"date-parts":[[2021,9]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proc. ICLR.","author":"Ahmad Wasi Uddin","year":"2018"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331246"},{"key":"e_1_2_1_3_1","volume-title":"Proc. EMNLP: System Demonstrations. 19\u201324","author":"Yilmaz Zeynep Akkalyoncu","year":"2019"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343413.3377968"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331265"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-012-9217-9"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2484028.2484132"},{"key":"e_1_2_1_8_1","volume-title":"Proc. of NIPS: the Workshop on Cognitive Computation. 1773","author":"Bajaj Payal","year":"2016"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/160688.160760"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3345001"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341981.3344230"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1179"},{"key":"e_1_2_1_13_1","doi-asserted-by":"crossref","unstructured":"Eunsol Choi He He Mohit Iyyer Mark Yatskar Wen-tau Yih Yejin Choi Percy Liang and Luke Zettlemoyer. 2018. QuAC: Question answering in context. arXiv:1808.07036. Retrieved from https:\/\/arxiv.org\/abs\/1808.07036.  Eunsol Choi He He Mohit Iyyer Mark Yatskar Wen-tau Yih Yejin Choi Percy Liang and Luke Zettlemoyer. 2018. QuAC: Question answering in context. arXiv:1808.07036. Retrieved from https:\/\/arxiv.org\/abs\/1808.07036.","DOI":"10.18653\/v1\/D18-1241"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-016-9279-1"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1572114"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/564376.564429"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3015022.3015026"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274784.3274788"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331303"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401204"},{"key":"e_1_2_1_21_1","volume-title":"Proc. TREC.","author":"Dalton Jeffrey","year":"2019"},{"key":"e_1_2_1_22_1","volume-title":"Proc. NAACL. 4171\u20134186","author":"Devlin Jacob","year":"2019"},{"key":"e_1_2_1_23_1","volume-title":"Proc. TREC.","author":"Dietz Laura","year":"2018"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455457"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1605"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3290986"},{"key":"e_1_2_1_27_1","first-page":"2712","article-title":"Using pre-training can improve model robustness and uncertainty","volume":"97","author":"Hendrycks Dan","year":"2019","journal-title":"Proc. ICML"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080801"},{"key":"e_1_2_1_29_1","volume-title":"Natural questions: A benchmark for question answering research. Trans. ACL","author":"Kwiatkowski Tom","year":"2019"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.383972"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080664"},{"key":"e_1_2_1_32_1","unstructured":"Sheng-Chieh Lin Jheng-Hong Yang Rodrigo Nogueira Ming-Feng Tsai Chuan-Ju Wang and Jimmy Lin. 2020. Conversational question reformulation via sequence-to-sequence architectures and pretrained language models. arXiv:2004.01909. Retrieved from https:\/\/arxiv.org\/abs\/2004.01909.  Sheng-Chieh Lin Jheng-Hong Yang Rodrigo Nogueira Ming-Feng Tsai Chuan-Ju Wang and Jimmy Lin. 2020. Conversational question reformulation via sequence-to-sequence architectures and pretrained language models. arXiv:2004.01909. Retrieved from https:\/\/arxiv.org\/abs\/2004.01909."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646259"},{"key":"e_1_2_1_34_1","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"van der Maaten Laurens","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210005"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1061"},{"key":"e_1_2_1_37_1","unstructured":"Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage re-ranking with BERT. arXiv:1901.04085. Retrieved from https:\/\/arxiv.org\/abs\/1901.04085.  Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage re-ranking with BERT. arXiv:1901.04085. Retrieved from https:\/\/arxiv.org\/abs\/1901.04085."},{"key":"e_1_2_1_38_1","unstructured":"Rodrigo Nogueira and Jimmy Lin. 2019. From doc2query to docTTTTTquery. Retrieved from https:\/\/cs.uwaterloo.ca\/ jimmylin\/publications\/Nogueira_Lin_2019_docTTTTTquery-v2.pdf.  Rodrigo Nogueira and Jimmy Lin. 2019. From doc2query to docTTTTTquery. Retrieved from https:\/\/cs.uwaterloo.ca\/ jimmylin\/publications\/Nogueira_Lin_2019_docTTTTTquery-v2.pdf."},{"key":"e_1_2_1_39_1","unstructured":"Rodrigo Nogueira Wei Yang Kyunghyun Cho and Jimmy Lin. 2019. Multi-stage document ranking with BERT. arXiv:1910.14424. Retrieved from https:\/\/arxiv.org\/abs\/1910.14424.  Rodrigo Nogueira Wei Yang Kyunghyun Cho and Jimmy Lin. 2019. Multi-stage document ranking with BERT. arXiv:1910.14424. Retrieved from https:\/\/arxiv.org\/abs\/1910.14424."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/636669.636674"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.191"},{"key":"e_1_2_1_42_1","unstructured":"Gustavo Penha Alexandru Balan and Claudia Hauff. 2019. Introducing MANtIS: A novel multi-domain information seeking dialogues dataset. arXiv:1912.04639. Retrieved from https:\/\/arxiv.org\/abs\/1912.04639.  Gustavo Penha Alexandru Balan and Claudia Hauff. 2019. Introducing MANtIS: A novel multi-domain information seeking dialogues dataset. arXiv:1912.04639. Retrieved from https:\/\/arxiv.org\/abs\/1912.04639."},{"key":"e_1_2_1_43_1","volume-title":"Language models are unsupervised multitask learners. OpenAI blog 1, 8","author":"Radford Alec","year":"2018"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3020183"},{"key":"e_1_2_1_45_1","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel Colin","year":"2020","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186083"},{"key":"e_1_2_1_47_1","volume-title":"Proc. TREC.","author":"Robertson Stephen E.","year":"1994"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331334"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-3017"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2180868.2180873"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806493"},{"key":"e_1_2_1_52_1","unstructured":"Sandeep Subramanian Raymond Li Jonathan Pilault and Christopher Pal. 2019. On extractive and abstractive neural document summarization with transformer language models. arXiv:1909.03186. Retrieved from https:\/\/arxiv.org\/abs\/1909.03186.  Sandeep Subramanian Raymond Li Jonathan Pilault and Christopher Pal. 2019. On extractive and abstractive neural document summarization with transformer language models. arXiv:1909.03186. Retrieved from https:\/\/arxiv.org\/abs\/1909.03186."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1455"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969033.2969173"},{"key":"e_1_2_1_55_1","volume-title":"Proc. TREC.","author":"Tomlinson Stephen","year":"2004"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433407"},{"key":"e_1_2_1_57_1","unstructured":"Zhucheng Tu Matt Crane Royal Sequiera Junchen Zhang and Jimmy Lin. 2017. An exploration of approaches to integrating neural reranking models in multi-stage ranking architectures. arXiv:1707.08275. Retrieved from https:\/\/arxiv.org\/abs\/1707.08275.  Zhucheng Tu Matt Crane Royal Sequiera Junchen Zhang and Jimmy Lin. 2017. An exploration of approaches to integrating neural reranking models in multi-stage ranking architectures. arXiv:1707.08275. Retrieved from https:\/\/arxiv.org\/abs\/1707.08275."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441748"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_1_60_1","volume-title":"Overview of the TREC 2004 robust retrieval track. Proc. TREC.","author":"Voorhees Ellen M.","year":"2004"},{"key":"e_1_2_1_61_1","volume-title":"Proc. TREC.","author":"Voskarides Nikos","year":"2019"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401130"},{"key":"e_1_2_1_63_1","volume-title":"Proc. ICLR.","author":"Wang Shuohang","year":"2018"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/243199.243202"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2747874"},{"key":"e_1_2_1_66_1","volume-title":"Proc. TREC.","author":"Yang Jheng-Hong","year":"2019"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239571"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401323"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331253"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277835"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234944.3234962"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446426","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3446426","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:27Z","timestamp":1750191447000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3446426"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9]]},"references-count":71,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,10,31]]}},"alternative-id":["10.1145\/3446426"],"URL":"https:\/\/doi.org\/10.1145\/3446426","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9]]},"assertion":[{"value":"2020-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}