{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T16:51:51Z","timestamp":1792687911997,"version":"4.5.0"},"reference-count":189,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T00:00:00Z","timestamp":1670371200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council","doi-asserted-by":"crossref","award":["RGPIN-2020-07157"],"award-info":[{"award-number":["RGPIN-2020-07157"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2023,7,31]]},"abstract":"<jats:p>\n                    The advent of recent Natural Language Processing technology has led human and machine interactions more toward conversation. In Conversational Search Systems (CSS) like chatbots and Virtual Personal Assistants such as Apple\u2019s Siri, Amazon Alexa, Microsoft\u2019s Cortana, and Google Assistant, both user and device have a limited platform to communicate through chatting or voice. In the information-seeking process, often users do not know how to properly describe their information need in a machine understandable language. Consequently, it is hard for the assistant agent to predict the user\u2019s intent and yield relevant results by only relying on the original query. Studies have shown many unsatisfactory results can be enhanced with the benefit of CSS, which can dig deeper into the user\u2019s query to reveal the real need. This survey intends to provide a comprehensive and comparative overview of\n                    <jats:italic>ambiguous query clarification<\/jats:italic>\n                    task in the context of conversational search technology. We investigate different approaches, their evaluation methods, and future work. We also address the importance of understanding a query for retrieving the most relevant document(s) and satisfying user\u2019s need by predicting their potential request. This work provides an overview of characteristics of ambiguous queries and contributes to better understanding of the existing technologies and challenges in CSS focus on disambiguation of unclear queries from various dimensions.\n                  <\/jats:p>","DOI":"10.1145\/3534965","type":"journal-article","created":{"date-parts":[[2022,5,25]],"date-time":"2022-05-25T07:56:03Z","timestamp":1653465363000},"page":"1-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":69,"title":["How to Approach Ambiguous Queries in Conversational Search: A Survey of Techniques, Approaches, Tools, and Challenges"],"prefix":"10.1145","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1944-1191","authenticated-orcid":false,"given":"Kimiya","family":"Keyvan","sequence":"first","affiliation":[{"name":"York University, Toronto, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1292-1491","authenticated-orcid":false,"given":"Jimmy Xiangji","family":"Huang","sequence":"additional","affiliation":[{"name":"York University, Toronto, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,12,7]]},"reference":[{"key":"e_1_3_4_2_2","first-page":"265","volume-title":"Proceedings of the 12th USENIX Symposium on OSDI 16","author":"Abadi Mart\u00edn","year":"2016","unstructured":"Mart\u00edn Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, et\u00a0al. 2016. TensorFlow: A system for Large-scale machine learning. In Proceedings of the 12th USENIX Symposium on OSDI 16. 265\u2013283."},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482231"},{"key":"e_1_3_4_4_2","unstructured":"Mohammad Aliannejadi Julia Kiseleva Aleksandr Chuklin Jeff Dalton and Mikhail Burtsev. 2020. ConvAI3: Generating clarifying questions for open-domain dialogue systems (ClariQ). Retrieved from https:\/\/arXiv:2009.11352."},{"key":"e_1_3_4_5_2","doi-asserted-by":"crossref","unstructured":"Mohammad Aliannejadi Julia Kiseleva Aleksandr Chuklin Jeffrey Dalton and Mikhail Burtsev. 2021. Building and evaluating open-domain dialogue corpora with clarifying questions. Retrieved from https:\/\/arXiv:2109.05794.","DOI":"10.18653\/v1\/2021.emnlp-main.367"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331265"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/5254.796083"},{"key":"e_1_3_4_8_2","first-page":"107","article-title":"Recognizing intentions from natural language utterances","author":"Allen James F.","year":"1983","unstructured":"James F. Allen. 1983. Recognizing intentions from natural language utterances. In Comput. Models Discourse, Michael Brady and Robert C. Berwick (Eds.). MIT Press, 107\u2013166.","journal-title":"Comput. Models Discourse"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1075\/nlp.1.02all"},{"key":"e_1_3_4_10_2","volume-title":"Dagstuhl Reports","author":"Anand Avishek","year":"2020","unstructured":"Avishek Anand, Lawrence Cavedon, Hideo Joho, Mark Sanderson, and Benno Stein. 2020. Conversational search (dagstuhl seminar 19461). In Dagstuhl Reports, Vol. 9. Schloss Dagstuhl-Leibniz-Zentrum f\u00fcr Informatik."},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-76298-0_52"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1287\/opre.18.5.947"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3343413.3377941"},{"key":"e_1_3_4_14_2","volume-title":"How Wikipedia Works: And How You Can Be a Part of It","author":"Ayers Phoebe","year":"2008","unstructured":"Phoebe Ayers, Charles Matthews, and Ben Yates. 2008. How Wikipedia Works: And How You Can Be a Part of It. No Starch Press."},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.05.009"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/11880561_9"},{"key":"e_1_3_4_17_2","unstructured":"Dzmitry Bahdanau Kyunghyun Cho and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. Retrieved from https:\/\/arXiv:1409.0473."},{"key":"e_1_3_4_18_2","first-page":"80","volume-title":"Proceedings of the 2nd International DESIRES Conference","volume":"2950","author":"Balog Krisztian","year":"2021","unstructured":"Krisztian Balog. 2021. Conversational AI from an information retrieval perspective: Remaining challenges and a case for user simulation. In Proceedings of the 2nd International DESIRES Conference, Vol. 2950. CEUR-WS.org, 80\u201390."},{"key":"e_1_3_4_19_2","first-page":"65","volume-title":"Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization","author":"Banerjee Satanjeev","year":"2005","unstructured":"Satanjeev Banerjee and Alon Lavie. 2005. METEOR: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization. 65\u201372."},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-009-9081-4"},{"key":"e_1_3_4_21_2","volume-title":"Questioning the Author: An Approach for Enhancing Student Engagement with Text.","author":"Beck Isabel L.","year":"1997","unstructured":"Isabel L. Beck et\u00a0al. 1997. Questioning the Author: An Approach for Enhancing Student Engagement with Text.Newark, DE: International Reading Association."},{"key":"e_1_3_4_22_2","first-page":"157","volume-title":"Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval","author":"Bi Keping","year":"2021","unstructured":"Keping Bi, Qingyao Ai, and W. Bruce Croft. 2021. Asking clarifying questions based on negative feedback in conversational search. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval. 157\u2013166."},{"key":"e_1_3_4_23_2","first-page":"1","volume-title":"Proceedings of the Information Retrieval for Question Answering Workshop at SIGIR (IR4QA\u201904)","author":"Bilotti Matthew W.","year":"2004","unstructured":"Matthew W. Bilotti, Boris Katz, Jimmy Lin, et\u00a0al. 2004. What works better for question answering: Stemming or morphological query expansion. In Proceedings of the Information Retrieval for Question Answering Workshop at SIGIR (IR4QA\u201904). 1\u20133."},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/1376616.1376746"},{"key":"e_1_3_4_25_2","first-page":"345","volume-title":"Proceedings of the Conference on CHIIR","author":"Braslavski Pavel","year":"2017","unstructured":"Pavel Braslavski, Denis Savenkov, Eugene Agichtein, and Alina Dubatovka. 2017. What do you mean exactly? Analyzing clarification questions in CQA. In Proceedings of the Conference on CHIIR. 345\u2013348."},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7552(98)00110-X"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401995"},{"key":"e_1_3_4_28_2","first-page":"53","volume-title":"Proceedings of the WNLP@ ACL","author":"Cao Yang Trista","year":"2019","unstructured":"Yang Trista Cao, Rao, et al.2019. Controlling the specificity of clarification question generation. In Proceedings of the WNLP@ ACL. 53\u201356."},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/2071389.2071390"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646033"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3166054.3166058"},{"key":"e_1_3_4_32_2","doi-asserted-by":"crossref","unstructured":"Eunsol Choi He He Mohit Iyyer Mark Yatskar Wen-tau Yih Yejin Choi Percy Liang and Luke Zettlemoyer. 2018. Quac: Question answering in context. Retrieved from https:\/\/arXiv:1808.07036.","DOI":"10.18653\/v1\/D18-1241"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511620539"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1302_7"},{"key":"e_1_3_4_35_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Clark Kevin","year":"2020","unstructured":"Kevin Clark, Minh-Thang Luong, Quoc V. Le, and Christopher D. Manning. 2020. ELECTRA: Pre-training text encoders as discriminators rather than generators. In Proceedings of the International Conference on Learning Representations. Retrieved from https:\/\/openreview.net\/forum?id=r1xMH1BtvB."},{"key":"e_1_3_4_36_2","volume-title":"Overview of the Trec 2009 Web Track","author":"Clarke Charles L.","year":"2009","unstructured":"Charles L. Clarke, Nick Craswell, and Ian Soboroff. 2009. Overview of the Trec 2009 Web Track. Technical Report. In Proceedings of the TREC\u201909."},{"key":"e_1_3_4_37_2","volume-title":"Proceedings of the SumPre-HSWI@ ESWC","author":"Coden Anni","year":"2015","unstructured":"Anni Coden, Daniel Gruhl, Neal Lewis, and Pablo N. Mendes. 2015. Did you mean A or B? Supporting clarification dialog for entity disambiguation. In Proceedings of the SumPre-HSWI@ ESWC."},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1163\/9789004368811_005"},{"key":"e_1_3_4_39_2","first-page":"34","volume-title":"Proceedings of the ACM SIGIR Forum","volume":"52","author":"Culpepper J. Shane","year":"2018","unstructured":"J. Shane Culpepper, Fernando Diaz, and Mark D. Smucker. 2018. Research frontiers in information retrieval: Report from the 3rd strategic workshop on information retrieval in Lorne (SWIRL\u201918). In Proceedings of the ACM SIGIR Forum, Vol. 52. ACM New York, NY, 34\u201390."},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.5555\/534996"},{"key":"e_1_3_4_41_2","doi-asserted-by":"crossref","unstructured":"Jeffrey Dalton Chenyan Xiong and Jamie Callan. 2020. TREC CAsT 2019: The conversational assistance track overview. Retrieved from https:\/\/arXiv:2003.13624.","DOI":"10.6028\/NIST.SP.1266.cast-overview"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401206"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/1718487.1718493"},{"key":"e_1_3_4_44_2","first-page":"48","volume-title":"Proceedings of the NAACL-HLT","author":"Boni Marco De","year":"2003","unstructured":"Marco De Boni and Suresh Manandhar. 2003. An analysis of clarification dialogue for question answering. In Proceedings of the NAACL-HLT. 48\u201355."},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-020-09866-x"},{"key":"e_1_3_4_46_2","first-page":"4171","volume-title":"Proceedings of the Conference of the NAACL-HLT","volume":"1","author":"Devlin J.","year":"2019","unstructured":"J. Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the NAACL-HLT, Vol. 1. 4171\u20134186."},{"key":"e_1_3_4_47_2","unstructured":"Kaustubh D. Dhole. 2020. Resolving intent ambiguities by retrieving discriminative clarifying questions. Retrieved from https:\/\/arXiv:2008.07559."},{"key":"e_1_3_4_48_2","unstructured":"Kaustubh D. Dhole and Christopher D. Manning. 2020. Syn-QG: Syntactic and shallow semantic rules for question generation. Retrieved from https:\/\/arXiv:2004.08694."},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.3102\/00346543054003327"},{"key":"e_1_3_4_50_2","volume-title":"Questioning and Teaching: A Manual of Practice","author":"Dillon James Thomas","year":"1988","unstructured":"James Thomas Dillon. 1988. Questioning and Teaching: A Manual of Practice. Croom Helm."},{"key":"e_1_3_4_51_2","first-page":"121","article-title":"Query expansion.","volume":"31","author":"Efthimiadis Efthimis N.","year":"1996","unstructured":"Efthimis N. Efthimiadis. 1996. Query expansion. Annu. Rev. Info. Sci. Technol. 31 (1996), 121\u201387.","journal-title":"Annu. Rev. Info. Sci. Technol."},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1605"},{"key":"e_1_3_4_53_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/7287.001.0001","article-title":"WordNet","author":"Fellbaum Christiane","year":"1998","unstructured":"Christiane Fellbaum. 1998. WordNet. An Electronic Lexical Database (Language, Speech and Communication).","journal-title":"An Electronic Lexical Database (Language, Speech and Communication)"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.eacl-main.197"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00309225"},{"key":"e_1_3_4_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2914701"},{"key":"e_1_3_4_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/32206.32212"},{"key":"e_1_3_4_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMPSAC.2019.00070"},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000074"},{"key":"e_1_3_4_60_2","first-page":"10","volume-title":"Proceedings of the Workshop on Question Generation","author":"Graesser Art","year":"2008","unstructured":"Art Graesser, Vasile Rus, and Zhiqiang Cai. 2008. Question classification schemes. In Proceedings of the Workshop on Question Generation. 10\u201317."},{"key":"e_1_3_4_61_2","first-page":"167","article-title":"Mechanisms that generate questions","volume":"2","author":"Graesser Arthur C.","year":"1992","unstructured":"Arthur C. Graesser, Natalie Person, and John Huber. 1992. Mechanisms that generate questions. Quest. Info. Syst. 2 (1992), 167\u2013187.","journal-title":"Quest. Info. Syst."},{"key":"e_1_3_4_62_2","doi-asserted-by":"publisher","DOI":"10.3102\/00028312031001104"},{"key":"e_1_3_4_63_2","unstructured":"Xiaoxiao Guo Tim Klinger Clemens Rosenbaum Joseph P. Bigus Murray Campbell Ban Kawas Kartik Talamadupula Gerry Tesauro and Satinder Singh. 2016. Learning to query reason and answer questions on ambiguous texts. In Proceedings of the 5th International Conference on Learning Representations (ICLR) . 12 pages."},{"key":"e_1_3_4_64_2","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324903003176"},{"key":"e_1_3_4_65_2","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199101)42:1<7::AID-ASI2>3.0.CO;2-P"},{"key":"e_1_3_4_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401061"},{"key":"e_1_3_4_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505682"},{"key":"e_1_3_4_68_2","first-page":"543","volume-title":"Proceedings of the 24th ACM CIKM","author":"Awadallah Ahmed Hassan","year":"2015","unstructured":"Ahmed Hassan Awadallah, Ranjitha Gurunath Kulkarni, Umut Ozertem, and Rosie Jones. 2015. Characterizing and predicting voice query reformulation. In Proceedings of the 24th ACM CIKM. 543\u2013552."},{"key":"e_1_3_4_69_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(83)80049-2"},{"key":"e_1_3_4_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2011.03.007"},{"key":"e_1_3_4_71_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-industry.8"},{"key":"e_1_3_4_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1645966"},{"key":"e_1_3_4_73_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026028229881"},{"key":"e_1_3_4_74_2","volume-title":"Proceedings of the 14th Text Retrieval Conference (TREC\u201905)","author":"Huang Xiangji","year":"2005","unstructured":"Xiangji Huang, Ming Zhong, and Luo Si. 2005. York university at TREC 2005: Genomics track. In Proceedings of the 14th Text Retrieval Conference (TREC\u201905). Citeseer."},{"key":"e_1_3_4_75_2","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613835"},{"key":"e_1_3_4_76_2","volume-title":"Proceedings of the 7th Annual Symposium on Human-computer Interaction and Information Retrieval","author":"Jeng Wei","year":"2013","unstructured":"Wei Jeng, Daqing He, and Jiepu Jiang. 2013. Users\u2019 perceived difficulties and corresponding reformulation strategies in voice search. In Proceedings of the 7th Annual Symposium on Human-computer Interaction and Information Retrieval."},{"key":"e_1_3_4_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741669"},{"key":"e_1_3_4_78_2","first-page":"143","volume-title":"Proceedings of the 36th International ACM SIGIR","author":"Jiang Jiepu","year":"2013","unstructured":"Jiepu Jiang, Wei Jeng, and Daqing He. 2013. How do users respond to voice input errors? Lexical and phonetic query reformulation in voice search. In Proceedings of the 36th International ACM SIGIR. 143\u2013152."},{"key":"e_1_3_4_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271808"},{"key":"e_1_3_4_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462859"},{"key":"e_1_3_4_81_2","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2010-558"},{"key":"e_1_3_4_82_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(82)90035-2"},{"key":"e_1_3_4_83_2","doi-asserted-by":"crossref","unstructured":"Vladimir Karpukhin Barlas O\u011fuz Sewon Min Patrick Lewis Ledell Wu Sergey Edunov Danqi Chen and Wen-tau Yih. 2020. Dense passage retrieval for open-domain question answering. Retrieved from https:\/\/arXiv:2004.04906.","DOI":"10.18653\/v1\/2020.emnlp-main.550"},{"key":"e_1_3_4_84_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-012-9216-x"},{"key":"e_1_3_4_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468519"},{"key":"e_1_3_4_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/https:\/\/doi.org"},{"key":"e_1_3_4_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3468868"},{"key":"e_1_3_4_88_2","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. Retrieved from https:\/\/arXiv:1412.6980."},{"key":"e_1_3_4_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/https:\/\/doi.org"},{"key":"e_1_3_4_90_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(99)00101-0"},{"key":"e_1_3_4_91_2","doi-asserted-by":"publisher","DOI":"10.1145\/146802.146810"},{"key":"e_1_3_4_92_2","doi-asserted-by":"crossref","unstructured":"Vaibhav Kumar and Alan W. Black. 2020. ClarQ: A large-scale and diverse dataset for clarification question generation. Retrieved from https:\/\/arXiv:2006.05986.","DOI":"10.18653\/v1\/2020.acl-main.651"},{"key":"e_1_3_4_93_2","doi-asserted-by":"publisher","DOI":"10.5555\/908336"},{"key":"e_1_3_4_94_2","doi-asserted-by":"crossref","unstructured":"Mike Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdelrahman Mohamed et\u00a0al. 2019. Bart: Denoising sequence-to-sequence pre-training for natural language generation translation and comprehension. Retrieved from https:\/\/arXiv:1910.13461.","DOI":"10.18653\/v1\/2020.acl-main.703"},{"key":"e_1_3_4_95_2","unstructured":"Margaret Li Jason Weston and Stephen Roller. 2019. Acute-eval: Improved dialogue evaluation with optimized questions and multi-turn comparisons. Retrieved from https:\/\/arXiv:1909.03087."},{"key":"e_1_3_4_96_2","first-page":"9748","article-title":"Towards deep conversational recommendations","author":"Li Raymond","year":"2018","unstructured":"Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards deep conversational recommendations. In Proceedings of the NeurIPS. 9748\u20139758.","journal-title":"Proceedings of the NeurIPS"},{"key":"e_1_3_4_97_2","doi-asserted-by":"publisher","DOI":"10.3115\/1072228.1072378"},{"key":"e_1_3_4_98_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-38825-6_13"},{"key":"e_1_3_4_99_2","first-page":"74","volume-title":"Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text Summarization Branches Out. 74\u201381."},{"key":"e_1_3_4_100_2","doi-asserted-by":"publisher","DOI":"10.1145\/3451160"},{"issue":"1","key":"e_1_3_4_101_2","first-page":"1","article-title":"Analysis and evaluation of query reformulations in different task types","volume":"47","author":"Liu Chang","year":"2010","unstructured":"Chang Liu, Jacek Gwizdka, Jingjing Liu, Tao Xu, and Nicholas J. Belkin. 2010. Analysis and evaluation of query reformulations in different task types. Proceedings of the ASIS&T 47, 1 (2010), 1\u20139.","journal-title":"Proceedings of the ASIS&T"},{"key":"e_1_3_4_102_2","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009974"},{"key":"e_1_3_4_103_2","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du et\u00a0al. 2019. RoBERTa: A robustly optimized BERT pretraining approach. Retrieved from https:\/\/arxiv.org\/abs\/1907.11692."},{"key":"e_1_3_4_104_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-5573-2"},{"key":"e_1_3_4_105_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445029"},{"key":"e_1_3_4_106_2","unstructured":"Babak Loni. 2011. A survey of state-of-the-art methods on question classification literature survey published on TU Delft Repository. https:\/\/repository.tudelft.nl\/islandora\/object\/uuid%3A8e57caa8-04fc-4fe2-b668-20767ab3db9."},{"key":"e_1_3_4_107_2","unstructured":"Tom Lotze Stefan Klut Mohammad Aliannejadi and Evangelos Kanoulas. 2021. Ranking clarifying questions based on predicted user engagement. Retrieved from https:\/\/arXiv:2103.06192."},{"issue":"1","key":"e_1_3_4_108_2","first-page":"22","article-title":"Development of a stemming algorithm.","volume":"11","author":"Lovins Julie Beth","year":"1968","unstructured":"Julie Beth Lovins. 1968. Development of a stemming algorithm. Mech. Transl. Comput. Linguistics 11, 1\u20132 (1968), 22\u201331.","journal-title":"Mech. Transl. Comput. Linguistics"},{"key":"e_1_3_4_109_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5010"},{"key":"e_1_3_4_110_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102682"},{"key":"e_1_3_4_111_2","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. Retrieved from https:\/\/arXiv:1301.3781."},{"key":"e_1_3_4_112_2","doi-asserted-by":"crossref","unstructured":"Sewon Min Julian Michael Hannaneh Hajishirzi and Luke Zettlemoyer. 2020. AmbigQA: Answering ambiguous open-domain questions. Retrieved from https:\/\/arXiv:2004.10645.","DOI":"10.18653\/v1\/2020.emnlp-main.466"},{"key":"e_1_3_4_113_2","doi-asserted-by":"publisher","DOI":"10.17762\/turcomat.v12i2.1526"},{"key":"e_1_3_4_114_2","doi-asserted-by":"crossref","unstructured":"Dan Moldovan Sanda Harabagiu Marius Pasca A. Harabagiu Rada Mihalcea Roxana Girju Richard Goodrum and Vasile Rus. 1999. Lasso: A tool for surfing the answer net. In Proceedings of the 8th Text Retrieval Conference (TREC\u201999) . 9 pages.","DOI":"10.6028\/NIST.SP.500-246.smu"},{"key":"e_1_3_4_115_2","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.88.2.314"},{"issue":"1","key":"e_1_3_4_116_2","first-page":"1","article-title":"Identification of user sessions with hierarchical agglomerative clustering","volume":"43","author":"Murray G. Craig","year":"2006","unstructured":"G. Craig Murray, Jimmy Lin, and Abdur Chowdhury. 2006. Identification of user sessions with hierarchical agglomerative clustering. Proceedings of the ASIS&T 43, 1 (2006), 1\u20139.","journal-title":"Proceedings of the ASIS&T"},{"key":"e_1_3_4_117_2","unstructured":"Wenjie Ou and Yue Lin. 2020. A clarifying question selection system from NTES_ALONG in Convai3 challenge. Retrieved from https:\/\/arXiv:2010.14202."},{"key":"e_1_3_4_118_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3481932"},{"key":"e_1_3_4_119_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102734"},{"key":"e_1_3_4_120_2","first-page":"311","volume-title":"Proceedings of the 40th Annual Meeting of ACL","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of ACL. 311\u2013318."},{"key":"e_1_3_4_121_2","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441786"},{"key":"e_1_3_4_122_2","volume-title":"Proceedings of the Converse@ KDD","author":"Penha Gustavo","year":"2020","unstructured":"Gustavo Penha and Claudia Hauff. 2020. Challenges in the evaluation of conversational search systems. In Proceedings of the Converse@ KDD."},{"key":"e_1_3_4_123_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_4_124_2","doi-asserted-by":"publisher","DOI":"10.1108\/eb046814"},{"key":"e_1_3_4_125_2","unstructured":"Martin F. Porter. 2001. Snowball: A Language for Stemming Algorithms. http:\/\/snowball.tartarus.org\/texts\/introduction.html."},{"key":"e_1_3_4_126_2","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/978-94-010-0019-2_11","volume-title":"Current and New Directions in Discourse and Dialogue","author":"Purver Matthew","year":"2003","unstructured":"Matthew Purver, Jonathan Ginzburg, and Patrick Healey. 2003. On the means for clarification in dialogue. In Current and New Directions in Discourse and Dialogue. Springer, 235\u2013255."},{"key":"e_1_3_4_127_2","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210124"},{"key":"e_1_3_4_128_2","doi-asserted-by":"crossref","unstructured":"Filip Radlinski Krisztian Balog Bill Byrne and Karthik Krishnamoorthi. 2019. Coached conversational preference elicitation: A case study in understanding movie preferences. In Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue (SIGdial) . 353\u2013360.","DOI":"10.18653\/v1\/W19-5941"},{"key":"e_1_3_4_129_2","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3020183"},{"key":"e_1_3_4_130_2","doi-asserted-by":"crossref","unstructured":"Sudha Rao and Hal Daum\u00e9 III. 2018. Learning to ask good questions: Ranking clarification questions using neural expected value of perfect information. Retrieved from https:\/\/arXiv:1805.04655.","DOI":"10.18653\/v1\/P18-1255"},{"key":"e_1_3_4_131_2","unstructured":"Sudha Rao and Hal Daum\u00e9 III. 2019. Answer-based adversarial training for generating clarification questions. Retrieved from https:\/\/arXiv:1904.02281."},{"key":"e_1_3_4_132_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1013"},{"key":"e_1_3_4_133_2","first-page":"1715","article-title":"Conversational query understanding using sequence to sequence modeling","author":"Ren Gary","year":"2018","unstructured":"Gary Ren, Xiaochuan Ni, M. Malik, and Q. Ke. 2018. Conversational query understanding using sequence to sequence modeling. Proceedings of the WWW. 1715\u20131724.","journal-title":"Proceedings of the WWW"},{"key":"e_1_3_4_134_2","doi-asserted-by":"publisher","DOI":"10.1145\/3432726"},{"key":"e_1_3_4_135_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2005.05.005"},{"key":"e_1_3_4_136_2","first-page":"109","volume-title":"Proceedings of the 3rd Text Retrieval Conference (TREC\u201995).","author":"Robertson Stephen","year":"1995","unstructured":"Stephen Robertson, S. Walker, S. Jones, M. M. Hancock-Beaulieu, and M. Gatford. 1995. Okapi at TREC-3. In Proceedings of the 3rd Text Retrieval Conference (TREC\u201995).109\u2013126."},{"key":"e_1_3_4_137_2","first-page":"313","article-title":"Relevance feedback in information retrieval","author":"Rocchio Joseph","year":"1971","unstructured":"Joseph Rocchio. 1971. Relevance feedback in information retrieval. The Smart Retrieval System-experiments in Automatic Document Processing. 313\u2013323.","journal-title":"The Smart Retrieval System-experiments in Automatic Document Processing"},{"key":"e_1_3_4_138_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380193"},{"key":"e_1_3_4_139_2","doi-asserted-by":"publisher","DOI":"10.1145\/2854946.2854951"},{"key":"e_1_3_4_140_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11332"},{"key":"e_1_3_4_141_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72113-8_39"},{"key":"e_1_3_4_142_2","doi-asserted-by":"publisher","DOI":"10.1561\/1500000040"},{"key":"e_1_3_4_143_2","volume-title":"Explanation Patterns: Understanding Mechanically and Creatively","author":"Schank R. P.","year":"1986","unstructured":"R. P. Schank. 1986. Explanation Patterns: Understanding Mechanically and Creatively. Psychology Press."},{"key":"e_1_3_4_144_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888906000944"},{"key":"e_1_3_4_145_2","first-page":"136","volume-title":"Proceedings of the 5th SIGdial Workshop on Discourse and Dialogue at NAACL-HLT\u201904","author":"Schlangen David","year":"2004","unstructured":"David Schlangen. 2004. Causes and strategies for requesting clarification in dialogue. In Proceedings of the 5th SIGdial Workshop on Discourse and Dialogue at NAACL-HLT\u201904. 136\u2013143."},{"key":"e_1_3_4_146_2","doi-asserted-by":"publisher","DOI":"10.1109\/78.650093"},{"key":"e_1_3_4_147_2","first-page":"167","volume-title":"Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval","author":"Sekuli\u0107 Ivan","year":"2021","unstructured":"Ivan Sekuli\u0107, Mohammad Aliannejadi, and Fabio Crestani. 2021. Towards facet-driven generation of clarifying questions for conversational search. In Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval. 167\u2013175."},{"key":"e_1_3_4_148_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72113-8_41"},{"key":"e_1_3_4_149_2","doi-asserted-by":"publisher","DOI":"10.1145\/3488560.3498440"},{"key":"e_1_3_4_150_2","unstructured":"Chen Shani Alexander Libov Sofia Tolmach Liane Lewin-Eytan Yoelle Maarek and Dafna Shahaf. 2021. \u201cAlexa what do you do for fun?\u201d Characterizing playful requests with virtual assistants. Retrieved from https:\/\/arXiv:2105.05571."},{"key":"e_1_3_4_151_2","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609497"},{"key":"e_1_3_4_152_2","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242749"},{"key":"e_1_3_4_153_2","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806493"},{"key":"e_1_3_4_154_2","doi-asserted-by":"publisher","DOI":"10.1002\/1097-4571(2000)9999:9999<::AID-ASI1591>3.0.CO;2-R"},{"key":"e_1_3_4_155_2","volume-title":"Proceedings of the AISB Symposium on Questions, Discourse and Dialogue","volume":"20","author":"Stoyanchev Svetlana","year":"2014","unstructured":"Svetlana Stoyanchev, Alex Liu, and Julia Hirschberg. 2014. Towards natural clarification questions in dialogue systems. In Proceedings of the AISB Symposium on Questions, Discourse and Dialogue, Vol. 20."},{"key":"e_1_3_4_156_2","doi-asserted-by":"publisher","DOI":"10.1177\/016327877800100102"},{"key":"e_1_3_4_157_2","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242667"},{"key":"e_1_3_4_158_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3418513"},{"key":"e_1_3_4_159_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-15712-8_18"},{"key":"e_1_3_4_160_2","doi-asserted-by":"publisher","DOI":"10.1145\/3458553.3458570"},{"key":"e_1_3_4_161_2","doi-asserted-by":"publisher","DOI":"10.1145\/3176349.3176387"},{"key":"e_1_3_4_162_2","doi-asserted-by":"publisher","DOI":"10.1145\/2810355.2810356"},{"key":"e_1_3_4_163_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2019.102162"},{"key":"e_1_3_4_164_2","unstructured":"Svitlana Vakulenko. 2019. Knowledge-based conversational search. Retrieved from https:\/\/arXiv:1912.06859."},{"key":"e_1_3_4_165_2","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441748"},{"key":"e_1_3_4_166_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72240-1_43"},{"issue":"2","key":"e_1_3_4_167_2","first-page":"111","article-title":"Assumptions of information-seeking questions","volume":"1","author":"Meij Hans Van der","year":"1987","unstructured":"Hans Van der Meij. 1987. Assumptions of information-seeking questions. Quest. Exch. 1, 2 (1987), 111\u2013118.","journal-title":"Quest. Exch."},{"key":"e_1_3_4_168_2","first-page":"5998","article-title":"Attention is all you need","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, et\u00a0al. 2017. Attention is all you need. In Proceedings of the NeurIPS. 5998\u20136008.","journal-title":"Proceedings of the NeurIPS"},{"key":"e_1_3_4_169_2","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324901002789"},{"key":"e_1_3_4_170_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401130"},{"key":"e_1_3_4_171_2","doi-asserted-by":"publisher","DOI":"10.1145\/2629489"},{"key":"e_1_3_4_172_2","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053175"},{"key":"e_1_3_4_173_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482199"},{"key":"e_1_3_4_174_2","unstructured":"Xiao Wang Craig Macdonald and Iadh Ounis. 2020. Deep reinforced query reformulation for information retrieval. Retrieved from https:\/\/arXiv:2007.07987."},{"key":"e_1_3_4_175_2","doi-asserted-by":"publisher","DOI":"10.1108\/00330330610681295"},{"key":"e_1_3_4_176_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186068"},{"key":"e_1_3_4_177_2","unstructured":"Dongfang Xu Peter Jansen Jaycie Martin Zhengnan Xie Vikas Yadav Harish Tayyar Madabushi Oyvind Tafjord and Peter Clark. 2019. Multi-class hierarchical question classification for multiple choice science exams. Retrieved from https:\/\/arXiv:1908.05441."},{"key":"e_1_3_4_178_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1172"},{"key":"e_1_3_4_179_2","unstructured":"Liu Yang Hamed Zamani Yongfeng Zhang Jiafeng Guo and W. Bruce Croft. 2017. Neural matching models for question retrieval and next question prediction in conversation. Retrieved from https:\/\/arXiv:1707.05409."},{"key":"e_1_3_4_180_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401323"},{"key":"e_1_3_4_181_2","unstructured":"Munazza Zaib Wei Emma Zhang Quan Z. Sheng Adnan Mahmood and Yang Zhang. 2021. Conversational question answering: A survey. Retrieved from https:\/\/arXiv:2106.00874."},{"key":"e_1_3_4_182_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401415"},{"key":"e_1_3_4_183_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380126"},{"key":"e_1_3_4_184_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412772"},{"key":"e_1_3_4_185_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401160"},{"key":"e_1_3_4_186_2","doi-asserted-by":"publisher","DOI":"10.1145\/3446328"},{"key":"e_1_3_4_187_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271776"},{"key":"e_1_3_4_188_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401180"},{"key":"e_1_3_4_189_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357967"},{"key":"e_1_3_4_190_2","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412094"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534965","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3534965","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T15:02:54Z","timestamp":1750172574000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3534965"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,7]]},"references-count":189,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,7,31]]}},"alternative-id":["10.1145\/3534965"],"URL":"https:\/\/doi.org\/10.1145\/3534965","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,7]]},"assertion":[{"value":"2021-08-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-02","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}