{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,7]],"date-time":"2026-02-07T11:48:28Z","timestamp":1770464908712,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":54,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,17]]},"DOI":"10.1145\/3511808.3557719","type":"proceedings-article","created":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:29:57Z","timestamp":1665883797000},"page":"3811-3816","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Unsupervised Question Clarity Prediction through Retrieved Item Coherency"],"prefix":"10.1145","author":[{"given":"Negar","family":"Arabzadeh","sequence":"first","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}]},{"given":"Mahsa","family":"Seifikar","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}]},{"given":"Charles L.A.","family":"Clarke","sequence":"additional","affiliation":[{"name":"University of Waterloo, Waterloo, Canada"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Building and evaluating open-domain dialogue corpora with clarifying questions. arXiv preprint arXiv:2109.05794","author":"Aliannejadi Mohammad","year":"2021","unstructured":"Mohammad Aliannejadi , Julia Kiseleva , Aleksandr Chuklin , Jeffrey Dalton , and Mikhail Burtsev . 2021. Building and evaluating open-domain dialogue corpora with clarifying questions. arXiv preprint arXiv:2109.05794 ( 2021 ). Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton, and Mikhail Burtsev. 2021. Building and evaluating open-domain dialogue corpora with clarifying questions. arXiv preprint arXiv:2109.05794 (2021)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331265"},{"key":"e_1_3_2_1_3_1","volume-title":"Query Performance Prediction Through Retrieval Coherency. In European Conference on Information Retrieval. Springer, 193--200","author":"Arabzadeh Negar","year":"2021","unstructured":"Negar Arabzadeh , Amin Bigdeli , Morteza Zihayat , and Ebrahim Bagheri . 2021 . Query Performance Prediction Through Retrieval Coherency. In European Conference on Information Retrieval. Springer, 193--200 . Negar Arabzadeh, Amin Bigdeli, Morteza Zihayat, and Ebrahim Bagheri. 2021. Query Performance Prediction Through Retrieval Coherency. In European Conference on Information Retrieval. Springer, 193--200."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482063"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482011"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102248"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3358152"},{"key":"e_1_3_2_1_8_1","volume-title":"The average connectivity of a graph. Discrete mathematics 252, 1--3","author":"Beineke Lowell W","year":"2002","unstructured":"Lowell W Beineke , Ortrud R Oellermann , and Raymond E Pippert . 2002. The average connectivity of a graph. Discrete mathematics 252, 1--3 ( 2002 ), 31--45. Lowell W Beineke, Ortrud R Oellermann, and Raymond E Pippert. 2002. The average connectivity of a graph. Discrete mathematics 252, 1--3 (2002), 31--45."},{"key":"e_1_3_2_1_9_1","volume-title":"Network analysis: methodological foundations","author":"Brandes Ulrik","unstructured":"Ulrik Brandes . 2005. Network analysis: methodological foundations . Vol. 3418 . Springer Science & Business Media . Ulrik Brandes. 2005. Network analysis: methodological foundations. Vol. 3418. Springer Science & Business Media."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3022149"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1855038"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOAS285"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04417-5_17"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463249"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3115\/1289189.1289266"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/564376.564429"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010063"},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the 2003 human language technology conference of the north american chapter of the association for computational linguistics. 48--55","author":"Boni Marco De","year":"2003","unstructured":"Marco De Boni and Suresh Manandhar . 2003 . An analysis of clarification dialogue for question answering . In Proceedings of the 2003 human language technology conference of the north american chapter of the association for computational linguistics. 48--55 . Marco De Boni and Suresh Manandhar. 2003. An analysis of clarification dialogue for question answering. In Proceedings of the 2003 human language technology conference of the north american chapter of the association for computational linguistics. 48--55."},{"key":"e_1_3_2_1_19_1","volume-title":"Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2018 . Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018). Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1860702.1860709"},{"key":"e_1_3_2_1_21_1","volume-title":"Neural Approaches to Conversational Information Retrieval. arXiv preprint arXiv:2201.05176","author":"Gao Jianfeng","year":"2022","unstructured":"Jianfeng Gao , Chenyan Xiong , Paul Bennett , and Nick Craswell . 2022. Neural Approaches to Conversational Information Retrieval. arXiv preprint arXiv:2201.05176 ( 2022 ). Jianfeng Gao, Chenyan Xiong, Paul Bennett, and Nick Craswell. 2022. Neural Approaches to Conversational Information Retrieval. arXiv preprint arXiv:2201.05176 (2022)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341981.3344249"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-78646-7_80"},{"key":"e_1_3_2_1_24_1","volume-title":"Rufai Aliyu Yauri, and Azreen Azman","author":"Kadir Rabiah A","year":"2018","unstructured":"Rabiah A Kadir , Rufai Aliyu Yauri, and Azreen Azman . 2018 . Semantic ambiguous query formulation using statistical Linguistics technique. Malaysian Journal of Computer Science ( 2018), 48--56. Rabiah A Kadir, Rufai Aliyu Yauri, and Azreen Azman. 2018. Semantic ambiguous query formulation using statistical Linguistics technique. Malaysian Journal of Computer Science (2018), 48--56."},{"key":"e_1_3_2_1_25_1","volume-title":"Dense passage retrieval for opendomain question answering. arXiv preprint arXiv:2004.04906","author":"Karpukhin Vladimir","year":"2020","unstructured":"Vladimir Karpukhin , Barlas O?uz, Sewon Min , Patrick Lewis , Ledell Wu , Sergey Edunov , Danqi Chen , and Wen-tau Yih. 2020. Dense passage retrieval for opendomain question answering. arXiv preprint arXiv:2004.04906 ( 2020 ). Vladimir Karpukhin, Barlas O?uz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020. Dense passage retrieval for opendomain question answering. arXiv preprint arXiv:2004.04906 (2020)."},{"key":"e_1_3_2_1_26_1","volume-title":"The 41st international acm sigir conference on research & development in information retrieval. 1257--1260.","author":"Kiesel Johannes","unstructured":"Johannes Kiesel , Arefeh Bahrami , Benno Stein , Avishek Anand , and Matthias Hagen . 2018. Toward voice query clarification . In The 41st international acm sigir conference on research & development in information retrieval. 1257--1260. Johannes Kiesel, Arefeh Bahrami, Benno Stein, Avishek Anand, and Matthias Hagen. 2018. Toward voice query clarification. In The 41st international acm sigir conference on research & development in information retrieval. 1257--1260."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00276"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.2200\/S01123ED1V01Y202108HLT053"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3451160"},{"key":"e_1_3_2_1_30_1","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. (2019). arXiv:cs.CL\/1907.11692  Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. (2019). arXiv:cs.CL\/1907.11692"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463262"},{"key":"e_1_3_2_1_32_1","volume-title":"AmbigQA: Answering ambiguous open-domain questions. arXiv preprint arXiv:2004.10645","author":"Min Sewon","year":"2020","unstructured":"Sewon Min , Julian Michael , Hannaneh Hajishirzi , and Luke Zettlemoyer . 2020. AmbigQA: Answering ambiguous open-domain questions. arXiv preprint arXiv:2004.10645 ( 2020 ). Sewon Min, Julian Michael, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2020. AmbigQA: Answering ambiguous open-domain questions. arXiv preprint arXiv:2004.10645 (2020)."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Bhaskar Mitra Nick Craswell etal 2018. An introduction to neural information retrieval. Now Foundations and Trends Boston MA.  Bhaskar Mitra Nick Craswell et al. 2018. An introduction to neural information retrieval. Now Foundations and Trends Boston MA.","DOI":"10.1561\/9781680835335"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1111\/0022-4537.00153"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-2410"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-2410"},{"key":"e_1_3_2_1_37_1","volume-title":"Learning to ask good questions: Ranking clarification questions using neural expected value of perfect information. arXiv preprint arXiv:1805.04655","author":"Rao Sudha","year":"2018","unstructured":"Sudha Rao and Hal Daum\u00e9 III. 2018. Learning to ask good questions: Ranking clarification questions using neural expected value of perfect information. arXiv preprint arXiv:1805.04655 ( 2018 ). Sudha Rao and Hal Daum\u00e9 III. 2018. Learning to ask good questions: Ranking clarification questions using neural expected value of perfect information. arXiv preprint arXiv:1805.04655 (2018)."},{"key":"e_1_3_2_1_38_1","volume-title":"An effective information retrieval for ambiguous query. arXiv preprint arXiv:1204.1406","author":"Roul Rajendra Kumar","year":"2012","unstructured":"Rajendra Kumar Roul and Sanjay Kumar Sahay . 2012. An effective information retrieval for ambiguous query. arXiv preprint arXiv:1204.1406 ( 2012 ). Rajendra Kumar Roul and Sanjay Kumar Sahay. 2012. An effective information retrieval for ambiguous query. arXiv preprint arXiv:1204.1406 (2012)."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390420"},{"key":"e_1_3_2_1_40_1","volume-title":"Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval. 167--175","author":"Ivan","year":"2021","unstructured":"Ivan Sekuli?, Mohammad Aliannejadi , and Fabio Crestani . 2021 . Towards FacetDriven Generation of Clarifying Questions for Conversational Search . In Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval. 167--175 . Ivan Sekuli?, Mohammad Aliannejadi, and Fabio Crestani. 2021. Towards FacetDriven Generation of Clarifying Questions for Conversational Search. In Proceedings of the 2021 ACM SIGIR International Conference on Theory of Information Retrieval. 167--175."},{"key":"e_1_3_2_1_41_1","volume-title":"Advances in Information Retrieval, Matthias Hagen, Suzan Verberne, Craig Macdonald, Christin Seifert, Krisztian Balog, Kjetil N\u00f8rv\u00e5g","author":"Sekuli\u0107 Ivan","unstructured":"Ivan Sekuli\u0107 , Mohammad Aliannejadi , and Fabio Crestani . 2022. Exploiting Document-Based Features for Clarification in Conversational Search . In Advances in Information Retrieval, Matthias Hagen, Suzan Verberne, Craig Macdonald, Christin Seifert, Krisztian Balog, Kjetil N\u00f8rv\u00e5g , and Vinay Setty (Eds.). Springer International Publishing , Cham , 413--427. Ivan Sekuli\u0107, Mohammad Aliannejadi, and Fabio Crestani. 2022. Exploiting Document-Based Features for Clarification in Conversational Search. In Advances in Information Retrieval, Matthias Hagen, Suzan Verberne, Craig Macdonald, Christin Seifert, Krisztian Balog, Kjetil N\u00f8rv\u00e5g, and Vinay Setty (Eds.). Springer International Publishing, Cham, 413--427."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2180868.2180873"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242749"},{"key":"e_1_3_2_1_44_1","volume-title":"AISB symposium on questions, discourse and dialogue","volume":"20","author":"Stoyanchev Svetlana","year":"2014","unstructured":"Svetlana Stoyanchev , Alex Liu , and Julia Hirschberg . 2014 . Towards natural clarification questions in dialogue systems . In AISB symposium on questions, discourse and dialogue , Vol. 20 . Svetlana Stoyanchev, Alex Liu, and Julia Hirschberg. 2014. Towards natural clarification questions in dialogue systems. In AISB symposium on questions, discourse and dialogue, Vol. 20."},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2661906"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.26615\/978-954-452-049-6_098"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.26615\/978-954-452-049-6_098"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348396"},{"key":"e_1_3_2_1_49_1","volume-title":"MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. CoRR abs\/2002.10957","author":"Wang Wenhui","year":"2020","unstructured":"Wenhui Wang , Furu Wei , Li Dong , Hangbo Bao , Nan Yang , and Ming Zhou . 2020. MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. CoRR abs\/2002.10957 ( 2020 ). arXiv:2002.10957 https:\/\/arxiv.org\/abs\/2002.10957 Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, and Ming Zhou. 2020. MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. CoRR abs\/2002.10957 (2020). arXiv:2002.10957 https:\/\/arxiv.org\/abs\/2002.10957"},{"key":"e_1_3_2_1_50_1","volume-title":"Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. 361--364","author":"Wang Yu","year":"2010","unstructured":"Yu Wang and Eugene Agichtein . 2010 . Query ambiguity revisited: clickthrough measures for distinguishing informational and ambiguous queries . In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. 361--364 . Yu Wang and Eugene Agichtein. 2010. Query ambiguity revisited: clickthrough measures for distinguishing informational and ambiguous queries. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. 361--364."},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Douglas R White and Mark Newman. 2001. Fast approximation algorithms for finding node-independent paths in networks. (2001).  Douglas R White and Mark Newman. 2001. Fast approximation algorithms for finding node-independent paths in networks. (2001).","DOI":"10.2139\/ssrn.1831790"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380126"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-78646-7_8"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277835"}],"event":{"name":"CIKM '22: The 31st ACM International Conference on Information and Knowledge Management","location":"Atlanta GA USA","acronym":"CIKM '22","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 31st ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557719","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511808.3557719","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:49Z","timestamp":1750182529000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557719"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":54,"alternative-id":["10.1145\/3511808.3557719","10.1145\/3511808"],"URL":"https:\/\/doi.org\/10.1145\/3511808.3557719","relation":{},"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"2022-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}