{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,4]],"date-time":"2026-04-04T06:16:02Z","timestamp":1775283362807,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,6]],"date-time":"2022-07-06T00:00:00Z","timestamp":1657065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Australian Research Council","award":["DP18010268"],"award-info":[{"award-number":["DP18010268"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,6]]},"DOI":"10.1145\/3477495.3531750","type":"proceedings-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T15:12:13Z","timestamp":1657206733000},"page":"3198-3208","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["MIMICS-Duo"],"prefix":"10.1145","author":[{"given":"Leila","family":"Tavakoli","sequence":"first","affiliation":[{"name":"RMIT University, Melbourne, VIC, Australia"}]},{"given":"Johanne R.","family":"Trippas","sequence":"additional","affiliation":[{"name":"University of Melbourne, Melbourne, VIC, Australia"}]},{"given":"Hamed","family":"Zamani","sequence":"additional","affiliation":[{"name":"University of Massachusetts Amherst, Amherst, MA, USA"}]},{"given":"Falk","family":"Scholer","sequence":"additional","affiliation":[{"name":"RMIT University, Melbourne, VIC, Australia"}]},{"given":"Mark","family":"Sanderson","sequence":"additional","affiliation":[{"name":"RMIT University, Melbourne, VIC, Australia"}]}],"member":"320","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"ConvAI3: Generating Clarifying Questions for OpenDomain Dialogue Systems (ClariQ). arXiv preprint arXiv:2009.11352","author":"Aliannejadi Mohammad","year":"2020","unstructured":"Mohammad Aliannejadi , Julia Kiseleva , Aleksandr Chuklin , Jeff Dalton , and Mikhail Burtsev . 2020. ConvAI3: Generating Clarifying Questions for OpenDomain Dialogue Systems (ClariQ). arXiv preprint arXiv:2009.11352 ( 2020 ). Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeff Dalton, and Mikhail Burtsev. 2020. ConvAI3: Generating Clarifying Questions for OpenDomain Dialogue Systems (ClariQ). arXiv preprint arXiv:2009.11352 (2020)."},{"key":"e_1_3_2_2_2_1","volume-title":"Building and evaluating open-domain dialogue corpora with clarifying questions. arXiv preprint arXiv:2109.05794","author":"Aliannejadi Mohammad","year":"2021","unstructured":"Mohammad Aliannejadi , Julia Kiseleva , Aleksandr Chuklin , Jeffrey Dalton , and Mikhail Burtsev . 2021. Building and evaluating open-domain dialogue corpora with clarifying questions. arXiv preprint arXiv:2109.05794 ( 2021 ). Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, Jeffrey Dalton, and Mikhail Burtsev. 2021. Building and evaluating open-domain dialogue corpora with clarifying questions. arXiv preprint arXiv:2109.05794 (2021)."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331265"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/5254.796083"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2532508.2532511"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3022149"},{"key":"e_1_3_2_2_7_1","volume-title":"Random forests. Machine learning 45, 1","author":"Breiman Leo","year":"2001","unstructured":"Leo Breiman . 2001. Random forests. Machine learning 45, 1 ( 2001 ), 5--32. Leo Breiman. 2001. Random forests. Machine learning 45, 1 (2001), 5--32."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102363"},{"key":"e_1_3_2_2_9_1","unstructured":"Yang Trista Cao Sudha Rao and Hal Daum\u00e9 III. 2019. Controlling the Specificity of Clarification Question Generation.. In WNLP@ ACL. 53--56.  Yang Trista Cao Sudha Rao and Hal Daum\u00e9 III. 2019. Controlling the Specificity of Clarification Question Generation.. In WNLP@ ACL. 53--56."},{"key":"e_1_3_2_2_10_1","volume-title":"Resolving intent ambiguities by retrieving discriminative clarifying questions. arXiv preprint arXiv:2008.07559","author":"Dhole Kaustubh D","year":"2020","unstructured":"Kaustubh D Dhole . 2020. Resolving intent ambiguities by retrieving discriminative clarifying questions. arXiv preprint arXiv:2008.07559 ( 2020 ). Kaustubh D Dhole. 2020. Resolving intent ambiguities by retrieving discriminative clarifying questions. arXiv preprint arXiv:2008.07559 (2020)."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2645710.2645737"},{"key":"e_1_3_2_2_12_1","first-page":"933","article-title":"An efficient boosting algorithm for combining preferences","author":"Freund Yoav","year":"2003","unstructured":"Yoav Freund , Raj Iyer , Robert E Schapire , and Yoram Singer . 2003 . An efficient boosting algorithm for combining preferences . Journal of machine learning research 4 , Nov (2003), 933 -- 969 . Yoav Freund, Raj Iyer, Robert E Schapire, and Yoram Singer. 2003. An efficient boosting algorithm for combining preferences. Journal of machine learning research 4, Nov (2003), 933--969.","journal-title":"Journal of machine learning research 4"},{"key":"e_1_3_2_2_13_1","volume-title":"Greedy function approximation: a gradient boosting machine. Annals of statistics","author":"Friedman Jerome H","year":"2001","unstructured":"Jerome H Friedman . 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics ( 2001 ), 1189--1232. Jerome H Friedman. 2001. Greedy function approximation: a gradient boosting machine. Annals of statistics (2001), 1189--1232."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2645710.2645745"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482445"},{"key":"e_1_3_2_2_16_1","volume-title":"Deciding Whether to Ask Clarifying Questions in Large-Scale Spoken Language Understanding. arXiv preprint arXiv:2109.12451","author":"Kim Joo-Kyung","year":"2021","unstructured":"Joo-Kyung Kim , Guoyin Wang , Sungjin Lee , and Young-Bum Kim . 2021. Deciding Whether to Ask Clarifying Questions in Large-Scale Spoken Language Understanding. arXiv preprint arXiv:2109.12451 ( 2021 ). Joo-Kyung Kim, Guoyin Wang, Sungjin Lee, and Young-Bum Kim. 2021. Deciding Whether to Ask Clarifying Questions in Large-Scale Spoken Language Understanding. arXiv preprint arXiv:2109.12451 (2021)."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Vaibhav Kumar et al. 2020. ClarQ: A large-scale and diverse dataset for Clarification Question Generation. arXiv preprint arXiv:2006.05986 (2020).  Vaibhav Kumar et al. 2020. ClarQ: A large-scale and diverse dataset for Clarification Question Generation. arXiv preprint arXiv:2006.05986 (2020).","DOI":"10.18653\/v1\/2020.acl-main.651"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412137"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767721"},{"key":"e_1_3_2_2_20_1","volume-title":"Ranking clarifying questions based on predicted user engagement. arXiv preprint arXiv:2103.06192","author":"Lotze Tom","year":"2021","unstructured":"Tom Lotze , Stefan Klut , Mohammad Aliannejadi , and Evangelos Kanoulas . 2021. Ranking clarifying questions based on predicted user engagement. arXiv preprint arXiv:2103.06192 ( 2021 ). Tom Lotze, Stefan Klut, Mohammad Aliannejadi, and Evangelos Kanoulas. 2021. Ranking clarifying questions based on predicted user engagement. arXiv preprint arXiv:2103.06192 (2021)."},{"key":"e_1_3_2_2_21_1","volume-title":"Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledge. arXiv preprint arXiv:2104.06828","author":"Majumder Bodhisattwa Prasad","year":"2021","unstructured":"Bodhisattwa Prasad Majumder , Sudha Rao , Michel Galley , and Julian McAuley . 2021. Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledge. arXiv preprint arXiv:2104.06828 ( 2021 ). Bodhisattwa Prasad Majumder, Sudha Rao, Michel Galley, and Julian McAuley. 2021. Ask what's missing and what's useful: Improving Clarification Question Generation using Global Knowledge. arXiv preprint arXiv:2104.06828 (2021)."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2911451.2911507"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766462.2767755"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872427.2883044"},{"key":"e_1_3_2_2_25_1","volume-title":"A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge. arXiv preprint arXiv:2010.14202","author":"Ou Wenjie","year":"2020","unstructured":"Wenjie Ou and Yue Lin . 2020. A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge. arXiv preprint arXiv:2010.14202 ( 2020 ). Wenjie Ou and Yue Lin. 2020. A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge. arXiv preprint arXiv:2010.14202 (2020)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-3006"},{"key":"e_1_3_2_2_27_1","volume-title":"Learning to ask good questions: Ranking clarification questions using neural expected value of perfect information. arXiv preprint arXiv:1805.04655","author":"Rao Sudha","year":"2018","unstructured":"Sudha Rao and Hal Daum\u00e9 III. 2018. Learning to ask good questions: Ranking clarification questions using neural expected value of perfect information. arXiv preprint arXiv:1805.04655 ( 2018 ). Sudha Rao and Hal Daum\u00e9 III. 2018. Learning to ask good questions: Ranking clarification questions using neural expected value of perfect information. arXiv preprint arXiv:1805.04655 (2018)."},{"key":"e_1_3_2_2_28_1","volume-title":"Answer-based adversarial training for generating clarification questions. arXiv preprint arXiv:1904.02281","author":"Rao Sudha","year":"2019","unstructured":"Sudha Rao and Hal Daum\u00e9 III. 2019. Answer-based adversarial training for generating clarification questions. arXiv preprint arXiv:1904.02281 ( 2019 ). Sudha Rao and Hal Daum\u00e9 III. 2019. Answer-based adversarial training for generating clarification questions. arXiv preprint arXiv:1904.02281 (2019)."},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959176"},{"key":"e_1_3_2_2_30_1","volume-title":"User Engagement Prediction for Clarification in Search. arXiv preprint arXiv:2102.04163","author":"Ivan","year":"2021","unstructured":"Ivan Sekuli?, Mohammad Aliannejadi , and Fabio Crestani . 2021. User Engagement Prediction for Clarification in Search. arXiv preprint arXiv:2102.04163 ( 2021 ). Ivan Sekuli?, Mohammad Aliannejadi, and Fabio Crestani. 2021. User Engagement Prediction for Clarification in Search. arXiv preprint arXiv:2102.04163 (2021)."},{"key":"e_1_3_2_2_31_1","volume-title":"AISB symposium on questions, discourse and dialogue","volume":"20","author":"Stoyanchev Svetlana","year":"2014","unstructured":"Svetlana Stoyanchev , Alex Liu , and Julia Hirschberg . 2014 . Towards natural clarification questions in dialogue systems . In AISB symposium on questions, discourse and dialogue , Vol. 20 . Svetlana Stoyanchev, Alex Liu, and Julia Hirschberg. 2014. Towards natural clarification questions in dialogue systems. In AISB symposium on questions, discourse and dialogue, Vol. 20."},{"key":"e_1_3_2_2_32_1","volume-title":"William Bruce Croft, and Mark Sanderson","author":"Tavakoli Leila","year":"2021","unstructured":"Leila Tavakoli , Hamed Zamani , Falk Scholer , William Bruce Croft, and Mark Sanderson . 2021 . Analyzing clarification in asynchronous information-seeking conversations. Journal of the Association for Information Science and Technology ( 2021). Leila Tavakoli, Hamed Zamani, Falk Scholer, William Bruce Croft, and Mark Sanderson. 2021. Analyzing clarification in asynchronous information-seeking conversations. Journal of the Association for Information Science and Technology (2021)."},{"key":"e_1_3_2_2_33_1","unstructured":"Paul Tseng et al. 1988. Coordinate ascent for maximizing nondifferentiable concave functions. (1988).  Paul Tseng et al. 1988. Coordinate ascent for maximizing nondifferentiable concave functions. (1988)."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482199"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-009-9112-1"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1172"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487575.2488215"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380126"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412772"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401160"},{"key":"e_1_3_2_2_41_1","volume-title":"Conversational Information Seeking. arXiv preprint arXiv:2201.08808","author":"Zamani Hamed","year":"2022","unstructured":"Hamed Zamani , Johanne R Trippas , Jeff Dalton , and Filip Radlinski . 2022. Conversational Information Seeking. arXiv preprint arXiv:2201.08808 ( 2022 ). Hamed Zamani, Johanne R Trippas, Jeff Dalton, and Filip Radlinski. 2022. Conversational Information Seeking. arXiv preprint arXiv:2201.08808 (2022)."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449876"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1864708.1864759"}],"event":{"name":"SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval","location":"Madrid Spain","acronym":"SIGIR '22","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477495.3531750","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477495.3531750","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:02:07Z","timestamp":1750186927000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477495.3531750"}},"subtitle":["Offline &amp; Online Evaluation of Search Clarification"],"short-title":[],"issued":{"date-parts":[[2022,7,6]]},"references-count":43,"alternative-id":["10.1145\/3477495.3531750","10.1145\/3477495"],"URL":"https:\/\/doi.org\/10.1145\/3477495.3531750","relation":{},"subject":[],"published":{"date-parts":[[2022,7,6]]},"assertion":[{"value":"2022-07-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}