{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T08:41:33Z","timestamp":1774428093324,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":34,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,8,23]]},"DOI":"10.1145\/3394486.3403202","type":"proceedings-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T23:03:53Z","timestamp":1597964633000},"page":"1512-1520","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":80,"title":["Evaluating Conversational Recommender Systems via User Simulation"],"prefix":"10.1145","author":[{"given":"Shuo","family":"Zhang","sequence":"first","affiliation":[{"name":"Bloomberg, London, United Kingdom"}]},{"given":"Krisztian","family":"Balog","sequence":"additional","affiliation":[{"name":"University of Stavanger, Stavanger, Norway"}]}],"member":"320","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proc. of SIGIR '19","author":"Aliannejadi Mohammad","unstructured":"Mohammad Aliannejadi , Hamed Zamani , Fabio Crestani , and W. Bruce Croft . 2019. Asking Clarifying Questions in Open-Domain Information-Seeking Conversations . In Proc. of SIGIR '19 . 475--484. Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani, and W. Bruce Croft. 2019. Asking Clarifying Questions in Open-Domain Information-Seeking Conversations. In Proc. of SIGIR '19. 475--484."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2016-1175"},{"key":"e_1_3_2_1_3_1","volume-title":"Proc. of CAIR '18","author":"Azzopardi Leif","year":"2018","unstructured":"Leif Azzopardi , Mateusz Dubiel , Martin Halvey , and Jeffery Dalton . 2018 . Conceptualizing Agent-human Interactions during the Conversational Search Process . In Proc. of CAIR '18 . Leif Azzopardi, Mateusz Dubiel, Martin Halvey, and Jeffery Dalton. 2018. Conceptualizing Agent-human Interactions during the Conversational Search Process. In Proc. of CAIR '18."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341981.3344241"},{"key":"e_1_3_2_1_5_1","volume-title":"Proc. of EACL '06","author":"Belz Anja","year":"2006","unstructured":"Anja Belz and Ehud Reiter . 2006 . Comparing Automatic and Human Evaluation of NLG Systems . In Proc. of EACL '06 . Anja Belz and Ehud Reiter. 2006. Comparing Automatic and Human Evaluation of NLG Systems. In Proc. of EACL '06."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357939"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3166054.3166058"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939746"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3115\/1218955.1218964"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274784.3274788"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Jeff Dalton Chenyan Xiong and Jamie Callan. 2019. TREC Conversational Assistance Track. http:\/\/www.treccast.ai\/. Jeff Dalton Chenyan Xiong and Jamie Callan. 2019. TREC Conversational Assistance Track. http:\/\/www.treccast.ai\/.","DOI":"10.6028\/NIST.SP.1266.cast-overview"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/08839514.2013.835230"},{"key":"e_1_3_2_1_13_1","article-title":"The MovieLens Datasets","volume":"5","author":"Maxwell Harper F.","year":"2015","unstructured":"F. Maxwell Harper and Joseph A. Konstan . 2015 . The MovieLens Datasets : History and Context. ACM Trans. Interact. Intell. Syst. , Vol. 5 , 4, Article 19 (2015). F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst., Vol. 5, 4, Article 19 (2015).","journal-title":"History and Context. ACM Trans. Interact. Intell. Syst."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000051"},{"key":"e_1_3_2_1_15_1","volume-title":"Martin","author":"Jurafsky Dan","year":"2019","unstructured":"Dan Jurafsky and James H . Martin . 2019 . Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, 3 nd Edition draft .Prentice Hall, Pearson Education International . Dan Jurafsky and James H. Martin. 2019. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, 3nd Edition draft .Prentice Hall, Pearson Education International.","edition":"3"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000012"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5007"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1127"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1230"},{"key":"e_1_3_2_1_20_1","volume-title":"Proc. of IJCNLP '17","author":"Li Xiujun","year":"2017","unstructured":"Xiujun Li , Yun-Nung Chen , Lihong Li , Jianfeng Gao , and Asli Celikyilmaz . 2017 a. End-to-End Task-Completion Neural Dialogue Systems . In Proc. of IJCNLP '17 . 733--743. Xiujun Li, Yun-Nung Chen, Lihong Li, Jianfeng Gao, and Asli Celikyilmaz. 2017a. End-to-End Task-Completion Neural Dialogue Systems. In Proc. of IJCNLP '17. 733--743."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1230"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5912"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1203"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888912000343"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295750.3298924"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3020183"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000009"},{"key":"e_1_3_2_1_29_1","volume-title":"Proc. of SIGDIAL '05","author":"Schatzmann Jost","year":"2005","unstructured":"Jost Schatzmann , Kallirroi Georgila , and Steve Young . 2005 . Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems . In Proc. of SIGDIAL '05 . 45--54. Jost Schatzmann, Kallirroi Georgila, and Steve Young. 2005. Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems. In Proc. of SIGDIAL '05. 45--54."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.3115\/1614108.1614146"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0269888906000944"},{"key":"e_1_3_2_1_32_1","first-page":"1","article-title":"A Survey of Available Corpora For Building Data-Driven Dialogue Systems: The Journal Version","volume":"9","author":"Serban Iulian Vlad","year":"2018","unstructured":"Iulian Vlad Serban , Ryan Lowe , Peter Henderson , Laurent Charlin , and Joelle Pineau . 2018 . A Survey of Available Corpora For Building Data-Driven Dialogue Systems: The Journal Version . D & D , Vol. 9 , 1 (2018), 1 -- 49 . Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, and Joelle Pineau. 2018. A Survey of Available Corpora For Building Data-Driven Dialogue Systems: The Journal Version. D & D, Vol. 9, 1 (2018), 1--49.","journal-title":"D & D"},{"key":"e_1_3_2_1_35_1","volume-title":"Claudio Di Ciccio, and Maarten de Rijke","author":"Vakulenko Svitlana","year":"2019","unstructured":"Svitlana Vakulenko , Kate Revoredo , Claudio Di Ciccio, and Maarten de Rijke . 2019 . QRFA : A Data-Driven Model of Information Seeking Dialogues. In Advances in Information Retrieval . 541--557. Svitlana Vakulenko, Kate Revoredo, Claudio Di Ciccio, and Maarten de Rijke. 2019. QRFA: A Data-Driven Model of Information Seeking Dialogues. In Advances in Information Retrieval. 541--557."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210011"},{"key":"e_1_3_2_1_37_1","volume-title":"User Respond. In Proc. of CIKM '18","author":"Zhang Yongfeng","unstructured":"Yongfeng Zhang , Xu Chen , Qingyao Ai , Liu Yang , and W. Bruce Croft . 2018. Towards Conversational Search and Recommendation: System Ask , User Respond. In Proc. of CIKM '18 . 177--186. Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and W. Bruce Croft. 2018. Towards Conversational Search and Recommendation: System Ask, User Respond. In Proc. of CIKM '18. 177--186."}],"event":{"name":"KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event CA USA","acronym":"KDD '20","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403202","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3403202","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:01:46Z","timestamp":1750197706000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403202"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":34,"alternative-id":["10.1145\/3394486.3403202","10.1145\/3394486"],"URL":"https:\/\/doi.org\/10.1145\/3394486.3403202","relation":{},"subject":[],"published":{"date-parts":[[2020,8,20]]},"assertion":[{"value":"2020-08-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}