{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T16:55:25Z","timestamp":1781369725920,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,7,6]],"date-time":"2022-07-06T00:00:00Z","timestamp":1657065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,6]]},"DOI":"10.1145\/3477495.3531814","type":"proceedings-article","created":{"date-parts":[[2022,7,7]],"date-time":"2022-07-07T15:12:08Z","timestamp":1657206728000},"page":"2115-2119","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["A Multi-Task Based Neural Model to Simulate Users in Goal Oriented Dialogue Systems"],"prefix":"10.1145","author":[{"given":"To Eun","family":"Kim","sequence":"first","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aldo","family":"Lipani","sequence":"additional","affiliation":[{"name":"University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,7,7]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Proc. of the Second International Conference on Design of Experimental Search & Information REtrieval Systems","volume":"90","author":"Balog Krisztian","year":"2021","unstructured":"Krisztian Balog . 2021 . Conversational AI from an Information Retrieval Perspective: Remaining Challenges and a Case for User Simulation . In Proc. of the Second International Conference on Design of Experimental Search & Information REtrieval Systems , Padova, Italy, September 15--18 , 2021 (CEUR Workshop Proceedings, Vol. 2950). CEUR-WS.org, 80-- 90 . Krisztian Balog. 2021. Conversational AI from an Information Retrieval Perspective: Remaining Challenges and a Case for User Simulation. In Proc. of the Second International Conference on Design of Experimental Search & Information REtrieval Systems, Padova, Italy, September 15--18, 2021 (CEUR Workshop Proceedings, Vol. 2950). CEUR-WS.org, 80--90."},{"key":"e_1_3_2_2_2_1","unstructured":"Eyal Ben-David Boaz Carmeli and Ateret Anaby-Tavor. 2021. Improved Goal Oriented Dialogue via Utterance Generation and Look Ahead. arXiv:2110.12412 [cs.CL]  Eyal Ben-David Boaz Carmeli and Ateret Anaby-Tavor. 2021. Improved Goal Oriented Dialogue via Utterance Generation and Look Ahead. arXiv:2110.12412 [cs.CL]"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.347"},{"key":"e_1_3_2_2_4_1","volume-title":"Proc. of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 459--466","author":"Chen Meng","year":"2020","unstructured":"Meng Chen , Ruixue Liu , Lei Shen , Shaozu Yuan , Jingyan Zhou , Youzheng Wu , Xiaodong He , and Bowen Zhou . 2020 . The JDDC Corpus: A Large-Scale MultiTurn Chinese Dialogue Dataset for E-commerce Customer Service . In Proc. of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 459--466 . Meng Chen, Ruixue Liu, Lei Shen, Shaozu Yuan, Jingyan Zhou, Youzheng Wu, Xiaodong He, and Bowen Zhou. 2020. The JDDC Corpus: A Large-Scale MultiTurn Chinese Dialogue Dataset for E-commerce Customer Service. In Proc. of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 459--466."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-020-09866-x"},{"key":"e_1_3_2_2_6_1","volume-title":"Proc. of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proc. of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 . Association for Computational Linguistics, 4171--4186. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proc. of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1. Association for Computational Linguistics, 4171--4186."},{"key":"e_1_3_2_2_7_1","volume-title":"Proc. of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 422--428","author":"Eric Mihail","year":"2020","unstructured":"Mihail Eric , Rahul Goel , Shachi Paul , Abhishek Sethi , Sanchit Agarwal , Shuyang Gao , Adarsh Kumar , Anuj Goyal , Peter Ku , and Dilek Hakkani-Tur . 2020 . MultiWOZ 2.1: A Consolidated Multi-Domain Dialogue Dataset with State Corrections and State Tracking Baselines . In Proc. of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 422--428 . Mihail Eric, Rahul Goel, Shachi Paul, Abhishek Sethi, Sanchit Agarwal, Shuyang Gao, Adarsh Kumar, Anuj Goyal, Peter Ku, and Dilek Hakkani-Tur. 2020. MultiWOZ 2.1: A Consolidated Multi-Domain Dialogue Dataset with State Corrections and State Tracking Baselines. In Proc. of the 12th Language Resources and Evaluation Conference. European Language Resources Association, 422--428."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Braden Hancock Antoine Bordes Pierre-Emmanuel Mazar\u00e9 and Jason Weston. 2019. Learning from Dialogue after Deployment: Feed Yourself Chatbot! arXiv:1901.05415 [cs.CL]  Braden Hancock Antoine Bordes Pierre-Emmanuel Mazar\u00e9 and Jason Weston. 2019. Learning from Dialogue after Deployment: Feed Yourself Chatbot! arXiv:1901.05415 [cs.CL]","DOI":"10.18653\/v1\/P19-1358"},{"key":"e_1_3_2_2_9_1","volume-title":"Lyu","author":"Jiao Wenxiang","year":"2019","unstructured":"Wenxiang Jiao , Haiqin Yang , Irwin King , and Michael R . Lyu . 2019 . HiGRU: Hierarchical Gated Recurrent Units for Utterance-Level Emotion Recognition. In Proc. of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 . Association for Computational Linguistics , 397--406. Wenxiang Jiao, Haiqin Yang, Irwin King, and Michael R. Lyu. 2019. HiGRU: Hierarchical Gated Recurrent Units for Utterance-Level Emotion Recognition. In Proc. of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1. Association for Computational Linguistics, 397--406."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.527"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5007"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3327546.3327641"},{"key":"e_1_3_2_2_13_1","volume-title":"ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out","author":"Lin Chin-Yew","year":"2004","unstructured":"Chin-Yew Lin . 2004 . ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out . Association for Computational Linguistics , 74--81. Chin-Yew Lin. 2004. ROUGE: A Package for Automatic Evaluation of Summaries. In Text Summarization Branches Out. Association for Computational Linguistics, 74--81."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.273"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3451160"},{"key":"e_1_3_2_2_16_1","volume-title":"Proc. of the 40th Annual Meeting on Association for Computational Linguistics","author":"Papineni Kishore","year":"2002","unstructured":"Kishore Papineni , Salim Roukos , Todd Ward , and Wei-Jing Zhu . 2002 . BLEU: A Method for Automatic Evaluation of Machine Translation . In Proc. of the 40th Annual Meeting on Association for Computational Linguistics ( Philadelphia, Pennsylvania) (ACL '02). Association for Computational Linguistics, 311--318. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A Method for Automatic Evaluation of Machine Translation. In Proc. of the 40th Annual Meeting on Association for Computational Linguistics (Philadelphia, Pennsylvania) (ACL '02). Association for Computational Linguistics, 311--318."},{"key":"e_1_3_2_2_17_1","unstructured":"Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei Ilya Sutskever etal 2019. Language models are unsupervised multitask learners. OpenAI blog 1 8 (2019) 9.  Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei Ilya Sutskever et al. 2019. Language models are unsupervised multitask learners. OpenAI blog 1 8 (2019) 9."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5941"},{"key":"e_1_3_2_2_19_1","first-page":"1","article-title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","volume":"21","author":"Raffel Colin","year":"2020","unstructured":"Colin Raffel , Noam Shazeer , Adam Roberts , Katherine Lee , Sharan Narang , Michael Matena , Yanqi Zhou , Wei Li , and Peter J. Liu . 2020 . Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer . Journal of Machine Learning Research 21 , 140 (2020), 1 -- 67 . Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. Journal of Machine Learning Research 21, 140 (2020), 1--67.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6394"},{"key":"e_1_3_2_2_21_1","volume-title":"Proc. of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Reimers Nils","unstructured":"Nils Reimers and Iryna Gurevych . 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks . In Proc. of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . Association for Computational Linguistics , 3982--3992. Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proc. of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, 3982--3992."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Joel Ross Andrew Zaldivar Lilly C. Irani and Bill Tomlinson. 2009. Who are the Turkers? Worker Demographics in Amazon Mechanical Turk.  Joel Ross Andrew Zaldivar Lilly C. Irani and Bill Tomlinson. 2009. Who are the Turkers? Worker Demographics in Amazon Mechanical Turk.","DOI":"10.1145\/1753846.1753873"},{"key":"e_1_3_2_2_23_1","volume-title":"Human Language Technologies 2007: The Conference of the North American","author":"Schatzmann Jost","unstructured":"Jost Schatzmann , Blaise Thomson , Karl Weilhammer , Hui Ye , and Steve Young . 2007. Agenda-Based User Simulation for Bootstrapping a POMDP Dialogue System . In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers. Association for Computational Linguistics , 149--152. Jost Schatzmann, Blaise Thomson, Karl Weilhammer, Hui Ye, and Steve Young. 2007. Agenda-Based User Simulation for Bootstrapping a POMDP Dialogue System. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers. Association for Computational Linguistics, 149--152."},{"key":"e_1_3_2_2_24_1","volume-title":"StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts","author":"Shi Zhengxiang","unstructured":"Zhengxiang Shi , Qiang Zhang , and Aldo Lipani . 2022. StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts . In Association for the Advancement of Artificial Intelligence. AAAI. Zhengxiang Shi, Qiang Zhang, and Aldo Lipani. 2022. StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts. In Association for the Advancement of Artificial Intelligence. AAAI."},{"key":"e_1_3_2_2_25_1","volume-title":"Simulating User Satisfaction for the Evaluation of Task-Oriented Dialogue Systems","author":"Sun Weiwei","unstructured":"Weiwei Sun , Shuo Zhang , Krisztian Balog , Zhaochun Ren , Pengjie Ren , Zhumin Chen , and Maarten de Rijke . 2021. Simulating User Satisfaction for the Evaluation of Task-Oriented Dialogue Systems . Association for Computing Machinery , 2499--2506. Weiwei Sun, Shuo Zhang, Krisztian Balog, Zhaochun Ren, Pengjie Ren, Zhumin Chen, and Maarten de Rijke. 2021. Simulating User Satisfaction for the Evaluation of Task-Oriented Dialogue Systems. Association for Computing Machinery, 2499--2506."},{"key":"e_1_3_2_2_26_1","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , ? ukasz Kaiser, and Illia Polosukhin . 2017 . Attention is All you Need . In Advances in Neural Information Processing Systems , Vol. 30 . Curran Associates, Inc. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ? ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"crossref","unstructured":"Jason Wei and Kai Zou. 2019. EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks. In Proc. of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics 6382--6388.  Jason Wei and Kai Zou. 2019. EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks. In Proc. of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics 6382--6388.","DOI":"10.18653\/v1\/D19-1670"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i16.17666"},{"key":"e_1_3_2_2_29_1","volume-title":"DialogueBERT: A Self-Supervised Learning Based Dialogue Pre-Training Encoder","author":"Zhang Zhenyu","unstructured":"Zhenyu Zhang , Tao Guo , and Meng Chen . 2021. DialogueBERT: A Self-Supervised Learning Based Dialogue Pre-Training Encoder . Association for Computing Machinery , 3647--3651. Zhenyu Zhang, Tao Guo, and Meng Chen. 2021. DialogueBERT: A Self-Supervised Learning Based Dialogue Pre-Training Encoder. Association for Computing Machinery, 3647--3651."}],"event":{"name":"SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval","location":"Madrid Spain","acronym":"SIGIR '22","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477495.3531814","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477495.3531814","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:10:26Z","timestamp":1750183826000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477495.3531814"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,6]]},"references-count":29,"alternative-id":["10.1145\/3477495.3531814","10.1145\/3477495"],"URL":"https:\/\/doi.org\/10.1145\/3477495.3531814","relation":{},"subject":[],"published":{"date-parts":[[2022,7,6]]},"assertion":[{"value":"2022-07-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}