{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,1,10]],"date-time":"2024-01-10T00:25:07Z","timestamp":1704846307834},"reference-count":24,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:p> Neural end-to-end goal-oriented dialog systems showed promise to reduce the workload of human agents for customer service, as well as reduce wait time for users. However, their inability to handle new user behavior at deployment has limited their usage in real world. In this work, we propose an end-to-end trainable method for neural goal-oriented dialog systems that handles new user behaviors at deployment by transferring the dialog to a human agent intelligently. The proposed method has three goals: 1) maximize user\u2019s task success by transferring to human agents, 2) minimize the load on the human agents by transferring to them only when it is essential, and 3) learn online from the human agent\u2019s responses to reduce human agents\u2019 load further. We evaluate our proposed method on a modified-bAbI dialog task, <jats:sup>1<\/jats:sup> which simulates the scenario of new user behaviors occurring at test time. Experimental results show that our proposed method is effective in achieving the desired goals. <\/jats:p>","DOI":"10.1162\/tacl_a_00274","type":"journal-article","created":{"date-parts":[[2019,7,12]],"date-time":"2019-07-12T18:24:05Z","timestamp":1562955845000},"page":"375-386","source":"Crossref","is-referenced-by-count":2,"title":["Learning End-to-End Goal-Oriented Dialog with Maximal User Task Success and Minimal Human Agent Use"],"prefix":"10.1162","volume":"7","author":[{"given":"Janarthanan","family":"Rajendran","sequence":"first","affiliation":[{"name":"University of Michigan."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jatin","family":"Ganhotra","sequence":"additional","affiliation":[{"name":"IBM Research."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lazaros C.","family":"Polymenakos","sequence":"additional","affiliation":[{"name":"IBM Research."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"bib1","volume-title":"In the International Conference on Learning Representations (ICLR)","author":"Bordes Antoine","year":"2017"},{"key":"bib2","author":"Eric Mihail","year":"2017","journal-title":"In Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL)"},{"key":"bib3","first-page":"214","volume-title":"Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL)","author":"Gasic Milica","year":"2013"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1162\/coli.2008.07-028-R2-05-82"},{"issue":"1","key":"bib5","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/89.817450","volume":"8","author":"Levin Esther","year":"2000","journal-title":"IEEE Transactions on Speech and Audio Processing"},{"key":"bib6","author":"Li Jiwei","year":"2017","journal-title":"In the International Conference on Learning Representations (ICLR)"},{"key":"bib7","volume-title":"Proceedings of the Eighth International Joint Conference on Natural Language Processing (IJCNLP)","author":"Li Xiujun","year":"2017"},{"key":"bib8","author":"Liu Bing","year":"2017","journal-title":"2017 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)"},{"key":"bib9","volume-title":"Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)","author":"Liu Bing","year":"2018"},{"key":"bib10","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Peng Baolin","year":"2017"},{"key":"bib11","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-642-04208-9_3","volume-title":"Proceedings of the 12th International Conference on Text, Speech and Dialogue","author":"Pieraccini Roberto","year":"2009"},{"key":"bib12","volume-title":"Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Rajendran Janarthanan","year":"2018"},{"issue":"2","key":"bib13","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1017\/S0269888906000944","volume":"21","author":"Schatzmann Jost","year":"2006","journal-title":"The Knowledge Engineering Review"},{"key":"bib14","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Seo Minjoon","year":"2017"},{"key":"bib15","first-page":"645","volume-title":"Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence","author":"Singh Satinder","year":"2000"},{"key":"bib16","volume-title":"Proceedings of the 24th ACM International on Conference on Information and Knowledge Management (CIKM)","author":"Sordoni Alessandro","year":"2015"},{"key":"bib17","volume-title":"Advances in Neural Information Processing Systems 28 (NeurIPS)","author":"Sukhbaatar Sainbayar","year":"2015"},{"key":"bib18","volume-title":"Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL)","author":"Wen Tsung-Hsien","year":"2017"},{"key":"bib19","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR)","author":"Weston Jason","year":"2014"},{"key":"bib20","volume-title":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL)","author":"Williams Jason D.","year":"2017"},{"key":"bib21","author":"Williams Jason D.","year":"2016","journal-title":"CoRR"},{"issue":"3","key":"bib22","first-page":"229","volume":"8","author":"Williams Ronald J.","year":"1992","journal-title":"Machine Learning"},{"issue":"5","key":"bib23","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1109\/JPROC.2012.2225812","volume":"101","author":"Young Steve J.","year":"2013","journal-title":"Proceedings of the IEEE"},{"key":"bib24","volume-title":"Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL)","author":"Zhao Tiancheng","year":"2016"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00274","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:24Z","timestamp":1615585164000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11]]},"references-count":24,"alternative-id":["10.1162\/tacl_a_00274"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00274","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11]]}}}