{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T08:36:53Z","timestamp":1775723813987,"version":"3.50.1"},"reference-count":42,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:p> We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph. A dialogue agent maps each user utterance to a program that extends this graph. Programs include metacomputation operators for reference and revision that reuse dataflow fragments from previous turns. Our graph-based state enables the expression and manipulation of complex user intents, and explicit metacomputation makes these intents easier for learned models to predict. We introduce a new dataset, SMCalFlow, featuring complex dialogues about events, weather, places, and people. Experiments show that dataflow graphs and metacomputation substantially improve representability and predictability in these natural dialogues. Additional experiments on the MultiWOZ dataset show that our dataflow representation enables an otherwise off-the-shelf sequence-to-sequence model to match the best existing task-specific state tracking model. The SMCalFlow dataset, code for replicating experiments, and a public leaderboard are available at https:\/\/www.microsoft.com\/en-us\/research\/project\/dataflow-based-dialogue-semantic-machines . <\/jats:p>","DOI":"10.1162\/tacl_a_00333","type":"journal-article","created":{"date-parts":[[2020,9,21]],"date-time":"2020-09-21T19:00:29Z","timestamp":1600714829000},"page":"556-571","source":"Crossref","is-referenced-by-count":20,"title":["Task-Oriented Dialogue as Dataflow Synthesis"],"prefix":"10.1162","volume":"8","author":[{"given":"Jacob","family":"Andreas","sequence":"first","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"John","family":"Bufe","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"David","family":"Burkett","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Charles","family":"Chen","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Josh","family":"Clausman","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Jean","family":"Crawford","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Kate","family":"Crim","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Jordan","family":"DeLoach","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Leah","family":"Dorner","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Jason","family":"Eisner","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Hao","family":"Fang","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Alan","family":"Guo","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"David","family":"Hall","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Kristin","family":"Hayes","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Kellie","family":"Hill","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Diana","family":"Ho","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Wendy","family":"Iwaszuk","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Smriti","family":"Jha","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Dan","family":"Klein","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Jayant","family":"Krishnamurthy","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Theo","family":"Lanman","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Percy","family":"Liang","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Christopher H.","family":"Lin","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Ilya","family":"Lintsbakh","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Andy","family":"McGovern","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Aleksandr","family":"Nisnevich","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Adam","family":"Pauls","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Dmitrij","family":"Petters","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Brent","family":"Read","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Dan","family":"Roth","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Subhro","family":"Roy","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Jesse","family":"Rusak","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Beth","family":"Short","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Div","family":"Slomin","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Ben","family":"Snyder","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Stephon","family":"Striplin","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Yu","family":"Su","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Zachary","family":"Tellman","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Sam","family":"Thomson","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Andrei","family":"Vorobev","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Izabela","family":"Witoszko","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Jason","family":"Wolfe","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Abby","family":"Wray","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Yuchen","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]},{"given":"Alexander","family":"Zotov","sequence":"additional","affiliation":[{"name":"Microsoft Semantic Machines"}]}],"member":"281","reference":[{"key":"bib1","doi-asserted-by":"crossref","first-page":"62","DOI":"10.3115\/981863.981872","volume-title":"Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics","author":"Allen James F.","year":"1996"},{"key":"bib2","series-title":"William James Lectures","volume-title":"How to Do Things with Words","author":"Austin John Langshaw","year":"1962"},{"key":"bib3","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Bordes Antoine","year":"2016"},{"key":"bib4","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Budzianowski Pawel","year":"2018"},{"key":"bib5","first-page":"4516","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing and the International Joint Conference on Natural Language Processing","author":"Byrne Bill","year":"2019"},{"key":"bib6","author":"Eric Mihail","year":"2019","journal-title":"arXiv:1907.01669 [cs.CL]"},{"issue":"2","key":"bib7","first-page":"127","volume":"13","author":"Gao Jianfeng","year":"2019","journal-title":"Foundations and Trends\u00ae in Information Retrieval"},{"key":"bib8","volume-title":"Proceedings of the Conference of the International Speech Communication Association","author":"Goel Rahul","year":"2019"},{"issue":"3","key":"bib9","first-page":"175","volume":"12","author":"Grosz Barbara J.","year":"1986","journal-title":"Computational Linguistics"},{"key":"bib10","unstructured":"Barbara J. Grosz and Candace L. Sidner. 1988. Plans for discourse. Technical report, BBN Laboratories."},{"key":"bib11","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Gupta Sonal","year":"2018"},{"key":"bib12","volume-title":"Speech and Natural Language: Proceedings of a Workshop Held at Hidden Valley","author":"Hemphill Charles T.","year":"1990"},{"key":"bib13","first-page":"29","volume":"146","author":"Hindley R.","year":"1969","journal-title":"Transactions of the American Mathematical Society"},{"key":"bib14","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Iyyer Mohit","year":"2017"},{"issue":"1","key":"bib15","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1145\/321921.321938","volume":"23","author":"Kam John B.","year":"1976","journal-title":"Journal of the ACM (JACM)"},{"key":"bib16","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Kingma Diederik","year":"2015"},{"key":"bib17","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Klein Guillaume","year":"2017"},{"key":"bib18","volume-title":"Term Rewriting Systems","author":"Klop Jan Willem","year":"1990"},{"issue":"4","key":"bib19","first-page":"535","volume":"20","author":"Lappin Shalom","year":"1994","journal-title":"Computational Linguistics"},{"key":"bib20","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1016\/0022-0000(78)90014-4","volume":"17","author":"Milner Robin","year":"1978","journal-title":"Journal of Computer and System Sciences"},{"key":"bib21","doi-asserted-by":"crossref","DOI":"10.4324\/9781315840086","volume-title":"Anaphora Resolution","author":"Mitkov Ruslan","year":"2014"},{"key":"bib22","volume-title":"Proceedings of the Conference on Machine Translation","author":"Murray Kenton","year":"2018"},{"key":"bib23","author":"Neelakantan Arvind","year":"2019","journal-title":"arXiv:1910.14613 [cs.LG]"},{"key":"bib24","first-page":"1532","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Pennington Jeffrey","year":"2014"},{"key":"bib25","first-page":"193","volume-title":"Proceedings of 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)","volume":"1","author":"Pieraccini Roberto","year":"1992"},{"issue":"4","key":"bib26","first-page":"15","volume":"22","author":"Rich Charles","year":"2001","journal-title":"AI Magazine"},{"key":"bib27","first-page":"1073","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"See Abigail","year":"2017"},{"key":"bib28","doi-asserted-by":"publisher","DOI":"10.1162\/089120100561737"},{"key":"bib29","volume-title":"Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics","author":"Suhr Alane","year":"2018"},{"key":"bib30","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/S1571-0661(04)00270-1","volume":"57","author":"Visser Eelco","year":"2001","journal-title":"Electronic Notes in Theoretical Computer Science"},{"key":"bib31","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00202"},{"key":"bib32","first-page":"438","volume-title":"Proceedings of the European Association for Computational Linguistics","author":"Wen Tsung-Hsien","year":"2017"},{"key":"bib33","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Williams Jason D.","year":"2017"},{"key":"bib34","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Chien-Sheng Wu","year":"2019"},{"issue":"5","key":"bib35","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1109\/JPROC.2012.2225812","volume":"101","author":"Young Steve","year":"2013","journal-title":"Proc. IEEE"},{"key":"bib36","first-page":"1962","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Tao Yu","year":"2019"},{"key":"bib37","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Tao Yu","year":"2019"},{"key":"bib38","unstructured":"John Zelle. 1995. Using Inductive Logic Programming to Automate the Construction of Natural Language Parsers. Ph.D. thesis, Department of Computer Sciences, The University of Texas at Austin."},{"key":"bib39","first-page":"976","volume-title":"Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP","author":"Zettlemoyer Luke","year":"2009"},{"key":"bib40","volume-title":"Proceedings of the Conference on Empirical Methods in Natural Language Processing","author":"Zhang Rui","year":"2019"},{"key":"bib41","first-page":"1","volume-title":"Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue","author":"Zhao Tiancheng","year":"2016"},{"issue":"3","key":"bib42","first-page":"331","volume":"15","author":"Zue Victor","year":"1994","journal-title":"Speech Communication"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00333","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:44Z","timestamp":1615585184000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/96470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12]]},"references-count":42,"alternative-id":["10.1162\/tacl_a_00333"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00333","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12]]}}}