{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T22:24:06Z","timestamp":1776205446494,"version":"3.50.1"},"reference-count":54,"publisher":"MIT Press - Journals","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Transactions of the Association for Computational Linguistics"],"published-print":{"date-parts":[[2019,11]]},"abstract":"<jats:p> Humans gather information through conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions. We introduce CoQA, a novel dataset for building Conversational Question Answering systems. Our dataset contains 127k questions with answers, obtained from 8k conversations about text passages from seven diverse domains. The questions are conversational, and the answers are free-form text with their corresponding evidence highlighted in the passage. We analyze CoQA in depth and show that conversational questions have challenging phenomena not present in existing reading comprehension datasets (e.g., coreference and pragmatic reasoning). We evaluate strong dialogue and reading comprehension models on CoQA. The best system obtains an F1 score of 65.4%, which is 23.4 points behind human performance (88.8%), indicating that there is ample room for improvement. We present CoQA as a challenge to the community at https:\/\/stanfordnlp.github.io\/coqa . <\/jats:p>","DOI":"10.1162\/tacl_a_00266","type":"journal-article","created":{"date-parts":[[2019,5,29]],"date-time":"2019-05-29T17:06:41Z","timestamp":1559149601000},"page":"249-266","source":"Crossref","is-referenced-by-count":392,"title":["CoQA: A Conversational Question Answering Challenge"],"prefix":"10.1162","volume":"7","author":[{"given":"Siva","family":"Reddy","sequence":"first","affiliation":[{"name":"Computer Science Department, Stanford University."}]},{"given":"Danqi","family":"Chen","sequence":"additional","affiliation":[{"name":"Computer Science Department, Stanford University."}]},{"given":"Christopher D.","family":"Manning","sequence":"additional","affiliation":[{"name":"Computer Science Department, Stanford University."}]}],"member":"281","reference":[{"key":"bib1","first-page":"2425","volume-title":"International Conference on Computer Vision (ICCV)","author":"Antol Stanislaw","year":"2015"},{"key":"bib2","volume-title":"International Conference on Learning Representations (ICLR)","author":"Bahdanau Dzmitry","year":"2015"},{"key":"bib3","first-page":"1533","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Berant Jonathan","year":"2013"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"bib5","author":"Bordes Antoine","year":"2015","journal-title":"arXiv preprint arXiv:1506.02075"},{"key":"bib6","first-page":"643","volume-title":"Association for Computational Linguistics (ACL)","author":"Chaganty Arun","year":"2018"},{"key":"bib7","first-page":"2358","author":"Chen Danqi","year":"2016","journal-title":"Association for Computational Linguistics (ACL)"},{"key":"bib8","first-page":"1870","volume-title":"Association for Computational Linguistics (ACL)","author":"Chen Danqi","year":"2017"},{"key":"bib9","first-page":"2174","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Choi Eunsol","year":"2018"},{"key":"bib10","first-page":"4019","volume-title":"Association for the Advancement of Artificial Intelligence (AAAI)","author":"Clark Peter","year":"2015"},{"key":"bib11","first-page":"326","volume-title":"Computer Vision and Pattern Recognition (CVPR)","author":"Das Abhishek","year":"2017"},{"key":"bib12","author":"Devlin Jacob","year":"2018","journal-title":"arXiv preprint arXiv:1810.04805"},{"key":"bib13","author":"Dunn Matthew","year":"2017","journal-title":"arXiv preprint arXiv:1704.05179"},{"key":"bib14","first-page":"1077","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Elgohary Ahmed","year":"2018"},{"key":"bib15","first-page":"889","volume-title":"Association for Computational Linguistics (ACL)","author":"Fan Angela","year":"2018"},{"key":"bib16","first-page":"1631","volume-title":"Association for Computational Linguistics (ACL)","author":"Jiatao Gu","year":"2016"},{"key":"bib17","first-page":"1693","volume-title":"Advances in Neural Information Processing Systems (NIPS)","author":"Hermann Karl Moritz","year":"2015"},{"key":"bib18","volume-title":"International Conference on Learning Representations (ICLR)","author":"Hill Felix","year":"2016"},{"key":"bib19","author":"Hori Chiori","year":"2018","journal-title":"arXiv preprint arXiv:1806.08409"},{"key":"bib20","volume-title":"International Conference on Learning Representations (ICLR)","author":"Huang Hsin-Yuan","year":"2019"},{"key":"bib21","first-page":"1821","volume-title":"Association for Computational Linguistics (ACL)","author":"Iyyer Mohit","year":"2017"},{"key":"bib22","first-page":"1601","volume-title":"Association for Computational Linguistics (ACL)","author":"Joshi Mandar","year":"2017"},{"key":"bib23","first-page":"252","volume-title":"North American Chapter of the Association for Computational Linguistics (NAACL)","author":"Khashabi Daniel","year":"2018"},{"key":"bib24","first-page":"67","volume-title":"Association for Computational Linguistics (ACL)","author":"Klein Guillaume","year":"2017"},{"key":"bib25","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00023"},{"key":"bib26","first-page":"833","volume-title":"Association for Computational Linguistics (ACL)","author":"Labutov Igor","year":"2018"},{"key":"bib27","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Lai Guokun","year":"2017"},{"key":"bib28","first-page":"110","volume-title":"North American Chapter of the Association for Computational Linguistics (NAACL)","author":"Li Jiwei","year":"2016"},{"key":"bib29","first-page":"2122","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Liu Chia-Wei","year":"2016"},{"key":"bib30","first-page":"55","volume-title":"Association for Computational Linguistics (ACL)","author":"Manning Christopher D.","year":"2014"},{"key":"bib31","first-page":"79","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Miller Alexander","year":"2017"},{"key":"bib32","author":"Nguyen Tri","year":"2016","journal-title":"arXiv preprint arXiv:1611.09268"},{"key":"bib33","doi-asserted-by":"crossref","first-page":"747","DOI":"10.18653\/v1\/S18-1119","volume-title":"International Workshop on Semantic Evaluation (SemEval)","author":"Ostermann Simon","year":"2018"},{"key":"bib34","first-page":"1470","volume-title":"Association for Computational Linguistics and International Joint Conference on Natural Language Processing (ACL-IJCNLP)","author":"Pasupat Panupong","year":"2015"},{"key":"bib35","first-page":"1532","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington Jeffrey","year":"2014"},{"key":"bib36","first-page":"784","volume-title":"Association for Computational Linguistics (ACL)","author":"Rajpurkar Pranav","year":"2018"},{"key":"bib37","first-page":"2383","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Rajpurkar Pranav","year":"2016"},{"key":"bib38","first-page":"193","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Richardson Matthew","year":"2013"},{"key":"bib39","first-page":"2087","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Saeidi Marzieh","year":"2018"},{"key":"bib40","first-page":"705","volume-title":"Association for the Advancement of Artificial Intelligence (AAAI)","author":"Saha Amrita","year":"2018"},{"key":"bib41","first-page":"1073","volume-title":"Annual Meeting of the Association for Computational Linguistics (ACL)","author":"See Abigail","year":"2017"},{"key":"bib42","volume-title":"International Conference on Learning Representations (ICLR)","author":"Seo Minjoon","year":"2016"},{"key":"bib43","author":"Serban Iulian Vlad","year":"2016","journal-title":"arXiv preprint arXiv:1611.06216"},{"key":"bib44","first-page":"641","volume-title":"North American Chapter of the Association for Computational Linguistics (NAACL)","author":"Talmor Alon","year":"2018"},{"key":"bib45","doi-asserted-by":"crossref","first-page":"191","DOI":"10.18653\/v1\/W17-2623","volume-title":"Workshop on Representation Learning for NLP","author":"Trischler Adam","year":"2017"},{"key":"bib46","author":"Vinyals Oriol","year":"2015","journal-title":"arXiv preprint arXiv:1506.05869"},{"key":"bib47","first-page":"271","volume-title":"Computational Natural Language Learning (CoNLL)","author":"Weissenborn Dirk","year":"2017"},{"key":"bib48","doi-asserted-by":"crossref","first-page":"94","DOI":"10.18653\/v1\/W17-4413","volume-title":"Workshop on Noisy User-generated Text","author":"Welbl Johannes","year":"2017"},{"key":"bib49","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00021"},{"key":"bib50","volume-title":"International Conference on Learning Representations (ICLR)","author":"Weston Jason","year":"2016"},{"key":"bib51","volume-title":"International Conference on Learning Representations (ICLR)","author":"Adams Wei Yu","year":"2018"},{"key":"bib52","first-page":"2204","volume-title":"Association for Computational Linguistics (ACL)","author":"Zhang Saizheng","year":"2018"},{"key":"bib53","first-page":"708","volume-title":"Empirical Methods in Natural Language Processing (EMNLP)","author":"Zhou Kangyan","year":"2018"},{"key":"bib54","author":"Zhu Chenguang","year":"2018","journal-title":"arXiv preprint arXiv:1812.03593"}],"container-title":["Transactions of the Association for Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/tacl_a_00266","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:39:22Z","timestamp":1615585162000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/tacl\/article\/43511"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11]]},"references-count":54,"alternative-id":["10.1162\/tacl_a_00266"],"URL":"https:\/\/doi.org\/10.1162\/tacl_a_00266","relation":{},"ISSN":["2307-387X"],"issn-type":[{"value":"2307-387X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11]]}}}