{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T23:38:21Z","timestamp":1774309101360,"version":"3.50.1"},"reference-count":86,"publisher":"MIT Press","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Linguistics"],"published-print":{"date-parts":[[2017,9]]},"abstract":"<jats:p>In this article, we present a novel approach for parsing argumentation structures. We identify argument components using sequence labeling at the token level and apply a new joint model for detecting argumentation structures. The proposed model globally optimizes argument component types and argumentative relations using Integer Linear Programming. We show that our model significantly outperforms challenging heuristic baselines on two different types of discourse. Moreover, we introduce a novel corpus of persuasive essays annotated with argumentation structures. We show that our annotation scheme and annotation guidelines successfully guide human annotators to substantial agreement.<\/jats:p>","DOI":"10.1162\/coli_a_00295","type":"journal-article","created":{"date-parts":[[2017,6,9]],"date-time":"2017-06-09T17:06:51Z","timestamp":1497028011000},"page":"619-659","source":"Crossref","is-referenced-by-count":191,"title":["Parsing Argumentation Structures in Persuasive Essays"],"prefix":"10.1162","volume":"43","author":[{"given":"Christian","family":"Stab","sequence":"first","affiliation":[{"name":"Technische Universit\u00e4t Darmstadt"}]},{"given":"Iryna","family":"Gurevych","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Darmstadt and German Institute for Educational Research"}]}],"member":"281","reference":[{"key":"bib1","unstructured":"Afantenos, Stergos and Nicholas Asher. 2014. Counter-argumentation and discourse: A case study. In Proceedings of the Workshop on Frontiers and Connections between Argumentation Theory and Natural Language Processing, pages 11\u201316, Bertinoro."},{"key":"bib2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1109"},{"key":"bib3","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2109"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1162\/coli.07-034-R2"},{"key":"bib7","unstructured":"Beigman Klebanov, Beata and Derrick Higgins. 2012. Measuring the use of factual information in test-taker essays. In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP, pages 63\u201372, Montreal."},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-010-9154-1"},{"key":"bib9","doi-asserted-by":"publisher","DOI":"10.1142\/S1793351X11001328"},{"key":"bib10","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00238"},{"key":"bib11","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2107"},{"key":"bib12","unstructured":"Botley, Simon Philip. 2014. Argument structure in learner writing: a corpus-based analysis using argument mapping. Kajian Malaysia, 32(1):45\u201377."},{"key":"bib13","unstructured":"Braud, Chlo\u00e9 and Pascal Denis. 2014. Combining natural and artificial examples to improve implicit discourse relation identification. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pages 1694\u20131705, Dublin."},{"key":"bib14","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"bib16","doi-asserted-by":"crossref","unstructured":"Cabrio, Elena and Serena Villata. 2012. Natural language arguments: A combined approach. In Proceedings of the 20th European Conference on Artificial Intelligence, ECAI '12, pages 205\u2013210, Montpellier.","DOI":"10.3233\/978-1-61499-098-7-205"},{"key":"bib17","doi-asserted-by":"crossref","unstructured":"Cabrio, Elena and Serena Villata. 2014. NoDE: A benchmark of natural language arguments. In Proceedings of COMMA, pages 449\u2013450, Pitlochry.","DOI":"10.3233\/978-1-61499-436-7-449"},{"key":"bib18","doi-asserted-by":"crossref","unstructured":"Carlson, Lynn, Daniel Marcu, and Mary Ellen Okurowski. 2001. Building a discourse-tagged corpus in the framework of rhetorical structure theory. In Proceedings of the Second SIGdial Workshop on Discourse and Dialogue - Volume 16, SIGDIAL '01, pages 1\u201310, Aalborg.","DOI":"10.3115\/1118078.1118083"},{"key":"bib19","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0504"},{"key":"bib20","doi-asserted-by":"crossref","unstructured":"Eckart de Castilho, Richard and Iryna Gurevych. 2014. A broad-coverage collection of portable NLP components for building shareable analysis pipelines. In Proceedings of the Workshop on Open Infrastructures and Analysis Frameworks for HLT (OIAF4HLT) at COLING 2014, pages 1\u201311, Dublin.","DOI":"10.3115\/v1\/W14-5201"},{"key":"bib21","doi-asserted-by":"publisher","DOI":"10.2307\/2347628"},{"key":"bib22","unstructured":"Church, Kenneth Ward and Patrick Hanks. 1990. Word association norms, mutual information, and lexicography. Computational Linguistics, 16(1):22\u201329."},{"key":"bib23","unstructured":"Cinkov\u00e1, Silvie, Martin Holub, and Vincent Kr\u00ed\u017e. 2012. Managing uncertainty in semantic tagging. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL '12, pages 840\u2013850, Avignon."},{"key":"bib24","unstructured":"Cohen, Robin. 1987. Analyzing the structure of argumentative discourse. Computational Linguistics, 13(1-2):11\u201324."},{"key":"bib25","doi-asserted-by":"crossref","unstructured":"Collins, Michael. 2002. Discriminative training methods for hidden Markov models: Theory and experiments with perceptron algorithms. In Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing - Volume 10, EMNLP '02, pages 1\u20138, Pennsylvania, PA.","DOI":"10.3115\/1118693.1118694"},{"key":"bib26","doi-asserted-by":"publisher","DOI":"10.1162\/089120103322753356"},{"key":"bib27","doi-asserted-by":"publisher","DOI":"10.22329\/il.v13i3.2564"},{"key":"bib29","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"bib31","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-5011"},{"key":"bib33","unstructured":"Feng, Vanessa Wei and Graeme Hirst. 2011. Classifying arguments by scheme. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1, HLT '11, pages 987\u2013996, Portland, OR."},{"key":"bib34","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1048"},{"key":"bib35","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"bib36","unstructured":"Florou, Eirini, Stasinos Konstantopoulos, Antonis Koukourikos, and Pythagoras Karampiperis. 2013. Argument extraction for supporting public policy formulation. In Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, pages 49\u201354, Sofia."},{"key":"bib37","doi-asserted-by":"publisher","DOI":"10.1145\/1882471.1882479"},{"key":"bib39","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2106"},{"key":"bib42","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00276"},{"key":"bib43","doi-asserted-by":"publisher","DOI":"10.1145\/1656274.1656278"},{"key":"bib44","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1083"},{"key":"bib45","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007800305762"},{"key":"bib46","doi-asserted-by":"publisher","DOI":"10.5087\/dad.2010.003"},{"key":"bib47","unstructured":"John, George H. and Pat Langley. 1995. Estimating continuous distributions in Bayesian classifiers. In Eleventh Conference on Uncertainty in Artificial Intelligence, pages 338\u2013345, Montreal."},{"key":"bib50","doi-asserted-by":"crossref","unstructured":"Kirschner, Christian, Judith Eckle-Kohler, and Iryna Gurevych. 2015. Linking the thoughts: Analysis of argumentation structures in scientific publications. In Proceedings of the 2nd Workshop on Argumentation Mining, 1\u201311, Denver, CO.","DOI":"10.3115\/v1\/W15-0501"},{"key":"bib51","doi-asserted-by":"crossref","unstructured":"Klein, Dan and Christopher D. Manning. 2003. Accurate unlexicalized parsing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics - Volume 1, ACL '03, pages 423\u2013430, Sapporo.","DOI":"10.3115\/1075096.1075150"},{"key":"bib52","doi-asserted-by":"publisher","DOI":"10.1007\/s11135-004-8107-7"},{"key":"bib54","unstructured":"Kwon, Namhee, Liang Zhou, Eduard Hovy, and Stuart W. Shulman. 2007. Identifying and classifying subjective claims. In Proceedings of the 8th Annual International Conference on Digital Government Research: Bridging Disciplines & Domains, pages 76\u201381, Philadelphia, PA."},{"key":"bib55","unstructured":"Lafferty, John D., Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the Eighteenth International Conference on Machine Learning, ICML '01, 282\u2013289, San Francisco, CA."},{"key":"bib56","unstructured":"Levy, Ran, Yonatan Bilu, Daniel Hershcovich, Ehud Aharoni, and Noam Slonim. 2014. Context dependent claim detection. In Proceedings of the 25th International Conference on Computational Linguistics (COLING 2014), 1489\u20131500, Dublin."},{"key":"bib57","doi-asserted-by":"publisher","DOI":"10.3115\/1699510.1699555"},{"key":"bib58","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324912000307"},{"key":"bib59","unstructured":"Lippi, Marco and Paolo Torroni. 2015. Context-independent claim detection for argument mining. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015), pages 185\u2013191, Buenos Aires."},{"key":"bib60","unstructured":"Louis, Annie, Aravind Joshi, Rashmi Prasad, and Ani Nenkova. 2010. Using entity features to classify implicit discourse relations. In Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL '10, pages 59\u201362, Stroudsburg, PA."},{"key":"bib62","unstructured":"Marcu, Daniel and Abdessamad Echihabi. 2002. An unsupervised approach to recognizing discourse relations. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, ACL '02, pages 368\u2013375."},{"key":"bib63","unstructured":"Meyer, Christian M., Margot Mieskes, Christian Stab, and Iryna Gurevych. 2014. DKPro agreement: An open-source Java library for measuring inter-rater agreement. In Proceedings of the 25th International Conference on Computational Linguistics: System Demonstrations (COLING), pages 105\u2013109, Dublin."},{"key":"bib65","doi-asserted-by":"publisher","DOI":"10.1145\/1568234.1568238"},{"key":"bib66","doi-asserted-by":"crossref","unstructured":"Mochales-Palau, Raquel and Marie-Francine Moens. 2009. Argumentation mining: The detection, classification and structure of arguments in text. In Proceedings of the 12th International Conference on Artificial Intelligence and Law, ICAIL '09, pages 98\u2013107, Barcelona.","DOI":"10.1145\/1568234.1568246"},{"key":"bib67","doi-asserted-by":"publisher","DOI":"10.1007\/s10506-010-9104-x"},{"key":"bib68","doi-asserted-by":"crossref","unstructured":"Moens, Marie Francine. 2013. Argumentation mining: Where are we now, where do we want to be and how do we get there? In Post-proceedings of the Forum for Information Retrieval Evaluation (FIRE 2013), pages 4\u20136, New Delhi.","DOI":"10.1145\/2701336.2701635"},{"key":"bib69","doi-asserted-by":"crossref","unstructured":"Moens, Marie Francine, Erik Boiy, Raquel Mochales Palau, and Chris Reed. 2007. Automatic detection of arguments in legal texts. In Proceedings of the 11th International Conference on Artificial Intelligence and Law, ICAIL '07, pages 225\u2013230, Stanford, CA.","DOI":"10.1145\/1276318.1276362"},{"key":"bib70","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0503"},{"key":"bib71","doi-asserted-by":"crossref","unstructured":"O'Keefe, Daniel J. 1977. Two concepts of argument. Journal of the American Forensic Association, 13(3):121\u2013128.","DOI":"10.1080\/00028533.1977.11951098"},{"key":"bib72","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0515"},{"key":"bib73","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2105"},{"key":"bib74","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2112"},{"key":"bib75","doi-asserted-by":"publisher","DOI":"10.4018\/jcini.2013010101"},{"key":"bib76","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1110"},{"key":"bib77","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1053"},{"key":"bib79","doi-asserted-by":"crossref","unstructured":"Pitler, Emily, Annie Louis, and Ani Nenkova. 2009. Automatic sense prediction for implicit discourse relations in text. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 683\u2013691, Suntec.","DOI":"10.3115\/1690219.1690241"},{"key":"bib80","unstructured":"Prasad, Rashmi, Nikhil Dinesh, Alan Lee, Eleni Miltsakaki, Livio Robaldo, Aravind Joshi, and Bonnie Webber. 2008. The Penn Discourse Treebank 2.0. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08), Marrakech."},{"key":"bib82","unstructured":"Ramshaw, Lance A. and Mitchell P. Marcus. 1995. Text chunking using transformation-based learning. In Proceedings of the 3rd ACL Workshop on Very Large Corpora, pages 82\u201394, Cambridge, MA."},{"key":"bib83","unstructured":"Reed, Chris, Raquel Mochales-Palau, Glenn Rowe, and Marie-Francine Moens. 2008. Language resources for studying argument. In Proceedings of the Sixth International Conference on Language Resources and Evaluation, LREC '08, pages 2613\u20132618, Marrakech."},{"key":"bib84","doi-asserted-by":"publisher","DOI":"10.1142\/S0218213004001922"},{"key":"bib85","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D15-1050"},{"key":"bib86","unstructured":"Rooney, Niall, Hui Wang, and Fiona Browne. 2012. Applying kernel methods to argumentation mining. In Proceedings of the Twenty-Fifth International Florida Artificial Intelligence Research Society Conference, FLAIRS '12, pages 272\u2013275, Marco Island, FL."},{"key":"bib87","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W15-0508"},{"key":"bib89","doi-asserted-by":"crossref","unstructured":"Socher, Richard, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D. Manning, Andrew Y. Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1631\u20131642, Seattle, WA.","DOI":"10.18653\/v1\/D13-1170"},{"key":"bib90","unstructured":"S\u00f8gaard, Anders. 2013. Estimating effect size across datasets. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 607\u2013611, Atlanta."},{"key":"bib91","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2009.03.002"},{"key":"bib92","doi-asserted-by":"crossref","unstructured":"Somasundaran, Swapna and Janyce Wiebe. 2009. Recognizing stances in online debates. In Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLP, ACL '09, pages 226\u2013234, Suntec.","DOI":"10.3115\/1687878.1687912"},{"key":"bib93","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-2110"},{"key":"bib94","doi-asserted-by":"publisher","DOI":"10.3115\/1073445.1073475"},{"key":"bib95","unstructured":"Stab, Christian and Iryna Gurevych. 2014a. Annotating argument components and relations in persuasive essays. In Proceedings of the 25th International Conference on Computational Linguistics (COLING 2014), pages 1501\u20131510, Dublin."},{"key":"bib96","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1006"},{"key":"bib97","unstructured":"Stab, Christian, Christian Kirschner, Judith Eckle-Kohler, and Iryna Gurevych. 2014. Argumentation mining in persuasive essays and scientific articles from the discourse structure perspective. In Proceedings of the Workshop on Frontiers and Connections between Argumentation Theory and Natural Language Processing, pages 40\u201349, Bertinoro."},{"key":"bib98","unstructured":"Stenetorp, Pontus, Sampo Pyysalo, Goran Topi\u0107, Tomoko Ohta, Sophia Ananiadou, and Jun'ichi Tsujii. 2012. Brat: A web-based tool for NLP-assisted text annotation. In Proceedings of the Demonstrations at the 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL '12, pages 102\u2013107, Avignon."},{"key":"bib100","doi-asserted-by":"publisher","DOI":"10.3115\/1073445.1073478"},{"key":"bib101","doi-asserted-by":"crossref","unstructured":"Turney, Peter D. 2002. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, ACL '02, pages 417\u2013424, Philadelphia, PA.","DOI":"10.3115\/1073083.1073153"},{"key":"bib102","unstructured":"Walker, Marilyn, Jean Fox Tree, Pranav Anand, Rob Abbott, and Joseph King. 2012. A corpus for research on deliberation and debate. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 23\u201325, Istanbul."},{"key":"bib105","doi-asserted-by":"publisher","DOI":"10.1177\/0741088309333019"},{"key":"bib106","doi-asserted-by":"publisher","DOI":"10.22329\/il.v13i3.2563"}],"container-title":["Computational Linguistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/COLI_a_00295","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T02:54:25Z","timestamp":1750301665000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/coli\/article\/43\/3\/619-659\/1573"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9]]},"references-count":86,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2017,9]]}},"alternative-id":["10.1162\/COLI_a_00295"],"URL":"https:\/\/doi.org\/10.1162\/coli_a_00295","relation":{},"ISSN":["0891-2017","1530-9312"],"issn-type":[{"value":"0891-2017","type":"print"},{"value":"1530-9312","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9]]}}}