{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T11:26:29Z","timestamp":1764588389661,"version":"3.40.5"},"reference-count":206,"publisher":"Cambridge University Press (CUP)","issue":"4","license":[{"start":{"date-parts":[[2023,2,28]],"date-time":"2023-02-28T00:00:00Z","timestamp":1677542400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/www.cambridge.org\/core\/terms"}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["Nat. Lang. Eng."],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The study of argumentation is transversal to several research domains, from philosophy to linguistics, from the law to computer science and artificial intelligence. In discourse analysis, several distinct models have been proposed to harness argumentation, each with a different focus or aim. To analyze the use of argumentation in natural language, several corpora annotation efforts have been carried out, with a more or less explicit grounding on one of such theoretical argumentation models. In fact, given the recent growing interest in argument mining applications, argument-annotated corpora are crucial to train machine learning models in a supervised way. However, the proliferation of such corpora has led to a wide disparity in the granularity of the argument annotations employed. In this paper, we review the most relevant theoretical argumentation models, after which we survey argument annotation projects closely following those theoretical models. We also highlight the main simplifications that are often introduced in practice. Furthermore, we glimpse other annotation efforts that are not so theoretically grounded but instead follow a shallower approach. It turns out that most argument annotation projects make their own assumptions and simplifications, both in terms of the textual genre they focus on and in terms of adapting the adopted theoretical argumentation model for their own agenda. Issues of compatibility among argument-annotated corpora are discussed by looking at the problem from a syntactical, semantic, and practical perspective. Finally, we discuss current and prospective applications of models that take advantage of argument-annotated corpora.<\/jats:p>","DOI":"10.1017\/s1351324923000062","type":"journal-article","created":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T03:18:29Z","timestamp":1677640709000},"page":"1150-1187","update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":4,"title":["Argumentation models and their use in corpus annotation: Practice, prospects, and challenges"],"prefix":"10.1017","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1252-7515","authenticated-orcid":false,"given":"Henrique","family":"Lopes Cardoso","sequence":"first","affiliation":[]},{"given":"Rui","family":"Sousa-Silva","sequence":"additional","affiliation":[]},{"given":"Paula","family":"Carvalho","sequence":"additional","affiliation":[]},{"given":"Bruno","family":"Martins","sequence":"additional","affiliation":[]}],"member":"56","published-online":{"date-parts":[[2023,2,28]]},"reference":[{"doi-asserted-by":"publisher","key":"S1351324923000062_ref59","DOI":"10.3233\/AAC-181003"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref142","DOI":"10.1017\/S0269888907001051"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref79","DOI":"10.1007\/s10503-015-9386-y"},{"volume-title":"La nouvelle rh\u00e9torique. Trait\u00e9 de l\u2019argumentation","year":"1958","author":"Perelman","key":"S1351324923000062_ref119"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref82","DOI":"10.1016\/S0378-2166(03)00034-1"},{"volume-title":"Natural Language Annotation for Machine Learning","year":"2012","author":"Pustejovsky","key":"S1351324923000062_ref129"},{"unstructured":"Reed, C. and Walton, D. (2003). Argumentation schemes in argument-as-process and argument-as-product. In Proceedings of the Conference Celebrating Informal Logic @25, Windsor, ON.","key":"S1351324923000062_ref141"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref161","DOI":"10.18653\/v1\/2020.acl-main.268"},{"unstructured":"Reed, C. and Long, D. (1997). Persuasive monologue. In Proceedings of the 2nd International Conference of the Ontario Society for the Study of Argumentation (OSSA).","key":"S1351324923000062_ref137"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref11","DOI":"10.18653\/v1\/2020.emnlp-main.3"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref31","DOI":"10.24963\/ijcai.2018\/766"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref98","DOI":"10.1177\/026553229501200104"},{"unstructured":"Bal, B.K. and Saint Dizier, P. (2010). Towards building annotated resources for analyzing opinions and argumentation in news editorials. In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC\u201910), Valletta, Malta. European Languages Resources Association (ELRA), pp. 1152\u20131158.","key":"S1351324923000062_ref9"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref93","DOI":"10.1007\/s10503-013-9307-x"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref18","DOI":"10.1017\/CBO9780511621024"},{"key":"S1351324923000062_ref131","first-page":"1","article-title":"Exploring the limits of transfer learning with a unified text-to-text transformer","volume":"21","author":"Raffel","year":"2020","journal-title":"Journal of Machine Learning Research"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref162","DOI":"10.18653\/v1\/N19-1380"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref147","DOI":"10.1007\/978-0-387-98125-3_2"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref153","DOI":"10.1007\/978-1-84800-149-7_8"},{"unstructured":"Radford, A. , Wu, J. , Child, R. , Luan, D. , Amodei, D. and Sutskever, I. (2019). Language models are unsupervised multitask learners. https:\/\/d4mucfpksywv.cloudfront.net\/better-language-models\/language-models.pdf.","key":"S1351324923000062_ref130"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref70","DOI":"10.1007\/978-1-4039-3893-0"},{"unstructured":"Visser, J. , Lawrence, J. , Wagemans, J. and Reed, C. (2018). Revisiting computational models of argument schemes: Classification, annotation, comparison. In Modgil S., Budzynska, K., Lawrence, J. and Budzynska, K. (eds), Computational Models of Argument - Proceedings of COMMA 2018. Frontiers in Artificial Intelligence and Applications, vol. 305, Netherlands. IOS Press, pp. 313\u2013324.","key":"S1351324923000062_ref189"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref43","DOI":"10.3233\/AIC-180752"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref115","DOI":"10.3115\/v1\/W14-2105"},{"volume-title":"Linguagem, Argumenta\u00e7\u00e3o e Decis\u00e3o Judici\u00e1ria","year":"2012","author":"do Carmo","key":"S1351324923000062_ref42"},{"unstructured":"Budzynska, K. , Janier, M. , Reed, C. , Saint-Dizier, P. , Stede, M. and Yakorska, O. (2014). A model for processing illocutionary structures and argumentation in debates. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC\u201914), Reykjavik, Iceland. European Language Resources Association (ELRA), pp. 917\u2013924.","key":"S1351324923000062_ref25"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref86","DOI":"10.1007\/978-1-4471-0037-9"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref184","DOI":"10.1007\/978-3-319-20955-5_1"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref183","DOI":"10.1007\/978-1-4020-6244-5"},{"unstructured":"Blitzer, J. , Dredze, M. and Pereira, F. (2007). Biographies, Bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, Prague, Czech Republic. Association for Computational Linguistics, pp. 440\u2013447.","key":"S1351324923000062_ref20"},{"volume-title":"SpringerBriefs in Computer Science","year":"2021","author":"Chen","key":"S1351324923000062_ref33"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref160","DOI":"10.1007\/978-1-4020-8265-8_200183"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref2","DOI":"10.3115\/v1\/W14-2109"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref146","DOI":"10.1007\/978-3-030-04568-5"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref72","DOI":"10.18653\/v1\/W19-4512"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref66","DOI":"10.18653\/v1\/P19-1463"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref94","DOI":"10.1075\/jaic.18017.lew"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref143","DOI":"10.3115\/v1\/W15-0507"},{"unstructured":"Abbott, R. , Ecker, B. , Anand, P. and Walker, M. (2016). Internet argument corpus 2.0: An SQL schema for dialogic social media and the corpora to go with it. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC\u201916), Portoro\u017e, Slovenia. European Language Resources Association (ELRA), pp. 4445\u20134452.","key":"S1351324923000062_ref1"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref10","DOI":"10.18653\/v1\/2020.acl-main.371"},{"unstructured":"Aharonov, R. and Slonim, N. (2019). Watch IBM\u2019s AI System Debate a Human Champion Live at Think 2019. https:\/\/www.ibm.com\/blogs\/research\/2019\/02\/ai-debate-think-2019\/ (accessed 14 April 2021).","key":"S1351324923000062_ref3"},{"unstructured":"Ruder, S. (2017). An overview of multi-task learning in deep neural networks. ArXiv, abs\/1706.05098.","key":"S1351324923000062_ref154"},{"unstructured":"Musi, E. , Stede, M. , Kriese, L. , Muresan, S. and Rocci, A. (2018). A multi-layer annotated corpus of argumentative text: From argument schemes to discourse relations. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018), Miyazaki, Japan. European Languages Resources Association (ELRA).","key":"S1351324923000062_ref109"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref51","DOI":"10.1515\/9783110875843"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref170","DOI":"10.18653\/v1\/D18-1402"},{"key":"S1351324923000062_ref87","first-page":"1","volume-title":"ACM Computing Surveys","volume":"53","author":"K\u00fc\u00e7\u00fck","year":"2020"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref114","DOI":"10.18653\/v1\/W19-4503"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref40","DOI":"10.1080\/0163853X.2017.1379327"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref62","DOI":"10.18653\/v1\/P16-1150"},{"key":"S1351324923000062_ref101","first-page":"243","article-title":"Rhetorical structure theory: Toward a functional theory of text organization","volume":"8","author":"Mann","year":"1988","journal-title":"Text"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref95","DOI":"10.1145\/2850417"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref6","DOI":"10.18653\/v1\/2020.emnlp-main.717"},{"key":"S1351324923000062_ref112","first-page":"121","article-title":"Two concepts of argument","volume":"13","author":"O\u2019Keefe","year":"1977","journal-title":"The Journal of the American Forensic Association"},{"unstructured":"Rocha, G. , Trigo, L. , Lopes Cardoso, H. , Sousa-Silva, R. , Carvalho, P. , Martins, B. and Won, M. (2022b). Annotating arguments in a corpus of opinion articles. In Proceedings of the Language Resources and Evaluation Conference, Marseille, France. European Language Resources Association, pp. 1890\u20131899.","key":"S1351324923000062_ref151"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref19","DOI":"10.1007\/978-94-007-1078-8_8"},{"key":"S1351324923000062_ref185","first-page":"9","article-title":"The reason! project","volume":"21","author":"van Gelder","year":"2001","journal-title":"The Skeptic"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref85","DOI":"10.3115\/v1\/W15-0501"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref177","DOI":"10.5117\/9789053565230"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref81","DOI":"10.1023\/B:ARGU.0000024044.34360.82"},{"volume-title":"A Practical Study of Argument","year":"2010","author":"Govier","key":"S1351324923000062_ref58"},{"unstructured":"Prasad, R. , Dinesh, N. , Lee, A. , Miltsakaki, E. , Robaldo, L. , Joshi, A. and Webber, B. (2008). The Penn discourse TreeBank 2.0. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC\u201908), Marrakech, Morocco. European Language Resources Association (ELRA).","key":"S1351324923000062_ref127"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref117","DOI":"10.4018\/jcini.2013010101"},{"volume-title":"Computational Models of Argument","author":"Duthie","first-page":"299","key":"S1351324923000062_ref46"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref107","DOI":"10.1007\/s10503-017-9441-y"},{"key":"S1351324923000062_ref157","first-page":"45","article-title":"Argument mining on twitter: A survey","volume":"63","author":"Schaefer","year":"2021","journal-title":"Information Technology"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref187","DOI":"10.1007\/s10579-019-09446-8"},{"unstructured":"Splieth\u00f6ver, M. and Wachsmuth, H. (2020). Argument from old man\u2019s view: Assessing social bias in argumentation. In Proceedings of the 7th Workshop on Argument Mining, Online. Association for Computational Linguistics, pp. 76\u201387.","key":"S1351324923000062_ref167"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref148","DOI":"10.1007\/s10503-010-9190-7"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref8","DOI":"10.18653\/v1\/N18-1172"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref169","DOI":"10.1162\/COLI_a_00295"},{"unstructured":"Reed, C. and Budzynska, K. (2011). How dialogues create arguments. In Proceedings of the 7th Conference of the International Society for the Study of Argumentation.","key":"S1351324923000062_ref136"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref192","DOI":"10.2478\/rela-2019-0005"},{"volume-title":"Argumentation Schemes for Presumptive Reasoning","year":"1996","author":"Walton","key":"S1351324923000062_ref197"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref96","DOI":"10.18653\/v1\/P17-1001"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref133","DOI":"10.1007\/978-0-387-98197-0_19"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref110","DOI":"10.1007\/s00778-017-0462-9"},{"volume-title":"Genre Analysis: English in Academic and Research Settings","year":"1990","author":"Swales","key":"S1351324923000062_ref172"},{"volume-title":"Springer Reference","year":"2014","author":"van Eemeren","key":"S1351324923000062_ref179"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref35","DOI":"10.1017\/S0269888906001044"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref23","DOI":"10.18653\/v1\/2021.emnlp-main.113"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref57","DOI":"10.1007\/978-3-319-07064-3_23"},{"unstructured":"Haddadan, S. , Cabrio, E. and Villata, S. (2018). Annotation of argument components in political debates data. In Sandra K\u00fcbler, H.Z. (ed.), Proceedings of the Workshop on Annotation in Digital Humanities, Sofia, Bulgaria. CEUR Workshop Proceedings, pp. 12\u201316.","key":"S1351324923000062_ref65"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref61","DOI":"10.18653\/v1\/D16-1129"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref14","DOI":"10.1007\/s10462-010-9154-1"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref105","DOI":"10.1007\/s10506-010-9104-x"},{"unstructured":"Peldszus, A. and Stede, M. (2016). An annotated corpus of argumentative microtexts. In Mohammed D. and Lewinski M. (eds), Argumentation and Reasoned Action - Proceedings of the 1st European Conference on Argumentation, Lisbon, 2015. London: College Publications.","key":"S1351324923000062_ref118"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref67","DOI":"10.3115\/1596409.1596411"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref92","DOI":"10.1162\/coli_a_00364"},{"key":"S1351324923000062_ref12","first-page":"15","article-title":"We need to consider disagreement in evaluation","author":"Basile","year":"2021","journal-title":"Procs 1st Workshop on Benchmarking: Past, Present and Future,"},{"unstructured":"Plank, B. (2016). What to do about non-standard (or non-canonical) language in NLP. In Dipper S., Neubarth F. and Zinsmeister H. (eds), Proceedings of the 13th Conference on Natural Language Processing, KONVENS 2016. Bochumer Linguistische Arbeitsberichte, vol. 16, Bochum, Germany.","key":"S1351324923000062_ref123"},{"key":"S1351324923000062_ref186","first-page":"491","article-title":"A critical discussion game for prohibiting fallacies","volume":"27","author":"Visser","year":"2017","journal-title":"Logic and Logical Philosophy"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref152","DOI":"10.1016\/j.patrec.2013.05.012"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref159","DOI":"10.1007\/s13218-021-00714-w"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref122","DOI":"10.1007\/978-3-030-62365-4_38"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref181","DOI":"10.1007\/BF00136779"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref199","DOI":"10.18653\/v1\/P19-1566"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref60","DOI":"10.3233\/AIC-140627"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref200","DOI":"10.1080\/01411920701532228"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref30","DOI":"10.1080\/19462166.2013.862303"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref47","DOI":"10.18653\/v1\/P19-2059"},{"unstructured":"Reed, C. , Palau, R.M. , Rowe, G. and Moens, M.-F. (2008). Language resources for studying argument. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC\u201908), Marrakech, Morocco. European Language Resources Association (ELRA).","key":"S1351324923000062_ref138"},{"key":"S1351324923000062_ref149","first-page":"45","article-title":"Artificial intelligence and legal reasoning: A discussion of the field and gardner\u2019s book","volume":"9","author":"Rissland","year":"1988","journal-title":"AI Magazine"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref125","DOI":"10.18653\/v1\/2021.emnlp-main.827"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref195","DOI":"10.1080\/19462166.2015.1123772"},{"unstructured":"Hautli-Janisz, A. , Kikteva, Z. , Siskou, W. , Gorska, K. , Becker, R. and Reed, C. (2022). Qt30: A corpus of argument and conflict in broadcast debate. In Proceedings of the Language Resources and Evaluation Conference, Marseille, France. European Language Resources Association.","key":"S1351324923000062_ref71"},{"unstructured":"Cabrio, E. and Villata, S. (2012). Combining textual entailment and argumentation theory for supporting online debates interactions. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Jeju Island, Korea. Association for Computational Linguistics, pp. 208\u2013212.","key":"S1351324923000062_ref29"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref180","DOI":"10.1515\/9783110846089"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref204","DOI":"10.2307\/249686"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref16","DOI":"10.7551\/mitpress\/9780262026437.001.0001"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref158","DOI":"10.18653\/v1\/2021.naacl-main.34"},{"unstructured":"Stab, C. and Gurevych, I. (2014). Annotating argument components and relations in persuasive essays. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, Dublin, Ireland. Dublin City University and Association for Computational Linguistics, pp. 1501\u20131510.","key":"S1351324923000062_ref168"},{"unstructured":"Brown, T. , Mann, B. , Ryder, N. , Subbiah, M. , Kaplan, J.D. , Dhariwal, P. , Neelakantan, A. , Shyam, P. , Sastry, G. , Askell, A. , Agarwal, S. , Herbert-Voss, A. , Krueger, G. , Henighan, T. , Child, R. , Ramesh, A. , Ziegler, D. , Wu, J. , Winter, C. , Hesse, C. , Chen, M. , Sigler, E. , Litwin, M. , Gray, S. , Chess, B. , Clark, J. , Berner, C. , McCandlish, S. , Radford, A. , Sutskever, I. and Amodei, D. (2020). Language models are few-shot learners. In Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F. and Lin H. (eds), Advances in Neural Information Processing Systems, vol. 33, Online. Curran Associates, Inc., pp. 1877\u20131901.","key":"S1351324923000062_ref24"},{"unstructured":"Huber, R. and Snider, A.C. (2006). Influencing Through Argument , updated Edn. New York: International Debate Education Association.","key":"S1351324923000062_ref77"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref63","DOI":"10.1162\/COLI_a_00276"},{"volume-title":"The New Rhetoric: A Treatise on Argumentation","year":"1969","author":"Perelman","key":"S1351324923000062_ref120"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref106","DOI":"10.3233\/AAC-170025"},{"unstructured":"Kienpointner, M. (1986). Towards a typology of argument schemes. In Argumentation: Across the Lines of Discipline, Proceedings of the Conference on Argumentation. Amsterdam: Amsterdam University Press, pp. 275\u2013287.","key":"S1351324923000062_ref83"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref124","DOI":"10.7551\/mitpress\/1887.001.0001"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref128","DOI":"10.18653\/v1\/2020.acl-main.467"},{"doi-asserted-by":"crossref","unstructured":"Snow, R. , O\u2019Connor, B. , Jurafsky, D. and Ng, A. (2008). Cheap and fast \u2013 but is it good? evaluating non-expert annotations for natural language tasks. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, Honolulu, Hawaii. Association for Computational Linguistics, pp. 254\u2013263.","key":"S1351324923000062_ref166","DOI":"10.3115\/1613715.1613751"},{"unstructured":"Burstein, J. , Kukich, K. , Wolff, S. , Lu, C. and Chodorow, M. (1998). Enriching automated essay scoring using discourse marking. In Discourse Relations and Discourse Markers (Proceedings of the Workshop), Montreal, Quebec, Canada, pp. 15\u201321.","key":"S1351324923000062_ref28"},{"unstructured":"Cerutti, F. , Toniolo, A. and Norman, T. (2019). On natural language generation of formal argumentation. In Santini, F. and Toniolo, A. (eds), Proceedings of the 3rd Workshop on Advances In Argumentation In Artificial Intelligence co-located with the 18th International Conference of the Italian Association for Artificial Intelligence (AI*IA 2019), CEUR Workshop Proceedings, Rende, Italy. Sun SITE Central Europe, pp. 15\u201329.","key":"S1351324923000062_ref32"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref135","DOI":"10.18653\/v1\/2020.coling-main.603"},{"volume-title":"Critical Reasoning and Argumentation","year":"2006","author":"Walton","key":"S1351324923000062_ref198"},{"unstructured":"Teufel, S. (1998). Meta-discourse markers and problem-structuring in scientific articles. In Discourse Relations and Discourse Markers.","key":"S1351324923000062_ref173"},{"unstructured":"Das, D. and Taboada, M. (2013). Explicit and implicit coherence relations: A corpus study. In Proceedings of the 2013 Annual Conference of the Canadian Linguistic Association.","key":"S1351324923000062_ref39"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref102","DOI":"10.1609\/aaai.v32i1.11920"},{"volume-title":"The Uses of Argument","year":"1958","author":"Toulmin","key":"S1351324923000062_ref176"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref21","DOI":"10.1007\/978-3-030-99739-7_43"},{"unstructured":"Devlin, J. , Chang, M.-W. , Lee, K. and Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, Minnesota. Association for Computational Linguistics, pp. 4171\u20134186.","key":"S1351324923000062_ref41"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref53","DOI":"10.1609\/aaai.v32i1.11330"},{"key":"S1351324923000062_ref100","first-page":"2493","article-title":"Argumentation schemes: History, classifications, and computational applications","volume":"4","author":"Macagno","year":"2017","journal-title":"Journal of Logics and their Applications"},{"unstructured":"Poudyal, P. , Savelka, J. , Ieven, A. , Moens, M.F. , Goncalves, T. and Quaresma, P. (2020). ECHR: Legal corpus for argument mining. In Proceedings of the 7th Workshop on Argument Mining, Online. Association for Computational Linguistics, pp. 67\u201375.","key":"S1351324923000062_ref126"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref191","DOI":"10.2139\/ssrn.2769833"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref103","DOI":"10.18653\/v1\/D17-1318"},{"volume-title":"Practical Reasoning in Natural Language","year":"1986","author":"Thomas","key":"S1351324923000062_ref174"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref90","DOI":"10.1162\/tacl_a_00525"},{"unstructured":"Budzynska, K. and Reed, C. (2011). Whence inference. Technical report, University of Dundee.","key":"S1351324923000062_ref26"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref36","DOI":"10.18653\/v1\/S18-1122"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref108","DOI":"10.18653\/v1\/W16-2810"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref73","DOI":"10.18653\/v1\/W17-5102"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref156","DOI":"10.1613\/jair.1.11640"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref140","DOI":"10.1007\/s10503-005-4416-9"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref205","DOI":"10.1007\/978-3-031-08473-7_22"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref88","DOI":"10.18653\/v1\/W18-5203"},{"unstructured":"Lumer, C. (2011). Argument schemes \u2013 an epistemological approach. In Argumentation: Cognition and Community. Proceedings of the 9th International Conference of the Ontario Society for the Study of Argumentation (OSSA), pp. 1\u201332.","key":"S1351324923000062_ref97"},{"unstructured":"Lawrence, J. , Janier, M. and Reed, C. (2015). Working with open argument corpora. In Proceedings of the 1st European Conference on Argumentation (ECA 2015), Lisbon. College Publications.","key":"S1351324923000062_ref91"},{"key":"S1351324923000062_ref111","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1093\/oso\/9780198537472.003.0007","volume-title":"Handbook of Logic in Artificial Intelligence and Logic Programming","author":"Nute","year":"1994"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref15","DOI":"10.1016\/S0004-3702(01)00071-6"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref45","DOI":"10.18653\/v1\/N18-1094"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref44","DOI":"10.1016\/0004-3702(94)00041-X"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref80","DOI":"10.1007\/978-3-642-23333-3_8"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref69","DOI":"10.18653\/v1\/2021.emnlp-main.710"},{"unstructured":"Sharma, S. , Zheng, G. and Awadallah, A.H. (2021). Metaxt: Meta cross-task transfer between disparate label spaces. CoRR, abs\/2109.04240.","key":"S1351324923000062_ref163"},{"key":"S1351324923000062_ref175","first-page":"173","volume-title":"Ninth Conference of the European Chapter of the Association for Computational Linguistics","author":"Tjong Kim Sang","year":"1999"},{"volume-title":"Analysing Genre: Language Use in Professional Settings","year":"1993","author":"Bhatia","key":"S1351324923000062_ref17"},{"key":"S1351324923000062_ref27","first-page":"577","volume-title":"Handbook of Formal Argumentation","author":"Budzynska","year":"2018"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref75","DOI":"10.18653\/v1\/N19-1219"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref121","DOI":"10.18653\/v1\/2020.emnlp-main.617"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref64","DOI":"10.18653\/v1\/N18-1175"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref7","DOI":"10.18653\/v1\/2021.eacl-main.17"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref34","DOI":"10.18653\/v1\/D18-1024"},{"unstructured":"Eger, S. , Daxenberger, J. , Stab, C. and Gurevych, I. (2018). Cross-lingual argumentation mining: Machine translation (and a bit of projection) is all you need! In Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, New Mexico, USA. Association for Computational Linguistics, pp. 831\u2013844.","key":"S1351324923000062_ref48"},{"volume-title":"Argumentation and Debate","year":"1925","author":"O\u2019Neill","key":"S1351324923000062_ref113"},{"key":"S1351324923000062_ref84","first-page":"178","volume-title":"Argumentation Illuminated","author":"Kienpointner","year":"1992"},{"unstructured":"Park, J. and Cardie, C. (2018). A corpus of eRulemaking user comments for measuring evaluability of arguments. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan. European Language Resources Association (ELRA).","key":"S1351324923000062_ref116"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref134","DOI":"10.1016\/j.artint.2007.04.015"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref188","DOI":"10.1007\/s10503-020-09519-x"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref55","DOI":"10.3115\/v1\/W14-2106"},{"doi-asserted-by":"crossref","unstructured":"Elhadad, M. (1992). Generating coherent argumentative paragraphs. In COLING 1992 Volume 2: The 14th International Conference on Computational Linguistics, Nantes, France.","key":"S1351324923000062_ref49","DOI":"10.3115\/992133.992169"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref155","DOI":"10.1609\/aaai.v33i01.33014822"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref150","DOI":"10.1007\/978-3-031-08473-7_21"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref178","DOI":"10.1007\/978-3-319-95381-6"},{"unstructured":"Reisert, P. , Inoue, N. , Okazaki, N. and Inui, K. (2017a). A corpus of deep argumentative structures as an explanation to argumentative relations. arXiv:1712.02480.","key":"S1351324923000062_ref144"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref190","DOI":"10.18653\/v1\/E17-1017"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref56","DOI":"10.1177\/030631277600600302"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref164","DOI":"10.1023\/A:1024059024337"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref201","DOI":"10.1007\/978-3-642-12837-0_4"},{"unstructured":"Al-Khatib, K. , Hou, Y. and Stede, M. (2021). Proceedings of the 8th Workshop on Argument Mining, Punta Cana, Dominican. Association for Computational Linguistics Republic.","key":"S1351324923000062_ref4"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref52","DOI":"10.1007\/978-94-007-0357-5"},{"unstructured":"Al-Khatib, K. , Wachsmuth, H. , Kiesel, J. , Hagen, M. and Stein, B. (2016). A news editorial corpus for mining argumentation strategies. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan. The COLING 2016 Organizing Committee, pp. 3433\u20133443.","key":"S1351324923000062_ref5"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref193","DOI":"10.1007\/s10503-015-9374-2"},{"unstructured":"Reisert, P. , Inoue, N. , Okazaki, N. and Inui, K. (2017b). Deep argumentative structure analysis as an explanation to argumentative relations. In Proceedings of The 23rd Annual Meeting of the Association for Natural Language Processing, pp. 38\u201341.","key":"S1351324923000062_ref145"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref139","DOI":"10.1142\/S0218213004001922"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref206","DOI":"10.3115\/1118253.1118262"},{"unstructured":"Janier, M. , Lawrence, J. and Reed, C. (2014). OVA+: An argument analysis interface. In Parsons S., Oren N., Reed C. and Cerutti F. (eds), Proceedings of the Fifth International Conference on Computational Models of Argument (COMMA 2014), Pitlochry. IOS Press, pp. 463\u2013464.","key":"S1351324923000062_ref78"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref196","DOI":"10.1017\/CBO9780511802034"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref76","DOI":"10.18653\/v1\/P18-1021"},{"volume-title":"Advances in Neural Information Processing Systems","year":"2019","author":"Yang","key":"S1351324923000062_ref203"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref68","DOI":"10.1075\/jaic.2.2.03han"},{"unstructured":"Walker, M. , Tree, J.F. , Anand, P. , Abbott, R. and King, J. (2012). A corpus for research on deliberation and debate. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC\u201912), Istanbul, Turkey. European Language Resources Association (ELRA), pp. 812\u2013817.","key":"S1351324923000062_ref194"},{"unstructured":"Wyner, A. , Schneider, J.A. , Atkinson, K. and Bench-Capon, T. (2012). Semi-automated argumentative analysis of online product reviews. In Computational Models of Argument - Proceedings of COMMA 2012. Frontiers in Artificial Intelligence and Applications, vol. 1, USA. IOS Press, pp. 43\u201350.","key":"S1351324923000062_ref202"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref38","DOI":"10.18653\/v1\/D18-1269"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref165","DOI":"10.18653\/v1\/W18-5218"},{"unstructured":"Eliot, L. (2021). Identifying a Set of Autonomous Levels for AI-Based Computational Legal Reasoning. MIT Computational Law Report. https:\/\/law.mit.edu\/pub\/identifyingasetofautonomouslevelsforaibasedcomputationallegalreasoning.","key":"S1351324923000062_ref50"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref104","DOI":"10.1145\/1568234.1568238"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref89","DOI":"10.18653\/v1\/W18-5206"},{"volume-title":"Argumentation Mining","year":"2018","author":"Stede","key":"S1351324923000062_ref171"},{"volume-title":"A Systematic Theory of Argumentation: The Pragma-Dialectical Approach","year":"2004","author":"van Eemeren","key":"S1351324923000062_ref182"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref22","DOI":"10.1007\/978-3-030-72240-1_67"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref99","DOI":"10.1016\/j.ipm.2019.102055"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref37","DOI":"10.18653\/v1\/2020.acl-main.747"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref54","DOI":"10.1038\/s42256-020-00257-z"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref13","DOI":"10.1162\/COLI_a_00074"},{"unstructured":"Hu, Z. , Lee, R.K. and Aggarwal, C.C. (2020). Text style transfer: A review and experiment evaluation. CoRR, abs\/2010.12742.","key":"S1351324923000062_ref74"},{"doi-asserted-by":"publisher","key":"S1351324923000062_ref132","DOI":"10.1017\/S0269888904000098"}],"container-title":["Natural Language Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S1351324923000062","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,8]],"date-time":"2023-12-08T00:29:41Z","timestamp":1701995381000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S1351324923000062\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,28]]},"references-count":206,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["S1351324923000062"],"URL":"https:\/\/doi.org\/10.1017\/s1351324923000062","relation":{},"ISSN":["1351-3249","1469-8110"],"issn-type":[{"type":"print","value":"1351-3249"},{"type":"electronic","value":"1469-8110"}],"subject":[],"published":{"date-parts":[[2023,2,28]]},"assertion":[{"value":"\u00a9 The Author(s), 2023. Published by Cambridge University Press","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}}]}}