{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T06:56:24Z","timestamp":1751525784016,"version":"3.40.5"},"reference-count":44,"publisher":"Walter de Gruyter GmbH","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,2,23]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We present an approach to extracting arguments from social media, exemplified by a case study on a large corpus of Twitter messages collected under the #Brexit hashtag during the run-up to the referendum in 2016. Our method is based on constructing dedicated corpus queries that capture predefined argumentation patterns following standard Walton-style argumentation schemes. Query matches are transformed directly into logical patterns, i.\u2009e. formulae with placeholders in a general form of modal logic. We prioritize precision over recall, exploiting the fact that the sheer size of the corpus still delivers substantial numbers of matches for all patterns, and with the goal of eventually gaining an overview of widely-used arguments and argumentation schemes. We evaluate our approach in terms of recall on a manually annotated gold standard of 1000 randomly selected tweets for three selected high-frequency patterns. We also estimate precision by manual inspection of query matches in the entire corpus. Both evaluations are accompanied by an analysis of inter-annotator agreement between three independent judges.<\/jats:p>","DOI":"10.1515\/itit-2020-0051","type":"journal-article","created":{"date-parts":[[2021,5,4]],"date-time":"2021-05-04T21:56:02Z","timestamp":1620165362000},"page":"31-44","source":"Crossref","is-referenced-by-count":2,"title":["Argument parsing via corpus queries"],"prefix":"10.1515","volume":"63","author":[{"given":"Natalie","family":"Dykes","sequence":"first","affiliation":[{"name":"FAU Erlangen-N\u00fcrnberg , Computational Corpus Linguistics , Erlangen , Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4192-2437","authenticated-orcid":false,"given":"Stefan","family":"Evert","sequence":"additional","affiliation":[{"name":"FAU Erlangen-N\u00fcrnberg , Computational Corpus Linguistics , Erlangen , Germany"}]},{"given":"Merlin","family":"G\u00f6ttlinger","sequence":"additional","affiliation":[{"name":"FAU Erlangen-N\u00fcrnberg , Theoretical Computer Science , Erlangen , Germany"}]},{"given":"Philipp","family":"Heinrich","sequence":"additional","affiliation":[{"name":"FAU Erlangen-N\u00fcrnberg , Computational Corpus Linguistics , Erlangen , Germany"}]},{"given":"Lutz","family":"Schr\u00f6der","sequence":"additional","affiliation":[{"name":"FAU Erlangen-N\u00fcrnberg , Theoretical Computer Science , Erlangen , Germany"}]}],"member":"374","published-online":{"date-parts":[[2021,5,5]]},"reference":[{"key":"2023033120003138907_j_itit-2020-0051_ref_001_w2aab3b7d378b1b6b1ab2ab1Aa","doi-asserted-by":"crossref","unstructured":"T. Alsinet, J. Argelich, R. B\u00e9jar, and J. Cemeli. A distributed argumentation algorithm for mining consistent opinions in weighted twitter discussions. Soft Comput., 23(7):2147\u20132166, 2019.","DOI":"10.1007\/s00500-018-3380-x"},{"key":"2023033120003138907_j_itit-2020-0051_ref_002_w2aab3b7d378b1b6b1ab2ab2Aa","doi-asserted-by":"crossref","unstructured":"R. Alur, T. Henzinger, and O. Kupferman. Alternating-time temporal logic. J. ACM, 49:672\u2013713, 2002.","DOI":"10.1145\/585265.585270"},{"key":"2023033120003138907_j_itit-2020-0051_ref_003_w2aab3b7d378b1b6b1ab2ab3Aa","unstructured":"F. Baader, D. Calvanese, D. McGuinness, D. Nardi, and P. Patel-Schneider, eds. The Description Logic Handbook. Cambridge University Press, 2003."},{"key":"2023033120003138907_j_itit-2020-0051_ref_004_w2aab3b7d378b1b6b1ab2ab4Aa","unstructured":"P. Baroni, D. Gabbay, M. Giacomin, and L. van der Torre, eds. Handbook of Formal Argumentation. College Publications, 2018."},{"key":"2023033120003138907_j_itit-2020-0051_ref_005_w2aab3b7d378b1b6b1ab2ab5Aa","unstructured":"T. Bosc, E. Cabrio, and S. Villata. Tweeties squabbling: Positive and negative results in applying argument mining on social media. In Computational Models of Argument, COMMA 2016, vol.\u2009287 of Frontiers Artif. Intell. Appl., pp.\u200921\u201332. IOS Press, 2016."},{"key":"2023033120003138907_j_itit-2020-0051_ref_006_w2aab3b7d378b1b6b1ab2ab6Aa","doi-asserted-by":"crossref","unstructured":"E. Cabrio and S. Villata. Five years of argument mining: a data-driven analysis. In International Joint Conference on Artificial Intelligence, IJCAI 2018, pp.\u20095427\u20135433, 2018. ijcai.org.","DOI":"10.24963\/ijcai.2018\/766"},{"key":"2023033120003138907_j_itit-2020-0051_ref_007_w2aab3b7d378b1b6b1ab2ab7Aa","doi-asserted-by":"crossref","unstructured":"B. Chellas. Modal logic. Cambridge University Press, 1980.","DOI":"10.1017\/CBO9780511621192"},{"key":"2023033120003138907_j_itit-2020-0051_ref_008_w2aab3b7d378b1b6b1ab2ab8Aa","doi-asserted-by":"crossref","unstructured":"C. Ches\u00f1evar, J. McGinnis, S. Modgil, I. Rahwan, C. Reed, G. Simari, M. South, G. Vreeswijk, and S. Willmott. Towards an argument interchange format. Knowledge Eng. Review, 21(4):293\u2013316, 2006.","DOI":"10.1017\/S0269888906001044"},{"key":"2023033120003138907_j_itit-2020-0051_ref_009_w2aab3b7d378b1b6b1ab2ab9Aa","unstructured":"O. Christ. A modular and flexible architecture for an integrated corpus query system. In Papers in Computational Lexicography, COMPLEX 1994, pp.\u200922\u201332, 1994."},{"key":"2023033120003138907_j_itit-2020-0051_ref_010_w2aab3b7d378b1b6b1ab2ac10Aa","doi-asserted-by":"crossref","unstructured":"C. C\u00eerstea, A. Kurz, D. Pattinson, L. Schr\u00f6der, and Y. Venema. Modal logics are coalgebraic. Comput. J., 54:31\u201341, 2011.","DOI":"10.1093\/comjnl\/bxp004"},{"key":"2023033120003138907_j_itit-2020-0051_ref_011_w2aab3b7d378b1b6b1ab2ac11Aa","doi-asserted-by":"crossref","unstructured":"J. Cohen. A coefficient of agreement for nominal scales. Educ. Psychol. Meas., 20:37\u201346, 1960.","DOI":"10.1177\/001316446002000104"},{"key":"2023033120003138907_j_itit-2020-0051_ref_012_w2aab3b7d378b1b6b1ab2ac12Aa","doi-asserted-by":"crossref","unstructured":"H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. GATE: an architecture for development of robust HLT applications. In Annual Meeting of the Association for Computational Linguistics, ACL 2002, pp.\u2009168\u2013175, 2002.","DOI":"10.3115\/1073083.1073112"},{"key":"2023033120003138907_j_itit-2020-0051_ref_013_w2aab3b7d378b1b6b1ab2ac13Aa","doi-asserted-by":"crossref","unstructured":"M. Dusmanu, E. Cabrio, and S. Villata. Argument mining on Twitter: Arguments, facts and sources. In Empirical Methods in Natural Language Processing, EMNLP 2017, pp.\u20092317\u20132322. ACL, 2017.","DOI":"10.18653\/v1\/D17-1245"},{"key":"2023033120003138907_j_itit-2020-0051_ref_014_w2aab3b7d378b1b6b1ab2ac14Aa","doi-asserted-by":"crossref","unstructured":"N. Dykes, S. Evert, M. G\u00f6ttlinger, P. Heinrich, and L. Schr\u00f6der. Reconstructing arguments from noisy text: Introduction to the RANT project. Datenbank-Spektrum, 20:123\u2013129, 2020.","DOI":"10.1007\/s13222-020-00342-y"},{"key":"2023033120003138907_j_itit-2020-0051_ref_015_w2aab3b7d378b1b6b1ab2ac15Aa","unstructured":"S. Evert and A. Hardie. Twenty-first century corpus workbench: Updating a query architecture for the new millennium. In Corpus Linguistics, CL 2011. University of Birmingham, 2011."},{"key":"2023033120003138907_j_itit-2020-0051_ref_016_w2aab3b7d378b1b6b1ab2ac16Aa","unstructured":"S. Evert and The CWB Development Team. The IMS Open Corpus Workbench (CWB) CQP Query Language Tutorial, 2020. CWB Version 3.5, available at http:\/\/cwb.sourceforge.net\/documentation.php."},{"key":"2023033120003138907_j_itit-2020-0051_ref_017_w2aab3b7d378b1b6b1ab2ac17Aa","unstructured":"V. Feng and G. Hirst. Classifying arguments by scheme. In Annual Meeting of the Association for Computational Linguistics, ACL 2011, pp.\u2009987\u2013996. ACL, 2011."},{"key":"2023033120003138907_j_itit-2020-0051_ref_018_w2aab3b7d378b1b6b1ab2ac18Aa","doi-asserted-by":"crossref","unstructured":"J. Fleiss, J. Cohen, and B. Everitt. Large sample standard errors of kappa and weighted kappa. Psychol. Bull., 72(5):323\u2013327, 1969.","DOI":"10.1037\/h0028106"},{"key":"2023033120003138907_j_itit-2020-0051_ref_019_w2aab3b7d378b1b6b1ab2ac19Aa","doi-asserted-by":"crossref","unstructured":"L. Godo and R. Rodr\u00edguez. Logical approaches to fuzzy similarity-based reasoning: an overview. In Preferences and Similarities, pp.\u200975\u2013128. Springer, 2008.","DOI":"10.1007\/978-3-211-85432-7_4"},{"key":"2023033120003138907_j_itit-2020-0051_ref_020_w2aab3b7d378b1b6b1ab2ac20Aa","doi-asserted-by":"crossref","unstructured":"D. Gor\u00edn, D. Pattinson, L. Schr\u00f6der, F. Widmann, and T. Wi\u00dfmann. COOL \u2013 a generic reasoner for coalgebraic hybrid logics (system description). In Automated Reasoning, IJCAR 2014, vol.\u20098562 of LNCS, pp.\u2009396\u2013402. Springer, 2014.","DOI":"10.1007\/978-3-319-08587-6_31"},{"key":"2023033120003138907_j_itit-2020-0051_ref_021_w2aab3b7d378b1b6b1ab2ac21Aa","doi-asserted-by":"crossref","unstructured":"T. Goudas, C. Louizos, G. Petasis, and V. Karkaletsis. Argument extraction from news, blogs, and social media. In Artificial Intelligence: Methods and Applications, SETN 2014, pp.\u2009287\u2013299. Springer, 2014.","DOI":"10.1007\/978-3-319-07064-3_23"},{"key":"2023033120003138907_j_itit-2020-0051_ref_022_w2aab3b7d378b1b6b1ab2ac22Aa","unstructured":"K. Grosse, C. Ches\u00f1evar, A. Maguitman, and E. Estevez. Empowering an E-government platform through Twitter-based arguments. Inteligencia Artif., 15(50):46\u201356, 2012."},{"key":"2023033120003138907_j_itit-2020-0051_ref_023_w2aab3b7d378b1b6b1ab2ac23Aa","doi-asserted-by":"crossref","unstructured":"S. Kraus, D. Lehmann, and M. Magidor. Nonmonotonic reasoning, preferential models and cumulative logics. Artif. Intell., 44(1-2):167\u2013207, 1990.","DOI":"10.1016\/0004-3702(90)90101-5"},{"key":"2023033120003138907_j_itit-2020-0051_ref_024_w2aab3b7d378b1b6b1ab2ac24Aa","unstructured":"A. Kurucz, F. Wolter, M. Zakharyaschev, and D.\u2009M. Gabbay. Many-Dimensional Modal Logics: Theory and Applications. Elsevier, 2003."},{"key":"2023033120003138907_j_itit-2020-0051_ref_025_w2aab3b7d378b1b6b1ab2ac25Aa","doi-asserted-by":"crossref","unstructured":"J. Lawrence, M. Snaith, B. Konat, K. Budzynska, and C. Reed. Debating technology for dialogical argument: Sensemaking, engagement, and analytics. ACM Trans. Internet Tech., 17(3):1\u201323, 2017.","DOI":"10.1145\/3007210"},{"key":"2023033120003138907_j_itit-2020-0051_ref_026_w2aab3b7d378b1b6b1ab2ac26Aa","doi-asserted-by":"crossref","unstructured":"M. Lenz, S. Ollinger, P. Sahitaj, and R. Bergmann. Semantic textual similarity measures for case-based retrieval of argument graphs. In Case-Based Reasoning Research and Development, ICCBR 2019, vol.\u200911680 of LNCS, pp.\u2009219\u2013234. Springer, 2019.","DOI":"10.1007\/978-3-030-29249-2_15"},{"key":"2023033120003138907_j_itit-2020-0051_ref_027_w2aab3b7d378b1b6b1ab2ac27Aa","unstructured":"D. Lewis. Counterfactuals. Harvard University Press, 1973."},{"key":"2023033120003138907_j_itit-2020-0051_ref_028_w2aab3b7d378b1b6b1ab2ac28Aa","doi-asserted-by":"crossref","unstructured":"A. Lytos, T. Lagkas, P. Sarigiannidis, and K. Bontcheva. The evolution of argumentation mining: From models to social media and emerging tools. Inf. Process. Manage., 56(6):102055, 11 2019.","DOI":"10.1016\/j.ipm.2019.102055"},{"key":"2023033120003138907_j_itit-2020-0051_ref_029_w2aab3b7d378b1b6b1ab2ac29Aa","doi-asserted-by":"crossref","unstructured":"S. Mac Lane. Categories for the Working Mathematician. Springer, 1971.","DOI":"10.1007\/978-1-4612-9839-7"},{"key":"2023033120003138907_j_itit-2020-0051_ref_030_w2aab3b7d378b1b6b1ab2ac30Aa","unstructured":"T. Mikolov, K. Chen, G. Corrado, and J. Dean. Efficient estimation of word representations in vector space. CoRR, 1301.3781, 2013."},{"key":"2023033120003138907_j_itit-2020-0051_ref_031_w2aab3b7d378b1b6b1ab2ac31Aa","doi-asserted-by":"crossref","unstructured":"G. Minnen, J. Carroll, and D. Pearce. Applied morphological processing of English. Nat. Lang. Eng., 7(3):207\u2013223, 2001.","DOI":"10.1017\/S1351324901002728"},{"key":"2023033120003138907_j_itit-2020-0051_ref_032_w2aab3b7d378b1b6b1ab2ac32Aa","unstructured":"O. Owoputi, B. O\u2019Connor, C. Dyer, K. Gimpel, N. Schneider, and N. Smith. Improved part-of-speech tagging for online conversational text with word clusters. In Human Language Technologies, HLT-NAACL 2013, pp.\u2009380\u2013390. ACL, 2013."},{"key":"2023033120003138907_j_itit-2020-0051_ref_033_w2aab3b7d378b1b6b1ab2ac33Aa","doi-asserted-by":"crossref","unstructured":"P. Pantel and M. Pennacchiotti. Espresso: Leveraging generic patterns for automatically harvesting semantic relations. In Computational Linguistics \/ Annual Meeting of the Association for Computational Linguistics, ACL 2006. ACL, 2006.","DOI":"10.3115\/1220175.1220190"},{"key":"2023033120003138907_j_itit-2020-0051_ref_034_w2aab3b7d378b1b6b1ab2ac34Aa","unstructured":"C. Reed, S. Wells, J. Devereux, and G. Rowe. AIF+: dialogue in the argument interchange format. In Computational Models of Argument, COMMA 2008, vol.\u2009172 of Frontiers Artif. Intell. Appl., pp.\u2009311\u2013323. IOS Press, 2008."},{"key":"2023033120003138907_j_itit-2020-0051_ref_035_w2aab3b7d378b1b6b1ab2ac35Aa","doi-asserted-by":"crossref","unstructured":"N. Reimers, B. Schiller, T. Beck, J. Daxenberger, C. Stab, and I. Gurevych. Classification and clustering of arguments with contextualized word embeddings. In Annual Meeting of the Association for Computational Linguistics, ACL 2019, pp.\u2009567\u2013578. ACL, 2019.","DOI":"10.18653\/v1\/P19-1054"},{"key":"2023033120003138907_j_itit-2020-0051_ref_036_w2aab3b7d378b1b6b1ab2ac36Aa","unstructured":"A. Ritter, S. Clark, Mausam, and O. Etzioni. Named entity recognition in tweets: An experimental study. In Empirical Methods in Natural Language Processing, EMNLP 2011, pp.\u20091524\u20131534. ACL, 2011."},{"key":"2023033120003138907_j_itit-2020-0051_ref_037_w2aab3b7d378b1b6b1ab2ac37Aa","doi-asserted-by":"crossref","unstructured":"A. Ritter, Mausam, O. Etzioni, and S. Clark. Open domain event extraction from twitter. In Knowledge Discovery and Data Mining, KDD 2012, pp.\u20091104\u20131112. ACM, 2012.","DOI":"10.1145\/2339530.2339704"},{"key":"2023033120003138907_j_itit-2020-0051_ref_038_w2aab3b7d378b1b6b1ab2ac38Aa","doi-asserted-by":"crossref","unstructured":"J. Rutten. Universal coalgebra: A theory of systems. Theor. Comput. Sci., 249:3\u201380, 2000.","DOI":"10.1016\/S0304-3975(00)00056-6"},{"key":"2023033120003138907_j_itit-2020-0051_ref_039_w2aab3b7d378b1b6b1ab2ac39Aa","doi-asserted-by":"crossref","unstructured":"L. Schr\u00f6der and D. Pattinson. Modular algorithms for heterogeneous modal logics via multi-sorted coalgebra. Math. Struct. Comput. Sci., 21(2):235\u2013266, 2011.","DOI":"10.1017\/S0960129510000563"},{"key":"2023033120003138907_j_itit-2020-0051_ref_040_w2aab3b7d378b1b6b1ab2ac40Aa","unstructured":"L. Schr\u00f6der, D. Pattinson, and D. Hausmann. Optimal tableaux for conditional logics with cautious monotonicity. In European Conference on Artificial Intelligence, ECAI 2010, vol.\u2009215 of Frontiers Artif. Intell. Appl., pp.\u2009707\u2013712. IOS Press, 2010."},{"key":"2023033120003138907_j_itit-2020-0051_ref_041_w2aab3b7d378b1b6b1ab2ac41Aa","doi-asserted-by":"crossref","unstructured":"F. Sch\u00e4fer, S. Evert, and P. Heinrich. Japan\u2019s 2014 general election: Political bots, right-wing Internet activism and PM Abe Shinz\u014d\u2019s hidden nationalist agenda. Big Data, 5(4):294\u2013309, 2017.","DOI":"10.1089\/big.2017.0049"},{"key":"2023033120003138907_j_itit-2020-0051_ref_042_w2aab3b7d378b1b6b1ab2ac42Aa","doi-asserted-by":"crossref","unstructured":"Y. Son, A. Buffone, J. Raso, A. Larche, A. Janocko, K. Zembroski, H.\u2009A. Schwartz, and L. Ungar. Recognizing counterfactual thinking in social media texts. In Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2017.","DOI":"10.18653\/v1\/P17-2103"},{"key":"2023033120003138907_j_itit-2020-0051_ref_043_w2aab3b7d378b1b6b1ab2ac43Aa","doi-asserted-by":"crossref","unstructured":"D. Walton, C. Reed, and F. Macagno. Argumentation Schemes. Cambridge University Press, 2008.","DOI":"10.1017\/CBO9780511802034"},{"key":"2023033120003138907_j_itit-2020-0051_ref_044_w2aab3b7d378b1b6b1ab2ac44Aa","doi-asserted-by":"crossref","unstructured":"L. Zadeh. Probability measures of fuzzy events. J. Math. Anal. Appl., 23:421\u2013427, 1968.","DOI":"10.1016\/0022-247X(68)90078-4"}],"container-title":["it - Information Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2020-0051\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2020-0051\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,30]],"date-time":"2024-08-30T05:09:40Z","timestamp":1724994580000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/itit-2020-0051\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,1]]},"references-count":44,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3,27]]},"published-print":{"date-parts":[[2021,2,23]]}},"alternative-id":["10.1515\/itit-2020-0051"],"URL":"https:\/\/doi.org\/10.1515\/itit-2020-0051","relation":{},"ISSN":["2196-7032","1611-2776"],"issn-type":[{"type":"electronic","value":"2196-7032"},{"type":"print","value":"1611-2776"}],"subject":[],"published":{"date-parts":[[2021,2,1]]}}}