{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T16:32:43Z","timestamp":1773246763728,"version":"3.50.1"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T00:00:00Z","timestamp":1687478400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T00:00:00Z","timestamp":1687478400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005687","name":"Goethe-Universit\u00e4t Frankfurt am Main","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100005687","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["HA 8018\/2-1"],"award-info":[{"award-number":["HA 8018\/2-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005714","name":"Technische Universit\u00e4t Darmstadt","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005714","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Law"],"published-print":{"date-parts":[[2024,9]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Identifying, classifying, and analyzing arguments in legal discourse has been a prominent area of research since the inception of the argument mining field. However, there has been a major discrepancy between the way natural language processing (NLP) researchers model and annotate arguments in court decisions and the way legal experts understand and analyze legal argumentation. While computational approaches typically simplify arguments into generic premises and claims, arguments in legal research usually exhibit a rich typology that is important for gaining insights into the particular case and applications of law in general. We address this problem and make several substantial contributions to move the field forward. First, we design a new annotation scheme for legal arguments in proceedings of the European Court of Human Rights (ECHR) that is deeply rooted in the theory and practice of legal argumentation research. Second, we compile and annotate a large corpus of 373 court decisions (2.3M tokens and 15k annotated argument spans). Finally, we train an argument mining model that outperforms state-of-the-art models in the legal NLP domain and provide a thorough expert-based evaluation. All datasets and source codes are available under open lincenses at<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/trusthlt\/mining-legal-arguments\">https:\/\/github.com\/trusthlt\/mining-legal-arguments<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/s10506-023-09361-y","type":"journal-article","created":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T19:30:42Z","timestamp":1687548642000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["Mining legal arguments in court decisions"],"prefix":"10.1007","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0990-4554","authenticated-orcid":false,"given":"Ivan","family":"Habernal","sequence":"first","affiliation":[]},{"given":"Daniel","family":"Faber","sequence":"additional","affiliation":[]},{"given":"Nicola","family":"Recchia","sequence":"additional","affiliation":[]},{"given":"Sebastian","family":"Bretthauer","sequence":"additional","affiliation":[]},{"given":"Iryna","family":"Gurevych","sequence":"additional","affiliation":[]},{"given":"Indra","family":"Spiecker genannt D\u00f6hmann","sequence":"additional","affiliation":[]},{"given":"Christoph","family":"Burchard","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,6,23]]},"reference":[{"key":"9361_CR1","volume-title":"Domestic courts and the interpretation of international law","author":"O Ammann","year":"2019","unstructured":"Ammann O (2019) Domestic courts and the interpretation of international law. Brill Nijhoff, Leiden, Netherlands"},{"key":"9361_CR2","doi-asserted-by":"publisher","DOI":"10.1017\/cbo9781139035293","author":"A Barak","year":"2012","unstructured":"Barak A (2012) Cambridge Studies in Constitutional Law, Cambridge University Press. Proportionality: constitutional rights and their limitations. https:\/\/doi.org\/10.1017\/cbo9781139035293","journal-title":"Proportionality: constitutional rights and their limitations"},{"key":"9361_CR4","doi-asserted-by":"publisher","unstructured":"Chalkidis I, Fergadiotis M, Malakasiotis P, et\u00a0al (2020) LEGAL-BERT: The Muppets straight out of law school. In: findings of the association for computational linguistics: EMNLP 2020. Association for Computational Linguistics, Online, pp 2898\u20132904, https:\/\/doi.org\/10.18653\/v1\/2020.findings-emnlp.261","DOI":"10.18653\/v1\/2020.findings-emnlp.261"},{"key":"9361_CR3","doi-asserted-by":"publisher","unstructured":"Eckart\u00a0de Castilho R, Gurevych I (2014) A broad-coverage collection of portable NLP components for building shareable analysis pipelines. In: Proceedings of the workshop on open infrastructures and analysis frameworks for HLT. Association for Computational Linguistics and Dublin City University, Dublin, Ireland, pp 1\u201311, https:\/\/doi.org\/10.3115\/v1\/W14-5201","DOI":"10.3115\/v1\/W14-5201"},{"key":"9361_CR5","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-024-1129-4","volume-title":"Fundamentals of legal argumentation","author":"ET Feteris","year":"2017","unstructured":"Feteris ET (2017) Fundamentals of legal argumentation, 2nd edn. Springer, Cham","edition":"2"},{"key":"9361_CR6","doi-asserted-by":"crossref","unstructured":"Grabenwarter C, Pabel K (2021) Europ\u00e4ische Menschenrechtskonvention, 7th edn. C. H, Beck, Munich, Germany","DOI":"10.17104\/9783406759673"},{"issue":"1","key":"9361_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3458754","volume":"3","author":"Y Gu","year":"2022","unstructured":"Gu Y, Tinn R, Cheng H et al (2022) Domain-specific language model pretraining for biomedical natural language processing. ACM Trans Comput Healthcare 3(1):1\u201323. https:\/\/doi.org\/10.1145\/3458754","journal-title":"ACM Trans Comput Healthcare"},{"key":"9361_CR8","doi-asserted-by":"publisher","unstructured":"Gururangan S, Marasovi\u0107 A, Swayamdipta S, et\u00a0al (2020) Don\u2019t stop pretraining: adapt language models to domains and tasks. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Virtual conference, pp 8342\u20138360, https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.740","DOI":"10.18653\/v1\/2020.acl-main.740"},{"issue":"1","key":"9361_CR9","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1162\/COLI_a_00276","volume":"43","author":"I Habernal","year":"2017","unstructured":"Habernal I, Gurevych I (2017) Argumentation mining in user-generated web discourse. Comput Linguist 43(1):125\u2013179. https:\/\/doi.org\/10.1162\/COLI_a_00276","journal-title":"Comput Linguist"},{"key":"9361_CR10","unstructured":"Klie JC, Bugert M, Boullosa B, et\u00a0al (2018) The INCEpTION platform: machine-assisted and knowledge-oriented interactive annotation. In: proceedings of the 27th international conference on computational Linguistics: system demonstrations. Association for Computational Linguistics, pp 5\u20139"},{"key":"9361_CR11","unstructured":"Krippendorff K (2014) Agreement for unitizing finite continua. In: Content analysis; an introduction to its methodology, 3rd edn. Sage Publications, chap\u00a012, pp. 309\u2013319"},{"key":"9361_CR12","unstructured":"Liu Y, Ott M, Goyal N, et\u00a0al (2019) RoBERTa: a robustly optimized BERT pretraining approach. arXiv preprint pp 1\u201313. http:\/\/arxiv.org\/abs\/1907.11692"},{"key":"9361_CR13","unstructured":"Maultzsch F (2017) Grundstrukturen der englischen Case Law-Methodik. In: R\u00fcckert J, Seinecke R (eds) Methodik des Zivilrechts - von Savigny bis Teubner, 3rd edn. Nomos Verlagsgesellschaft, Baden-Baden, Germany"},{"key":"9361_CR14","unstructured":"Meyer CM, Mieskes M, Stab C, et\u00a0al (2014) DKPro agreement: an open-source java library for measuring inter-rater agreement. In: Proceedings of COLING 2014, the 25th international conference on computational linguistics: system demonstrations. Dublin City University and Association for Computational Linguistics, Dublin, Ireland, pp 105\u2013109, https:\/\/aclanthology.org\/C14-2023"},{"key":"9361_CR15","doi-asserted-by":"publisher","unstructured":"Mochales R, Moens MF (2008) Study on the Structure of Argumentation in Case Law. In: Francesconi E, Sartor G, Tiscornia D (eds) Proceedings of JURIX. IOS Press, pp 11\u201320, https:\/\/doi.org\/10.3233\/978-1-58603-952-3-11","DOI":"10.3233\/978-1-58603-952-3-11"},{"issue":"1","key":"9361_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10506-010-9104-x","volume":"19","author":"R Mochales","year":"2011","unstructured":"Mochales R, Moens MF (2011) Argumentation mining. Artif Intell Law 19(1):1\u201322. https:\/\/doi.org\/10.1007\/s10506-010-9104-x","journal-title":"Artif Intell Law"},{"key":"9361_CR17","first-page":"89","volume-title":"Legal knowledge and information systems","author":"R Mochales-Palau","year":"2007","unstructured":"Mochales-Palau R, Moens MF (2007) Study on sentence relations in the automatic detection of argumentation in legal cases. In: Lodder AR, Mommers L (eds) Legal knowledge and information systems. IOS Press, Amsterdam, NL, pp 89\u201398"},{"key":"9361_CR18","doi-asserted-by":"publisher","unstructured":"Moens MF, Boiy E, Palau RM, et\u00a0al (2007) Automatic detection of arguments in legal texts. In: Proceedings of the 11th international conference on artificial intelligence and law - ICAIL \u201907. ACM Press, Palo Alto, USA, pp 225\u2013230, https:\/\/doi.org\/10.1145\/1276318.1276362","DOI":"10.1145\/1276318.1276362"},{"issue":"2","key":"9361_CR19","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1093\/hrlr\/ngp006","volume":"9","author":"A Mowbray","year":"2009","unstructured":"Mowbray A (2009) An examination of the European court of human rights\u2019 approach to overruling its previous case law. Hum Rights Law Rev 9(2):179\u2013201. https:\/\/doi.org\/10.1093\/hrlr\/ngp006","journal-title":"Hum Rights Law Rev"},{"key":"9361_CR20","unstructured":"Mullerat R (2008) US and EU legal professions: two lawyers separated by the same justice. Common law and civil law procedures compared. Jean Monnet\/Robert Schuman Paper Series 8(4):3\u201311"},{"key":"9361_CR21","unstructured":"Poudyal P, Savelka J, Ieven A, et\u00a0al (2020) ECHR: legal corpus for argument mining. In: Proceedings of the 7th workshop on argument mining. Association for computational linguistics, Online, pp 67\u201375"},{"key":"9361_CR22","unstructured":"Radford A, Wu J, Child R et al (2019) Language models are unsupervised multitask learners. Tech. rep, OpenAI, San Francisco, California, USA"},{"issue":"04","key":"9361_CR23","doi-asserted-by":"publisher","first-page":"961","DOI":"10.1142\/S0218213004001922","volume":"13","author":"C Reed","year":"2004","unstructured":"Reed C, Rowe G (2004) Araucaria: software for argument analysis, diagramming and representation. Int J Artif Intell Tools 13(04):961\u2013979. https:\/\/doi.org\/10.1142\/S0218213004001922","journal-title":"Int J Artif Intell Tools"},{"key":"9361_CR24","unstructured":"Reed C, Walton D (2001) Applications of argumentation schemes. In: Proceedings of the 4th conference of the Ontario society for the study of argument, pp 1\u201314"},{"key":"9361_CR25","doi-asserted-by":"crossref","unstructured":"R\u00fcthers B, Fischer C, Birk A (2022) Rechtstheorie und Juristische Methodenlehre, 12th edn. C. H, Beck, Munich, Germany","DOI":"10.17104\/9783406776243"},{"key":"9361_CR26","doi-asserted-by":"crossref","DOI":"10.1093\/law\/9780199594061.001.0001","volume-title":"The European convention on human rights: a commentary","author":"WA Schabas","year":"2015","unstructured":"Schabas WA (2015) The European convention on human rights: a commentary. Oxford University Press, Oxford UK"},{"key":"9361_CR27","doi-asserted-by":"publisher","unstructured":"Simpson E, Gurevych I (2019a) A Bayesian approach for sequence tagging with crowds. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for computational linguistics, Hong Kong, China, pp 1093\u20131104, https:\/\/doi.org\/10.18653\/v1\/D19-1101","DOI":"10.18653\/v1\/D19-1101"},{"key":"9361_CR28","doi-asserted-by":"publisher","unstructured":"Simpson E, Pfeiffer J, Gurevych I (2020) Low resource sequence tagging with weak labels. In: Proceedings of the AAAI conference on artificial intelligence, New York, USA, pp 8862\u20138869, https:\/\/doi.org\/10.1609\/aaai.v34i05.6415","DOI":"10.1609\/aaai.v34i05.6415"},{"key":"9361_CR29","doi-asserted-by":"publisher","unstructured":"Simpson ED, Gurevych I (2019b) A Bayesian approach for sequence tagging with crowds. In: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, pp 1093\u20131104, https:\/\/doi.org\/10.18653\/v1\/D19-1101","DOI":"10.18653\/v1\/D19-1101"},{"key":"9361_CR30","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/BF00118477","volume":"1","author":"DB Skalak","year":"1992","unstructured":"Skalak DB, Rissland EL (1992) Arguments and cases: an inevitable intertwining. Artif Intell Law 1:3\u201344. https:\/\/doi.org\/10.1007\/BF00118477","journal-title":"Artif Intell Law"},{"key":"9361_CR31","volume-title":"Argumentation mining","author":"M Stede","year":"2018","unstructured":"Stede M, Schneider J (2018) Argumentation mining, vol 11. Morgan & Claypool Publishers"},{"key":"9361_CR32","unstructured":"Steinberger R, Pouliquen B, Widiger A, et\u00a0al (2006) The JRC-Acquis: a multilingual aligned parallel corpus with 20+ languages. In: Proceedings of the 5th international conference on language resources and evaluation, LREC 2006. European Language Resources Association (ELRA), Genoa, Italy, pp 2142\u20132147"},{"key":"9361_CR33","volume-title":"The uses of argument","author":"SE Toulmin","year":"1958","unstructured":"Toulmin SE (1958) The uses of argument. Cambridge University Press, Cambridge, USA"},{"key":"9361_CR34","doi-asserted-by":"crossref","unstructured":"Trachtman JP (2013) The tools of argument: how the best lawyers think, argue, and win. Createspace Independent Publishing Platform","DOI":"10.2139\/ssrn.2302693"},{"key":"9361_CR35","unstructured":"Walton D (2012) Argument from fairness in judicial reasoning. In: Proceedings of the international conference on alternative methods of argumentation in law. Masaryk University, Brno, CZ, pp 117\u2013131"},{"key":"9361_CR36","unstructured":"Walton DN (1996) Argumentation schemes for presumptive reasoning. Lawrence Erlbaum Associates"},{"key":"9361_CR37","doi-asserted-by":"publisher","unstructured":"Wolf T, Debut L, Sanh V, et\u00a0al (2020) Transformers: state-of-the-art natural language processing. In: Proceedings of the 2020 conference on empirical methods in natural language processing: system demonstrations. Association for Computational Linguistics, Online, pp 38\u201345, https:\/\/doi.org\/10.18653\/v1\/2020.emnlp-demos.6","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"9361_CR38","doi-asserted-by":"publisher","unstructured":"Xu H, \u0160avelka J, Ashley KD (2020) Using argument mining for legal text summarization. In: Villata S, Hara\u0161ta J, K\u0159emen P (eds) Proceedings of the 33rd international conference on legal knowledge and information systems (JURIX 2020). IOS Press, Virtual event, pp 184\u2013193, https:\/\/doi.org\/10.3233\/FAIA200862","DOI":"10.3233\/FAIA200862"},{"issue":"2","key":"9361_CR39","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1007\/s10506-019-09242-3","volume":"27","author":"H Yamada","year":"2019","unstructured":"Yamada H, Teufel S, Tokunaga T (2019a) Building a corpus of legal argumentation in Japanese judgement documents: towards structure-based summarisation. Artif Intell Law 27(2):141\u2013170. https:\/\/doi.org\/10.1007\/s10506-019-09242-3","journal-title":"Artif Intell Law"},{"key":"9361_CR40","doi-asserted-by":"publisher","unstructured":"Yamada H, Teufel S, Tokunaga T (2019b) Neural network based rhetorical status classification for Japanese judgment documents. In: Araszkiewicz M, Rodr\u00edguez-Doncel V (eds) Proceedings of the 32nd international conference on legal knowledge and information systems (JURIX 2019). IOS Press, Madrid, Spain, pp 133\u2013142, https:\/\/doi.org\/10.3233\/FAIA190314","DOI":"10.3233\/FAIA190314"},{"key":"9361_CR41","doi-asserted-by":"publisher","unstructured":"Zheng L, Guha N, Anderson BR, et\u00a0al (2021) When does pretraining help? Assessing self-supervised learning for law and the CaseHOLD dataset of 53,000+ legal holdings. In: Proceedings of the eighteenth international conference on artificial intelligence and law. ACM, Virtual event, pp 159\u2013168, https:\/\/doi.org\/10.1145\/3462757.3466088","DOI":"10.1145\/3462757.3466088"}],"container-title":["Artificial Intelligence and Law"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-023-09361-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10506-023-09361-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-023-09361-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,22]],"date-time":"2024-10-22T21:35:39Z","timestamp":1729632939000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10506-023-09361-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,23]]},"references-count":41,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,9]]}},"alternative-id":["9361"],"URL":"https:\/\/doi.org\/10.1007\/s10506-023-09361-y","relation":{},"ISSN":["0924-8463","1572-8382"],"issn-type":[{"value":"0924-8463","type":"print"},{"value":"1572-8382","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,23]]},"assertion":[{"value":"16 May 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 June 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}