{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T15:58:02Z","timestamp":1765382282806,"version":"3.38.0"},"reference-count":42,"publisher":"China Science Publishing & Media Ltd.","issue":"2","license":[{"start":{"date-parts":[[2021,5,11]],"date-time":"2021-05-11T00:00:00Z","timestamp":1620691200000},"content-version":"vor","delay-in-days":130,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>In this paper we present the results of the Interactive Argument-Pair Extraction in Judgement Document Challenge held by both the Chinese AI and Law Challenge (CAIL) and the Chinese National Social Media Processing Conference (SMP), and introduce the related data set - SMP-CAIL2020-Argmine. The task challenged participants to choose the correct argument among five candidates proposed by the defense to refute or acknowledge the given argument made by the plaintiff, providing the full context recorded in the judgement documents of both parties. We received entries from 63 competing teams, 38 of which scored higher than the provided baseline model (BERT) in the first phase and entered the second phase. The best performing system in the two phases achieved accuracy of 0.856 and 0.905, respectively. In this paper, we will present the results of the competition and a summary of the systems, highlighting commonalities and innovations among participating systems. The SMP-CAIL2020-Argmine data set and baseline models\u2460 have been already released.<\/jats:p>","DOI":"10.1162\/dint_a_00094","type":"journal-article","created":{"date-parts":[[2021,5,11]],"date-time":"2021-05-11T23:42:07Z","timestamp":1620776527000},"page":"287-307","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":9,"title":["Overview of SMP-CAIL2020-Argmine: The Interactive Argument-Pair\n                    Extraction in Judgement Document Challenge"],"prefix":"10.3724","volume":"3","author":[{"given":"Jian","family":"Yuan","sequence":"first","affiliation":[{"name":"School of Data Science, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhongyu","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Data Science, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yixu","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Data Science, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Data Science, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yun","family":"Song","sequence":"additional","affiliation":[{"name":"Heilongjiang University, Heilongjiang 150080, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donghua","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinglei","family":"Ma","sequence":"additional","affiliation":[{"name":"China Judicial Big Data Institute, Beijing 100043, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhen","family":"Hu","sequence":"additional","affiliation":[{"name":"China Judicial Big Data Institute, Beijing 100043, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaokun","family":"Zou","sequence":"additional","affiliation":[{"name":"THUNISOFT Co., Ltd., Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Donghai","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuanjing","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"2026","published-online":{"date-parts":[[2021,6,2]]},"reference":[{"key":"2021091617272573100_ref1","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.2307\/797328","article-title":"Judicial history","volume":"108","author":"Vermeule","year":"1998","journal-title":"Yale Law\n                        Journal"},{"key":"2021091617272573100_ref2","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1007\/978-3-030-32381-3_45","article-title":"Automatic judgment prediction via legal reading\n                        comprehension","volume-title":"China National Conference on\n                        Chinese Computational Linguistics","author":"Long","year":"2019"},{"issue":"4","key":"2021091617272573100_ref3","doi-asserted-by":"crossref","first-page":"891","DOI":"10.2307\/1955796","article-title":"Predicting Supreme Court cases probabilistically: The search\n                        and seizure cases, 1962\u20131981","volume":"78","author":"Segal","journal-title":"American\n                        Political Science Review"},{"key":"2021091617272573100_ref4","first-page":"829","article-title":"Mathematical models for legal prediction","volume":"2","author":"Keown","year":"1980","journal-title":"Computer\/I J"},{"issue":"1","key":"2021091617272573100_ref5","doi-asserted-by":"crossref","first-page":"164","DOI":"10.2307\/1190728","article-title":"Quantitative analysis of judicial processes: Some practical\n                        and theoretical applications","volume":"28","author":"Ulmer","year":"1963","journal-title":"Law and Contemporary\n                        Problems"},{"key":"2021091617272573100_ref6","article-title":"Applying correlation analysis to case\n                        prediction","volume":"42","author":"Nagel","year":"1963","journal-title":"Texas Law Review"},{"issue":"5","key":"2021091617272573100_ref7","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1177\/0165551517722741","article-title":"A two-phase sentiment analysis approach for judgement\n                        prediction","volume":"44","author":"Liu","year":"2018","journal-title":"Journal of Information Science"},{"volume-title":"Exploring the use of text classification in the legal\n                        domain","year":"2017","author":"Sulea","key":"2021091617272573100_ref8"},{"issue":"4","key":"2021091617272573100_ref9","doi-asserted-by":"crossref","first-page":"e0174698","DOI":"10.1371\/journal.pone.0174698","article-title":"A general approach for predicting the behavior of the Supreme\n                        Court of the United States","volume":"12","author":"Katz","year":"2017","journal-title":"PLoS ONE"},{"key":"2021091617272573100_ref10","doi-asserted-by":"crossref","first-page":"46","DOI":"10.3115\/v1\/D14-1006","article-title":"Identifying argumentative discourse structures in persuasive\n                        essays","volume-title":"Proceedings of the 2014 Conference on\n                        Empirical Methods in Natural Language Processing (EMNLP)","author":"Stab","year":"2014"},{"key":"2021091617272573100_ref11","doi-asserted-by":"crossref","first-page":"6248","DOI":"10.18653\/v1\/P19-1629","article-title":"Discourse representation parsing for sentences and\n                        documents","volume-title":"Proceedings of the 57th Annual\n                        Meeting of the Association for Computational Linguistics","author":"Liu","year":"2019"},{"key":"2021091617272573100_ref12","first-page":"13","article-title":"Predicting thread discourse structure over technical web\n                        forums","volume-title":"Proceedings of the 2011 Conference on\n                        Empirical Methods in Natural Language Processing","author":"Wang","year":"2011"},{"key":"2021091617272573100_ref13","doi-asserted-by":"crossref","first-page":"525","DOI":"10.18653\/v1\/P16-2085","article-title":"Claim synthesis via predicate recycling","volume-title":"Proceedings of the 54th Annual Meeting of the Association for\n                        Computational Linguistics (Volume 2: Short Papers)","author":"Bilu","year":"2016"},{"key":"2021091617272573100_ref14","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3115\/1118253.1118262","article-title":"Using argumentation strategies in automated argument\n                        generation","volume-title":"INLG' 2000 Proceedings of the\n                        First International Conference on Natural Language Generation","author":"Zukerman","year":"2000"},{"key":"2021091617272573100_ref15","doi-asserted-by":"crossref","first-page":"109","DOI":"10.3115\/v1\/P15-4019","article-title":"End-to-end argument generation system in\n                        debating","volume-title":"Proceedings of ACL-IJCNLP 2015 System\n                        Demonstrations","author":"Sato","year":"2015"},{"key":"2021091617272573100_ref16","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/P18-1021","volume-title":"Neural argument generation augmented with externally retrieved\n                        evidence","author":"Hua","year":"2018"},{"key":"2021091617272573100_ref17","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/P18-1101","volume-title":"Unsupervised discrete sentence representation learning for\n                        interpretable neural dialog generation","author":"Zhao","year":"2018"},{"key":"2021091617272573100_ref18","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.18653\/v1\/D16-1193","article-title":"A neural approach to automated essay scoring","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural\n                        Language Processing","author":"Taghipour","year":"2016"},{"key":"2021091617272573100_ref19","doi-asserted-by":"crossref","first-page":"195","DOI":"10.18653\/v1\/P16-2032","article-title":"Is this post persuasive? Ranking argumentative comments in\n                        online forum","volume-title":"Proceedings of the 54th Annual\n                        Meeting of the Association for Computational Linguistics (Volume 2: Short\n                        Papers)","author":"Wei","year":"2016"},{"key":"2021091617272573100_ref20","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1145\/2872427.2883081","article-title":"Winning arguments: Interaction dynamics and persuasion\n                        strategies in good-faith online discussions","volume-title":"Proceedings of the 25th International Conference on World Wide\n                        Web","author":"Tan","year":"2016"},{"key":"2021091617272573100_ref21","doi-asserted-by":"crossref","first-page":"153","DOI":"10.18653\/v1\/K17-1017","article-title":"Attention-based recurrent convolutional neural network for\n                        automatic essay scoring","volume-title":"Proceedings of the 21st\n                        Conference on Computational Natural Language Learning (CoNLL 2017)","author":"Dong","year":"2017"},{"key":"2021091617272573100_ref22","doi-asserted-by":"crossref","first-page":"1589","DOI":"10.18653\/v1\/P16-1150","article-title":"Which argument is more convincing? Analyzing and predicting\n                        convincingness of web arguments using bidirectional LSTM","volume-title":"Proceedings of the 54th Annual Meeting of the Association for\n                        Computational Linguistics (Volume 1: Long Papers)","author":"Habernal","year":"2016"},{"key":"2021091617272573100_ref23","first-page":"3703","article-title":"Incorporating argument-level interactions for persuasion\n                        comments evaluation using co-attention model","volume-title":"Proceedings of the 27th International Conference on Computational\n                        Linguistics","author":"Ji","year":"2018"},{"volume-title":"Discrete argument representation learning for interactive argument\n                        pair identification","year":"2019","author":"Ji","key":"2021091617272573100_ref24"},{"key":"2021091617272573100_ref25","doi-asserted-by":"crossref","first-page":"7000","DOI":"10.18653\/v1\/2020.emnlp-main.569","article-title":"Argument pair extraction from peer review and rebuttal via\n                        multi-task learning","volume-title":"Proceedings of the 2020\n                        Conference on Empirical Methods in Natural Language Processing\n                        (EMNLP)","author":"Cheng","year":"2020"},{"issue":"1","key":"2021091617272573100_ref26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/1951767","article-title":"Predicting Supreme Court decisions mathematically: A\n                        quantitative analysis of the \u201cright to counsel\u201d\n                        cases","volume":"51","author":"Kort","year":"1957","journal-title":"The American Political Science\n                        Review"},{"issue":"4","key":"2021091617272573100_ref27","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1017\/S0003055412000469","article-title":"The Supreme Court's many median\n                        justices","volume":"106","author":"Lauderdale","year":"2012","journal-title":"American Political Science Review"},{"key":"2021091617272573100_ref28","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/D17-1289","volume-title":"Learning to predict charges for criminal cases with legal\n                        basis","author":"Luo","year":"2017"},{"volume-title":"CAIL2018: A large-scale legal dataset for judgment\n                        prediction","year":"2018","author":"Xiao","key":"2021091617272573100_ref29"},{"volume-title":"Overview of CAIL2018: Legal judgment prediction\n                    competition","year":"2018","author":"Zhong","key":"2021091617272573100_ref30"},{"volume-title":"CAIL2019-SCM: A dataset of similar case matching in legal\n                        domain","year":"2019","author":"Xiao","key":"2021091617272573100_ref31"},{"key":"2021091617272573100_ref32","first-page":"681","article-title":"Exploring phrase-based classification of judicial documents\n                        for criminal charges in Chinese","volume-title":"International\n                        Symposium on Methodologies for Intelligent Systems","author":"Liu","year":"2006"},{"key":"2021091617272573100_ref33","doi-asserted-by":"crossref","first-page":"3154","DOI":"10.18653\/v1\/2020.acl-main.287","article-title":"Analyzing the persuasive effect of style in news editorial\n                        argumentation","volume-title":"Proceedings of the 58th Annual\n                        Meeting of the Association for Computational Linguistics","author":"Baff","year":"2020"},{"volume-title":"BERT: Pre-training of deep bidirectional transformers for language\n                        understanding","year":"2018","author":"Devlin","key":"2021091617272573100_ref34"},{"volume-title":"Jieba Chinese word segmentation tool","author":"Sun","key":"2021091617272573100_ref35"},{"issue":"8","key":"2021091617272573100_ref36","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","journal-title":"Neural\n                        Computation"},{"key":"2021091617272573100_ref37","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1049\/cp:19991218","article-title":"Learning to forget: Continual prediction with\n                        LSTM","volume-title":"The Ninth International Conference on\n                        Artificial Neural Networks ICANN 99","author":"Gers","year":"1999"},{"volume-title":"Sentence-BERT: Sentence embeddings using Siamese\n                        BERT-Networks","year":"2019","author":"Reimers","key":"2021091617272573100_ref38"},{"volume-title":"RoBerta: A robustly optimized BERT pretraining approach","year":"2019","author":"Liu","key":"2021091617272573100_ref39"},{"volume-title":"ERNIE: Enhanced language representation with informative\n                        entities","year":"2019","author":"Zhang","key":"2021091617272573100_ref40"},{"key":"2021091617272573100_ref41","first-page":"2440","article-title":"End-to-end memory networks","volume-title":"Advances in Neural Information Processing Systems","author":"Sukhbaatar","year":"2015"},{"key":"2021091617272573100_ref42","first-page":"2980","article-title":"Focal loss for dense object detection","volume-title":"Proceedings of the IEEE International Conference on Computer\n                        Vision","author":"Lin","year":"2017"}],"container-title":["Data Intelligence"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/dint\/article-pdf\/3\/2\/287\/1963484\/dint_a_00094.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/dint\/article-pdf\/3\/2\/287\/1963484\/dint_a_00094.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,14]],"date-time":"2025-03-14T07:42:30Z","timestamp":1741938150000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.sciengine.com\/doi\/10.1162\/dint_a_00094"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":42,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6,2]]}},"URL":"https:\/\/doi.org\/10.1162\/dint_a_00094","relation":{},"ISSN":["2641-435X"],"issn-type":[{"type":"electronic","value":"2641-435X"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}