{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T11:55:30Z","timestamp":1777550130828,"version":"3.51.4"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T00:00:00Z","timestamp":1643068800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T00:00:00Z","timestamp":1643068800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Law"],"published-print":{"date-parts":[[2023,3]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper, we discuss previous research in automatic prediction of court decisions. We define the difference between outcome identification, outcome-based judgement categorisation and outcome forecasting, and review how various studies fall into these categories. We discuss how important it is to understand the legal data that one works with in order to determine which task can be performed. Finally, we reflect on the needs of the legal discipline regarding the analysis of court judgements.<\/jats:p>","DOI":"10.1007\/s10506-021-09306-3","type":"journal-article","created":{"date-parts":[[2022,1,25]],"date-time":"2022-01-25T08:02:31Z","timestamp":1643097751000},"page":"195-212","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":60,"title":["Rethinking the field of automatic prediction of court decisions"],"prefix":"10.1007","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2972-8447","authenticated-orcid":false,"given":"Masha","family":"Medvedeva","sequence":"first","affiliation":[]},{"given":"Martijn","family":"Wieling","sequence":"additional","affiliation":[]},{"given":"Michel","family":"Vols","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,1,25]]},"reference":[{"key":"9306_CR1","doi-asserted-by":"publisher","first-page":"e93","DOI":"10.7717\/peerj-cs.93","volume":"2","author":"N Aletras","year":"2016","unstructured":"Aletras N, Tsarapatsanis D, Preo\u0163iuc-Pietro D, Lampos V (2016) Predicting judicial decisions of the European Court of Human Rights: a natural language processing perspective. PeerJ Comput Sci 2:e93","journal-title":"PeerJ Comput Sci"},{"issue":"2","key":"9306_CR2","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/s10506-009-9077-9","volume":"17","author":"KD Ashley","year":"2009","unstructured":"Ashley KD, Br\u00fcninghaus S (2009) Automatically classifying case texts and predicting outcomes. Artif Intell Law 17(2):125\u2013165","journal-title":"Artif Intell Law"},{"key":"9306_CR3","unstructured":"Bertalan VGF, Ruiz EES (2020) Predicting judicial outcomes in the Brazilian legal system using textual features. In: DHandNLP@ PROPOR, pp 22\u201332"},{"key":"9306_CR4","doi-asserted-by":"crossref","unstructured":"Bex F, Prakken H (2021) On the relevance of algorithmic decision predictors for judicial decision making. In: Proceedings of the 19th international conference on artificial intelligence and law (ICAIL 2021). ACM Press","DOI":"10.1145\/3462757.3466069"},{"key":"9306_CR5","first-page":"326","volume":"6","author":"P Bhilare","year":"2019","unstructured":"Bhilare P, Parab N, Soni N, Thakur B (2019) Predicting outcome of judicial cases and analysis using machine learning. Int Res J Eng Technol (IRJET) 6:326\u2013330","journal-title":"Int Res J Eng Technol (IRJET)"},{"key":"9306_CR6","doi-asserted-by":"publisher","unstructured":"Chalkidis I, Androutsopoulos I, Aletras N (2019) Neural legal judgment prediction in English. In: Proceedings of the 57th annual meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Florence, Italy, pp 4317\u20134323. https:\/\/doi.org\/10.18653\/v1\/P19-1424. https:\/\/www.aclweb.org\/anthology\/P19-1424","DOI":"10.18653\/v1\/P19-1424"},{"key":"9306_CR7","unstructured":"Chalkidis I, Fergadiotis M, Malakasiotis P, Aletras N, Androutsopoulos I (2020) LEGAL-BERT: \u201cpreparing the muppets for court\u201d. In: Proceedings of the 2020 conference on empirical methods in natural language processing: findings, pp 2898\u20132904"},{"key":"9306_CR8","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1613\/jair.1.11377","volume":"66","author":"W Chao","year":"2019","unstructured":"Chao W, Jiang X, Luo Z, Hu Y, Ma W (2019) Interpretable charge prediction for criminal cases with dynamic rationale attention. J Artif Intell Res 66:743\u2013764","journal-title":"J Artif Intell Res"},{"key":"9306_CR9","doi-asserted-by":"crossref","unstructured":"Chen H, Cai D, Dai W, Dai Z, Ding Y (2019) Charge-based prison term prediction with deep gating network. arXiv preprint arXiv:1908.11521","DOI":"10.18653\/v1\/D19-1667"},{"key":"9306_CR10","doi-asserted-by":"crossref","unstructured":"Cheng X, Bi S, Qi G, Wang Y (2020) Knowledge-aware method for confusing charge prediction. In: CCF international conference on natural language processing and Chinese computing. Springer, pp 667\u2013679","DOI":"10.1007\/978-3-030-60450-9_53"},{"key":"9306_CR11","unstructured":"Collenette J, Atkinson K, Bench-Capon TJ (2020) An explainable approach to deducing outcomes in European Court of Human Rights cases using ADFs. In: COMMA, pp 21\u201332"},{"issue":"3","key":"9306_CR12","doi-asserted-by":"publisher","first-page":"396","DOI":"10.3390\/stats3030025","volume":"3","author":"C Condevaux","year":"2020","unstructured":"Condevaux C (2020) Neural legal outcome prediction with partial least squares compression. Stats 3(3):396\u2013411","journal-title":"Stats"},{"key":"9306_CR13","doi-asserted-by":"crossref","unstructured":"Dyevre A (2020) Text-mining for lawyers: how machine learning techniques can advance our understanding of legal discourse. Available at SSRN 3734430","DOI":"10.2139\/ssrn.3734430"},{"key":"9306_CR14","doi-asserted-by":"crossref","unstructured":"Fan Y, Zhang L, Wang P (2020) Leveraging label semantics and correlations for judgment prediction. In: China conference on information retrieval. Springer, pp 70\u201382","DOI":"10.1007\/978-3-030-56725-5_6"},{"key":"9306_CR15","doi-asserted-by":"crossref","unstructured":"Huang YX, Dai WZ, Yang J, Cai LW, Cheng S, Huang R, Li YF, Zhou ZH (2020) Semi-supervised abductive learning and its application to theft judicial sentencing. In: 2020 IEEE international conference on data mining (ICDM). IEEE, pp 1070\u20131075","DOI":"10.1109\/ICDM50108.2020.00127"},{"key":"9306_CR16","unstructured":"Jiang X, Ye H, Luo Z, Chao W, Ma W (2018) Interpretable rationale augmented charge prediction system. In: Proceedings of the 27th international conference on computational linguistics: system demonstrations, pp 146\u2013151"},{"issue":"4","key":"9306_CR17","doi-asserted-by":"publisher","first-page":"e0174698","DOI":"10.1371\/journal.pone.0174698","volume":"12","author":"DM Katz","year":"2017","unstructured":"Katz DM, Bommarito MJ II, Blackman J (2017) A general approach for predicting the behavior of the Supreme Court of the United States. PloS One 12(4):e0174698","journal-title":"PloS One"},{"issue":"3","key":"9306_CR18","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1017\/pan.2018.59","volume":"27","author":"AR Kaufman","year":"2019","unstructured":"Kaufman AR, Kraft P, Sen M (2019) Improving Supreme Court forecasting using boosted decision trees. Polit Anal 27(3):381\u2013387","journal-title":"Polit Anal"},{"key":"9306_CR19","unstructured":"Kaur A, Bozic B (2019) Convolutional neural network-based automatic prediction of judgments of the European Court of Human Rights. In: AICS, pp 458\u2013469"},{"key":"9306_CR20","doi-asserted-by":"crossref","unstructured":"Kowsrihawat K, Vateekul P, Boonkwan P (2018) Predicting judicial decisions of criminal cases from Thai Supreme Court using bi-directional GRU with attention mechanism. In: 2018 5th Asian conference on defense technology (ACDT). IEEE, pp 50\u201355","DOI":"10.1109\/ACDT.2018.8592948"},{"key":"9306_CR21","unstructured":"Lage-Freitas A, Allende-Cid H, Santana O, de\u00a0Oliveira-Lage L (2019) Predicting brazilian court decisions. arXiv preprint arXiv:1905.10348"},{"key":"9306_CR22","doi-asserted-by":"crossref","unstructured":"Li Y, He T, Yan G, Zhang S, Wang H (2019) Using case facts to predict penalty with deep learning. In: International conference of pioneering computer scientists. Springer, Engineers and Educators, pp 610\u2013617","DOI":"10.1007\/978-981-15-0121-0_47"},{"issue":"5","key":"9306_CR23","doi-asserted-by":"publisher","first-page":"594","DOI":"10.1177\/0165551517722741","volume":"44","author":"YH Liu","year":"2018","unstructured":"Liu YH, Chen YL (2018) A two-phase sentiment analysis approach for judgement prediction. J Inf Sci 44(5):594\u2013607","journal-title":"J Inf Sci"},{"key":"9306_CR24","doi-asserted-by":"crossref","unstructured":"Liu Z, Chen H (2017) A predictive performance comparison of machine learning models for judicial cases. In: 2017 IEEE symposium series on computational intelligence (SSCI). IEEE, pp 1\u20136","DOI":"10.1109\/SSCI.2017.8285436"},{"key":"9306_CR25","doi-asserted-by":"crossref","unstructured":"Long S, Tu C, Liu Z, Sun M (2019) Automatic judgment prediction via legal reading comprehension. In: China national conference on Chinese computational linguistics. Springer, pp 558\u2013572","DOI":"10.1007\/978-3-030-32381-3_45"},{"key":"9306_CR26","doi-asserted-by":"publisher","unstructured":"Luo B, Feng Y, Xu J, Zhang X, Zhao D (2017) Learning to predict charges for criminal cases with legal basis. In: Proceedings of the 2017 conference on empirical methods in natural language processing. Association for Computational Linguistics, Copenhagen, Denmark, pp 2727\u20132736. https:\/\/doi.org\/10.18653\/v1\/D17-1289. https:\/\/www.aclweb.org\/anthology\/D17-1289","DOI":"10.18653\/v1\/D17-1289"},{"key":"9306_CR27","doi-asserted-by":"crossref","unstructured":"Malik V, Sanjay R, Nigam SK, Ghosh K, Guha SK, Bhattacharya A, Modi A (2021) ILDC for CJPE: Indian legal documents corpus for court judgment prediction and explanation. arXiv preprint arXiv:2105.13562","DOI":"10.18653\/v1\/2021.acl-long.313"},{"key":"9306_CR28","doi-asserted-by":"crossref","unstructured":"Markovi\u0107 M, Gostoji\u0107 S (2018) Open judicial data: a comparative analysis. Soc Sci Comput Rev 38, 295-314","DOI":"10.1177\/0894439318770744"},{"key":"9306_CR29","unstructured":"Medvedeva M, Vols M, Wieling M (2018) Judicial decisions of the European Court of Human Rights: looking into the crystal ball. In: Proceedings of the conference on empirical legal studies"},{"key":"9306_CR30","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1007\/s10506-019-09255-y","volume":"28","author":"M Medvedeva","year":"2020","unstructured":"Medvedeva M, Vols M, Wieling M (2020a) Using machine learning to predict decisions of the European Court of Human Rights. Artif Intell Law 28:237\u2013266","journal-title":"Artif Intell Law"},{"key":"9306_CR31","doi-asserted-by":"crossref","unstructured":"Medvedeva M, Xu X, Wieling M, Vols M (2020b) Juri says: prediction system for the European Court of Human Rights. In: Legal knowledge and information systems: JURIX 2020: the thirty-third annual conference, Brno, Czech Republic, December 9-11, 2020. IOS Press, vol 334, p 277","DOI":"10.3233\/FAIA200883"},{"key":"9306_CR32","unstructured":"Medvedeva M, \u00dcstun A, Xu X, Vols M, Wieling M (2021) Automatic judgement forecasting for pending applications of the European Court of Human Rights. In: Proceedings of the fifth workshop on automated semantic analysis of information in legal text (ASAIL 2021)"},{"key":"9306_CR33","unstructured":"O\u2019Sullivan C, Beel J (2019) Predicting the outcome of judicial decisions made by the European Court of Human Rights. In: AICS 2019\u201427th AIAI Irish conference on artificial intelligence and cognitive science"},{"key":"9306_CR34","doi-asserted-by":"crossref","unstructured":"Petrova A, Armour J, Lukasiewicz T (2020) Extracting outcomes from appellate decisions in US State Courts. In: Legal knowledge and information systems: JURIX 2020: the thirty-third annual conference, Brno, Czech Republic, December 9-11, 2020. IOS Press, vol 334, p 133","DOI":"10.3233\/FAIA200857"},{"key":"9306_CR35","doi-asserted-by":"crossref","unstructured":"Quemy A, Wrembel R (2020) On integrating and classifying legal text documents. In: International conference on database and expert systems applications. Springer, pp 385\u2013399","DOI":"10.1007\/978-3-030-59003-1_25"},{"key":"9306_CR36","doi-asserted-by":"crossref","unstructured":"Sala\u00fcn O, Langlais P, Lou A, Westermann H, Benyekhlef K (2020) Analysis and multilabel classification of Quebec court decisions in the domain of housing law. In: International conference on applications of natural language to information systems. Springer, pp 135\u2013143","DOI":"10.1007\/978-3-030-51310-8_13"},{"key":"9306_CR37","doi-asserted-by":"crossref","unstructured":"Sert MF, Y\u0131ld\u0131rm E, \u0130rfan Ha\u015flak (2021) Using artificial intelligence to predict decisions of the Turkish Constitutional Court. Soc Sci Comput Rev","DOI":"10.1177\/08944393211010398"},{"key":"9306_CR38","doi-asserted-by":"publisher","first-page":"2393","DOI":"10.1016\/j.procs.2020.03.292","volume":"167","author":"RA Shaikh","year":"2020","unstructured":"Shaikh RA, Sahu TP, Anand V (2020) Predicting outcomes of legal cases based on legal factors using classifiers. Procedia Comput Sci 167:2393\u20132402","journal-title":"Procedia Comput Sci"},{"key":"9306_CR39","doi-asserted-by":"crossref","unstructured":"Sharma RD, Mittal S, Tripathi S, Acharya S (2015) Using modern neural networks to predict the decisions of Supreme Court of the United States with state-of-the-art accuracy. In: International conference on neural information processing. Springer, pp 475\u2013483","DOI":"10.1007\/978-3-319-26535-3_54"},{"key":"9306_CR40","unstructured":"Spaeth H, Epstein L, Ruger T, Whittington K, Segal J, Martin AD (2014) Supreme Court database code book"},{"key":"9306_CR41","doi-asserted-by":"crossref","unstructured":"Strickson B, De\u00a0La\u00a0Iglesia B (2020) Legal judgement prediction for UK courts. In: Proceedings of the 2020 the 3rd international conference on information science and system, pp 204\u2013209","DOI":"10.1145\/3388176.3388183"},{"key":"9306_CR42","unstructured":"Sulea OM, Zampieri M, Malmasi S, Vela M, Dinu LP, Van\u00a0Genabith J (2017a) Exploring the use of text classification in the legal domain. In: Proceedings of the 2nd workshop on automated semantic analysis of information in legal texts (ASAIL 2017)"},{"key":"9306_CR43","doi-asserted-by":"crossref","unstructured":"\u015eulea OM, Zampieri M, Vela M, van Genabith J (2017b) Predicting the law area and decisions of French Supreme Court cases. In: Proceedings of the international conference recent advances in natural language processing, RANLP 2017. INCOMA Ltd., Varna, Bulgaria, pp 716\u2013722","DOI":"10.26615\/978-954-452-049-6_092"},{"issue":"4","key":"9306_CR44","doi-asserted-by":"publisher","first-page":"427","DOI":"10.3390\/stats3040027","volume":"3","author":"G Tagny-Ngomp\u00e9","year":"2020","unstructured":"Tagny-Ngomp\u00e9 G, Mussard S, Zambrano G, Harispe S, Montmain J (2020) Identification of judicial outcomes in judgments: a generalized Gini-PLS approach. Stats 3(4):427\u2013443","journal-title":"Stats"},{"key":"9306_CR45","doi-asserted-by":"crossref","unstructured":"Tan H, Zhang B, Zhang H, Li R (2020) The sentencing-element-aware model for explainable term-of-penalty prediction. In: CCF international conference on natural language processing and Chinese computing. Springer, pp 16\u201327","DOI":"10.1007\/978-3-030-60457-8_2"},{"key":"9306_CR46","doi-asserted-by":"crossref","unstructured":"Vacek T, Schilder F (2017) A sequence approach to case outcome detection. In: Proceedings of the 16th edition of the international conference on artificial intelligence and law, pp 209\u2013215","DOI":"10.1145\/3086512.3086534"},{"key":"9306_CR47","doi-asserted-by":"crossref","unstructured":"Virtucio MBL, Aborot JA, Abonita JKC, Avinante RS, Copino RJB, Neverida MP, Osiana VO, Peramo EC, Syjuco JG, Tan GBA (2018) Predicting decisions of the Philippine Supreme Court using natural language processing and machine learning. In: 2018 IEEE 42nd annual computer software and applications conference (COMPSAC). IEEE, vol\u00a02, pp 130\u2013135","DOI":"10.1109\/COMPSAC.2018.10348"},{"key":"9306_CR48","doi-asserted-by":"crossref","unstructured":"Visentin A, Nardotto A, O\u2019Sullivan B (2019) Predicting judicial decisions: a statistically rigorous approach and a new ensemble classifier. In: 2019 IEEE 31st international conference on tools with artificial intelligence (ICTAI). IEEE, pp 1820\u20131824","DOI":"10.1109\/ICTAI.2019.00275"},{"issue":"4","key":"9306_CR49","doi-asserted-by":"publisher","first-page":"719","DOI":"10.54648\/ERPL2019040","volume":"27","author":"M Vols","year":"2019","unstructured":"Vols M (2019) European law and evictions: property, proportionality and vulnerable people. Eur Rev Priv Law 27(4):719\u2013752","journal-title":"Eur Rev Priv Law"},{"key":"9306_CR50","volume-title":"Legal research","author":"M Vols","year":"2021","unstructured":"Vols M (2021) Legal research. Eleven Publishing, The Hague"},{"key":"9306_CR51","doi-asserted-by":"crossref","unstructured":"Waltl B, Bonczek G, Scepankova E, Landthaler J, Matthes F (2017) Predicting the outcome of appeal decisions in Germany\u2019s tax law. In: International conference on electronic participation. Springer, pp 89\u201399","DOI":"10.1007\/978-3-319-64322-9_8"},{"key":"9306_CR52","doi-asserted-by":"publisher","unstructured":"Ye H, Jiang X, Luo Z, Chao W (2018) Interpretable charge predictions for criminal cases: learning to generate court views from fact descriptions. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long papers). Association for Computational Linguistics, New Orleans, Louisiana, pp 1854\u20131864. https:\/\/doi.org\/10.18653\/v1\/N18-1168. https:\/\/www.aclweb.org\/anthology\/N18-1168","DOI":"10.18653\/v1\/N18-1168"},{"key":"9306_CR53","doi-asserted-by":"crossref","unstructured":"Zhong H, Guo Z, Tu C, Xiao C, Liu Z, Sun M (2018a) Legal judgment prediction via topological learning. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp 3540\u20133549","DOI":"10.18653\/v1\/D18-1390"},{"key":"9306_CR54","unstructured":"Zhong H, Xiao C, Guo Z, Tu C, Liu Z, Sun M, Feng Y, Han X, Hu Z, Wang H et\u00a0al (2018b) Overview of cail2018: legal judgment prediction competition. arXiv preprint arXiv:1810.05851"}],"container-title":["Artificial Intelligence and Law"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-021-09306-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10506-021-09306-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10506-021-09306-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,28]],"date-time":"2023-01-28T15:02:23Z","timestamp":1674918143000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10506-021-09306-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,25]]},"references-count":54,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,3]]}},"alternative-id":["9306"],"URL":"https:\/\/doi.org\/10.1007\/s10506-021-09306-3","relation":{},"ISSN":["0924-8463","1572-8382"],"issn-type":[{"value":"0924-8463","type":"print"},{"value":"1572-8382","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,25]]},"assertion":[{"value":"7 November 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 January 2022","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}